Data Lake Studio Manager

We are looking for a proactive and technically skilled Data Lake Studio Manager to oversee and expand our Data Lake Studio workspace. This platform allows our customers—data engineers, analysts, and business teams—to easily transfer data across diverse storage systems and coordinate intricate data pipelines from start to finish.

In this role, you will be responsible for the operational success, feature adoption, and reliability of our Studio platform. You will ensure users can easily set up connectors for cross-storage data transfers. You will build and schedule automated ETL/ELT workflows, monitor job execution, and provide transparency into data movement across cloud, on-premises, and object storage systems.

Key Responsibilities

• Data Transfer & Storage Coordination
• Direct the Studio’s data movement suite, maintaining high efficiency, reduced latency, and consistent reliability for batch and streaming transfers across multiple storage platforms (e.g., S3, ADLS, GCS, HDFS, relational databases, and data warehouses).
• Coordinate connector connectivity, throughput efficiency, error-handling mechanisms, and schema evolution during cross-storage data migrations and replication tasks.
• Drive self-service ingestion frameworks, allowing customers to easily register new data sources and targets without manual infrastructure setup.

2. Workflow Orchestration & Pipeline Management

• Take responsibility for the operational health and user experience of the pipeline orchestration engine within the Studio (e.g., DAG-based scheduling, event-driven triggers, dependency management).
• Define standards and guidelines for customer pipeline development, ensuring fault tolerance, automatic retry policies, and backfilling capabilities.
• Maintain pipeline observability, providing customers with comprehensive monitoring dashboards, real-time logging, and configurable alerting for job failures or bottlenecks.

3. Customer Enablement & Platform Operations

…