Data Engineer

We are seeking a Data Engineer to build and operate the data platform spanning both network/operational (OSS) and business/commercial data. This role is responsible for owning data ingestion, storage, transformation, and serving processes, leveraging both streaming and batch data architectures. The successful candidate will ensure operational and commercial data are governed effectively while enabling reporting, analytics, and AI/ML initiatives across the organization.

Key Responsibilities:

· Build, develop, and deploy data ingestion and streaming pipelines using Apache Flink, CDC-based ingestion, AWS Glue Schema Registry, and in-stream validation processes. · Design and maintain raw, curated, and served data layers while optimizing query performance, storage costs, and data freshness. · Manage table maintenance, compaction, and partitioning strategies as data volumes increase. · Develop and maintain SQL transformation pipelines and dimensional data models. · Design schemas and implement ingestion and transformation logic for new data domains. · Implement and maintain data quality testing to ensure freshness, completeness, and schema conformance. · Build and maintain BI and reporting solutions including dashboards, ad hoc query capabilities, and scheduled reports. · Establish governed, high-quality datasets to support AI/ML initiatives such as predictive maintenance and capacity forecasting. · Document data models, pipeline architectures, and governance controls. · Collaborate with internal teams to gather requirements, validate assumptions, and deliver data solutions that meet business needs.

Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field, or equivalent professional experience.

A minimum of 4+ years of professional experience in data engineering, including both streaming and batch data pipeline development.

Preferred Qualifications:

…