Senior Data Engineer, Data Lake

We're looking for a Data Engineer at the Analyst level to join our Data Lake team. You'll build and maintain data ingestion and transformation pipelines using Spark, Databricks, and Airflow, contributing to the reliability and quality of the corporate data lake. This is an intermediate role where you'll work under moderate supervision on defined tasks while building deeper expertise in lakehouse architecture.

At Pismo, the Data Lake team is responsible for centralizing and organizing data into a single, trusted platform that supports decision-making across the company and for external clients. We work on challenges such as scaling global data infrastructure, delivering high-quality reporting, and enabling secure, self-service access to data—helping teams move faster while avoiding information silos.

What You'll Do :

• Develop, test, and maintain data pipelines (ingestion, transformation, quality checks) using PySpark/SparkSQL on Databricks .
• Build and modify Airflow DAGs (MWAA) for pipeline orchestration.
• Write and optimize SQL queries for data transformation and validation.
• Support data quality by implementing and monitoring quality checks (Great Expectations or equivalent).
• Participate in code reviews — both giving and receiving feedback.
• Investigate pipeline failures and data quality issues with guidance from senior engineers.
• Write and maintain documentation for datasets and pipelines you build.
• Participate in sprint planning, estimation, and retrospectives.
• Follow CI/CD, testing, and governance standards defined by the team.

This is a remote position. A remote position does not require job duties be performed within proximity of a Visa office location. Remote positions may be required to be present at a Visa office with scheduled notice. #LI‑Remote

For this role, you must be based in Brazil

Language Skills

• Proficiency in English at B2 level or above (Upper-Intermediate)

Basic Qualifications

…