Databricks Data Engineer - Senior

Added
14 hours ago
Type
Full time
Salary
Salary not provided

Related skills

etl python databricks pyspark delta lake

πŸ“‹ Description

  • The role focuses on reconstructing, optimizing, and validating data pipelines aligned with
  • Rebuild legacy data warehouse pipelines using Databricks, PySpark, and Spark SQL per
  • Implement bronze, silver, and gold data layers following Medallion architecture and ingestion
  • Execute migration waves by business domain while coexisting legacy and new platforms until cutover.
  • Develop data transformations and automate testing across pipelines.
  • Collaborate with engineers to improve data quality, reliability, and delivery processes.

🎯 Requirements

  • 5+ years in Data Engineering roles.
  • Advanced proficiency in PySpark and Python for large-scale batch pipelines, testing, and standards.
  • Strong SQL for complex transformations and data modeling.
  • Hands-on Databricks and Delta Lake experience with production workflows and Lakehouse patterns.
  • Experience migrating/rebuilding ETL pipelines from legacy systems to Spark-based solutions with CDC
  • Knowledge of AWS data services (S3, Glue, EMR, Athena, Lambda, DMS, Step Functions) and Azure

🎁 Benefits

  • Opportunity to work on large-scale data modernization and Lakehouse initiatives.
  • Remote work flexibility within Brazil.
  • Exposure to Databricks, Delta Lake, Spark, AWS, and Azure.
  • Collaborate with experienced engineers on high-impact data projects.
  • Professional growth through AI, cloud, and data engineering practices.
  • Tech-driven environment focused on innovation and continuous learning.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’