Senior Data Engineer - Databricks

📋 Description

• Design, develop, maintain, and optimize scalable data pipelines using Databricks, PySpark, Delta
• Integrate data from diverse sources, including APIs, relational databases, files, and other
• Build and maintain robust data ingestion and transformation processes aligned with the Medallion
• Collaborate with business and analytics teams to understand data requirements and deliver solutions
• Ensure the quality, reliability, security, and governance of ingested and processed data throughout
• Apply modern DataOps practices, including code versioning, automated data testing, CI/CD pipelines

🎯 Requirements

• Proven experience designing, developing, and managing large-scale data pipelines using Databricks
• Strong programming skills in Python and SQL for data processing, transformation, and pipeline
• In-depth understanding of ETL/ELT frameworks, data warehousing concepts, and distributed data
• Hands-on experience with modern DataOps practices, including Git version control, CI/CD pipelines
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform and their associated
• Strong problem-solving and analytical skills, with the ability to troubleshoot and optimize data

🎁 Benefits

• Health and dental insurance.
• Meal and food allowances.
• Childcare assistance.
• Extended paternity leave.
• Access to gyms and health and wellness professionals through Wellhub (Gympass) and TotalPass
• Profit Sharing and Results Participation (PLR).