Databricks Data Engineer | Senior

📋 Description

• Design, develop, implement, and continuously improve data engineering solutions using the
• Define and implement scalable data architectures based on Lakehouse principles and the Medallion
• Develop, optimize, and maintain data pipelines using Databricks, PySpark, Spark SQL, Apache Spark
• Implement data ingestion, processing, and integration solutions, including Change Data Capture
• Build and manage data pipeline orchestration and system integrations using Azure Data Factory (ADF).
• Develop REST APIs, microservices, and automation solutions using Python.

🎯 Requirements

• Extensive professional experience delivering and maintaining production-grade data engineering
• Advanced proficiency in PySpark, Spark SQL, Delta Lake, and Apache Spark.
• Hands-on experience with Delta Live Tables (DLT) / Lakeflow Spark Declarative Pipelines, Change
• Strong knowledge of Liquid Clustering, Auto Loader, and Delta table optimization techniques.
• Advanced understanding of Unity Catalog, including data governance, security, lineage, and access
• Proven experience designing and implementing scalable data architectures, particularly Lakehouse

🎁 Benefits

• Food and/or meal vouchers
• Medical and dental insurance coverage
• Health insurance for your pet
• Home office allowance for remote positions
• Onboarding welcome kit
• Life insurance