Senior Data Engineer

📋 Description

• Work with analysts and stakeholders to understand source systems, data flows, business processes
• Design, build and maintain ETL/ELT pipelines in Azure Databricks using Python, PySpark and SQL.
• Implement bronze, silver and gold data layers, covering raw data ingestion, cleansing, validation
• Develop curated datasets and dimensional models, and make them available through Microsoft Fabric
• Implement incremental processing and manage schema changes, duplicates, missing values and
• Provide technical guidance and mentoring, lead code and design reviews, and support consistent

🎯 Requirements

• 7+ years of experience in data engineering, including designing, building, deploying and supporting
• Strong Python and SQL skills, with strong hands-on experience using PySpark and Spark SQL in Azure
• Experience with Microsoft Fabric, particularly making curated data available for reporting through
• Good understanding of data warehousing and dimensional modelling, including table grain, facts
• Experience orchestrating and monitoring data pipelines.
• Experience with automated testing, data validation, Git and CI/CD practices.

🎁 Benefits

• Competitive salary package
• Share plan
• Company performance bonuses
• Value-based recognition awards
• Referral bonus
• Career coaching