Senior Data Engineer

📋 Description

• Work with solution architects to gather data integration requirements
• Collaborate with data scientists to develop pipelines
• Design and optimize data pipelines for multi-terabyte datasets in Databricks
• Improve Spark performance: memory management, caching, resources
• Manage tasks and communicate updates in Agile Scrum
• Mentor junior colleagues and maintain documentation

🎯 Requirements

• Third level IT qualification or equivalent, strong math/statistics
• 10+ years ETL/DWH development experience
• Python, Spark, SQL proficiency
• Understanding of Spark execution plans and memory management
• Databricks cluster config, performance and cost optimization
• Customer-focused with strong communication

🎁 Benefits

• Flexible/remote working options
• Career progression and mentorship programs
• Pension and private healthcare benefits
• Wellbeing initiatives, gym discounts, and mental health support
• Training and certifications including AWS, Microsoft, Oracle, Red Hat
• Employee rewards and inclusive workplace culture