Senior Data Engineer

📋 Description

• Work with solution architects, data architects, and application developers to gather data
• Collaborate with data scientists to develop and integrate statistical and forecasting algorithms
• Design, develop, and optimize data pipeline solutions scaling to multi-terabyte datasets in
• Assess and improve Spark performance in areas of memory management, caching strategies, and cluster
• Manage individual tasks and communicate updates to colleagues following an Agile Scrum methodology
• Mentor junior colleagues, providing guidance and support to help them grow professionally

🎯 Requirements

• Third level IT qualification or equivalent experience, with a solid foundation in mathematics
• 10+ years hands-on experience as an ETL/DWH developer with strong knowledge in designing
• Strong programming experience with Python, SPARK, and SQL
• Strong understanding of Spark execution plans and memory management
• Experience with Databricks cluster configuration, performance, and cost optimization strategies
• Customer focused with excellent communications skills (both oral and written)

🎁 Benefits

• Share in our success with our Quarterly Performance-Related Profit Share Scheme
• Strong Career Progression & mentorship coaching through our Strength in Balance &amp
• Flexible/remote working
• Financial Wellbeing initiatives including Pension, Private Healthcare Cover, Life Assurance
• Employee Wellbeing schemes including Gym Discounts, Bike to Work, Fitness classes, Mindfulness
• Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave