Senior AI Data Engineer

📋 Description

• Design and build scalable ETL/ELT and AI pipelines using Databricks, PySpark, Delta Lake and SQL.
• Develop and maintain Lakehouse architectures using Bronze, Silver and Gold data layers.
• Build and optimise Delta Live Tables, Databricks Workflows and job orchestration processes.
• Develop and deploy production-grade Generative AI and agent-based solutions.
• Create and maintain RAG pipelines and AI agent frameworks.
• Support MLOps activities, including model training and inference pipelines using MLflow.

🎯 Requirements

• Strong experience as Data Engineer, AI Engineer, or Machine Learning Engineer
• Hands-on experience with multi-agent workflows, RAG solutions, and AI agent frameworks
• Strong programming skills in Python and SQL
• Experience with Apache Spark and distributed data processing
• Experience with Databricks Lakehouse, Delta Lake, Unity Catalog, MLflow
• Experience with Azure Service Bus, Azure Functions, Azure Databricks

🎁 Benefits

• Quarterly performance-related profit share scheme
• Strong career progression and mentorship coaching
• Flexible/remote working
• Pension, private healthcare, life assurance
• Gym discounts, bike to work, fitness classes
• Educational assistance and incentivized certifications