Senior Data Engineer

📋 Description

• Migrate on-prem/legacy data to AWS Lakehouse (Databricks/Snowflake)
• Design low-latency pipelines for real-time betting data
• Implement data quality, validation, and audit controls
• Develop streaming/micro-batch solutions with Kinesis, Kafka, or MSK
• Build pipelines with S3, Glue, Lambda, Athena, Redshift, Lake Formation
• Support regulatory reporting with data lineage for UK Gambling Commission

🎯 Requirements

• AWS data engineering expertise
• Real-time streaming with Kinesis, Kafka (MSK)
• Python, SQL, Spark
• dbt tests and Great Expectations
• Terraform / AWS CDK for IaC
• Azure Data Factory / Synapse or GCP Dataflow / BigQuery familiarity beneficial

🎁 Benefits

• Flexible working, hybrid/remote options
• Office hubs in Edinburgh, Leeds, Manchester, London, Bulgaria
• Growth opportunities and supportive culture
• Travel to client sites when needed