Lead Data Platform Engineer - AWS, Spark

📋 Description

• Lead and support an agile technical team delivering data platform solutions for fraud-related data
• Help guide the delivery of AWS-based data pipelines, data lake components and producer-side data
• Support the handover, ownership, maintenance and enhancement of pipelines and cloud components
• Lead the team in building, testing and maintaining high-quality data pipelines from source systems
• Ensure metadata is prepared and published accurately so assets can be surfaced through the DAP
• Champion DevSecOps practices, CI/CD, Infrastructure as Code and cloud-native tooling to improve

🎯 Requirements

• Strong experience building data pipelines, data lake solutions or data platform capabilities.
• Strong experience with AWS cloud services relevant to data engineering and platform delivery
• Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD
• Strong experience developing on Apache Spark or Hadoop.
• Significant programming experience using Scala or Python.
• Experience with Configuration as Code principles and API integration.

🎁 Benefits

• Great compensation package and discretionary bonus plan
• Core benefits include pension, bupa healthcare, sharesave scheme and more
• 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional
• Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best