Principal Data Engineer, Data Quality & Datasets Pipelines

📋 Description

• Implement and iterate filtering, retention and offload policies across hot, cold, archive and
• Build the data movement and pipelines that our pre-ingestion selection model depends on
• Decide where and how selection models run, balancing compute cost against data value
• Build early, low-compute decision points that avoid expensive standardisation and enrichment of
• Work with the storage and data infra teams, and monitor data quality to make sure our datasets

🎯 Requirements

• Senior data or software engineer who has run data ingestion or data quality pipelines at petabyte
• Strong in Python and Spark, with cloud data engineering experience
• Good judgement on data filtering and quality, and know how to check you haven't discarded valuable
• Able to ship practical solutions quickly and are comfortable iterating on live systems
• Software engineer at heart, building the systems around models rather than the models themselves
• Enjoy working closely with data infra and storage teams

🎁 Benefits

• Salaries benchmarked against the market annually
• Meaningful equity, sharing in the ownership and long term success of Wayve
• Relocation support and visa sponsorship where applicable
• Hybrid working, core hours and the chance to work hands on in vehicle workshops and labs
• Learning and development budgets with support for training, conferences and growth
• Comprehensive benefits including health insurance, dental, enhanced maternity and paternity leave