Data Engineer, Data Quality & Provenance

📋 Description

• Design, build and operate scalable batch and streaming pipelines for multimodal fleet and
• Create data models, catalogs, indexes and query capabilities that make sensor, vehicle-state, map
• Build versioned, reproducible datasets for training, evaluation, replay, scenario mining and safety
• Develop robust workflows for data ingestion, synchronisation, transformation, curation, labelling
• Partner with autonomy, ML, simulation and safety engineers to define schemas, APIs and data
• Establish strong standards for lineage, observability, access controls, retention and cost

🎯 Requirements

• Strong hands-on Python and SQL skills, with solid production software-engineering fundamentals
• Experience designing and operating large-scale distributed data systems, beyond small-scale
• Hands-on experience with distributed processing and workflow orchestration technologies, such as
• Experience building and operating cloud-based data platforms using object storage, including data
• Proven ownership of data quality, lineage, observability, reproducibility and incident response for
• Experience translating ambiguous requirements from ML, data-science, robotics or similarly