Senior Software Engineer, Data and Orchestration

Added
5 hours ago
Type
Full time
Salary
Salary not provided

Related skills

python kubernetes airflow spark apache kafka

๐Ÿ“‹ Description

  • Designing, building and evolving scalable data pipeline and orchestration infrastructure for
  • Revamping the existing Harness system and developing a new DAG-based workflow platform
  • Building tooling and libraries that make data ingestion, processing, inference and evaluation
  • Making sure the platform runs hundreds of parallel pipeline steps efficiently, with correct
  • Supporting batch inference and performance optimisation workflows, so teams can run evaluations in
  • Improving platform reliability, quality and usability, including incident response workflows

๐ŸŽฏ Requirements

  • Strong software engineering fundamentals and solid Python programming skills, with experience
  • Experience building or operating DAG-based workflow orchestration and data pipeline systems, using
  • Experience with distributed computing frameworks such as Ray or Spark
  • Experience working with systems at scale, ideally involving distributed systems, large data volumes
  • Experience deploying and operating production workloads on Kubernetes, including troubleshooting
  • Familiarity with distributed event streaming platforms such as Apache Kafka

๐ŸŽ Benefits

  • Salaries benchmarked against the market annually
  • Meaningful equity, sharing in the ownership and long term success of Wayve
  • Relocation support and visa sponsorship where applicable
  • Hybrid working, core hours and the chance to work hands on in vehicle workshops and labs
  • Learning and development budgets with support for training, conferences and growth
  • Comprehensive benefits including health insurance, dental, enhanced maternity and paternity leave

๐Ÿšš Relocation support

๐Ÿ›ƒ Visa sponsorship

Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’