Staff Software Engineer, Inference / Compute Infrastructure Engineering

📋 Description

• Build provisioning state machine for host lifecycle from discovery to decommission.
• Build a self-service API/control plane for one-call cluster provisioning.
• Automate self-healing: detect degraded nodes, drain, repair, and reintroduce capacity.
• Own pipeline reliability: idempotency, retries, rollback, drift detection.
• Partner with ML platform to encode cluster shapes as abstractions.
• Engineer infrastructure like software: typing, tests, reviews, and CI/CD.

🎯 Requirements

• Strong software engineering background in Go, Python, Rust, or similar.
• Experience with durable workflow orchestration tools like Temporal, Cadence, or equivalent.
• Experience building software control planes or orchestration systems (Kubernetes controllers/operators, etc.).
• Experience with event-driven systems using message queues or streams (Kafka, NATS, SQS).
• A product mindset; internal platforms or APIs used by other teams.
• Nice to have: bare-metal provisioning or GPU infrastructure familiarity.

🎁 Benefits

• Startup equity
• Health insurance
• Other competitive benefits