Staff Software Engineer, Inference / Compute Infrastructure Engineering

📋 Description

• Build the provisioning state machine for lifecycle management of physical hosts and GPUs.
• Create a self-service API and control plane to stand up, scale, and tear down inference clusters
• Automate self-healing: detect degraded nodes, drain, repair/replace, and reintroduce capacity
• Own reliability of the pipeline with idempotency, retries, rollback, and drift detection.
• Partner with the inference/ML platform team to encode cluster shapes as first-class platform
• Engineer like software: strong typing, automated tests, code reviews, versioning, and CI/CD for

🎯 Requirements

• Strong software engineering background in Go, Python, Rust, or similar.
• Experience with durable workflow orchestration tools (Temporal, Cadence, or equivalent).
• Experience building software control planes or orchestration systems that model state over time
• Experience with event-driven systems (message queues, event streams, pub/sub like Kafka, NATS, SQS).
• A product mindset; built internal platforms or APIs used by other engineering teams.
• Nice to have: exposure to bare-metal provisioning (PXE/iPXE, Redfish/IPMI, BMC) and