Build the provisioning state machine to model full lifecycle of a physical host to run inference
Design self-service APIs and a control plane to stand up, scale, or tear down clusters via API
Automate self-healing: detect degraded nodes, repair or replace, and rebalance capacity.
Own reliability of the provisioning pipeline with idempotency, retries, and drift detection.
Partner with inference/ML platform teams to encode cluster shapes as abstractions.
Engineer infrastructure code with strong typing, tests, versioning, and CI/CD.

🎯 Requirements

Strong software engineering background in Go, Python, Rust, or similar.
Experience with durable workflow orchestration tools (Temporal, Cadence, or equivalent).
Experience building software control planes or orchestration systems (Kubernetes
Experience with event-driven systems (Kafka, NATS, SQS) rather than polling scripts.

🎁 Benefits

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot