(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure

📋 Description

• Operate the provisioning state machine in production: own the health of the host lifecycle
• Triage and extend automated self-healing: when the node-scanning and remediation platform misses
• Own end-to-end reliability of the pipeline: hold the SLOs and error budgets for provisioning and
• Partner with the inference/ML platform team from the production side: be the one who knows how real
• Work alongside machine learning researchers, engineers, and product managers to bring our latest
• Introduce new techniques, tools, and architecture that improve the performance, latency

🎯 Requirements

• Experience operating a provisioning or host-lifecycle pipeline in production, comfortable
• Deep experience owning production reliability for large-scale distributed systems; GPU/ML-serving
• Hands-on experience troubleshooting InfiniBand/RDMA networking issues, ideally in a multi-node
• Familiarity with the operational realities of multi-tenant model serving (LoRA/adapter-based
• A demonstrated track record of eliminating operational toil through automation and tooling you
• Hands-on experience with Kubernetes controller/CRD patterns, reconciliation loops, and node-level

🎁 Benefits

• Competitive compensation
• Startup equity
• Health insurance
• Other competitive benefits