Engineering Manager, Inference Infrastructure

📋 Description

• Own the technical roadmap for how the inference fleet is coordinated — where traffic goes, where
• Partner with the product, inference engine, performance, and capacity teams to identify throughput
• Build the group's habit of quantitative modeling: claim a win only when you can measure it, and
• Set technical strategy for how the control plane evolves across heterogeneous hardware, across
• Run the group's operational backbone — on-call rotations, incident response, postmortem review
• Create clarity at a seam: this group sits between the API surface, the inference engines, capacity

🎯 Requirements

• Engineering management experience leading teams on critical-path production infrastructure at scale
• A deep systems background — load balancing, scheduling, cluster orchestration, autoscaling
• Experience shipping performance or efficiency improvements in large-scale systems, and the ability
• Experience running production infrastructure with real operational stakes: on-call, incident
• A results-oriented, impact-driven approach, and comfort working in a space where throughput
• Ability to build strong relationships across team boundaries — this is a seam role, and much of the

🎁 Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space in which to collaborate with colleagues