Technical Program Manager, Inference

📋 Description

• Own the programs that scale Claude’s serving fleet across accelerator and cloud platforms, from
• Drive new capacity online end to end, working across compute, infrastructure, security, networking
• Build visibility into supply, demand, and utilization with capacity and finance partners, and drive
• Lead reliability programs and large migrations without disrupting production traffic or research
• Drive the programs that make inference engineers faster: define the productivity metrics that
• Coordinate roadmaps and priorities across the production, research, and safeguards needs that

🎯 Requirements

• 7+ years of experience as a TPM, or in an equivalent engineering or SRE lead role, owning large
• Technical fluency in large-scale serving infrastructure, including request routing and load
• A working understanding of how LLM inference uses hardware (prefill and decode, batching, caching
• A track record of building program mechanisms from scratch on ambiguous, fast-moving efforts, and
• The ability to drive outcomes across organizations you don't manage, with competing priorities and
• Strong written communication, including plans, reviews, and executive updates that many teams

🎁 Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space in which to collaborate with colleagues
• Visa sponsorship (we do sponsor visas, every reasonable effort, retain an immigration lawyer)