Engineering Manager, Foundation Model Inference (FMAPI)

📋 Description

• Lead and grow a product-minded infra engineering team for FM Inference and FM API.
• Own infra powering large-scale inference for partner models (OpenAI/Anthropic/Gemini) and self-hosted models.
• Shape the roadmap for real-time inference, provisioned throughput, and batch inference.
• Partner with product/engineering leadership to deliver reliable, high-quality capabilities.
• Build an inclusive, high-performing team that attracts and retains engineers.
• Maintain deep technical knowledge and uphold architecture, quality, and operational excellence.

🎯 Requirements

• Experience managing and growing high-performing software engineering teams.
• Strong technical judgment in distributed systems, platform infra, or AI/ML infra.
• Track record delivering complex, multi-quarter initiatives with quality and predictability.
• Experience partnering with product management and peer engineering to translate needs into roadmaps and outcomes.
• Operational rigor including service health, incident response, postmortems, and continuous improvement.
• BS in CS or related field; strong communication, coaching, and hiring skills.

🎁 Benefits

• Zone 1 Pay Range: $190,000 – $261,000 USD.
• Benefits vary by region; regional details are available via the company benefits docs.