Engineering Manager, Serving/API

📋 Description

• Lead, coach, hire, and develop engineers working across API serving, tokenization, structured
• Establish and maintain a clear technical and organizational roadmap covering API compatibility
• Own API fidelity, including OpenAI-compatible behavior, HTTP endpoints, request validation
• Lead support for reasoning models, including reasoning formats, reasoning-effort controls, token
• Partner with compiler and execution teams on speculative decoding, including draft-model
• Define and lead the roadmap for vision-language model support and interoperability with modern

🎯 Requirements

• Demonstrated success managing and growing engineering teams responsible for LLM inference, model
• Strong systems engineering background with expertise in C++ and working proficiency in Python
• Proven ability to turn ambiguous product and customer requirements into coherent roadmaps, clear
• Experience recruiting, coaching, developing, and retaining engineers across different levels of
• Strong understanding of LLM serving concepts, including tokenization, chat templates, sampling
• Hands-on understanding of tool calling, function-calling formats, structured output, and the

🎁 Benefits

• Base salary range of $225,000–$350,000, with final compensation determined by experience
• Competitive equity as part of the total compensation package.
• Fully company-paid medical, dental, and vision insurance for employees and dependents.
• Company-paid life and disability insurance, with voluntary supplemental coverage options.
• Supplemental hospital, critical illness, and accident insurance options.
• Unlimited paid time off, with an emphasis on taking meaningful time to rest and recharge.