Senior Director, Inference Products and Optimizations

📋 Description

• Lead, mentor, and grow the engineering team.
• Define and drive the roadmap for Inference Products.
• Architect and optimize the inference serving stack (vLLM, SGLang, LLM-D).
• Collaborate with product, eng, and stakeholders.
• Ensure production health and on-call readiness.
• Champion benchmarking, observability, and auto-tuning.

🎯 Requirements

• 10+ years software engineering
• 6+ years in technical leadership
• Distributed systems and AI/ML expertise
• Kubernetes at scale and LLM inference
• GPU architectures and optimization
• Product mindset and strong communication

🎁 Benefits

• Career development resources and courses
• Conference/training reimbursements
• LinkedIn Learning access
• Competitive global benefits and well-being programs
• Equity and Employee Stock Purchase Program
• Flexible time off and local meetups