Senior Staff Software Engineer - AI/ML Inference Engineering

📋 Description

• Lead the architecture, optimization, and operational excellence of our AI inference platform
• Own the end-to-end inference lifecycle—from onboarding cutting-edge models to deploying optimized
• Architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide

🎯 Requirements

• Experience with Go or Python, OOP, Design Patterns, time and space-efficient algorithms
• Experience with model-serving and runtime like vLLM, TensorRT-LLM, Triton Inference Server
• Exposure to LLM APIs or ML-serving systems
• Experience building new products that use challenging algorithms
• Knowledge of core AI/ML techniques and algorithms
• Experience with unit testing, profiling, and code tuning

🎁 Benefits

• Base pay of $201,300 - $352,300
• Equity (when applicable)
• Variable/incentive compensation
• Health plans including flexible spending accounts
• 401(k) Plan with company match
• ESPP