Senior Staff Software Engineer - AI/ML Inference Engineering

📋 Description

• Lead the architecture, optimization, and operational excellence of our AI inference platform
• Own the end-to-end inference lifecycle—from onboarding cutting-edge models to deploying optimized
• Architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide
• Deploy, scale, and operate services in production Kubernetes environments, including Helm-based
• Own observability for what you build—meaningful metrics, useful logs, real tracing, and alerts that
• Debug and resolve production incidents independently, participate in on-call, run root-cause

🎯 Requirements

• Expertise in Go or Python, OOP, Design Patterns, time and space-efficient algorithms
• Model-serving and runtime experience, such as vLLM, TensorRT-LLM, Triton Inference Server
• Exposure to LLM APIs or ML-serving systems, or a clear ability to ramp up quickly
• Experience building new products that use challenging algorithms
• Expertise in coding efficient, object-oriented, modularized and quality software
• Knowledge of core AI/ML techniques and algorithms

🎁 Benefits

• Base pay of $201,300 - $352,300
• Equity (when applicable)
• Variable/incentive compensation
• Health plans including flexible spending accounts
• 401(k) Plan with company match
• ESPP (Employee Stock Purchase Plan)