Staff/ Principal Software Engineer (L6/L7): AI Platform Model Serving

📋 Description

• Lead platform architecture and technical strategy
• Build high-performance inference infrastructure
• Optimize GPU utilization and inference economics
• Develop intelligent model-serving capabilities
• Advance asynchronous and agentic workloads
• Drive technical innovation and research

🎯 Requirements

• Bachelor's, master's, or doctoral degree in Computer Science, Applied Mathematics, Engineering, or
• Extensive experience designing and operating high-traffic distributed services, high-performance
• Demonstrated success building and scaling inference platforms for machine learning and foundation
• Strong understanding of latency and throughput optimization, resource allocation, GPU/CPU
• Practical experience with model-serving platforms and runtimes such as NVIDIA Triton Inference
• Experience deploying and scaling AI workloads using Kubernetes and public cloud platforms such as

🎁 Benefits

• Competitive compensation: Annual salary range of $890,000–$1,690,000, depending on location
• Flexible compensation structure: Compensation is primarily salary-based, without annual bonuses.
• Comprehensive healthcare: Access to health plans, mental health support, health savings accounts
• Retirement planning: 401(k) retirement plan with employer matching.
• Equity opportunities: Stock option program offering eligible employees an opportunity to
• Family and personal protection: Family-forming benefits, disability programs, life insurance, and