Engineer, Inference

📋 Description

• Partner with frontier labs and providers to supply capacity, training and inference infrastructure.
• Shape Sierra's inference architecture, designing how inference traffic flows across models
• Build for low latency and high reliability with systems for routing, failover, capacity management
• Build and operate self-hosted inference on GPU infrastructure.
• Optimize inference performance with techniques such as speculative decoding and serving-engine
• Build across a hybrid inference stack with both Sierra-managed infrastructure and leading inference

🎯 Requirements

• Deep systems thinking and strong distributed systems fundamentals.
• Experience designing, building, and operating large-scale production systems.
• Strong judgment around tradeoffs involving latency, reliability, capacity, and cost.
• Experience taking ownership of complex infrastructure from architecture through production
• Excitement about applying systems expertise to AI infrastructure and learning quickly.
• Experience with ML infrastructure, MLOps, or production inference systems.

🎁 Benefits

• Flexible (unlimited) paid time off
• Medical, dental, and vision benefits for you and your family
• Life insurance and disability benefits
• Retirement plan dependent on country of employment
• Parental leave
• Fertility and family building benefits through Carrot