Staff+ Software Engineer, ML Inference Path

📋 Description

• Design and build scalable ML infrastructure to support real-time safety deployments across our
• Build monitoring and observability tools to track classifier performance, data quality, and system
• Collaborate with research teams to productionize safety research, translating experimental safety
• Optimize inference latency and throughput for real-time safety evaluations while maintaining high
• Implement automated testing, deployment, and rollback systems for ML models in production safety
• Partner with Safeguards, Security, and Alignment teams to understand requirements and deliver

🎯 Requirements

• 5+ years of experience building production ML infrastructure, ideally in safety-critical domains
• Proficient in Python
• Experience with ML frameworks like PyTorch, TensorFlow, or JAX
• Understanding of distributed systems principles
• Experience building systems that handle high-throughput, low-latency workloads
• Experience with automated or self-service deployment pipelines and eval infrastructure

🎁 Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space in which to collaborate with colleagues