Staff + Senior Software Engineer, Inference Deployment

📋 Description

• Own deployment orchestration moving inference builds into production across GPU/TPU/Trainium fleets.
• Improve capacity-aware deployment scheduling to maximize throughput under constrained accelerator budgets.
• Extend deployment observability with dashboards showing running code, commit location, and validation status.
• Drive down merge-to-production cycle time with pipelines that maximize parallelism.
• Optimize rollout strategies for large-scale deployments across thousands of accelerator chips with minimal disruption.
• Evolve self-service model onboarding for adding new models to the continuous deployment pipeline without Launch Engineering.

🎯 Requirements

• Strong software engineering skills, including experience designing systems that manage complex state machines and multi-stage pipelines
• Proficiency with Kubernetes-based deployments, rolling update mechanics, and container orchestration
• Experience building deployment, release, or delivery infrastructure where resource constraints (fleet capacity, network bandwidth, hardware availability, coordinated rollout windows) shape the design
• A track record of building automation that measurably improves deployment velocity and reliability
• Comfort working across the stack — from backend services and databases to CLI tools and web UIs
• Strong communication skills and the ability to work closely with oncall engineers, model teams, and infrastructure partners

🎁 Benefits

• Competitive benefits package
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space