Data Scientist, Inference Capacity Optimization

📋 Description

• Build statistical and ML models to optimize GPU utilization, latency, and throughput.
• Develop forecasting models for inference demand across products, regions, and models.
• Analyze production workloads to identify latency bottlenecks and capacity constraints.
• Partner with Capacity Systems Engineering for infrastructure planning and GPU investments.
• Design experiments and simulations to evaluate scheduling and serving strategies.
• Build dashboards and metrics to enable data-driven capacity decisions.

🎯 Requirements

• MS/PhD in Statistics/CS/OR/Applied Math/Economics or equivalent.
• 5+ years in infrastructure data science.
• Strong expertise in Python and SQL.
• Experience building forecasting, optimization, or predictive models.
• Strong understanding of experimentation, statistical inference, and causal analysis.
• Experience communicating insights to executive stakeholders.