Software Engineer, ML Training Performance

📋 Description

• Design, implement, and operate cutting-edge ML training performance optimization techniques —
• Work on RL framework and RL performance optimization for driving foundation model
• Profile and debug training throughput bottlenecks across the compute, compiler, framework, and
• Collaborate closely with ML researchers, data engineers, and hardware engineers to define
• Implement custom kernels and build benchmarks to track and validate training-performance

🎯 Requirements

• 4+ years of total experience, including 2+ years working on large-scale model training platforms.
• Experience with distributed training frameworks (Megatron-LM, TorchTitan), efficiently utilizing
• Experience with RL framework such as Verl/MILES and RL algorithms(GRPO, PPO)
• Experience with collective communication libraries (e.g., NCCL) and optimizing
• Experience using profiling tools (NVIDIA Nsight, PyTorch Profiler, or XLA/JAX profiling) to
• Proficient in Python or C++.

🎁 Benefits

• Paid time off (e.g. sick leave, vacation, bereavement)
• Unpaid time off
• Zoox Stock Appreciation Rights
• Amazon RSUs
• Health insurance
• Long-term care insurance