Senior/Staff Software Engineer, ML Training Performance

📋 Description

• Lead the design, implementation, and operation of training performance optimizations
• Own the technical strategy and multi-quarter roadmap for RL framework and RL performance
• Drive profiling and root-cause analysis of throughput bottlenecks across the compute, compiler
• Partner with ML researchers, data engineers, and hardware engineers to define requirements and make
• Build custom kernels and benchmarks that track and validate performance gains across the stack.
• Mentor engineers and raise the team’s technical bar through design reviews and best practices.

🎯 Requirements

• 7+ years of total experience, including 4+ years on large-scale model training platforms, with a
• Deep experience with distributed training frameworks (Megatron-LM, TorchTitan) and efficiently
• Experience with RL frameworks (Verl/MILES) and algorithms (GRPO, PPO).
• Experience with collective communication libraries (e.g., NCCL) and optimizing
• Strong command of profiling tools (NVIDIA Nsight, PyTorch Profiler, or XLA/JAX profiling) to find
• Proficiency in Python or C++.