Research Engineer / Research Scientist, RL Frontiers

📋 Description

• Study how RL training and sampling scale with model size, context length, and compute, and find the
• Develop next-generation model architectures and RL algorithms, and make them run efficiently at
• Take promising small-scale results to frontier-scale runs, and diagnose why they behave differently
• Build the experimental infrastructure that sets research velocity: fast, reproducible comparisons
• Own end-to-end performance of our largest RL runs, from research code down to the hardware
• Build performance and cost models for proposed architecture and algorithm changes, and use them to

🎯 Requirements

• Deep familiarity with modern transformer language models, including their architecture, training
• Hands-on experience training large models in a distributed setting, including the tradeoffs between
• A track record of original technical work in ML training or systems, such as new methods
• Ability to design rigorous experiments at scale, including baselines, ablations, and enough
• Ability to reason quantitatively about the compute, memory, and communication costs of a model or
• Strong programming skills in Python and JAX or PyTorch, and comfort reading and changing code at

🎁 Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Visa sponsorship available (we make every reasonable effort)
• Retain an immigration lawyer to assist with visa process