Research Engineering Manager, STEM

📋 Description

• Build and lead a team of research engineers, defining profiles, running hiring, and coaching on
• Set the team's operating rhythm including project selection, planning, experiment reviews, and
• Partner with research scientists to turn hypotheses into experiment plans and set the technical
• Own synthetic data pipelines that generate, verify, filter, deduplicate, and version data
• Judge data by its effect on models through ablations and fine-tuning or RL experiments
• Create new benchmarks and evaluations for capabilities current benchmarks miss, including

🎯 Requirements

• 8+ years of hands-on ML or research engineering, at least 5 in industry, including 3+ years
• Owned synthetic or curated data pipelines in production whose output drove training decisions
• Designed and shipped LLM evals or benchmarks that others used to make model decisions
• Strong Python; production experience with PyTorch or JAX; working knowledge of the post-training
• Track record of setting technical direction for a team
• Experience with distributed data processing and large evaluation or training jobs (e.g., Ray

🎁 Benefits

• Work directly with leading AI labs and enterprises at the frontier of post-training, evaluation
• Build datasets and benchmarks that improve and measure advanced AI systems
• Shape how frontier labs measure progress on coding and STEM reasoning
• Operate with high autonomy, rapid iteration, and meaningful commercial impact
• Collaborate with exceptional colleagues from organizations including Google, Meta, Amazon
• Contribute to research shared through technical publications and conferences such as ICLR, ICML