Senior Research Scientist, STEM

📋 Description

• Identify high-impact gaps in existing benchmark and evaluation literature.
• Design novel benchmarks in and across STEM fields and on general model functionality.
• Develop evaluations for emerging model capabilities that are poorly captured by traditional static
• Design rigorous task-generation, grading, contamination-control, difficulty-calibration, and
• Build benchmarks that can become both valuable research contributions and meaningful standards for
• Develop methods for generating high-quality synthetic STEM training data.

🎯 Requirements

• PhD or equivalent research experience in machine learning, computer science, mathematics, physics
• Demonstrated ability to formulate and execute original research.
• Strong understanding of modern LLMs and the frontier AI research landscape.
• Excellent experimental design, quantitative reasoning, and scientific judgment.
• Ability to rapidly understand unfamiliar technical literature and develop expertise in new areas.
• Strong Python skills and the ability to independently build research prototypes and evaluation

🎁 Benefits

• Work at the frontier of AI, helping the world’s leading AI labs improve their most advanced models
• Contribute to leading-edge AI research and showcase your work at top conferences such as ICLR
• Bring frontier AI innovation to the enterprise, applying lessons learned from leading AI labs to
• Collaborate with and learn from exceptional colleagues with deep AI experience from Google, Meta
• Move at the pace of AI innovation, with the speed, ownership, and impact of a startup.