Software Engineer, Model Evaluation and Improvement

📋 Description

• Build datasets for evaluating and improving frontier models, turning complex scientific data into
• Analyze model failure modes, running experiments across frontier models to understand where they
• Build scalable data infrastructure, creating pipelines that curate, transform, and validate large
• Collaborate with frontier AI labs, helping develop and evaluate new approaches for improving models
• Work closely with scientists, translating expert judgment into problems and evaluation criteria

🎯 Requirements

• 2+ years at the intersection of biology and AI, with experience evaluating and improving scientific
• Experience building with LLMs, with an intuition for where current models excel, where they
• Curiosity and excitement about frontier AI, with a desire to understand and push the capabilities
• Comfort working on ambiguous problems, where the playing field is rapidly shifting and the right
• Collaborative mindset, able to work closely with engineers, scientists, and external research
• Desire to work in a fast-paced environment, where priorities can shift and rapid experimentation is