ML Researcher - Evaluations

📋 Description

• Develop signal-driven evals: translate needs into measurable metrics.
• Own the evaluation infra: build and scale Python pipelines and data.
• Explore external benchmarks for tabular data and pipelines.
• Maintain competitive baselines: track models against state-of-the-art.
• Manage internal leaderboard: report results to the team.

🎯 Requirements

• Proven experience in ML, data science, or AI engineering focused on model evaluation.
• Strong Python skills and pandas experience.
• Solid ML metrics knowledge and evaluation of foundation model outputs.
• Experience building automated testing pipelines or evaluation harnesses.
• Excellent internal communication; translate requirements into metrics.
• Experience translating real-world problems into quantifiable metrics.

🎁 Benefits

• Competitive compensation with salary and equity
• Comprehensive health coverage for you and your dependents
• Paid parental leave for all new parents, incl. adoptive/surrogate journeys
• Relocation support for employees joining in one of our office locations
• Mission-driven, low-ego culture that values diversity of thought and action