Research Engineer / Scientist, Data & Evals

📋 Description

• Build synthetic data pipelines that generate, filter, and curate training and evaluation samples
• Design evaluations and verifiers that reflect real legal work, calibrate them against expert
• Build and maintain capability benchmarks like our Legal Agent Benchmark (LAB), along with
• Work with legal domain experts to define quality metrics, rubrics, and other grading mechanisms for
• Own training and evaluation data quality, including provenance, coverage, and safeguards against
• Close the loop from product usage and customer feedback to new evaluations and training data, so

🎯 Requirements

• Experience building data pipelines, ML evaluation systems, or experimentation tooling, with strong
• A rigorous approach to measurement, including statistical reasoning, experimental design, and
• The ability to translate ambiguous goals or expert judgment into structured datasets, rubrics, and
• Experience with synthetic data, LLM evaluations, automated raters, or preference data is a plus.