Define how the products you own should work, build a measurement framework and evaluation systems
Run continuous evaluation of products from the end user's perspective
Build data pipelines and tooling including ingestion, conflation, entity resolution, quality checks
Track and evaluate external datasets, models, and benchmarks from published research
Design feedback loops to improve the products
Design the boundary between a model and its tools

🎯 Requirements

Bachelor's degree in STEM and 5+ years of software engineering experience
2+ years shipping LLM-backed features
Direct experience designing evaluations for non-deterministic systems
SQL and experience with distributed processing pipeline
Fluency with tool calling and agent orchestration
Working knowledge of multiple agent harnesses

🎁 Benefits

Hybrid/Remote options
Country-specific care and coverage
Family-first support
Lifestyle spending account
Balance & brainpower
Rest & recharge

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot