Researcher, AI Evaluations

Added
7 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

ai research statistics quantitative research evaluation
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now →

📋 Description

  • Own evaluation research for priority AI Research workstreams. Define quality criteria, design
  • Build rubrics, representative evaluation datasets, benchmarks, and quality thresholds that reflect
  • Work with AI Research and Modeling Platform engineers to integrate validated methods into
  • Explain quality, failure patterns, and uncertainty. Recommend actions that guide model selection
  • Validate automated graders against human ratings, including LLM-as-judge methods that use a large
  • Connect user research with AI Research’s model development work. Share reusable methods, review

🎯 Requirements

  • 7+ years of experience in research, applied research, or a related field, with a proven track
  • Hands-on experience evaluating AI products, with demonstrated ability to translate evaluation
  • Expertise in designing human evaluations, scoring rubrics, datasets, and benchmarks, including
  • Strong qualitative and quantitative research skills, with the ability to analyze data, interpret
  • Excellent problem-solving and stakeholder management skills, with the ability to navigate

🎁 Benefits

  • Equity
  • Health, dental, and vision coverage
  • Retirement benefits with company contributions
  • Parental leave and reproductive or family planning support
  • Mental health and wellness benefits
  • Paid time off
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs →