Human Data Evals Lead (Remote/US/LATAM)

Added
25 minutes ago
Type
Contract
Salary
Salary not provided

Related skills

llms quality control ground truth data proposals multi-model evaluation

๐Ÿ“‹ Description

  • Own data initiatives and proposals to AI labs, from data proposal to pilot delivery.
  • Build frontier-grade sample packages across reasoning, coding, agents, and tools.
  • Collaborate with subject-matter experts; include expert-verified ground truth.
  • Create multi-model headroom results and robust QC for buyer scrutiny.
  • Design samples that demonstrate quality and convert pilots to production.
  • Lead pilot delivery as the operational center of the Human Data Division.

๐ŸŽฏ Requirements

  • 5+ years in technical delivery, quality, or program management with AI/ML data.
  • Hands-on experience delivering data or evaluation work to AI labs or enterprise ML teams.
  • Fluent with frontier-model evaluation: benchmarks, rubrics, headroom, and discrimination.
  • Proven people/vendor leadership; recruited and calibrated expert pools.
  • fluent English; Spanish is nice to have.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’