Program Manager, Human Evaluations (Recommendations)

📋 Description

• Lead human evaluation and data operations initiatives from initial scoping and planning through
• Partner with Product Management to translate recommendation strategies and roadmap priorities into
• Coordinate cross-functional stakeholders across Product, Machine Learning, Data Science, UX
• Track project progress, manage dependencies, anticipate risks, and proactively resolve bottlenecks
• Ensure evaluation programs support continuous improvements in recommendation relevance, diversity
• Develop clear, scalable evaluation guidelines, scoring rubrics, and assessment protocols that

🎯 Requirements

• At least 4 years of experience in human evaluation, data collection, data labeling, annotation
• Demonstrated success leading complex, cross-functional programs from planning through delivery
• Experience managing external annotation vendors, human raters, or data-labeling teams, including
• Strong understanding of evaluation methodologies, scoring rubrics, annotation guidelines, and
• Proven ability to improve annotation program efficiency, including throughput, turnaround time
• Working familiarity with film and television content, including genres, formats, talent, and the

🎁 Benefits

• Annual salary range of $230,000–$360,000, depending on location, experience, skills, and relevant
• Flexible compensation structure: opportunity to choose annual mix of salary and stock options; no
• Comprehensive healthcare: health insurance plans and mental health support.
• Retirement benefits: 401(k) plan with employer matching.
• Equity opportunities: access to a stock option program.
• Financial protection: disability coverage, HSAs, FSAs, life and serious injury benefits.