Product & Research Operations Manager, Human Data

📋 Description

• Design and implement workforce structure across languages and skill tiers.
• Build capacity models to support continuous eval pipelines and data production workflows.
• Own relationships with vendors (annotation firms, contractors); negotiate rates and SLAs.
• Decide build/buy/hybrid workforce models; benchmark cost and regional performance.
• Design multi-layer QA systems with self-checks, peer review, and audits.
• Define and track inter-rater reliability and annotator performance distributions.

🎯 Requirements

• 5+ years in operations, workforce management, or data annotation systems
• Experience managing large contractor or vendor-based workforces
• Proven ability to scale operations from zero to production
• Systems thinking with the ability to design scalable operational frameworks
• Strong analytical skills with metrics like inter-rater reliability and throughput
• Ability to execute quickly under ambiguity with attention to quality and edge cases

🎁 Benefits

• Health Insurance for you and family
• Parental leave: 9 weeks paternity; 12 weeks maternity
• 401(k) plan
• Commuter Allowance
• Flexible PTO
• Meals & Snacks
• Your own personal Yoshi