Senior Product Manager

📋 Description

• Own the overall charter for Evals & Quality, defining the long-term problem, success metrics
• Define and improve core quality metrics, including first-pass-right performance, evaluation
• Own the methodology for evaluating creative quality, including quality rubrics and calibration
• Design and manage scalable human quality-control processes, determining where human review adds
• Own the golden dataset, including its curation, representativeness across formats and client
• Build reusable evaluation loops that enable product and engineering teams to evaluate new

🎯 Requirements

• Demonstrated experience owning a quality, evaluation, experimentation, or ML measurement product
• Proven experience defining and measuring quality in a subjective or complex domain where there is
• Hands-on understanding of golden datasets, evaluation rubrics, judge calibration, human review
• Ability to identify weaknesses in measurement systems and develop practical approaches to improve
• Strong product discovery skills, including the ability to understand customer needs, learn
• Experience owning metrics that have influenced decisions outside your immediate team or function.

🎁 Benefits

• Paid time off: 25 days of PTO plus public holidays, within a flexible time-off framework.
• Healthcare: Health insurance and private medical coverage.
• Wellness and development: Monthly stipend supporting wellness, fitness, and learning and
• Remote work: Work remotely from anywhere within your home country.
• Flexible hours: Flexible working hours designed to support different working styles and schedules.
• Parental support: Enhanced parental leave policies covering birth, adoption, and surrogacy.