Lead Product Data Scientist, Agents

📋 Description

• Own agent measurement end to end across Composer and Customer Agent, developing comprehensive
• Define what successful agent performance looks like by partnering with Product and Engineering to
• Build scalable agent evaluation frameworks by combining conversation data, agent traces, tool-call
• Measure causal impact and incremental value through experimentation and advanced statistical
• Connect agent performance to business strategy by partnering with Finance and Product teams to
• Establish trusted metrics and analytical standards by defining consistent measurement

🎯 Requirements

• 10+ years of experience in data science, product analytics, applied statistics, or a related
• Deep expertise in product measurement, experimentation, statistical modeling, and causal inference.
• Experience evaluating AI systems in production, including designing evaluation frameworks
• Highly proficient in SQL and Python or R, with experience developing production-quality analytical
• AI-first approach to work, actively leveraging coding agents, LLMs, and emerging tools while
• Demonstrated technical leadership in setting direction on complex analytical initiatives and

🎁 Benefits

• Base salary range $172,000–$258,000 USD
• Annual cash bonus plan
• Equity
• Sign-on payments
• Comprehensive health, welfare, and wellbeing benefits