Lead Product Manager, Agent Runtime & Evals

📋 Description

• Own the vision, product strategy, and roadmap for the agent runtime platform, enabling
• Lead the development of agent lifecycle management capabilities, including version control
• Define and evolve evaluation and model governance frameworks, including golden datasets, data
• Establish evaluation mechanisms for AI agents that assess other agents, ensuring quality
• Shape agent memory, learning, and self-improvement capabilities, ensuring that agents can retain
• Lead the development of a model-agnostic platform, defining model routing, cost attribution, and

🎯 Requirements

• 7+ years of product management experience in B2B or enterprise SaaS environments, including at
• Proven experience owning complex products end to end, from product vision and strategy through
• Experience building and scaling AI agents or automation solutions that replace manual business
• Strong practical understanding of AI evaluation methodologies, including golden datasets, data
• Ability to work closely with engineering teams on technical concepts such as agent-to-workflow
• Strong understanding of how non-technical users build, configure, deploy, and supervise automated

🎁 Benefits

• Competitive compensation: US salary range of USD $200,000–$230,000+, with final compensation
• Equity: Opportunity to participate in the company's long-term growth through equity compensation.
• Comprehensive healthcare: Medical, dental, and vision coverage for employees and their families.
• Life insurance: Financial protection and additional security.
• Mental wellness: Coverage and resources to support mental health and overall well-being.
• Family support: Fertility benefits and support for growing families.