Senior Technical Product Manager - AI Agents, Evals & Reliability

📋 Description

• Define end-to-end requirements for AI-powered systems, connecting model capabilities and technical
• Translate model performance, data limitations, evaluation results, and user feedback into clear
• Partner closely with ML, backend, mobile, and other engineering teams on architecture, system
• Establish and continuously improve evaluation frameworks spanning offline metrics, online
• Make informed trade-offs across product quality, reliability, latency, cost, speed of execution
• Drive execution through clear product specifications, disciplined prioritization, strong technical

🎯 Requirements

• Strong foundation in computer science fundamentals, including algorithms, data structures, and
• Solid understanding of machine learning fundamentals and how modern AI systems behave in production
• Significant experience owning complex, technically sophisticated products from strategy through
• Hands-on experience with AI-powered products, particularly LLM-based systems, model evaluation
• Strong intuition for AI limitations and failure modes, including hallucinations, bias, model drift
• Ability to read, review, and discuss technical design documents and confidently collaborate with

🎁 Benefits

• Opportunity to shape AI products designed to deliver practical value to billions of potential users.
• High-ownership role within a small, high-talent-density, hands-on team.
• Significant influence over AI product strategy, system behavior, evaluation, and reliability.
• Close collaboration with experienced ML, backend, mobile, and product engineering professionals.
• Fast-paced environment emphasizing rapid iteration, thoughtful experimentation, and high-quality
• Opportunity to work on challenging problems involving AI agents, long-running workflows