Lead Product Manager, Agent Platform

📋 Description

• Set the direction for agents across Pylon and get product, engineering, and operations aligned on
• Own the roadmap for the platform’s core pieces, like tools, orchestration, context and memory
• Make it much faster for internal teams to go from an idea to an agent running in production, and
• Treat evals as a product of their own. Teams should have shared datasets, benchmarks, and
• Own how external agents work with Pylon, including MCP servers, APIs, scoped permissions, rate
• Make sure we can trace and explain every action an agent takes. We’d rather design for regulators

🎯 Requirements

• 4+ years as a product manager. An engineering background is a plus
• You’ve owned and scaled a developer platform, infrastructure product, or API used by several
• You’ve shipped LLM-based agents or agent tooling to production and know your way around tool use
• You know evals well, including golden datasets, evals, LLM-as-judge, and regression testing, and
• You understand retrieval, including RAG, embeddings, vector databases, chunking, hybrid search, and
• You understand the tradeoffs between prompt and context engineering, model choice, and fine-tuning