Agent Reliability Engineer, GTM

📋 Description

• Monitor production health across every graph, catching errors, slow runs, expensive runs, and
• Triage incoming issues from Slack, tickets, and rep reports, fixing small things directly and
• Run the weekly eval suite, investigate failures, and turn real production bugs into permanent
• Track cost and latency by model, graph, use case, and role, and recommend concrete changes to model
• Track usage and adoption per rep and per feature, and own the weekly health report the team runs on
• Build the business metrics that show leadership what the agent is worth, from reply rates and

🎯 Requirements

• Strong production Python and SQL, comfortable working in traces, logs, and warehouse tables
• Real experience running LLM applications, including tracing, evals, and prompt and cache mechanics
• SRE or production operations instincts: percentiles, SLOs, and separating noise from real pattern
• Healthy skepticism about metrics; you check what a number actually counts before you publish it
• Clear writing, and interest in publishing what you learn
• High agency; you notice what's missing and take initiative to build it

🎁 Benefits

• Medical, dental, and vision coverage
• Flexible vacation
• 401(k) plan
• Meals on in-office days in the US