Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)

📋 Description

• Build realistic enterprise evaluation environments spanning connected applications, representative
• Own evaluation infrastructure, task suites, and automated graders that measure how well agents
• Analyze agent trajectories and production failures, identify root causes, and ship improvements
• Develop reusable skills and improve tool descriptions, schemas, and result handling so agents can
• Build and evaluate model-selection and routing strategies that match each task to the right model
• Improve agent efficiency through context management, skill loading, caching, and execution

🎯 Requirements

• 5+ years of software engineering or machine learning engineering experience, with a track record of
• Strong system design skills, including building reliable, scalable infrastructure for
• Strong proficiency in a backend language such as Python, Go, or Rust, and the ability to work
• Hands-on experience building, evaluating, or improving LLM-based applications or agents, including
• Deep expertise in at least one of the following: Evaluation infrastructure, benchmark design, and
• Strong experimental and statistical judgment, including choosing representative tasks, defining

🎁 Benefits

• Offers Equity
• Compensation Range: $220K – $405K per year