Senior Staff Software Engineer

📋 Description

• Own eval strategy and roadmap: prompt set design, scoring methodology, failure-mode taxonomy, and
• Coordinate across the multiple teams contributing to Build Agent to arbitrate quality standards and
• Lead model benchmarking efforts, making data-backed recommendations on model support decisions
• Solve ambiguous, cross-cutting problems where eval signal, model capability, and platform

🎯 Requirements

• Direct experience building or leading evaluation systems for LLM-based products — scoring
• Understanding of coding agent architecture: tool use, agentic loops, context management, and the
• 6+ years of experience with technologies relevant to ServiceNow, including advanced coding skills
• Experience critically evaluating foundation models — distinguishing real capability differences
• Ability to execute against ambiguous priorities, weighing context, risk, and desired outcomes —

🎁 Benefits

• Equity (when applicable)
• Variable/incentive compensation
• Health plans including flexible spending accounts
• 401(k) Plan with company match
• ESPP
• Matching donations