Staff Technical Product Manager – AI Evaluation

Added
10 hours ago
Type
Full time
Salary
Salary not provided

Related skills

ai ci/cd observability evaluation llm
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now →

📋 Description

  • Lead and scale AI Evaluation as a core engineering capability across the DT organization.
  • Partner with ServiceNow AI platform and product teams to drive adoption of out-of-the-box Evals and
  • Define custom Evals, metrics, rubrics, datasets, and evaluation strategies for enterprise AI apps
  • Embed Evals into the full AI lifecycle: Define → Measure → Build → Evaluate → Improve → Release →
  • Establish Eval-based quality gates and enable continuous evaluation in production.

🎯 Requirements

  • Experience in leveraging AI in work processes and solving real problems with AI-powered tools.
  • 10+ years in Product Management with a focus on AI.
  • Technically strong PM combining AI/LLM expertise, evaluation science, quality engineering, product
  • Experience with LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability
  • ServiceNow AI Platform experience is a plus.

🎁 Benefits

  • Note: Benefits information is typically provided in the official job posting or Careers page; refer
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →