Staff Technical Product Manager – AI Quality and Evaluation

Added
12 hours ago
Type
Full time
Salary
Salary not provided

Related skills

ai ci/cd evaluation llm platform strategy

📋 Description

  • Establish and scale AI Evaluation as a core engineering capability
  • Lead Eval-driven development across AI lifecycle
  • Define platform eval strategy and adoption with AI teams
  • Identify gaps and define custom Evals, metrics, rubrics
  • Create reusable Evals for domain-specific outcomes
  • Embed Evals into development, regression, and release workflows

🎯 Requirements

  • 10+ years in Product Management with AI focus
  • Technically strong PM with AI/LLM, Evaluation Science, Quality Engineering, Platform Strategy
  • Experience with LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability
  • Experience with developer platforms; ServiceNow AI Platform a plus
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →