Partner closely with ServiceNow AI platform and product teams to understand, implement, validate
Identify gaps in platform evaluation capabilities and drive the definition and development of
Establish Eval-Driven Development as a standard engineering practice—moving AI quality from
Identify gaps where OOTB Evals don't adequately measure enterprise AI quality.
Define and drive custom metrics, rubrics, datasets and evaluation strategies.
Develop reusable Evals for domain-specific behaviors and business outcomes.

🎯 Requirements

Experience in leveraging or critically thinking about how to integrate AI into work processes
10+ years of experience in Product Management roles, with a focus on AI.
A technically strong Product Manager who combines: AI/LLM expertise + Evaluation Science + Quality
Experience with LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability
ServiceNow AI Platform experience is a huge plus.

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Get alerts for new remote engineering jobs

A weekly email with new matches. Unsubscribe anytime.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot