User Researcher, AI Evaluations

Added
2 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

ux research quantitative llms measurement rubrics

๐Ÿ“‹ Description

  • Define "good" via reusable evaluation criteria reflecting user expectations.
  • Run longitudinal and feature studies to measure experience quality.
  • Anchor evals in real workflows across the user journey.
  • Identify failure modes and recovery across the system.
  • Collaborate with product, design, engineering, and data science to scale evaluation.

๐ŸŽฏ Requirements

  • Turn soft user expectations into concrete rubrics and metrics.
  • AI fluency; reason about model behavior and work with DS/ML partners.
  • Clear communication; align partners and drive product impact with insights.
  • Strong UX research craft (quant + qual) with method mix.
  • Pragmatic in fast-moving environments; balance speed and depth.
  • 5+ years UX research in industry.

๐ŸŽ Benefits

  • Competitive compensation, equity, and benefits.
  • Hybrid work with in-office days (Mon/Tue/Thu) in SF or NYC.
  • Cross-functional collaboration across product, design, eng, and data science.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Product Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Product Jobs

See more Product jobs โ†’