Senior Research Scientist, Agent Evaluation

Added
7 days ago
Type
Full time
Salary
Salary not provided

Related skills

python machine learning prompt engineering benchmarking llm

๐Ÿ“‹ Description

  • Design evaluation methodologies and benchmarks for agent reasoning, planning, tool use
  • Take problems from research question to prototype to shipped feature, owning them end to end
  • Build and harden the pipelines and scoring logic behind customer-facing evaluation
  • Curate synthetic and real-world datasets; measure the evaluator itself for consistency and

๐ŸŽฏ Requirements

  • 5+ years in ML, applied AI, prompt engineering, agentic AI, including shipping something real to
  • Strong Python skills
  • Practical depth in agentic AI and context engineering: planning, reasoning, memory, tool use
  • Experience designing evaluation methodologies, not just running evaluations
  • Hands-on production work with LLM APIs โ€” prompt engineering, structured output, cost and latency
  • Clear communication with technical and non-technical audiences

๐ŸŽ Benefits

  • Flexible work persona
  • Equal opportunity employer
  • Accommodations for candidates
  • Export control regulations compliance
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’