Software Engineer, Agent Eval Platform

Added
7 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

grpc python go airflow opentelemetry
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now β†’

πŸ“‹ Description

  • Execute multi-turn agent scenarios end-to-end
  • Implement scheduling, retries, high-concurrency execution, run isolation at production scale
  • Manage versioned specs, datasets, and reports with run-to-run comparison
  • Consolidate one-off eval workflows into a single orchestration service
  • Establish reliability floor and SLO for the harness
  • Enable self-serve evals for teams

🎯 Requirements

  • 0-2 years building production backend or infrastructure systems
  • Strong in Python or Go (ideally both)
  • Experience designing and operating systems handling real traffic at scale
  • Comfort making a non-deterministic system measurable
  • Comfort with ambiguity; these are novel problems without textbook solutions
  • Experience in at least 3 of: distributed systems (idempotency, delivery guarantees, isolation

🎁 Benefits

  • Base pay $113,500 - $175,900
  • Equity (when applicable)
  • Variable/incentive compensation
  • Health plans including flexible spending accounts
  • 401(k) Plan with company match
  • ESPP (Employee Stock Purchase Plan)
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’