Staff Software Engineer (AI Evals)

Added
2 days ago
Type
Contract
Salary
Upgrade to Premium to se...

Related skills

rust javascript python go typescript

๐Ÿ“‹ Description

  • Evaluate AI-generated coding interactions end-to-end
  • Judge whether outputs are useful, correct (at a high level), and aligned with how a strong engineer
  • Assess the quality of explanations and reasoning, not just code
  • Distinguish between different levels of response quality (e.g., what makes something a 2 vs 4)
  • Provide clear, opinionated feedback on what worked, what didn't, and what felt 'off' or misleading
  • Help define what great looks like when interacting with tools like Cursor

๐ŸŽฏ Requirements

  • Staff / Principal-level engineer (or equivalent experience)
  • Strong background in one of: Go, Python, Rust, TypeScript / JavaScript
  • Hands-on experience using OpenAI Codex, Claude Code, Cursor
  • Deep familiarity with modern AI-assisted dev workflows
  • Able to evaluate code without needing to fully execute or deeply review every line
  • Comfortable giving direct, opinionated feedback

๐ŸŽ Benefits

  • $100โ€“$200/hour
  • 20-40 hrs/week
  • Start ASAP
  • Through October with possible extensions
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’