Senior Python Engineer - LLM Code Evaluation

Added
10 days ago
Type
Contract
Salary
Upgrade to Premium to se...

Related skills

javascript python typescript llm cursor

📋 Description

  • Evaluate AI-generated coding interactions end-to-end
  • Judge whether outputs are useful, correct (at a high level), and aligned with how a strong engineer
  • Assess the quality of explanations and reasoning, not just code
  • Distinguish between different levels of response quality (e.g., what makes something a 2 vs 4)
  • Provide clear, opinionated feedback on what worked, what didn’t, and what felt “off” or misleading
  • Help define what great looks like when interacting with tools like Cursor

🎯 Requirements

  • Staff / Principal-level engineer (or equivalent experience)
  • Strong background in TypeScript / JavaScript or Python
  • Hands-on experience using OpenAI Codex, Claude Code, and Cursor
  • Deep familiarity with modern AI-assisted dev workflows
  • Able to evaluate code without needing to fully execute or deeply review every line
  • Comfortable giving direct, opinionated feedback
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →