Python Senior Software Engineer, AI Training

📋 Description

• Evaluate AI-generated coding interactions from beginning to end, assessing their overall quality
• Determine whether AI outputs are useful, technically sound, and aligned with the reasoning and
• Assess the quality of explanations, reasoning, and recommendations rather than focusing exclusively
• Differentiate between varying levels of response quality and apply consistent evaluation standards
• Provide clear, detailed, and opinionated written feedback
• Assess whether AI models guide developers effectively and build trust through interactions

🎯 Requirements

• Senior, Staff, or Principal-level software engineering experience
• Strong professional background in Python; TypeScript or JavaScript also relevant
• Hands-on experience with at least one AI coding tool: OpenAI Codex, Claude Code, or Cursor
• Deep familiarity with modern AI-assisted software development workflows
• Ability to evaluate code and technical responses without executing the code or reviewing every line
• Strong written and spoken English proficiency (B2 level or above)

🎁 Benefits

• Competitive hourly compensation ranging from $100 to $200 based on experience and location
• Fully remote contract opportunity with worldwide availability subject to regional eligibility
• Flexible workload of approximately 10-20 hours per week
• Flexible working hours
• Ongoing engagement with projects typically lasting from two weeks to several months
• Opportunities to participate in additional projects based on evaluation performance