Python Senior Software Engineer, AI Training

📋 Description

• Evaluate AI-generated coding interactions from beginning to end, assessing their overall quality
• Determine whether AI outputs are useful, technically sound at a high level, and aligned with the
• Assess the quality of explanations, reasoning, and recommendations rather than focusing exclusively
• Differentiate between varying levels of response quality and apply consistent evaluation standards.
• Provide clear, detailed, and opinionated written feedback on what works, what does not, and what
• Assess whether AI models guide developers effectively, provide meaningful context, and build trust

🎯 Requirements

• Senior, Staff, or Principal-level software engineering experience, or equivalent professional
• Strong professional background in Python, with additional experience in TypeScript or JavaScript
• Hands-on experience with at least one of the following AI coding tools: OpenAI Codex, Claude Code
• Deep familiarity with modern AI-assisted software development workflows.
• Ability to evaluate code and technical responses without necessarily executing the code or
• Strong written and spoken English proficiency (B2 level or above), as the role involves detailed

🎁 Benefits

• Competitive hourly compensation ranging from $100 to $200, depending on experience and location.
• Fully remote contract opportunity, with worldwide availability subject to regional eligibility.
• Flexible workload of approximately 10–20 hours per week.
• Flexible working hours.
• Ongoing engagement, with individual projects typically lasting from two weeks to several months.
• Opportunities to participate in additional projects based on evaluation performance.