SWE-Bench AI Task Auditor - Freelance AI Trainer Project

📋 Description

• Evaluate software engineering tasks for technical accuracy, realism, solvability, reproducibility
• Review complex codebases and real-world scenarios to determine task accuracy
• Assess reliability and completeness of tests, evaluation criteria, and expected outcomes
• Identify codebase integration issues, logic errors, test failures, and technical inconsistencies
• Troubleshoot technical scenarios and provide clear, actionable feedback
• Apply specialized software engineering knowledge to ensure AI training tasks meet high technical

🎯 Requirements

• Demonstrated professional software engineering experience and deep technical expertise, including
• Strong familiarity with software engineering concepts and task evaluation against practical
• Strong analytical and problem-solving skills, with the ability to rigorously test, troubleshoot
• Strong attention to detail and ability to identify subtle logic, integration, testing, and
• Excellent written communication skills for precise, constructive, and actionable technical feedback
• Ability to work independently on project-based freelance assignments

🎁 Benefits

• Freelance contract with flexible, project-based work
• Remote work environment
• Competitive hourly compensation ($70-$100/hour, exact rate based on experience and location)
• Opportunity to contribute to advanced AI training and evaluation projects
• Engaging work applying specialized software engineering expertise