SWE-Bench AI Task Auditor - Freelance AI Trainer Project

📋 Description

• Evaluate software engineering tasks for technical accuracy, realism, solvability, reproducibility
• Review complex codebases and real-world application scenarios to determine whether tasks accurately
• Assess the reliability and completeness of tests, evaluation criteria, and expected outcomes
• Identify codebase integration issues, logic errors, test failures, and other technical
• Troubleshoot complex technical scenarios and provide clear, actionable feedback to improve task
• Apply specialized software engineering knowledge to ensure AI training and evaluation tasks meet

🎯 Requirements

• Demonstrable professional experience and deep technical expertise in software engineering
• Strong familiarity with software engineering concepts and the ability to evaluate tasks against
• Strong analytical and problem-solving skills, with the ability to rigorously test, troubleshoot
• Strong attention to detail and the ability to identify subtle logic, integration, testing, and
• Excellent written communication skills for providing precise, constructive, and actionable
• Ability to work independently and apply specialized expertise to project-based freelance

🎁 Benefits

• Compensation of $70–$100 per hour, with the exact rate determined based on experience, expertise
• Final compensation may vary from the published range following evaluation of your qualifications
• Freelance contract structure offering flexibility for project-based work.
• Remote work environment.
• Opportunity to contribute directly to the training and evaluation of advanced AI systems.
• Opportunity to apply specialized software engineering expertise to technically challenging AI