SWE-Bench AI Task Auditor - Freelance AI Trainer Project

📋 Description

• Evaluate software engineering tasks for technical accuracy, realism, solvability, reproducibility
• Review complex codebases and real-world application scenarios
• Assess the reliability and completeness of tests, evaluation criteria, and expected outcomes
• Identify codebase integration issues, logic errors, test failures, and other technical
• Troubleshoot complex technical scenarios and provide actionable feedback
• Apply specialized software engineering knowledge to ensure AI training tasks meet high standards

🎯 Requirements

• Demonstrable professional experience and deep technical expertise in software engineering
• Strong familiarity with software engineering concepts and ability to evaluate tasks against
• Strong analytical and problem-solving skills
• Strong attention to detail
• Excellent written communication skills
• Ability to work independently

🎁 Benefits

• Compensation of $70–$100 per hour, determined by experience, expertise, and location
• Freelance contract structure offering flexibility for project-based work
• Remote work environment
• Opportunity to contribute directly to the training and evaluation of advanced AI systems
• Opportunity to apply specialized software engineering expertise to technically challenging AI
• Health insurance, paid time off, and other company-sponsored employee benefits are not provided