SWE-Bench AI Task Auditor - Freelance AI Trainer Project

📋 Description

• Evaluate software engineering tasks for technical accuracy, realism, solvability, reproducibility
• Review complex codebases and real-world application scenarios to determine whether tasks accurately
• Assess the reliability and completeness of tests, evaluation criteria, and expected outcomes
• Identify codebase integration issues, logic errors, test failures, and other technical
• Troubleshoot complex technical scenarios and provide clear, actionable feedback to improve task
• Apply specialized software engineering knowledge to ensure AI training and evaluation tasks meet

🎁 Benefits

• Compensation of $70–$100 per hour, with the exact rate determined based on experience, expertise
• Freelance contract structure offering flexibility for project-based work
• Remote work environment
• Opportunity to contribute directly to the training and evaluation of advanced AI systems
• Opportunity to apply specialized software engineering expertise to technically challenging AI
• Health insurance, paid time off, and other company-sponsored employee benefits are not provided