AI Benchmark Engineer | Native Language Specialist - Arabic (UAE) - Remote

📋 Description

• Design, build, and validate Terminal-Bench evaluation tasks for multilingual software challenges
• Create realistic task environments using datasets and files in the native language
• Find failure points where AI does not work in the native language
• Support development of robust reference implementations
• Write reliable, deterministic verifier scripts
• Analyze execution logs and calibrate task difficulty (Easy to Very Hard)

🎯 Requirements

• 5+ years of industry experience in software engineering
• Native or near-native Arabic fluency with high English proficiency
• Strong proficiency in Python, shell scripting, and data processing
• Extensive experience with Terminal/CLI-based development workflows
• Working familiarity with coding agents
• Deep technical understanding of multilingual text processing pitfalls (encoding, Unicode

🎁 Benefits

• Flexible schedule as an independent contractor
• Competitive rates and prompt payments
• Work on cutting-edge AI and language technology
• Join a global community of linguists and experts
• Access diverse projects and grow your portfolio