AI Benchmark Engineer | Native Language Specialist - French

📋 Description

• Design and build benchmark tasks for coding agents and LLMs in multilingual environments.
• Create realistic task environments with datasets, files, and prompts written in French.
• Identify failure points and edge cases in French-language processing and translation.
• Develop reference implementations and deterministic verifier scripts.
• Analyze execution logs and calibrate task difficulty across model tiers.
• Participate in four-layer human quality-control process.

🎯 Requirements

• At least 5 years of professional software engineering experience.
• Native or near-native French fluency with deep language knowledge.
• High proficiency in English for technical communication.
• Strong proficiency in Python and shell scripting.
• Experience with terminal/CLI-based development workflows.
• Familiarity with coding agents and AI-assisted development.

🎁 Benefits

• Flexible working schedules with no fixed daily hours.
• Choose when and how much to work based on projects.
• Competitive contractor rates and prompt payments.
• Contribute to cutting-edge AI and language technology projects.
• Exposure to multilingual AI evaluation and benchmark engineering.
• Access to global community of linguists and technical specialists.