AI Benchmark Engineer | Native Language Specialist - Hindi - Remote

📋 Description

• Task Engineering: Evaluating Coding Agents.
• Asset Creation: build tasks in native language; assets stay in target language.
• Prompting & Translation: find failure points in your native language.
• Implementation & Verification: write reference implementations and verifiers.
• Calibration & Execution: calibrate task difficulty across model tiers.
• Quality Assurance: 4-layer QC plus automated checks for benchmark integrity.

🎯 Requirements

• 5+ years of software engineering.
• Native or near-native fluency; high English proficiency.
• Python, shell scripting, and data processing.
• Terminal/CLI development workflows; familiarity with coding agents.
• Deep multilingual text processing knowledge: Unicode and locale rules.
• Experience at leading tech companies or top-tier universities.

🎁 Benefits

• Flexible schedule as an independent contractor.
• Competitive rates with prompt payments.
• Work on cutting-edge AI and language tech.
• Join a global community of linguists and language professionals.
• Diverse projects across industries.
• Work from anywhere with streamlined onboarding.