AI Benchmark Engineer | Native Language Specialist - German - Remote

📋 Description

• Task Engineering: Evaluating Coding Agents.
• Asset Creation: Build task environments in native language.
• Prompting & Translation: find failure points in your native language.
• Implementation & Verification: robust solutions and verifier scripts.
• Calibration & Execution: analyze logs and calibrate task difficulty (Easy to Very Hard).
• Quality Assurance: 4-layer QC with automated checks to ensure benchmark integrity.

🎯 Requirements

• Experience: 1+ years in software or prompt engineering.
• Background: Track record at leading tech firms or top universities.
• Language: Native or near-native fluency; high English proficiency.
• Technical Stack: Python, shell scripting, and data processing.
• Workflow: CLI-based development workflows; familiarity with coding agents.
• Domain Expertise: Multilingual text processing, encoding, locale.

🎁 Benefits

• Flexible schedule as an independent contractor.
• Competitive rates with prompt payments.
• Work on cutting-edge AI and language tech.
• Global community of linguists and language professionals.
• Grow with diverse projects across industries.
• Remote work from anywhere.