Data Annotation Specialist, Generalist

📋 Description

• Evaluate and rank model outputs for accuracy, helpfulness, tone
• Stress-test models and document reproducible failure cases
• Create datasets by authoring prompts, responses, exemplars
• Build rubrics and taxonomies for structured annotations
• Annotate and correct multimodal data (text, image, JSON)
• Calibrate and maintain consistency; flag edge cases

🎯 Requirements

• 1+ years of AI data annotation or related analytical role
• Ability to apply detailed guidelines to complex/ambiguous content with nuance
• Comfort with ambiguity and novel, experimental tasks
• Familiarity with large language models and common failure modes
• Excellent written English and ability to clearly justify evaluations
• Experience with annotation platforms and structured formats like JSON, CSV/TSV, Markdown, XML, YAML

🎁 Benefits

• Part-time independent contractor role
• Remote work from Canada
• BYOD — Bring Your Own Device
• Flexible, asynchronous collaboration in a global team
• Opportunity to contribute to Cohere's AI data annotation projects
• Contract work with no employee health benefits