Data Annotation Specialist, Data Science

📋 Description

• Evaluate model responses to coding tasks using tools.
• Assess agent trajectories and model capabilities for code gen and debugging.
• Prompt models for complex data science tasks; review results.
• Label, proofread, and improve software engineering outputs.
• Report quality and performance trends of model/agent behavior.

🎯 Requirements

• Exceptional data analysis and visualization skills.
• 3+ years of data science experience on real-world pipelines.
• Proficient Python and data science packages: numpy, pandas, matplotlib, sqlite.
• Strong SQL skills; familiar with JSON, XML.
• Experience rewriting, proofreading, and giving code feedback.
• Familiarity with code agents (OpenCode, Claude Code, Codex).

🎁 Benefits

• Remote work within Canada
• 12-month contract
• BYOD laptop
• Performance incentives included
• 16 hours/week minimum