Member of Technical Staff, North Modelling (Evals)

📋 Description

• Own the eval strategy for North: define measurements across agent workflows and enterprise
• Build high-quality evals from user feedback, production logs, and customer needs.
• Create systems turning learnings into evals to pace product progress.
• Be the voice of North inside modelling; translate eval results into actionable recommendations.
• Work with North product teams, customer teams, and modelling teams to align meaning of “good” with
• Apply rigorous measurement to real-world enterprise AI usage and updates.

🎯 Requirements

• Proven experience improving AI-product systems through evals, feedback loops, or model selection.
• Strong craft in evaluation: representative tasks, clean data, and regression tracking.
• Applied MLE judgment; ability to reason about model behavior and product outcomes.
• Comfortable collaborating with users and product teams to turn qualitative signals into measurable
• Self-directed, practical, and motivated by open-ended problems with technical depth and product
• Interest in making AI systems genuinely useful in real enterprise settings.

🎁 Benefits

• Remote-friendly with offices in multiple cities; support for collaboration across time zones.
• Competitive health benefits, parental leave, and learning stipends.
• Vacation, travel budget for remote staff, and home office stipend.