Added
3 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

python deep learning machine learning ai research

📋 Description

  • Define what we evaluate by creating, maintaining, and extending the evaluations roadmap in
  • Define how we evaluate by implementing the evals roadmap, building new evals including benchmarks
  • Minimize noise in the eval pipeline to ensure reproducible and trustworthy results with understood
  • Understand what cannot be measured and communicate limitations of each evaluation to avoid blind
  • Observe training runs and visualize important findings to catch regressions and emerging
  • Manage the evals team, defining hiring roadmap and supporting team members' growth

🎯 Requirements

  • Proven experience designing, running, and maintaining large and complex evaluation suites for
  • Strong research background with experience designing and implementing evaluations for AI research
  • Strong understanding of Python is required
  • Strong understanding of agentic coding is required
  • Experience as a people manager, actively managing a team for at least one year
  • Strong understanding of statistics including variance, confidence intervals, and significance

🎁 Benefits

  • Equity
  • Hybrid work with real office in Freiburg, at least 2 days a week or one full week every other week
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →