Principal Data Scientist - Agent Builder

📋 Description

• Define the evaluation strategy for conversational and agentic search
• Lead quality metrics and decision frameworks for RAG, agents, tools
• Improve retrieval, vector search, and context enrichment
• Turn results into product decisions: models, routing, tools
• Partner with engineering to productionize eval pipelines and dashboards
• Mentor data scientists and engineers in experiment design

🎯 Requirements

• 8+ years of applied DS/ML with IR/NLP/ranking/RAG/LLM
• Proven track record defining eval for production AI/ML systems
• Influence product/technical strategy through data in ambiguous domains
• Hands-on Python, PyTorch/Transformers, Pandas and notebooks
• Deep knowledge of retrieval systems: dense/sparse, vector search, metrics
• Experience with Elasticsearch or similar search/distributed systems

🎁 Benefits

• Competitive pay based on the work you do
• Health coverage for you and your family in many locations
• Flexible locations and schedules for many roles
• Generous vacation days each year
• Donation matching up to €2000 or local currency
• Up to 40 hours/year for volunteer projects