Principal Data Scientist - Agent Builder

📋 Description

• Define evaluation strategy for conversational and agentic search, offline and online
• Lead quality metrics and decision frameworks for RAG, agents, tools
• Improve retrieval and re-ranking: dense/sparse, vector search
• Turn experiments into product decisions: model choices, routing, tools
• Collaborate with engineering to productionize evaluation pipelines and dashboards
• Influence roadmap by identifying gaps and communicating trade-offs

🎯 Requirements

• 8+ years of DS/ML with IR/NLP/ranking/semantic search/RAG/LLM products
• Proven track record defining/evaluating prod AI/ML systems: offline/online metrics
• Experience guiding product/technical strategy in ambiguous domains
• Hands-on Python, PyTorch/Transformers, Pandas; reproducible experiments and clean code
• Strong understanding of retrieval: dense/sparse, vector search, re-ranking, metrics
• Elasticsearch experience or similar search; ES|QL familiarity a plus

🎁 Benefits

• Health coverage for you and your family
• Flexible locations and schedules for many roles
• Generous vacation days
• Donation matching up to 2000 (local currency equivalent)
• Up to 40 hours per year for volunteer projects you love
• Parental leave of at least 16 weeks