Data Scientist, Applied AI

📋 Description

• Develop AI workflows: Build and test LLM, RAG, and tool-using agent workflows for assigned use
• Evaluate approaches: Compare LLMs, embedding models, and retrieval methods against quality
• Maintain evaluation assets: Create and update representative test cases, benchmark datasets, and
• Improve retrieval quality: Develop and tune RAG pipelines, including embeddings, retrieval
• Investigate failures: Review incorrect answers, retrieval misses, and workflow failures; implement
• Support production workflows: Use experimentation, tracing, and observability tools to help monitor

🎯 Requirements

• Bachelor's degree in a quantitative or technical field.
• 3+ years of experience in data science, machine learning, applied AI, or a related field.
• Hands-on experience developing applications with LLMs and evaluating their outputs.
• Strong Python, data analysis, and problem-solving skills.
• Understanding of embeddings, semantic search, retrieval, RAG and evaluation metrics.
• Experience with an agent framework such as PydanticAI, LangGraph, or a similar tool.

🎁 Benefits

• Medical, dental, and vision coverage
• Unlimited paid time off
• 401(k) plan with employer contribution
• Company bonus or commission plan based on position
• Flexible and dynamic culture
• Opportunity to work with talented teammates