Senior Data Scientist, Applied AI

📋 Description

• Own assigned workflows: Independently build, test, and improve LLM, RAG, and tool-using agent
• Apply the evaluation framework: Select and apply evaluation criteria, baselines, and test datasets
• Select technical approaches: Compare models, embeddings, and retrieval methods for the assigned use
• Diagnose and resolve issues: Investigate retrieval misses, incorrect answers, and workflow failures
• Maintain and extend test assets: Build and update test cases, benchmark datasets, and regression
• Support production reliability: Monitor and investigate performance changes for workflows they own

🎯 Requirements

• Bachelor's degree required; master's degree in a quantitative or technical field preferred.
• 5+ years of relevant experience in data science, machine learning, applied AI, software
• Hands-on experience building and evaluating LLM applications.
• Strong Python programming, software engineering and testing, and analytical problem-solving skills.
• Strong knowledge of LLMs, embeddings, semantic search, retrieval systems, and RAG architectures.
• Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Lakebase, Lakeflow

🎁 Benefits

• Comprehensive benefits package including medical, dental, and vision coverage
• Unlimited paid time off
• Participation in the company's 401(k) plan with employer contribution
• Company bonus or commission plan (depending on position)
• Flexible and dynamic culture
• Definitive Cares community service group