LLM-based evaluation to assess relevance and align with user behavior
Real-time quality in production: reranking, filtering, latency
Automated quality monitoring with agentic insights and actionable recommendations

🎯 Requirements

4+ years shipping production ML systems
Experience with search, information retrieval, or recommendation systems
Fine-tuning, evaluation frameworks, and scaling LLM deployments
Python and PyTorch; SQL and data orchestration tools (Spark, Airflow)
Designing and running A/B tests to validate model impact
Excellent English communication; cross-functional collaboration

🎁 Benefits

Work with smart and empathetic people who will help you grow
Regular team offsite events to connect and collaborate
Fully remote team - choose where you live
Unlimited vacation time - we strongly encourage all employees take at least 3 weeks per year
Work from home stipend to set up your home office
Apple laptops provided for new employees

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot