Member of Technical Staff (Search Quality Analyst)

📋 Description

• Find and diagnose quality issues in our search pipeline
• Design metrics from scratch to track and measure search quality
• Build datasets for model training, including LLM-as-a-judge labeling pipelines
• Improve search snippet quality and page selection algorithms for indexing
• Design and analyze A/B experiments to validate improvements

🎯 Requirements

• 4+ years of experience as a data analyst or in a related role
• Strong coding skills — expected to write production-grade code at a mid-level backend engineer level
• Proficiency with SQL and Python
• Demonstrated hands-on experience with at least one of the following: Designing metrics from scratch