Software Engineer L5/L6 — Model Evaluations & Data Curation (MEDC)

📋 Description

• Design and build reusable data curation infrastructure, including shared libraries, components, and
• Develop scalable LLM-powered pipelines that transform raw catalog, metadata, and other data sources
• Implement large-scale batch inference workflows while balancing data quality, computational
• Develop sampling strategies that optimize coverage, diversity, difficulty, and representation
• Create data-quality and filtering systems using techniques such as LLM-as-judge scoring
• Partner closely with researchers to design experiments that measure how data curation choices

🎯 Requirements

• Strong software engineering expertise in Python, including experience developing reusable
• Hands-on experience building LLM-driven data generation or transformation pipelines, including
• Practical experience with data quality techniques such as sampling, filtering, deduplication
• Strong modeling intuition and an understanding of how dataset composition and curation decisions
• Experience designing experiments or evaluation approaches to measure the impact of data and
• Experience with distributed data processing technologies such as Spark, Ray, or comparable

🎁 Benefits

• Annual compensation range of $600,000–$1,066,000
• Flexibility to determine balance between salary and stock options
• Comprehensive health insurance plans and mental health support
• 401(k) retirement plan with employer matching
• Stock option program
• Health Savings Accounts and Flexible Spending Accounts