Research Engineer, Domain Scaling

📋 Description

• Own the data strategy for knowledge work verticals end-to-end, from task sourcing through RL training
• Manage technical relationships with external data vendors, including evaluation of data quality and reward design
• Collaborate with domain experts to design data pipelines and evaluations
• Explore novel ways of creating RL envs for high value tasks
• Develop and improve QA frameworks to catch reward hacking and ensure env quality
• Run generalization experiments to measure how data strategy changes improve model capabilities

🎯 Requirements

• Have experience with fine-tuning large language models for specific domains or real-world use cases
• Have experience with reinforcement learning, reward design, or training data curation for LLMs
• Are comfortable managing technical vendor relationships and iterating quickly on feedback
• Find value in reading through datasets to understand them and spot issues
• Have strong cross-functional collaboration skills
• Are passionate about making AI more useful and accessible across different industries

🎁 Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• A supportive, collaborative office environment
• Office space in San Francisco for in-person collaboration