Sr. Research Scientist - Agent Flywheel

📋 Description

• Turn raw production session traces from Genie Code and Genie One into online signals agents can
• Train and calibrate LLM judges so model feedback becomes reliable, repeatable signal, including
• Convert multi-turn agent trajectories into datasets and reward signals for post-training, closing
• Design benchmarks and RL environments from real customer workloads that probe long-horizon
• Advance evaluation research: online evals on live traffic, automated raters, verifiable rewards
• Keep up with the latest developments in deep learning and create new techniques that go beyond the

🎯 Requirements

• Expertise in debugging and diagnosing failures in complex, stochastic, multi-component systems
• Deep instinct for designing metrics and evals that track what actually matters, and questioning
• Experimental rigor and causal thinking, from offline ablations to online experiments
• A drive to turn measurement into improvement: closing the loop from signals to changes that move
• Solid AI research and software engineering skills
• Strong communication skills and excitement to work on a small, fast-paced team

🎁 Benefits

• Comprehensive benefits and perks that meet the needs of all employees (specific details per region
• Eligibility for annual performance bonus and equity
• Fair and equitable compensation practices