Sr. Staff Software Engineer, AI Platform

📋 Description

• Identify modernization opportunities and scale the roadmap for a company-wide evaluation system in
• Define cross-team technical strategy, align partner teams, and drive broad adoption of shared
• Make durable architectural decisions that improve the user experience and reliability of
• Establish evaluation methodologies and standards that balance automated metrics, expert judgment
• Lead complex cross-team workstreams, resolve technical tradeoffs and risks, and deliver impact

🎯 Requirements

• 3+ years of deep, hands-on experience designing and operating evaluation systems for GenAI and
• Strong programming skills in Python coupled with a solid grasp of distributed systems principles
• Deep familiarity with GenAI and RecSys evaluation libraries and frameworks, AutoEvals, OpenEvals
• 5+ years of experience building scalable platforms for distributed experimentation, data and model
• Strong judgment around GenAI risks, including robustness, bias, privacy, security, and the
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience

🎁 Benefits

• Base salary range for this position is $208,592 - $429,454 USD
• Position is eligible for equity
• Flexible work model allowing in-office collaboration 1-2 times per quarter
• Comprehensive benefits package available at https://www.pinterestcareers.com/pinterest-life/