Cyber Evaluations Engineer

📋 Description

• Design and run capability, uplift, and safety evaluations to assess cyber-relevant risk in new
• Execute per-release safeguard-robustness testing ahead of major model launches
• Analyze evaluation results and communicate findings clearly to the team and to stakeholders
• Design, prototype, and tune detection probes for cyber misuse
• Work with the cyber policy team to turn policy lines into a layered, robust abuse-detection
• Build and maintain internal tooling used to run and score evaluations

🎯 Requirements

• Experience building or running evaluations, benchmarks, or test suites for software or ML systems
• Hands-on cybersecurity experience (e.g., CTF participation, vulnerability research, exploit
• Proficiency in Python
• Strong ability to communicate evaluation results with multiple cross-functional stakeholders or

🎁 Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space in which to collaborate with colleagues
• Visa sponsorship with immigration lawyer assistance