Staff Software Engineer – Testing \u0026 Evals Frameworks

📋 Description

• Own Test Architecture & Strategy: Set the architecture and long-term strategy for automation
• Lead Testing Strategy for Distributed Systems: Define end-to-end and integration testing strategy
• Drive Testing-in-Production as an Org Standard: Build and champion canary deployments
• Own Security-Focused Test Automation: Set the standard for testing authentication/authorization
• CI/CD Quality Gates: Integrate automated testing into CI/CD pipelines (e.g., GitHub Actions)
• Drive AI & Evals Culture: Build robust evaluation pipelines for AI-assisted features and LLM

🎯 Requirements

• 10+ years of experience (or equivalent: 10+ years with Master's degree, PhD with 5+ years) as
• Proficiency in Python/TypeScript/JavaScript/Java
• Hands-on experience with Playwright, Jest, API automation, or evaluation frameworks for software/AI
• Experience integrating automated tests into CI/CD pipelines (e.g., GitHub Actions, ArgoCD)
• Proven ability to lead cross-team technical initiatives
• Track record mentoring senior engineers

🎁 Benefits

• Comprehensive medical, dental, vision insurance
• Health savings account
• Flexible spending accounts
• Basic and voluntary life and AD&D insurance
• 401(k) with company match
• Parental leave