Engineer II - QA Engineer

📋 Description

• Design QA strategies for GenAI features and LLM workflows
• Build automated test suites for prompts and regression testing
• Create evaluation metrics across accuracy, relevance, safety, latency
• Develop test datasets and golden examples for diverse scenarios
• Implement monitoring/alerts for GenAI quality in production
• Conduct adversarial testing to surface failures and biases

🎯 Requirements

• 3+ years QA or test engineering, AI/ML preferred
• Strong understanding of GenAI, LLMs, prompt engineering
• Experience with test automation (Python, JavaScript)
• UI testing with Playwright or Puppeteer
• API testing tools (Postman, REST Assured) and backend testing
• Familiarity with CI/CD and quality gates

🎁 Benefits

• Work with cutting-edge GenAI tech and AI QA
• Ensure AI features are reliable and trustworthy
• Impact millions of enterprise users
• Collaborate across engineers, data scientists, and product teams
• Grow expertise in a specialized AI QA domain
• Join Anaplan's Winning Culture and growth opportunities