Senior QA Automation Engineer - AI

📋 Description

• Design and architect comprehensive test plans, evaluation frameworks, and quality metrics designed
• Develop robust, end-to-end automated test suites in Python across evaluations, API checks, UI
• Create automated prompt testing systems and regression suites to proactively detect unintended
• Establish multi-dimensional evaluation criteria to measure and track GenAI quality across accuracy
• Perform adversarial testing (red-teaming) to identify and mitigate model hallucinations, biases, or
• Develop internal tools and testing frameworks that enable software engineering teams to seamlessly

🎯 Requirements

• Deep understanding of GenAI technologies including LLMs, prompt engineering, and AI application
• Strong hands-on Python coding experience.
• Expert experience with test automation frameworks and scripting (Python, JavaScript, Selenium
• Strong background of software testing methodologies (functional, integration, regression
• Proven ability to design test cases and evaluation criteria for non-deterministic systems.
• Strong analytical and problem-solving skills with attention to detail.

🎁 Benefits

• At Anaplan, we are a team of innovators focused on optimizing business decision-making through our
• What unites Anaplanners across teams and geographies is our collective commitment to our customers'
• Our customers rank among the who's who in the Fortune 50. Coca-Cola, LinkedIn, Adobe, LVMH and
• Our Winning Culture is the engine that drives our teams of innovators. We champion diversity of
• Supported by operating principles of being strategy-led, values-based and disciplined in execution