Engineer II - QA Engineer

📋 Description

• Design and implement GenAI QA strategies for conversational AI and LLM-powered workflows
• Develop automated test suites for prompts and regression tests
• Create evaluation frameworks for GenAI quality across accuracy, relevance, safety, latency
• Build and maintain test datasets and golden examples for diverse user scenarios
• Implement monitoring to detect quality degradation in production GenAI features
• Collaborate with engineers to define acceptance criteria and quality gates

🎯 Requirements

• 3+ years QA/test engineering, preferably with AI/ML systems
• GenAI tech knowledge: LLMs and prompt engineering
• Experience with test automation frameworks; scripting in Python/JavaScript
• Knowledge of functional, integration, regression, and security testing
• API testing tools: Postman, REST Assured; backend testing
• Familiarity with CI/CD pipelines and automated testing integration

🎁 Benefits

• Define QA practices for GenAI apps
• Work on cutting-edge AI technologies
• Ensure reliability and trust in AI features
• Collaborate with engineers, data scientists and product teams
• Grow expertise in a specialized AI QA domain