Senior Software Development Engineer in Test - AI

📋 Description

• Design and architect comprehensive test plans, evaluation frameworks, and quality metrics designed
• Develop robust, end-to-end automated test suites in Python across evaluations, API checks, UI
• Create automated prompt testing systems and regression suites to proactively detect unintended
• Establish multi-dimensional evaluation criteria to measure and track GenAI quality across accuracy
• Perform adversarial testing (red-teaming) to identify and mitigate model hallucinations, biases, or
• Develop internal tools and testing frameworks that enable software engineering teams to seamlessly

🎯 Requirements

• Deep understanding of GenAI technologies including LLMs, prompt engineering, and AI application
• Strong hands-on Python coding experience.
• Expert experience with test automation frameworks and scripting (Python, JavaScript, Selenium
• Strong background of software testing methodologies (functional, integration, regression
• Proven ability to design test cases and evaluation criteria for non-deterministic systems.
• Strong analytical and problem-solving skills with attention to detail.