Software Development Engineer in Test - AI

📋 Description

• Design, implement, and optimize testing strategies for AI-powered applications, chatbots, copilots
• Develop and maintain AI evaluation (Evals) frameworks to assess hallucinations, groundedness
• Build automated validation pipelines for LLM-generated outputs using structured assertions
• Validate multi-agent orchestration workflows, agent planning and execution, memory retention
• Contribute to prompt engineering, context engineering, and prompt optimization strategies to
• Evaluate AI application latency, token consumption, throughput, scalability, and model usage costs.

🎯 Requirements

• Bachelor's or Master's degree in Computer Science, Software Engineering, Artificial Intelligence
• Strong programming skills in Python.
• Solid understanding of software testing principles, quality engineering methodologies, and modern
• Hands-on experience with AI/LLM testing, prompt engineering, context engineering, AI evaluation
• Practical experience designing and validating AI-powered workflows, including automated output
• Experience with API testing and automation, microservices testing, UI automation, and data

🎁 Benefits

• Fully remote working arrangement from India.
• Full-time employment with opportunities to collaborate with international teams.
• Competitive healthcare coverage, including an HMO benefit of 175K MBL and one free dependent after
• Generous vacation policy.
• Punctuality bonus and additional employee benefits.
• Access to learning and professional development opportunities.