Senior QA Automation Engineer

📋 Description

• Embed fully within a Scrum team, participating in all ceremonies and maintaining associated
• Own the end-to-end test strategy for the AI voice virtual agent across the LLM, speech, and
• Design test scenarios for complex conversational behavior, including multi-turn dialogues
• Build and maintain an evaluation framework for non-deterministic output, leveraging golden
• Adversarially test the agent against hallucinations, incorrect grounding, guardrail bypasses
• Prepare and provision SIP devices, endpoints, and call scenarios to automate call origination

🎯 Requirements

• 5+ years in QA, with recent hands-on ownership of a complex, integrated product.
• Practical experience testing SIP/VoIP systems, including call flows, SIP signaling, media handling
• Demonstrated creativity in test design (live scenario design will be a core part of the interview
• Proficiency in Python, sufficient to independently build and maintain automation frameworks.
• Experience testing non-deterministic or probabilistic systems, with a clear approach to designing
• Strong analytical skills, including the ability to define quality metrics, justify their

🎁 Benefits

• Remote work opportunity!
• B2B Employment ($, gross).
• Stable job with long-term growth perspective.
• Competitive salary with annual performance review.
• Really good hardware.
• An exciting and challenging job with talented people around.