AI Quality and Automation Specialist

📋 Description

• Build and maintain API, integration and end-to-end regression tests that keep critical workflows
• Evaluate AI agents on task completion, response quality, tool use and permissions, and measure how
• Build quality checks into CI/CD pipelines and turn every production defect into a regression case
• Put agents to work exploring workflows, generating tests and reproducing bugs, then rigorously
• Share the tools and methods that work with the wider AI team and the central QA department, raising

🎯 Requirements

• Strong test automation and programming skills in TypeScript or Python.
• Solid hands-on experience with web apps, APIs, Git and CI/CD.
• A structured approach to judging AI output against clear, measurable criteria.
• A knack for reproducing, isolating and pinning down bugs fast, with a sharp eye for root cause.
• A direct communicator who documents decisions and shares what works.
• Bonus: agentic browser testing, LLM evaluation frameworks, Supabase, Vercel or GCP.

🎁 Benefits

• Be at the cutting edge of AI agent evaluation and help define how it's done.
• Real ownership: accountable, trusted and close to the impact.
• Progress over perfectionism: set achievable deadlines, ship, learn and improve.
• Genuinely open culture: conversations in open Slack channels, outcomes in Monday.com, calls on
• No fluff: if it can be said in 20 words, we won't use 1,000.
• Great people: strict no ass-hole policy.