Member of Technical Staff (QA Engineer - Agentic Systems)

📋 Description

• Own quality for the AI powering Solstice platform.
• Design evals to measure quality and catch regressions.
• Build end-to-end test suites across backend and frontend.
• Write code and test infra; do manual testing when needed.
• Collaborate across product, backend and frontend teams.

🎯 Requirements

• Strong Python; build test infra; CI/CD automation.
• End-to-end and UI test automation with Playwright.
• Manual and exploratory QA; release sign-off ownership.
• Experience testing ML/LLM systems; non-deterministic outputs.
• Evaluation methods: golden datasets and LLM-as-judge.
• LangChain/LangGraph exp; LLM observability; TS/React familiarity.

🎁 Benefits

• Health, dental, and vision insurance.
• Ground-floor equity opportunity.
• 401(k) with match.
• Visa sponsorship (O-1, H-1B, TN) available.
• Professional growth stipend.
• Relocation support.