Added
4 hours ago
Type
Full time
Salary
Salary not provided

Related skills

python ci/cd postman api testing pytest

๐Ÿ“‹ Description

  • Develop and execute end-to-end automated test coverage across evaluations, APIs, UIs, and
  • Implement testing strategies for GenAI features, including conversational AI, agentic systems, and
  • Run and maintain automated test suites for prompt testing, including regression tests designed to
  • Support and maintain evaluation frameworks to measure GenAI performance across accuracy, relevance
  • Contribute to curating high-quality test datasets and "golden examples" that represent diverse user
  • Assist in adversarial testing to identify potential model hallucinations or biases, and support the

๐ŸŽฏ Requirements

  • Solid QA or test engineering experience, with exposure to or a keen interest in AI/ML systems.
  • Hands-on Python coding experience.
  • Good understanding of GenAI technologies including LLMs, prompt engineering, and AI application
  • Solid experience with test automation frameworks and scripting (Python, Pytest, API, and UI
  • Practical knowledge of software testing methodologies (functional, integration, regression
  • Ability to execute test cases and evaluation criteria for non-deterministic systems.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’