Clinical AI Engineer

📋 Description

• Design the evaluation: Define evaluations for greenfield products to an academic standard
• Build the measurement: Build, optimize and validate the LLM judges and rubrics that score the
• Run it and write it up: Execute the evaluation, do the statistics, and write it up for the pod, the
• Run post-market surveillance: Monitor output quality in production and respond to regulatory
• Fix what the evidence finds: Make prompt, rubric, evaluation harness, and code changes in the pod’s
• Publish: Contribute to peer-reviewed literature on the translational benefit of the product.

🎯 Requirements

• A medical degree and clinical practice with independent clinical judgment.
• Academic depth: study design, inferential statistics, agreement and reliability measures, sample
• Experience evaluating medical software or clinical AI, including building or validating
• Enough engineering to work in a production codebase: make changes in Python or TypeScript and get
• Independence: run a project for weeks with light direction and say early when stuck.
• Clear writing: evaluation reports, surveillance summaries and manuscripts are the primary output.

🎁 Benefits

• Equity from day one.
• Comprehensive private medical and dental cover through Bupa, plus 24/7 mental health, coaching and
• Global parental leave: 26 weeks paid for primary carers and 18 weeks for secondary carers.
• Fertility support: £7,000 one-off payment, eligibility applies.
• Learning & development: £700 per year for courses, books, memberships, conferences and more.
• Home office budget of £500 one-off.