Domain Advisor Consultant (Subject Matter Expert)

📋 Description

• Review and advise on evaluation criteria and scoring rubrics to determine whether AI-generated
• Create, edit, and validate high-quality benchmark tasks, prompts, and responses that can serve as
• Analyze model failures, including hallucinations, flawed reasoning, and logical inconsistencies
• Assess the complexity, nuance, and difficulty of evaluation scenarios to ensure AI systems are
• Clearly document expert reasoning and recommendations so that technical teams can translate domain
• Work under project-specific Statements of Work, delivering agreed outcomes within defined timelines

🎯 Requirements

• Demonstrated elite-level expertise in a specialized professional or academic domain, supported by
• Recognized professional standing, such as senior/principal-level leadership, significant
• Current experience as an independent consultant, freelancer, business owner, academic leader, or
• Strong ability to distinguish high-quality from flawed reasoning and to explain complex concepts
• Ability to apply deep subject matter expertise to unfamiliar or ambiguous problems and establish
• Excellent written communication skills, with the ability to articulate nuanced technical or

🎁 Benefits

• Project-based flexibility
• Non-exclusive engagements
• Flexible delivery
• Defined compensation
• Remote work
• Intellectual challenge