Domain Advisor Consultant (Subject Matter Expert)

📋 Description

• Review and advise on evaluation criteria and scoring rubrics for AI outputs
• Create, edit, and validate high-quality benchmark tasks, prompts, and responses
• Analyze model failures like hallucinations, flawed reasoning, and inconsistencies
• Assess the complexity, nuance, and difficulty of evaluation scenarios
• Document expert reasoning and recommendations for technical teams
• Work under project-specific Statements of Work to deliver outcomes

🎯 Requirements

• Elite-level expertise in a specialized domain with advanced degree (PhD, MD, JD)
• Recognized professional standing (senior/principal-level, publications, awards)
• Current independent consultant, freelancer, business owner, or academic leader
• Strong ability to distinguish high-quality from flawed reasoning
• Ability to apply expertise to ambiguous problems
• Excellent written communication skills; experience with AI/ML beneficial

🎁 Benefits

• Project-based flexibility
• Non-exclusive engagements
• Flexible delivery
• Defined compensation
• Remote work
• Intellectual challenge