Domain Advisor Consultant (Subject Matter Expert)

📋 Description

• Review and advise on evaluation criteria and scoring rubrics
• Assess whether AI-generated outputs meet professional standards
• Create, edit, and validate high-quality benchmark tasks, prompts, and responses
• Analyze model failures (hallucinations, flawed reasoning)
• Assess complexity and difficulty of evaluation scenarios
• Document expert reasoning and recommendations

🎯 Requirements

• Demonstrated elite-level expertise in a specialized professional or academic domain
• Advanced degree (PhD, MD, JD) or equivalent industry-recognized achievement
• Recognized professional standing (senior/principal-level leadership, publications, awards)
• Current experience as independent consultant, freelancer, business owner, or academic leader
• Strong ability to distinguish high-quality from flawed reasoning
• Excellent written communication skills

🎁 Benefits

• Project-based flexibility
• Non-exclusive engagements
• Flexible delivery
• Defined compensation
• Remote work
• Intellectual challenge