Domain Advisor Consultant (Subject Matter Expert)

📋 Description

• Review and advise on evaluation criteria and scoring rubrics for AI outputs.
• Create, edit, and validate high-quality benchmark tasks, prompts, and responses.
• Analyze model failures and provide expert explanations of causes and improvements.
• Assess complexity and difficulty of evaluation scenarios for rigorous testing.
• Document expert reasoning to translate domain knowledge into AI evaluation methodologies.
• Work under project-specific Statements of Work and deliver agreed outcomes.

🎯 Requirements

• Elite-level expertise in a specialized domain with advanced degree (PhD, MD, JD).
• Recognized professional standing (senior/principal, publications, awards).
• Current experience as independent consultant, freelancer, or academic leader.
• Strong ability to distinguish high-quality from flawed reasoning and explain clearly.
• Ability to apply expertise to unfamiliar problems and establish sound responses.
• Excellent written communication and ability to manage own workflow.

🎁 Benefits

• Project-based flexibility to complement existing work.
• Non-exclusive engagements with other clients.
• Flexible delivery of agreed deliverables.
• Defined compensation and timelines per assignment.
• Remote work from your own location.
• Intellectual challenge and meaningful impact on AI systems.