AI Response Quality Evaluator

📋 Description

• Evaluate AI-generated responses using personalized prompts and information retrieved from connected
• Assess whether responses are relevant, accurate, helpful, contextually appropriate, and
• Identify incorrect personalization, unsupported assumptions, irrelevant recommendations
• Compare multiple AI-generated responses and assess differences in quality and overall user
• Review nuanced AI outputs to identify both strengths and weaknesses, including subtle issues that
• Provide clear, detailed, structured, and well-reasoned feedback to support improvements to AI

🎯 Requirements

• Currently based in Australia.
• Willing and able to connect relevant Google applications to Gemini, subject to required consent and
• Active use of Google applications such as Gmail, Google Calendar, Google Photos, and Google Drive.
• Sufficient personal data or usage history within connected Google applications to support
• Strong analytical and critical-thinking skills, with excellent attention to detail.
• Excellent written English and the ability to communicate observations and evaluation results

🎁 Benefits

• Fully remote contractor position available to candidates based in Australia.
• Project duration of up to 16 weeks.
• Flexible remote working environment suited to independent work.
• Opportunity to contribute directly to the evaluation and improvement of AI personalization
• Exposure to advanced AI evaluation workflows involving personalized prompts and contextual
• Opportunity to develop practical experience assessing AI-generated content and user experiences.