AI Personalization Raters

Location: Remote — Canada only; 4 hours of overlap with PST required.

Company

Boutique consultancy specializing in IT professional services and engineering talent solutions.

What you will do

• Evaluate AI-generated responses using personalized prompts and information retrieved from connected Google applications.
• Assess response accuracy, relevance, helpfulness, and personalization quality.
• Identify incorrect personalization, unsupported assumptions, irrelevant recommendations, and inconsistencies.
• Compare multiple generated responses and assess their overall user experience.
• Provide clear, detailed feedback while following project guidelines and confidentiality requirements.

Requirements

• Currently based in Canada.
• Willing and able to connect relevant Google applications to Gemini with the required permissions and consent.
• Active use of Google Workspace or consumer Google applications, with sufficient personal data or history for personalized retrieval evaluations.
• Strong analytical thinking, attention to detail, and excellent written English.
• Bachelor’s degree or equivalent practical experience in any field.
• Desktop or laptop with a reliable internet connection and ability to work independently.

Culture & Benefits

• Remote contract engagement.
• Minimum 4 hours per day, up to 40 hours per week.
• Contract duration of up to 16 weeks.
• Work focused on improving AI personalization quality and user experience.