AI Personalization Evaluator - Australia

Help evaluate how an AI assistant uses information from connected Google apps to respond to personalized prompts. This remote project is for people based in Australia who can review AI responses carefully and explain what works and what does not.

What you’ll do

• Evaluate AI-generated answers for relevance, accuracy and appropriate use of context.
• Compare responses, identify unsupported assumptions or missed information, and provide clear written feedback.
• Follow project guidelines for consistent, confidential evaluation work.

Important account-access requirement

• This project requires you to connect eligible Google apps to Gemini and grant the permissions needed for personalized evaluations. These may include Gmail, Google Drive, Google Calendar and Google Photos. Shortlisted candidates will receive the project’s consent and onboarding details before participation.

What we’re looking for

• Currently resident in Australia.
• Bachelor’s degree or equivalent practical experience in any field.
• Active use of Google apps with enough account history to support personalized evaluation tasks.
• Strong analytical judgment, attention to detail and written communication.
• Desktop or laptop computer and reliable internet access.
• AI evaluation, annotation, content review or quality assurance experience is helpful but not required.

Engagement and pay

• Remote contractor assignment for up to 16 weeks.
• Plan for 20 hours per week, with potential for up to 40 hours depending on project needs, and four hours of daily overlap with Pacific Time.
• $13.00 per hour.
• Selected applicants may be invited to complete an interest form, which is mandatory to move forward in the hiring process.

Where you can work

This role is 100% remote, for applicants located in Australia.