Portuguese AI Evaluation Specialist (Brazil)

Opportunity Overview

Handshake is looking for Portuguese speakers based in Brazil to help make AI responses more personalized. This is not a traditional job - you'll use your Portuguese language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users.

This is an ongoing, project-based opportunity you can take on alongside your current role.

What You'll Do

• Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
• Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
• Provide clear written feedback that helps AI better understand and personalize responses for individual users
• Complete tasks at your own pace with no set schedule or minimum hour requirement

Ideal candidates meet all of the following

• Location - Based in Brazil and able to work remotely in an asynchronous, self-directed capacity
• Language - Fluent in Portuguese, both written and spoken, with strong written communication skills for explaining your reasoning clearly. A minimum of B2-level English proficiency is also required, as all platform content, instructions, and training materials are provided in English.
• Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle

Required for all applicants

• Must have a Bachelor's degree or higher
• Strong written communication in Portuguese and English at B-2 level proficiency
• Ability to work independently in a remote, asynchronous environment

Where you can work

This role is 100% remote, for applicants located in Brazil.