Senior Software Code Reviewer
About the role
About Vetto
Vetto is a tech company focused on building and scaling high-quality datasets for artificial intelligence systems. We work at the intersection of human expertise and AI, ensuring that models are trained on technically accurate, well-defined, and realistic data.
Our projects support the training and evaluation of Large Language Models (LLMs), where technical rigor and correctness are non-negotiable.
About the Project
This project focuses on the technical review and validation of coding tasks used to train AI models. Automated code is generated in response to software engineering prompts, and your role is to evaluate whether that code is correct and truly solves what was asked.
The core questions you will be answering on every task
- Is the coding task technically well-defined?
- Does the generated code actually solve the problem?
- Are the associated tests robust, correct, and aligned with real-world software behavior?
Tests are treated as the mechanism of truth in this context. Mistakes here propagate at scale into AI systems, error criticality is high.
Languages
Tasks in this project involve code written across multiple languages. You will be expected to review and evaluate tasks in any of the following: Python, JavaScript / TypeScript, Go, Rust, and Java.
Strong command of at least two of these languages is required. Breadth across languages is a plus.
Responsibilities
- Review and analyze generated code against the original software engineering prompt
- Evaluate whether the coding task itself is clearly and correctly defined
- Validate whether tests accurately reflect whether the problem has been solved
- Identify gaps, ambiguities, false positives, and false negatives in test suites
- Determine whether a solution that passes the tests genuinely solves the underlying problem
- Apply strict technical criteria and quality standards consistently across tasks
Required Profile
This role is designed for mid/senior-level software engineers with real professional experience.
Technical requirements
- Proven professional experience in software development (production environments)
- Strong command of at least two of the listed languages
- Experience reviewing and evaluating code written by other engineers
- Solid understanding of automated testing - how tests validate (or fail to validate) behavior
- Experience contributing to or working with open source projects
- High attention to detail and strong technical judgment
- Comfortable working fully in English (reading and writing)
Nice to have
- Experience with test-driven development (TDD) or test design
- Familiarity with large or complex codebases
- Background in AI, ML, or data-centric projects
Project Details
This is expert, task-based technical work focused on analysis, validation, and judgment - not code production. Each task takes approximately 30 minutes. Tasks are reviewed under continuous QA and calibration.
Compensation is in the range of $100 per hour (task-equivalent reference), varying based on task complexity and approved volume.
Selection Process
The selection process is fully asynchronous and based on your application. There are no interviews: we evaluate candidates through their background, screening responses, and a short technical exercise focused on code review and test validation.
No traditional interviews required.
Final Note
This role is not about writing more code. It is about technical judgment, rigor, and responsibility.
If you are comfortable challenging problem definitions, questioning tests that "pass but are wrong", and acting as a technical quality gate, this project is for you!
Where you can work
This role is 100% remote: you can work from anywhere in the world.
From Vetto's job posting, checked Oct 18, 2026.
The application
Your details, then 12 questions (9 written).
- 1.Have you contributed to open source projects?Pick one
- 2.Are you available to dedicate at least 90 minutes per day to task-based work?Pick one: Yes, fully available · Yes, but with some scheduling constraints · Not sure yet · No
- 3.Which of the following programming languages do you have professional-level proficiency in?Pick any: Python · JavaScript / TypeScript · Go · Rust · Java · Bash / Shell
- 4.CUSTOM_INTEGRATION_QUESTION__YEARS_OF_EXPERIENCEWritten answer · optional
- 5.CUSTOM_INTEGRATION_QUESTION__EDUCATIONSWritten answer · optional
- 6.CUSTOM_INTEGRATION_QUESTION__SKILLSWritten answer · optional
- 7.CUSTOM_INTEGRATION_QUESTION__AI_FLUENCYWritten answer · optional
- 8.CUSTOM_INTEGRATION_QUESTION__ENGLISH_PROFICIENCYWritten answer · optional
- 9.CUSTOM_INTEGRATION_QUESTION__EMPLOYMENTSWritten answer · optional
- 10.CUSTOM_INTEGRATION_QUESTION__AREA_AND_SPECIALIZATIONWritten answer · optional
- 11.CUSTOM_INTEGRATION_QUESTION__GITHUB_URLWritten answer · optional
- 12.CUSTOM_INTEGRATION_QUESTION__LATTES_URLWritten answer · optional
From Vetto's apply page, checked Oct 15, 2026.
About Vetto
A Brazilian-founded expert network that pays professionals per approved task to review and write AI training data.
How it pays: Weekly, on Fridays, by bank transfer (PIX in Brazil, IBAN or a local bank account elsewhere) after an identity check, converted from US dollars to your currency; a W-8BEN or W-9 tax form is required.
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.
$35–$55/hr
Software Engineers: Paid Code Review for AI Agent Evaluation (opens the job details)
Terac · Agentic & RL Envs · Remote· 2w agoDetails
$65/hr
$50–$100/hr- $50–$70/hr
An experienced engineer?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new Vetto roles by email
We check the Vetto job board daily and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.