Skip to content

AI Evaluation

Post-Training Research Scientist (LLMs) — Experimental Track

VettoFlexible (EU-friendly time zones preferred)Posted 8mo ago

About the role

About us

Vetto is a global talent platform connecting top-tier professionals to high-impact AI projects around the world. Our mission is to build trust, quality, and long-term value in the AI ecosystem - for both exceptional talents and companies operating at the frontier of technology.

About the role

This role sits at the heart of Vetto’s mission: using high-quality human data to build AI systems that make the world better. You’ll take raw expert signals and turn it into tangible model improvement, experimenting rapidly and carving new paths in post-training. With full autonomy and no production constraints, you’ll have the freedom to try unconventional ideas and see their impact quickly.

Key Responsibilities

  • Design and run post-training experiments on frontier and open-weight LLMs (SFT, preference-based methods, rubric-driven training)
  • Translate raw annotation artifacts (multi-step solutions, evaluations, adversarial prompts) into training-ready datasets.
  • Prototype new reward signals beyond pairwise preferences (rubrics, constraints, structured critics).
  • Analyze failure modes; propose data-centric fixes (sampling, curriculum, counterfactuals).
  • Build lightweight training/eval pipelines ; iterate quickly.
  • Produce short internal memos: what worked, what didn’t, why.

About you

We’re looking for a researcher who thrives with autonomy, is hands-on, and brings a strong execution mindset and startup mentality. You are opinionated about data quality, pragmatic about tradeoffs, and comfortable moving quickly with incomplete information. You have strong experimental instincts - you can design, run, and interpret messy experiments and extract meaningful insights from them.

Minimum Qualification

  • PhD (or equivalent experience) in ML/AI, applied math, stats, or adjacent.
  • Hands-on experience with LLM post-training (at least one of SFT/DPO/RLHF/RLVR).
  • Solid Python + PyTorch/JAX; comfortable with training infra basics.
  • Fluent English

Preferred Qualification

  • Worked with rubric-based evaluation or tool-augmented tasks.
  • Experience mixing synthetic and human data.
  • Familiarity with failure analysis and dataset audits.

Work Model

We operate remote-first. We focus on outcomes, not where the work is done. To support flexibility and personal choice, we maintain offices in select locations as an optional resource for the team.

Location: Flexible (EU-friendly time zones preferred)

Type: Full-time or long-term contract

Equal Employment Opportunity

Vetto is proud to be an equal opportunity employer and values diversity at our company. We do not discriminate on the basis of race, color, religion, national origin, sex, sexual orientation, gender identity, age, disability, veteran status, or any other protected characteristic.

Type: Full-time or long-term contract

From Vetto's job posting, checked Oct 18, 2026.

The application

Your details, then 1 question (1 written).

Have readyCV (optional)Cover letter (optional)LinkedIn (optional)Website (optional)
  1. 1.
    Tell us how you typically approach post-training an LLM when given a new dataset or set of human signals. How do you decide what to train, what signals to use, how to evaluate success, and how you iterate when results are unclear?Written answer

From Vetto's apply page, checked Oct 15, 2026.

About Vetto

A Brazilian-founded expert network that pays professionals per approved task to review and write AI training data.

How it pays: Weekly, on Fridays, by bank transfer (PIX in Brazil, IBAN or a local bank account elsewhere) after an identity check, converted from US dollars to your currency; a W-8BEN or W-9 tax form is required.

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.

Want companies to ask for you?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new Vetto roles by email

We check the Vetto job board daily and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.