AI Model Evaluation Specialist
About the role
We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement.
Key Responsibilities
- Design and implement evaluation metrics for AI models
- Conduct thorough testing of model performance across different scenarios
- Analyze model outputs for bias, fairness, and accuracy
- Collaborate with ML engineers to implement improvements
- Document findings and recommendations
Ideal Candidate
- PhD or Masters in Computer Science, ML, or related field
- 5+ years experience in AI/ML model evaluation
- Strong background in statistical analysis
- Experience with evaluation frameworks and metrics
- Excellent communication skills
Where you can work
This role is 100% remote: you can work from anywhere in the world.
From Rise Data Labs's job posting, checked Oct 18, 2026.
About Rise Data Labs
A small AI-data company recruiting remote contract AI trainers in languages, code, science and business, mostly $15 to $50 an hour.
How it pays: Not stated on its job pages.
Similar open roles
Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.

PhysioNet Competitor (Biomedical Signal Processing & ML) (opens the job details)
micro1 · AI Evaluation · Remote· 1d agoDetails
$60–$120/hr
AI Product Evaluator (opens the job details)
micro1 · AI Evaluation · Remote· 1d agoDetails
$14–$36/hr
App Security Expert (opens the job details)
micro1 · AI Evaluation · Remote· 2d agoDetails
$40–$80/hr
ML Research Expert — Published First Author (Benchmark Authoring) (opens the job details)
AfterQuery · AI Evaluation · Remote· 1mo agoDetails
$150/hr
Full-Stack Software Engineer - Testing & Evaluation (opens the job details)
AfterQuery · AI Evaluation · Remote· 10mo agoDetails
$75/hr
Want companies to ask for you?
One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.
Get new Rise Data Labs roles by email
We check the Rise Data Labs job board daily and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.