For companies: explore licensing operational data for AI. Check eligibility

Jobs › AI evaluator jobs

AI evaluator and rater jobs open now

Jobs that pay people to rate chatbot answers are open now: 308 AI evaluator and rater roles were open on 15 platforms on . Evaluators and raters judge written or spoken AI responses, search results, ads and maps against written criteria. 187 of them state hourly pay, and their median is $26 per hour. 9 are entry-level, with no set field. See how we count.

Big T, the TrainerGigs mascot, celebrating beside an envelope.
Open roles
308on 15 platforms
Median listed pay
$26per hour, across 187 roles
Entry-level
92% of these roles, no set field
Posted this week
11in the last 7 days

What AI evaluators do

An AI evaluator, or rater, checks what an AI system produces and grades it against the project's written guidelines. The tasks are of a few kinds.

The work is done online, by the guidelines each project gives. Each posting says what it asks for, so read it before you apply.

Open roles that match this guide

Open on . Pay as each listing states it.

AI evaluator roles by kind of work

Each role counts for one kind, by the words of its title and its field. The first kind that fits wins.

Kind of workWhat you doRolesPlatformsMedian per hour
Search, ads and maps ratingSay how well a search result, an ad or a map result matches what a person asked for.633$20.30
Red teaming and safetyTry prompts that could make a model fail or answer unsafely, and report what happened.105No median
Expert review in a fieldGrade a model's answers in your own field, such as medicine, law, finance or code.11010$55
Translation and language reviewCheck a translation or a model's text in your language for meaning, grammar and tone.113$23.75
AI answer ratingRead or listen to a model's answers and grade them against written guidelines, or pick the better of two.11413$26

Platforms with AI evaluator roles

Each row is a platform with such a role open today, the platform with the most first. Posted this week counts the roles that its platform dates in the last 7 days. A median needs 8 roles that state hourly pay.

Platforms with AI evaluator rolesWelo Data: 93. Alignerr: 67. Turing: 53. Rise Data Labs: 27. Mercor: 13. Volga Partners: 11. micro1: 10. Elsevier Health: 7. Invisible: 7. Terac: 7.Welo Data93Alignerr67Turing53Rise Data Labs27Mercor13Volga Partners11micro110Elsevier Health7Invisible7Terac7
Platforms with AI evaluator roles
PlatformRolesPosted this weekMedian per hourListed hourly pay
Welo Data934$20.30$2.25 to $92.50
Alignerr67Not dated$26$12 to $120
Turing530$15$15 to $150
Rise Data Labs271No median$15 to $150
Mercor131$95$45 to $190
Volga Partners110No median$7 to $35
micro1101$37.50$10 to $70
Elsevier Health70No median$55 to $80
Invisible70No median$6 to $65
Terac71No median$50 to $150
Innodata60No medianNot listed
Braintrust33No median$20 to $76
Appen20No median$2.40
Cohere10No medianNot listed
Vetto AI10No medianNot listed

Listed pay

How the roles state their pay. A median uses the midpoint of each hourly rate or range. The hourly figures run from $2.25 to $190 per hour.

How pay is listedRolesListed pay
Per hour, a rate or a range187Median $26, middle half $23 to $66.25
Per task2$40 to $50 per task
Pay not listed117

Languages these roles name

172 of the 308 roles name a language in the title. These are the languages named most, by two roles or more. The link searches the board for the language.

Countries these roles name

167 of the 308 roles name the countries they accept. 162 name them in their own listing, and these are the countries they name most. 5 carry a platform's standard list of countries instead: micro1 (5). The link shows every role on the board that names the country. Platforms by country shows every platform for each country.

The best-paid AI evaluator roles

Ranked by the midpoint of the listed hourly pay, the highest first.

  1. Multilingual Primary Care Physician (MD) - Clinical Documentation & AI Evaluation$180 per hourMercor · Medicine · Listed $170 to $190 per hour
  2. Multilingual Inpatient Hospitalist (MD) - Clinical Documentation & AI Evaluation$170 per hourMercor · Medicine · Listed $170 per hour
  3. Finance Expert - AI Training & Evaluation | Global$150 per hourRise Data Labs · Finance · Listed $150 per hour
  4. Finance Expert - AI Training & Evaluation | US, Canada & Europe$150 per hourRise Data Labs · Finance · Listed $150 per hour
  5. Offensive Cybersecurity Engineers: Build RL Environments for AI Evaluation$150 per hourTerac · Software Engineering · Listed $150 per hour
  6. Hardware Engineers: RTL Implementation and Evaluation Workflows$147 per hourTerac · Software Engineering · Listed $147 per hour
  7. Senior Software Engineer - AI Evaluation / Coding Agents ($100-150/hr)$125 per hourTuring · Software Engineering · Listed $100 to $150 per hour
  8. Applied Engineer, Evaluations Role$110 per hourMercor · Software Engineering · Listed $100 to $120 per hour
  9. Healthcare Expert - AI Training & Evaluation$100 per hourRise Data Labs · Medicine · Listed $50 to $150 per hour
  10. Legal & Paralegal Expert - AI Training & Evaluation$100 per hourRise Data Labs · Law · Listed $50 to $150 per hour

AI evaluator roles open today

In the board's Recommended order. Each title opens the role's page, with its full posting and its Apply link. A posting that a platform lists in 3 or more languages or places is one line, and its link opens those roles on the board.

These are the first 150 lines. Search the board for the rest.

New roles like this, by email.

Quick answers

Can I get paid to rate chatbot answers?

Jobs that pay people to rate chatbot answers are open now: 308 AI evaluator and rater roles were open on 15 platforms on . The median listed pay is $26 per hour, across 187 roles that state hourly pay.

What does an AI evaluator do?

An AI evaluator grades what an AI model writes or says, against the project's written guidelines. Some roles compare two answers and pick the better one. 308 such roles are open on this board today.

What is an AI rater job?

A rater scores results for how well they meet a request: search results, ads, map results or a model's answers. 79 of the open roles here say rater in their titles today.

What is RLHF work?

RLHF means reinforcement learning from human feedback. People grade or compare a model's answers, and the model is trained on their choices. No open role title says RLHF today, so this page counts the titles that say evaluation, rating or review.

How much do AI evaluator jobs pay?

The median listed pay is $26 per hour, across 187 roles that state hourly pay. The middle half list $23 to $66.25 per hour. Each platform sets its own pay, and it can change.

Do AI evaluator jobs need experience?

9 of the 308 roles are listed as general work, with no set field. 172 name a language in the title, and 121 sit under a field such as medicine, law or software. Read the posting before you apply.

Which platforms have AI evaluator jobs?

15 platforms list them today. The most are on Welo Data (93), Alignerr (67) and Turing (53). The table above shows every one.

Do AI evaluator jobs pay by the hour or by the task?

187 of the 308 roles state pay by the hour, 2 by the task, and 117 state no pay today.

Which countries can apply?

167 of the 308 roles name the countries they accept, most often the United States, India and Canada. A role that names no country may still accept yours: check the posting.

How we count

A role is here when its title names evaluation, rating, grading, RLHF, red teaming, search or ads quality, a quality analyst, or an AI, content, language or safety review. We read titles only, as the board's cards show them. Software testing roles, salaried staff jobs and paid research studies are left out.

Each role counts for one kind of work: the first kind whose words its title says, or whose field it sits under.

Pay is listed pay, the platform's word. A median uses the midpoint of each hourly rate or range, from 8 roles or more. We make no estimates and convert no pay.

We counted on .

More: Entry-level jobs · Highest pay · AI training pay · Platforms by country · Data annotation jobs

Back to the open roles. Not sure which one fits you? Match your resume to the open roles. Matching runs in your browser. Your resume stays on your device.

New to this work? Lesson 1 of our free school takes about 5 minutes, and you can get a badge.

New this week · Entry-level jobs · Jobs by country · Highest pay · Weekly index · All guides · Every role on the board · Every platform · How we count