For companies: explore licensing operational data for AI. Check eligibility

Andromeda Shimu Deep Research Reviewer (EN-US)New

$28/hr

Apply on Welo Data →

Get new roles by emailFollow on X

Jobs › Science & Research › Welo Data

Pay
$28 per hour
Pay type
Hourly
Platform
Welo Data
Field
Science & Research
Where
Remote, for applicants in United States
First seen
Posted
Feed read

This listing comes from Welo Data's own public job feed. The posting on Welo Data is the source of truth.

About the role

About the Role
We're looking for a QA Deep Research Reviewer to evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines. You'll read documents that include tables and citations, judge each criterion on its own merits, and write clear, evidence-based rationales that help us improve the quality of AI research tools. This role suits someone with a sharp editorial eye, a fact-checker's instincts, and the discipline to apply guidelines consistently
Project Details:
Location: Remote (United States)
Commitment: 15-20 hours per week
Engagement type: Freelancer
Pay rate: Philippines: $28 USD

What You'll Do

  • Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments
  • Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages
  • Write short, specific rationales (1-3 sentences) that point to concrete evidence
  • Follow guideline updates and calibrate your decisions consistently with the QA team.

Must-Have Qualifications

  • Native or near-native US English (C2), with the ability to read long documents containing tables and citations
  • Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA
  • Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)
  • Ability to write concise rationales that cite evidence
  • Ability to judge each criterion independently, without letting an overall impression influence the call
  • Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer.

More: Every role for scientists · Roles open in United States · No tasks? Roles open on other platforms · What AI training roles pay · Free resume help