AI Developer Trace Task Auditor
$70–$90/hr
New to Mercor? Create an account before applying.
Get new roles by emailFollow on X
- Pay
- $70 to $90 per hour
- Pay type
- Hourly
- Platform
- Mercor
- Field
- Finance
- Where
- Remote, for applicants in United States
- First seen
- Posted
- History
- Half of Mercor roles listed since Oct 2 were gone within 28 days (of 329). How long roles stay open
- Feed read
This listing comes from Mercor's own public job feed. The posting on Mercor is the source of truth.
About the role
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.
Basic Qualifications
- 3+ years professional software development
- Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
- Strong code-reading and debugging skills across full-stack or backend systems
- Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications
- Experience with Kiro or Amazon CodeCatalyst
- Prior work evaluating or grading AI-generated code
- Contributions to developer tooling