Mercor opens its Explore page; search for "AI Developer Trace Task Auditor" to find this role.

AI Developer Trace Task Auditor
Apply NowReferral link · no cost to you
← Back to all jobs
Get new roles the moment they’re postedTelegramDiscord
MC
MercorSoftware Engineering

AI Developer Trace Task Auditor

Remote · US only$70–$90 per hourContract / Freelance

About the Role

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback. Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling


Eligibility

Mercor lists this role for residents of the United States.

Similar Opportunities

Recommended AI training and data annotation positions

View all jobs →
Up to $30per hour
SME Careers

Blender Specialist

Remote31 countries onlyContract / FreelanceAdvanced / Expert

1w ago
Up to $20per hour
SME Careers

PyCharm Specialist

RemoteBangladesh, India & Pakistan onlyContract / FreelanceAdvanced / Expert

2026-10-12
$25–$60per hour
Micro1High demand

Game Developer

RemoteContract / FreelanceAdvanced / Expert

2026-10-09