Computing and ICT
Active Posting
AI Developer Trace Task Auditor
Mercor
Remote, United States of America
Contract
Mid Level
Job Description
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.
Duties & Responsibilities
Basic Qualifications\n\t\t• 3+ years professional software development\n\t\t• Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)\n\t\t• Strong code-reading and debugging skills across full-stack or backend systems\n\t\t• Ability to evaluate multi-step coding trajectories for correctness and best practice\n\t\nPreferred Qualifications\n\t\t• Experience with Kiro or Amazon CodeCatalyst\n\t\t• Prior work evaluating or grading AI-generated code\n\t\t• Contributions to developer tooling
Basic Qualifications\n\t\t• 3+ years professional software development\n\t\t• Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)\n\t\t• Strong code-reading and debugging skills across full-stack or backend systems\n\t\t• Ability to evaluate multi-step coding trajectories for correctness and best practice\n\nPreferred Qualifications\n\t\t• Experience with Kiro or Amazon CodeCatalyst\n\t\t• Prior work evaluating or grading AI-generated code\n\t\t• Contributions to developer tooling
Required Skills
Ability to evaluate multi-step coding trajectories for correctness and best practice, Strong code-reading and debugging skills across full-stack or backend systems, Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
Benefits & Perks
$70-$90 per hour, Hourly contract
How to Apply
Apply now
AI Custom Cover Letter Assistant
Draft a personalized, high-converting cover letter tailored specifically to this position using your selected Career Profile and AI NLP orchestration.
Sign in to generate a custom AI cover letter tailored to this job!
Sign In / RegisterInstant Match % Analysis
Sign in and set up your Career Profile to calculate your match compatibility score for this position.
Sign In to Calculate MatchJob Summary
- Posted Date Oct 12, 2026
- Expiration Date Open until filled
- Category Computing and ICT
- Job Type Contract
- Level Mid Level