← All jobs

AI Developer Trace Task Auditor (Train AI Models Part Time!)

up to $400k/year Remote Full-time
Full Stack Python DeveloperFull Stack Java DeveloperPython DeveloperNode.js DeveloperJava DeveloperProduct EngineerPrompt EngineerFull Stack Node.js DeveloperPlatform EngineerSoftware Developer in Test

Archer is matching candidates to this role at Mercor. Create a free profile and Archer will check you against this role and every other live role, showing you exactly where you match.

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback. Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling

Apply knowing you're qualified

One free profile is all it takes. Archer checks you against this role and every other live role we list, and shows you exactly which requirements you meet before you apply.

More roles like this

See all Java jobs

Not quite the right role?

Archer scans thousands of live roles and surfaces the ones you genuinely match, each with a clear explanation of why. It keeps working after you apply, so you hear about roles you would never have found by searching.

Create your free profile