**1\. Role Overview** Mercor is partnering with a leading AI research organization to engage experienced marketing professionals for a project focused on evaluating how well AI systems perform real-world marketing work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications. **2\. Key Responsibilities** - Design precise, task-specific grading criteria for real-world marketing deliverables (creative briefs, campaign concepts and decks, brand positioning and messaging frameworks, ad copy and scripts, integrated campaign plans, client-ready presentations) - Score AI-generated and human work samples against those criteria, with detailed written justifications for every score - Apply consistent, evidence-based judgment so that scores are reproducible and defensible - Incorporate structured feedback from senior reviewers and iterate quickly on your work **3\. Ideal Qualifications** - 5+ years of professional experience in marketing or advertising - Background as a creative director, account lead, or brand strategist at top-tier global creative agencies, or in senior brand marketing roles at leading consumer companies - Deep fluency in the day-to-day craft: writing and evaluating creative briefs, campaign development across channels, brand positioning and messaging, and judging creative work against a brief and a business objective - Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar - Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers - Prior experience with AI training, evaluation, or human-data projects is a strong plus - No specialized media-planning or measurement background is required for this role **4\. Application Process** - Submit your resume or relevant professional background to get started - Qualified applicants may be asked to complete a brief assessment or submit additional information
hackajob is partnering with Mercor to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.
Upskill
Level up the hackajob way. Verify your skills, learn brand new ones and test your ability with Pathways, our learning and development platform.
Find out more