**Location**: Geography restricted to USA, UK, Canada, EU
**Type**: Full-time or Part-time Contract Work
**Fluent Language Skills Required:** English
**Why This Role Exists**
Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
In physics-related contexts, conversational AI systems must demonstrate strong theoretical grounding, quantitative rigor, and precise reasoning. This project focuses on evaluating and improving how models explain, reason about, and respond to physics-related questions across both foundational and advanced topics.
**What You’ll Do**
- **Write and refine prompts** to guide model behavior in physics contexts
- **Evaluate LLM-generated responses** to physics-related queries for conceptual accuracy, mathematical correctness, and reasoning quality
- **Conduct fact-checking** using authoritative public sources and domain knowledge
- **Annotate model responses** by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
- **Assess clarity, structure, and appropriateness of explanations** for different audiences
- Ensure **model responses align with expected conversational behavior** and system guidelines
- **Apply consistent evaluation standards** by following clear taxonomies, benchmarks, and detailed evaluation guidelines
**Who You Are**
- You hold a **PhD in Physics or closely related field**
- You have deep expertise in **one or more of the following sub-domains**:
- Classical Mechanics & Dynamics
- Electromagnetism, Optics & Signals
- Thermodynamics & Statistical Physics
- Quantum Physics
- Relativity, Cosmology & High-Energy Physics
- You have **significant experience using large language models** (LLMs) and understand how and why people use them
- You have **excellent writing skills** and can clearly explain complex physics concepts
- You have **strong attention to detail** and consistently notice subtle issues others may overlook
- **Experience reviewing or editing technical or academic writing**
**Nice-to-Have Specialties**
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience teaching, mentoring, or explaining physics concepts to non-expert audiences
- Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
**What Success Looks Like**
- You identify conceptual inaccuracies or weak reasoning in physics-related model outputs
- Your feedback improves the rigor, clarity, and correctness of AI explanations
- You deliver consistent, reproducible evaluation artifacts that strengthen model performance
- Mercor customers trust their AI systems in physics contexts because you’ve rigorously evaluated them
**Why Join Mercor**
Mercor offers PhD-level scientists the opportunity to directly influence how advanced AI systems reason about complex scientific concepts. This flexible, remote role allows you to apply deep expertise beyond academia while contributing to high-impact AI development work.
hackajob is partnering with Mercor to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.