Back to jobs
Job Description
**1\. Role Overview**
Mercor is seeking generalist experts to support a large-scale project with a leading AI research partner. The goal is to create and refine a diverse dataset of human-aligned tasks for supervised fine-tuning (SFT) of frontier models. Generalists will contribute by generating realistic prompts, evaluating AI outputs, and iterating on responses to ensure quality and domain relevance. This is a short-term, project-based opportunity ideal for professionals with broad analytical capabilities and writing skills.
**2\. Key Responsibilities**
- Create / evaluate base prompts across a range of generalist topics
- Review and revise AI-generated responses for clarity, accuracy, and alignment with human reasoning
- Develop prompt-response iterations using variations in length, style, and system prompts
- Contribute to benchmarking efforts by identifying failure points in model responses
- Create Rubrics to evaluate the prompts
- Apply consistent quality standards across diverse content types (e.g., summaries, Q&A, synthesis tasks)
**3\. Ideal Qualifications**
- 2+ years of experience in research, education, writing, editing, or adjacent analytical fields
- Proven ability to communicate complex topics clearly and concisely
- Strong attention to detail and critical thinking skills
- Comfort working independently with evolving task guidelines
- Familiarity with LLMs or AI-assisted writing tools is a plus
**4\. More About the Opportunity**
- Expected commitment: 10–25 hours/week
- Flexible task structure with batch-based assignments
**5\. Application Process**
- Submit your resume to get started
- Complete the Domain Expert interview
- We aim to follow up within a few business days
