Dutch Audio Generalist Evaluator Expert

Mercor is seeking **detail-oriented transcribing and writing experts** to contribute to a high-impact **audio AI research project** with a leading lab. Freelancers will listen to and transcribe audio, annotate images, and evaluate videos to help train advanced language models. This is a **short-term, flexible opportunity** for professionals with strong academic backgrounds, **fluent in both Dutch and English**, and with a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted text. ## Job Details ### Transcribe and Optimise Audio/Video - Create detailed audio and video transcriptions with multiple constraints and instructions in **Dutch**, with supporting work in **English** when required. ### Define and Document Evaluation Standards - Establish high-level expectations for correct responses in general consumer audio contexts. - Develop comprehensive evaluation rubrics and guidelines in Dutch and English. ### Conduct Model Testing and Grading - Run prompts through models and assess preliminary outputs against defined expectations. ### Support Benchmarking and Quality Assurance - Collaborate in QA review processes to ensure prompt tasks and rubrics meet high standards of rigour. - Maintain consistency and reliability before integration into official benchmarks. * * * ## Minimum Qualifications - Strong writing and critical thinking skills - Ability to work independently and meet deadlines - **Fluent in Dutch and English** - **Able to work within GMT or PST working hours** * * * ## Preferred Qualifications - College students or graduates * * * ## Application & Onboarding Process - Complete an AI-led interview (approximately 15 minutes) - If selected, you will be invited to work on the project * * * ## More Details About This Role - Expected commitment of **3–6 months** - You’ll work in a structured project environment with clear goals and tools