Subject Matter Expert (SME) – LLM Validation
Job Description
We are seeking subject matter experts to evaluate AI-generated scientific responses across multiple subject domains. This position requires academic knowledge to assess AI-generated content quality.
Subject areas: Life & Health Sciences | Physical Sciences | Engineering & Technology | Social Sciences, Arts & Humanities
- Review and evaluate scientific AI-generated responses
- Rate scientific AI-generated responses based on pre-determined metrics and scales and provide written feedback
- Review scientific AI-generated responses within specified deadlines (approximately 60 minutes per query)
- PhD in a relevant subject area
- Currently working as an academic researcher, corporate researcher, or technical librarian
- Minimum 2 years of professional experience post-PhD
- Flexibility: Set your own work hours to match your lifestyle.
If you are among the qualified candidates, one of our recruiters will email you with further details.
Established in 2002, Cactus Communications (cactusglobal.com) is a leading technology company that specializes in expert services and AI-driven products which improve how research gets funded, published, communicated, and discovered. Its flagship brand Editage offers a comprehensive suite of researcher solutions, including expert services and cutting-edge AI products like Mind the Graph, Paperpal, and R Discovery. With offices in Princeton, London, Singapore, Beijing, Shanghai, Seoul, Tokyo, and Mumbai and a global workforce of over 3,000 experts, CACTUS is a pioneer in workplace best practices and has been consistently recognized as a great place to work.
- Employers of the Future, 2024
- Excellence in Employer Branding (Gold), 2024
- ISO 17100 certification for translation services, 2024
- Future of Workplace Disruptor, 2023
- Top 100 Companies for Remote Jobs (Ranked #14), 2023
- Three-star “Eruboshi” certification, 2023
- India’s Best Workplaces™ for Women (Top 100), 2022
- Quartz’s Best Companies for Remote Workers, 2022
- HR Asia’s Best Companies to Work for in Asia, 2021
- PhD in a relevant subject area
- Currently working as an academic researcher, corporate researcher, or technical librarian
- Minimum 2 years of professional experience post-PhD
- Review and evaluate scientific AI-generated responses
- Rate scientific AI-generated responses based on pre-determined metrics and scales and provide written feedback
- Review scientific AI-generated responses within specified deadlines (approximately 60 minutes per query)