Back to all jobs
AI
Generalist Research Specialist — AI Evaluation
Remote Part-time Platform: Mercor
About the Role
A structured AI research initiative focused on benchmarking and improving advanced language models through high-quality research questions, answers, and evaluation materials.
This opportunity is ideal for individuals with 2–3 years of relevant professional experience or current/recent postgraduate study, particularly those with strong research, reasoning, and communication skills. Interdisciplinary academic backgrounds are useful but not required.
The work involves researching diverse topics, synthesizing information from multiple sources, creating evaluation materials, and assessing AI-generated outputs. Independent work, clear written communication, and consistent research quality are critical.
What You'll Do
- Develop high-quality research questions for AI model evaluation.
- Produce accurate, well-structured answers based on research.
- Gather and synthesize information from diverse online sources.
- Create evaluation materials for advanced language models.
- Assess AI-generated responses for accuracy, relevance, reasoning, and quality.
- Communicate research findings and conclusions clearly.
- Apply consistent evaluation criteria across assigned tasks.
- Complete approximately 10–20 hours of project work per week.
- Adapt to changing project requirements and evaluation priorities.
Requirements
- 2–3 years of relevant professional experience with a bachelor’s degree, or current/recent postgraduate study.
- Strong online research and information-gathering skills.
- Ability to evaluate sources and synthesize information accurately.
- Excellent written communication and summarization skills.
- Strong analytical and reasoning abilities.
- Ability to work independently in a remote environment.
- Interdisciplinary academic or professional background preferred.
- Ownership of a MacBook with Apple Silicon, including an M-series MacBook Pro or MacBook Air.
- MacBook must run macOS 15 or higher.
- Availability for approximately 10–20 hours per week.
- Ability to work as an independent contractor.
- Access to a suitable payment method for contractor payments, such as Stripe or Wise.
- Eligibility to participate in the applicable contractor arrangement.
Application Note: By submitting your profile for this partnered position, our team can quickly review your background and reach out to present you with this specific opportunity or match you with similar AI Training projects.