Healthcare AI Quality Analyst (Contract)
About the Role
Job Title: Healthcare AI Quality Analyst (Contract)
Sector: Artificial Intelligence / Healthcare
Location: Remote
Source Platform: External Opportunity Network
Job Type: Contract
Description:
A structured AI evaluation initiative is seeking experienced healthcare professionals to contribute to the validation and improvement of AI-generated medical content. The work focuses on ensuring high standards of accuracy, safety, and reliability in outputs used within sensitive, high-stakes environments.
This opportunity is ideal for individuals with strong clinical or healthcare expertise who are comfortable applying critical judgment to complex information. It suits professionals who value precision, evidence-based reasoning, and clear written communication in analytical tasks.
The work involves reviewing and assessing AI-generated responses to health-related prompts, identifying inaccuracies or risks, and systematically scoring outputs using defined evaluation frameworks where attention to detail and domain expertise are critical.
What You'll Do
- Develop realistic prompts reflecting real-world healthcare inquiries
- Evaluate AI-generated responses for clinical accuracy and regulatory alignment
- Identify misleading claims, hallucinations, or unsupported references
- Compare and rank multiple outputs using structured scoring rubrics
- Document evaluation decisions with clear, evidence-based justifications
- Apply domain knowledge to assess safety and practical usefulness of responses
Requirements
- Master’s degree or higher in healthcare, medicine, or a related field
- Professional experience applying healthcare knowledge in practice or advisory roles
- Familiarity with clinical standards, regulatory frameworks, or medical guidelines
- Strong analytical thinking and critical reasoning skills
- Clear and precise written communication abilities
- Ability to work independently and manage flexible schedules in a remote setup
- Comfort with structured evaluation systems and scoring methodologies
- Preferred: Prior exposure to AI systems, model evaluation workflows, or tools such as ChatGPT or similar platforms