Board-Certified Dermatologist – Clinical AI Evaluation Specialist
About the Role
A high-impact healthcare AI initiative is seeking experienced dermatology physicians to evaluate the clinical accuracy, safety, and reliability of AI-generated medical responses. The project focuses on improving AI performance through structured assessments of dermatology-related clinical scenarios and de-identified patient records.
This opportunity is suited to board-certified dermatologists with active US medical licenses, independent clinical practice experience, and strong knowledge of current dermatology standards of care. Candidates must demonstrate sound clinical judgment, analytical ability, and precise written communication.
The work involves reviewing de-identified patient charts, comparing AI-generated responses to clinical questions, identifying inaccuracies, and documenting structured evaluation rationales. Clinical rigor, patient safety awareness, and consistency in medical judgment are critical.
What You'll Do
- Evaluate AI-generated responses to dermatology-related clinical questions for accuracy and safety.
- Review de-identified patient charts to validate clinical context and supporting evidence.
- Compare alternative AI-generated responses and determine which demonstrates stronger clinical reasoning.
- Assess responses against current dermatology standards of care.
- Document structured rationales covering clinical accuracy, completeness, and clarity.
- Identify and flag medical errors, unsafe recommendations, and potential patient safety risks.
- Provide consistent clinical assessments to support AI model quality improvement.
Requirements
- MD or DO degree from an accredited medical school.
- Board certification in Dermatology through an ABMS member board or the American Osteopathic Association (AOA).
- Active and unrestricted US medical license.
- Completed dermatology residency training.
- Completed fellowship training where required for the relevant specialty.
- Currently practicing and actively seeing patients in the United States.
- Minimum of 1 year of independent clinical practice experience following completion of training.
- Strong understanding of current dermatology guidelines, diagnostic approaches, and treatment standards.
- Ability to critically evaluate clinical information and identify potentially unsafe medical recommendations.
- Excellent written communication and structured documentation skills.
- High attention to detail and ability to maintain consistency across clinical evaluations.
- Ability to work independently in a fully remote environment.
- Availability for flexible, part-time hourly contract work.
- Must be eligible to work under an independent contractor arrangement in the United States.
- Candidates requiring H-1B or STEM OPT sponsorship are not supported.
- Preferred: 3 or more years of post-training clinical experience.
- Preferred: Experience with medical AI evaluation, clinical research, medical writing, or evidence-based clinical assessment.