Internal Medicine AI Clinical Reviewer
About the Role
A high-impact healthcare AI initiative is seeking Internal Medicine professionals to contribute to the development and evaluation of advanced clinical reasoning systems. The work focuses on improving how large-scale AI models interpret patient presentations, apply evidence-based medicine, and generate medically sound recommendations.
This opportunity is ideal for attending physicians, fellows, and senior residents with strong diagnostic reasoning skills and experience in evidence-based patient care. Individuals with subspecialty exposure in areas such as Cardiology, Endocrinology, Nephrology, Pulmonology, Gastroenterology, or Hematology/Oncology may be especially well aligned with the work.
The work involves designing realistic clinical scenarios, reviewing AI-generated medical outputs, and producing high-quality reference responses across Internal Medicine workflows where precision, guideline alignment, and structured clinical judgment are critical.
What You'll Do
- Design realistic Internal Medicine clinical scenarios and diagnostic reasoning prompts
- Develop attending-level reference answers for clinical evaluation tasks
- Evaluate AI-generated medical responses using structured scoring frameworks
- Assess treatment plans, risk stratification logic, and guideline adherence
- Provide detailed written feedback to improve clinical reasoning quality in AI systems
- Participate in onboarding sessions and calibration activities for evaluation consistency
- Collaborate within asynchronous remote project workflows
- Maintain high standards for medical accuracy and evidence-based reasoning
Requirements
- Board-certified Internal Medicine physician with active unrestricted medical license, OR
- Final-year Internal Medicine resident with board-eligible status, OR
- Fellow with board certification/eligibility in primary specialty and active unrestricted license
- Strong understanding of evidence-based Internal Medicine practice
- Ability to evaluate complex clinical reasoning objectively and consistently
- Experience with diagnostic workflows, treatment planning, and clinical documentation
- Strong written communication and analytical skills
- Comfort working independently in a fully remote asynchronous environment
- Availability for approximately 20 hours per week or more based on project demand
- Must be located in the United States or Canada
- Preferred: Experience reviewing medical content, clinical education materials, or healthcare AI outputs
- Preferred: Familiarity with structured evaluation rubrics and AI-assisted workflows such as ChatGPT or related systems