Internal Medicine Expert – AI Clinical Reasoning
About the Role
A leading healthcare AI initiative is seeking Internal Medicine professionals to contribute clinical expertise toward the development and evaluation of advanced AI systems. The work focuses on improving clinical reasoning, diagnostic accuracy, treatment recommendations, and evidence-based decision-making capabilities within healthcare-focused AI models.
This opportunity is ideal for attending physicians, fellows, and senior trainees with strong foundations in Internal Medicine and a commitment to evidence-based practice. Professionals with experience across general internal medicine or subspecialty disciplines are encouraged to apply.
The work involves designing realistic clinical scenarios, evaluating AI-generated medical responses, developing high-quality reference answers, and providing structured feedback to improve model performance. Success in this role requires strong clinical judgment, attention to detail, and the ability to communicate complex medical concepts clearly and accurately.
What You'll Do
- Design realistic Internal Medicine clinical scenarios based on real-world patient care situations
- Develop high-quality reference responses aligned with current clinical standards and best practices
- Evaluate AI-generated outputs for clinical accuracy, reasoning quality, and guideline adherence
- Assess diagnostic approaches, treatment plans, risk stratification methods, and patient management recommendations
- Apply structured evaluation rubrics to review model performance consistently
- Provide detailed written feedback to support ongoing model improvement
- Review medical content for accuracy, completeness, and evidence-based alignment
- Participate in onboarding activities and calibration exercises to ensure evaluation consistency
- Contribute clinical expertise to healthcare-focused AI research and development initiatives
Requirements
- Board-certified Internal Medicine physician with a current, active, unrestricted medical license; or
- Final-year Internal Medicine resident who is board-eligible or recently completed training; or
- Internal Medicine fellow who is board-certified or board-eligible in their primary specialty with a current, active, unrestricted medical license
- Strong knowledge of Internal Medicine practice, diagnostic reasoning, and patient management
- Ability to evaluate clinical content using evidence-based standards and professional judgment
- Excellent written communication and medical documentation skills
- Strong analytical thinking and attention to detail
- Ability to provide clear, structured, and actionable feedback
- Comfort working independently within a remote and asynchronous environment
- Commitment to maintaining high-quality clinical and professional standards
- Availability for approximately 20 hours per week, with potential for increased workload based on project needs
- Experience teaching, supervising, mentoring, reviewing clinical cases, or participating in quality improvement initiatives preferred
- Experience evaluating medical content, clinical guidelines, healthcare education materials, or research outputs preferred
- Familiarity with AI-assisted healthcare tools, clinical decision support systems, or platforms such as ChatGPT preferred
- Subspecialty expertise in Cardiology, Hematology/Oncology, Endocrinology, Nephrology, Gastroenterology, Pulmonology, or related Internal Medicine disciplines preferred