Internal Medicine Clinical Reasoning Specialist (AI Healthcare)
About the Role
A high-impact healthcare AI initiative is seeking Internal Medicine professionals to support the development and evaluation of advanced clinical reasoning systems. This opportunity focuses on improving the quality, accuracy, and evidence-based performance of next-generation healthcare AI models.
This opportunity is ideal for board-certified physicians, hospitalists, subspecialists, fellows, and senior residents with strong clinical judgment and a commitment to evidence-based medicine. Individuals who enjoy analyzing complex clinical scenarios and providing structured evaluations will be well suited for the role.
The work involves creating realistic patient-care scenarios, assessing model-generated clinical responses, and contributing expert feedback that supports ongoing model improvement, where accuracy, consistency, and guideline alignment are critical.
What You'll Do
- Develop clinically realistic case scenarios based on Internal Medicine practice
- Create high-quality reference responses that reflect attending-level clinical reasoning
- Evaluate AI-generated outputs using structured assessment frameworks
- Assess diagnostic reasoning, treatment recommendations, and risk stratification approaches
- Verify alignment with current clinical guidelines and evidence-based standards
- Provide detailed written feedback to support model improvement efforts
- Participate in onboarding activities and calibration sessions
- Maintain consistency and quality across evaluation tasks
- Contribute subject-matter expertise to healthcare-focused AI initiatives
Requirements
- Board certification in Internal Medicine with an active, unrestricted medical license (for attending physicians)
- Final-year Internal Medicine residency status with board eligibility upon completion (for residents)
- Board-certified or board-eligible status in a primary specialty with an active, unrestricted license (for fellows)
- Strong knowledge of evidence-based Internal Medicine practice
- Ability to evaluate clinical reasoning and decision-making processes
- Experience interpreting and applying clinical guidelines
- Excellent written communication and documentation skills
- Ability to provide structured, objective feedback
- Strong attention to detail and analytical thinking
- Comfortable working independently in a fully remote environment
- Availability for approximately 20 hours per week or more, depending on project needs
- Eligibility to work as an independent contractor
- Preferred: Experience with clinical education, medical content development, peer review, or healthcare AI evaluation
- Preferred: Familiarity with AI-assisted workflows and tools such as ChatGPT or similar large language models
- Preferred: Subspecialty expertise in areas such as Cardiology, Hematology/Oncology, Endocrinology, Nephrology, Gastroenterology, Pulmonology, or related Internal Medicine disciplines