AMIE: A Research AI System for Diagnostic Medical Reasoning and Conversations

The physician-patient conversation is a cornerstone of medicine, in which skilled and intentional communication drives diagnosis, management, empathy and trust. AI systems capable of such diagnostic dialogues could increase availability, accessibility, quality and consistency of care by being useful conversational partners to clinicians and patients alike. But approximating clinicians’ considerable expertise is a significant challenge.

Inspired by this challenge, we developed Articulate Medical Intelligence Explorer (AMIE), a research AI system based on a LLM and optimized for diagnostic reasoning and conversations. We trained and evaluated AMIE along many dimensions that reflect quality in real-world clinical consultations from the perspective of both clinicians and patients. To scale AMIE across a multitude of disease conditions, specialties and scenarios, we developed a novel self-play based simulated diagnostic dialogue environment with automated feedback mechanisms to enrich and accelerate its learning process.

We also introduced an inference time chain-of-reasoning strategy to improve AMIE’s diagnostic accuracy and conversation quality. Finally, we tested AMIE prospectively in real examples of multi-turn dialogue by simulating consultations with trained actors.

About the speaker
Hoifung Poon

Mike Schaekermann

Research Scientist at Google

Mike Schaekermann is a Research Scientist at Google Research where he contributes to the human-centered application of AI to healthcare through the use of computational and socio-technical methods. Mike received a PhD in Computer Science from the University of Waterloo, a BSc from Salzburg University of Applied Sciences, and a medical degree (equiv. to BSc) from the University of Marburg. During his PhD, Mike spent two years with the Google Health team contributing to improvements to the ground truthing process in medical settings. His work has been published in premier HCI conferences (CHI, CSCW) and medical journals and has been recognized with several awards, including the Google PhD Fellowship and the Canadian Computer Science Distinguished Dissertation Award.

NLP-Summit

When

Sessions: April 2nd – 3rd 2024
Trainings: April 15th – 19th 2024

Contact

nlpsummit@johnsnowlabs.com

Presented by

jhonsnow_logo