Empowering Healthcare through NLP: Harnessing Clinical Document Insights at Intermountain Health

Clinical documents play a pivotal role in patient care, research, and Health Information Management (HIM). At Intermountain Health, we present a comprehensive approach to unlocking valuable insights from these documents through Natural Language Processing (NLP) on the Databricks Lakehouse Platform. Our strategy involves leveraging advanced Electronic Health Records (EHRs) management, processing, and analysis to transform hundreds of millions of unstructured clinical documents into precise, accessible, and collaborative resources. This not only aids in guiding medical decisions but also enhances patient care and accelerates research endeavors.

Our workflow begins with decompressing raw files and storing them as delta tables, followed by the application of John Snow Labs’ medical NLP libraries to deidentify Personally Identifiable Information (PII). The resulting data is then made available for research purposes and shared with Intermountain’s research subsidiaries. Next, we employ medical text summarization models to create synopses of the notes.

The process reduces review time from 10 minutes to 3 minutes per document. Finally, we utilize Generative AI applications for seamless querying of the database using natural language, facilitating a more intuitive and user-friendly interaction with the wealth of information stored within the clinical documents. This integrated approach not only enhances the efficiency of research initiatives but also contributes to the overall improvement of healthcare outcomes.

About the speakers

Hoifung Poon

Dylan Wagenseller

Senior Data Architect at Intermountain Health

Dylan Wagenseller is currently a Data Architect at Intermountain Health. He has worked with healthcare data for approximately 9 years from various EMRs. Having had some full stack development experience from a startup, he utilized his knowledge of Python to develop GenAI applications in Databricks.

Hoifung Poon

Yinxi Zhang

Staff Data Scientist at Databricks

Yinxi is a Staff Data Scientist at Databricks, where she works with customers to build end-to-end AI systems at scale. She has worked with numerous customers across different verticals and witnessed the value add by big data and AI. She holds a Ph.D. in Electrical Engineering from the University of Houston. Yinxi is a former marathon runner, and is now a happy yogi.



Sessions: April 2nd – 3rd 2024
Trainings: April 15th – 19th 2024



Presented by