Integrating Multimodal RAG and Human-in-the-Loop for Scalable Healthcare IT Applications: From Analytics to Dx Coding

In this work, we present an integrated framework employing multimodal Retrieval-Augmented Generation (RAG) combined with human-in-the-loop oversight to address a spectrum of applications in healthcare IT. This framework is designed to harness both textual and visual data, facilitating comprehensive information extraction for enhanced decision-making across various domains, including analytics optimization, knowledge base synthesis, and diagnostic (Dx) coding accuracy.

Our approach leverages the strengths of multimodal RAG to interpret complex datasets, incorporating visual and textual clues for a richer analysis. The inclusion of human-in-the-loop mechanisms further refines the system’s output, ensuring both scalability and precision in applications ranging from function calling in analytics platforms to the generation of dynamic, accurate knowledge repositories and the substantiation of Dx codes through precise ICD-10-CM mapping.

We detail the architecture’s design principles, emphasizing its modular nature that allows for scalability across different healthcare IT needs. Through case studies, we demonstrate the architecture’s effectiveness in improving operational efficiencies, enhancing the reliability of clinical data interpretation, and supporting comprehensive knowledge synthesis. This work underscores the potential of multimodal RAG systems in transforming healthcare IT by providing a robust, scalable solution for integrating diverse data types into actionable insights.

About the speaker

Rosh Singh

CTO at Cozeva – Applied Research Works

Rupinder (Rosh) Singh serves as the Chief Technology Officer at Cozeva, bringing a wealth of expertise with over 15 years in product management, artificial intelligence, machine learning, and mathematical modeling. His previous role as Vice President of Product Management at Cozeva saw him leading the charge on developing innovative analytics, business intelligence, and new technology solutions to enhance payer-provider risk-sharing agreements. Singh’s notable contributions include creating decision science technology that underpins multibillion-dollar transactions and patented methods to advance cardiac care. His career also includes a tenure at Amazon, and he holds a Ph.D. in Biomedical Engineering from Cornell University.



Online Event: April 2-3, 2024



Presented by