The system demonstrates robust performance with a 76% top-5 accuracy rate across diverse test matching scenarios. The architecture incorporates daily updates to the test compendium and weekly reference lab scrapes to maintain current information. A key feature is the LLM’s ability to provide detailed explanations for match suggestions, which has received positive feedback from SMEs.
The implementation aims to reduce test matching time by one-third while maintaining accuracy. This solution particularly excels in handling complex queries with variable information content, from simple test names to detailed specifications including methodology, specimen types, and CPT codes. The project showcases successful collaboration between AI teams and subject matter experts, demonstrating how artificial intelligence can enhance healthcare operations while preserving expert oversight.
Keywords: Healthcare AI, Test Matching, AWS, Machine Learning, Laboratory Operations, RAG Architecture.
About the speaker

He has worked on a variety of projects, including predictive analytics, payer life science work, full-stack data science development, and generative AI.
He began his career as a machine learning engineer at Allscripts, a large electronic health records company. He developed algorithms to predict patient risk of readmission, identify high-cost patients, and optimize clinical workflows. He then moved to a community-based health services provider where he led a team of data scientists in developing a full-stack data science solution to improve patient outcomes. In his most recent role at McKinsey & Company, he led a team of machine learning engineers in developing and deploying predictive models that have saved healthcare payers millions of dollars. Chris is now a Senior Health ML Solutions Architect at Amazon Web Services, where he helps healthcare and life science companies adopt generative AI. Generative AI can be used to generate new drug molecules, design clinical trials, or create personalized patient experiences.
When
Sessions: April 2nd – 3rd 2024
Trainings: April 15th – 19th 2024