Large Language Models in Real-World Clinical Workflows: A Systematic Review of Applications and Implementation

Yaara Artsi^1,2*Vera Sorin³Benjamin S Glicksberg^4,5,6Panagiotis Korfiatis³Girish N Nadkarni^4,5,6Eyal Klang^4,5,6

• ¹Bar-Ilan University Press, Ramat Gan, Israel
• ²Azrieli Faculty of Medicine, Bar-Ilan University, Zefat, Israel, Zefat, Israel
• ³Department of Radiology, Mayo Clinic, Rochester, MN, USA, Minnesota, United States
• ⁴The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA, New York, United States
• ⁵The Windreich Department of Artificial Intelligence and Human Health, Mount Sinai Medical Center, NY, USA, New York, United States
• ⁶The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, NY, USA, New York, United States

ABSTRACT Background Large language models (LLMs) offer promise for enhancing clinical care by automating documentation, supporting decision-making, and improving communication. However, their integration into real-world healthcare workflows remains limited and under characterized. This systematic review aims to evaluate the literature on real-world implementation of LLMs in clinical workflows, including their use cases, clinical settings, observed outcomes, and challenges. Methods We searched MEDLINE, Scopus, Web of Science, and Google Scholar for studies published between January 2015 and April 2025 that assessed LLMs in real-world clinical applications. Inclusion criteria were peer-reviewed, full-text studies in English reporting empirical implementation of LLMs in clinical settings. Study quality and risk of bias were assessed using the PROBAST tool. Results Four studies published between 2024 and 2025 met inclusion criteria. All used generative pre-trained transformers (GPTs). Reported applications included outpatient communication, mental health support, inbox message drafting, and clinical data extraction. LLM deployment was associated with improvements in operational efficiency, user satisfaction, and reduced workload. However, challenges included performance variability across data types, limitations in generalizability, regulatory delays, and lack of post-deployment monitoring. Conclusions Early evidence suggests that LLMs can enhance clinical workflows, but real-world adoption remains constrained by systemic, technical, and regulatory barriers. To support safe and scalable use, future efforts should prioritize standardized evaluation metrics, multi-site validation, human oversight, and implementation frameworks tailored to clinical settings.