Real-World Integration of a Sepsis Deep Learning Technology Into Routine Clinical Care: Implementation Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Background: Successful integrations of machine learning into routine clinical care are exceedingly rare, and barriers to its adoption are poorly characterized in the literature. Objective: This study aims to report a quality improvement effort to integrate a deep learning sepsis detection and management platform, Sepsis Watch, into routine clinical care. Methods: In 2016, a multidisciplinary team consisting of statisticians, data scientists, data engineers, and clinicians was assembled by the leadership of an academic health system to radically improve the detection and treatment of sepsis. This report of the quality improvement effort follows the learning health system framework to describe the problem assessment, design, development, implementation, and evaluation plan of Sepsis Watch. Results: Sepsis Watch was successfully integrated into routine clinical care and reshaped how local machine learning projects are executed. Frontline clinical staff were highly engaged in the design and development of the workflow, machine learning model, and application. Novel machine learning methods were developed to detect sepsis early, and implementation of the model required robust infrastructure. Significant investment was required to align stakeholders, develop trusting relationships, define roles and responsibilities, and to train frontline staff, leading to the establishment of 3 partnerships with internal and external research groups to evaluate Sepsis Watch. Conclusions: Machine learning models are commonly developed to enhance clinical decision making, but successful integrations of machine learning into routine clinical care are rare. Although there is no playbook for integrating deep learning into clinical care, learnings from the Sepsis Watch integration can inform efforts to develop machine learning technologies at other health care delivery systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Conversely, alerts that are poorly integrated into workflow can increase interruptions, contribute to unnecessary antibiotics, and shift attention away from other competing tasks.”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Sendak et al. performed a single-center implementation study integrating a deep learning-based sepsis detection platform into the emergency department of an academic health system. They used EHR time-series data from ~39,918 adult ED encounters to develop and deploy a multitask Gaussian processes (MGPs)–recurrent neural network (RNN) model within a real-time clinical workflow.”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Studies of sepsis alerts frequently report improvements in process measures such as time-to-antibiotics or completion of key bundle elements, particularly when these alerts are coupled to structured triage, escalation, and rapid clinician response.”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Implementation barriers for sepsis AI cluster around trust and interpretability, workflow integration, technical readiness and generalizability, governance and safety, leadership alignment, and the resources required for sustainment (Table 4) [10,33,34,46,48,77,78].”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The system was successfully implemented with high clinician engagement and continuous risk prediction, demonstrating feasibility of real-world integration but requiring substantial infrastructure and organizational coordination [10].”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 1×
“The next goal to drive adoption was to broadly communicate the change vision and empower action [43,44].”
BackgroundHigh-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“Machine learning, a set of statistical methods optimized for prediction on new observations, is central to this transformation [1].”
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Surviving Sepsis Campaign: International guidelines for management of sepsis and septic shock: 2016.
Rhodes, A., Evans, L. E., Alhazzani, W., Levy, M. M., Antonelli, M., Ferrer, R., Kumar, A., Sevransky, J. E., Sprung, C. L., Nunnally, M. E., et al. (2017) · Intensive Care Medicine · doi:10.1007/s00134-017-4683-6 · Cited by 6,621
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“All new machine learning implementations have the potential for introducing inequality and bias that is not always clearly visible in numeric data [45-48].”
BackgroundRecurrent Neural Networks for Multivariate Time Series with Missing Values
Che, Z., Purushotham, S., Cho, K., Sontag, D., & Liu, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24271-9 · Cited by 2,370 · cited 1×
“RNNs are a type of deep learning configured to ingest time series data and are ideally suited to combine static and dynamic features of hospital encounters that vary in length [39,40].”
BackgroundAbràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638 · cited 1×
“Isolated efforts demonstrating the clinical impact of previously validated technologies show the potential of machine learning in health care [3,4].”
BackgroundPrognosis Research Strategy (PROGRESS) 3: Prognostic Model Research
Steyerberg, E. W., Moons, K. G. M., van der Windt, D. A., Hayden, J. A., Perel, P., Schroter, S., Riley, R. D., Hemingway, H., Altman, D. G., & for the PROGRESS Group (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001381 · Cited by 1,508
Research works printed but not linked: 5
- SculleyDHoltGGolovinDHidden Technical Debt in Machine Learning SystemsNIPS Proceedings20142020-06-16https://papers.nips.cc/paper/5656-hidden-technical-debt-in-machine-learning-systems.pdf
- SariaSSubbaswamyATutorial: Safe and Reliable Machine LearningACM Conference on Fairness, Accountability, and Transparency201901FAT'19January 29-31, 2019Atlanta, USA
- 10.5555/3305381.3305503 · doi:10.5555/3305381.3305503
- Barocas, S, 2016, Cal L Rev, 104, 671
- Moore, G, 2006, Crossing the Chasm: Marketing and Selling High-Tech Products to Mainstream Customers
Cited by
Items 101–200 of 289
van Velzen, M., de Graaf-Waar, H. I., Ubert, T., van der Willigen, R. F., Muilwijk, L., Schmitt, M. A., Scheper, M. C., & van Meeteren, N. L. U. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02372-4 · Cited by 13
Başer, H. Y., Evran, T., & Çifçi, M. A. (2025) · Biomedicines · doi:10.3390/biomedicines13061449 · Cited by 16
“In [22], the researchers demonstrated that integrating multi-omic datasets achieved an AUROC of 0.95, marking a shift toward personalized predictive modeling.”
InfluentialStroke Risk Prediction and Prevention: Traditional versus Machine Learning Approaches
Singh, M. S., Thongam, K., Choudhary, P., & Bhagat, P. K. (2025) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-025-10406-5 · Cited by 19
Khairil, L., Benny, K. H. S., Jerry, J., Khatib, F. M., Ramli, M. D. C., & Kumar, S. (2026) · Pharmaceuticals · doi:10.3390/ph19060916 · Cited by 14
“Recent policy reviews suggest that in the absence of well-established post-market controls, initial regulatory authorisation will only provide a partial guarantee of clinical safety and efficacy over time [100].”
Sandhu, S., Sendak, M., Ratliff, W., Knechtle, W. S., Fulkerson, W. J., & Balu, S. (2023) · Patterns · doi:10.1016/j.patter.2023.100710 · Cited by 16
“To ensure real-world uptake and avoid clinician alert fatigue, we displayed algorithm outputs on a user-friendly Sepsis Watch tablet application.(14) With guidance from our project’s governance committee of physician, nursing, and administrative”
MethodSelf-citationNew Innovation Models in Medical AIPreprint
Price, W. N., II, Sachs, R. E., & Eisenberg, R. S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3783879 · Cited by 12
Unveiling the Algorithm: The Role of Explainable Artificial Intelligence in Modern Surgery
Lopes, S., Mascarenhas, M., Fonseca, J., Fernandes, G., & Leite-Moreira, A. F. (2025) · Healthcare · doi:10.3390/healthcare13243208 · Cited by 14
“For intraoperative systems where milliseconds matter, raw performance may take precedence, providing fail-safes and human override mechanisms in place [97].”
Exploring an AI-First Healthcare System
Gates, A., Ali, A., Conard, S. E., & Dunn, P. J. (2026) · Bioengineering · doi:10.3390/bioengineering13010112 · Cited by 10
“However, reviews consistently note that the clinical impact of these systems depends less on model sophistication than on how outputs are presented, timed, and aligned with existing team-based decision processes [8,25].”
InfluentialSMOTE-TOMEK: A Hybrid Sampling-Based Ensemble Learning Approach for Sepsis Prediction
Kumar, M. R., Natteshan, N. V. S., Avanija, J., Madhavi, K. R., Charan, N., & Kushal, V. (2023) · International Conference on Edge Computing and Applications (ICECAA) · doi:10.1109/icecaa58104.2023.10212208 · Cited by 12
Noselli, M., van der Vegt, A. H., Cordeil, M., Campbell, V. K., Wang, A. P., Shetty, A., & Scott, I. A. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3572494 · Cited by 6
“Of the 31 included studies, 3 did not pass the screening questions of the MMAT and could not be assessed because they lacked a research question [37], [49], [51].”
Artificial intelligence in emergency medicine: a narrative review
Rego, A., Arango-Ibañez, J. P., Taylor, R. A., Smith, M. E., Jones, D. D., Pelletier, J., Colletti, J. E., Gottlieb, M. A., & Long, B. (2026) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2026.01.028 · Cited by 8
Artificial Intelligence for the Prediction of Sepsis in Adults
Haas, R., & McGill, S. C. (2022) · Canadian Journal of Health Technologies · doi:10.51731/cjht.2022.283 · Cited by 12
Bai, E., Song, S. L., Fraser, H., & Ranney, M. L. (2022) · Applied Clinical Informatics · doi:10.1055/s-0041-1740923 · Cited by 9
Large Language Model–Based Critical Care Big Data Deployment and Extraction: Descriptive Analysis
Zhong-bao, Y., Xu, S.-S., Liu, X., Xu, N., Chen, Y., Wang, S., Miao, M.-Y., Hou, M., Liu, S., Zhou, Y., et al. (2025) · JMIR Medical Informatics · doi:10.2196/63216 · Cited by 7
“Despite the promise of rich data and analytics, the adoption of actionable insights depends on accessible interfaces and informative data presentations [15].”
Zhang, R., Long, F., Wu, J., & Tan, R. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1575237 · Cited by 7
Next-Level Prediction of Structural Progression in Knee Osteoarthritis: A Perspective
Martel‐Pelletier, J., & Pelletier, J. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26104748 · Cited by 8
“Currently, in the musculoskeletal field, to our knowledge, ML tools for prognosis have not yet achieved regulatory adoption, unlike in other medical domains (e.g., Sepsis Watch, for predicting sepsis risk in hospitalized patients [79]).”
Ustaalioğlu, İ., & Ak, R. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14207425 · Cited by 6
Tian, J., Zhao, Z., Tang, L., Song, Y., Li, Y., & Jiang, N. (2026) · Journal of Medical Internet Research · doi:10.2196/92680 · Cited by 12
“Staged deployment strategies similarly enable systems to evolve within monitored operational environments before wider clinical integration [34].”
Antweiler, D., Albiez, D., Bures, D., Hosters, B., Jovy-Klein, F., Nickel, K., Reibel, T., Schramm, J., Sander, J., Antons, D., et al. (2023) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-023-03817-x · Cited by 8
A Visionary Approach to Anemia Detection: Integrating Eye Condition Data and Machine Learning
Priyadarshini, M. A., Salma, S., Sailesh, D., Manasa, E., Charan, G. L., & Dinesh, B. (2024) · Advances in computer science research · doi:10.2991/978-94-6463-471-6_75 · Cited by 6
Ignorance Isn't Bliss: We Must Close the Machine Learning Knowledge Gap in Pediatric Critical Care
Ehrmann, D. E., Harish, V., Morgado, F., Rosella, L. C., Johnson, A. E. W., Mema, B., & Mazwi, M. (2022) · Frontiers in Pediatrics · doi:10.3389/fped.2022.864755 · Cited by 6
“…guidelines for ML and its prospective evaluation Case-based discussion with ML clinician champions and researchers (Competency D1) Asynchronous online module with subsequent small group discussion (Competency D2) been successfully employed in both adult (22) and pediatric critical care (23).”
BackgroundTaming Multi-Output Recommenders for Software Engineering
Treude, C. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3559557 · Cited by 6
“the software engineering research community has so far focused on evaluating model performance [23], we lack behind other fields in terms of real-world integration of these models [33].”
MethodClinical Artificial Intelligence
McDermott, M. B. A., Nestor, B., & Szolovits, P. (2022) · Clinics in Laboratory Medicine · doi:10.1016/j.cll.2022.09.004 · Cited by 7
The use of probabilistic graphical models in pediatric sepsis: a feasibility and scoping review
Nguyen, T. M., Poh, K. L., Chong, S., Loh, S. W., Heng, Y. C. K., & Lee, J. H. (2023) · Translational Pediatrics · doi:10.21037/tp-23-25 · Cited by 6
“Finally, while traditional methods like LR and RF continue to be the popular choices in pediatric sepsis, a growing number of studies are incorporating deep learning into diagnostic models of sepsis (15,31,40,41).”
Kennedy, C. J., Mark, D. G., Huang, J., van der Laan, M. J., Hubbard, A., & Reed, M. E. (2021) · medRxiv · doi:10.1101/2021.03.08.21252615 · Cited by 11
Popoff, B., Cabon, S., Cuggia, M., Bouzillé, G., & Clavier, T. (2025) · JMIR Medical Informatics · doi:10.2196/63709 · Cited by 6
Oo, C. T. L., Wider, W., Pang, N. T. P., Koh, E. B. Y., Vasanthi, R. K., Thet, K. Z. Z., Ramalho, R., Özdemir, B. N., & Mahboob, K. (2026) · International Journal of Qualitative Studies on Health and Well-being · doi:10.1080/17482631.2026.2621802 · Cited by 5
“These findings align with research indicating that AI can improve diagnostic accuracy and streamline administrative processes, enabling clinicians to devote more attention to direct patient care (Rollwage et al., 2024; Sendak et al., 2020).”
Lin, A. L., Parrish, A. B., Cary, M. P., Silcox, C., Balu, S., Jelovsek, J. E., O’Brien, C. L., Pencina, M. J., Poon, E. G., & Economou-Zavlanos, N. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-094601 · Cited by 10
Self-citationFarrokhi, M., Fallahian, A., Rahmani, E., Aghajan, A., Alipour, M., Khouzani, P. J., Hezarani, H. B., Sabzehie, H., Pirouzan, M., Pirouzan, Z., et al. (2025) · Archives of Academic Emergency Medicine · doi:10.22037/aaemj.v13i1.2712 · Cited by 16
“Additionally, cultural barriers in some institutions may limit the integration of AI tools into the emergency department workflow (106).”
Human performance evaluation of a pediatric artificial intelligence sepsis model
Kandaswamy, S., Muthu, N., Braykov, N. P., Carter, R., Blanco, R., Bui, T. T., Orenstein, E. W., & Mai, M. V. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf106 · Cited by 9
Nurses’ Perspectives on AI in Clinical Practice
Lansdowne, M., Sperling, J. B., Lytle, K. S., Allen, D., Merrill, T., & Cary, M. P. (2025) · Nursing Administration Quarterly · doi:10.1097/naq.0000000000000710 · Cited by 6
Lin, Z., Deng, J., Chen, S., He, J., Li, Z., Mo, J., Tang, W., Guo, L., Zhan, R. Y., Liu, P., et al. (2025) · Digital Health · doi:10.1177/20552076251396574 · Cited by 8
Mubarak, F. (2026) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-08-2025-0212 · Cited by 10
Atkova, I., Jansson, M., Ahokangas, P., Härkönen, H., Rana, T., & Vesty, G. M. (2026) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2026.124711 · Cited by 7
Manjunath, P., Lerner, B., & Dunn, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-66535-6_35 · Cited by 5
Why algorithmic speed can be more important than algorithmic accuracy
Mainz, J. T., Munch, L. A., Bjerring, J. C., & Godtfredsen, S. J. (2022) · Clinical Ethics · doi:10.1177/14777509221138750 · Cited by 6
“Perhaps the most interesting results coming from the team behind Sepsis Watch is that the model has been successfully implemented.(20) And in contrast to most cases where attempts have been made to implement AI systems in a clinical setting, the stakeholders involved with the Sepsis Watch model have generally welcomed…”
ResultHow Well Do AI-Enabled Decision Support Systems Perform in Clinical Settings?
Susanto, A. P., Lyell, D., Widyantoro, B., Berkovsky, S., & Magrabi, F. (2024) · Studies in health technology and informatics · doi:10.3233/shti230971 · Cited by 5
Wilson, B., Natali, C., Roach, M., Scott, D., Rahat, A., Rawlinson, D. R., & Cabitza, F. (2025) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-025-09514-4 · Cited by 12
Shostakovych-Koretska, L. R. (2025) · Інфекційні хвороби · doi:10.11603/1681-2727.2025.2.15302 · Cited by 7
Exploring the Potentials of Artificial Intelligence in Sepsis Management in the Intensive Care Unit
Riahi, A., Yazdani, M. S., Eshraghi, R., Houyeh, M. K., Bahrami, A., Khoshdooz, S., Amini, M., Behzadi, E., Khalaji, A., Taba, S. M. M., et al. (2025) · Critical Care Research and Practice · doi:10.1155/ccrp/9031137 · Cited by 5
“A l e r t s , a l o n g w i t h a dd i t i o n a l s u gg e s t i o n s o r d a t a , m a y b e s e n t t o p h y s i c i a n s v i a e m a i l , p h o n e , o r e l e c t r o n i c h e a l t h r e c o r d s y s t e m s a t t h e m e d i c a l f a c i l i t y [ 94 ] .”
InfluentialAyyalasomayajula, V. S. R. K., Veen, K. M., Wolterink, J. M., Smit, N. N., Jessen, R., Ploem, M. C., & Yeung, K. K. (2025) · The Journal of Cardiovascular Surgery · doi:10.23736/s0021-9509.25.13491-5 · Cited by 5
Forecasting migraine with time-series machine learning from mobile health data
Faisal, F., Poole, A. C., Danelakis, A., Meisingset, T. W., Bjørk, M., Khanevski, A. N., Kristoffersen, E. S., Kumelj, T., Larsen, I. C. K., Lunder, O. V., et al. (2026) · The Journal of Headache and Pain · doi:10.1186/s10194-026-02346-7 · Cited by 4
Sirago, G., Zotti, F., Mele, F., Misceo, F., Solarino, B., Dell'Erba, A., & Ferorelli, D. (2026) · Journal of Hospital Infection · doi:10.1016/j.jhin.2026.04.019 · Cited by 6
Saraboji, K., Gopalakrishnan, K., Sood, D., Kaur, A., Shivaram, S., Helgeson, S. A., Arunachalam, S. P., & Mitra, D. (2026) · AI in Medicine · doi:10.3390/aimed1020016 · Cited by 4
“Real-world studies further show that model performance can degrade when deployed across different healthcare settings due to variations in patient populations, data quality, and clinical practices [23,24].”
InfluentialHandra, J., James, H., Mbilinyi, A., Moller‐Hansen, A., O'Riley, C., Andrade, J. G., Deyell, M. W., Hague, C. J., Hawkins, N. M., Ho, K., et al. (2024) · JMIR Cardio · doi:10.2196/60697 · Cited by 6
ВИКОРИСТАННЯ ШТУЧНОГО ІНТЕЛЕКТУ В КЛІНІЧНІЙ МЕДИЦИНІ Й НАУКОВИХ ДОСЛІДЖЕННЯХ
Shostakovych-Koretska, L. R., & Kopcha, V. S. (2025) · Медична освіта · doi:10.11603/m.2414-5998.2025.1.15382 · Cited by 5
Agius, S., Cassar, V., Magri, C. J., Khan, W., & Topham, L. (2025) · Health and Technology · doi:10.1007/s12553-025-01010-5 · Cited by 7
“While automation can assist in accelerating certain aspects of model development, healthcare predictive models require careful alignment with clinical workflows and transparent handling of complex data challenges, factors that generic automated tools often fail to address [6, 17, 20, 24, 26].”
Antweiler, D., & Fuchs, G. (2025) · Computers & Graphics · doi:10.1016/j.cag.2025.104212 · Cited by 3
“The broad definition of CDSS encompasses various ML-based applications, including the prediction of delirium [28], sepsis [29], disease progression [30], surgery risk [31], detecting epileptic seizures [32], or tumor board evaluations [33].”
Artificial intelligence in critical care
Wu, C.-P., & Mathur, P. (2023) · Elsevier eBooks · doi:10.1016/b978-0-443-15688-5.00006-1 · Cited by 3
Nahar, N., Zhou, S., Lewis, G. A., & Kästner, C. (2021) · arXiv (Cornell University) · Cited by 6
Artificial Intelligence Applications in Health Care Practice: A Scoping Review (Preprint)Preprint
Sharma, M., Savage, C., Nair, M., Larsson, I., Svedberg, P., & Nygren, J. (2022) · doi:10.2196/preprints.40238 · Cited by 3
Karcıoğlu, U. B. (2025) · Journal of Healthcare Management and Leadership · doi:10.35345/johmal.1670414 · Cited by 3
Feng, X., Zhu, S., Fang, L., Zhu, H., Cai, G., Shen, Y., & Ning, G. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3647877 · Cited by 3
“Recent advances in reinforcement learning (RL) have provided decision support tools for clinical therapeutic interventions [16], [17], [18].”
Rethinking sepsis prediction in the era of large language models
Wong, A., Singh, K., & Nemati, S. (2026) · npj Health Systems · doi:10.1038/s44401-025-00062-z · Cited by 4
Strategies for Embedding Prediction Models in Clinical Decision‑Making Workflows
Amusa, T., Okunola, D., Izinyon, O. C., Alabi, A., & Akinpeloye, O. (2026) · Cureus · doi:10.7759/cureus.101185 · Cited by 14
“The process involved aligning stakeholders, defining roles, and establishing partnerships with research groups [2].”
InfluentialGao, S., Zhang, Y., Deng, M., Liu, H., Xu, W., Luo, M., Tian, Y., & Zhang, B. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2025.1694001 · Cited by 4
Tian, J., Song, Y., Tang, L., An, L., & Zhou, J. (2026) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s604289 · Cited by 4
“25,26 Diffusion of the WenYi system to 53 specialties occurred without mandatory participation or direct financial incentives.”
Căliman-Sturdza, O. A., Gheorghita, R. E., Filip, R., & Lobiuc, A. (2026) · Diagnostics · doi:10.3390/diagnostics16121827 · Cited by 5
“There are three motivations behind AI in the context of infectious care [44].”
Practical Aspects of Designing a Human-centred AI System in Manufacturing
Yamamoto, Y., Muñoz, Á. A., & Sandström, K. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.02.081 · Cited by 3
Hill, A., Morrissey, D., & Marsh, W. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106089 · Cited by 5
Critical Limitations in Systematic Reviews of Large Language Models in Health Care
Weizman, Z. (2025) · Journal of Medical Internet Research · doi:10.2196/81769 · Cited by 2
Online Course Model of Social and Political Education Using Deep Learning
Zhang, M., & Gao, Q. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/7653766 · Cited by 2
“In recent years, deep learning algorithms are a breakthrough in the field of machine learning research [9, 10].”
BackgroundRetractedLooking for clinician involvement under the wrong lamp post: The need for collaboration measures
Sendak, M., Gao, M. C., Ratliff, W., Nichols, M., Bedoya, A., O’Brien, C. L., & Balu, S. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab129 · Cited by 3
Self-citationArtificial intelligence in medicine: its working, potentials and challenges
Goel, R. (2022) · International Journal of Advances in Medicine · doi:10.18203/2349-3933.ijam20223412 · Cited by 3
Integrating Deep Learning into Electronic Health Records: Opportunities and Challenges
Goswami, R. C., Joshi, H., & Gautam, S. (2025) · Algorithms for intelligent systems · doi:10.1007/978-981-96-1285-7_8 · Cited by 1
Revolutionizing Anaemia Detection: Leveraging Eye Condition Data and Machine Learning
Mangalapu, N. K., Thangavelu, L. P., Gayathri, J., Kalyani, G., & Balamurugan, K. S. (2025) · International Conference on Electronics, Materials Engineering & Nano-Technology (IEMENTech) · doi:10.1109/iementech65115.2025.10959598 · Cited by 1
A development framework for human work integrated AI systems in manufacturing
Yamamoto, Y., Muñoz, Á. A., & Sandström, K. (2025) · Frontiers in Manufacturing Technology · doi:10.3389/fmtec.2025.1601903 · Cited by 1
Artificial Intelligence in UK Hospital Medicine: From Innovation to Implementation
Carroll, D., Boodhoo, V., Lowe, D. J., & Carlin, C. M. (2025) · British Journal of Hospital Medicine · doi:10.12968/hmed.2025.0468 · Cited by 1
Elay, G., & Güven, A. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15062310 · Cited by 1
“Performance monitoring and safety frameworks should be re-evaluated as data distributions shift over time [27,28].”
Lo, H. K. Y., Chu, I. W. L., Chan, J. K. N., Wong, C. S. M., & Chang, W. C. (2026) · Molecular Psychiatry · doi:10.1038/s41380-026-03555-x · Cited by 1
Zhu, Y., Jiawei, F. E. N. G., Liu, R., Ren, W., Ma, X., Wang, N., Gong, L., & Kong, F. (2026) · Scientific Reports · doi:10.1038/s41598-026-47372-2 · Cited by 1
“Prospective real-time implementation studies will be essential to evaluate clinical impact, workflow integration, and cost-effectiveness 50 .”
Invisible AI Infrastructure for Safety-Net Healthcare Organizations
Kim, J. Y., Thomas, C., Kpodzro, S., Hasan, A., Patel, M. R., Balu, S., & Sendak, M. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812211 · Cited by 1
“For example, AI tools have enabled early disease prediction to support timely intervention, enhance patient-centered care, improve operational efficiency, and reduce staff burden by automating administrative tasks [5, 13, 18, 23, 68, 71, 73].”
Self-citationMedical question answering: A comprehensive multimodal and LLM-driven survey
Mhedhbi, E., Zhu, X., Ayaz, M., Khan, M., & Othmani, A. (2026) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2026.109541 · Cited by 4
Validating medical digital twins for clinical decision support: beyond predictive accuracy
Vallée, A. (2026) · JAMIA Open · doi:10.1093/jamiaopen/ooag160 · Cited by 2
Ghafur, A. K., Nagao, M., Kanj, S. S., Abbara, S., Tattevin, P., Awad, M., Dagher, M., Ndegwa, L., Mundia, G., Schouten, J. A., et al. (2026) · Journal of Global Antimicrobial Resistance · doi:10.1016/j.jgar.2026.08.003 · Cited by 2
Dube, S. (2021) · Springer eBooks · doi:10.1007/978-3-030-68624-6_16 · Cited by 1
Information visualization and integration
Wright, M. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91200-6.00032-2 · Cited by 3
Lessons for Approaching Implementation of AI Systems in Clinical Settings
Owoyemi, A., Okpara, E., Okor, M., Awais, F., Harwani, S., Salwei, M. E., & Boyd, A. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00067 · Cited by 2
“…of the AI tool with the existing workflow in the clinical workspace, which leads to the ineffective decision making and challenges in the execution of clinical tasks which is similar to some of the findings by Sendak et al in their implementation study of an AI system in a clinical setting [15] .”
BackgroundResultThe Present and Future of AI: Ethical Issues and Research Opportunities
Srivastava, A., Marabelli, M., Blanch‐Hartigan, D., Moriarty, J., Carey, E., Persky, S., & Torous, J. B. (2025) · Communications of the Association for Information Systems · doi:10.17705/1cais.05611 · Cited by 29
Huyut, M. T., Velichko, A., Belyaev, M. A., Izotov, Y., Tosun, M., Sertoğullarından, B., Karaoğlanoğlu, Ş., Demir, A. Y., & Korzun, D. G. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103337 · Cited by 2
Cardiovascular waveforms - can we extract more from routine signals?
Nandi, M., Anton, M., & Lyle, J. V. (2022) · JRSM Cardiovascular Disease · doi:10.1177/20480040221121438 · Cited by 2
Zhang, Y., Trinh, S. H., Phelan, T., Byrd, T. F., Tourani, R., Kumar, V., Caraballo, P. J., Melton, G. B., & Simon, G. (2026) · medRxiv · doi:10.64898/2026.05.22.26353890 · Cited by 1
Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis
Nguyen, H. B., Krishtopaytis, E., Lopez, E., Farnoudi, N., Van, T., Kharalampova, V., & Coz Yataco, A. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15093477
“Implementation science frameworks can help specify who receives alerts, what actions are expected, and what resources are required to respond, thereby reducing alert fatigue and ensuring accountability [10,77].”
InfluentialSchwartz, J., Moy, A. J., Rossetti, S. C., Elhadad, N., & Cato, K. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab177
Lui, T. K.-L., Shing, M. C. K., & Leung, W. K. (2021) · doi:10.2196/preprints.32281
Tang, K., Jiang, X., Li, C., & Zhang, K. (2022) · doi:10.2196/preprints.40794
Robinson, D. A., Church, L., Blackwell, A. F., Vuylsteke, A., O'Hara, K. P., & Besser, M. W. (2022) · Electronic workshops in computing · doi:10.14236/ewic/hci2022.25
The Future of Patient Monitoring
Ehrmann, D. E., Assadi, A., Eytan, D., Goodfellow, S. D., Goodwin, A., Greer, R., Schwartz, S. M., & Mazwi, M. (2023) · Springer eBooks · doi:10.1007/978-1-4471-4999-6_108-2
Henkin, R., Remfry, E., Reynolds, D. J., Clinch, M., & Barnes, M. R. (2026) · PLoS ONE · doi:10.1371/journal.pone.0354358 · Cited by 4
“…of AI impacts the confluence of healthcare and interdisciplinarity research • We break the convention of pitching data scientists against single-domain experts by including perspectives from clinicians, statisticians, and staff involved in patient and public involvement and engagement (PPIE).”
Valan, B. N., Prakash, A., Ratliff, W., Gao, M. C., Muthya, S., Thomas, A. J., Eaton, J. L., Gardner, M., Nichols, M., Revoir, M., et al. (2024) · medRxiv · doi:10.1101/2024.03.22.24304753
Self-citationArtificial Intelligence: Revolutionizing the Medicolegal Field
Brigham, C. R., Buttar, W. A., Bucksbaum, M., & Talmage, J. B. (2023) · AMA guides newsletter · doi:10.1001/amaguidesnewsletters.2023.sepoct01 · Cited by 1
Data Extractions and Extractors
Marabelli, M. (2024) · Palgrave studies in equity, diversity, inclusion, and indigenization in business · doi:10.1007/978-3-031-53919-0_2
Improving Machine Learning Based Sepsis Diagnosis Using Heart Rate Variability
Balaji, S., Sun, C., & Somalwar, A. (2024) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb58642.2024.10702108
“Sendak et al. (2020) successfully implement “Sepsis Watch,” a deep learning based sepsis detection tool requiring both invasive and non-invasive clinical data.”
BackgroundMethodSung, L., Brudno, M., Caesar, M. C. W., Verma, A. A., Buchsbaum, B., Retnakaran, R. R., Giannakeas, V., Kushki, A., Bader, G. D., Lasthiotakis, H., et al. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1511943
“Successful scenarios include early warning systems for clinical deterioration (9, 10), mortality (11) prediction, and sepsis (12) prediction as examples.”
Boğa, E. (2025) · The European Research Journal · doi:10.18621/eurj.1641700
Leonard, F., Lyttle, M. D., O’Sullivan, D. M., Gilligan, J., Roland, D., & Barrett, M. (2025) · medRxiv · doi:10.1101/2025.07.06.25330977
Daily Dispo Documentation Improves Patient Flow and Discharge Efficiency
Bechir, G. (2025) · Cureus · doi:10.7759/cureus.88814 · Cited by 2
Tikhomirov, L., Semmler, C., Prizant, N. T., Bhasin, S., Kenyon, G., van der Vegt, A. H., Erdman, L., Palmer, L. J., Mohamud, A., Gichoya, J. W., et al. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/n9cx7_v1
Self-citationKhalid, A. R., & Nashwan, A. J. (2025) · World Journal of Psychiatry · doi:10.5498/wjp.v15.i10.110719
Metadata
- Authors
- Sendak, M. P., Ratliff, W., Sarro, D., Alderton, E., Futoma, J., Gao, M., Nichols, M., Revoir, M., Yashar, F., Miller, C., Kester, K., Sandhu, S., Corey, K., Brajer, N., Tan, C., Lin, A., Brown, T., Engelbosch, S., Anstrom, K., Elish, M. C., Heller, K., Donohoe, R., Theiling, J., Poon, E., Balu, S., Bedoya, A., & O'Brien, C.
- Affiliations
- Duke University (US)
- Duke University Hospital (US)
- Harvard University (US)
- Duke Clinical Research Institute (US)
- Data & Society Research Institute (US)
- Google (United States) (US)
- Corresponding author
- Sendak, Mark P
- ORCID
- Sendak, Mark P
- Ratliff, William
- Sarro, Dina
- Alderton, Elizabeth
- Futoma, Joseph
- Gao, Michael
- Nichols, Marshall
- Revoir, Mike
- Yashar, Faraz
- Miller, Corinne
- Kester, Kelly
- Sandhu, Sahil
- Corey, Kristin
- Brajer, Nathan
- Tan, Christelle
- Lin, Anthony
- Brown, Tres
- Engelbosch, Susan
- Anstrom, Kevin
- Elish, Madeleine Clare
- Heller, Katherine
- Donohoe, Rebecca
- Theiling, Jason
- Poon, Eric
- Balu, Suresh
- Bedoya, Armando
- O'Brien, Cara
- Venue
- JMIR Medical Informatics
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-15
- Volume
- 8
- Issue
- 7
- Pages
- e15182
- ISSN
- 2291-9694 (ISSN-L)
- PMC
- PMC7391165
- OpenAlex
- W2998524378
- Cited by
- 287
- References
- 48
- Citations by year
- 2026: 102 · 2025: 59 · 2024: 36 · 2023: 32 · 2022: 38 · 2021: 18 · 2020: 2
- FWCI
- 11.04
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Informatics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- John D. and Catherine T. MacArthur Foundation
- Duke Institute for Health Innovation
- Topics
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- sepsis, deep learning, clinical implementation, early sepsis detection, learning health systems, quality improvement, clinical decision support, stakeholder engagement, clinical workflow integration, health care delivery systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


