Real-World Integration of a Sepsis Deep Learning Technology Into Routine Clinical Care: Implementation Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Background: Successful integrations of machine learning into routine clinical care are exceedingly rare, and barriers to its adoption are poorly characterized in the literature. Objective: This study aims to report a quality improvement effort to integrate a deep learning sepsis detection and management platform, Sepsis Watch, into routine clinical care. Methods: In 2016, a multidisciplinary team consisting of statisticians, data scientists, data engineers, and clinicians was assembled by the leadership of an academic health system to radically improve the detection and treatment of sepsis. This report of the quality improvement effort follows the learning health system framework to describe the problem assessment, design, development, implementation, and evaluation plan of Sepsis Watch. Results: Sepsis Watch was successfully integrated into routine clinical care and reshaped how local machine learning projects are executed. Frontline clinical staff were highly engaged in the design and development of the workflow, machine learning model, and application. Novel machine learning methods were developed to detect sepsis early, and implementation of the model required robust infrastructure. Significant investment was required to align stakeholders, develop trusting relationships, define roles and responsibilities, and to train frontline staff, leading to the establishment of 3 partnerships with internal and external research groups to evaluate Sepsis Watch. Conclusions: Machine learning models are commonly developed to enhance clinical decision making, but successful integrations of machine learning into routine clinical care are rare. Although there is no playbook for integrating deep learning into clinical care, learnings from the Sepsis Watch integration can inform efforts to develop machine learning technologies at other health care delivery systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Conversely, alerts that are poorly integrated into workflow can increase interruptions, contribute to unnecessary antibiotics, and shift attention away from other competing tasks.”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Sendak et al. performed a single-center implementation study integrating a deep learning-based sepsis detection platform into the emergency department of an academic health system. They used EHR time-series data from ~39,918 adult ED encounters to develop and deploy a multitask Gaussian processes (MGPs)–recurrent neural network (RNN) model within a real-time clinical workflow.”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Studies of sepsis alerts frequently report improvements in process measures such as time-to-antibiotics or completion of key bundle elements, particularly when these alerts are coupled to structured triage, escalation, and rapid clinician response.”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Implementation barriers for sepsis AI cluster around trust and interpretability, workflow integration, technical readiness and generalizability, governance and safety, leadership alignment, and the resources required for sustainment (Table 4) [10,33,34,46,48,77,78].”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The system was successfully implemented with high clinician engagement and continuous risk prediction, demonstrating feasibility of real-world integration but requiring substantial infrastructure and organizational coordination [10].”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [10]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 1×
“The next goal to drive adoption was to broadly communicate the change vision and empower action [43,44].”
BackgroundHigh-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“Machine learning, a set of statistical methods optimized for prediction on new observations, is central to this transformation [1].”
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Surviving Sepsis Campaign: International guidelines for management of sepsis and septic shock: 2016.
Rhodes, A., Evans, L. E., Alhazzani, W., Levy, M. M., Antonelli, M., Ferrer, R., Kumar, A., Sevransky, J. E., Sprung, C. L., Nunnally, M. E., et al. (2017) · Intensive Care Medicine · doi:10.1007/s00134-017-4683-6 · Cited by 6,621
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“All new machine learning implementations have the potential for introducing inequality and bias that is not always clearly visible in numeric data [45-48].”
BackgroundRecurrent Neural Networks for Multivariate Time Series with Missing Values
Che, Z., Purushotham, S., Cho, K., Sontag, D., & Liu, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24271-9 · Cited by 2,370 · cited 1×
“RNNs are a type of deep learning configured to ingest time series data and are ideally suited to combine static and dynamic features of hospital encounters that vary in length [39,40].”
BackgroundAbràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638 · cited 1×
“Isolated efforts demonstrating the clinical impact of previously validated technologies show the potential of machine learning in health care [3,4].”
BackgroundPrognosis Research Strategy (PROGRESS) 3: Prognostic Model Research
Steyerberg, E. W., Moons, K. G. M., van der Windt, D. A., Hayden, J. A., Perel, P., Schroter, S., Riley, R. D., Hemingway, H., Altman, D. G., & for the PROGRESS Group (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001381 · Cited by 1,508
Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395 · cited 1×
“Growing concern about such biases in health care highlighted the need for specialized evaluation of the Sepsis Watch [49-51].”
BackgroundEnsuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341 · cited 1×
“Feedback loops are created where Sepsis Watch may prompt clinical action for patients who do not ultimately develop sepsis [57].”
BackgroundDo no harm: a roadmap for responsible machine learning for health care
Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0548-6 · Cited by 1,266 · cited 1×
“We draw upon lessons from the learning health system framework and previously described best practices for responsible machine learning in health care [19,20].”
MethodSelf-citationUnintended consequences of machine learning in medicine
Cabitza, F., Rasoini, R., & Gensini, G. F. (2017) · JAMA · doi:10.1001/jama.2017.7797 · Cited by 1,066
An interpretable machine learning model for accurate prediction of sepsis in the ICU
Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002936 · Cited by 832 · cited 2×
“Third, although some health systems do build and integrate home-grown machine learning solutions [12,13], that effort is often outsourced to research teams or technology vendors [5].”
BackgroundResultDiagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection
Lehman, C. D., Wellman, R. D., Buist, D. S. M., Kerlikowske, K., Tosteson, A. N. A., & Miglioretti, D. L. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.5231 · Cited by 678
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · cited 2×
“with the CMS SEP-1 measure and quality improvement efforts at peer institutions, specified in Multimedia Appendix 1 [23,24].”
MethodRhee, C., Jones, T. M., Hamad, Y., Pande, A., Varon, J., O’Brien, C., Anderson, D. J., Warren, D. K., Dantes, R. B., Epstein, L., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.7571 · Cited by 584
Self-citationDesautels, T., Calvert, J., Hoffman, J., Jay, M., Kerem, Y., Shieh, L., Shimabukuro, D., Chettipally, U., Feldman, M. D., Barton, C., et al. (2016) · JMIR Medical Informatics · doi:10.2196/medinform.5909 · Cited by 509
Taylor, R. A., Pare, J. R., Venkatesh, A. K., Mowafi, H., Melnick, E. R., Fleischman, W., & Hall, M. K. (2016) · Academic Emergency Medicine · doi:10.1111/acem.12876 · Cited by 491 · cited 1×
“A model specific to the ED predicted inpatient mortality among patients already meeting sepsis criteria [30].”
MethodDeep Learning in Medicine—Promise, Progress, and Challenges
Wang, F., Casalino, L. P., & Khullar, D. (2019) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.7117 · Cited by 483 · cited 1×
“Growing concern about such biases in health care highlighted the need for specialized evaluation of the Sepsis Watch [49-51].”
BackgroundImplementing the Learning Health System: From Concept to Action
Greene, S. M., Reid, R. J., & Larson, E. B. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-3-201208070-00012 · Cited by 398 · cited 1×
“We draw upon lessons from the learning health system framework and previously described best practices for responsible machine learning in health care [19,20].”
MethodArtificial intelligence and the implementation challenge
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13659 · Cited by 389 · cited 1×
“Although Sepsis Watch is an instance of machine learning clinical decision support (CDS), deep learning systems do pose implementation challenges beyond traditional CDS, as detailed elsewhere [14-16].”
BackgroundShimabukuro, D. W., Barton, C. W., Feldman, M. D., Mataraso, S. J., & Das, R. (2017) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2017-000234 · Cited by 382 · cited 1×
“Isolated efforts demonstrating the clinical impact of previously validated technologies show the potential of machine learning in health care [3,4].”
BackgroundMachine learning for real-time prediction of complications in critical care: a retrospective study
Meyer, A., Zverinski, D., Pfahringer, B., Kempfert, J., Kuehne, T., Sündermann, S. H., Stamm, C., Hofmann, T., Falk, V., & Eickhoff, C. (2018) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(18)30300-x · Cited by 350 · cited 1×
“RNNs are a type of deep learning configured to ingest time series data and are ideally suited to combine static and dynamic features of hospital encounters that vary in length [39,40].”
BackgroundPrehospital antibiotics in the ambulance for sepsis: A multicentre, open label, randomised trial.
Alam, N., Oskam, E., Stassen, P. M., Exter, P. V., van de Ven, P. M., Haak, H. R., Holleman, F., Zanten, A. V., Leeuwen-Nguyen, H. V., Bon, V., et al. (2018) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(17)30469-1 · Cited by 290
Giannini, H. M., Ginestra, J. C., Chivers, C., Draugelis, M., Hanish, A., Schweickert, W. D., Fuchs, B. D., Meadows, L., Lynch, M., Donnelly, P. J., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003891 · Cited by 269 · cited 1×
“Third, although some health systems do build and integrate home-grown machine learning solutions [12,13], that effort is often outsourced to research teams or technology vendors [5].”
BackgroundAskim, Å., Moser, F., Gustad, L. T., Stene, H., Gundersen, M., Åsvold, B. O., Dale, J., Bjørnsen, L. P., Damås, J. K., & Solligård, E. (2017) · Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine · doi:10.1186/s13049-017-0399-4 · Cited by 246 · cited 1×
“However, qSOFA was not adopted by CMS for the SEP-1 core measure and does not accurately identify patients at risk of developing sepsis [24,32].”
MethodA computational approach to early sepsis detection
Calvert, J. S., Price, D. A., Chettipally, U. K., Barton, C. W., Feldman, M. D., Hoffman, J. L., Jay, M., & Das, R. (2016) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2016.05.003 · Cited by 244 · cited 1×
“In 2016, efforts to predict sepsis largely used the Medical Information Mart for Intensive Care [26] and restricted focus to just intensive care units (ICUs) [23,27,28].”
MethodFlores, A. W., Bechtel, K., & Lowenkamp, C. T. (2016) · Federal probation · Cited by 240
Artificial Intelligence in Health Care: Will the Value Match the Hype?
Emanuel, E. J., & Wachter, R. M. (2019) · JAMA · doi:10.1001/jama.2019.4914 · Cited by 237
Corey, K. M., Kashyap, S., Lorenzi, E., Lagoo-Deenadayalan, S. A., Heller, K., Whalen, K., Balu, S., Heflin, M. T., McDonald, S. R., Swaminathan, M., et al. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002701 · Cited by 204 · cited 1×
“Significant investment in infrastructure is required [6-8].”
Self-citationSebat, F., Musthafa, A. A., Johnson, D., Kramer, A. A., Shoffner, D., Eliason, M., Henry, K., & Spurlock, B. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000287593.54658.89 · Cited by 200 · cited 1×
“RRTs significantly reduce time to medical resuscitation and escalation of care and, for sepsis specifically, improve the delivery of care bundles and outcomes [33-36].”
BackgroundAntibiotics for sepsis-finding the equilibrium.
Klompas, M., Calandra, T., & Singer, M. (2018) · JAMA · doi:10.1001/jama.2018.12179 · Cited by 183 · cited 1×
“For example, the administration of antibiotics early in the clinical course of sepsis may not improve outcomes [53-55].”
BackgroundDevelopment, implementation, and impact of an automated early warning and response system for sepsis
Umscheid, C. A., Betesh, J., VanZandbergen, C., Hanish, A., Tait, G., Mikkelsen, M. E., French, B., & Fuchs, B. D. (2015) · Journal of Hospital Medicine · doi:10.1002/jhm.2259 · Cited by 168 · cited 1×
“RRTs significantly reduce time to medical resuscitation and escalation of care and, for sepsis specifically, improve the delivery of care bundles and outcomes [33-36].”
BackgroundMinimal Impact of Implemented Early Warning Score and Best Practice Alert for Patient Deterioration*
Bedoya, A. D., Clement, M. E., Phelan, M., Steorts, R. C., O’Brien, C., & Goldstein, B. A. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003439 · Cited by 162 · cited 1×
“Earlier attempts to implement CDS to improve timely detection and response to inpatient deterioration, including sepsis, caused significant alarm fatigue and did not improve clinical outcomes [21].”
MethodSelf-citationPromoting Trust Between Patients and Physicians in the Era of Artificial Intelligence
Nundy, S., Montgomery, T., & Wachter, R. M. (2019) · JAMA · doi:10.1001/jama.2018.20563 · Cited by 161 · cited 1×
“In particular, new mechanisms of trust and accountability must be developed to ensure that the systems are safe and reliable [17,18].”
BackgroundPrognostic models will be victims of their own success, unless…
Lenert, M. C., Matheny, M. E., & Walsh, C. G. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz145 · Cited by 114 · cited 2×
“The practice of including clinical interventions as model inputs has been recommended for models built to be integrated into clinical practice [11].”
BackgroundMethodHealth Care and Precision Medicine Research: Analysis of a Scalable Data Science Platform
McPadden, J., Durant, T. J., Bunch, D. R., Coppi, A., Price, N., Rodgerson, K., Torre Jr, C. J., Byron, W., Hsiao, A. L., Krumholz, H. M., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/13043 · Cited by 91 · cited 1×
“Significant investment in infrastructure is required [6-8].”
Machine Learning in Health Care: A Critical Appraisal of Challenges and Opportunities
Sendak, M., Gao, M., Nichols, M., Lin, A., & Balu, S. (2019) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.5334/egems.287 · Cited by 84 · cited 3×
“This reinforces previous findings that academic medical centers may be uniquely positioned to conduct translational machine learning research [5].”
BackgroundResultSelf-citationManaging sepsis: Electronic recognition, rapid response teams, and standardized care save lives
Guirgis, F. W., Jones, L., Esma, R., Weiss, A., McCurdy, K., Ferreira, J., Cannon, C., McLauchlin, L., Smotherman, C., Kraemer, D. F., et al. (2017) · Journal of Critical Care · doi:10.1016/j.jcrc.2017.04.005 · Cited by 80 · cited 1×
“RRTs significantly reduce time to medical resuscitation and escalation of care and, for sepsis specifically, improve the delivery of care bundles and outcomes [33-36].”
BackgroundThe Stakes of Uncertainty: Developing and Integrating Machine Learning in Clinical Care
ELISH, M. C. (2018) · Ethnographic Praxis in Industry Conference Proceedings · doi:10.1111/1559-8918.2018.01213 · Cited by 59 · cited 1×
“Preliminary analysis of clinician’s perceptions of evidence, trust, and authority in the early phase of development was completed, and several salient findings emerged [52].”
BackgroundSelf-citationBarriers to Achieving Economies of Scale in Analysis of EHR Data: A Cautionary Tale
Sendak, M. P., Balu, S., & Schulman, K. A. (2017) · Applied Clinical Informatics · doi:10.4338/aci-2017-03-cr-0046 · Cited by 45 · cited 2×
“Significant investment in infrastructure is required [6-8].”
MethodSelf-citationEarly Administration of Antibiotics for Suspected Sepsis
Mi, M., Klompas, M., & Evans, L. (2019) · New England Journal of Medicine · doi:10.1056/nejmclde1809210 · Cited by 45 · cited 1×
“For example, the administration of antibiotics early in the clinical course of sepsis may not improve outcomes [53-55].”
BackgroundAmland, R. C., & Sutariya, B. B. (2017) · American Journal of Medical Quality · doi:10.1177/1062860617692034 · Cited by 40 · cited 2×
“with the CMS SEP-1 measure and quality improvement efforts at peer institutions, specified in Multimedia Appendix 1 [23,24].”
MethodJu, T., Al‐Mashat, M., Rivas, L., & Sarani, B. (2018) · Critical Care Clinics · doi:10.1016/j.ccc.2017.12.004 · Cited by 37 · cited 1×
“RRTs significantly reduce time to medical resuscitation and escalation of care and, for sepsis specifically, improve the delivery of care bundles and outcomes [33-36].”
BackgroundIdentifying Severe Sepsis via Electronic Surveillance
Brandt, B., Gartner, A., Moncure, M., Cannon, C. M., Carlton, E. F., Cleek, C., Wittkopp, C., & Simpson, S. Q. (2014) · American Journal of Medical Quality · doi:10.1177/1062860614541291 · Cited by 28 · cited 1×
“At that time, there were successful reports of sepsis CDS algorithms [29], but there was no validated machine learning method to predict sepsis among adult patients presenting to the ED.”
BackgroundClinical considerations when applying machine learning to decision-support tasks versus automation
Jamieson, T., & Goldfarb, A. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-009514 · Cited by 26 · cited 1×
“Although Sepsis Watch is an instance of machine learning clinical decision support (CDS), deep learning systems do pose implementation challenges beyond traditional CDS, as detailed elsewhere [14-16].”
Background
Research works printed but not linked: 5
- SculleyDHoltGGolovinDHidden Technical Debt in Machine Learning SystemsNIPS Proceedings20142020-06-16https://papers.nips.cc/paper/5656-hidden-technical-debt-in-machine-learning-systems.pdf
- SariaSSubbaswamyATutorial: Safe and Reliable Machine LearningACM Conference on Fairness, Accountability, and Transparency201901FAT'19January 29-31, 2019Atlanta, USA
- 10.5555/3305381.3305503 · doi:10.5555/3305381.3305503
- Barocas, S, 2016, Cal L Rev, 104, 671
- Moore, G, 2006, Crossing the Chasm: Marketing and Selling High-Tech Products to Mainstream Customers
Cited by
A Systematic Review of the Barriers to the Implementation of Artificial Intelligence in Healthcare
Ahmed, M. I., Spooner, B., Isherwood, J., Lane, M., Orrock, E., & Dennison, A. (2023) · Cureus · doi:10.7759/cureus.46454 · Cited by 364
Power to the People? Opportunities and Challenges for Participatory AI
Birhane, A., Isaac, W., Prabhakaran, V., Diaz, M., Elish, M. C., Gabriel, I., & Mohamed, S. (2022) · Equity and Access in Algorithms Mechanisms and Optimization · doi:10.1145/3551624.3555290 · Cited by 330
“The recent upswing in participatory tools have varied in approach and point in the machine learning product lifecycle, including: auditing methods for machine learning based interventions [48, 75], public consultation methods such as citizen juries [6, 83] or joint problem formulation [61], information disclosures suc…”
BackgroundSelf-citationThe Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice
Delgado, F., Yang, S., Madaio, M., & Yang, Q. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623261 · Cited by 256
Artificial Intelligence Applications in Health Care Practice: Scoping Review
Sharma, M., Savage, C., Nair, M., Larsson, I., Svedberg, P., & Nygren, J. M. (2022) · Journal of Medical Internet Research · doi:10.2196/40238 · Cited by 198
“However, the study by Sendak et al [46] encouraged the separation of developers and clinicians and made conscious efforts to shift focus away from the technical aspects of AI.”
InfluentialNair, M., Svedberg, P., Larsson, I., & Nygren, J. M. (2024) · PLOS ONE · doi:10.1371/journal.pone.0305949 · Cited by 179
Metadata
- Authors
- Sendak, M. P., Ratliff, W., Sarro, D., Alderton, E., Futoma, J., Gao, M., Nichols, M., Revoir, M., Yashar, F., Miller, C., Kester, K., Sandhu, S., Corey, K., Brajer, N., Tan, C., Lin, A., Brown, T., Engelbosch, S., Anstrom, K., Elish, M. C., Heller, K., Donohoe, R., Theiling, J., Poon, E., Balu, S., Bedoya, A., & O'Brien, C.
- Affiliations
- Duke University (US)
- Duke University Hospital (US)
- Harvard University (US)
- Duke Clinical Research Institute (US)
- Data & Society Research Institute (US)
- Google (United States) (US)
- Corresponding author
- Sendak, Mark P
- ORCID
- Sendak, Mark P
- Ratliff, William
- Sarro, Dina
- Alderton, Elizabeth
- Futoma, Joseph
- Gao, Michael
- Nichols, Marshall
- Revoir, Mike
- Yashar, Faraz
- Miller, Corinne
- Kester, Kelly
- Sandhu, Sahil
- Corey, Kristin
- Brajer, Nathan
- Tan, Christelle
- Lin, Anthony
- Brown, Tres
- Engelbosch, Susan
- Anstrom, Kevin
- Elish, Madeleine Clare
- Heller, Katherine
- Donohoe, Rebecca
- Theiling, Jason
- Poon, Eric
- Balu, Suresh
- Bedoya, Armando
- O'Brien, Cara
- Venue
- JMIR Medical Informatics
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-15
- Volume
- 8
- Issue
- 7
- Pages
- e15182
- ISSN
- 2291-9694 (ISSN-L)
- PMC
- PMC7391165
- OpenAlex
- W2998524378
- Cited by
- 287
- References
- 48
- Citations by year
- 2026: 102 · 2025: 59 · 2024: 36 · 2023: 32 · 2022: 38 · 2021: 18 · 2020: 2
- FWCI
- 11.04
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Informatics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- John D. and Catherine T. MacArthur Foundation
- Duke Institute for Health Innovation
- Topics
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- sepsis, deep learning, clinical implementation, early sepsis detection, learning health systems, quality improvement, clinical decision support, stakeholder engagement, clinical workflow integration, health care delivery systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


