A targeted real-time early warning score (TREWScore) for septic shock.
The DOI matches its Crossref record; 60 of the 62 references it cites were found in a registry or an index.
Abstract
TREWScore, a targeted early warning score for septic shock, identifies patients who develop septic shock before the onset of sepsis-related organ failure.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Machine learning has been used to accurately predict sepsis, in-hospital mortality, and acute kidney injury using intraoperative time-series data.9,21,27,32”
From Artificial Intelligence and Surgical Decision-making. (2020) · cites this paper as [27]
In the citing paper
“However, existing studies have largely focused on binary outcome prediction (e.g., mortality) and less on dynamic prediction of patient recovery trajectories12,13.”
From Machine learning predicts sepsis deterioration trajectories. (2026) · cites this paper as [12]
In the citing paper
“numerous models were tested on the freely accessible MIMIC database [27, 33, 52–59]”
From Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy (2020) · cites this paper as [56]
Citations
Cites
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Early goal-directed therapy in the treatment of severe sepsis and septic shock
Rivers, E., Nguyen, B., Havstad, S., Ressler, J., Muzzin, A., Knoblich, B., Peterson, E., & Tomlanovich, M. (2001) · New England Journal of Medicine · doi:10.1056/nejmoa010307 · Cited by 10,743
Surviving Sepsis Campaign: International Guidelines for Management of Severe Sepsis and Septic Shock
Dellinger, R. P., Levy, M. M., Rhodes, A., Annane, D., Gerlach, H., Opal, S. M., Sevransky, J. E., Sprung, C. L., Douglas, I. S., Jaeschke, R., et al. (2013) · Critical Care Medicine · doi:10.1097/ccm.0b013e31827e83af · Cited by 9,694
Angus, D. C., Linde-Zwirble, W. T., Lidicker, J., Clermont, G., Carcillo, J., & Pinsky, M. R. (2001) · Critical Care Medicine · doi:10.1097/00003246-200107000-00002 · Cited by 8,503 · cited 2×
“(1) or by the presence of a clinical note that mentioned sepsis or septic shock.”
BackgroundStatistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
The Surviving Sepsis Campaign Guidelines Committee including The Pediatric Subgroup*, Dellinger, R. P., Levy, M. M., Rhodes, A., Annane, D., Gerlach, H., Opal, S. M., Sevransky, J. E., Sprung, C. L., Douglas, I. S., et al. (2013) · Intensive Care Medicine · doi:10.1007/s00134-012-2769-8 · Cited by 7,290
Kumar, A., Roberts, D., Wood, K. E., Light, B., Parrillo, J. E., Sharma, S., Suppes, R., Feinstein, D., Zanotti, S., Taiberg, L., et al. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000217961.75225.e9 · Cited by 6,109
Research works printed but not linked: 4
- Morgan R. J. M., Williams F., Wright M. N., An early warning scoring system for detecting developing critical illness. Clin. Intens. Care Nurs. 8, 100 (1997).
- Henry K., Paxton C., Kim K. S., Pham J., Saria S., REWS: Real-time early warning score for septic shock. Crit. Care Med. 42, abstract 63 (2014).
- S. Townsend T. Clemmer D. Jacobsen IHI Expedition: Treating Sepsis in the Emergency Department and Beyond Session 6 (Institute for Healthcare Improvement Cambridge MA 2013); www.ihi.org/Engage/Memberships/Passport/Pages/Treating-Sepsis.aspx).
- H. D. Humes in Kelley’s Essentials of Internal Medicine (Lippincott Williams & Wilkins Philadelphia ed. 2 2001) chap. 18.
Cited by
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Explainable machine-learning predictions for the prevention of hypoxaemia during surgery
Lundberg, S. M., Nair, B., Vavilala, M. S., Horibe, M., Eisses, M. J., Adams, T., Liston, D. E., Low, D. K.-W., Newman, S.-F., Kim, J., et al. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0304-0 · Cited by 1,967
Big data and machine learning algorithms for health-care delivery
Ngiam, K. Y., & Khor, I. W. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30149-4 · Cited by 1,424
Do no harm: a roadmap for responsible machine learning for health care
Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0548-6 · Cited by 1,266
“For example, in deploying an early-warning system for sepsis, an ML-based system requires a novel workflow, such as presenting a display that indicates why the model generated an alert, to facilitate evaluation 18 .”
BackgroundSelf-citationToward Causal Representation Learning
Scholkopf, B., Locatello, F., Bauer, S., Ke, N. R., Kalchbrenner, N., Goyal, A., & Bengio, Y. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3058954 · Cited by 1,170
“One example is personalized medicine, where we may wish to build a model of a patient health state through a multitude of data sources, such as electronic health records and genetic information [66], [109].”
BackgroundA clinically applicable approach to continuous prediction of future acute kidney injury
Tomašev, N., Glorot, X., Rae, J. W., Zielinski, M., Askham, H., Saraiva, A., Mottram, A., Meyer, C., Ravuri, S., Protsyuk, I., et al. (2019) · Nature · doi:10.1038/s41586-019-1390-1 · Cited by 1,086
“…develop a deep learning approach for the continuous risk prediction of future deterioration in patients, building upon recent work that models adverse events from electronic health records (2–17) and using acute kidney injury—a common and potentially life-threatening condition (18)—as an exemplar.”
Ahmed, Z., Mohamed, K., Zeeshan, S., & Dong, X. (2020) · Database · doi:10.1093/database/baaa010 · Cited by 1,035
“AI’ (243,244), for analyzing EHR of cancer patients and recommend treatments and drug doses; TREWScore (245,246,247,248) for analyzing EHR for predicting septic shock risk and analyze CT brain scans for three-dimensional convolutional neural network neurological disorder classification; ‘PowerLook Density Assessment 3.”
MethodWong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., et al. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.2626 · Cited by 995
“Depression 8140 (21) 7478 (21) 662 (26) <.”
Multitask learning and benchmarking with clinical time series data
Harutyunyan, H., Khachatrian, H., Kale, D. C., Ver Steeg, G., & Galstyan, A. (2019) · Scientific Data · doi:10.1038/s41597-019-0103-9 · Cited by 958
“The bottom row of Figure 1 shows the distribution of patient length of stay across the ten buckets.”
BackgroundLearning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
“…of research applies machine learning to temporal clinical data for tasks including artifact removal (Aleks et al., 2009; Quinn et al., 2009), early detection and prediction (Stanculescu et al., 2014a; Henry et al., 2015), and clustering and subtyping (Marlin et al., 2012; Schulam et al., 2015).”
BackgroundAn interpretable machine learning model for accurate prediction of sepsis in the ICU
Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002936 · Cited by 832
“[13, 16–18] EMR alerts to detect existing sepsis can improve adherence to treatment protocols, decreases time until antibiotic administration and length of hospital stay, and can improve mortality [19–21] They can predict septic shock with 85% accuracy using either EMR data or high-resolution vital sign streams [13, 1…”
Fleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755
The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities
Floridi, L. (2023) · doi:10.1093/oso/9780198883098.001.0001 · Cited by 507
Surgical data science for next-generation interventions
Maier-Hein, L., Vedula, S. S., Speidel, S., Navab, N., Kikinis, R., Park, A., Eisenmann, M., Feussner, H., Forestier, G., Giannarou, S., et al. (2017) · Nature Biomedical Engineering · doi:10.1038/s41551-017-0132-7 · Cited by 566
Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist.
Norgeot, B., Quer, G., Beaulieu-Jones, B. K., Torkamani, A., Dias, R., Gianfrancesco, M., Arnaout, R., Kohane, I. S., Saria, S., Topol, E., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1041-y · Cited by 665
Self-citationArtificial Intelligence and Surgical Decision-making.
Loftus, T. J., Tighe, P. J., Filiberto, A. C., Efron, P. A., Brakenridge, S. C., Mohr, A. M., Rashidi, P., Upchurch, G. R., & Bihorac, A. (2020) · JAMA Surgery · doi:10.1001/jamasurg.2019.4917 · Cited by 650
“9,21,27,32 Each machine learning algorithm has distinct advantages and disadvantages for different tasks such that performance depends on fit between algorithm and task.”
BackgroundMachine Learning for Healthcare: On the Verge of a Major Shift in Healthcare Epidemiology
Wiens, J., & Shenoy, E. S. (2018) · Clinical Infectious Diseases · doi:10.1093/cid/cix731 · Cited by 574
“Predicting Patients at Greatest Risk of Developing Septic Shock [18]”
BackgroundDesautels, T., Calvert, J., Hoffman, J., Jay, M., Kerem, Y., Shieh, L., Shimabukuro, D., Chettipally, U., Feldman, M. D., Barton, C., et al. (2016) · JMIR Medical Informatics · doi:10.2196/medinform.5909 · Cited by 509
Early prediction of circulatory failure in the intensive care unit using machine learning
Hyland, S. L., Faltys, M., Hüser, M., Lyu, X., Gumbsch, T., Esteban, C., Bock, C., Horn, M., Moor, M., Rieck, B., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0789-4 · Cited by 477
How to Design AI for Social Good: Seven Essential Factors
Floridi, L., Cowls, J., King, T. C., & Taddeo, M. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00213-5 · Cited by 430
“They range from models to predict septic shock (Henry et al. 2015) to game-theoretic models to prevent poaching (Fang et al. 2016); from online reinforcement learning to target HIV-education at homeless youths (Yadav et al. 2016a, b) to probabilistic models to prevent harmful policing (Carton et…”
BackgroundShifting machine learning for healthcare from development to deployment and from models to data
Zhang, A., Xing, L., Zou, J., & Wu, J. C. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00898-y · Cited by 420
“NLP has enabled the automated translation of doctor–patient interactions to notes 5,104,105 , the summarization of clinical notes 106 , the captioning of medical images 107,108 and the prediction of disease progression 6,7 .”
MethodGoh, K. H., Wang, L., Yeow, A. Y. K., Poh, H., Li, K., Yeow, J. J. L., & Tan, G. Y. H. (2021) · Nature Communications · doi:10.1038/s41467-021-20910-4 · Cited by 415
The Application of Deep Learning in Cancer Prognosis Prediction
Zhu, W., Xie, L., Han, J., & Guo, X. (2020) · Cancers · doi:10.3390/cancers12030603 · Cited by 380
Early Prediction of Sepsis From Clinical Data: The PhysioNet/Computing in Cardiology Challenge 2019
Reyna, M. A., Josef, C. S., Jeter, R., Shashikumar, S. P., Westover, M. B., Nemati, S., Clifford, G. D., & Sharma, A. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004145 · Cited by 383
Shimabukuro, D. W., Barton, C. W., Feldman, M. D., Mataraso, S. J., & Das, R. (2017) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2017-000234 · Cited by 382
“2 While sepsis definitions vary, including the recent third international consensus definitions, 3 here we define severe sepsis as ‘organ dysfunction caused by sepsis’, 4 and sepsis as a dysregulated host response to infection.”
BackgroundAdams, R., Henry, K. E., Sridharan, A., Soleimani, H., Zhan, A., Rawat, N., Johnson, L., Hager, D. N., Cosgrove, S. E., Markowski, A., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01894-0 · Cited by 365
“First, to ensure that our conclusions were not dependent on our choice of statistical method, we repeated the analysis using an alternative method, inverse probability of treatment weighting 45–47 .”
MethodSelf-citationA Review of Challenges and Opportunities in Machine Learning for Health
Ghassemi, M., Naumann, T., Schulam, P., Beam, A. L., Chen, I. Y., & Ranganath, R. (2018) · PubMed · doi:10.48550/arxiv.1806.00388 · Cited by 248
Emerging Technologies for Molecular Diagnosis of Sepsis
Sinha, M., Jupe, J., Mack, H., Coleman, T. P., Lawrence, S. M., & Fraley, S. I. (2018) · Clinical Microbiology Reviews · doi:10.1128/cmr.00089-17 · Cited by 331
“septic shock in adult ICU patients 28 h before clinical onset (202), providing a superior”
Mao, Q., Jay, M., Hoffman, J. L., Calvert, J., Barton, C., Shimabukuro, D., Shieh, L., Chettipally, U., Fletcher, G., Kerem, Y., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-017833 · Cited by 336
“52 and additionally demonstrated the following conditions: ► systolic blood pressure of <90 mm Hg, defined as hypotension, for at least 30 min and ► who were resuscitated with ≥20 mL/kg over a 24-hour period, or ► who received ≥1200 mL in total fluids.(19) The onset time was defined as the first hour when either the h…”
BackgroundHorng, S., Sontag, D. A., Halpern, Y., Jernite, Y., Shapiro, N. I., & Nathanson, L. A. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174708 · Cited by 310
“However, whereas our paper focuses on the very early detection of sepsis, at Emergency Department triage, previous work considered identification of sepsis much later in a patient’s hospital stay, using data such as laboratory test results or continuous vital signs that are not available in our setting [22,23,24,25].”
MethodBig Data and Data Science in Critical Care
Sanchez-Pinto, L. N., Luo, Y., & Churpek, M. M. (2018) · Chest · doi:10.1016/j.chest.2018.04.037 · Cited by 282
Haimovich, A. D., Ravindra, N. G., Stoytchev, S., Young, H. P., Wilson, F. P., van Dijk, D., Schulz, W. L., & Taylor, R. A. (2020) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2020.07.022 · Cited by 294
Surviving sepsis campaign: research priorities for sepsis and septic shock
Coopersmith, C. M., De Backer, D., Deutschman, C. S., Ferrer, R., Lat, I., Machado, F. R., Martin, G. S., Martin-Loeches, I., Nunnally, M. E., Antonelli, M., et al. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5175-z · Cited by 281
Sendak, M. P., Ratliff, W., Sarro, D., Alderton, E., Futoma, J., Gao, M., Nichols, M., Revoir, M., Yashar, F., Miller, C., et al. (2020) · JMIR Medical Informatics · doi:10.2196/15182 · Cited by 287
“with the CMS SEP-1 measure and quality improvement efforts at peer institutions, specified in Multimedia Appendix 1 [23,24].”
MethodGiannini, H. M., Ginestra, J. C., Chivers, C., Draugelis, M., Hanish, A., Schweickert, W. D., Fuchs, B. D., Meadows, L., Lynch, M., Donnelly, P. J., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003891 · Cited by 269
Bernert, R. A., Hilberg, A. M., Melia, R., Kim, J. P., Shah, N. H., & Abnousi, F. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17165929 · Cited by 222
“Risk models learned, using such data, have been developed to predict preterm infant morbidity [20], early warning signs of sepsis [21], and risk for rare outcomes (e.g., first-onset cancers, congestive heart failure, and schizophrenia) with a high degree (i.e., > 90”
BackgroundPopulation-Level Prediction of Type 2 Diabetes From Claims Data and Analysis of Risk Factors
Razavian, N., Blecker, S., Schmidt, A. M., Smith-McLallen, A., Nigam, S., & Sontag, D. (2015) · Big Data · doi:10.1089/big.2015.0020 · Cited by 212
Learning representations for the early detection of sepsis with deep neural networks
Kam, H. J., & Kim, H. Y. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.08.015 · Cited by 218
Henry, K. E., Kornfield, R., Sridharan, A., Linton, R. C., Groh, C., Wang, T., Wu, A., Mutlu, B., & Saria, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00597-7 · Cited by 207
Self-citationDelahanty, R. J., Alvarez, J., Flynn, L. M., Sherwin, R. L., & Jones, S. S. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2018.11.036 · Cited by 206
An attention based deep learning model of clinical events in the intensive care unit
Kaji, D. A., Zech, J. R., Kim, J. S., Cho, S. K., Dangayach, N. S., Costa, A. B., & Oermann, E. K. (2019) · PLOS ONE · doi:10.1371/journal.pone.0211057 · Cited by 198
Shameer, K., Badgeley, M. A., Miotto, R., Glicksberg, B. S., Morgan, J. W., & Dudley, J. T. (2017) · Briefings in Bioinformatics · doi:10.1093/bib/bbv118 · Cited by 198
“By capturing continuous vital sign data for populations of patients, we will be able to develop more sophisticated and elegant models for a patient’s normal physiology, and enable identification of subtle or activity-specific changes toward pathophysiology early in the course of disease progression [112, 159, 160].”
BackgroundMasino, A. J., Harris, M. C., Forsyth, D., Ostapenko, S., Srinivasan, L., Bonafide, C. P., Balamuth, F., Schmatz, M., & Grundmeier, R. W. (2019) · PLOS ONE · doi:10.1371/journal.pone.0212665 · Cited by 183
AI, Health, and Health Care Today and Tomorrow: The JAMA Summit Report on Artificial Intelligence
Angus, D. C., Khera, R., Lieu, T., Liu, V., Ahmad, F. S., Anderson, B., Bhavani, S. V., Bindman, A., Brennan, T., Celi, L. A., et al. (2025) · JAMA · doi:10.1001/jama.2025.18490 · Cited by 195
Self-citationHow to Design AI for Social Good: Seven Essential Factors
Floridi, L., Cowls, J., King, T. C., & Taddeo, M. (2021) · Philosophical Studies Series · doi:10.1007/978-3-030-81907-1_9 · Cited by 161
Machine Learning in Healthcare
Callahan, A., & Shah, N. H. (2017) · Key Advances in Clinical Informatics · doi:10.1016/b978-0-12-809523-2.00019-4 · Cited by 160
Barton, C., Chettipally, U., Zhou, Y., Jiang, Z., Lynn-Palevsky, A., Le, S., Calvert, J., & Das, R. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.04.027 · Cited by 175
“Other studies have applied machine learning techniques to predict sepsis onset up to 48 h prior to organ failure [28], although these algorithms require significantly more data input including patient histories and laboratory test results.”
BackgroundA Path for Translation of Machine Learning Products into Healthcare Delivery
(2020) · EMJ Innovations · doi:10.33590/emjinnov/19-00172 · Cited by 172
Comparing machine learning algorithms for predicting ICU admission and mortality in COVID-19
Subudhi, S., Verma, A., Patel, A. B., Hardin, C. C., Khandekar, M. J., Lee, H., McEvoy, D., Stylianopoulos, T., Munn, L. L., Dutta, S., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00456-x · Cited by 170
Impact of a deep learning sepsis prediction model on quality of care and survival
Boussina, A., Shashikumar, S. P., Malhotra, A., Owens, R. L., El-Kareh, R., Longhurst, C. A., Quintero, K., Donahue, A., Chan, T. C., Nemati, S., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-023-00986-6 · Cited by 170
“The detection of patients with sepsis can be challenging due to the heterogeneity of the condition; thus, we and others have used predictive analytics to improve the early detection 10 – 14 .”
Strich, J. R., Heil, E. L., & Masur, H. (2020) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiaa221 · Cited by 188
“The Targeted Real-time Early Warning Score (TREWScore) has been developed in ICU patients to predict development of septic shock and could potentially be used to identify patients at high risk for developing septic shock [66].”
BackgroundTiming of antibiotic therapy in the ICU
Kollef, M. H., Shorr, A. F., Bassetti, M., Timsit, J.-F., Micek, S. T., Michelson, A. P., & Garnacho-Montero, J. (2021) · Critical Care · doi:10.1186/s13054-021-03787-z · Cited by 161
Early Prediction of Sepsis from Clinical Data: The PhysioNet/Computing in Cardiology Challenge 2019
Reyna, M., Prajwal Shashikumar, S., Moody, B., Gu, P., Sharma, A., nemati, S., & Clifford, G. (2019) · Computing in Cardiology Conference (CinC) · doi:10.22489/cinc.2019.412 · Cited by 153
Ginestra, J. C., Giannini, H. M., Schweickert, W. D., Meadows, L., Lynch, M. J., Pavan, K., Chivers, C. J., Draugelis, M., Donnelly, P. J., Fuchs, B. D., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003803 · Cited by 159
Ross, E. G., Shah, N. H., Dalman, R. L., Nead, K. T., Cooke, J. P., & Leeper, N. J. (2016) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2016.04.026 · Cited by 149
McCoy, A., & Das, R. (2017) · BMJ Open Quality · doi:10.1136/bmjoq-2017-000158 · Cited by 148
“14 Other prior works applying machine learning algorithms to the EHR in the detection or prediction of sepsis include the retrospective studies of Henry et al 16 and Nachimuthu and Haug, 17 and the pilot studies of Sawyer et al .”
MethodWinter, A., Stäubert, S., Ammon, D., Aiche, S., Beyan, O., Bischoff, V., Daumke, P., Decker, S., Funkat, G., Gewehr, J., et al. (2018) · Methods of Information in Medicine · doi:10.3414/me18-02-0004 · Cited by 130
“4% of all patients requiring mechanical ventilation [35].”
Artificial intelligence sepsis prediction algorithm learns to say “I don’t know”
Shashikumar, S. P., Wardi, G., Malhotra, A., & Nemati, S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00504-6 · Cited by 125
S-LIME: Stabilized-LIME for Model Explanation
Zhou, Z.-Z., Hooker, G., & Wang, F. (2021) · Knowledge Discovery and Data Mining · doi:10.1145/3447548.3467274 · Cited by 153
“There have been several work to predict sepsis based on EHR [16, 21, 29].”
BackgroundBetter medicine through machine learning: What’s real, and what’s artificial?
Saria, S., Butte, A., & Sheikh, A. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002721 · Cited by 127
Self-citationIslam, K. R., Prithula, J., Kumar, J., Tan, T. L., Reaz, M. B. I., Sumon, M. S. I., & Chowdhury, M. E. H. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12175658 · Cited by 153
Clinical applications of artificial intelligence in sepsis: A narrative review
Schinkel, M., Paranjape, K., Nannan Panday, R. S., Skyttberg, N., & Nanayakkara, P. W. B. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103488 · Cited by 130
Reporting and Implementing Interventions Involving Machine Learning and Artificial Intelligence
Bates, D. W., Auerbach, A., Schulam, P., Wright, A., & Saria, S. (2020) · Annals of Internal Medicine · doi:10.7326/m19-0872 · Cited by 114
Self-citationFeng, C., Wang, L., Chen, X., Zhai, Y., Zhu, F., Chen, H., Wang, Y., Su, X., Huang, S., Tian, L., et al. (2021) · Annals of Translational Medicine · doi:10.21037/atm-20-3073 · Cited by 124
“Therefore, it is necessary to integrate all the above nonspecific but important features by machinelearning algorithms for secondary analysis in order to develop cost-effective diagnostic aid models (22,23).”
BackgroundHenry, K. E., Adams, R., Parent, C., Soleimani, H., Sridharan, A., Johnson, L., Hager, D. N., Cosgrove, S. E., Markowski, A., Klein, E. Y., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01895-z · Cited by 144
“Described in full in Henry et al. 36,37 , suspicion of organ dysfunction was determined based on administration of new intravenous antibiotic with at least four days of antibiotic treatment and a culture within 48 h or the presence of both documentation of sepsis and two of the systemic inflammatory response syndrome…”
MethodInfluentialSelf-citationKaraba, S. M., Jones, G. F., Helsel, T., Smith, L., Avery, R. K., Dzintars, K., Salinas, A. B., Keller, S. C., Townsend, J., Klein, E. Y., et al. (2020) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofaa578 · Cited by 143
“Demographic information, medical history, comorbid conditions, data from a previously validated tool that identifies patients at risk for septic shock (Targeted Real-time Early Warning Score [TREWS]) [16], and medication orders and administration were obtained electronically from the medical records.”
LiSep LSTM: A Machine Learning Algorithm for Early Detection of Septic Shock
Fagerström, J., Bång, M., Wilhelms, D., & Chew, M. S. (2019) · Scientific Reports · doi:10.1038/s41598-019-51219-4 · Cited by 124
“The features, that is, the input variables used by our model were chosen to match, as closely as possible, the list in the Supplementary Materials of Henry et al .’s paper 14 .”
BackgroundMethodResultInfluentialDeepAISE – An interpretable and recurrent neural survival model for early prediction of sepsis
Shashikumar, S. P., Josef, C. S., Sharma, A., & Nemati, S. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102036 · Cited by 109
“Other works [15] have focused on developing models to predict septic shock, which occurs when sepsis leads to low blood pressure that persists despite treatment with intravenous fluids.”
BackgroundLearning to Detect Sepsis with a Multitask Gaussian Process RNN Classifier
Futoma, J., Hariharan, S., & Heller, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04152 · Cited by 101
“Finally, (Henry et al., 2015) used a Cox regression to predict sepsis using clinical time series data, although they do not account for temporal structure since they simply create feature and event-time pairs from raw data.”
MethodA deep learning model for real-time mortality prediction in critically ill children
Kim, S. Y., Kim, S., Cho, J., Kim, Y. S., Sol, I. S., Sung, Y., Cho, I., Park, M., Jang, H., Kim, Y. H., et al. (2019) · Critical Care · doi:10.1186/s13054-019-2561-z · Cited by 142
An Explainable Artificial Intelligence Predictor for Early Detection of Sepsis
Yang, M., Liu, C., Wang, X., Li, Y., Gao, H., Liu, X., & Li, J. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004550 · Cited by 118
Identifying Patients With Sepsis on the Hospital Wards
Bhattacharjee, P., Edelson, D. P., & Churpek, M. M. (2017) · Chest · doi:10.1016/j.chest.2016.06.020 · Cited by 120
Pediatric Severe Sepsis Prediction Using Machine Learning
Le, S., Hoffman, J. L., Barton, C., Fitzgerald, J. C., Allen, A. O., Pellegrini, E., Calvert, J. S., & Das, R. (2019) · Frontiers in Pediatrics · doi:10.3389/fped.2019.00413 · Cited by 126
Yan, M. Y., Gustad, L. T., & Nytrø, Ø. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab236 · Cited by 119
“Delahanty et al,(51) Hammoud et al,(54) Goh et al,(52) and Qin et al(55) compared their algorithm to scoring systems used in clinical practice, such as SIRS,(121) sequential organ failure assessment (SOFA),(122) quick SOFA (qSOFA),(123) modified early warning system (MEWS),(124) or a targeted real-time early warning s…”
Surviving Sepsis Campaign: Research Priorities for Sepsis and Septic Shock
Coopersmith, C. M., Backer, D. D., Deutschman, C. S., Ferrer, R., Lat, I., Machado, F. R., Martin, G. S., Martín‐Loeches, I., Nunnally, M., Antonelli, M. M., et al. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003225 · Cited by 128
Shen, Y., Zhang, Y., Du, J., Jiang, B., Shan, T., Li, H., Bao, H., & Si, Y. (2021) · Journal of Neuroinflammation · doi:10.1186/s12974-021-02300-1 · Cited by 116
Applying Artificial Intelligence to Identify Physiomarkers Predicting Severe Sepsis in the PICU*
Kamaleswaran, R., Akbilgic, O., Hallman, M. A., West, A. N., Davis, R. L., & Shah, S. H. (2018) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000001666 · Cited by 114
Clinical Predictive Models for COVID-19: Systematic Study
Schwab, P., DuMont Schütte, A., Dietz, B., & Bauer, S. (2020) · Journal of Medical Internet Research · doi:10.2196/21439 · Cited by 101
“Clinical predictive models have, for example, been used to predict risk of septic shock [32,33], risk of heart failure [34], readmission following heart failure [35-37], false alarms in critical care [38], risk scores [39], outcomes [40] and mortality in pneumonia [41,42] , and mortality risk in critical care [43-45].”
MethodSingh, K., Valley, T. S., Tang, S., Li, B. Y., Kamran, F., Sjoding, M. W., Wiens, J., Otles, E., Donnelly, J. P., Wei, M. Y., et al. (2021) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202006-698oc · Cited by 111
Machine learning for early detection of sepsis: an internal and temporal validation study
Bedoya, A. D., Futoma, J., Clement, M. E., Corey, K., Brajer, N., Lin, A., Simons, M. G., Gao, M., Nichols, M., Balu, S., et al. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooaa006 · Cited by 109
“Most sepsis models were developed on cohorts of ICU patients 16,30,38,39 and nearly all use the publicly available MIMIC dataset.”
MethodResultArtificial Intelligence for Social Good
Hager, G. D., Drobnis, A., Fang, F., Ghani, R., Greenwald, A., Lyons, T., Parkes, D. C., Schultz, J., Saria, S., Smith, S. F., et al. (2019) · arXiv · doi:10.48550/arxiv.1901.05406 · Cited by 108
Self-citationTomašev, N., Harris, N., Baur, S., Mottram, A., Glorot, X., Rae, J. W., Zielinski, M., Askham, H., Saraiva, A., Magliulo, V., et al. (2021) · Nature Protocols · doi:10.1038/s41596-021-00513-5 · Cited by 130
“Use cases have ranged from mortality 4 and length of stay (LoS) prediction 5 to more targeted algorithms for sepsis 6 , shock 7 or delirium 8 .”
Machine learning for prediction of septic shock at initial triage in emergency department
Kim, J., Chang, H., Kim, D., Jang, D.-H., Park, I., & Kim, K. (2020) · Journal of Critical Care · doi:10.1016/j.jcrc.2019.09.024 · Cited by 104
An Improved Multi-Output Gaussian Process RNN with Real-Time Validation for Early Sepsis Detection
Futoma, J., Hariharan, S., Sendak, M., Brajer, N., Clement, M. E., Bedoya, A., O’Brien, C. L., & Heller, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.05894 · Cited by 65
“(Henry et al. (2015)) present a simple Cox regression approach to prediction of sepsis using clinical time series data.”
MethodTang, S., Davarmanesh, P., Song, Y., Koutra, D., Sjoding, M. W., & Wiens, J. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa139 · Cited by 87
Chen, J. H., Alagappan, M., Goldstein, M. K., Asch, S. M., & Altman, R. B. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.03.006 · Cited by 101
Sparse multi-output Gaussian processes for online medical time series prediction
Cheng, L.-F., Dumitrascu, B., Darnell, G., Chivers, C., Draugelis, M. E., Li, K., & Engelhardt, B. E. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-1069-4 · Cited by 115
“…presence of sparse, unaligned time-series data for up to 24 covariates, and we would expect to further associate the cross-covariate dynamics to more complicated diseases, such as septic shock [51], where the interactions of multiple covariates are jointly taken into consideration for diagnosis.”
BackgroundRobot use self-efficacy in healthcare work (RUSH): development and validation of a new measure
Turja, T., Rantanen, T., & Oksanen, A. (2017) · AI & Society · doi:10.1007/s00146-017-0751-2 · Cited by 104
“Artificial intelligence is predicted to create a new generation of assistive tools (Henry et al. 2015), since hospitals have both assistive equipment and information systems that can afford to be more autonomous and easy to use.”
BackgroundLin, C., Zhang, Y., Ivy, J., Capan, M., Arnold, R., Huddleston, J. M., & Chi, M. (2018) · 2018 IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2018.00032 · Cited by 85
“Some tools can successfully identify patients who are already in septic shock but cannot accurately predict who will have septic shock in the future [18].”
BackgroundMethodAutomated prediction of sepsis using temporal convolutional network
Kok, C., Jahmunah, V., Oh, S. L., Zhou, X., Gururajan, R., Tao, X., Cheong, K. H., Gururajan, R., Molinari, F., & Acharya, U. R. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103957 · Cited by 105
Chiew, C. J., Liu, N., Tagami, T., Wong, T. H., Koh, Z. X., & Ong, M. E. H. (2019) · Medicine · doi:10.1097/md.0000000000014197 · Cited by 89
“[20] A randomised controlled trial also showed that the use of a machine learning-based severe sepsis surveillance and alert system improved patient outcomes such as length of stay and IHM.”
BackgroundPadula, W. V., Kreif, N., Vanness, D. J., Adamson, B., Rueda, J.-D., Felizzi, F., Jonsson, P., IJzerman, M. J., Butte, A., & Crown, W. (2022) · Value in Health · doi:10.1016/j.jval.2022.03.022 · Cited by 80
Manaktala, S., & Claypool, S. R. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw056 · Cited by 89
Septic shock prediction for ICU patients via coupled HMM walking on sequential contrast patterns
Ghosh, S., Li, J., Cao, L., & Ramamohanarao, K. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.12.010 · Cited by 91
Predicting childhood obesity using electronic health records and publicly available data
Hammond, R., Athanasiadou, R., Curado, S., Aphinyanaphongs, Y., Abrams, C. B., Messito, M. J., Gross, R. S., Katzow, M. W., Jay, M. R., Razavian, N., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0215571 · Cited by 105
Huang, C., Li, S.-X., Caraballo, C., Masoudi, F. A., Rumsfeld, J. S., Spertus, J. A., Normand, S.-L. T., Mortazavi, B. J., & Krumholz, H. M. (2021) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.120.007526 · Cited by 83
Abdulaal, A., Patel, A. M., Charani, E., Denny, S., Mughal, N., & Moore, L. S. P. (2020) · Journal of Medical Internet Research · doi:10.2196/20259 · Cited by 94
“However, significant recent advances have been made in deep learning interpretability research [23] and specifically in creating predictive machine learning models for health care [24-26].”
BackgroundCrocin protects cardiomyocytes against LPS-Induced inflammation
Rahimi, V. B., Khammar, M. T., Rakhshandeh, H., Samzadeh‐Kermani, A., Hosseini, A., & Askari, V. R. (2019) · Pharmacological Reports · doi:10.1016/j.pharep.2019.07.007 · Cited by 85
“Sepsis is a problem which leads to more than 30% mortality in the world [1].”
Designing AI for Social Good: Seven Essential Factors
Cowls, J., King, T., Taddeo, M., & Floridi, L. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3388669 · Cited by 83
“They range from models to predict septic shock (Henry et al. 2015) to game-theoretic models to prevent poaching (Fang et al. 2016); from online reinforcement learning to target HIV-education at homeless youths (Yadav, Chan, Jiang, et al. 2016) to probabilistic models to prevent harmful policing…”
BackgroundData-driven discovery of a novel sepsis pre-shock state predicts impending septic shock in the ICU
Liu, R., Greenstein, J. L., Granite, S. J., Fackler, J. C., Bembea, M. M., Sarma, S. V., & Winslow, R. L. (2019) · Scientific Reports · doi:10.1038/s41598-019-42637-5 · Cited by 79
“The major performance differences between our pre-shock state-based method vs the Cox method as employed previously by Henry et al .”
MethodResultInfluential
Metadata
- Authors
- Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Saria, Suchi
- Venue
- Science Translational Medicine
- Published
- 2015-08-05
- Volume
- 7
- Issue
- 299
- Pages
- 299ra122-299ra122
- ISSN
- 1946-6234 (ISSN-L)
- 1946-6242
- OpenAlex
- W1943063538
- Cited by
- 598
- References
- 62
- Citations by year
- 2026: 52 · 2025: 54 · 2024: 43 · 2023: 64 · 2022: 44 · 2021: 89 · 2020: 72 · 2019: 78 · 2018: 43 · 2017: 33 · 2016: 22 · 2015: 4
- FWCI
- 26.66
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science Translational Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (ID 1232825)
- Gordon and Betty Moore Foundation
- Google Research (ID 1202463721)
- Johns Hopkins University Whiting School of Engineering
- Topics
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Health Sciences › Medicine › Nephrology › Acute Kidney Injury Research
- Health Sciences › Medicine › Surgery › Abdominal Surgery and Complications
- Keywords
- septic shock, sepsis, early warning scores, intensive care unit patients, electronic health records, Modified Early Warning Score, systemic inflammatory response syndrome, hypotension, hyperlactatemia, organ dysfunction, risk stratification
- MeSH terms
- Humans, Intensive Care Units, ROC Curve, Shock, Septic, United States, Secondary Prevention, Propensity Score, Early Medical Intervention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.