Early Detection of Sepsis With Machine Learning Techniques: A Brief Clinical Perspective
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Sepsis is a major cause of death worldwide. Over the past years, prediction of clinically relevant events through machine learning models has gained particular attention. In the present perspective, we provide a brief, clinician-oriented vision on the following relevant aspects concerning the use of machine learning predictive models for the early detection of sepsis in the daily practice: (i) the controversy of sepsis definition and its influence on the development of prediction models; (ii) the choice and availability of input features; (iii) the measure of the model performance, the output, and their usefulness in the clinical practice. The increasing involvement of artificial intelligence and machine learning in health care cannot be disregarded, despite important pitfalls that should be always carefully taken into consideration. In the long run, a rigorous multidisciplinary approach to enrich our understanding in the application of machine learning techniques for the early recognition of sepsis may show potential to augment medical decision-making when facing this heterogeneous and complex syndrome.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579 · cited 1×
“Conceptually, machine learning, which is a branch of artificial intelligence, is different from standard computer expert systems for helping clinicians in daily decision making (20).”
BackgroundFleischmann, C., Scherag, A., Adhikari, N. K. J., Hartog, C. S., Tsaganos, T., Schlattmann, P., Angus, D. C., & Reinhart, K. (2016) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201504-0781oc · Cited by 3,548
Big Data and Machine Learning in Health Care
Beam, A. L., & Kohane, I. S. (2018) · JAMA · doi:10.1001/jama.2017.18391 · Cited by 2,506 · cited 2×
“…into consideration that the field of machine learning is closely connected with the concept of “big data,” since, at least in general, the possibility of including complex features in prediction models requires far larger samples than those usually employed in classical prediction studies (22, 27).”
BackgroundResultTime to treatment and mortality during mandated emergency care for sepsis.
Seymour, C. W., Gesten, F., Prescott, H. C., Friedrich, M. E., Iwashyna, T. J., Phillips, G. S., Lemeshow, S., Osborn, T., Terry, K. M., & Levy, M. M. (2017) · New England Journal of Medicine · doi:10.1056/nejmoa1703058 · Cited by 2,225
Incidence and trends of sepsis in US hospitals using clinical vs claims data, 2009-2014.
Rhee, C., Dantes, R., Epstein, L., Murphy, D. J., Seymour, C. W., Iwashyna, T. J., Kadri, S. S., Angus, D. C., Danner, R. L., Fiore, A. E., et al. (2017) · JAMA · doi:10.1001/jama.2017.13836 · Cited by 1,884
Derivation, Validation, and Potential Treatment Implications of Novel Clinical Phenotypes for Sepsis
Seymour, C. W., Kennedy, J. N., Wang, S., Chang, C.-C. H., Elliott, C. F., Xu, Z., Berry, S., Clermont, G., Cooper, G., Gomez, H., et al. (2019) · JAMA · doi:10.1001/jama.2019.5791 · Cited by 1,567
Big data and machine learning algorithms for health-care delivery
Ngiam, K. Y., & Khor, I. W. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30149-4 · Cited by 1,424
Ethical and legal challenges of artificial intelligence-driven healthcare
Gerke, S., Minssen, T., & Cohen, G. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00012-5 · Cited by 1,170
Prevalence and outcomes of infection among patients in intensive care units in 2017.
Vincent, J.-L., Sakr, Y., Singer, M., Martin-Loeches, I., Machado, F. R., Marshall, J. C., Finfer, S., Pelosi, P., Brazzi, L., Aditianingsih, D., et al. (2020) · JAMA · doi:10.1001/jama.2020.2717 · Cited by 1,011
Self-citationThe immune system’s role in sepsis progression, resolution, and long-term outcome
Delano, M. J., & Ward, P. A. (2016) · Immunological Reviews · doi:10.1111/imr.12499 · Cited by 880
An interpretable machine learning model for accurate prediction of sepsis in the ICU
Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002936 · Cited by 832 · cited 1×
“(47) ICU patients 27,527 Vital signs, laboratory data,”
BackgroundFleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755 · cited 2×
“Indeed, these models may continuously update their prediction of sepsis by utilizing the unceasing stream of electronic data from the EMR and/or vital signs monitors (57, 74, 85, 92, 94).”
BackgroundInfluentialA targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · cited 1×
“(33) ICU patients in the MIMIC-II dataset (34) 16,025 Vital signs, laboratory data Supervised learning based on Cox”
MethodDesautels, T., Calvert, J., Hoffman, J., Jay, M., Kerem, Y., Shieh, L., Shimabukuro, D., Chettipally, U., Feldman, M. D., Barton, C., et al. (2016) · JMIR Medical Informatics · doi:10.2196/medinform.5909 · Cited by 509
Shimabukuro, D. W., Barton, C. W., Feldman, M. D., Mataraso, S. J., & Das, R. (2017) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2017-000234 · Cited by 382
Iwashyna, T. J., Odden, A., Rohde, J., Bonham, C., Kuhn, L., Malani, P., Chen, L., & Flanders, S. (2014) · Medical Care · doi:10.1097/mlr.0b013e318268ac86 · Cited by 358
Mao, Q., Jay, M., Hoffman, J. L., Calvert, J., Barton, C., Shimabukuro, D., Shieh, L., Chettipally, U., Fletcher, G., Kerem, Y., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-017833 · Cited by 336
Horng, S., Sontag, D. A., Halpern, Y., Jernite, Y., Shapiro, N. I., & Nathanson, L. A. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174708 · Cited by 310
Presenting machine learning model information to clinical end users with model facts labels
Sendak, M. P., Gao, M., Brajer, N., & Balu, S. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0253-3 · Cited by 279 · cited 1×
“In this regard, there are no standardized directives on the optimal way to present model pitfalls to clinicians together with the model output, although “model facts” labels have started to be proposed (100).”
BackgroundGiannini, H. M., Ginestra, J. C., Chivers, C., Draugelis, M., Hanish, A., Schweickert, W. D., Fuchs, B. D., Meadows, L., Lynch, M., Donnelly, P. J., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003891 · Cited by 269
Prediction of sepsis patients using machine learning approach: a meta-analysis
Islam, M. M., Nasrin, T., Walther, B. A., Wu, C.-C., Yang, H.-C., & Li, Y.-C. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.12.027 · Cited by 259
A computational approach to early sepsis detection
Calvert, J. S., Price, D. A., Chettipally, U. K., Barton, C. W., Feldman, M. D., Hoffman, J. L., Jay, M., & Das, R. (2016) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2016.05.003 · Cited by 244
Learning representations for the early detection of sepsis with deep neural networks
Kam, H. J., & Kim, H. Y. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.08.015 · Cited by 218
Delahanty, R. J., Alvarez, J., Flynn, L. M., Sherwin, R. L., & Jones, S. S. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2018.11.036 · Cited by 206
Barton, C., Chettipally, U., Zhou, Y., Jiang, Z., Lynn-Palevsky, A., Le, S., Calvert, J., & Das, R. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.04.027 · Cited by 175
Shashikumar, S. P., Stanley, M. D., Sadiq, I., Li, Q., Holder, A., Clifford, G. D., & Nemati, S. (2017) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2017.08.013 · Cited by 167 · cited 1×
“(45) ICU patients 242 Vital signs, clinical data Elastic-net LR((9,10)) Sepsis according to Sepsis-3”
MethodPredicting sepsis with a recurrent neural network using the MIMIC III database
Scherpf, M., Gräßer, F., Malberg, H., & Zaunseder, S. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103395 · Cited by 167
Ginestra, J. C., Giannini, H. M., Schweickert, W. D., Meadows, L., Lynch, M. J., Pavan, K., Chivers, C. J., Draugelis, M., Donnelly, P. J., Fuchs, B. D., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003803 · Cited by 159 · cited 1×
“…probability provided to doctors may be a clinically understandable value that can be easily weighted in the balance when deciding whether or not to administer antimicrobials, possibly also improving acceptance of the implementation of machine learning-based sepsis alerts in daily practice (99).”
BackgroundClinical applications of artificial intelligence in sepsis: A narrative review
Schinkel, M., Paranjape, K., Nannan Panday, R. S., Skyttberg, N., & Nanayakkara, P. W. B. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103488 · Cited by 130
Machine learning for early detection of sepsis: an internal and temporal validation study
Bedoya, A. D., Futoma, J., Clement, M. E., Corey, K., Brajer, N., Lin, A., Simons, M. G., Gao, M., Nichols, M., Balu, S., et al. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooaa006 · Cited by 109
Luz, C. F., Vollmer, M., Decruyenaere, J., Nijsten, M. W., Glasner, C., & Sinha, B. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.02.003 · Cited by 106
Burdick, H., Pino, E., Gabel-Comeau, D., McCoy, A., Gu, C., Roberts, J., Le, S., Slote, J., Pellegrini, E., Green-Saxena, A., et al. (2020) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2019-100109 · Cited by 80
AI, Machine Learning, and Ethics in Health Care
Johnson, S. L. J. (2019) · Journal of Legal Medicine · doi:10.1080/01947648.2019.1690604 · Cited by 53
Brown, S. M., Jones, J., Kuttler, K. G., Keddington, R. K., Allen, T. L., & Haug, P. (2016) · BMC Emergency Medicine · doi:10.1186/s12873-016-0095-0 · Cited by 45 · cited 1×
“(39) Patients admitted to the ED 226,481 Vital signs, laboratory data, age NB((1)) Severe sepsis according to ICD-9 coding AUROC, sensitivity, specificity, PPV, NPV”
Method
Cited by
Yan, M. Y., Gustad, L. T., & Nytrø, Ø. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab236 · Cited by 119
O'Reilly, D., McGrath, J., & Martin-Loeches, I. (2024) · Journal of Intensive Medicine · doi:10.1016/j.jointm.2023.10.001 · Cited by 55
Jiang, S., Dai, S., Li, Y., Zhou, X., Jiang, C., Tian, C., Yuan, Y., Li, C., & Zhao, Y. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.103048 · Cited by 18
“34 By using the structured EHR, this complicated process is avoided, as the patient ’ s medical history and physical examination information are stored in a structured manner, creating a comprehensive emergency EHR database.”
Ground truth labels challenge the validity of sepsis consensus definitions in critical illness.
Lindner, H. A., Schamoni, S., Kirschning, T., Worm, C., Hahn, B., Centner, F.-S., Schoettler, J. J., Hagmann, M., Krebs, J., Mangold, D., et al. (2022) · Journal of Translational Medicine · doi:10.1186/s12967-022-03228-7 · Cited by 14
Metadata
- Authors
- Giacobbe, D. R., Signori, A., Del Puente, F., Mora, S., Carmisciano, L., Briano, F., Vena, A., Ball, L., Robba, C., Pelosi, P., Giacomini, M., & Bassetti, M.
- Venue
- Frontiers in Medicine
- Publisher
- Frontiers Media SA
- Published
- 2021-02-12
- Volume
- 8
- Pages
- 617486-617486
- ISSN
- 2296-858X (ISSN-L)
- OpenAlex
- W3130868966
- Cited by
- 65
- References
- 35
- FWCI
- 6.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.