Cited by 62Sepsis Diagnosis and TreatmentMachine Learning in HealthcareAcute Kidney Injury Research

High-performance detection and early prediction of septic shock for alcohol-use disorder patients

Open access
Calvert, Jacob, Desautels, Thomas, Chettipally, Uli, Barton, Christopher, Hoffman, Jana, Jay, Melissa, Mao, Qingqing, Mohamadlou, Hamid +1 more·2016·Annals of Medicine & Surgery

Abstract

BACKGROUND: The presence of Alcohol Use Disorder (AUD) complicates the medical conditions of patients and increases the difficulty of detecting and predicting the onset of septic shock for patients in the ICU. METHODS: We have developed a high-performance sepsis prediction algorithm, InSight, which outperforms existing methods for AUD patient populations. InSight analyses a combination of singlets, doublets, and triplets of clinical measurements over time to generate a septic shock risk score. AUD patients obtained from the MIMIC III database were used in this retrospective study to train InSight and compare performance with the Modified Early Warning Score (MEWS), the Simplified Acute Physiology Score (SAPS II), and the Systemic Inflammatory Response Syndrome (SIRS) for septic shock prediction and detection. RESULTS: From 4-fold cross validation, InSight performs particularly well on diagnostic odds ratio and demonstrates a relatively high Area Under the Receiver Operating Characteristic (AUROC) metric. Four hours prior to onset, InSight had an average AUROC of 0.815, and at the time of onset, InSight had an average AUROC value of 0.965. When applied to patient populations where AUD may complicate prediction methods of sepsis, InSight outperforms existing diagnostic tools. CONCLUSIONS: Analysis of the higher order correlations and trends between relevant clinical measurements using the InSight algorithm leads to more accurate detection and prediction of septic shock, even in cases where diagnosis may be confounded by AUD.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.amsu.2016.04.023

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Calvert et al. was one of the first to study machine learning to identify sepsis in an ICU population, and Seymour et al. assessed the sepsis-3 criteria.

    “Calvert et al. [33] was one of the first to study machine learning to identify sepsis in an ICU population and Seymour et al. [34] assessed the sepsis-3 criteria.”

    From Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy (2020) · cites this paper as [33]

    The Methods (Data set; InSight training) describe an algorithm tested on ICU records to detect and predict septic shock in patients with alcohol-use disorder. The cited paper does not establish that it was among the first machine-learning studies of sepsis, and its studied outcome and population are narrower than the claim suggests. The separately cited statement about Seymour et al. is not attributed to Calvert et al. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Numerous models were tested on the freely accessible MIMIC database.

    “numerous models were tested on the freely accessible MIMIC database [27, 33, 52–59]”

    From Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy (2020) · cites this paper as [33]

    The Methods (Data set and Abstract > Methods; page numbers unavailable) say the study used MIMIC III data to train InSight and compare it with MEWS, SAPS II, and SIRS. The copy does not establish that the database itself was freely accessible; it calls the SQL queries used for SAPS II open source, not the database. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 42 · Cited by 62

Research works printed but not linked: 34

  1. [2]de Wit M. Jones D.G. Sessler C.N. Zilberberg M.D. Weaver M.F. Alcohol-use disorders in the critically ill patient CHEST J. 138 4 2010 Oct 1 994 1003 PMC2951755 20923804
  2. [4]Baldwin W.A. Rosenfeld B.A. Breslow M.J. Buchman T.G. Deutschman C.S. Moore R.D. Substance abuse-related admissions to adult intensive care CHEST J. 103 1 1993 Jan 1 21 25 8417881
  3. [5]Lindenauer P.K. Normand S.L. Drye E.E. Lin Z. Goodrich K. Desai M.M. Bratzler D.W. O'Donnell W.J. Metersky M.L. Krumholz H.M. Development, validation, and results of a measure of 30-day readmission following hospitalization for pneumonia J. Hosp. Med. 6 3 2011 Mar 1 142 150 21387551
  4. [7]De Wit M. Best A.M. Gennings C. Burnham E.L. Moss M. Alcohol use disorders increase the risk for mechanical ventilation in medical patients Alcohol. Clin. Exp. Res. 31 7 2007 Jul 1 1224 1230 17511746
  5. [8]de Wit M. Zilberberg M.D. Boehmler J.M. Bearman G.M. Edmond M.B. Outcomes of patients with alcohol use disorders experiencing healthcare-associated infections Alcohol. Clin. Exp. Res. 35 7 2011 Jul 1 1368 1373 21676005
  6. [9]Mehta A.J. Alcoholism and critical illness: a review World J. Crit. Care Med. 5 1 2016 Feb 4 27 26855891 PMC4733453
  7. [10]Hoyert D.L. Heron M.P. Murphy S.L. Kung H.C. Deaths: Final Data for 2003 Natl. Vital Stat. Rep. 54 13 2006 Apr 19 1 20 16689256
  8. [11]Murphy S.L. Xu J. Kochanek K.D. Deaths: Final Data for 2010 Natl. Vital Stat. Rep. 61 4 2013 May 1 17 from the Centers for Disease Control and Prevention, National Center for Health Statistics, National Vital Statistics System 24979972
  9. [12]Angus D.C. Linde-Zwirble W.T. Lidicker J. Clermont G. Carcillo J. Pinsky M.R. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care Crit. Care Med. Baltim. 29 7 2001 Jul 1 1303 1310 11445675
  10. [13]Singer M. Deutschman C.S. Seymour C.W. The third international consensus definitions for sepsis and septic shock (Sepsis-3) JAMA 315 8 2016 Feb 23 801 810 26903338 PMC4968574
  11. [14]Vincent J.L. Opal S.M. Marshall J.C. Tracey K.J. Sepsis definitions: time for change Lancet Lond. Engl. 381 9868 2013 Mar 2 774 775 PMC4535310 23472921
  12. [15]Sprung C.L. Sakr Y. Vincent J.L. An evaluation of systemic inflammatory response syndrome signs in the Sepsis Occurrence in Acutely ill Patients (SOAP) study Intensive Care Med. 32 3 2006 Mar 1 421 427 16479382
  13. [16]Levy M.M. Fink M.P. Marshall J.C. 2001 sccm/esicm/accp/ats/sis international sepsis definitions conference Intensive Care Med. 29 4 2003 Apr 1 530 538 12664219
  14. [17]Dellinger R.P. Levy M.M. Rhodes A. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock Intensive Care Med. 39 2 2012 165 228 2013 Feb 1 23361625 PMC7095153
  15. [18]de Wit M. Goldberg S. Hussein E. Neifeld J.P. Health care-associated infections in surgical patients undergoing elective surgery: are alcohol use disorders a risk factor? J. Am. Coll. Surg. 215 2 2012 Aug 31 229 236 22727411
  16. [19]Moss M. Parsons P.E. Steinberg K.P. Chronic alcohol abuse is associated with an increased incidence of acute respiratory distress syndrome and severity of multiple organ dysfunction in patients with septic shock Crit. Care Med. 31 3 2003 Mar 1 869 877 12626999
  17. [20]O'Brien J.M. Jr. Lu B. Ali N.A. Alcohol dependence is independently associated with sepsis, septic shock, and hospital mortality among adult intensive care unit patients* Crit. Care Med. 35 2 2007 Feb 1 345 350 17205003
  18. [21]de Wit M. Wiaterek G.K. Gray N.D. Relationship between alcohol use disorders, cortisol concentrations, and cytokine levels in patients with sepsis Crit. Care 14 6 2010 Dec 22 R230 21176217 PMC3219986
  19. [22]Szabo G. Mandrekar P. A recent perspective on alcohol, immunity, and host defense Alcohol. Clin. Exp. Res. 33 2 2009 Feb 1 220 232 19053973 PMC3787826
  20. [23]Lau A. von Dossow V. Sander M. MacGuill M. Lanzke N. Spies C. Alcohol use disorder and perioperative immune dysfunction Anesth. Analg. 108 3 2009 Mar 1 916 920 19224804
  21. [24]Moss M. Epidemiology of sepsis: race, sex, and chronic alcohol abuse Clin. Infect. Dis. 41 Suppl. 7 2005 Nov 15 S490 S497 16237652
  22. [25]Beilin L.J. Alcohol and hypertension Clin. Exp. Pharmacol. Physiol. 22 3 1995 Mar 1 185 188 7554411
  23. [26]Okorie O.N. Dellinger P. Lactate: biomarker and potential therapeutic target Crit. Care Clin. 27 2 2011 Apr 30 299 326 21440203
  24. [27]Gustafson Mark L. The effect of ethanol on lactate and base deficit as predictors of morbidity and mortality in trauma Am. J. Emerg. Med. 33.5 2015 607 613 25770595 PMC4453763
  25. [28]Nguyen H.B. Rivers E.P. Knoblich B.P. Early lactate clearance is associated with improved outcome in severe sepsis and septic shock Crit. Care Med. 32 8 2004 Aug 1 1637 1642 15286537
  26. [29]Dezman Zachary DW. Alcohol consumption decreases lactate clearance in acutely injured patients Injury 2016 pii: S0020-1383(16)30034-1. doi: 10.1016/j.injury.2016.03.007. http://www.ncbi.nlm.nih.gov/pubmed/27025567 PMC5482221 27025567 · DOI
  27. [31]Goldberger A.L. Amaral L.A. Glass L. Hausdorff J.M. Ivanov P.C. Mark R.G. Mietus J.E. Moody G.B. Peng C.K. Stanley H.E. Physiobank, physiotoolkit, and physionet components of a new research resource for complex physiologic signals Circulation 101 23 2000 Jun 13 e215 e220 10851218
  28. [32]Subbe C.P. Kruger M. Rutherford P. Gemmel L. Validation of a modified early warning score in medical admissions Qjm 94 10 2001 Oct 1 521 526 11588210
  29. [33]Calvert J.S. Price D.A. Barton C.W. Chettipally U.K. Das R. Discharge recommendation based on a novel technique of homeostatic analysis J. Am. Med. Inform. Assoc. 2016 ocw014. https://jamia.oxfordjournals.org/content/early/2016/03/28/jamia.ocw014.full PMC7654071 27026611
  30. [34]Le Gall J.R. Lemeshow S. Saulnier F. A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study Jama 270 24 1993 Dec 22 2957 2963 8254858
  31. [36]Gentilello L.M. Villaveces A. Ries R.R. Detection of acute alcohol intoxication and chronic alcohol dependence by trauma center staff J. Trauma Acute Care Surg. 47 6 1999 Dec 1 1131 1135 10608546
  32. [37]Escobar F. Espi F. Canteras M. Diagnostic tests for alcoholism in primary health care: compared efficacy of different instruments Drug Alcohol Depend. 40 2 1995 Dec 31 151 158 8745137
  33. [38]Schneekloth T.D. Morse R.M. Herrick L.M. Suman V.J. Offord K.P. Davis L.J. Point prevalence of alcoholism in hospitalized patients: continuing challenges of detection, assessment, and diagnosis InMayo Clin. Proc. 76 5 2001 May 3 460 466 11357792
  34. [39]Ziring D.J. Adler A.G. Alcoholism. Are you missing the diagnosis? Postgrad. Med. 89 5 1991 Apr 139 141 2008393

Authors
Calvert, J., Desautels, T., Chettipally, U., Barton, C., Hoffman, J., Jay, M., Mao, Q., Mohamadlou, H., & Das, R.
Affiliations
  • Dascena (United States) (US)
  • University of California, San Francisco (US)
Corresponding author
Das, Ritankar
Venue
Annals of Medicine & Surgery
Published
2016-06
Volume
8
Pages
50-55
ISSN
2049-0801 (ISSN-L)
OpenAlex
W2346435289
Cited by
62
References
42
Citations by year
2025: 1 · 2024: 11 · 2023: 2 · 2022: 8 · 2021: 9 · 2020: 7 · 2019: 8 · 2018: 6 · 2017: 8 · 2016: 2
FWCI
7.50
Type
journal article
Language
en
Open access
Locations
  • Annals of Medicine and Surgery (publishedVersion, cc-by-nc-nd)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
Funders
National Science Foundation (1549867)
Topics
  • Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Medicine › Nephrology › Acute Kidney Injury Research
Keywords
septic shock, alcoholism, sepsis prediction, early warning scores, intensive care unit patients, MIMIC-III, diagnostic odds ratio, Modified Early Warning Score, Simplified Acute Physiology Score, systemic inflammatory response syndrome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review