High-performance detection and early prediction of septic shock for alcohol-use disorder patients
Open accessAbstract
BACKGROUND: The presence of Alcohol Use Disorder (AUD) complicates the medical conditions of patients and increases the difficulty of detecting and predicting the onset of septic shock for patients in the ICU. METHODS: We have developed a high-performance sepsis prediction algorithm, InSight, which outperforms existing methods for AUD patient populations. InSight analyses a combination of singlets, doublets, and triplets of clinical measurements over time to generate a septic shock risk score. AUD patients obtained from the MIMIC III database were used in this retrospective study to train InSight and compare performance with the Modified Early Warning Score (MEWS), the Simplified Acute Physiology Score (SAPS II), and the Systemic Inflammatory Response Syndrome (SIRS) for septic shock prediction and detection. RESULTS: From 4-fold cross validation, InSight performs particularly well on diagnostic odds ratio and demonstrates a relatively high Area Under the Receiver Operating Characteristic (AUROC) metric. Four hours prior to onset, InSight had an average AUROC of 0.815, and at the time of onset, InSight had an average AUROC value of 0.965. When applied to patient populations where AUD may complicate prediction methods of sepsis, InSight outperforms existing diagnostic tools. CONCLUSIONS: Analysis of the higher order correlations and trends between relevant clinical measurements using the InSight algorithm leads to more accurate detection and prediction of septic shock, even in cases where diagnosis may be confounded by AUD.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Calvert et al. was one of the first to study machine learning to identify sepsis in an ICU population, and Seymour et al. assessed the sepsis-3 criteria.
“Calvert et al. [33] was one of the first to study machine learning to identify sepsis in an ICU population and Seymour et al. [34] assessed the sepsis-3 criteria.”
From Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy (2020) · cites this paper as [33]
The Methods (Data set; InSight training) describe an algorithm tested on ICU records to detect and predict septic shock in patients with alcohol-use disorder. The cited paper does not establish that it was among the first machine-learning studies of sepsis, and its studied outcome and population are narrower than the claim suggests. The separately cited statement about Seymour et al. is not attributed to Calvert et al. (LLM, conf=0.86)
Experimental — accuracy not yet measuredNumerous models were tested on the freely accessible MIMIC database.
“numerous models were tested on the freely accessible MIMIC database [27, 33, 52–59]”
From Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy (2020) · cites this paper as [33]
The Methods (Data set and Abstract > Methods; page numbers unavailable) say the study used MIMIC III data to train InSight and compare it with MEWS, SAPS II, and SIRS. The copy does not establish that the database itself was freely accessible; it calls the SQL queries used for SAPS II open source, not the database. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 42 · Cited by 62
Research works printed but not linked: 34
- [2]de Wit M. Jones D.G. Sessler C.N. Zilberberg M.D. Weaver M.F. Alcohol-use disorders in the critically ill patient CHEST J. 138 4 2010 Oct 1 994 1003 PMC2951755 20923804
- [4]Baldwin W.A. Rosenfeld B.A. Breslow M.J. Buchman T.G. Deutschman C.S. Moore R.D. Substance abuse-related admissions to adult intensive care CHEST J. 103 1 1993 Jan 1 21 25 8417881
- [5]Lindenauer P.K. Normand S.L. Drye E.E. Lin Z. Goodrich K. Desai M.M. Bratzler D.W. O'Donnell W.J. Metersky M.L. Krumholz H.M. Development, validation, and results of a measure of 30-day readmission following hospitalization for pneumonia J. Hosp. Med. 6 3 2011 Mar 1 142 150 21387551
- [7]De Wit M. Best A.M. Gennings C. Burnham E.L. Moss M. Alcohol use disorders increase the risk for mechanical ventilation in medical patients Alcohol. Clin. Exp. Res. 31 7 2007 Jul 1 1224 1230 17511746
- [8]de Wit M. Zilberberg M.D. Boehmler J.M. Bearman G.M. Edmond M.B. Outcomes of patients with alcohol use disorders experiencing healthcare-associated infections Alcohol. Clin. Exp. Res. 35 7 2011 Jul 1 1368 1373 21676005
- [9]Mehta A.J. Alcoholism and critical illness: a review World J. Crit. Care Med. 5 1 2016 Feb 4 27 26855891 PMC4733453
- [10]Hoyert D.L. Heron M.P. Murphy S.L. Kung H.C. Deaths: Final Data for 2003 Natl. Vital Stat. Rep. 54 13 2006 Apr 19 1 20 16689256
- [11]Murphy S.L. Xu J. Kochanek K.D. Deaths: Final Data for 2010 Natl. Vital Stat. Rep. 61 4 2013 May 1 17 from the Centers for Disease Control and Prevention, National Center for Health Statistics, National Vital Statistics System 24979972
- [12]Angus D.C. Linde-Zwirble W.T. Lidicker J. Clermont G. Carcillo J. Pinsky M.R. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care Crit. Care Med. Baltim. 29 7 2001 Jul 1 1303 1310 11445675
- [13]Singer M. Deutschman C.S. Seymour C.W. The third international consensus definitions for sepsis and septic shock (Sepsis-3) JAMA 315 8 2016 Feb 23 801 810 26903338 PMC4968574
- [14]Vincent J.L. Opal S.M. Marshall J.C. Tracey K.J. Sepsis definitions: time for change Lancet Lond. Engl. 381 9868 2013 Mar 2 774 775 PMC4535310 23472921
- [15]Sprung C.L. Sakr Y. Vincent J.L. An evaluation of systemic inflammatory response syndrome signs in the Sepsis Occurrence in Acutely ill Patients (SOAP) study Intensive Care Med. 32 3 2006 Mar 1 421 427 16479382
- [16]Levy M.M. Fink M.P. Marshall J.C. 2001 sccm/esicm/accp/ats/sis international sepsis definitions conference Intensive Care Med. 29 4 2003 Apr 1 530 538 12664219
- [17]Dellinger R.P. Levy M.M. Rhodes A. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock Intensive Care Med. 39 2 2012 165 228 2013 Feb 1 23361625 PMC7095153
- [18]de Wit M. Goldberg S. Hussein E. Neifeld J.P. Health care-associated infections in surgical patients undergoing elective surgery: are alcohol use disorders a risk factor? J. Am. Coll. Surg. 215 2 2012 Aug 31 229 236 22727411
- [19]Moss M. Parsons P.E. Steinberg K.P. Chronic alcohol abuse is associated with an increased incidence of acute respiratory distress syndrome and severity of multiple organ dysfunction in patients with septic shock Crit. Care Med. 31 3 2003 Mar 1 869 877 12626999
- [20]O'Brien J.M. Jr. Lu B. Ali N.A. Alcohol dependence is independently associated with sepsis, septic shock, and hospital mortality among adult intensive care unit patients* Crit. Care Med. 35 2 2007 Feb 1 345 350 17205003
- [21]de Wit M. Wiaterek G.K. Gray N.D. Relationship between alcohol use disorders, cortisol concentrations, and cytokine levels in patients with sepsis Crit. Care 14 6 2010 Dec 22 R230 21176217 PMC3219986
- [22]Szabo G. Mandrekar P. A recent perspective on alcohol, immunity, and host defense Alcohol. Clin. Exp. Res. 33 2 2009 Feb 1 220 232 19053973 PMC3787826
- [23]Lau A. von Dossow V. Sander M. MacGuill M. Lanzke N. Spies C. Alcohol use disorder and perioperative immune dysfunction Anesth. Analg. 108 3 2009 Mar 1 916 920 19224804
- [24]Moss M. Epidemiology of sepsis: race, sex, and chronic alcohol abuse Clin. Infect. Dis. 41 Suppl. 7 2005 Nov 15 S490 S497 16237652
- [25]Beilin L.J. Alcohol and hypertension Clin. Exp. Pharmacol. Physiol. 22 3 1995 Mar 1 185 188 7554411
- [26]Okorie O.N. Dellinger P. Lactate: biomarker and potential therapeutic target Crit. Care Clin. 27 2 2011 Apr 30 299 326 21440203
- [27]Gustafson Mark L. The effect of ethanol on lactate and base deficit as predictors of morbidity and mortality in trauma Am. J. Emerg. Med. 33.5 2015 607 613 25770595 PMC4453763
- [28]Nguyen H.B. Rivers E.P. Knoblich B.P. Early lactate clearance is associated with improved outcome in severe sepsis and septic shock Crit. Care Med. 32 8 2004 Aug 1 1637 1642 15286537
- [29]Dezman Zachary DW. Alcohol consumption decreases lactate clearance in acutely injured patients Injury 2016 pii: S0020-1383(16)30034-1. doi: 10.1016/j.injury.2016.03.007. http://www.ncbi.nlm.nih.gov/pubmed/27025567 PMC5482221 27025567 · DOI
- [31]Goldberger A.L. Amaral L.A. Glass L. Hausdorff J.M. Ivanov P.C. Mark R.G. Mietus J.E. Moody G.B. Peng C.K. Stanley H.E. Physiobank, physiotoolkit, and physionet components of a new research resource for complex physiologic signals Circulation 101 23 2000 Jun 13 e215 e220 10851218
- [32]Subbe C.P. Kruger M. Rutherford P. Gemmel L. Validation of a modified early warning score in medical admissions Qjm 94 10 2001 Oct 1 521 526 11588210
- [33]Calvert J.S. Price D.A. Barton C.W. Chettipally U.K. Das R. Discharge recommendation based on a novel technique of homeostatic analysis J. Am. Med. Inform. Assoc. 2016 ocw014. https://jamia.oxfordjournals.org/content/early/2016/03/28/jamia.ocw014.full PMC7654071 27026611
- [34]Le Gall J.R. Lemeshow S. Saulnier F. A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study Jama 270 24 1993 Dec 22 2957 2963 8254858
- [36]Gentilello L.M. Villaveces A. Ries R.R. Detection of acute alcohol intoxication and chronic alcohol dependence by trauma center staff J. Trauma Acute Care Surg. 47 6 1999 Dec 1 1131 1135 10608546
- [37]Escobar F. Espi F. Canteras M. Diagnostic tests for alcoholism in primary health care: compared efficacy of different instruments Drug Alcohol Depend. 40 2 1995 Dec 31 151 158 8745137
- [38]Schneekloth T.D. Morse R.M. Herrick L.M. Suman V.J. Offord K.P. Davis L.J. Point prevalence of alcoholism in hospitalized patients: continuing challenges of detection, assessment, and diagnosis InMayo Clin. Proc. 76 5 2001 May 3 460 466 11357792
- [39]Ziring D.J. Adler A.G. Alcoholism. Are you missing the diagnosis? Postgrad. Med. 89 5 1991 Apr 139 141 2008393
- Authors
- Calvert, J., Desautels, T., Chettipally, U., Barton, C., Hoffman, J., Jay, M., Mao, Q., Mohamadlou, H., & Das, R.
- Affiliations
- Dascena (United States) (US)
- University of California, San Francisco (US)
- Corresponding author
- Das, Ritankar
- Venue
- Annals of Medicine & Surgery
- Published
- 2016-06
- Volume
- 8
- Pages
- 50-55
- ISSN
- 2049-0801 (ISSN-L)
- PMC
- PMC4960347
- OpenAlex
- W2346435289
- Cited by
- 62
- References
- 42
- Citations by year
- 2025: 1 · 2024: 11 · 2023: 2 · 2022: 8 · 2021: 9 · 2020: 7 · 2019: 8 · 2018: 6 · 2017: 8 · 2016: 2
- FWCI
- 7.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Annals of Medicine and Surgery (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (1549867)
- Topics
- Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Nephrology › Acute Kidney Injury Research
- Keywords
- septic shock, alcoholism, sepsis prediction, early warning scores, intensive care unit patients, MIMIC-III, diagnostic odds ratio, Modified Early Warning Score, Simplified Acute Physiology Score, systemic inflammatory response syndrome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review