CoChat

Development and evaluation of an automated machine learning algorithm for in-hospital mortality risk adjustment among critical care patients.

Delahanty, Ryan J., Kaufman, David, Jones, Spencer S. · 2018 · Critical Care Medicine

The DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.

Abstract

Objectives Risk adjustment algorithms for ICU mortality are necessary for measuring and improving ICU performance. Existing risk adjustment algorithms are not widely adopted. Key barriers to adoption include licensing and implementation costs as well as labor costs associated with human-intensive data collection. Widespread adoption of electronic health records makes automated risk adjustment feasible. Using modern machine learning methods and open source tools, we developed and evaluated a retrospective risk adjustment algorithm for in-hospital mortality among ICU patients. The Risk of Inpatient Death score can be fully automated and is reliant upon data elements that are generated in the course of usual hospital processes. Setting One hundred thirty-one ICUs in 53 hospitals operated by Tenet Healthcare. Patients A cohort of 237,173 ICU patients discharged between January 2014 and December 2016. Design The data were randomly split into training (36 hospitals), and validation (17 hospitals) data sets. Feature selection and model training were carried out using the training set while the discrimination, calibration, and accuracy of the model were assessed in the validation data set. Measurements and main results Model discrimination was evaluated based on the area under receiver operating characteristic curve; accuracy and calibration were assessed via adjusted Brier scores and visual analysis of calibration curves. Seventeen features, including a mix of clinical and administr…

Overview

Integrity signals

Registry

Crossref · 10.1097/ccm.0000000000003011

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 28 references

Research works printed but not linked: 1

  1. Lewis-kraus, 2016, The Great A.I. Awakening., N Y Times

Cited by

See all 107

Metadata

Authors
Delahanty, R. J., Kaufman, D., & Jones, S. S.
Affiliations
  • Tenet Healthcare (US)
  • The Intensivist Group/Sound Physicians, Tacoma, WA.
Venue
Critical Care Medicine
Published
2018-06
Volume
46
Issue
6
Pages
e481-e488
ISSN
0090-3493 (ISSN-L)
OpenAlex
W2793981925
Cited by
105
References
29
Citations by year
2026: 5 · 2025: 10 · 2024: 17 · 2023: 18 · 2022: 12 · 2021: 13 · 2020: 11 · 2019: 14 · 2018: 5
FWCI
6.06
Type
journal article
Language
en
Open access
closed
Locations
  • Critical Care Medicine (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
risk adjustment, in-hospital mortality, intensive care unit, electronic health records, clinical prediction model, discrimination and calibration, Tenet Healthcare
MeSH terms
Unsupervised Machine Learning, Algorithms, Female, Humans, Intensive Care Units, Male, Middle Aged, Models, Statistical, Hospital Mortality, Risk Adjustment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Development and evaluation of an automated machine learning algorithm for in-hospital mortality risk adjustment among critical care patients. https://app.cochat.ai/papers/10.1097/ccm.0000000000003011
The paper
Delahanty, R. J., Kaufman, D., & Jones, S. S. (2018). Development and evaluation of an automated machine learning algorithm for in-hospital mortality risk adjustment among critical care patients. Critical Care Medicine. https://doi.org/10.1097/ccm.0000000000003011

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.