Prediction model of in-hospital mortality in intensive care unit patients with heart failure: machine learning-based, retrospective analysis of the MIMIC-III database
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Objective: The predictors of in-hospital mortality for intensive care units (ICUs)-admitted heart failure (HF) patients remain poorly characterised. We aimed to develop and validate a prediction model for all-cause in-hospital mortality among ICU-admitted HF patients. Design: A retrospective cohort study. Setting and participants: Data were extracted from the Medical Information Mart for Intensive Care (MIMIC-III) database. Data on 1177 heart failure patients were analysed. Methods: Patients meeting the inclusion criteria were identified from the MIMIC-III database and randomly divided into derivation (n=825, 70%) and a validation (n=352, 30%) group. Independent risk factors for in-hospital mortality were screened using the extreme gradient boosting (XGBoost) and the least absolute shrinkage and selection operator (LASSO) regression models in the derivation sample. Multivariate logistic regression analysis was used to build prediction models in derivation group, and then validated in validation cohort. Discrimination, calibration and clinical usefulness of the predicting model were assessed using the C-index, calibration plot and decision curve analysis. After pairwise comparison, the best performing model was chosen to build a nomogram according to the regression coefficients. Results: Among the 1177 admissions, in-hospital mortality was 13.52%. In both groups, the XGBoost, LASSO regression and Get With the Guidelines-Heart Failure (GWTG-HF) risk score models showed acceptable discrimination. The XGBoost and LASSO regression models also showed good calibration. In pairwise comparison, the prediction effectiveness was higher with the XGBoost and LASSO regression models than with the GWTG-HF risk score model (p<0.05). The XGBoost model was chosen as our final model for its more concise and wider net benefit threshold probability range and was presented as the nomogram. Conclusions: Our nomogram enabled good prediction of in-hospital mortality in ICU-admitted HF patients, which may help clinical decision-making for such patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
McDonagh, T. A., Metra, M., Adamo, M., Gardner, R. S., Baumbach, A., Böhm, M., Burri, H., Butler, J., Čelutkienė, J., Chioncel, O., et al. (2021) · European Heart Journal · doi:10.1093/eurheartj/ehab670 · Cited by 19,442
2016 ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure
Ponikowski, P., Voors, A. A., Anker, S. D., Bueno, H., Cleland, J. G. F., Coats, A. J. S., Falk, V., González-Juanatey, J. R., Harjola, V.-P., Jankowska, E. A., et al. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw128 · Cited by 11,429
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Decision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341
Adams, K. F., Fonarow, G. C., Emerman, C. L., LeJemtel, T. H., Costanzo, M. R., Abraham, W. T., Berkowitz, R. L., Galvao, M., & Horton, D. P. (2005) · American Heart Journal · doi:10.1016/j.ahj.2004.08.005 · Cited by 2,116
Fonarow, G. C. (2005) · JAMA · doi:10.1001/jama.293.5.572 · Cited by 1,611
Predicting survival in heart failure: a risk score based on 39 372 patients from 30 studies
Pocock, S. J., Ariti, C. A., McMurray, J. J. V., Maggioni, A., Køber, L., Squire, I. B., Swedberg, K., Dobson, J., Poppe, K. K., Whalley, G. A., et al. (2013) · European Heart Journal · doi:10.1093/eurheartj/ehs337 · Cited by 1,331 · cited 1×
“Involving a small number of routinely collected variables, this tool can be easily used at the bedside.”
MethodSauerbrei, W., Royston, P., & Binder, H. (2007) · Statistics in Medicine · doi:10.1002/sim.3148 · Cited by 1,171 · cited 1×
“Second, we used the least absolute shrinkage and selection operator (LASSO) method, 19 which involves regression analysis to perform both variable selection and regularisation.”
MethodPlagnol, V., Curtis, J., Epstein, M., Mok, K. Y., Stebbings, E., Grigoriadou, S., Wood, N. W., Hambleton, S., Burns, S. O., Thrasher, A. J., et al. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts526 · Cited by 743 · cited 1×
“First, we used extreme gradient boosting (XGBoost), 17 a supervised machine-learning and data-mining tool, which involves a meta-algorithm, to construct a strong ensemble learner from weak learners, such as regression trees.”
Method
Cited by
Weiner, E. B., Dankwa-Mullan, I., Nelson, W. A., & Hassanpour, S. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000810 · Cited by 218
Peng, S., Huang, J., Liu, X., Deng, J., Sun, C., Tang, J., Chen, H., Cao, W., Wang, W., Duan, X., et al. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.994359 · Cited by 88
Pang, K., Li, L., Ouyang, W., Liu, X., & Tang, Y. (2022) · Diagnostics · doi:10.3390/diagnostics12051068 · Cited by 84
“A study used admission and laboratory variables to construct an XGBoost model to predict in-hospital mortality among patients with heart failure and achieved a high AUC of 0.84 [16].”
MethodInfluentialKarpov, O. E., Николаевна, П. Е., Kurkin, S., Александрович, М. В., Gusev, A. V., Shusharina, N. N., & Hramov, A. E. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20075335 · Cited by 72
Machine learning based readmission and mortality prediction in heart failure patients
Sabouri, M., Bitarafan‐Rajabi, A., Hajianfar, G., Gharibi, O., Mohebi, M., Avval, A. H., Naderi, N., & Shiri, I. (2023) · Scientific Reports · doi:10.1038/s41598-023-45925-3 · Cited by 51
“In other studies by Li et al. 23 and Kwon et al. 43 , renal functionality is assessed by measuring either means of creatinine or chronic renal insufficiency.”
BackgroundInfluential
Metadata
- Authors
- Li, F., Xin, H., Zhang, J., Fu, M., Zhou, J., & Lian, Z.
- Affiliations
- Fudan University (CN)
- Affiliated Hospital of Qingdao University (CN)
- Corresponding author
- Zhou, Jingmin
- Lian, Zhexun
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2021-07
- Volume
- 11
- Issue
- 7
- Pages
- e044779
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC8311359
- OpenAlex
- W3184022450
- Cited by
- 128
- References
- 41
- Citations by year
- 2026: 9 · 2025: 36 · 2024: 46 · 2023: 25 · 2022: 11 · 2021: 1
- FWCI
- 13.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Basic Research Program of China (973 350 Program, 2012CB518605)
- National Natural Science Foundation of China (81370199)
- the Program for the Outstanding Academic Leaders supported by Shanghai Science and Technology Commission (16XD1400700)
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Failure Treatment and Management
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Keywords
- heart failure, in-hospital mortality, mortality prediction model, intensive care unit patients, nomogram, XGBoost, LASSO, risk factors, MIMIC-III
- MeSH terms
- Machine Learning, Critical Care, Heart Failure, Humans, Intensive Care Units, Retrospective Studies, Hospital Mortality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Prediction model of in-hospital mortality in intensive care unit patients with heart failure: machine learning-based, retrospective analysis of the MIMIC-III database. https://app.cochat.ai/papers/10.1136/bmjopen-2020-044779
- The paper
- Li, F., Xin, H., Zhang, J., Fu, M., Zhou, J., & Lian, Z. (2021). Prediction model of in-hospital mortality in intensive care unit patients with heart failure: machine learning-based, retrospective analysis of the MIMIC-III database. BMJ Open. https://doi.org/10.1136/bmjopen-2020-044779
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.