Interpretable prediction of 3-year all-cause mortality in patients with heart failure caused by coronary heart disease based on machine learning and SHAP
Open accessAbstract
BACKGROUND: This study sought to evaluate the performance of machine learning (ML) models and establish an explainable ML model with good prediction of 3-year all-cause mortality in patients with heart failure (HF) caused by coronary heart disease (CHD). METHODS: We established six ML models using follow-up data to predict 3-year all-cause mortality. Through comprehensive evaluation, the best performing model was used to predict and stratify patients. The log-rank test was used to assess the difference between Kaplan-Meier curves. The association between ML risk and 3-year all-cause mortality was also assessed using multivariable Cox regression. Finally, an explainable approach based on ML and the SHapley Additive exPlanations (SHAP) method was deployed to calculate 3-year all-cause mortality risk and to generate individual explanations of the model's decisions. RESULTS: The best performing extreme gradient boosting (XGBoost) model was selected to predict and stratify patients. Subjects with a higher ML score had a high hazard of suffering events (hazard ratio [HR]: 10.351; P < 0.001), and this relationship persisted with a multivariable analysis (adjusted HR: 5.343; P < 0.001). Age, N-terminal pro-B-type natriuretic peptide, occupation, New York Heart Association classification, and nitrate drug use were important factors for both genders. CONCLUSIONS: The ML-based risk stratification tool was able to accurately assess and stratify the risk of 3-year all-cause mortality in patients with HF caused by CHD. ML combined with SHAP could provide an explicit explanation of individualized risk prediction and give physicians an intuitive understanding of the influence of key features in the model.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
SHAP values provide a consistent and locally accurate assessment of the contribution of each feature to the model's predictions.
“SHAP values provide a consistent and locally accurate assessment of the contribution of each feature to the model’s predictions, enabling a more transparent understanding of the relationships between input variables and outcomes [37, 38].”
From Machine learning-driven prediction model for successful weaning of patients from mechanical ventilation in ICU (2026) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · see citing works
2013 ACCF/AHA Guideline for the Management of Heart Failure
Yancy, C. W., Jessup, M., Bozkurt, B., Butler, J., Casey, D. E., Drazner, M. H., Fonarow, G. C., Geraci, S. A., Horwich, T., Januzzi, J. L., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.05.019 · Cited by 12,536 · see citing works
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551 · see citing works
MissForest—Non-parametric missing value imputation for mixed-type data
Stekhoven, D. J., & Bühlmann, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr597 · Cited by 6,156 · see citing works
2019 ACC/AHA Guideline on the Primary Prevention of Cardiovascular Disease: Executive Summary
Arnett, D. K., Blumenthal, R. S., Albert, M. A., Buroker, A. B., Goldberger, Z. D., Hahn, E. J., Himmelfarb, C. D., Khera, A., Lloyd-Jones, D., McEvoy, J. W., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.03.009 · Cited by 1,193 · see citing works
Analysis of machine learning techniques for heart failure readmissions
Mortazavi, B. J., Downing, N. S., Bucholz, E. M., Dharmarajan, K., Manhapra, A., Li, S.-X., Negahban, S. N., & Krumholz, H. M. (2016) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.116.003039 · Cited by 401 · see citing works
Zihni, E., Madai, V. I., Livne, M., Galinovic, I., Khalil, A. A., Fiebach, J. B., & Frey, D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231166 · Cited by 187 · see citing works
Delahanty, R. J., Kaufman, D., & Jones, S. S. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003011 · Cited by 105 · see citing works
Flagged first, then by citations
Research works printed but not linked: 7
- A. Alba, T. Agoritsas, M. Jankowski, et al., Risk prediction models for mortality in ambulatory patients with heart failure: a systematic review, Circulation Heart Failure 6 (5) (2013) 881-889.
- M. Athanasiou, K. Sfrintzeri, K. Zarkogianni, et al., An Explainable XGBoost-Based Approach towards Assessing the Risk of Cardiovascular Disease in Patients with Type 2 Diabetes Mellitus[C]//2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE), IEEE, 2020.
- A. Singh, N. Thakur, A. Sharma, A review of supervised machine learning algorithms, in: 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), 2016, 1310-5. IEEE; 2016.
- T. Chen, C. Guestrin, XGBoost: a scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, 2016, pp. 785-794.
- G.E.A.P.A. Batista, R.C. Prati, M.C. Monard, A study of the behavior of several methods for balancing ML training data, ACM SIGKDD Explorations Newsletter 6 (1) (2004) 20.
- A. Azeez, Adeola Ogunleye, et al., XGBoost model for chronic kidney disease diagnosis, IEEE ACM Trans. Comput. Biol. Bioinf 17 (6) (2020) 2131-2140.
- M. Li, X. Fu, D. Li, Diabetes prediction based on XGBoost algorithm, IOP Conf. Ser. Mater. Sci. Eng. 768 (7) (2020), 072093 (7pp).
Cited by
Sorted by citations
Unveiling Explainable <scp>AI</scp> in Healthcare: Current Trends, Challenges, and Future Directions
Noor, A. A., Manzoor, A., Mazhar Qureshi, M. D., Qureshi, M. A., & Rashwan, W. (2025) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.70018 · Cited by 52 · see citing works
Alkhodari, M., Xiong, Z., Khandoker, A. H., Hadjileontiadis, L. J., Leeson, P., & Lapidaire, W. (2023) · Expert Review of Cardiovascular Therapy · doi:10.1080/14779072.2023.2223978 · Cited by 23 · see citing works
Qiu, C., Tang, L., Zhuang, Y., Chi, C., Zheng, K., & Zhu, X. (2026) · Intensive Care Medicine Experimental · doi:10.1186/s40635-026-00859-8 · Cited by 1 · see citing works
“SHAP values provide a consistent and locally accurate assessment of the contribution of each feature to the model’s predictions, enabling a more transparent understanding of the relationships between input variables and outcomes [37, 38].”
- Authors
- Wang, K., Tian, J., Zheng, C., Yang, H., Ren, J., Liu, Y., Han, Q., & Zhang, Y.
- Affiliations
- Shanxi Medical University (CN)
- Corresponding author
- Han, Qinghua
- Zhang, Yanbo
- Venue
- Computers in Biology and Medicine
- Publisher
- Elsevier BV
- Published
- 2021-10
- Volume
- 137
- Pages
- 104813
- ISSN
- 0010-4825 (ISSN-L)
- OpenAlex
- W3196831580
- Cited by
- 361
- References
- 8
- Citations by year
- 2026: 74 · 2025: 124 · 2024: 85 · 2023: 53 · 2022: 23 · 2021: 1 · 2012: 1
- FWCI
- 35.30
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Computers in Biology and Medicine (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (81872714, 82173631)
- Topics
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Failure Treatment and Management
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- heart failure, coronary artery disease, all-cause mortality, mortality prediction, risk stratification, SHAP, explainable machine learning, XGBoost, N-terminal pro-brain natriuretic peptide, New York Heart Association classification, personalized risk prediction
- MeSH terms
- Machine Learning, Coronary Disease, Female, Heart Failure, Humans, Male
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review