The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Cardiovascular disease risk prediction using automated machine learning: A prospective study of 423,604 UK Biobank participants
Open accessAbstract
BACKGROUND: Identifying people at risk of cardiovascular diseases (CVD) is a cornerstone of preventative cardiology. Risk prediction models currently recommended by clinical guidelines are typically based on a limited number of predictors with sub-optimal performance across all patient groups. Data-driven techniques based on machine learning (ML) might improve the performance of risk predictions by agnostically discovering novel risk predictors and learning the complex interactions between them. We tested (1) whether ML techniques based on a state-of-the-art automated ML framework (AutoPrognosis) could improve CVD risk prediction compared to traditional approaches, and (2) whether considering non-traditional variables could increase the accuracy of CVD risk predictions. METHODS AND FINDINGS: Using data on 423,604 participants without CVD at baseline in UK Biobank, we developed a ML-based model for predicting CVD risk based on 473 available variables. Our ML-based model was derived using AutoPrognosis, an algorithmic tool that automatically selects and tunes ensembles of ML modeling pipelines (comprising data imputation, feature processing, classification and calibration algorithms). We compared our model with a well-established risk prediction algorithm based on conventional CVD risk factors (Framingham score), a Cox proportional hazards (PH) model based on familiar risk factors (i.e, age, gender, smoking status, systolic blood pressure, history of diabetes, reception of treatments for hypertension and body mass index), and a Cox PH model based on all of the 473 available variables. Predictive performances were assessed using area under the receiver operating characteristic curve (AUC-ROC). Overall, our AutoPrognosis model improved risk prediction (AUC-ROC: 0.774, 95% CI: 0.768-0.780) compared to Framingham score (AUC-ROC: 0.724, 95% CI: 0.720-0.728, p < 0.001), Cox PH model with conventional risk factors (AUC-ROC: 0.734, 95% CI: 0.729-0.739, p < 0.001), and Cox PH model with all UK Biobank variables (AUC-ROC: 0.758, 95% CI: 0.753-0.763, p < 0.001). Out of 4,801 CVD cases recorded within 5 years of baseline, AutoPrognosis was able to correctly predict 368 more cases compared to the Framingham score. Our AutoPrognosis model included predictors that are not usually considered in existing risk prediction models, such as the individuals' usual walking pace and their self-reported overall health rating. Furthermore, our model improved risk prediction in potentially relevant sub-populations, such as in individuals with history of diabetes. We also highlight the relative benefits accrued from including more information into a predictive model (information gain) as compared to the benefits of using more complex models (modeling gain). CONCLUSIONS: Our AutoPrognosis model improves the accuracy of CVD risk prediction in the UK Biobank population. This approach performs well in traditionally poorly served patient subgroups. Additionally, AutoPrognosis uncovered novel predictors for CVD disease that may now be tested in prospective studies. We found that the "information gain" achieved by considering more risk factors in the predictive model was significantly higher than the "modeling gain" achieved by adopting complex predictive models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728
European Guidelines on cardiovascular disease prevention in clinical practice (version 2012)
Authors/Task Force Members:, Perk, J., De Backer, G., Gohlke, H., Graham, I., Reiner, Ž., Verschuren, M., Albus, C., Benlian, P., Boysen, G., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs092 · Cited by 8,490
General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243
Cited by
Automated machine learning: Review of the state-of-the-art and opportunities for healthcare
Waring, J., Lindvall, C., & Umeton, R. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101822 · Cited by 834
Opening the black box: the promise and limitations of explainable machine learning in cardiology
Petch, J., Di, S., & Nelson, W. (2022) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2021.09.004 · Cited by 552
RETRACTED ARTICLE: Artificial intelligence and machine learning in precision and genomic medicine
Quazi, S. (2022) · Medical Oncology · doi:10.1007/s12032-022-01711-1 · Cited by 432
RetractedStudy of cardiovascular disease prediction model based on random forest in eastern China
Yang, L., Wu, H., Jin, X., Zheng, P., Hu, S., Xu, X., Yu, W., & Yan, J. (2020) · Scientific Reports · doi:10.1038/s41598-020-62133-5 · Cited by 353
Causal machine learning for predicting treatment outcomes
Feuerriegel, S., Frauen, D., Melnychuk, V., Schweisthal, J., Hess, K., Curth, A., Bauer, S., Kilbertus, N., Kohane, I. S., & van der Schaar, M. (2024) · Nature Medicine · doi:10.1038/s41591-024-02902-1 · Cited by 343
Self-citationLiu, T., Krentz, A., Lu, L., & Curcin, V. (2025) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztae080 · Cited by 177
Brnabic, A., & Hess, L. M. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01403-2 · Cited by 123
Cai, Y., Cai, Y.-Q., Tang, L.-Y., Wang, Y.-H., Gong, M., Jing, T.-C., Li, H.-J., Li-Ling, J., Hu, W., Yin, Z., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03273-7 · Cited by 122
Ravaut, M., Sadeghi, H., Leung, K. K., Volkovs, M., Kornas, K., Harish, V., Watson, T., Lewis, G. F., Weisman, A., Poutanen, T., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00394-8 · Cited by 121
Mohd Faizal, A. S., Thevarajah, T. M., Khor, S. M., & Chang, S.-W. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106190 · Cited by 113
Abdalrada, A. S., Abawajy, J., Al-Quraishi, T., & Islam, S. M. S. (2022) · Journal of Diabetes & Metabolic Disorders · doi:10.1007/s40200-021-00968-z · Cited by 78
Suri, J. S., Bhagawati, M., Paul, S., Protogerou, A. D., Sfikakis, P. P., Kitas, G. D., Khanna, N. N., Ruzsa, Z., Sharma, A. M., Saxena, S., et al. (2022) · Diagnostics · doi:10.3390/diagnostics12030722 · Cited by 55
Machine learning to guide the use of adjuvant therapies for breast cancer
Alaa, A. M., Gurdasani, D., Harris, A. L., Rashbass, J., & van der Schaar, M. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00353-8 · Cited by 55
Self-citationMuse, E. D., & Topol, E. J. (2024) · Cell Metabolism · doi:10.1016/j.cmet.2024.02.002 · Cited by 50
Artificial intelligence for dementia prevention
Newby, D., Orgeta, V., Marshall, C. R., Lourida, I., Albertyn, C. P., Tamburin, S., Raymont, V., Veldsman, M., Koychev, I., Bauermeister, S., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.13463 · Cited by 42
Sharma, D., Gotlieb, N., Farkouh, M. E., Patel, K., Xu, W., & Bhat, M. (2022) · Journal of the American Heart Association · doi:10.1161/jaha.121.022576 · Cited by 36
Lee, J., Choi, Y., Ko, T., Lee, K., Shin, J., & Kim, H.-S. (2024) · Endocrinology and Metabolism · doi:10.3803/enm.2023.1739 · Cited by 9
Cundrič, L., Bosnić, Z., Kaminsky, L. A., Myers, J., Peterman, J. E., Markovic, V., Arena, R., & Popović, D. (2023) · Journal of Cardiopulmonary Rehabilitation and Prevention · doi:10.1097/hcr.0000000000000786 · Cited by 4
Kasim, S., Amir Rudin, P. N. F., Malek, S., Ibrahim, N., Kiew, X. N., Nasir, N. M., Ibrahim, K. S., & Raja Shariff, R. E. (2025) · PLOS One · doi:10.1371/journal.pone.0323949 · Cited by 3
Decision Support System for Early Diagnosis of Heart Diseases
Ahmed, R. W. (2023) · VFAST Transactions on Software Engineering · doi:10.21015/vtse.v11i2.1470 · Cited by 1
Metadata
- Authors
- Alaa, A. M., Bolton, T., Di Angelantonio, E., Rudd, J. H. F., & van der Schaar, M.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-05-15
- Volume
- 14
- Issue
- 5
- Pages
- e0213653
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2945583287
- Cited by
- 604
- References
- 49
- FWCI
- 64.81
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.