The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Cardiovascular disease risk prediction using automated machine learning: A prospective study of 423,604 UK Biobank participants
Open accessAbstract
BACKGROUND: Identifying people at risk of cardiovascular diseases (CVD) is a cornerstone of preventative cardiology. Risk prediction models currently recommended by clinical guidelines are typically based on a limited number of predictors with sub-optimal performance across all patient groups. Data-driven techniques based on machine learning (ML) might improve the performance of risk predictions by agnostically discovering novel risk predictors and learning the complex interactions between them. We tested (1) whether ML techniques based on a state-of-the-art automated ML framework (AutoPrognosis) could improve CVD risk prediction compared to traditional approaches, and (2) whether considering non-traditional variables could increase the accuracy of CVD risk predictions. METHODS AND FINDINGS: Using data on 423,604 participants without CVD at baseline in UK Biobank, we developed a ML-based model for predicting CVD risk based on 473 available variables. Our ML-based model was derived using AutoPrognosis, an algorithmic tool that automatically selects and tunes ensembles of ML modeling pipelines (comprising data imputation, feature processing, classification and calibration algorithms). We compared our model with a well-established risk prediction algorithm based on conventional CVD risk factors (Framingham score), a Cox proportional hazards (PH) model based on familiar risk factors (i.e, age, gender, smoking status, systolic blood pressure, history of diabetes, reception of treatments for hypertension and body mass index), and a Cox PH model based on all of the 473 available variables. Predictive performances were assessed using area under the receiver operating characteristic curve (AUC-ROC). Overall, our AutoPrognosis model improved risk prediction (AUC-ROC: 0.774, 95% CI: 0.768-0.780) compared to Framingham score (AUC-ROC: 0.724, 95% CI: 0.720-0.728, p < 0.001), Cox PH model with conventional risk factors (AUC-ROC: 0.734, 95% CI: 0.729-0.739, p < 0.001), and Cox PH model with all UK Biobank variables (AUC-ROC: 0.758, 95% CI: 0.753-0.763, p < 0.001). Out of 4,801 CVD cases recorded within 5 years of baseline, AutoPrognosis was able to correctly predict 368 more cases compared to the Framingham score. Our AutoPrognosis model included predictors that are not usually considered in existing risk prediction models, such as the individuals' usual walking pace and their self-reported overall health rating. Furthermore, our model improved risk prediction in potentially relevant sub-populations, such as in individuals with history of diabetes. We also highlight the relative benefits accrued from including more information into a predictive model (information gain) as compared to the benefits of using more complex models (modeling gain). CONCLUSIONS: Our AutoPrognosis model improves the accuracy of CVD risk prediction in the UK Biobank population. This approach performs well in traditionally poorly served patient subgroups. Additionally, AutoPrognosis uncovered novel predictors for CVD disease that may now be tested in prospective studies. We found that the "information gain" achieved by considering more risk factors in the predictive model was significantly higher than the "modeling gain" achieved by adopting complex predictive models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728
European Guidelines on cardiovascular disease prevention in clinical practice (version 2012)
Authors/Task Force Members:, Perk, J., De Backer, G., Gohlke, H., Graham, I., Reiner, Ž., Verschuren, M., Albus, C., Benlian, P., Boysen, G., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs092 · Cited by 8,490
General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Rosuvastatin to Prevent Vascular Events in Men and Women with Elevated C-Reactive Protein
Ridker, P. M., Danielson, E., Fonseca, F. A. H., Genest, J., Gotto, A. M., Kastelein, J. J. P., Koenig, W., Libby, P., Lorenzatti, A. J., MacFadyen, J. G., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0807646 · Cited by 6,674
MissForest—Non-parametric missing value imputation for mixed-type data
Stekhoven, D. J., & Bühlmann, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr597 · Cited by 6,156
Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project
Conroy, R. (2003) · European Heart Journal · doi:10.1016/s0195-668x(03)00114-3 · Cited by 5,290
2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk
Goff, D. C., Lloyd-Jones, D. M., Bennett, G., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D., O’Donnell, C. J., et al. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.11.005 · Cited by 4,945
Lifestyle, diabetes, and cardiovascular risk factors 10 years after bariatric surgery
Sjöström, L., Lindroos, A.-K., Peltonen, M., Torgerson, J., Bouchard, C., Carlsson, B., Dahlgren, S., Larsson, B., Narbro, K., Sjöström, C. D., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa035622 · Cited by 4,457
Rosuvastatin to Prevent Vascular Events in Men and Women With Elevated C-Reactive Protein
Ridker, P. M., Danielson, E., Fonseca, F. A. H., Genest, J., Gotto, A. M., Kastelein, J. J. P., Koenig, W., Libby, P., Lorenzatti, A. J., MacFadyen, J. G., et al. (2009) · Obstetrical & Gynecological Survey · doi:10.1097/01.ogx.0000344393.60303.0a · Cited by 3,641
Conditional variable importance for random forests
Strobl, C., Boulesteix, A.-L., Kneib, T., Augustin, T., & Zeileis, A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-307 · Cited by 3,254
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995
Writing Committee Members, Greenland, P., Alpert, J. S., Beller, G. A., Benjamin, E. J., Budoff, M. J., Fayad, Z. A., Foster, E., Hlatky, M. A., Hodgson, J. M., et al. (2010) · Circulation · doi:10.1161/cir.0b013e3182051b4c · Cited by 1,873
Hippisley-Cox, J., Coupland, C., & Brindle, P. (2017) · BMJ · doi:10.1136/bmj.j2099 · Cited by 1,703
Assmann, G., Cullen, P., & Schulte, H. (2002) · Circulation · doi:10.1161/hc0302.102575 · Cited by 1,541
Hesse, B. W., Nelson, D. E., Kreps, G. L., Croyle, R. T., Arora, N. K., Rimer, B. K., & Viswanath, K. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.22.2618 · Cited by 1,523
Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2
Hippisley-Cox, J., Coupland, C., Vinogradova, Y., Robson, J., Minhas, R., Sheikh, A., & Brindle, P. (2008) · BMJ · doi:10.1136/bmj.39609.449676.25 · Cited by 1,459
Can machine-learning improve cardiovascular risk prediction using routine clinical data?
Weng, S. F., Reps, J., Kai, J., Garibaldi, J. M., & Qureshi, N. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174944 · Cited by 1,346
2010 ACCF/AHA Guideline for Assessment of Cardiovascular Risk in Asymptomatic Adults
Greenland, P., Alpert, J. S., Beller, G. A., Benjamin, E. J., Budoff, M. J., Fayad, Z. A., Foster, E., Hlatky, M. A., Hodgson, J. M., Kushner, F. G., et al. (2010) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2010.09.001 · Cited by 1,324
Rätsch, G., Onoda, T., & Müller, K.-R. (2001) · Machine Learning · doi:10.1023/a:1007618119488 · Cited by 1,299
C-reactive protein, fibrinogen, and cardiovascular disease prediction
The Emerging Risk Factors Collaboration (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1107477 · Cited by 1,150
Primary Prevention of Cardiovascular Diseases in People With Diabetes Mellitus
Buse, J. B., Ginsberg, H. N., Bakris, G. L., Clark, N. G., Costa, F., Eckel, R., Fonseca, V., Gerstein, H. C., Grundy, S., Nesto, R. W., et al. (2007) · Diabetes Care · doi:10.2337/dc07-9917 · Cited by 1,055
Type 2 diabetes and cardiovascular disease: Have all risk factors the same strength?
Martín-Timón, I. (2014) · World Journal of Diabetes · doi:10.4239/wjd.v5.i4.444 · Cited by 976
Goff, D. C., Lloyd‐Jones, D. M., Bennett, G. C., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D. A., O’Donnell, C. J., et al. (2014) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · Cited by 840
Cardiovascular Event Prediction by Machine Learning: The Multi-Ethnic Study of Atherosclerosis
Ambale-Venkatesh, B., Yang, X., Wu, C. O., Liu, K., Hundley, W. G., McClelland, R., Gomes, A. S., Folsom, A. R., Shea, S., Guallar, E., et al. (2017) · Circulation Research · doi:10.1161/circresaha.117.311312 · Cited by 639
Buse, J. B., Ginsberg, H. N., Bakris, G. L., Clark, N. G., Costa, F., Eckel, R., Fonseca, V., Gerstein, H. C., Grundy, S., Nesto, R. W., et al. (2007) · Circulation · doi:10.1161/circulationaha.106.179294 · Cited by 638
2016 European Guidelines on cardiovascular disease prevention in clinical practice
Piepoli, M. F., Hoes, A. W., Agewall, S., Albus, C., Brotons, C., Catapano, A. L., Cooney, M.-T., Corrà, U., Cosyns, B., Deaton, C., et al. (2016) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2016.05.037 · Cited by 486
Ganna, A., & Ingelsson, E. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60175-1 · Cited by 411
Palmer, L. J. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60924-6 · Cited by 373
Gaziano, T. A., Young, C. R., Fitzmaurice, G., Atwood, S., & Gaziano, J. M. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60418-3 · Cited by 366
Mendis, S., Lindholm, L. H., Mancia, G., Whitworth, J., Alderman, M., Lim, S., & Heagerty, T. (2007) · Journal of Hypertension · doi:10.1097/hjh.0b013e3282861fd3 · Cited by 332
Comparisons of established risk prediction models for cardiovascular disease: systematic review
Siontis, G. C. M., Tzoulaki, I., Siontis, K. C., & Ioannidis, J. P. A. (2012) · BMJ · doi:10.1136/bmj.e3318 · Cited by 300
Ahmad, T., Lund, L. H., Rao, P., Ghosh, R., Warier, P., Vaccaro, B., Dahlström, U., O'Connor, C. M., Felker, G. M., & Desai, N. R. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.117.008081 · Cited by 248
Willeit, P., Kaptoge, S., Welsh, P., Butterworth, A. S., Chowdhury, R., Spackman, S. A., Pennells, L., Gao, P., Burgess, S., Freitag, D. F., et al. (2016) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(16)30196-6 · Cited by 223
Self-citationKremers, H. M., Crowson, C. S., Therneau, T. M., Roger, V. L., & Gabriel, S. E. (2008) · Arthritis & Rheumatism · doi:10.1002/art.23650 · Cited by 221
Coleman, R. L., Stevens, R. J., Retnakaran, R., & Holman, R. R. (2007) · Diabetes Care · doi:10.2337/dc06-1358 · Cited by 193
Eeg‐Olofsson, K., Cederholm, J., Nilsson, P. M., Zethelius, B., Svensson, A. ‐., Gudbjörnsdóttir, S., & Eliasson, B. (2010) · Journal of Internal Medicine · doi:10.1111/j.1365-2796.2010.02265.x · Cited by 178
Novel Risk Markers and Risk Assessments for Cardiovascular Disease
Thomas, M. R., & Lip, G. Y. H. (2017) · Circulation Research · doi:10.1161/circresaha.116.309955 · Cited by 161
Allison, M., Hiatt, W. R., Hirsch, A. T., Coll, J. R., & Criqui, M. H. (2008) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2007.11.064 · Cited by 150
Evaluating the performance of the Framingham risk equations in a population with diabetes
McEwan, P. C., Williams, J. E., Griffiths, J. D., Bagust, A., Peters, J. R., Hopkinson, P. K., & Currie, C. J. (2004) · Diabetic Medicine · doi:10.1111/j.1464-5491.2004.01139.x · Cited by 91
Alaa, A. M., & van der Schaar, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.07207 · Cited by 76
Self-citationChallenges of linking to routine healthcare records in UK Biobank
Adamska, L., Allen, N. E., Flaig, R., et al. (2015) · Trials · doi:10.1186/1745-6215-16-s2-o68 · Cited by 20
Cited by
Automated machine learning: Review of the state-of-the-art and opportunities for healthcare
Waring, J., Lindvall, C., & Umeton, R. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101822 · Cited by 834
Opening the black box: the promise and limitations of explainable machine learning in cardiology
Petch, J., Di, S., & Nelson, W. (2022) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2021.09.004 · Cited by 552
RETRACTED ARTICLE: Artificial intelligence and machine learning in precision and genomic medicine
Quazi, S. (2022) · Medical Oncology · doi:10.1007/s12032-022-01711-1 · Cited by 432
RetractedStudy of cardiovascular disease prediction model based on random forest in eastern China
Yang, L., Wu, H., Jin, X., Zheng, P., Hu, S., Xu, X., Yu, W., & Yan, J. (2020) · Scientific Reports · doi:10.1038/s41598-020-62133-5 · Cited by 353
Causal machine learning for predicting treatment outcomes
Feuerriegel, S., Frauen, D., Melnychuk, V., Schweisthal, J., Hess, K., Curth, A., Bauer, S., Kilbertus, N., Kohane, I. S., & van der Schaar, M. (2024) · Nature Medicine · doi:10.1038/s41591-024-02902-1 · Cited by 343
Self-citation
Metadata
- Authors
- Alaa, A. M., Bolton, T., Di Angelantonio, E., Rudd, J. H. F., & van der Schaar, M.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-05-15
- Volume
- 14
- Issue
- 5
- Pages
- e0213653
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2945583287
- Cited by
- 604
- References
- 49
- FWCI
- 64.81
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.