Cited by 639Artificial Intelligence in HealthcareCardiac Imaging and DiagnosticsCardiovascular Health and Risk Factors

Cardiovascular Event Prediction by Machine Learning: The Multi-Ethnic Study of Atherosclerosis

Open access
Ambale-Venkatesh, Bharath, Yang, Xiaoying, Wu, Colin O., Liu, Kiang, Hundley, W. Gregory, McClelland, Robyn, Gomes, Antoinette S., Folsom, Aaron R. +4 more·2017·Circulation Research

Abstract

Rationale: Machine learning may be useful to characterize cardiovascular risk, predict outcomes, and identify biomarkers in population studies. Objective: To test the ability of random survival forests, a machine learning technique, to predict 6 cardiovascular outcomes in comparison to standard cardiovascular risk scores. Methods and Results: We included participants from the MESA (Multi-Ethnic Study of Atherosclerosis). Baseline measurements were used to predict cardiovascular outcomes over 12 years of follow-up. MESA was designed to study progression of subclinical disease to cardiovascular events where participants were initially free of cardiovascular disease. All 6814 participants from MESA, aged 45 to 84 years, from 4 ethnicities, and 6 centers across the United States were included. Seven-hundred thirty-five variables from imaging and noninvasive tests, questionnaires, and biomarker panels were obtained. We used the random survival forests technique to identify the top-20 predictors of each outcome. Imaging, electrocardiography, and serum biomarkers featured heavily on the top-20 lists as opposed to traditional cardiovascular risk factors. Age was the most important predictor for all-cause mortality. Fasting glucose levels and carotid ultrasonography measures were important predictors of stroke. Coronary Artery Calcium score was the most important predictor of coronary heart disease and all atherosclerotic cardiovascular disease combined outcomes. Left ventricular structure and function and cardiac troponin-T were among the top predictors for incident heart failure. Creatinine, age, and ankle-brachial index were among the top predictors of atrial fibrillation. TNF-α (tissue necrosis factor-α) and IL (interleukin)-2 soluble receptors and NT-proBNP (N-Terminal Pro-B-Type Natriuretic Peptide) levels were important across all outcomes. The random survival forests technique performed better than established risk scores with increased prediction accuracy (decreased Brier score by 10%–25%). Conclusions: Machine learning in conjunction with deep phenotyping improves prediction accuracy in cardiovascular event prediction in an initially asymptomatic population. These methods may lead to greater insights on subclinical disease markers without apriori assumptions of causality. Clinical Trial Registration: URL: http://www.clinicaltrials.gov . Unique identifier: NCT00005487.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1161/circresaha.117.311312

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • AI-CAC could support evolution toward a more informative, physiologically grounded CAC score, preserving clinical familiarity and, combined with radiomics features or additional image-derived markers such as epicardial adipose tissue, cardiac chamber volumetry, as well as complementary biomarkers such as thoracic aortic calcification and body composition markers if these are shown to be predictive

    “AI-CAC could support evolution toward a more informative, physiologically grounded CAC score, preserving clinical familiarity and, combined with radiomics features or additional image-derived markers such as epicardial adipose tissue, cardiac chamber volumetry, as well as complementary biomarkers such as thoracic aortic calcification and body composition markers if these are shown to be predictive”

    From Prognostication and clinical opportunities with AI for coronary artery calcium: a scoping review (2026) · cites this paper as [57]

    Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 24

  1. [1]Lloyd-Jones DM Cardiovascular Risk Prediction: Basic Concepts, Current Status, and Future Directions Circulation 2010 121 1768 1777 20404268
  2. [2]Wong ND Epidemiological studies of CHD and the evolution of preventive cardiology Nat Rev Cardiol 2014 11 276 289 24663092
  3. [3]Gorodeski EZ Ishwaran H Kogalur UB Blackstone EH Hsich E Zhang Z-m Vitolins MZ Manson JE Curb JD Martin LW Use of Hundreds of Electrocardiographic Biomarkers for Prediction of Mortality in Postmenopausal Women The Women’s Health Initiative Circulation: Cardiovascular Quality and Outcomes 2011 CIRCOUTCOMES.110.959023 PMC3893688 21862719
  4. [4]Bild DE Bluemke DA Burke GL Detrano R Diez Roux AV Folsom AR Greenland P Jacob DR Jr Kronmal R Liu K Nelson JC O’Leary D Saad MF Shea S Szklo M Tracy RP Multi-ethnic study of atherosclerosis: objectives and design Am J Epidemiol 2002 156 871 81 12397006
  5. [5]Akaike H Likelihood of a model and information criteria Journal of econometrics 1981 16 3 14
  6. [6]Tibshirani R The lasso method for variable selection in the Cox model Statistics in medicine 1997 16 385 395 9044528
  7. [7]Harrell FE Califf RM Pryor DB Lee KL Rosati RA Evaluating the yield of medical tests Jama 1982 247 2543 2546 7069920
  8. [11]Lloyd-Jones DM Wilson PW Larson MG Beiser A Leip EP D’Agostino RB Levy D Framingham risk score and prediction of lifetime risk for coronary heart disease The American journal of cardiology 2004 94 20 24 15219502
  9. [14]McClelland RL Jorgensen NW Budoff M Blaha MJ Post WS Kronmal RA Bild DE Shea S Liu K Watson KE Folsom AR Khera A Ayers C Mahabadi A-A Lehmann N Jöckel K-H Moebus S Carr JJ Erbel R Burke GL 10-Year Coronary Heart Disease Risk Prediction Using Coronary Artery Calcium and Traditional Risk FactorsDerivation in the MESA (Multi-Ethnic Study of Atherosclerosis) With Validation in the HNR (Heinz Nixdorf Recall) Study and the DHS (Dallas Heart Study) Journal of the American College of Cardiology 2015 66 1643 1653 26449133 PMC4603537
  10. [15]Chahal H Bluemke DA Wu CO McClelland R Liu K Shea SJ Burke G Balfour P Herrington D Shi P Heart failure risk prediction in the Multi-Ethnic Study of Atherosclerosis Heart 2015 101 58 64 25381326 PMC4685458
  11. [16]Andrus BW Welch HG Medicare services provided by cardiologists in the United States: 1999–2008 Circulation: Cardiovascular Quality and Outcomes 2012 5 31 36 22235064
  12. [17]Lanktree MB Hassell RG Lahiry P Hegele RA Phenomics: expanding the role of clinical evaluation in genomic studies Journal of Investigative Medicine 2010 58 700 706 20216460
  13. [18]Deo RC Machine Learning in Medicine Circulation 2015 132 1920 1930 26572668 PMC5831252
  14. [19]Ishwaran H Blackstone EH Pothier CE Lauer MS Relative risk forests for exercise heart rate recovery as a predictor of mortality Journal of the American Statistical Association 2004 99 591 600
  15. [20]Inuzuka R Diller G-P Borgia F Benson L Tay EL Alonso-Gonzalez R Silva M Charalambides M Swan L Dimopoulos K Comprehensive use of cardiopulmonary exercise testing identifies adults with congenital heart disease at increased mortality risk in the medium term Circulation 2012 125 250 259 22147905
  16. [21]Hsich E Gorodeski EZ Blackstone EH Ishwaran H Lauer MS Identifying important risk factors for survival in patient with systolic heart failure using random survival forests Circulation: Cardiovascular Quality and Outcomes 2011 4 39 45 21098782 PMC3991475
  17. [23]Colombet I Ruelland A Chatellier G Gueyffier F Degoulet P Jaulent M Models to predict cardiovascular risk: comparison of CART, multilayer perceptron and logistic regression Proceedings of the AMIA Symposium 2000 156 PMC2244093 11079864
  18. [24]Park G-M Han S Kim SH Jo M-W Her SH Lee JB Lee MS Kim HC Ahn J-M Lee S-W Model for assessing cardiovascular risk in a Korean population Circulation: Cardiovascular Quality and Outcomes 2014 7 944 951 25351481
  19. [25]Shardell MD Alley DE Hicks GE El-Kamary SS Miller RR Semba RD Ferrucci L Low-serum carotenoid concentrations and carotenoid interactions predict mortality in US adults: the Third National Health and Nutrition Examination Survey Nutrition research 2011 31 178 189 21481711 PMC3081783
  20. [26]Rizza S Copetti M Rossi C Cianfarani M Zucchelli M Luzi A Pecchioli C Porzio O Di Cola G Urbani A Metabolomics signature improves the prediction of cardiovascular events in elderly subjects Atherosclerosis 2014 232 260 264 24468136
  21. [27]Rebholz CM Grams ME Matsushita K Inker LA Foster MC Levey AS Selvin E Coresh J Change in Multiple Filtration Markers and Subsequent Risk of Cardiovascular Disease and Mortality Clinical Journal of the American Society of Nephrology 2015 CJN 10101014 PMC4455217 25825481
  22. [28]Yoo I Alafaireet P Marinov M Pena-Hernandez K Gopidi R Chang J-F Hua L Data mining in healthcare and biomedicine: a survey of the literature Journal of medical systems 2012 36 2431 2448 21537851
  23. [29]Ishwaran H Kogalur UB Gorodeski EZ Minn AJ Lauer MS High-Dimensional Variable Selection for Survival Data Journal of the American Statistical Association 2010 105 205 217
  24. [30]Benjamin I Brown N Burke G Correa A Houser SR Jones DW Loscalzo J Vasan RS Whitman GR American Heart Association Cardiovascular Genome-Phenome Study Foundational Basis and Program Circulation 2015 131 100 112 25411155 PMC4286232

Cited by

Sorted by citations

Authors
Ambale-Venkatesh, B., Yang, X., Wu, C. O., Liu, K., Hundley, W. G., McClelland, R., Gomes, A. S., Folsom, A. R., Shea, S., Guallar, E., Bluemke, D. A., & Lima, J. A. C.
Affiliations
  • From the Department of Radiology (B.A.-V.), Bloomberg School of Public Health (E.G.), and Department of Medicine, Cardiology and Radiology (J.A.C.L.), Johns Hopkins University, Baltimore, MD; George Washington University, DC (X.Y.); Office of Biostatistics, NHLBI, NIH, Bethesda, MD (C.O.W.); Department of Preventive Medicine, Northwestern University Medical School, Chicago, IL (K.L.); Department of Cardiology, Wake Forest University Health Sciences, Winston-Salem, NC (W.G.H.); Department of...
  • Northwestern University (US)
Venue
Circulation Research
Published
2017-10-13
Volume
121
Issue
9
Pages
1092-1101
ISSN
  • 0009-7330 (ISSN-L)
  • 1524-4571
OpenAlex
W2743269518
Cited by
639
References
6
Citations by year
2026: 66 · 2025: 73 · 2024: 91 · 2023: 81 · 2022: 102 · 2021: 102 · 2020: 65 · 2019: 39 · 2018: 17 · 2017: 3
FWCI
46.55
Type
journal article
Language
en
Open access
Locations
  • Circulation Research (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Institutes of Health (n01hc95164-17-0-1, n01hc95165-34-0-1, n01hc95161-24-0-1, n01hc095169-003, n01hc95166-21-0-1, n01hc95162-31-0-1, n01hc95168-27-0-1, n01hc95160-18-0-1, n01hc095167-000, UL1TR001079, n01hc95163-22-0-1, n01hc95159-40-0-1, UL1TR000040)
  • National Heart, Lung, and Blood Institute (N01-HC095169, N01-HC-095165, N01 HC095163, N01-HC-095159, N01 HC095168, N01-HC-095162, N01-HC-095161, N01 HC095167, N01-HC-095160, N01 HC095166, N01 HC095164, R01HL066075)
  • National Center for Advancing Translational Sciences
Topics
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Cardiac Imaging and Diagnostics
  • Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiovascular Health and Risk Factors
Keywords
cardiovascular event prediction, random survival forest, cardiovascular risk score, Multi-Ethnic Study of Atherosclerosis, all-cause mortality, stroke, coronary artery disease, heart failure, atrial fibrillation, carotid ultrasound, coronary artery calcium, NT-proBNP, TNF-α, subclinical atherosclerosis, biomarkers
MeSH terms
Machine Learning, Aged, Aged, 80 and over, Cardiovascular Diseases, Ethnicity, Female, Follow-Up Studies, Humans, Male, Middle Aged, Predictive Value of Tests, Cohort Studies, Survival Rate, Atherosclerosis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review