The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
An Analysis of Calibration and Discrimination Among Multiple Cardiovascular Risk Scores in a Modern Multiethnic Cohort
Open accessAbstract
BACKGROUND: Accurate risk assessment of atherosclerotic cardiovascular disease (ASCVD) is essential to effectively balance the risks and benefits of therapy for primary prevention. OBJECTIVE: To compare the calibration and discrimination of the new American Heart Association (AHA) and American College of Cardiology (ACC) ASCVD risk score with alternative risk scores and to explore preventive therapy as a cause of the reported risk overestimation using the AHA-ACC-ASCVD score. DESIGN: Prospective epidemiologic study of ASCVD. SETTING: MESA (Multi-Ethnic Study of Atherosclerosis), a community-based, sex-balanced, multiethnic cohort. PATIENTS: 4227 MESA participants aged 50 to 74 years and without diabetes at baseline. MEASUREMENTS: Observed and expected events for the AHA-ACC-ASCVD score were compared with 4 commonly used risk scores-and their respective end points-in MESA after a 10.2-year follow-up. RESULTS: The new AHA-ACC-ASCVD and 3 older Framingham-based risk scores overestimated cardiovascular events by 37% to 154% in men and 8% to 67% in women. Overestimation was noted throughout the continuum of risk. In contrast, the Reynolds Risk Score overestimated risk by 9% in men but underestimated risk by 21% in women. Aspirin, lipid-lowering or antihypertensive therapy, and interim revascularization did not explain the overestimation. LIMITATION: Comparability of MESA with target populations for primary prevention and possibility of missed events in MESA. CONCLUSION: Of the 5 risk scores, 4, including the new AHA-ACC-ASCVD score, showed overestimation of risk (25% to 115%) in a modern, multiethnic cohort without baseline clinical ASCVD. If validated, overestimation of ASCVD risk may have substantial implications for individual patients and the health care system. PRIMARY FUNDING SOURCE: National Heart, Lung, and Blood Institute.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grundy, S. M., Bilheimer, D. W., Chait, A., Clark, L. T., Denke, M. A., Havel, R. J., Hazzard, W. R., Hulley, S. B., Hunninghake, D. B., Kreisberg, R. A., et al. (1993) · JAMA · doi:10.1001/jama.269.23.3015 · Cited by 27,947
2013 ACCF/AHA Guideline for the Management of Heart Failure
Yancy, C. W., Jessup, M., Bozkurt, B., Butler, J., Casey, D. E., Drazner, M. H., Fonarow, G. C., Geraci, S. A., Horwich, T., Januzzi, J. L., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.05.019 · Cited by 12,536
Detection, evaluation, and treatment of high blood cholesterol in adults (Adult Treatment Panel III)
Grundy, S. M., Becker, D. M., Clark, L. T., Cooper, R., Denke, M. A., Howard, J. L., Hunninghake, D. B., Illingworth, D. R., Luepker, R. V., McBride, P. E., et al. (2002) · Civil War Book Review · Cited by 12,198
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581
General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491 · cited 3×
“Epidemiologic methods for ascertainment of clinical events seem to be similar in MESA with those of the studies used to derive all of the risk scores, except for 2 of the 4 cohorts used to derive the AHA-ACC-ASCVD risk score (8, 11, 15, 16, 27, 32).”
Stone, N. J., Robinson, J. G., Lichtenstein, A. H., Bairey Merz, C. N., Blum, C. B., Eckel, R. H., Goldberg, A. C., Gordon, D., Levy, D., Lloyd-Jones, D. M., et al. (2014) · Circulation · doi:10.1161/01.cir.0000437738.63853.7a · Cited by 7,081
2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk
Goff, D. C., Lloyd-Jones, D. M., Bennett, G., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D., O’Donnell, C. J., et al. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.11.005 · Cited by 4,945
Multi-Ethnic Study of Atherosclerosis: Objectives and Design
Bild, D. E. (2002) · American Journal of Epidemiology · doi:10.1093/aje/kwf113 · Cited by 3,942
Goff, D. C., Lloyd-Jones, D. M., Bennett, G., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D., O’Donnell, C. J., et al. (2014) · Circulation · doi:10.1161/01.cir.0000437741.48606.98 · Cited by 3,697
Cited by
Grundy, S. M., Stone, N. J., Bailey, A. L., Beam, C., Birtcher, K. K., Blumenthal, R. S., Braun, L. T., de Ferranti, S., Faiella-Tommasino, J., Forman, D. E., et al. (2019) · Circulation · doi:10.1161/cir.0000000000000625 · Cited by 6,185
Self-citationArnett, D. K., Blumenthal, R. S., Albert, M. A., Buroker, A. B., Goldberger, Z. D., Hahn, E. J., Himmelfarb, C. D., Khera, A., Lloyd-Jones, D., McEvoy, J. W., et al. (2019) · Circulation · doi:10.1161/cir.0000000000000678 · Cited by 4,536
Self-citation(2019) · doi:10.1161/cir.0000000000000677 · Cited by 4,501
Grundy, S. M., Stone, N. J., Bailey, A. L., Beam, C., Birtcher, K. K., Blumenthal, R. S., Braun, L. T., de Ferranti, S., Faiella-Tommasino, J., Forman, D. E., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.11.003 · Cited by 2,691
Self-citation2019 ACC/AHA Guideline on the Primary Prevention of Cardiovascular Disease
Arnett, D. K., Blumenthal, R. S., Albert, M. A., Buroker, A. B., Goldberger, Z. D., Hahn, E. J., Himmelfarb, C. D., Khera, A., Lloyd-Jones, D., McEvoy, J. W., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.03.010 · Cited by 1,896
Self-citation2019 ACC/AHA Guideline on the Primary Prevention of Cardiovascular Disease: Executive Summary
Arnett, D. K., Blumenthal, R. S., Albert, M. A., Buroker, A. B., Goldberger, Z. D., Hahn, E. J., Himmelfarb, C. D., Khera, A., Lloyd-Jones, D., McEvoy, J. W., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.03.009 · Cited by 1,193
Self-citationRidker, P. M. (2016) · Circulation Research · doi:10.1161/circresaha.115.306656 · Cited by 1,002
National Lipid Association Recommendations for Patient-Centered Management of Dyslipidemia: Part 2
Jacobson, T. A., Maki, K. C., Orringer, C. E., Jones, P. H., Kris-Etherton, P., Sikand, G., La Forge, R., Daniels, S. R., Wilson, D. P., Morris, P. B., et al. (2015) · Journal of Clinical Lipidology · doi:10.1016/j.jacl.2015.09.002 · Cited by 784
“Pooled Cohort Equations overestimated cardiovascular events in women by 8 to 67%, while the Reynolds Risk Score underestimated risk by 21%.(367) Due to these challenges in ASCVD risk assessment, some experts have recommended calculation of a patient’s risk by multiple algorithms when considering initiation of statin t…”
BackgroundDeveloping and evaluating polygenic risk prediction models for stratified disease prevention
Chatterjee, N., Shi, J., & García-Closas, M. (2016) · Nature Reviews Genetics · doi:10.1038/nrg.2016.27 · Cited by 697
Budoff, M. J., Young, R., Burke, G., Jeffrey Carr, J., Detrano, R. C., Folsom, A. R., Kronmal, R., Lima, J. A. C., Liu, K. J., McClelland, R. L., et al. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehy217 · Cited by 684
Self-citationMcClelland, R. L., Jorgensen, N. W., Budoff, M., Blaha, M. J., Post, W. S., Kronmal, R. A., Bild, D. E., Shea, S., Liu, K., Watson, K. E., et al. (2015) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2015.08.035 · Cited by 681
Self-citationUS Preventive Services Task Force, Bibbins-Domingo, K., Grossman, D. C., Curry, S. J., Davidson, K. W., Epling, J. W., García, F. A. R., Gillman, M. W., Kemper, A. R., Krist, A. H., et al. (2016) · JAMA · doi:10.1001/jama.2016.15450 · Cited by 589
Kopin, L., & Lowenstein, C. J. (2017) · Annals of Internal Medicine · doi:10.7326/aitc201712050 · Cited by 582
Chou, R., Dana, T., Blazina, I., Daeges, M., & Jeanne, T. L. (2016) · JAMA · doi:10.1001/jama.2015.15629 · Cited by 568
Lloyd-Jones, D. M., Braun, L. T., Ndumele, C. E., Smith, S. C., Sperling, L. S., Virani, S. S., & Blumenthal, R. S. (2019) · Circulation · doi:10.1161/cir.0000000000000638 · Cited by 554
Self-citationNasir, K., Bittencourt, M. S., Blaha, M. J., Blankstein, R., Agatson, A. S., Rivera, J. J., Miedema, M. D., Sibley, C. T., Shaw, L. J., Blumenthal, R. S., et al. (2015) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2015.07.066 · Cited by 488
Self-citationRidker, P. M. (2016) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2015.11.037 · Cited by 414
“The Reynolds Risk Score, with a net underestimation of risk of just 3%, was the best-calibrated (Figure 4) (49).”
US Preventive Services Task Force, Mangione, C. M., Barry, M. J., Nicholson, W. K., Cabana, M., Chelmow, D., Coker, T. R., Davis, E. M., Donahue, K. E., Jaén, C. R., et al. (2022) · JAMA · doi:10.1001/jama.2022.13044 · Cited by 391
US Preventive Services Task Force, Davidson, K. W., Barry, M. J., Mangione, C. M., Cabana, M., Chelmow, D., Coker, T. R., Davis, E. M., Donahue, K. E., Jaén, C. R., et al. (2022) · JAMA · doi:10.1001/jama.2022.4983 · Cited by 387
Hecht, H., Blaha, M. J., Berman, D. S., Nasir, K., Budoff, M., Leipsic, J., Blankstein, R., Narula, J., Rumberger, J., & Shaw, L. J. (2017) · Journal of Cardiovascular Computed Tomography · doi:10.1016/j.jcct.2017.02.010 · Cited by 371
Self-citationCirculating Ceramides Predict Cardiovascular Outcomes in the Population-Based FINRISK 2002 Cohort
Havulinna, A. S., Sysi-Aho, M., Hilvo, M., Kauhanen, D., Hurme, R., Ekroos, K., Salomaa, V., & Laaksonen, R. (2016) · Arteriosclerosis, Thrombosis, and Vascular Biology · doi:10.1161/atvbaha.116.307497 · Cited by 343
A multi-ancestry polygenic risk score improves risk prediction for coronary artery disease
Patel, A. P., Wang, M., Ruan, Y., Koyama, S., Clarke, S. L., Yang, X., Tcheandjieu, C., Agrawal, S., Fahed, A. C., Ellinor, P. T., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02429-x · Cited by 306
Lloyd-Jones, D. M., Braun, L. T., Ndumele, C. E., Smith, S. C., Sperling, L. S., Virani, S. S., & Blumenthal, R. S. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.11.005 · Cited by 302
Self-citationRana, J. S., Tabada, G. H., Solomon, M. D., Lo, J. C., Jaffe, M. G., Sung, S. H., Ballantyne, C. M., & Go, A. S. (2016) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.02.055 · Cited by 299
Yadlowsky, S., Hayward, R. A., Sussman, J. B., McClelland, R. L., Min, Y.-I., & Basu, S. (2018) · Annals of Internal Medicine · doi:10.7326/m17-3011 · Cited by 271
Self-citationUtility of Nontraditional Risk Markers in Atherosclerotic Cardiovascular Disease Risk Assessment
Yeboah, J., Young, R., McClelland, R. L., Delaney, J. C., Polonsky, T. S., Dawood, F. Z., Blaha, M. J., Miedema, M. D., Sibley, C. T., Carr, J. J., et al. (2016) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2015.10.058 · Cited by 270
Self-citationGuirguis-Blake, J. M., Evans, C. V., Senger, C. A., O'Connor, E. A., & Whitlock, E. P. (2016) · Annals of Internal Medicine · doi:10.7326/m15-2113 · Cited by 260
Damen, J. A., Pajouheshnia, R., Heus, P., Moons, K. G. M., Reitsma, J. B., Scholten, R. J. P. M., Hooft, L., & Debray, T. P. A. (2019) · BMC Medicine · doi:10.1186/s12916-019-1340-7 · Cited by 250
“One study performed a direct (head-to-head) comparison of all six prediction models [7] and one other study performed a direct comparison of the ATP III and PCE models [6].”
MethodResultVistisen, D., Andersen, G. S., Hansen, C. S., Hulman, A., Henriksen, J. E., Bech-Nielsen, H., & Jørgensen, M. E. (2016) · Circulation · doi:10.1161/circulationaha.115.018844 · Cited by 229
“Risk prediction models developed in 1 population are known to over- or underestimate the risk in other populations.(33) In the variable selection step, predictors are selected if they are estimated to be highly associated with the CVD outcome in the derivation data, irrespective of their true association with the outc…”
BackgroundMachine Learning Outperforms ACC/AHA CVD Risk Calculator in MESA
Kakadiaris, I. A., Vrigkas, M., Yen, A. A., Kuznetsova, T., Budoff, M., & Naghavi, M. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.118.009476 · Cited by 227
Self-citationSackner-Bernstein, J., Kanter, D., & Kaul, S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0139817 · Cited by 220
Carrión, R. E., Cornblatt, B. A., Burton, C. Z., Tso, I. F., Auther, A. M., Adelsheim, S., Calkins, R., Carter, C. S., Niendam, T., Sale, T. G., et al. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.15121565 · Cited by 170
Long-Term All-Cause and Cause-Specific Mortality in Asymptomatic Patients With CAC ≥1,000
Peng, A. W., Mirbolouk, M., Orimoloye, O. A., Osei, A. D., Dardari, Z., Dzaye, O., Budoff, M. J., Shaw, L., Miedema, M. D., Rumberger, J., et al. (2020) · JACC: Cardiovascular Imaging · doi:10.1016/j.jcmg.2019.02.005 · Cited by 134
“First, however, previous studies indicate that the CAC Consortium contains patients with characteristics that are generally similar to those of participants in the Framingham Heart Study and MESA studies (13,42).”
ResultSelf-citationRac2 Modulates Atherosclerotic Calcification by Regulating Macrophage Interleukin-1β Production
Ceneri, N., Zhao, L., Young, B. D., Healy, A., Coskun, S., Vasavada, H., Yarovinsky, T. O., Ike, K., Pardi, R., Qin, L., et al. (2017) · Arteriosclerosis, Thrombosis, and Vascular Biology · doi:10.1161/atvbaha.116.308507 · Cited by 124
“When applied to a diverse patient population, however, current risk assessment calculators can often overestimate risk in both men and women, resulting in substantial implications for the health care of individuals and to the cost of the healthcare system in general.(3) Coupling traditional risk assessment to a patien…”
BackgroundPokharel, Y., Tang, F., Jones, P. G., Nambi, V., Bittner, V. A., Hira, R. S., Nasir, K., Chan, P. S., Maddox, T. M., Oetgen, W. J., et al. (2017) · JAMA Cardiology · doi:10.1001/jamacardio.2016.5922 · Cited by 107
Self-citationCoronary Artery Calcium and Long-Term Risk of Death, Myocardial Infarction, and Stroke
Mitchell, J. D., Paisley, R., Moon, P., Novak, E., & Villines, T. C. (2018) · JACC: Cardiovascular Imaging · doi:10.1016/j.jcmg.2017.09.003 · Cited by 107
Hong, J. C., Blankstein, R., Shaw, L. J., Padula, W. V., Arrieta, A., Fialkow, J. A., Blumenthal, R. S., Blaha, M. J., Krumholz, H. M., & Nasir, K. (2017) · JACC: Cardiovascular Imaging · doi:10.1016/j.jcmg.2017.04.014 · Cited by 101
Self-citationMuse, E. D., & Topol, E. J. (2024) · Cell Metabolism · doi:10.1016/j.cmet.2024.02.002 · Cited by 50
Cholesterol-Lowering Agents: Statins—For Everyone?
Hadjiphilippou, S., & Ray, K. K. (2019) · Circulation Research · doi:10.1161/circresaha.118.313245 · Cited by 49
Pfohl, S., Xu, Y., Foryciarz, A., Ignatiadis, N., Genkins, J., & Shah, N. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533166 · Cited by 30
Monogenic and Polygenic Models of Coronary Artery Disease
Muse, E. D., Chen, S.-F., & Torkamani, A. (2021) · Current Cardiology Reports · doi:10.1007/s11886-021-01540-0 · Cited by 27
Garg, P. K., Jorgensen, N. W., McClelland, R. L., Leigh, J. A., Greenland, P., Blaha, M. J., Yoon, A. J., Wong, N. D., Yeboah, J., & Budoff, M. J. (2018) · Journal of Cardiovascular Computed Tomography · doi:10.1016/j.jcct.2018.10.001 · Cited by 26
Self-citationSchleyer, T., Hui, S., Wang, J., Zhang, Z., Knapp, K., Baker, J., Chase, M., Boggs, R., & Simpson, R. J. (2019) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2019.25.5.544 · Cited by 19
Lee, J., Choi, Y., Ko, T., Lee, K., Shin, J., & Kim, H.-S. (2024) · Endocrinology and Metabolism · doi:10.3803/enm.2023.1739 · Cited by 9
Ding, J., Luo, Y., Shi, H., Chen, R., Luo, S., Yang, X., Xiao, Z., Liang, B., Yan, Q., Xu, J., et al. (2023) · Journal of Diabetes Investigation · doi:10.1111/jdi.14069 · Cited by 9
Metadata
- Authors
- DeFilippis, A. P., Young, R., Carrubba, C. J., McEvoy, J. W., Budoff, M. J., Blumenthal, R. S., Kronmal, R. A., McClelland, R. L., Nasir, K., & Blaha, M. J.
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2015-02-17
- Volume
- 162
- Issue
- 4
- Pages
- 266-275
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2015185375
- Cited by
- 515
- References
- 41
- FWCI
- 67.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.