Performance of Cardiovascular Disease Risk Scores in People Diagnosed With Type 2 Diabetes: External Validation Using Data From the National Scottish Diabetes Register
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To evaluate the performance of five cardiovascular disease (CVD) risk scores developed in diabetes populations and compare their performance to QRISK2. RESEARCH DESIGN AND METHODS: A cohort of people diagnosed with type 2 diabetes between 2004 and 2016 was identified from the Scottish national diabetes register. CVD events were identified using linked hospital and death records. Five-year risk of CVD was estimated using each of QRISK2, ADVANCE (Action in Diabetes and Vascular disease: preterAx and diamicroN-MR Controlled Evaluation), Cardiovascular Health Study (CHS), New Zealand Diabetes Cohort Study (NZ DCS), Fremantle Diabetes Study, and Swedish National Diabetes Register (NDR) risk scores. Discrimination and calibration were assessed using the Harrell C statistic and calibration plots, respectively. RESULTS: The external validation cohort consisted of 181,399 people with type 2 diabetes and no history of CVD. There were 14,081 incident CVD events within 5 years of follow-up. The 5-year observed risk of CVD was 9.7% (95% CI 9.6, 9.9). C statistics varied between 0.66 and 0.67 for all risk scores. QRISK2 overestimated risk, classifying 87% to be at high risk for developing CVD within 5 years; ADVANCE underestimated risk, and the Swedish NDR risk score calibrated well to observed risk. CONCLUSIONS: None of the risk scores performed well among people with newly diagnosed type 2 diabetes. Using these risk scores to predict 5-year CVD risk in this population may not be appropriate.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
2016 European Guidelines on cardiovascular disease prevention in clinical practice
Piepoli, M. F., Hoes, A. W., Agewall, S., Albus, C., Brotons, C., Catapano, A. L., Cooney, M.-T., Corrà, U., Cosyns, B., Deaton, C., et al. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw106 · Cited by 6,457
Self-citationThe Emerging Risk Factors Collaboration (2010) · The Lancet · doi:10.1016/s0140-6736(10)60484-9 · Cited by 5,125
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
Ahlqvist, E., Storm, P., Käräjämäki, A., Martinell, M., Dorkhan, M., Carlsson, A., Vikman, P., Prasad, R. B., Aly, D. M., Almgren, P., et al. (2018) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(18)30051-2 · Cited by 2,335
Uno, H., Cai, T., Pencina, M. J., D'Agostino, R. B., & Wei, L. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4154 · Cited by 1,535 · cited 2×
“This statistic describes the probability that, for anypair of individuals among whom one developed CVD and the other did not develop CVD, the predicted risk of the outcome is higher for the individual who did subsequently develop the disease (28).”
BackgroundResultSteyerberg, E. W. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-77244-8 · Cited by 1,491
Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2
Hippisley-Cox, J., Coupland, C., Vinogradova, Y., Robson, J., Minhas, R., Sheikh, A., & Brindle, P. (2008) · BMJ · doi:10.1136/bmj.39609.449676.25 · Cited by 1,459 · cited 2×
“Selected Risk Scores QRISK2 was developed using data from the QResearch database, is based on a Cox proportional hazards model, and predicts 10-year risk of CVD (7).”
MethodRisk prediction models: II. External validation, model updating, and impact assessment
Moons, K. G. M., Kengne, A. P., Grobbee, D. E., Royston, P., Vergouwe, Y., Altman, D. G., & Woodward, M. (2012) · Heart · doi:10.1136/heartjnl-2011-301247 · Cited by 1,195
Self-citationCollins, G. S., Ogundimu, E. O., & Altman, D. G. (2016) · Statistics in Medicine · doi:10.1002/sim.6787 · Cited by 665
Vergouwe, Y., Steyerberg, E. W., Eijkemans, M. J. C., & Habbema, J. D. F. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.06.017 · Cited by 636
Riley, R. D., Ensor, J., Snell, K. I. E., Debray, T. P. A., Altman, D. G., Moons, K. G. M., & Collins, G. S. (2016) · BMJ · doi:10.1136/bmj.i3140 · Cited by 585 · cited 1×
“Beyond differences in the performance of different health systems, there are likely to be a number of explanations for the overall poor performance of the assessed risk scores (33).”
BackgroundCardiovascular risk assessment scores for people with diabetes: a systematic review
Chamnan, P., Simmons, R. K., Sharp, S. J., Griffin, S. J., & Wareham, N. J. (2009) · Diabetologia · doi:10.1007/s00125-009-1454-0 · Cited by 176 · cited 2×
“Several CVD risk scores have also been developed specifically for use among people with type 2 diabetes (8).”
BackgroundAn Australian cardiovascular risk equation for type 2 diabetes: the Fremantle Diabetes Study
Davis, W. A., Knuiman, M. W., & Davis, T. M. E. (2010) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2009.01958.x · Cited by 83 · cited 1×
“Of these, fivedthe Swedish National Diabetes Register (NDR) risk score (14), the Action in Diabetes and Vascular disease: preterAx and diamicroN-MR Controlled Evaluation (ADVANCE) CVD risk score (15), the Fremantle Diabetes Study risk score (16), the New Zealand Diabetes Cohort Study (NZ DCS) risk score (17), and the…”
Background
Cited by
Heart Disease and Stroke Statistics—2020 Update: A Report From the American Heart Association
Virani, S. S., Alonso, A., Benjamin, E. J., Bittencourt, M. S., Callaway, C. W., Carson, A. P., Chamberlain, A. M., Chang, A. R., Cheng, S., Delling, F. N., et al. (2020) · Circulation · doi:10.1161/cir.0000000000000757 · Cited by 9,175
Heart Disease and Stroke Statistics—2023 Update: A Report From the American Heart Association
Tsao, C. W., Aday, A. W., Almarzooq, Z. I., Anderson, C. A. M., Arora, P., Avery, C. L., Baker-Smith, C. M., Beaton, A. Z., Boehme, A. K., Buxton, A. E., et al. (2023) · Circulation · doi:10.1161/cir.0000000000001123 · Cited by 8,300
Heart Disease and Stroke Statistics—2022 Update: A Report From the American Heart Association
Tsao, C. W., Aday, A. W., Almarzooq, Z. I., Alonso, A., Beaton, A. Z., Bittencourt, M. S., Boehme, A. K., Buxton, A. E., Carson, A. P., Commodore-Mensah, Y., et al. (2022) · Circulation · doi:10.1161/cir.0000000000001052 · Cited by 5,987
Heart Disease and Stroke Statistics—2021 Update: A Report From the American Heart Association
Virani, S. S., Alonso, A., Aparicio, H. J., Benjamin, E. J., Bittencourt, M. S., Callaway, C. W., Carson, A. P., Chamberlain, A. M., Cheng, S., Delling, F. N., et al. (2021) · Circulation · doi:10.1161/cir.0000000000000950 · Cited by 5,784
Martin, S. S., Aday, A. W., Almarzooq, Z. I., Anderson, C. A. M., Arora, P., Avery, C. L., Baker-Smith, C. M., Barone Gibbs, B., Beaton, A. Z., Boehme, A. K., et al. (2024) · Circulation · doi:10.1161/cir.0000000000001209 · Cited by 2,800
Metadata
- Authors
- Read, S. H., van Diepen, M., Colhoun, H. M., Halbesma, N., Lindsay, R. S., McKnight, J. A., McAllister, D. A., Pearson, E. R., Petrie, J. R., Philip, S., Sattar, N., Woodward, M., & Wild, S. H.
- Venue
- Diabetes Care
- Publisher
- American Diabetes Association
- Published
- 2018-07-12
- Volume
- 41
- Issue
- 9
- Pages
- 2010-2018
- ISSN
- 0149-5992 (ISSN-L)
- 1935-5548
- OpenAlex
- W2852231730
- Cited by
- 67
- References
- 13
- FWCI
- 4.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.