The validation of cardiovascular risk scores for patients with type 2 diabetes mellitus
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Objective: Various cardiovascular prediction models have been developed for patients with type 2 diabetes. Their predictive performance in new patients is mostly not investigated. This study aims to quantify the predictive performance of all cardiovascular prediction models developed specifically for diabetes patients. Design and methods: Follow-up data of 453, 1174 and 584 type 2 diabetes patients without pre-existing cardiovascular disease (CVD) in the EPIC-NL, EPIC-Potsdam and Secondary Manifestations of ARTerial disease cohorts, respectively, were used to validate 10 prediction models to estimate risk of CVD or coronary heart disease (CHD). Discrimination was assessed by the c-statistic for time-to-event data. Calibration was assessed by calibration plots, the Hosmer–Lemeshow goodness-of-fit statistic and expected to observed ratios. Results: There was a large variation in performance of CVD and CHD scores between different cohorts. Discrimination was moderate for all 10 prediction models, with c-statistics ranging from 0.54 (95% CI 0.46 to 0.63) to 0.76 (95% CI 0.67 to 0.84). Calibration of the original models was poor. After simple recalibration to the disease incidence of the target populations, predicted and observed risks were close. Expected to observed ratios of the recalibrated models ranged from 1.06 (95% CI 0.81 to 1.40) to 1.55 (95% CI 0.95 to 2.54), mainly driven by an overestimation of risk in high-risk patients. Conclusions: All 10 evaluated models had a comparable and moderate discriminative ability. The recalibrated, but not the original, prediction models provided accurate risk estimates. These models can assist clinicians in identifying type 2 diabetes patients who are at low or high risk of developing CVD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Emerging Risk Factors Collaboration (2010) · The Lancet · doi:10.1016/s0140-6736(10)60484-9 · Cited by 5,125
Standards of medical care in diabetes—2013
American Diabetes Association (2013) · Diabetes Care · doi:10.2337/dc13-s011 · Cited by 4,369
Review: a gentle introduction to imputation of missing values.
Donders, A. R. T., van der Heijden, G. J. M. G., Stijnen, T., & Moons, K. G. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.014 · Cited by 2,582
Self-citationPrognosis and prognostic research: validating a prognostic model
Altman, D. G., Vergouwe, Y., Royston, P., & Moons, K. G. M. (2009) · BMJ · doi:10.1136/bmj.b605 · Cited by 1,436
Self-citationRisk prediction models: II. External validation, model updating, and impact assessment
Moons, K. G. M., Kengne, A. P., Grobbee, D. E., Royston, P., Vergouwe, Y., Altman, D. G., & Woodward, M. (2012) · Heart · doi:10.1136/heartjnl-2011-301247 · Cited by 1,195
Self-citationThe UKPDS risk engine: a model for the risk of coronary heart disease in Type II diabetes (UKPDS 56)
STEVENS, R. J., KOTHARI, V., ADLER, A. I., & STRATTON, I. M. (2001) · Clinical Science · doi:10.1042/cs20000335 · Cited by 1,084 · cited 1×
“Including all endpoints that occurred during follow-up, the c-statistics decreased slightly in the EPIC-NL and EPIC-Potsdam cohorts, whereas they increased for SMART (see online supplementary eFigures 7 and 8).”
Coronary heart disease risk equivalence in diabetes depends on concomitant risk factors
Howard, B. V., Best, L. G., Galloway, J. M., Howard, W. J., Jones, K., Lee, E. T., Ratner, R. E., Resnick, H. E., & Devereux, R. B. (2006) · Diabetes Care · doi:10.2337/diacare.29.02.06.dc05-1299 · Cited by 180
Cardiovascular risk assessment scores for people with diabetes: a systematic review
Chamnan, P., Simmons, R. K., Sharp, S. J., Griffin, S. J., & Wareham, N. J. (2009) · Diabetologia · doi:10.1007/s00125-009-1454-0 · Cited by 176
Risk Prediction of Cardiovascular Disease in Type 2 Diabetes
Cederholm, J., Eeg-Olofsson, K., Eliasson, B., Zethelius, B., Nilsson, P. M., Gudbjörnsdottir, S., & Register, O. B. O. T. S. N. D. (2008) · Diabetes Care · doi:10.2337/dc08-0662 · Cited by 173
An Australian cardiovascular risk equation for type 2 diabetes: the Fremantle Diabetes Study
Davis, W. A., Knuiman, M. W., & Davis, T. M. E. (2010) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2009.01958.x · Cited by 83
Cited by
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669
Self-citationCardiovascular risk in diabetes mellitus: Epidemiology, assessment and prevention
Wong, N. D., & Sattar, N. (2023) · Nature Reviews Cardiology · doi:10.1038/s41569-023-00877-z · Cited by 495
Updated Cardiovascular Prevention Guideline of the Brazilian Society of Cardiology - 2019
Précoma, D. B., Oliveira, G. M. M. D., Simão, A. F., Dutra, O. P., Coelho-Filho, O. R., Izar, M. C. D. O., Póvoa, R. M. D. S., Giuliano, I. D. C. B., Alencar Filho, A. C. D., Machado, C. A., et al. (2019) · Arquivos Brasileiros de Cardiologia · doi:10.5935/abc.20190204 · Cited by 434
Kosiborod, M., Gomes, M. B., Nicolucci, A., Pocock, S., Rathmann, W., Shestakova, M. V., Watada, H., Shimomura, I., Chen, H., Cid-Ruzafa, J., et al. (2018) · Cardiovascular Diabetology · doi:10.1186/s12933-018-0787-8 · Cited by 262
Cardiovascular risk in patients with type 2 diabetes: A systematic review of prediction models
Galbete, A., Tamayo, I., Librero, J., Enguita-Germán, M., Cambra, K., & Ibáñez-Beroiz, B. (2022) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2021.109089 · Cited by 32
Metadata
- Authors
- van der Leeuw, J., van Dieren, S., Beulens, J. W. J., Boeing, H., Spijkerman, A. M. W., van der Graaf, Y., van der A, D. L., Nöthlings, U., Visseren, F. L. J., Rutten, G. E. H. M., Moons, K. G. M., van der Schouw, Y. T., & Peelen, L. M.
- Venue
- Heart
- Publisher
- BMJ
- Published
- 2014-09-25
- Volume
- 101
- Issue
- 3
- Pages
- 222-229
- ISSN
- 1355-6037 (ISSN-L)
- 1468-201X
- OpenAlex
- W2154534237
- Cited by
- 69
- References
- 10
- FWCI
- 4.31
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The validation of cardiovascular risk scores for patients with type 2 diabetes mellitus. https://app.cochat.ai/papers/10.1136/heartjnl-2014-306068
- The paper
- van der Leeuw, J., van Dieren, S., Beulens, J. W. J., Boeing, H., Spijkerman, A. M. W., van der Graaf, Y., van der A, D. L., Nöthlings, U., Visseren, F. L. J., Rutten, G. E. H. M., Moons, K. G. M., van der Schouw, Y. T., & Peelen, L. M. (2015). The validation of cardiovascular risk scores for patients with type 2 diabetes mellitus. Heart. https://doi.org/10.1136/heartjnl-2014-306068
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.