External validation of four dementia prediction models for use in the general community-dwelling population: a comparative analysis from the Rotterdam Study
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
To systematically review the literature for dementia prediction models for use in the general population and externally validate their performance in a head-to-head comparison. We selected four prediction models for validation: CAIDE, BDSI, ANU-ADRI and DRS. From the Rotterdam Study, 6667 non-demented individuals aged 55 years and older were assessed between 1997 and 2001. Subsequently, participants were followed for dementia until 1 January, 2015. For each individual, we computed the risk of dementia using the reported scores from each prediction model. We used the C-statistic and calibration plots to assess the performance of each model to predict 10-year risk of all-cause dementia. For comparisons, we also evaluated discriminative accuracy using only the age component of these risk scores for each model separately. During 75,581 person-years of follow-up, 867 participants developed dementia. C-statistics for 10-year dementia risk prediction were 0.55 (95% CI 0.53-0.58) for CAIDE, 0.78 (0.76-0.81) for BDSI, 0.75 (0.74-0.77) for ANU-ADRI, and 0.81 (0.78-0.83) for DRS. Calibration plots showed that predicted risks were too extreme with underestimation at low risk and overestimation at high risk. Importantly, in all models age alone already showed nearly identical discriminative accuracy as the full model (C-statistics: 0.55 (0.53-0.58) for CAIDE, 0.81 (0.78-0.83) for BDSI, 0.77 (0.75-0.79) for ANU-ADRI, and 0.81 (0.78-0.83) for DRS). In this study, we found high variability in discriminative ability for predicting dementia in an elderly, community-dwelling population. All models showed similar discriminative ability when compared to prediction based on age alone. These findings highlight the urgent need for updated or new models to predict dementia risk in the general population.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170
Ngandu, T., Lehtisalo, J., Solomon, A., Levälahti, E., Ahtiluoto, S., Antikainen, R., Bäckman, L., Hänninen, T., Jula, A., Laatikainen, T., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60461-5 · Cited by 3,689 · cited 1×
“The results of the CAIDE model should therefore be interpreted with caution, yet we also note that the CAIDE model is increasingly being used in older populations to select high-risk individuals for clinical trials [7] and to conduct stratified analyses in high-risk individuals using this score [9].”
MethodA calibration hierarchy for risk models was defined: from utopia to empirical data
Van Calster, B., Nieboer, D., Vergouwe, Y., De Cock, B., Pencina, M. J., & Steyerberg, E. W. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.005 · Cited by 910
van Charante, E. P. M., Richard, E., Eurelings, L. S., van Dalen, J.-W., Ligthart, S. A., van Bussel, E. F., Hoevenaar-Blom, M. P., Vermeulen, M., & van Gool, W. A. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30950-3 · Cited by 611
Incidence of dementia: does gender make a difference?
Ruitenberg, A., Ott, A., van Swieten, J. C., Hofman, A., & Breteler, M. M. B. (2001) · Neurobiology of Aging · doi:10.1016/s0197-4580(01)00231-7 · Cited by 467 · cited 1×
“This may be explained by the fact that although the absolute incidence of dementia increases steeply with increasing age, the relative increase in dementia incidence is higher in younger (aged 55–79 years) than in older participants (aged 80 years or older) [20, 39].”
BackgroundHigh total cholesterol levels in late life associated with a reduced risk of dementia
Mielke, M. M., Zandi, P. P., Sjögren, M., Gustafson, D., Östling, S., Steen, B., & Skoog, I. (2005) · Neurology · doi:10.1212/01.wnl.0000161870.78572.a5 · Cited by 411
Soininen, H., Solomon, A., Visser, P. J., Hendrix, S. B., Blennow, K., Kivipelto, M., Hartmann, T., Hallikainen, I., Hallikainen, M., Helisalmi, S., et al. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30332-0 · Cited by 241
Comparing risk prediction models
Collins, G. S., & Moons, K. G. M. (2012) · BMJ · doi:10.1136/bmj.e3186 · Cited by 110
Cited by
A tutorial on calibration measurements and calibration models for clinical prediction models
Huang, Y., Li, W., Macheret, F., Gabriel, R. A., & Ohno-Machado, L. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz228 · Cited by 486
Objectives, design and main findings until 2020 from the Rotterdam Study
Ikram, M. A., Brusselle, G., Ghanbari, M., Goedegebure, A., Ikram, M. K., Kavousi, M., Kieboom, B. C. T., Klaver, C. C. W., de Knegt, R. J., Luik, A. I., et al. (2020) · European Journal of Epidemiology · doi:10.1007/s10654-020-00640-5 · Cited by 452
Self-citationde Wolf, F., Ghanbari, M., Licher, S., McRae-McKee, K., Gras, L., Weverling, G. J., Wermeling, P., Sedaghat, S., Ikram, M. K., Waziry, R., et al. (2020) · Brain · doi:10.1093/brain/awaa054 · Cited by 324
Self-citationLong-term dementia risk prediction by the LIBRA score: a 30-year follow-up of the CAIDE study
Deckers, K., Barbera, M., Köhler, S., Ngandu, T., van Boxtel, M., Rusanen, M., Laatikainen, T., Verhey, F., Soininen, H., Kivipelto, M., et al. (2020) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.5235 · Cited by 99
Heger, I. S., Deckers, K., Schram, M. T., Stehouwer, C. D. A., Dagnelie, P. C., van der Kallen, C. J. H., Koster, A., Eussen, S. J. P. M., Jansen, J. F. A., Verhey, F. R. J., et al. (2021) · Neurology · doi:10.1212/wnl.0000000000012572 · Cited by 67
Metadata
- Authors
- Licher, S., Yilmaz, P., Leening, M. J. G., Wolters, F. J., Vernooij, M. W., Stephan, B. C. M., Ikram, M. K., & Ikram, M. A.
- Venue
- European Journal of Epidemiology
- Published
- 2018-05-08
- Volume
- 33
- Issue
- 7
- Pages
- 645-655
- ISSN
- 0393-2990 (ISSN-L)
- 1573-7284
- OpenAlex
- W2799299958
- Cited by
- 102
- References
- 8
- FWCI
- 6.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: External validation of four dementia prediction models for use in the general community-dwelling population: a comparative analysis from the Rotterdam Study. https://app.cochat.ai/papers/10.1007/s10654-018-0403-y
- The paper
- Licher, S., Yilmaz, P., Leening, M. J. G., Wolters, F. J., Vernooij, M. W., Stephan, B. C. M., Ikram, M. K., & Ikram, M. A. (2018). External validation of four dementia prediction models for use in the general community-dwelling population: a comparative analysis from the Rotterdam Study. European Journal of Epidemiology. https://doi.org/10.1007/s10654-018-0403-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.