The validity of dementia diagnoses in routinely collected electronic health records in the United Kingdom: A systematic review
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Purpose: The purpose of the study is to assess the validity of codes or algorithms used to identify dementia in UK electronic health record (EHR) primary care and hospitalisation databases. Methods: Relevant studies were identified by searching the MEDLINE/EMBASE databases from inception to June 2018, hand‐searching reference lists, and consulting experts. The search strategy included synonyms for “Dementia”, “Europe”, and “EHR”. Studies were included if they validated dementia diagnoses in UK primary care or hospitalisation databases, irrespective of validation method used. The Quality Assessment for Diagnostic Accuracy Studies‐2 (QUADAS‐2) tool was used to assess risk of bias. Results: From 1469 unique records, 14 relevant studies were included. Thirteen validated individual diagnoses against a reference standard, reporting high estimates of validity. Most reported only the positive predictive value (PPV), with estimates ranging between 0.09 and 1.0 and 0.62 and 0.85 in primary care and hospitalisation databases, respectively. One study performed a rate comparison, indicating good generalisability of dementia diagnoses in The Health Improvement Network (THIN) database to the UK population. Studies were of low methodological quality. As studies were not comparable, no summary validity estimates were produced. Conclusion: While heterogenous across studies, reported validity estimates were generally high. However, the credibility of these estimates is limited by the methodological quality of studies, primarily resulting from insufficient blinding of researchers interpreting the reference test. Inadequate reporting, particularly of the specific codes validated, hindered comparison of estimates across studies. Future validation studies should make use of more robust reference tests, follow established reporting guidelines, and calculate all measures of validity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Dementia prevention, intervention, and care
Livingston, G., Sommerlad, A., Orgeta, V., Costafreda, S. G., Huntley, J., Ames, D., Ballard, C., Banerjee, S., Burns, A., Cohen-Mansfield, J., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31363-6 · Cited by 6,072
Data Resource Profile: Clinical Practice Research Datalink (CPRD)
Herrett, E., Gallagher, A. M., Bhaskaran, K., Forbes, H., Mathur, R., van Staa, T., & Smeeth, L. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv098 · Cited by 2,667
Metaprop: a Stata command to perform meta-analysis of binomial data
Nyaga, V. N., Arbyn, M., & Aerts, M. (2014) · Archives of Public Health · doi:10.1186/2049-3258-72-39 · Cited by 2,139
Validation and validity of diagnoses in the General Practice Research Database: a systematic review
Herrett, E., Thomas, S. L., Schoonen, W. M., Smeeth, L., & Hall, A. J. (2010) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2009.03537.x · Cited by 1,109 · cited 6×
“We did not include synonyms for “Validity” as it had previously been shown that terms relating to the validation of diagnoses are often not mentioned in the searchable terms of a reference (the title, abstract, and controlled vocabulary), particularly when validation represented only a small aspect of a larger study.(…”
BackgroundMethodResultInfluentialSelf-citationCochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy
(2023) · doi:10.1002/9781119756194 · Cited by 757
A two decade dementia incidence comparison from the Cognitive Function and Ageing Studies I and II
Matthews, F. E., Stephan, B. C. M., Robinson, L., Jagger, C., Barnes, L. E., Arthur, A., Brayne, C., Cognitive Function and Ageing Studies (CFAS) Collaboration, Comas-Herrera, A., Wittenberg, R., et al. (2016) · Nature Communications · doi:10.1038/ncomms11398 · Cited by 426 · cited 1×
“The burden of dementia and its associated health and societal costs are projected to have major global impact as populations continue to age over the next few decades, despite the recent decline in age‐ specific dementia incidence.(1) With only one‐third of cases being due to potentially modifiable risk factors and in…”
BackgroundBenchimol, E. I., Manuel, D. G., To, T., Griffiths, A. M., Rabeneck, L., & Guttmann, A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.10.006 · Cited by 368
Brown, A., Kirichek, O., Balkwill, A., Reeves, G., Beral, V., Sudlow, C., Gallacher, J., & Green, J. (2016) · Emerging Themes in Epidemiology · doi:10.1186/s12982-016-0053-z · Cited by 78 · cited 1×
“The scope for misclassification of dementia status by the reference standard also led to a high risk of bias judgement in several studies, for example, by estimating the PPV of HES using the CPRD as reference standard.(27) Furthermore, the definition of GP confirmation may differ between studies, with the potential to…”
Method
Cited by
Weuve, J., Bennett, E. E., Ranker, L., Gianattasio, K. Z., Pedde, M., Adar, S. D., Yanosky, J. D., & Power, M. C. (2021) · Environmental Health Perspectives · doi:10.1289/ehp8716 · Cited by 209
Infectious Disease Burden and the Risk of Alzheimer’s Disease: A Population-Based Study
Douros, A., Santella, C., Dell’Aniello, S., Azoulay, L., Renoux, C., Suissa, S., & Brassard, P. (2021) · Journal of Alzheimer's Disease · doi:10.3233/jad-201534 · Cited by 37
Mukadam, N., Marston, L., Lewis, G., Mathur, R., Lowther, E., Rait, G., & Livingston, G. (2023) · PLOS ONE · doi:10.1371/journal.pone.0289893 · Cited by 38
“Dementia in CPRD is validated [17], particularly all-cause dementia, with high positive predictive values (>75%) in studies examining all-cause dementia [18].”
BackgroundNo evidence that herpes zoster is associated with increased risk of dementia diagnosis
Warren‐Gash, C., Williamson, E., Shiekh, S. I., Borjas‐Howard, J., Pearce, N., Breuer, J. M., & Smeeth, L. (2022) · Annals of Clinical and Translational Neurology · doi:10.1002/acn3.51525 · Cited by 31
Self-citationCommon vaccines and the risk of incident dementia: a population-based cohort study
Douros, A., Ante, Z., Suissa, S., & Brassard, P. (2023) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiac484 · Cited by 24
Implications of the Use of Algorithmic Diagnoses or Medicare Claims to Ascertain Dementia
Power, M. C., Gianattasio, K. Z., & Ciarleglio, A. (2020) · Neuroepidemiology · doi:10.1159/000510753 · Cited by 21
Metadata
- Authors
- McGuinness, L. A., Warren‐Gash, C., Moorhouse, L. R., & Thomas, S. L.
- Venue
- Pharmacoepidemiology and Drug Safety
- Publisher
- Wiley
- Published
- 2019-01-22
- Volume
- 28
- Issue
- 2
- Pages
- 244-255
- ISSN
- 1053-8569 (ISSN-L)
- 1099-1557
- OpenAlex
- W2914311398
- Cited by
- 51
- References
- 9
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.