Identification of Physician-Diagnosed Alzheimer’s Disease and Related Dementias in Population-Based Administrative Data: A Validation Study Using Family Physicians’ Electronic Medical Records
The DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Population-based surveillance of Alzheimer's and related dementias (AD-RD) incidence and prevalence is important for chronic disease management and health system capacity planning. Algorithms based on health administrative data have been successfully developed for many chronic conditions. The increasing use of electronic medical records (EMRs) by family physicians (FPs) provides a novel reference standard by which to evaluate these algorithms as FPs are the first point of contact and providers of ongoing medical care for persons with AD-RD. OBJECTIVE: We used FP EMR data as the reference standard to evaluate the accuracy of population-based health administrative data in identifying older adults with AD-RD over time. METHODS: This retrospective chart abstraction study used a random sample of EMRs for 3,404 adults over 65 years of age from 83 community-based FPs in Ontario, Canada. AD-RD patients identified in the EMR were used as the reference standard against which algorithms identifying cases of AD-RD in administrative databases were compared. RESULTS: The highest performing algorithm was "one hospitalization code OR (three physician claims codes at least 30 days apart in a two year period) OR a prescription filled for an AD-RD specific medication" with sensitivity 79.3% (confidence interval (CI) 72.9-85.8%), specificity 99.1% (CI 98.8-99.4%), positive predictive value 80.4% (CI 74.0-86.8%), and negative predictive value 99.0% (CI 98.7-99.4%). This resulted in an age- and sex-adjusted incidence of 18.1 per 1,000 persons and adjusted prevalence of 72.0 per 1,000 persons in 2010/11. CONCLUSION: Algorithms developed from health administrative data are sensitive and specific for identifying older adults with AD-RD.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Despite the use of a validated health administrative data algorithm to capture dementia, we did not have information on clinical diagnosis and there is a potential for misclassification.”
From Trajectories of health system use and survival for community-dwelling persons with dementia: a cohort study (2020) · cites this paper as [14]
In the citing paper
“We identified 117 337 persons with dementia on 1 April 2007 using a previously validated algorithm based on diagnosis codes recorded in hospitalisation records and physician claims, as well as prescription drug reimbursements for cholinesterase inhibitors.14”
From Trajectories of health system use and survival for community-dwelling persons with dementia: a cohort study (2020) · cites this paper as [14]
In the citing paper
“Individuals with dementia were identified using a validated health administrative algorithm based on diagnosis codes from hospital stays and physician claims, and prescription medication claims for cholinesterase inhibitors.26”
From Factors associated with recurrent emergency department visits among people living with dementia: A retrospective cohort study (2023) · cites this paper as [26]
In the citing paper
“In Ontario, the algorithm was found to outperform other claims-based formulations and achieved a sensitivity of 79.3%, a specificity of 99.1% and a positive predictive value of 80.4%.26”
From Factors associated with recurrent emergency department visits among people living with dementia: A retrospective cohort study (2023) · cites this paper as [26]
In the citing paper
“In Ontario, the algorithm was found to outperform other claims-based formulations and achieved a sensitivity of 79.3%, a specificity of 99.1% and a positive predictive value of 80.4%.26”
From Factors associated with recurrent emergency department visits among people living with dementia: A retrospective cohort study (2023) · cites this paper as [26]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Global prevalence of dementia: a Delphi consensus study
Ferri, C. P., Prince, M., Brayne, C., Brodaty, H., Fratiglioni, L., Ganguli, M., Hall, K., Hasegawa, K., Hendrie, H., Huang, Y., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67889-0 · Cited by 5,332
The global prevalence of dementia: a systematic review and metaanalysis.
Prince, M., Bryce, R., Albanese, E., Wimo, A., Ribeiro, W., & Ferri, C. P. (2013) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2012.11.007 · Cited by 4,941 · cited 1×
“A 2012 meta-analysis of the global prevalence of dementia found that the age-standardized prevalence rate for people greater than 60 years varied between 5 and 7% in most regions in the world [39].”
BackgroundHux, J. E., Ivis, F., Flintoft, V., & Bica, A. (2002) · Diabetes Care · doi:10.2337/diacare.25.3.512 · Cited by 1,290 · cited 1×
“Algorithms for several chronic conditions such as diabetes [8] and asthma [9] have been successfully validated against reference standards and used todescribepopulation-levelprevalenceandincidence of disease [10, 11].”
Epidemiology of Alzheimer's disease: occurrence, determinants, and strategies toward intervention
Qiu, C., Kivipelto, M., & von Strauss, E. (2009) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2009.11.2/cqiu · Cited by 1,261 · cited 1×
“Populationbased health administrative data and disease-specific registries have been available in many European countries for several decades and used to determine AD-RD prevalence [40–42].”
BackgroundMatthews, F. E., Arthur, A., Barnes, L. E., Bond, J., Jagger, C., Robinson, L., & Brayne, C. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61570-6 · Cited by 1,155
Incidence of dementia over three decades in the Framingham heart study
Satizabal, C. L., Beiser, A. S., Chouraki, V., Chêne, G., Dufouil, C., & Seshadri, S. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1504327 · Cited by 1,051
Quan, H., Li, B., Duncan Saunders, L., Parsons, G. A., Nilsson, C. I., Alibhai, A., Ghali, W. A., & for the IMECCHI Investigators (2008) · Health Services Research · doi:10.1111/j.1475-6773.2007.00822.x · Cited by 892 · cited 2×
“Two Canadian studies using hospital discharge records for their validation study found one hospitalization of AD, as a co-morbid condition, had a Sns of 30% and 66.8%, Sps of 99.8% and 99.8% and PPVs of 75% and 92.7%, respectively [15, 16].”
InfluentialThe question of familial meningiomas and schwannomas: NF2B or not to be?
King, A., & Gutmann, D. H. (2000) · Neurology · doi:10.1212/wnl.54.1.4 · Cited by 817
The Prevalence of Dementia in Europe: A Collaborative Study of 1980–1990 Findings
HOFMAN, A., ROCCA, W. A., BRAYNE, C., BRETELER, M. M. B., CLARKE, M., COOPER, B., COPELAND, J. R. M., DARTIGUES, J. F., DROUX, A. D. S., HAGNELL, O., et al. (1991) · International Journal of Epidemiology · doi:10.1093/ije/20.3.736 · Cited by 667
Lipscombe, L. L., & Hux, J. E. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60361-4 · Cited by 626 · cited 1×
“Algorithms for several chronic conditions such as diabetes [8] and asthma [9] have been successfully validated against reference standards and used todescribepopulation-levelprevalenceandincidence of disease [10, 11].”
Validity of Information on Comorbidity Derived From ICD-9-CCM Administrative Data
Quan, H., Parsons, G. A., & Ghali, W. A. (2002) · Medical Care · doi:10.1097/00005650-200208000-00007 · Cited by 579 · cited 2×
“Two Canadian studies using hospital discharge records for their validation study found one hospitalization of AD, as a co-morbid condition, had a Sns of 30% and 66.8%, Sps of 99.8% and 99.8% and PPVs of 75% and 92.7%, respectively [15, 16].”
InfluentialIdentifying Patients with Physician‐Diagnosed Asthma in Health Administrative Databases
Gershon, A. S., Wang, C., Guan, J., Vasilevska-Ristovska, J., Cicutto, L., & To, T. (2009) · Canadian Respiratory Journal · doi:10.1155/2009/963098 · Cited by 426 · cited 1×
“Algorithms for several chronic conditions such as diabetes [8] and asthma [9] have been successfully validated against reference standards and used todescribepopulation-levelprevalenceandincidence of disease [10, 11].”
Lobo, A., Launer, L. J., Fratiglioni, L., Andersen, K., Di Carlo, A., Breteler, M. M. B., Copeland, J., Dartigues, J. F., Jagger, C., Martinez-Lage, J., et al. (2000) · University of Southern Denmark Research Portal (University of Southern Denmark) · Cited by 388
The Accuracy of Medicare Claims as an Epidemiological Tool: The Case of Dementia Revisited
Taylor, Jr., Østbye, T., Langa, K. M., Weir, D., & Plassman, B. L. (2009) · Journal of Alzheimer's Disease · doi:10.3233/jad-2009-1099 · Cited by 354 · cited 1×
“…an algorithm of having more than one neurologist claim and the study using patients assessed for cognitive impair-344 ment assessed an algorithm of more than one AD inpatient or outpatient claim (Sn, Sp, and PPV of 86.5%, 56.3%, and 70.8%, and 85.5%, 85.9%, and 77.6% respectively) [27, 28].”
InfluentialWilliamson, T., Green, M. E., Birtwhistle, R., Khan, S., Garies, S., Wong, S. T., Natarajan, N., Manca, D., & Drummond, N. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1644 · Cited by 244 · cited 1×
“tia [31].”
Religa, D., Fereshtehnejad, S.-M., Cermakova, P., Edlund, A.-K., Garcia-Ptacek, S., Granqvist, N., Hallbäck, A., Kåwe, K., Farahmand, B., Kilander, L., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0116538 · Cited by 176
Trends in Asthma Prevalence and Incidence in Ontario, Canada, 1996-2005: A Population Study
Gershon, A. S., Guan, J., Wang, C., & To, T. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq189 · Cited by 170 · cited 1×
“Algorithms for several chronic conditions such as diabetes [8] and asthma [9] have been successfully validated against reference standards and used to describe population-level prevalence and incidence of disease [10, 11].”
BackgroundWiddifield, J., Bombardier, C., Bernatsky, S., Paterson, J. M., Green, D., Young, J., Ivers, N., Butt, D. A., Jaakkimainen, R. L., Thorne, J. C., et al. (2014) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-15-216 · Cited by 159
Self-citationChertkow, H., Massoud, F., Nasreddine, Z., Belleville, S., Joanette, Y., Bocti, C., Drolet, V., Kirk, J., Freedman, M., & Bergman, H. (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.070797 · Cited by 144 · cited 2×
“[47].”
MethodAdvanced Dementia: State of the Art and Priorities for the Next Decade
Mitchell, S. L., Black, B. S., Ersek, M., Hanson, L. C., Miller, S. C., Sachs, G. A., Teno, J. M., & Morrison, R. S. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-1-201201030-00008 · Cited by 142 · cited 1×
“RD care [1].”
Matthews, F., Brayne, C., & Medical Research Council Cognitive Function and Ageing Study Investigators (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020193 · Cited by 134
Tu, K., Mitiku, T., Lee, D. S., Guo, H., & Tu, J. V. (2010) · Canadian Journal of Cardiology · doi:10.1016/s0828-282x(10)70412-8 · Cited by 127 · cited 2×
“Already family physician (FP) EMRs have identified individuals having a chronic disease as reference standard for the development of administrative data based algorithms for neurological, rheumatological, and cardiovascular conditions [17–20].”
BackgroundSelf-citationTu, K., Wang, M., Young, J., Green, D., Ivers, N. M., Butt, D. A., Jaakkimainen, L., & Kapral, M. K. (2013) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2013.07.676 · Cited by 122 · cited 1×
“Similar to other validation studies [17–20, 25 ], we The algorithms were tested on the EMRALD sample where individuals with a final classification of ‘definite’ AD-”
Self-citationAssessing the validity of using administrative data to identify patients with epilepsy
Tu, K., Wang, M., Jaakkimainen, R. L., Butt, D., Ivers, N. M., Young, J., Green, D., & Jetté, N. (2014) · Epilepsia · doi:10.1111/epi.12506 · Cited by 112
Self-citationShort‐term trends in dementia prevalence in Germany between the years 2007 and 2009
Doblhammer, G., Fink, A., & Fritze, T. (2015) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2014.02.006 · Cited by 93 · cited 1×
“RD living both in the community and in a long-term care facilities in Canada [12, 13] and internationally [14].”
Evaluation of Electronic Medical Record Administrative data Linked Database (EMRALD).
Tu, K., Mitiku, T., Ivers, N. M., Guo, H., Lu, H., Jaakkimainen, L., Kavanagh, D., Lee, D. S., & Tu, J. V. (2014) · PubMed · Cited by 90
Self-citationMoore, A. E., Patterson, C., Lee, L. S., Vedel, I., & Bergman, H. (2014) · Europe PMC (PubMed Central) · Cited by 89
Diagnosis and management of dementia in primary care: exploratory study.
Parmar, J., Dobbs, B., McKay, R., Kirwan, C., Cooper, T., Marin, A., & Gupta, N. (2014) · Europe PMC (PubMed Central) · Cited by 87
Family physicians and dementia in Canada: Part 2. Understanding the challenges of dementia care.
Pimlott, N., Persaud, M., Drummond, N., Cohen, C. A., Silvius, J. L., Seigel, K., Hollingworth, G. R., & Dalziel, W. B. (2009) · PubMed · Cited by 86
Butt, D. A., Tu, K., Young, J., Green, D., Wang, M., Ivers, N., Jaakkimainen, L., Lam, R., & Guttman, M. (2014) · Neuroepidemiology · doi:10.1159/000365590 · Cited by 82 · cited 2×
“Already family physician (FP) EMRs have identified individuals having a chronic disease as ref-erencestandardforthedevelopmentofadministrativedatabasedalgorithmsforneurological,rheumatological,andcardiovascularconditions[17–20].”
Self-citationA Population‐Based Study of Cholinesterase Inhibitor Use for Dementia
Herrmann, N., Gill, S. S., Bell, C. M., Anderson, G. M., Bronskill, S. E., Shulman, K. I., Fischer, H. D., Sykora, K., Shi, H. S., & Rochon, P. A. (2007) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2007.01377.x · Cited by 78
Self-citationPrevalence of dementia in East Asia: a synthetic review of time trends
Wu, Y., Brayne, C., & Matthews, F. E. (2015) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4297 · Cited by 65 · cited 1×
“RD prevalence [43, 44].”
Management of dementia by family physicians in academic settings.
Pimlott, N., Siegel, K., Persaud, M., Slaughter, S. E., Cohen, C. A., Hollingworth, G. R., Cummings, S., Drummond, N., Dalziel, W. B., Sylvius, J., et al. (2006) · Europe PMC (PubMed Central) · Cited by 58
Neurologists’ use of ICD-9CM codes for dementia
Pippenger, M., Holloway, R. G., & Vickrey, B. G. (2001) · Neurology · doi:10.1212/wnl.56.9.1206 · Cited by 50 · cited 1×
“…an algorithm of having more than one neurologist claim and the study using patients assessed for cognitive impair-344 ment assessed an algorithm of more than one AD inpatient or outpatient claim (Sn, Sp, and PPV of 86.5%, 56.3%, and 70.8%, and 85.5%, 85.9%, and 77.6% respectively) [27, 28].”
InfluentialWang, H.-W., Chen, D.-R., Yu, H.-W., & Chen, Y.-M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4516 · Cited by 50
Kosteniuk, J. G., Morgan, D., O’Connell, M. E., Kirk, A., Crossley, M., Teare, G. F., Stewart, N. J., Bello-Haas, V. P. M. D., Forbes, D. A., Innes, A., et al. (2015) · BMC Geriatrics · doi:10.1186/s12877-015-0075-3 · Cited by 48 · cited 1×
“RD living both in the community and in a long-term care facilities in Canada [12, 13] and internationally [14].”
Role Expectations in Dementia Care Among Family Physicians and Specialists
Hum, S., Cohen, C., Persaud, M., Lee, J., Drummond, N., Dalziel, W., & Pimlott, N. (2014) · Canadian Geriatrics Journal · doi:10.5770/cgj.17.110 · Cited by 41 · cited 1×
“It requires cognitive testing, physical examinations, and laboratory and radiological tests to rule out other causes of cognitive decline and often these tests are repeated over time [48, 49].”
Bharmal, M. F., Weiner, M., Sands, L. P., Xu, H., Craig, B. A., & Thomas, J. (2007) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e31805c0835 · Cited by 27 · cited 1×
“and NPV of 71% [29].”
Hill, G., Forbes, W. F., Berthelot, J. M., Lindsay, J., & McDowell, I. (1996) · PubMed · Cited by 25
Undercoding of Alzheimer's disease and related dementias in hospitalized elderly patients in Italy
Greco, A., Cascavilla, L., Paris, F., Errico, M., Orsitto, G., D’Alessandro, V., Placentino, G., Franceschi, M., Seripa, D., Vendemiale, G., et al. (2005) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/153331750502000307 · Cited by 15
Research works printed but not linked: 7
- McDowell, 2000, For the Canadian Study of Health and Aging Working Group. The incidence of dementia in Canada, Neurology, 55, 66
- Jaakkimainen, 2006, Ambulatory physician care for adults, Primary Care in Ontario: ICES Atlas, 53
- Bronskill, 2010, Aging in Ontario: An ICES Chartbook of Health Service Use by Older Adults
- Canadian Study of Health and Ageing: Study methods and prevalence of dementia, 1994, CMAJ, 150, 899
- Hill, 1996, Dementia among seniors, Health Rep, 8, 7
- Kosteniuk, 2015, Incidence and prevalence of dementia in linked administrative data in Saskatchewan, Canada: A retrospective cohort study, BMC Geriatrics, 15, 73, 10.1186/s12877-015-0075-3 · DOI
- Doblhammer, 2015, Short-term trends in dementia prevalence in Germany between the years 2007 and 2009, Alzheimers Dement, 11, 291, 10.1016/j.jalz.2014.02.006 · DOI · Paper page
Cited by
Chen, H., Kwong, J. C., Copes, R., Tu, K., Villeneuve, P. J., van Donkelaar, A., Hystad, P., Martin, R. V., Murray, B. J., Jessiman, B., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(16)32399-6 · Cited by 776
Self-citationExposure to ambient air pollution and the incidence of dementia: a population-based cohort study
Chen, H., Kwong, J. C., Copes, R., Hystad, P., van Donkelaar, A., Tu, K., Brook, J. R., Goldberg, M. S., Martin, R. V., Murray, B. J., et al. (2017) · Environment International · doi:10.1016/j.envint.2017.08.020 · Cited by 394
Self-citationIdentifying dementia cases with routinely collected health data: a systematic review
Wilkinson, T., Ly, A., Schnier, C., Rannikmäe, K., Bush, K., Brayne, C., Quinn, T. J., Sudlow, C. L. M., & On behalf of the UK Biobank Neurodegenerative Outcomes Group and Dementias Platform UK (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2018.02.016 · Cited by 279
“Four studies reported the PPV for dementia coding in mortality data [6–9], 10 in hospital admissions data bib10[9–13,17,18,20,24,25], six in hospital admissions and outpatient data combined [14– 17,19,21,22], one in hospital admissions and mortality combined [23], one in outpatient data [27], two in insurance data [24…”
Yuchi, W., Sbihi, H., Davies, H., Tamburic, L., & Brauer, M. (2020) · Environmental Health · doi:10.1186/s12940-020-0565-4 · Cited by 220
Mondor, L., Maxwell, C. J., Hogan, D. B., Bronskill, S. E., Gruneir, A., Lane, N. E., & Wodchis, W. P. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002249 · Cited by 173
Self-citation
Metadata
- Authors
- Jaakkimainen, R. L., Bronskill, S. E., Tierney, M. C., Herrmann, N., Green, D., Young, J., Ivers, N., Butt, D., Widdifield, J., & Tu, K.
- Affiliations
- University of Toronto (CA)
- Institute for Clinical Evaluative Sciences (CA)
- Sunnybrook Health Science Centre (CA)
- Cancer Care Ontario (CA)
- McGill University Health Centre (CA)
- Corresponding author
- Jaakkimainen, R. Liisa
- ORCID
- Venue
- Journal of Alzheimer's Disease
- Publisher
- SAGE Publications
- Published
- 2016-08-23
- Volume
- 54
- Issue
- 1
- Pages
- 337-349
- ISSN
- 1387-2877 (ISSN-L)
- 1875-8908
- OpenAlex
- W2509531641
- Cited by
- 305
- References
- 41
- Citations by year
- 2026: 19 · 2025: 41 · 2024: 32 · 2023: 30 · 2022: 36 · 2021: 43 · 2020: 46 · 2019: 28 · 2018: 21 · 2017: 7 · 2016: 2
- FWCI
- 32.91
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Alzheimer s Disease (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Institute for Clinical Evaluative Sciences
- Ontario Ministry of Health and Long-Term Care
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- Alzheimer's disease and related dementias, case identification algorithm
- MeSH terms
- Adult, Age Factors, Aged, Aged, 80 and over, Algorithms, Dementia, False Negative Reactions, False Positive Reactions, Female, Humans, Male, Middle Aged, Ontario, Physicians, Family, Retrospective Studies, Sensitivity and Specificity, Sex Factors, Incidence, Prevalence, Nootropic Agents, Electronic Health Records, Epidemiological Monitoring
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.