Complexity of MRI White Matter Hyperintensity Assessments in Relation to Cognition in Aging and Dementia from the Sunnybrook Dementia Study
The DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index.
Abstract
PURPOSE: Quantification methods for white matter hyperintensities (WMH) on Magnetic Resonance Imaging are heterogeneous, deterring their application. This study compared three WMH rating scales, varying in complexity, and a volumetric method, to evaluate trade-offs between complexity and clinical utility in differentiating dementia subgroups and in correlating with cognition. METHODS: WMH were rated using the Fazekas, Age-Related White Matter Changes (ARWMC) and Scheltens scales, and segmented by computational volumetry in 108 patients with Alzheimer's Disease (AD), 23 with Mild Cognitive Impairment (MCI) and 34 normal controls (NC). Global and hippocampal atrophy, age and education, were accounted for in correlations of WMH with cognitive domains. RESULTS: Intra- and inter-rater reliability were high (intraclass correlation coefficients = 0.88-0.97) across rating scales. WMH scores of all scales were highly correlated with volumes (Spearman r = 0.78-0.90, Ps < 0.001), as well as with each other (Spearman r = 0.86-0.91, Ps < 0.001). The Fazekas scale showed significant separation between AD, MCI and NC using non-parametric analysis, while the ARWMC and Scheltens' scales, and WMH volumes demonstrated significant correlations (standardized β = -0.19 to -0.24, Ps < 0.05) with cognitive domain scores using multivariate regression analysis, controlling for age, education, global and hippocampal atrophy in patients with AD. CONCLUSIONS: This study suggests that the degree of complexity of WMH rating scales did not affect validation against WMH volumes, but did vary in validation against cognition. The simplest scale performed best in separating cognitive subgroups, but the more complex scales and quantification correlated better with cognitive measures, especially executive function. Hence the best choice of scale depends on the particular application.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For some of the lesions, qualitative and quantitative approaches are closely related,82,83 and both have advantages and disadvantages that should be considered in the design of any study of SVD (appendix).”
From Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration (2013) · cites this paper as [83]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282 · cited 1×
“Mini-Mental State Examination (MMSE) [18] and the Mattis Dementia Rating Scale (DRS) total score [19] were used to measure global cognitive function.”
MethodMcKhann, G., Drachman, D., Folstein, M., Katzman, R., Price, D., & Stadlan, E. M. (1984) · Neurology · doi:10.1212/wnl.34.7.939 · Cited by 27,915
Mild Cognitive Impairment: Clinical Characterization and Outcome
Petersen, R. C., Smith, G. E., Waring, S. C., Ivnik, R. J., Tangalos, E. G., & Kokmen, E. (1999) · Archives of Neurology · doi:10.1001/archneur.56.3.303 · Cited by 8,980
MR signal abnormalities at 1.5 T in Alzheimer's dementia and normal aging
Fazekas, F., Chawluk, J., Alavi, A., Hurtig, H., & Zimmerman, R. (1987) · American Journal of Roentgenology · doi:10.2214/ajr.149.2.351 · Cited by 5,334 · cited 1×
“[24] B) Age-related White Matter Change (ARWMC) [25] and C) Scheltens et al.”
BackgroundThe Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods
Jack, C. R., Bernstein, M. A., Fox, N. C., Thompson, P., Alexander, G., Harvey, D., Borowski, B., Britson, P. J., L. Whitwell, J., Ward, C., et al. (2008) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.21049 · Cited by 4,347 · cited 1×
“The advantage of the rating scales is that they can be performed by trained observers on scans obtained clinically, as long as they include a T2 weighted or FLAIR sequence, using standardized protocols, preferably compliant with the Vascular Cognitive Impairment Harmonization Criteria [35], and exemplified in the prot…”
MethodA New Rating Scale for Age-Related White Matter Changes Applicable to MRI and CT
Wahlund, L. O., Barkhof, F., Fazekas, F., Bronge, L., Augustin, M., Sjögren, M., Wallin, A., Ader, H., Leys, D., Pantoni, L., et al. (2001) · Stroke · doi:10.1161/01.str.32.6.1318 · Cited by 1,797 · cited 1×
“[24] B) Age-related White Matter Change (ARWMC) [25] and C) Scheltens et al.”
BackgroundSelf-citationHachinski, V., Iadecola, C., Petersen, R. C., Breteler, M. M., Nyenhuis, D. L., Black, S. E., Powers, W. J., DeCarli, C., Merino, J. G., Kalaria, R. N., et al. (2006) · Stroke · doi:10.1161/01.str.0000237236.88823.47 · Cited by 1,722 · cited 1×
“The advantage of the rating scales is that they can be performed by trained observers on scans obtained clinically, as long as they include a T2 weighted or FLAIR sequence, using standardized protocols, preferably compliant with the Vascular Cognitive Impairment Harmonization Criteria [35], and exemplified in the prot…”
MethodSelf-citationde Leeuw, F.-E. (2001) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.70.1.9 · Cited by 1,291
Scheltens, P., Barkhof, F., Leys, D., Pruvo, J. P., Nauta, J. J. P., Vermersch, P., Steinling, M., & Valk, J. (1993) · Journal of the Neurological Sciences · doi:10.1016/0022-510x(93)90041-v · Cited by 923 · cited 1×
“[26] on axial T2/PD-weighted MR images.”
Self-citationDeCarli, C., Murphy, D. G. M., Tranh, M., Grady, C. L., Haxby, J. V., Gillette, J. A., Salerno, J. A., Gonzales-Aviles, A., Honvitz, B., Rapoport, S. I., et al. (1995) · Neurology · doi:10.1212/wnl.45.11.2077 · Cited by 531 · cited 3×
“Some studies have argued that this may be partially due to a threshold effect, which means a significant accumulation of WMH is necessary before cognitive deficit becomes apparent [7, 8].”
BackgroundExtent and distribution of white matter hyperintensities in normal aging, MCI, and AD
Yoshita, M., Fletcher, E., Harvey, D., Ortega, M., Martinez, O., Mungas, D. M., Reed, B. R., & DeCarli, C. S. (2006) · Neurology · doi:10.1212/01.wnl.0000249119.95747.1f · Cited by 434 · cited 1×
“The extent of WMH increases from normal aging to mild cognitive impairment and to dementia [3, 4, 5], and WMH burden negatively correlates with cognitive performance in both healthy elderly and demented groups [4, 6].”
BackgroundBarber, R., Scheltens, P., Gholkar, A., Ballard, C., McKeith, I., Ince, P., Perry, R., & O'Brien, J. (1999) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.67.1.66 · Cited by 417 · cited 1×
“The extent of WMH increases from normal aging to mild cognitive impairment and to dementia [3, 4, 5], and WMH burden negatively correlates with cognitive performance in both healthy elderly and demented groups [4, 6].”
BackgroundSelf-citationBoone, K. B. (1992) · Archives of Neurology · doi:10.1001/archneur.1992.00530290141024 · Cited by 400 · cited 3×
“Some studies have argued that this may be partially due to a threshold effect, which means a significant accumulation of WMH is necessary before cognitive deficit becomes apparent [7, 8].”
BackgroundMRI predictors of cognition in subcortical ischemic vascular disease and Alzheimer's disease
Mungas, D., Jagust, W. J., Reed, B. R., Kramer, J. H., Weiner, M. W., Schuff, N., Norman, D., Mack, W. J., Willis, L., & Chui, H. C. (2001) · Neurology · doi:10.1212/wnl.57.12.2229 · Cited by 341
van Straaten, E. C. W., Fazekas, F., Rostrup, E., Scheltens, P., Schmidt, R., Pantoni, L., Inzitari, D., Waldemar, G., Erkinjuntti, T., Mäntylä, R., et al. (2006) · Stroke · doi:10.1161/01.str.0000202585.26325.74 · Cited by 314 · cited 3×
“Although this was difficult to explain and contradictory to a previous report [31], a simple scale may better categorize the severity of WMH, and be more useful for quickly screening for brain-behavior studies.”
ResultSelf-citationKapeller, P., Barber, R., Vermeulen, R. J., Adèr, H., Scheltens, P., Freidl, W., Almkvist, O., Moretti, M., del Ser, T., Vaghfeldt, P., et al. (2003) · Stroke · doi:10.1161/01.str.0000049766.26453.e9 · Cited by 300 · cited 1×
“Heterogeneity of quantifying methods of WMH could contribute to these inconsistent findings [13, 14].”
BackgroundSelf-citationKertesz, A. (1988) · Archives of Neurology · doi:10.1001/archneur.1988.00520280050015 · Cited by 251 · cited 1×
“White matter hyperintensities (WMH) on brain T2 and proton density (PD) weighted or fluid-attenuated inversion recovery (FLAIR) magnetic resonance images (MRI) are frequent in the elderly [1, 2].”
BackgroundRoutine quantitative analysis of brain and cerebrospinal fluid spaces with MR imaging
Kikinis, R., Shenton, M. E., Gerig, G., Martin, J., Anderson, M., Metcalf, D., Guttmann, C. R. G., McCarley, R. W., Jolesz, F. A., Lorensen, W., et al. (1992) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880020603 · Cited by 237 · cited 1×
“Using a k-nearest neighbours algorithm [29], a fully segmented image was produced to classify supratentorial tissues into brain parenchyma, CSF and WMH.”
MethodNeuropsychologic correlates of MRI white matter hyperintensities: A study of 150 normal volunteers
Schmidt, R., Fazekas, F., Offenbacher, H., Dusek, T., Zach, E., Reinhart, B., Grieshofer, P., Freidl, W., Eber, B., Schumacher, M., et al. (1993) · Neurology · doi:10.1212/wnl.43.12.2490 · Cited by 209 · cited 1×
“The extent of WMH increases from normal aging to mild cognitive impairment and to dementia [3, 4, 5], and WMH burden negatively correlates with cognitive performance in both healthy elderly and demented groups [4, 6].”
BackgroundMeasuring progression of cerebral white matter lesions on MRI: Visual rating and volumetrics
Prins, N. D., van Straaten, E. C. W., van Dijk, E. J., Simoni, M., van Schijndel, R. A., Vrooman, H. A., Koudstaal, P. J., Scheltens, P., Breteler, M. M. B., & Barkhof, F. (2004) · Neurology · doi:10.1212/01.wnl.0000123264.40498.b6 · Cited by 185 · cited 1×
“They may also be more reliable for longitudinal studies [40].”
BackgroundSelf-citationA Robust Method for Extraction and Automatic Segmentation of Brain Images
Kovacevic, N., Lobaugh, N. J., Bronskill, M. J., Levine, B., Feinstein, A., & Black, S. E. (2002) · NeuroImage · doi:10.1006/nimg.2002.1221 · Cited by 158 · cited 1×
“WMH volumetry was performed using previously published techniques [10, 27, 28].”
MethodSelf-citationBurns, J. M., Church, J. A., Johnson, D. K., Xiong, C., Marcus, D., Fotenos, A. F., Snyder, A. Z., Morris, J. C., & Buckner, R. L. (2005) · Archives of Neurology · doi:10.1001/archneur.62.12.1870 · Cited by 155 · cited 1×
“The extent of WMH increases from normal aging to mild cognitive impairment and to dementia [3, 4, 5], and WMH burden negatively correlates with cognitive performance in both healthy elderly and demented groups [4, 6].”
BackgroundRamirez, J., Gibson, E., Quddus, A., Lobaugh, N. J., Feinstein, A., Levine, B., Scott, C. J. M., Levy‐Cooperman, N., Gao, F., & Black, S. E. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.013 · Cited by 149 · cited 2×
“5T or at 3T (adding on a FLAIR) as well [28, 37–39].”
BackgroundSelf-citationAutomatic segmentation of white matter hyperintensities in the elderly using FLAIR images at 3T
Gibson, E., Gao, F., Black, S. E., & Lobaugh, N. J. (2010) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.22004 · Cited by 129 · cited 2×
“5T or at 3T (adding on a FLAIR) as well [28, 37–39].”
BackgroundSelf-citationGouw, A. A., van der Flier, W. M., van Straaten, E. C. W., Barkhof, F., Ferro, J. M., Bäezner, H., Pantoni, L., Inzitari, D., Erkinjuntti, T., Wahlund, L., et al. (2006) · Journal of Neurology · doi:10.1007/s00415-006-0193-5 · Cited by 122 · cited 3×
“Associations of WMH with neuropsychological data have been found across different methods in previous studies on validity of visual rating scales and quantitative WMH volumetry [32, 33].”
BackgroundMethodResultSelf-citationDade, L. A., Gao, F., Kovacevic, N., Roy, P., Rockel, C. P., O'Toole, C., Lobaugh, N. J., Feinstein, A., Levine, B., & Black, S. E. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.03.023 · Cited by 114
Self-citationPantoni, L., Simoni, M., Pracucci, G., Schmidt, R., Barkhof, F., & Inzitari, D. (2002) · Stroke · doi:10.1161/01.str.0000038424.70926.5e · Cited by 109 · cited 1×
“Heterogeneity of quantifying methods of WMH could contribute to these inconsistent findings [13, 14].”
BackgroundSwartz, R. H., Stuss, D. T., Gao, F., & Black, S. E. (2008) · Stroke · doi:10.1161/strokeaha.107.491936 · Cited by 82 · cited 4×
“Whole brain and total intracranial volumes were obtained using the volumetric protocol [10].”
BackgroundMethodInfluentialSelf-citationWhite matter lesions and cognitive deficits: relevance of lesion pattern?
Damian, M. S., Schilling, G., Bachmann, G., Simon, C., Stöppler, S., & Dorndorf, W. (2009) · Acta Neurologica Scandinavica · doi:10.1111/j.1600-0404.1994.tb02753.x · Cited by 78 · cited 1×
“Some studies suggested WMH load must reach a threshold before neurobehavioral signs become manifest [7, 8] or must involve a strategic location [9, 10].”
BackgroundWhite Matter Lesions, Quantitative Magnetic Resonance Imaging, and Dementia
Bigler, E. D., Kerr, B., Victoroff, J., Tate, D. F., & Breitner, J. C. S. (2002) · Alzheimer Disease & Associated Disorders · doi:10.1097/00002093-200207000-00006 · Cited by 54 · cited 1×
“Others comment that WMH have little impact on cognition, especially when taking into account other factors such as hippocampal or general cerebral atrophy [11, 12].”
BackgroundA reliable MR measurement of medial temporal lobe width from the Sunnybrook Dementia Study
Gao, F., Black, S. E., Leibovitch, F. S., Callen, D. J., Lobaugh, N. J., & Szalai, J. P. (2002) · Neurobiology of Aging · doi:10.1016/s0197-4580(02)00013-1 · Cited by 34 · cited 1×
“Medial temporal lobe atrophy was measured (by FG) as previously described by using the thinnest medial temporal lobe width on axial T1 images parallel to the long axis of the hippocampus [30].”
MethodSelf-citationSachdev, P. S., Cathcart, S., Shnier, R., Wen, W. X., & Brodaty, H. (1999) · Psychiatry Research Neuroimaging · doi:10.1016/s0925-4927(99)00036-0 · Cited by 24 · cited 1×
“Associations of WMH with neuropsychological data have been found across different methods in previous studies on validity of visual rating scales and quantitative WMH volumetry [32, 33].”
MethodUtility of simultaneous brain, CSF and hyperintensity quantification in dementia
Swartz, R. H., Black, S. E., Feinstein, A., Rockel, C. P., Sela, G., Gao, F. Q., Caldwell, C. B., & Bronskill, M. J. (2002) · Psychiatry Research Neuroimaging · doi:10.1016/s0925-4927(02)00068-9 · Cited by 19 · cited 1×
“WMH volumetry was performed using previously published techniques [10, 27, 28].”
MethodSelf-citationAge-related white matter changes and cognitive impairment (Editorial)
Inzitari, D. (2000) · Florence Research (University of Florence) · Cited by 2
Cited by
Wardlaw, J. M., Smith, E. E., Biessels, G. J., Cordonnier, C., Fazekas, F., Frayne, R., Lindley, R. I., O'Brien, J. T., Barkhof, F., Benavente, O. R., et al. (2013) · The Lancet Neurology · doi:10.1016/s1474-4422(13)70124-8 · Cited by 5,544
Self-citationRamirez, J., Berezuk, C., McNeely, A. A., Scott, C. J. M., Gao, F., & Black, S. E. (2014) · Journal of Alzheimer's Disease · doi:10.3233/jad-132528 · Cited by 177
Self-citationRamirez, J., Berezuk, C., McNeely, A. A., Gao, F., McLaurin, J., & Black, S. E. (2016) · Cellular and Molecular Neurobiology · doi:10.1007/s10571-016-0343-6 · Cited by 161
Self-citationCaligiuri, M. E., Perrotta, P., Augimeri, A., Rocca, F., Quattrone, A., & Cherubini, A. (2015) · Neuroinformatics · doi:10.1007/s12021-015-9260-y · Cited by 151
“2006) and significant ceiling/floor effects (van Straaten et al. 2006; Gao et al. 2011), therefore leading to inconsistencies between WMH studies.”
Backgroundvan den Berg, E., Geerlings, M. I., Biessels, G. J., Nederkoorn, P. J., & Kloppenborg, R. P. (2018) · Journal of Alzheimer’s Disease · doi:10.3233/jad-170573 · Cited by 132
Metadata
- Authors
- Gao, F.-Q., Swartz, R. H., Scheltens, P., Leibovitch, F. S., Kiss, A., Honjo, K., & Black, S. E.
- Affiliations
- LC Campbell Cognitive Neurology Research Unit, Heart and Stroke Foundation Centre for Stroke Recovery, University of Toronto, Toronto, ON, Canada
- University of Toronto (CA)
- Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
- Venue
- Journal of Alzheimer's Disease
- Publisher
- SAGE Publications
- Published
- 2011-10-04
- Volume
- 26
- Issue
- s3
- Pages
- 379-388
- ISSN
- 1387-2877 (ISSN-L)
- 1875-8908
- OpenAlex
- W1534377073
- Cited by
- 50
- References
- 36
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 3 · 2023: 1 · 2022: 4 · 2021: 1 · 2020: 3 · 2019: 5 · 2018: 2 · 2017: 6 · 2016: 4 · 2015: 4 · 2014: 7 · 2013: 4 · 2012: 2
- FWCI
- 3.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Alzheimer s Disease (publishedVersion)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Canadian Institutes of Health Research (13129, MT13129)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Medicine › Clinical Neurology › Cerebrovascular and genetic disorders
- Life Sciences › Neuroscience › Neurology › Neurological Disease Mechanisms and Treatments
- Keywords
- white matter hyperintensities
- MeSH terms
- Aged, Aged, 80 and over, Aging, Alzheimer Disease, Analysis of Variance, Brain, Female, Humans, Magnetic Resonance Imaging, Male, Middle Aged, Nerve Fibers, Myelinated, Statistics, Nonparametric, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.