MRI visual rating scales in the diagnosis of dementia: evaluation in 184 post-mortem confirmed cases
Open accessThe DOI matches its Crossref record; 59 of the 60 references it cites were found in a registry or an index.
Abstract
Accurately distinguishing between different degenerative dementias during life is challenging but increasingly important with the prospect of disease-modifying therapies. Molecular biomarkers of dementia pathology are becoming available, but are not widely used in clinical practice. Conversely, structural neuroimaging is recommended in the evaluation of cognitive impairment. Visual assessment remains the primary method of scan interpretation, but in the absence of a structured approach, diagnostically relevant information may be under-utilized. This definitive, multi-centre study uses post-mortem confirmed cases as the gold standard to: (i) assess the reliability of six visual rating scales; (ii) determine their associated pattern of atrophy; (iii) compare their diagnostic value with expert scan assessment; and (iv) assess the accuracy of a machine learning approach based on multiple rating scales to predict underlying pathology. The study includes T1-weighted images acquired in three European centres from 184 individuals with histopathologically confirmed dementia (101 patients with Alzheimer's disease, 28 patients with dementia with Lewy bodies, 55 patients with frontotemporal lobar degeneration), and scans from 73 healthy controls. Six visual rating scales (medial temporal, posterior, anterior temporal, orbito-frontal, anterior cingulate and fronto-insula) were applied to 257 scans (two raters), and to a subset of 80 scans (three raters). Six experts also provided a diagnosis based on unstructured assessment of the 80-scan subset. The reliability and time taken to apply each scale was evaluated. Voxel-based morphometry was used to explore the relationship between each rating scale and the pattern of grey matter volume loss. Additionally, the performance of each scale to predict dementia pathology both individually and in combination was evaluated using a support vector classifier, which was compared with expert scan assessment to estimate clinical value. Reliability of scan assessment was generally good (intraclass correlation coefficient > 0.7), and average time to apply all six scales was <3 min. There was a very close association between the pattern of grey matter loss and the regions of interest each scale was designed to assess. Using automated classification based on all six rating scales, the accuracy (estimated using the area under the receiver-operator curves) for distinguishing each pathological group from controls ranged from 0.86-0.97; and from one another, 0.75-0.92. These results were substantially better than the accuracy of any single scale, at least as good as expert reads, and comparable to previous studies using molecular biomarkers. Visual rating scores from magnetic resonance images routinely acquired as part of the investigation of dementias, offer a practical, inexpensive means of improving diagnostic accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Visual assessment of scans using rating scales are reliable and offer diagnostic accuracy equivalent or better to unstructured scan evaluation by expert raters with an area under the curve (AUC) ranging from 0.67 to 0.97 for the differential diagnosis of different types of dementia [11, 13].”
From The use of neuroimaging techniques in the early and differential diagnosis of dementia (2023) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · cited 2×
“SVC processing and analysis was performed using the Python libraries SciPy 0.14.0 (Jones et al., 2001) and Scikit-Learn 0.15.2 (Pedregosa et al., 2011).”
MethodInfluentialIntraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532 · cited 1×
“As described by Shrout and Fleiss (1979), there are several forms of ICC, with the appropriate form determined by the underlying statistical model and the intended application of the reliability results.”
BackgroundData Structures for Statistical Computing in Python
McKinney, W. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-00a · Cited by 11,032 · cited 2×
“The time taken by each rater to apply the visual rating protocol to each image was automatically recorded to estimate the feasibility of implementing such a protocol in clinical practice.”
MethodInfluentialCortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910 · cited 8×
“This large, multi-centre study of pathologically proven dementias demonstrates that visual rating scales from routinely acquired structural MRIs are fairly reliable and highly correlated with cerebral atrophy in brain regions vulnerable to dementia pathology.”
MethodInfluentialThe NumPy Array: A Structure for Efficient Numerical Computation
van der Walt, S., Colbert, S. C., & Varoquaux, G. (2011) · Computing in Science & Engineering · doi:10.1109/mcse.2011.37 · Cited by 9,381 · cited 1×
“All data processing and analyses were performed using Python libraries NumPy 1.8.1 (van der Walt et al., 2011), SciPy 0.14.0 (Jones et al., 2001) and Pandas 0.14.1 (McKinney, 2010) on Python 2.7.6 – 64-bit.”
MethodInfluentialA fast diffeomorphic image registration algorithm
Ashburner, J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.007 · Cited by 8,122 · cited 2×
“A group average tissue probability map was generated through iterative alignment of the initial segmentations to an evolving estimate of their group-wise average using the Dartel toolbox (Ashburner, 2007; Ashburner and Friston, 2009).”
MethodAshburner, J., & Friston, K. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.018 · Cited by 7,507 · cited 2×
“Cognitively normal control subjects (n = 73) were also included in the study.”
InfluentialSensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia
Rascovsky, K., Hodges, J. R., Knopman, D., Mendez, M. F., Kramer, J. H., Neuhaus, J., van Swieten, J. C., Seelaar, H., Dopper, E. G. P., Onyike, C. U., et al. (2011) · Brain · doi:10.1093/brain/awr179 · Cited by 5,221 · cited 2×
“By contrast, structural neuroimaging is widely available and recommended as part of the clinical evaluation in all patients with suspected dementia [National Collaborating Centre for Mental Health (UK), 2006] and in the diagnostic criteria for a number of different dementias (Hort et al., 2010; Gorno-Tempini et al., 2…”
BackgroundSelf-citationClassification of primary progressive aphasia and its variants
Gorno-Tempini, M. L., Hillis, A. E., Weintraub, S., Kertesz, A., Mendez, M., Cappa, S. F., Ogar, J. M., Rohrer, J. D., Black, S., Boeve, B. F., et al. (2011) · Neurology · doi:10.1212/wnl.0b013e31821103e6 · Cited by 5,141 · cited 2×
“By contrast, structural neuroimaging is widely available and recommended as part of the clinical evaluation in all patients with suspected dementia [National Collaborating Centre for Mental Health (UK), 2006] and in the diagnostic criteria for a number of different dementias (Hort et al., 2010; Gorno-Tempini et al., 2…”
BackgroundSelf-citationDiagnosis and management of dementia with Lewy bodies: Third report of the DLB consortium
McKeith, I. G., Dickson, D. W., Lowe, J., Emre, M., O'Brien, J. T., Feldman, H., Cummings, J., Duda, J. E., Lippa, C., Perry, E. K., et al. (2005) · Neurology · doi:10.1212/01.wnl.0000187889.17253.b1 · Cited by 5,069
Self-citation
Research works printed but not linked: 1
- Fumagalli, 2014, 9th International Conference on Frontotemporal Dementias P.252 Development of a visual rating scale for atrophy of the anterior cingulate, insula and frontal lobes, Am J Neurodegener Dis, 3, 1
Cited by
Diagnosis and management of dementia with Lewy bodies: Fourth consensus report of the DLB Consortium
McKeith, I. G., Boeve, B. F., Dickson, D. W., Halliday, G., Taylor, J.-P., Weintraub, D., Aarsland, D., Galvin, J., Attems, J., Ballard, C. G., et al. (2017) · Neurology · doi:10.1212/wnl.0000000000004058 · Cited by 4,476
Self-citationDiagnosis and Management of Dementia: Review
Arvanitakis, Z., Shah, R. C., & Bennett, D. A. (2019) · JAMA · doi:10.1001/jama.2019.4782 · Cited by 1,403
Topiwala, A., Allan, C. L., Valkanova, V., Zsoldos, E., Filippini, N., Sexton, C., Mahmood, A., Fooks, P., Singh-Manoux, A., Mackay, C. E., et al. (2017) · BMJ · doi:10.1136/bmj.j2353 · Cited by 455
Amsterdam Dementia Cohort: Performing Research to Optimize Care
van der Flier, W. M., & Scheltens, P. (2018) · Journal of Alzheimer’s Disease · doi:10.3233/jad-170850 · Cited by 390
“performing scale in diagnosing AD [13].”
Self-citationDementia with Lewy bodies: an update and outlook
Outeiro, T. F., Koss, D. J., Erskine, D., Walker, L., Kurzawa-Akanbi, M., Burn, D., Donaghy, P., Morris, C., Taylor, J.-P., Thomas, A., et al. (2019) · Molecular Neurodegeneration · doi:10.1186/s13024-019-0306-8 · Cited by 381
“DLB is associated with less severe medial temporal lobe atrophy on structural imaging when compared to AD [56].”
Background
Metadata
- Authors
- Harper, L., Fumagalli, G. G., Barkhof, F., Scheltens, P., O’Brien, J. T., Bouwman, F., Burton, E. J., Rohrer, J. D., Fox, N. C., Ridgway, G. R., & Schott, J. M.
- Affiliations
- UCL Queen Square Institute of Neurology (GB)
- University of Milan (IT)
- Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
- Newcastle Hospitals - Campus for Ageing and Vitality (GB)
- Wellcome Centre for Human Neuroimaging (GB)
- Corresponding author
- Schott, Jonathan M.
- ORCID
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-03-01
- Volume
- 139
- Issue
- 4
- Pages
- 1211-1225
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- PMC
- PMC4806219
- OpenAlex
- W2289713178
- Cited by
- 264
- References
- 60
- Citations by year
- 2026: 15 · 2025: 29 · 2024: 30 · 2023: 21 · 2022: 28 · 2021: 33 · 2020: 34 · 2019: 33 · 2018: 16 · 2017: 18 · 2016: 7
- FWCI
- 21.91
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Brain (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- Institutional Research Information System (Università degli Studi di Trento) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity) (cc-by)
- Funders
- National Institute for Health and Care Research (NF-SI-0513-10134, NF-SI-0508-10123, CL-2012-18-010)
- Medical Research Council (MR/J014257/2, MR/M008525/1)
- Engineering and Physical Sciences Research Council (EP/J020990/1)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Alzheimer's disease research and treatments
- Keywords
- dementia diagnosis, Alzheimer's disease, dementia with Lewy bodies, frontotemporal lobar degeneration, gray matter atrophy, T1-weighted imaging, rating scale reliability, machine learning classification, support vector classifier, postmortem histopathology, structural neuroimaging, disease-modifying therapy, molecular biomarkers, voxel-based morphometry
- MeSH terms
- Aged, Aged, 80 and over, Alzheimer Disease, Autopsy, Cerebral Cortex, Dementia, Female, Humans, Magnetic Resonance Imaging, Male, Middle Aged, Reproducibility of Results, Lewy Body Disease, Frontotemporal Lobar Degeneration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: MRI visual rating scales in the diagnosis of dementia: evaluation in 184 post-mortem confirmed cases. https://app.cochat.ai/papers/10.1093/brain/aww005
- The paper
- Harper, L., Fumagalli, G. G., Barkhof, F., Scheltens, P., O’Brien, J. T., Bouwman, F., Burton, E. J., Rohrer, J. D., Fox, N. C., Ridgway, G. R., & Schott, J. M. (2016). MRI visual rating scales in the diagnosis of dementia: evaluation in 184 post-mortem confirmed cases. Brain. https://doi.org/10.1093/brain/aww005
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.