CoChat

MRI visual rating scales in the diagnosis of dementia: evaluation in 184 post-mortem confirmed cases

Open access

The DOI matches its Crossref record; 59 of the 60 references it cites were found in a registry or an index.

Abstract

Accurately distinguishing between different degenerative dementias during life is challenging but increasingly important with the prospect of disease-modifying therapies. Molecular biomarkers of dementia pathology are becoming available, but are not widely used in clinical practice. Conversely, structural neuroimaging is recommended in the evaluation of cognitive impairment. Visual assessment remains the primary method of scan interpretation, but in the absence of a structured approach, diagnostically relevant information may be under-utilized. This definitive, multi-centre study uses post-mortem confirmed cases as the gold standard to: (i) assess the reliability of six visual rating scales; (ii) determine their associated pattern of atrophy; (iii) compare their diagnostic value with expert scan assessment; and (iv) assess the accuracy of a machine learning approach based on multiple rating scales to predict underlying pathology. The study includes T1-weighted images acquired in three European centres from 184 individuals with histopathologically confirmed dementia (101 patients with Alzheimer's disease, 28 patients with dementia with Lewy bodies, 55 patients with frontotemporal lobar degeneration), and scans from 73 healthy controls. Six visual rating scales (medial temporal, posterior, anterior temporal, orbito-frontal, anterior cingulate and fronto-insula) were applied to 257 scans (two raters), and to a subset of 80 scans (three raters). Six experts also provided a diagnosis based on unstructured assessment of the 80-scan subset. The reliability and time taken to apply each scale was evaluated. Voxel-based morphometry was used to explore the relationship between each rating scale and the pattern of grey matter volume loss. Additionally, the performance of each scale to predict dementia pathology both individually and in combination was evaluated using a support vector classifier, which was compared with expert scan assessment to estimate clinical value. Reliability of scan assessment was generally good (intraclass correlation coefficient > 0.7), and average time to apply all six scales was <3 min. There was a very close association between the pattern of grey matter loss and the regions of interest each scale was designed to assess. Using automated classification based on all six rating scales, the accuracy (estimated using the area under the receiver-operator curves) for distinguishing each pathological group from controls ranged from 0.86-0.97; and from one another, 0.75-0.92. These results were substantially better than the accuracy of any single scale, at least as good as expert reads, and comparable to previous studies using molecular biomarkers. Visual rating scores from magnetic resonance images routinely acquired as part of the investigation of dementias, offer a practical, inexpensive means of improving diagnostic accuracy.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/brain/aww005

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Figures

Graphical abstract Distinguishing between the degenerative dementias during life can be challenging. Using histopathologically confirmed cases for comparison, Harper et al. evaluate six visual rating scales for use with routinely acquired structural MRI. Automated classification based on all six scales provides a practical, fast and inexpensive means of improving diagnostic certainty.
Graphical abstract Distinguishing between the degenerative dementias during life can be challenging. Using histopathologically confirmed cases for comparison, Harper et al. evaluate six visual rating scales for use with routinely acquired structural MRI. Automated classification based on all six scales provides a practical, fast and inexpensive means of improving diagnostic certainty.CC BY · PubMed Central
Figure 1 Correlation between grey matter volume and visual rating score. Voxel-based morphometry images demonstrating negative partial correlation between grey matter volume and each visual rating scale, adjusted for the other scales (Y = β AC X AC + β OF X OF + β AT X AT + β FI X FI + β MTA X MTA + β PA X PA + β Age X Age + β Gender X Gender + β TIV X TIV + β 1T X 1T + β 3T X 3T + β London X London + β Amsterdam X Amsterdam + μ + e). In all images statistical significance of correlations was corrected for multiple comparisons (family wise error rate P < 0.05). The corresponding visual rating scale reference images are displayed adjacent to each statistical parametric map. R indicates the right hemisphere.
Figure 1 Correlation between grey matter volume and visual rating score. Voxel-based morphometry images demonstrating negative partial correlation between grey matter volume and each visual rating scale, adjusted for the other scales (Y = β AC X AC + β OF X OF + β AT X AT + β FI X FI + β MTA X MTA + β PA X PA + β Age X Age + β Gender X Gender + β TIV X TIV + β 1T X 1T + β 3T X 3T + β London X London + β Amsterdam X Amsterdam + μ + e). In all images statistical significance of correlations was corrected for multiple comparisons (family wise error rate P < 0.05). The corresponding visual rating scale reference images are displayed adjacent to each statistical parametric map. R indicates the right hemisphere.CC BY · PubMed Central
Figure 2 Receiver operator characteristic curves of support vector machine performance. Receiver operator characteristic plots of SVC performance for prediction of primary pathology groups. AUC values with 95% confidence intervals are displayed for each classifier. AD = Alzheimer’s disease.
Figure 2 Receiver operator characteristic curves of support vector machine performance. Receiver operator characteristic plots of SVC performance for prediction of primary pathology groups. AUC values with 95% confidence intervals are displayed for each classifier. AD = Alzheimer’s disease.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 1

  1. Fumagalli, 2014, 9th International Conference on Frontotemporal Dementias P.252 Development of a visual rating scale for atrophy of the anterior cingulate, insula and frontal lobes, Am J Neurodegener Dis, 3, 1

Cited by

See all 264

Metadata

Authors
Harper, L., Fumagalli, G. G., Barkhof, F., Scheltens, P., O’Brien, J. T., Bouwman, F., Burton, E. J., Rohrer, J. D., Fox, N. C., Ridgway, G. R., & Schott, J. M.
Affiliations
  • UCL Queen Square Institute of Neurology (GB)
  • University of Milan (IT)
  • Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
  • Newcastle Hospitals - Campus for Ageing and Vitality (GB)
  • Wellcome Centre for Human Neuroimaging (GB)
Corresponding author
Schott, Jonathan M.
Venue
Brain
Published
2016-03-01
Volume
139
Issue
4
Pages
1211-1225
ISSN
  • 0006-8950 (ISSN-L)
  • 1460-2156
OpenAlex
W2289713178
Cited by
264
References
60
Citations by year
2026: 15 · 2025: 29 · 2024: 30 · 2023: 21 · 2022: 28 · 2021: 33 · 2020: 34 · 2019: 33 · 2018: 16 · 2017: 18 · 2016: 7
FWCI
21.91
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Brain (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Pure Amsterdam UMC (publishedVersion, other-oa)
  • Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
  • Institutional Research Information System (Università degli Studi di Trento) (submittedVersion, cc-by)
  • UCL Discovery (University College London) (submittedVersion)
  • HighWire Press Open Archive (submittedVersion)
  • Apollo (University of Cambridge) (submittedVersion, cc-by)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
  • Newcastle University ePrints (Newcastle Univesity) (cc-by)
Funders
  • National Institute for Health and Care Research (NF-SI-0513-10134, NF-SI-0508-10123, CL-2012-18-010)
  • Medical Research Council (MR/J014257/2, MR/M008525/1)
  • Engineering and Physical Sciences Research Council (EP/J020990/1)
Topics
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Alzheimer's disease research and treatments
Keywords
dementia diagnosis, Alzheimer's disease, dementia with Lewy bodies, frontotemporal lobar degeneration, gray matter atrophy, T1-weighted imaging, rating scale reliability, machine learning classification, support vector classifier, postmortem histopathology, structural neuroimaging, disease-modifying therapy, molecular biomarkers, voxel-based morphometry
MeSH terms
Aged, Aged, 80 and over, Alzheimer Disease, Autopsy, Cerebral Cortex, Dementia, Female, Humans, Magnetic Resonance Imaging, Male, Middle Aged, Reproducibility of Results, Lewy Body Disease, Frontotemporal Lobar Degeneration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.