CoChat

Accuracy of dementia diagnosis: a direct comparison between radiologists and a computerized method

Open access

The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.

Abstract

There has been recent interest in the application of machine learning techniques to neuroimaging-based diagnosis. These methods promise fully automated, standard PC-based clinical decisions, unbiased by variable radiological expertise. We recently used support vector machines (SVMs) to separate sporadic Alzheimer's disease from normal ageing and from fronto-temporal lobar degeneration (FTLD). In this study, we compare the results to those obtained by radiologists. A binary diagnostic classification was made by six radiologists with different levels of experience on the same scans and information that had been previously analysed with SVM. SVMs correctly classified 95% (sensitivity/specificity: 95/95) of sporadic Alzheimer's disease and controls into their respective groups. Radiologists correctly classified 65-95% (median 89%; sensitivity/specificity: 88/90) of scans. SVM correctly classified another set of sporadic Alzheimer's disease in 93% (sensitivity/specificity: 100/86) of cases, whereas radiologists ranged between 80% and 90% (median 83%; sensitivity/specificity: 80/85). SVMs were better at separating patients with sporadic Alzheimer's disease from those with FTLD (SVM 89%; sensitivity/specificity: 83/95; compared to radiological range from 63% to 83%; median 71%; sensitivity/specificity: 64/76). Radiologists were always accurate when they reported a high degree of diagnostic confidence. The results show that well-trained neuroradiologists classify typical Alzheimer's disease-associated scans comparable to SVMs. However, SVMs require no expert knowledge and trained SVMs can readily be exchanged between centres for use in diagnostic classification. These results are encouraging and indicate a role for computerized diagnostic methods in clinical practice.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/brain/awn239

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Illustration of performance. Positions are jittered to indicate overlap. Grey error bars display 95% confidence intervals for SVM accuracy. The fourth column illustrates the performance when sets 1 and 3 are combined. Note the shrinking CIs. sAD = sporadic Alzheimer's Disease.
Fig. 1 Illustration of performance. Positions are jittered to indicate overlap. Grey error bars display 95% confidence intervals for SVM accuracy. The fourth column illustrates the performance when sets 1 and 3 are combined. Note the shrinking CIs. sAD = sporadic Alzheimer's Disease.CC BY-NC · PubMed Central
Fig. 2 Illustration of the correlation between experience (given as the percentage of brain scans out of all scans in daily routine practice) and accuracy. sAD = sporadic Alzheimer's Disease.
Fig. 2 Illustration of the correlation between experience (given as the percentage of brain scans out of all scans in daily routine practice) and accuracy. sAD = sporadic Alzheimer's Disease.CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 30 references

Research works printed but not linked: 1

  1. 2008, Neurobiology of aging, 29, 514, 10.1016/j.neurobiolaging.2006.11.010 · DOI · Paper page

Cited by

Items 301–302 of 302

Metadata

Authors
Kloppel, S., Stonnington, C. M., Barnes, J., Chen, F., Chu, C., Good, C. D., Mader, I., Mitchell, L. A., Patel, A. C., Roberts, C. C., Fox, N. C., Jack, C. R., Ashburner, J., & Frackowiak, R. S. J.
Affiliations
Mayo Clinic (US)
Venue
Brain
Published
2008-06-21
Volume
131
Issue
11
Pages
2969-2974
ISSN
  • 0006-8950 (ISSN-L)
  • 1460-2156
OpenAlex
W2105037799
Cited by
271
References
30
Citations by year
2026: 7 · 2025: 8 · 2024: 10 · 2023: 22 · 2022: 11 · 2021: 16 · 2020: 12 · 2019: 21 · 2018: 15 · 2017: 8 · 2016: 15 · 2015: 17 · 2014: 13 · 2013: 20 · 2012: 23
FWCI
11.91
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • Brain (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • Pure Amsterdam UMC (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
Funders
  • Wellcome Trust (075696 2/04/2, 075696)
  • National Institute for Health and Care Research
  • National Institute on Aging (P50‐AG16574, U01AG06786, U01AG006786, AG-11378, P50AG016574)
Topics
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
dementia diagnosis, sporadic Alzheimer's disease, support vector machine, computer-aided diagnosis, neuroimaging classification, sensitivity and specificity
MeSH terms
Aged, Aged, 80 and over, Aging, Alzheimer Disease, Brain, Clinical Competence, Dementia, Diagnosis, Differential, Epidemiologic Methods, Female, Humans, Image Interpretation, Computer-Assisted, Magnetic Resonance Imaging, Male, Middle Aged, Pattern Recognition, Automated

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.