CoChat

Reply: A plea for confidence intervals and consideration of generalizability in diagnostic studies

Frost, C., Kallis, C. · 2008 · Brain
Cited by 13

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Abstract

Sir, We read with interest the recent article by Klöppel and colleagues (2008) on automatic classification of MR scans in Alzheimer's disease and the coverage on the BBC's website. In particular, we were concerned that the claim on the website that ‘computers “spot Alzheimer's fast” ’ cannot be justified on the basis of this research. Although the authors do not make this claim in their paper, in our opinion they do not pay enough attention to two limitations of their work, which may have encouraged the media over-interpretation of their findings. The first limitation of their work is the relatively small sample size. It has been recognized for many years that confidence intervals should be reported in medical research (Altman et al., 1983; Gardner and Altman, 1986). Indeed, some journals recommend that these be included in publications in preference to the rather over-used P-values. We were disappointed that they were not reported here as their inclusion would have been revealing. For example in Group 1 (confirmed Alzheimer's disease cases from the US versus controls) although the estimated sensitivity and specificity are both 95%, an exact 95% confidence interval on each of these extends from 75.1% to 99.9%. We believe that a balanced interpretation of the authors' findings would include reference to the fact that their results are consistent with somewhat lower (and higher) sensitivities and specificities.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/brain/awn090

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 13

Metadata

Authors
Frost, C., & Kallis, C.
Venue
Brain
Published
2008-05-21
Volume
132
Issue
4
Pages
e103-e103
ISSN
  • 0006-8950 (ISSN-L)
  • 1460-2156
OpenAlex
W2052566062
Cited by
13
References
1
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.