CoChat

Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

Abstract

PURPOSE: To estimate the frequency of distorted presentation and overinterpretation of results in diagnostic accuracy studies. MATERIALS AND METHODS: MEDLINE was searched for diagnostic accuracy studies published between January and June 2010 in journals with an impact factor of 4 or higher. Articles included were primary studies of the accuracy of one or more tests in which the results were compared with a clinical reference standard. Two authors scored each article independently by using a pretested data-extraction form to identify actual overinterpretation and practices that facilitate overinterpretation, such as incomplete reporting of study methods or the use of inappropriate methods (potential overinterpretation). The frequency of overinterpretation was estimated in all studies and in a subgroup of imaging studies. RESULTS: Of the 126 articles, 39 (31%; 95% confidence interval [CI]: 23, 39) contained a form of actual overinterpretation, including 29 (23%; 95% CI: 16, 30) with an overly optimistic abstract, 10 (8%; 96% CI: 3%, 13%) with a discrepancy between the study aim and conclusion, and eight with conclusions based on selected subgroups. In our analysis of potential overinterpretation, authors of 89% (95% CI: 83%, 94%) of the studies did not include a sample size calculation, 88% (95% CI: 82%, 94%) did not state a test hypothesis, and 57% (95% CI: 48%, 66%) did not report CIs of accuracy measurements. In 43% (95% CI: 34%, 52%) of studies, authors were unclear about the intended role of the test, and in 3% (95% CI: 0%, 6%) they used inappropriate statistical tests. A subgroup analysis of imaging studies showed 16 (30%; 95% CI: 17%, 43%) and 53 (100%; 95% CI: 92%, 100%) contained forms of actual and potential overinterpretation, respectively. CONCLUSION: Overinterpretation and misreporting of results in diagnostic accuracy studies is frequent in journals with high impact factors. SUPPLEMENTAL MATERIAL: http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.12120527/-/DC1.

Overview

Integrity signals

Registry

Crossref · 10.1148/radiol.12120527

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 45 references

Research works printed but not linked: 2

  1. Fletcher RH, 2007, Med Law, 26, 511
  2. Habbema JDF, 2002, The evidence base of clinical diagnosis, 117

Cited by

See all 177

Metadata

Authors
Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G.
Affiliations
  • Amsterdam UMC Location University of Amsterdam (NL)
  • University Medical Center Utrecht (NL)
  • University of Amsterdam (NL)
Venue
Radiology
Published
2013-05
Volume
267
Issue
2
Pages
581-588
ISSN
  • 0033-8419 (ISSN-L)
  • 1527-1315
OpenAlex
W2148203699
Cited by
158
References
44
Citations by year
2026: 9 · 2025: 5 · 2024: 8 · 2023: 9 · 2022: 13 · 2021: 14 · 2020: 13 · 2019: 21 · 2018: 10 · 2017: 14 · 2016: 8 · 2015: 14 · 2014: 14 · 2013: 5
FWCI
15.06
Type
journal article
Language
en
Open access
closed
Locations
  • Radiology (publishedVersion)
  • PubMed (publishedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
  • Pure Amsterdam UMC (submittedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Keywords
overinterpretation, misreporting, diagnostic accuracy studies, research integrity, reporting quality, sample size determination, subgroup analysis, image studies, high-impact journals, publication bias, selective reporting, hypothesis testing, research misconduct
MeSH terms
Diagnostic Imaging, Diagnostic Tests, Routine, Humans, Periodicals as Topic, Publishing, Research Design, Confidence Intervals, Guidelines as Topic, Journalism, Medical, Guideline Adherence, Journal Impact Factor

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”. https://app.cochat.ai/papers/10.1148/radiol.12120527
The paper
Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G. (2013). Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”. Radiology. https://doi.org/10.1148/radiol.12120527

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.