Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
PURPOSE: To estimate the frequency of distorted presentation and overinterpretation of results in diagnostic accuracy studies. MATERIALS AND METHODS: MEDLINE was searched for diagnostic accuracy studies published between January and June 2010 in journals with an impact factor of 4 or higher. Articles included were primary studies of the accuracy of one or more tests in which the results were compared with a clinical reference standard. Two authors scored each article independently by using a pretested data-extraction form to identify actual overinterpretation and practices that facilitate overinterpretation, such as incomplete reporting of study methods or the use of inappropriate methods (potential overinterpretation). The frequency of overinterpretation was estimated in all studies and in a subgroup of imaging studies. RESULTS: Of the 126 articles, 39 (31%; 95% confidence interval [CI]: 23, 39) contained a form of actual overinterpretation, including 29 (23%; 95% CI: 16, 30) with an overly optimistic abstract, 10 (8%; 96% CI: 3%, 13%) with a discrepancy between the study aim and conclusion, and eight with conclusions based on selected subgroups. In our analysis of potential overinterpretation, authors of 89% (95% CI: 83%, 94%) of the studies did not include a sample size calculation, 88% (95% CI: 82%, 94%) did not state a test hypothesis, and 57% (95% CI: 48%, 66%) did not report CIs of accuracy measurements. In 43% (95% CI: 34%, 52%) of studies, authors were unclear about the intended role of the test, and in 3% (95% CI: 0%, 6%) they used inappropriate statistical tests. A subgroup analysis of imaging studies showed 16 (30%; 95% CI: 17%, 43%) and 53 (100%; 95% CI: 92%, 100%) contained forms of actual and potential overinterpretation, respectively. CONCLUSION: Overinterpretation and misreporting of results in diagnostic accuracy studies is frequent in journals with high impact factors. SUPPLEMENTAL MATERIAL: http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.12120527/-/DC1.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Sometimes study results are selectively reported, and other times researchers cannot resist unwarranted optimism in interpretation of their findings.2 3 4”
From STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies (2015) · cites this paper as [3]
In the citing paper
“Sometimes study results are selectively reported, and other times researchers cannot resist unwarranted optimism in interpretation of their findings.2 3 4”
From STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies (2015) · cites this paper as [3]
In the citing paper
“There are several ways to spin a report (4, 6, 8–10).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [8]
In the citing paper
“Specific classifications of spin have been developed for different study designs and contexts [randomized controlled trials with nonstatistically significant results (4), observational studies evaluating an intervention (10), diagnostic accuracy studies (8), systematic reviews (9)].”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [8]
In the citing paper
“In diagnosis-accuracy studies, spin was identified in one-third of the articles published in high-impact factor journals (8), and in the field of molecular diagnostic tests, more than half of the reports overinterpreted the clinical applicability of the findings (39).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [8]
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL
CLOPPER, C. J., & PEARSON, E. S. (1934) · Biometrika · doi:10.1093/biomet/26.4.404 · Cited by 5,003 · cited 3×
“Overly optimistic abstract 29 (23) [16–30] 13 (25) [13–37]”
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 4×
“Overly optimistic abstract 29 (23) [16–30] 13 (25) [13–37]”
BackgroundInfluentialTowards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative.
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00010 · Cited by 3,219
Statistics in Medicine — Reporting of Subgroup Analyses in Clinical Trials
Wang, R., Lagakos, S. W., Ware, J. H., Hunter, D. J., & Drazen, J. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmsr077003 · Cited by 1,445 · cited 7×
“Selective reporting of results in abstract 7 (6) [2–10] 4 (8) [3–20]”
BackgroundInfluentialThe STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Moher, D., Rennie, D., de Vet, H. C. W., & Lijmer, J. G. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00012-w1 · Cited by 1,124 · cited 4×
“Selective reporting of results in abstract 7 (6) [2–10] 4 (8) [3–20]”
BackgroundInfluentialBoutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842 · cited 4×
“Longitudinal (with follow up) 17 (13) [7, 19]”
BackgroundInfluentialPepe, M. S., Feng, Z., Janes, H., Bossuyt, P. M., & Potter, J. D. (2008) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djn326 · Cited by 717 · cited 7×
“Selective reporting of results in abstract 7 (6) [2–10] 4 (8) [3–20]”
BackgroundInfluentialSelf-citationUnderreporting Research Is Scientific Misconduct
Chalmers, L. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100121018 · Cited by 551 · cited 4×
“Overly optimistic abstract 29 (23) [16–30] 13 (25) [13–37]”
BackgroundInfluentialThe Challenge of Subgroup Analyses — Reporting without Distorting
Lagakos, S. W. (2006) · New England Journal of Medicine · doi:10.1056/nejmp068070 · Cited by 504 · cited 5×
“Selective reporting of results in abstract 7 (6) [2–10] 4 (8) [3–20]”
BackgroundInfluential
Research works printed but not linked: 2
- Fletcher RH, 2007, Med Law, 26, 511
- Habbema JDF, 2002, The evidence base of clinical diagnosis, 117
Cited by
STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660
Self-citationSTARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration
Cohen, J. F., Korevaar, D. A., Altman, D. G., Bruns, D. E., Gatsonis, C. A., Hooft, L., Irwig, L., Levine, D., Reitsma, J. B., de Vet, H. C. W., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012799 · Cited by 2,570
“nostic test accuracy studies published in high-impact journals in 2010 revealed that 88% did not state a clear hypothesis.(22) In the first example, the authors’ objective was to evaluate the accuracy of three diagnostic strategies; their spe-”
Self-citationSTARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · Radiology · doi:10.1148/radiol.2015151516 · Cited by 1,337
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Self-citationSTARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · Clinical Chemistry · doi:10.1373/clinchem.2015.246280 · Cited by 984
“interpretation of their findings [2-4].”
Self-citation
Metadata
- Authors
- Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G.
- Affiliations
- Amsterdam UMC Location University of Amsterdam (NL)
- University Medical Center Utrecht (NL)
- University of Amsterdam (NL)
- Venue
- Radiology
- Published
- 2013-05
- Volume
- 267
- Issue
- 2
- Pages
- 581-588
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2148203699
- Cited by
- 158
- References
- 44
- Citations by year
- 2026: 9 · 2025: 5 · 2024: 8 · 2023: 9 · 2022: 13 · 2021: 14 · 2020: 13 · 2019: 21 · 2018: 10 · 2017: 14 · 2016: 8 · 2015: 14 · 2014: 14 · 2013: 5
- FWCI
- 15.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Pure Amsterdam UMC (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- overinterpretation, misreporting, diagnostic accuracy studies, research integrity, reporting quality, sample size determination, subgroup analysis, image studies, high-impact journals, publication bias, selective reporting, hypothesis testing, research misconduct
- MeSH terms
- Diagnostic Imaging, Diagnostic Tests, Routine, Humans, Periodicals as Topic, Publishing, Research Design, Confidence Intervals, Guidelines as Topic, Journalism, Medical, Guideline Adherence, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”. https://app.cochat.ai/papers/10.1148/radiol.12120527
- The paper
- Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G. (2013). Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”. Radiology. https://doi.org/10.1148/radiol.12120527
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.