Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index; 7 of the 96 sources its claims cite were checked for support.

Misrepresentation and distortion of research in biomedical literature

Open access
Boutron, Isabelle, Ravaud, Philippe · 2018 · Proceedings of the National Academy of Sciences

Abstract

Publication in peer-reviewed journals is an essential step in the scientific process. However, publication is not simply the reporting of facts arising from a straightforward analysis thereof. Authors have broad latitude when writing their reports and may be tempted to consciously or unconsciously “spin” their study findings. Spin has been defined as a specific intentional or unintentional reporting that fails to faithfully reflect the nature and range of findings and that could affect the impression the results produce in readers. This article, based on a literature review, reports the various practices of spin from misreporting by “beautification” of methods to misreporting by misinterpreting the results. It provides data on the prevalence of some forms of spin in specific fields and the possible effects of some types of spin on readers’ interpretation and research dissemination. We also discuss why researchers would spin their reports and possible ways to avoid it.

Overview

CoChat Summary

TL;DR

This review/perspective describes “spin” in biomedical literature—misreporting methods, results, interpretation, and rhetoric—and summarizes evidence on its prevalence and impact. It argues spin is a detrimental research practice and proposes protocol registration, reporting guidelines, editorial/peer-review changes, and reward-system reform to reduce it.

Key findings

  • Spin is defined as reporting that fails to faithfully reflect the nature and range of findings and can affect readers’ impressions; practices include misreporting methods, misreporting results, misinterpretation, and rhetoric. For example, a survey of 2,235 reports of RCTs in Chinese medical journals found only about 7% met methodological criteria for authentic randomization, while 93% were falsely reported as RCTs.
  • Prevalence varies by field: in two-arm parallel-group RCTs with nonstatistically significant primary outcomes, more than half of abstract conclusions contained spin; in observational studies evaluating an intervention, spin was identified in more than 80% of abstract conclusions, most frequently causal language; diagnosis-accuracy studies showed spin in one-third of articles in high-impact journals; HIV noninferiority trials showed spin in two-thirds of inconclusive studies; and more than half of molecular diagnostic test reports overinterpreted clinical applicability.
  • Impact evidence includes an RCT of 300 corresponding authors/investigators: after reading an abstract with spin, readers were more likely to believe the treatment would be beneficial (mean difference 0.71, 95% CI 0.07–1.35, P = 0.030). Peer reviewers failed to identify spin in the abstract’s conclusion in 76% of reports, and media coverage of the statin controversy was associated with an 11% and 12% increase in the likelihood of existing users stopping treatment for primary and secondary prevention, respectively, potentially more than 2,000 extra cardiovascular events across the United Kingdom over 10 y.
  • Other reported numbers: positive words in PubMed abstracts increased 880% from 2% in 1974–1980 to 17.5% in 2014; an assessment of 20,642 published articles in 40 journals over 20 y found 3.8% contained questionable images, with the number increasing; editors estimated about 20% of accepted papers contained at least one figure not complying with accepted practices.

Methods

  • Design: literature review/perspective. The authors systematically searched MEDLINE via PubMed for articles on spin with an abstract, searching the entire database from 1966, with search date May 23, 2017; they also searched Google Scholar for articles citing key articles in the field.
  • Sample: the search retrieved 592 citations, of which 49 were relevant; the authors also relied on a personal collection of articles meeting eligibility criteria. One researcher screened titles and abstracts, retrieved full texts when appropriate, and extracted information on type of spin, prevalence, associated factors, impact on readers’ interpretation, and possible ways to reduce spin.
  • Analysis: narrative synthesis and classification of spin practices under misreporting methods, misreporting results, misinterpretation, and other types of spin, with reported prevalence and impact from included studies; scope was limited to biomedicine.

Limitations

  • The paper states that only a single researcher screened citations, abstracts, and full texts, so the authors cannot rule out missing some relevant reports.
  • The paper states that it reflects the authors’ knowledge and opinion informed by a literature review, and that its scope is limited to biomedicine; it also notes no systematic assessment of spin in systematic reviews and meta-analyses was identified, and no data exist on the prevalence of researchers using spin (though the authors suspect it is common).
  • Evident from the text: the search strategy relied on title terms and “has abstract,” plus Google Scholar citation searching, and the paper does not report a formal quantitative synthesis or risk-of-bias assessment.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1073/pnas.1710755115

Cites

91 of 91 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

6 Valid · 2 Not valid · 61 Not checked · 28 Own results and interpretations

43 more claims

Create a free account to see all 97 claims and to verify the 89 references still open.

See all claims — free account
  • Probably not a substantial claim. 36
  • It may state two separate claims as one. 28

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 91 references

Research works printed but not linked: 1

  1. JC Bailar, How to distort the scientific record without actually lying: Truth, and arts of science. Eur J Oncol 11, 217–224 (2006).

Cited by

See all 273

Metadata

Authors
Boutron, I., & Ravaud, P.
Affiliations
Inserm (FR)
Venue
Proceedings of the National Academy of Sciences
Published
2018-03-12
Volume
115
Issue
11
Pages
2613-2619
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W2793285640
Cited by
273
References
91
Citations by year
2026: 30 · 2025: 24 · 2024: 28 · 2023: 41 · 2022: 35 · 2021: 32 · 2020: 39 · 2019: 31 · 2018: 12
FWCI
40.38
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
biomedical literature, publication bias, research integrity, misinterpretation of results, research dissemination, peer review
MeSH terms
Humans, Literature, Publications, Peer Review, Research, Biomedical Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Misrepresentation and distortion of research in biomedical literature. https://app.cochat.ai/papers/10.1073/pnas.1710755115
The paper
Boutron, I., & Ravaud, P. (2018). Misrepresentation and distortion of research in biomedical literature. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1710755115

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.