Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Spin represents specific reporting strategies, either intentional or unintentional, to convince the reader that the beneficial effect of the experimental intervention in terms of efficacy and safety is greater than that shown by the results. The objectives of this study were to 1) develop a classification of spin specific to non-randomized studies assessing an intervention and 2) estimate the prevalence of spin in abstracts of reports of such studies. METHODS: In a first step, we developed a specific classification of spin for non-randomized studies by a literature review and pilot study. In a second step, 2 researchers trained in the field of methodology evaluated the prevalence of spin in the abstract of all non-randomized studies assessing an intervention published in the BioMed Central Medical Series journals between January 1, 2011 and December 31, 2013. All disagreements were resolved by consensus. We also determined whether the level of spin in abstract conclusions was high (spin reported without uncertainty or recommendations for further trials), moderate (spin reported with some uncertainty or recommendations for further trials) or low (spin reported with uncertainty and recommendations for further trials). RESULTS: Among the 128 assessed articles assessed, 107 (84%) had at least one example of spin in their abstract. The most prevalent strategy of spin was the use of causal language, identified in 68 (53%) abstracts. Other frequent strategies were linguistic spin, inadequate implications for clinical practice, and lack of focus on harm, identified in 33 (26%), 25 (20%), and 34 (27%) abstracts respectively. Abstract conclusions of 61 (48%) articles featured a high level of spin. CONCLUSION: Abstract of reports of non-randomized studies assessing an intervention frequently includes spin. Efforts to reduce the prevalence of spin in abstract for such studies are needed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, their capacity to detect errors [10, 11], identify deficiencies in reporting [12] and spin [13] has been found lacking.”
From Tools used to assess the quality of peer review reports: A methodological systematic review (2019) · cites this paper as [13]
Experimental — accuracy not yet measuredIn the citing paper
“There are several ways to spin a report (4, 6, 8–10).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [10]
In the citing paper
“Specific classifications of spin have been developed for different study designs and contexts [randomized controlled trials with nonstatistically significant results (4), observational studies evaluating an intervention (10), diagnostic accuracy studies (8), systematic reviews (9)].”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842 · cited 2×
“To develop the classification of spin, we performed a literature review of studies of spin for other study designs [3 – 5, 9, 11] as well as studies of distorted presentation and interpretation of findings from non-randomized studies [12 – 19].”
Self-citationComparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
Self-citationChan, A.-W., & Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.38356.424606.8f · Cited by 613
When are observational studies as credible as randomised trials?
Vandenbroucke, J. P. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16261-2 · Cited by 538 · cited 1×
“Particularly, contrary to randomized clinical trials, they may not allow for establishing causal inferences but rather, only an association [8 – 10].”
Boutron, I., Altman, D. G., Hopewell, S., Vera-Badillo, F., Tannock, I., & Ravaud, P. (2014) · Journal of Clinical Oncology · doi:10.1200/jco.2014.56.7503 · Cited by 368
Self-citationCausation in epidemiology: Table 1
Parascandola, M., & Weed, D. L. (2001) · Journal of Epidemiology and Community Health · doi:10.1136/jech.55.12.905 · Cited by 276
Comparisons against baseline within randomised groups are often used and can be highly misleading
Bland, J. M., & Altman, D. G. (2011) · Trials · doi:10.1186/1745-6215-12-264 · Cited by 241
Effect of interpretive bias on research evidence
Kaptchuk, T. J. (2003) · BMJ · doi:10.1136/bmj.326.7404.1453 · Cited by 222 · cited 1×
“This situation is problematic because it has been demonstrated [6] that spin in the abstract conclusions of randomized controlled trial reports could bias the interpretation of the results by clinicians [29].”
Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”
Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G. (2013) · Radiology · doi:10.1148/radiol.12120527 · Cited by 158
MabsBase: A Mycobacterium abscessus Genome and Annotation Database
Heydari, H., Wee, W. Y., Lokanathan, N., Hari, R., Yusoff, A. M., Beh, C. Y., Yazdi, A. H., Wong, G. J., Ngeow, Y. F., & Choo, S. W. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062443 · Cited by 157
Cited by
‘Spin’ in published biomedical literature: A methodological systematic review
Chiu, K., Grundy, Q., & Bero, L. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2002173 · Cited by 317
Misrepresentation and distortion of research in biomedical literature
Boutron, I., & Ravaud, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710755115 · Cited by 273
Self-citationVinkers, C. H., Tijdink, J. K., & Otte, W. M. (2015) · BMJ · doi:10.1136/bmj.h6467 · Cited by 237
Yavchitz, A., Ravaud, P., Altman, D. G., Moher, D., Hrobjartsson, A., Lasserson, T., & Boutron, I. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.020 · Cited by 224
“, understate efficacy and/or overstate harm) because these types of spin were not considered in previous works about spin for other study designs [4,7,9,11].”
BackgroundSelf-citationBruce, R., Chauvin, A., Trinquart, L., Ravaud, P., & Boutron, I. (2016) · BMC Medicine · doi:10.1186/s12916-016-0631-5 · Cited by 218
“the study results [17–19].”
Self-citation
Metadata
- Authors
- Lazarus, C., Haneef, R., Ravaud, P., & Boutron, I.
- Affiliations
- Inserm (FR)
- Corresponding author
- Boutron, Isabelle
- Venue
- BMC Medical Research Methodology
- Published
- 2015-10-13
- Volume
- 15
- Issue
- 1
- Pages
- 85-85
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC4604617
- OpenAlex
- W1953064436
- Cited by
- 137
- References
- 38
- Citations by year
- 2026: 11 · 2025: 11 · 2024: 15 · 2023: 10 · 2022: 13 · 2021: 20 · 2020: 13 · 2019: 15 · 2018: 10 · 2017: 11 · 2016: 7 · 2015: 1
- FWCI
- 8.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Assistance Publique - Hôpitaux de Paris
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- spin, non-randomized studies, abstracts, reporting bias, causal language, harms reporting, clinical implications, intervention research, research integrity
- MeSH terms
- Abstracting and Indexing, Humans, Research Design, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention. https://app.cochat.ai/papers/10.1186/s12874-015-0079-x
- The paper
- Lazarus, C., Haneef, R., Ravaud, P., & Boutron, I. (2015). Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-015-0079-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
