‘Spin’ in published biomedical literature: A methodological systematic review
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
In the scientific literature, spin refers to reporting practices that distort the interpretation of results and mislead readers so that results are viewed in a more favourable light. The presence of spin in biomedical research can negatively impact the development of further studies, clinical practice, and health policies. This systematic review aims to explore the nature and prevalence of spin in the biomedical literature. We searched MEDLINE, PreMEDLINE, Embase, Scopus, and hand searched reference lists for all reports that included the measurement of spin in the biomedical literature for at least 1 outcome. Two independent coders extracted data on the characteristics of reports and their included studies and all spin-related outcomes. Results were grouped inductively into themes by spin-related outcome and are presented as a narrative synthesis. We used meta-analyses to analyse the association of spin with industry sponsorship of research. We included 35 reports, which investigated spin in clinical trials, observational studies, diagnostic accuracy studies, systematic reviews, and meta-analyses. The nature of spin varied according to study design. The highest (but also greatest) variability in the prevalence of spin was present in trials. Some of the common practices used to spin results included detracting from statistically nonsignificant results and inappropriately using causal language. Source of funding was hypothesised by a few authors to be a factor associated with spin; however, results were inconclusive, possibly due to the heterogeneity of the included papers. Further research is needed to assess the impact of spin on readers' decision-making. Editors and peer reviewers should be familiar with the prevalence and manifestations of spin in their area of research in order to ensure accurate interpretation and dissemination of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Publication bias [20, 21], lack of replicability and replication [22], implication of a causal relationship even after stating that the evidence is insufficient to reach causal conclusions [23–25], and related phenomena may also introduce error into bodies of published literature.”
From Causal language and strength of inference in academic and media articles shared in social media (CLAIMS): A systematic review (2018) · cites this paper as [25]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Industry sponsorship and research outcome
Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub3 · Cited by 1,697
Self-citationDwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group (2013) · PLoS ONE · doi:10.1371/journal.pone.0066844 · Cited by 1,127
Boutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842
Statistical Problems in the Reporting of Clinical Trials
Pocock, S. J., Hughes, M. D., & Lee, R. J. (1987) · New England Journal of Medicine · doi:10.1056/nejm198708133170706 · Cited by 662
Industry sponsorship and research outcome
Lundh, A., Sismondo, S., Lexchin, J., Busuioc, O. A., & Bero, L. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub2 · Cited by 605
Self-citation
Cited by
Integrated omics: tools, advances and future approaches
Misra, B. B., Langefeld, C., Olivier, M., & Cox, L. A. (2019) · Journal of Molecular Endocrinology · doi:10.1530/jme-18-0055 · Cited by 686
O. B. O. T. C.-S. G., Grant, S., Mayo-Wilson, E., Montgomery, P., Macdonald, G., Michie, S., Hopewell, S., & Moher, D. (2018) · Trials · doi:10.1186/s13063-018-2735-z · Cited by 348
“Authors should avoid distorted presentation or 'spin' when discussing trial findings [99, 100].”
BackgroundWallach, J. D., Boyack, K. W., & Ioannidis, J. P. A. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2006930 · Cited by 269
Edwards, P., Zhang, W., Belton, B., & Little, D. C. (2019) · Marine Policy · doi:10.1016/j.marpol.2019.103547 · Cited by 215
CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081124 · Cited by 205
Evidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G. S., & Barnett, A. G. (2023) · BMC Medicine · doi:10.1186/s12916-023-03048-6 · Cited by 189
“There were instances of potential spin [11, 40], with relatively low AUC values under 0.75 described as “excellent” (PMID35222547).”
BackgroundInfluentialReporting guidelines: doing better for readers
Moher, D. (2018) · BMC Medicine · doi:10.1186/s12916-018-1226-0 · Cited by 107
“The prevalence rates of reporting biases are disturbingly high [14, 15], and why researchers would get promoted for such offences is difficult to understand.”
BackgroundHaber, N., Smith, E. R., Moscoe, E., Andrews, K., Audy, R., Bell, W., Brennan, A. T., Breskin, A., Kane, J. C., Karra, M., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196346 · Cited by 97
“Previous studies examining overstatement of causal language utilize either language comparison and/or assumed strength of causal inference exclusively from very broad study design characteristics [12, 23, 25, 31].”
BackgroundPoor statistical reporting, inadequate data presentation and spin persist despite editorial advice
Diong, J. H. L., Butler, A. A., Gandevia, S. C., & Héroux, M. E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202121 · Cited by 104
Khan, M. S., Lateef, N., Siddiqi, T. J., Rehman, K. A., Alnaimat, S., Khan, S. U., Riaz, H., Murad, M. H., Mandrola, J. M., Doukky, R., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.2622 · Cited by 112
“0] For profit and nonprofit 19 (20) [13.”
BackgroundHealth communication in and out of public health emergencies: to persuade or to inform?
Oxman, A. D., Fretheim, A., Lewin, S. A., Flottorp, S. A., Glenton, C., Helleve, A., Vestrheim, D. F., Iversen, B. G., & Rosenbaum, S. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00828-z · Cited by 91
Evaluation of spin in abstracts of papers in psychiatry and psychology journals
Jellison, S., Roberts, W., Bowers, A., Combs, T., Beaman, J., Wayant, C., & Vassar, M. B. (2019) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2019-111176 · Cited by 80
“11 Evidence suggests that abstract information alone is capable of changing a majority of clinicians’ care decisions.”
Navarro, C. L. A., Damen, J. A., Takada, T., Nijman, S. W. J., Dhiman, P., Ma, J., Collins, G. S., Bajpai, R. C., Riley, R. D., Moons, K. G. M., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.03.024 · Cited by 86
Wen, J., & Lei, L. (2021) · Applied Linguistics · doi:10.1093/applin/amab037 · Cited by 66
Littell, J. H., Pigott, T., Nilsen, W., Green, S. J., & Montgomery, O. L. K. (2021) · Campbell Systematic Reviews · doi:10.1002/cl2.1158 · Cited by 114
Millar, N., Batalo, B., & Budgell, B. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.28676 · Cited by 57
Mouffak, A., Lepelley, M., Revol, B., Bernardeau, C., Salvo, F., Pariente, A., Roustit, M., Cracowski, J., & Khouri, C. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.06.022 · Cited by 54
The Weak Spots in Contemporary Science (and How to Fix Them)
Wicherts, J. M. (2017) · Animals · doi:10.3390/ani7120090 · Cited by 59
“This tendency to oversell the results is pervasive in the biomedical literature [60].”
BackgroundEvaluation of spin within abstracts in obesity randomized clinical trials: A cross‐sectional review
Austin, J., Smith, C. E., Natarajan, K., Som, M., Wayant, C., & Vassar, M. B. (2018) · Clinical Obesity · doi:10.1111/cob.12292 · Cited by 54
“A systematic review of investigations of spin found that spin occurs in a median of 60% of abstracts.(12) The first investigation of spin reported that conclusion sections of abstracts were particularly susceptible to spin, compared with other sections of a paper.”
BackgroundAbbruzzese, E., Levine, S. B., & Mason, J. W. (2023) · Journal of Sex & Marital Therapy · doi:10.1080/0092623x.2022.2150346 · Cited by 64
“What these studies “consistently demonstrate” is the art of spin—a well-documented problem in biomedical research where researchers “distort the interpretation of results and mislead readers so that results are viewed in a more favorable light” (Chiu et al., 2017).”
BackgroundBero, L., Lawrence, R., Leslie, L., Chiu, K., McDonald, S., Page, M. J., Grundy, Q., Parker, L., Boughton, S., Kirkham, J. J., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-051821 · Cited by 50
Self-citationEvaluation of spin in the abstracts of otolaryngology randomized controlled trials
Cooper, C. M., Gray, H. M., Ross, A., Hamilton, T. A., Downs, J. B., Wayant, C., & Vassar, M. B. (2018) · The Laryngoscope · doi:10.1002/lary.27750 · Cited by 51
“These studies were aggregated and evaluated in a systematic review of spin conducted by Chiu et al.(14) Based on the findings of this systematic review, our study demonstrated comparable but higher rates of spin in the abstracts of included otolaryngology randomized trials with nonsignificant primary endpoints (70% in…”
ResultInfluentialCosgrove, L., Cristea, I. A., Shaughnessy, A. F., Mintzes, B. J., & Naudet, F. (2019) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2019-111204 · Cited by 46
“Additionally, this study adds to the growing body of literature documenting the extent and effects of spin in the scientific literature and in the media reports.(7) 22 Indeed, the extent of spin found in the present study is likely controlled by industry; not only were authors of the published studies Otsuka employees…”
ResultOxman, M., Larun, L., Pérez‐Gaxiola, G., Alsaid, D., Qasim, A., Rose, C. J., Bischoff, K., & Oxman, A. D. (2021) · F1000Research · doi:10.12688/f1000research.52894.1 · Cited by 56
Gerrits, R. G., Jansen, T., Mulyanto, J., van den Berg, M. J., Klazinga, N., & Kringos, D. S. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-027903 · Cited by 51
“In the biomedical field, a systematic review by Chiu et al shows that estimates for the occurrence of questionable research practices in the interpretation of results in scientific publications vary from 10% of publications deriving discordant conclusions from study results to 100% of publications containing rhetorica…”
Guo, F., Fang, X., Li, C., Qin, D., Hua, F., & He, H. (2021) · European Journal of Orthodontics · doi:10.1093/ejo/cjab044 · Cited by 48
Otte, W. M., Vinkers, C. H., Habets, P. C., van IJzendoorn, D. G. P., & Tijdink, J. K. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001562 · Cited by 47
MASCC guideline: cannabis for cancer-related pain and risk of harms and adverse events
To, J., Davis, M., Sbrana, A., Alderman, B., Hui, D., Mukhopadhyay, S., Bouleuc, C., Case, A., Amano, K., Crawford, G., et al. (2023) · Supportive Care in Cancer · doi:10.1007/s00520-023-07662-1 · Cited by 38
Nascimento, D. P., Gonzalez, G. Z., Araújo, A. C., Moseley, A. M., Maher, C. G., & Costa, L. O. P. (2019) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2020.8962 · Cited by 46
Detecting Causal Language Use in Science Findings
Yu, B., Li, Y., & Wang, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1473 · Cited by 40
“Manual approaches often applied domain-specific, knowledge-based inferences (e.g. Kaplan and Berry-Rogghe, 1991) and hand-coded rules to encode the causal language cues (e.g. Garcia et al., 1997; Cofield et al., 2010; Lazarus et al., 2015; Chiu et al., 2017).”
BackgroundMethodArthur, W., Zaaza, Z., Checketts, J. X., Johnson, A., Middlemist, K., Basener, C., Jellison, S., Wayant, C., & Vassar, M. B. (2020) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2019.12.025 · Cited by 37
Being honest with causal language in writing for publication
Thapa, D. K., Visentin, D. C., Hunt, G. E., Watson, R. A., & Cleary, M. L. (2020) · Journal of Advanced Nursing · doi:10.1111/jan.14311 · Cited by 40
“6 Using causal language in reporting the correlational findings from observational studies is a common source of misinformation (Boutron & Ravaud, 2018; Chiu et al., 2017).”
Overinterpretation and misreporting of prognostic factor studies in oncology: a systematic review
Kempf, E., de Beyer, J. A., Cook, J. A., Holmes, J., Mohammed, S. B., Nguyen, T., Simera, I., Trivella, M., Altman, D. G., Hopewell, S., et al. (2018) · British Journal of Cancer · doi:10.1038/s41416-018-0305-5 · Cited by 41
“Each of these strategies were described in a recent systematic review on the use of spin in biomedical research published by Chiu and colleagues.(39) We collected strategies described in similar reviews on misleading reporting, misleading interpretation and misleading extrapolation in therapeutic RCTs,(27,40) diagnost…”
MethodSpin in Scientific Publications: A Frequent Detrimental Research Practice
Boutron, I. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2019.11.002 · Cited by 42
Abstracts of published randomized controlled trials in Endodontics: reporting quality and spin
Fang, X., Hua, F., Riley, P., Chen, F., Zhang, L., Walsh, T., & Chen, Z. (2020) · International Endodontic Journal · doi:10.1111/iej.13310 · Cited by 33
Ghannad, M., Olsen, M., Boutron, I., & Bossuyt, P. M. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.07.011 · Cited by 41
Yuan, Z.-M., & Yao, M. (2022) · Scientometrics · doi:10.1007/s11192-022-04515-2 · Cited by 38
“, 2013) as a strategy to impress the audience (Wen & Lei, 2021), editors, and peer reviewers (Chiu et al., 2017).”
BackgroundSpin in abstracts of randomized controlled trials in dentistry
Roszhart, J. I., Kumar, S., Allareddy, V., Childs, C., & Elangovan, S. (2019) · The Journal of the American Dental Association · doi:10.1016/j.adaj.2019.08.009 · Cited by 34
Inouye, K., & Mills, D. (2021) · Learned Publishing · doi:10.1002/leap.1377 · Cited by 35
The SSSPIN study—spin in studies of spin: meta-research analysis
Bero, L. A., Chiu, K., & Grundy, Q. (2019) · BMJ · doi:10.1136/bmj.l6202 · Cited by 30
Self-citationExtent and prevalence of spin in randomized controlled trials in dentistry
Eleftheriadi, I., Ioannou, T., & Pandis, N. (2020) · Journal of Dentistry · doi:10.1016/j.jdent.2020.103433 · Cited by 32
Messaging in Biological Psychiatry: Misrepresentations, Their Causes, and Potential Consequences
Dumas-Mallet, E., & Gonon, F. (2020) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000276 · Cited by 34
Nascimento, D. P., Costa, L. O. P., Gonzalez, G. Z., Maher, C. G., & Moseley, A. M. (2019) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2019.03.024 · Cited by 31
Won, J., Kim, S.-Y., Bae, I., & Lee, H. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223305 · Cited by 31
Evaluation of spin in oncology clinical trials
Wayant, C., Margalski, D., Vaughn, K., & Vassar, M. B. (2019) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2019.102821 · Cited by 29
Wu, X., Yan, Q., Fang, X., Hua, F., Shi, B., & Tu, Y. (2020) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.13340 · Cited by 29
“, 2019), as there is empirical evidence that spin is more common among abstracts of trials with non-significant primary outcome(s) (Chiu et al., 2017).”
BackgroundStoll, M., Mancini, A. L., Hubenschmid, L., Dreimüller, N., König, J., Cuijpers, P. J., Barth, J., & Lieb, K. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.08.013 · Cited by 30
Ghannad, M., Yang, B., Leeflang, M., Aldcroft, A., Bossuyt, P. M., Schroter, S., & Boutron, I. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.10.014 · Cited by 32
Gläser, J., Ash, M. G., Buenstorf, G., Hopf, D., Hubenschmid, L., Janßen, M., Laudel, G., Schimank, U., Stoll, M., Wilholt, T., et al. (2021) · Minerva · doi:10.1007/s11024-021-09451-8 · Cited by 40
“Interpretation bias is discussed in the medical sciences as “spin”, which is defined as “reporting practices that distort the interpretation of results and mislead readers so that results are viewed in a more favourable light” (Chiu et al. 2017: 11, Lieb et al. 2016, Stoll et al. submitted).”
BackgroundThe commercialization of the biomedical sciences: (mis)understanding bias
de Melo‐Martín, I. (2019) · History & Philosophy of the Life Sciences · doi:10.1007/s40656-019-0274-x · Cited by 29
Pitfalls and Misconducts in Medical Writing
Lazarides, M. K., Gougoudi, E., & Παπάνας, Ν. (2019) · The International Journal of Lower Extremity Wounds · doi:10.1177/1534734619870083 · Cited by 26
“Selective reporting practices that distort the interpretation of results or discordance between results and their interpretation misleading the readers represent also a form of spin.(8) Reviewers requesting addition of multiple citations of their own work is another questionable practice.”
BackgroundDo not make clinical decisions based on abstracts of healthcare research: A systematic review
Nascimento, D. P., Ostelo, R., van Tulder, M. W., Gonzalez, G. Z., Araújo, A. C., Vanin, A. A., & Costa, L. O. P. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.030 · Cited by 30
“Also, efforts have been made on improving the awareness of the prevalence of spin by journal editors and reviewers [15] , as well as training programs for authors, journal editors and peer reviewers.”
BackgroundMethodResultInfluentialReporting characteristics of journal infographics: a cross-sectional study
Ferreira, G. E., Elkins, M. R., Jones, C. M. P., O’Keeffe, M., Cashin, A. G., Becerra, R. E., Gamble, A. R., & Zadro, J. R. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03404-9 · Cited by 33
“The proportion of spin in our sample was much lower than spin in other samples (26% to 85%) depending on the study design [15].”
ResultInterventions on gender equity in the workplace: a scoping review
Tricco, A. C., Parker, A., Khan, P. A., Nincic, V., Robson, R. C., MacDonald, H. R., Warren, R., Cleary, O., Zibrowski, E. M., Baxter, N. N., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03346-7 · Cited by 35
Westwood, S. (2020) · Journal of Aging Studies · doi:10.1016/j.jaging.2020.100880 · Cited by 29
Bandholm, T., Thorborg, K., Ardern, C. L., Christensen, R., & Henriksen, M. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-105058 · Cited by 22
“17 We recommend aiming for a declarative title where possible—the title is your chance to share a powerful first impression with your reader—although, we recognise you do not always have a choice.”
BackgroundKoroleva, A., Kamath, S., & Paroubek, P. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.yjbinx.2019.100058 · Cited by 31
Transparency in clinical trials: Adding value to paediatric dental research
Cenci, M. S., Franco, M. C., Raggio, D. P., Moher, D., & Pereira‐Cenci, T. (2020) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.12769 · Cited by 21
Misinformation: an empirical study with scientists and communicators during the COVID-19 pandemic
Parker, L., Byrne, J. A., Goldwater, M. B., & Enfield, N. J. (2021) · BMJ Open Science · doi:10.1136/bmjos-2021-100188 · Cited by 30
Demarquette, A., Perrault, T., Alapetite, T., Bouizegarene, M., Bronnert, R., Fouré, G., Masson, C., Nicolas, V., Lasocki, S., & Léger, M. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.01.001 · Cited by 27
Nascimento, D., Almeida, M. P., Scola, L. F. C., Vanin, A., Oliveira, L., Costa, L., & Costa, L. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.06.016 · Cited by 20
Academics must list all publications on their CV
da Silva, J. A. T., & Tsigaris, P. (2018) · KOME · doi:10.17646/kome.2018.16 · Cited by 18
“authors, fake emails, and other weaknesses or flaws, as identified by Ioannidis (2005), and reviewed by Wicherts (2017). These declarations cannot be made by academics for obvious reasons.”
BackgroundHéroux, M. E., Butler, A. A., Cashin, A. G., McCaughey, E. J., Affleck, A. J., Green, M. A., Cartwright, A., Jones, M. D., Kiely, K. M., van Schooten, K. S., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-060976 · Cited by 20
Statistical Significance Does Not Show Clinical Relevance: We Need to Go Beyond the P-value
Pontes‐Silva, A. (2022) · Journal of Clinical and Experimental Hepatology · doi:10.1016/j.jceh.2022.04.017 · Cited by 17
Bernard, R., Weissgerber, T. L., Bobrov, E., Winham, S. J., Dirnagl, U., & Riedel, N. (2020) · Clinical Science · doi:10.1042/cs20201125 · Cited by 19
Automatic recognition of self-acknowledged limitations in clinical research literature
Halil Kilicoglu, B., Rosemblat, G., Malički, M., & ter Riet, G. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy038 · Cited by 22
Registered Reports in Special Education: Introduction to the Special Series
Cook, B. G., Maggin, D. M., & Robertson, R. (2021) · Remedial and special education · doi:10.1177/0741932521996459 · Cited by 12
“, present and interpret research results in a favorable manner) negative findings in articles (Chiu et al., 2017).”
BackgroundResultSiebert, M., Gaba, J. F., Renault, A., Laviolle, B., Locher, C., Moher, D., & Naudet, F. (2022) · BMC Medicine · doi:10.1186/s12916-022-02377-2 · Cited by 17
“In addition, for each paper, we assessed the presence of the following key reporting biases: selective reporting of the primary outcome and “spin” [30].”
MethodGulbrandsen, M. T., Taka, T. M., Peterson, J. G., Chung, J. H., Syed, H. M., Amin, N. H., Stone, A. V., Xerogeanes, J. W., & Liu, J. N. (2023) · The American Journal of Sports Medicine · doi:10.1177/03635465231169042 · Cited by 16
Moore, A., Karadag, P., Fisher, E., Crombez, G., Straube, S., & Eccleston, C. (2024) · Pain · doi:10.1097/j.pain.0000000000003140 · Cited by 25
Page, M. J., Boutron, I., Nejstgaard, C. H., Altman, D. G., & Hróbjartsson, A. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.01.004 · Cited by 17
“The ability to assess the trustworthiness of research results is therefore an indispensable skill, which is becoming even more valuable in this age of misinformation and “alternative facts” (3, 4).”
BackgroundIdentifying spin bias of nonsignificant findings in biomedical studies
O’Leary, R., Rosa, G. R. M. L., Vernooij, R. W. M., & Polosa, R. (2023) · BMC Research Notes · doi:10.1186/s13104-023-06321-2 · Cited by 14
“One type of spin bias occurs when statistically nonsignificant results are reported as “showing an effect” [5] or where unjustified claims are made for results with p-values > 0.”
BackgroundInfluentialAnalysis of spin in the reporting of studies of topical treatments of photoaged skin
Motosko, C. C., Ault, A. K., Kimberly, L. L., Zakhem, G. A., Gothard, M. D., Ho, R. S., & Hazen, A. (2018) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2018.04.034 · Cited by 16
SPIN-PM: a consensus framework to evaluate the presence of spin in studies on prediction models
Navarro, C. L. A., Damen, J. A., Ghannad, M., Dhiman, P., van Smeden, M., Reitsma, J. B., Collins, G. S., Riley, R. D., Moons, K. G. M., & Hooft, L. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111364 · Cited by 16
Valdez, D., Vorland, C. J., Brown, A. W., Mayo-Wilson, E., Otten, J. M., Ball, R. J., Grant, S., Levy, R., Svetina, D., & Allison, D. B. (2020) · F1000Research · doi:10.12688/f1000research.26594.1 · Cited by 16
“…of clinical trials and meta-analyses (Boutron et al ., 2019; Lazarus et al ., 2015) and that authors in a variety of research disciplines often draw inappropriate causal inferences (Bleske-Rechek et al ., 2015; Casazza et al ., 2013; Chiu et al ., 2017; Knight et al ., 1996; Ochodo et al ., 2013).”
BackgroundSpin in Randomized Controlled Trials in Obstetrics and Gynecology: A Systematic Review
Chow, R., Huang, E., Fu, S. Y., Kim, E., Li, S. H., Sodhi, J., Tulandi, T., Cobey, K. D., Bacal, V., & Chen, I. (2022) · Women s Health Reports · doi:10.1089/whr.2021.0141 · Cited by 13
Rodgers, P. (2017) · eLife · doi:10.7554/elife.32011 · Cited by 14
“…other things to worry about, such as conflicts of interest, various issues related to clinical trials and ’spin’ (which has been defined as "reporting practices that distort the interpretation of results and mislead readers so that results are viewed in a more favourable light"; Chiu et al., 2017).”
Nejstgaard, C. H., Laursen, D. R. T., Lundh, A., & Hróbjartsson, A. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1611 · Cited by 18
“Previous methodological studies have hypothesized that other factors like spin may be associated with funding source, though the results of such studies were inconclusive.(45)”
ResultRobert, C., & Wilson, C. S. (2023) · Frontiers in Pain Research · doi:10.3389/fpain.2023.1071453 · Cited by 16
Su, N., van der Linden, M. W., Faggion, C. M., & van der Heijden, G. J. M. G. (2023) · Caries Research · doi:10.1159/000531569 · Cited by 16
“…practice and population health, adversely in-fl uences health policy planning, adds to research waste, decreases the reproducibility of research, hampers the progress of science, and reduces return-of-investment from research [Ochodo et al., 2013; Caul fi eld and Ogbo-gu, 2015; Chiu et al., 2017].”
BackgroundInfluentialLutz, S. R., Popp, A., van Emmerik, T. H. M., Gleeson, T., Kalaugher, L., Möbius, K., Mudde, T., Walton, B., Hut, R., Savenije, H. H. G., et al. (2018) · Hydrology and earth system sciences · doi:10.5194/hess-22-3589-2018 · Cited by 13
Meta-research matters: Meta-spin cycles, the blindness of bias, and rebuilding trust
Bero, L. A. (2018) · PLoS Biology · doi:10.1371/journal.pbio.2005972 · Cited by 13
Self-citationPublication pressure threatens the integrity of palaeontological research
Raja, N. B., & Dunne, E. M. (2022) · Geological Curator · doi:10.55468/gc1459 · Cited by 10
Publication pressure and scientific misconduct: why we need more open governance
Gandevia, S. C. (2018) · Spinal Cord · doi:10.1038/s41393-018-0193-9 · Cited by 14
Rowhani-Farid, A., Hong, K., Grewal, M., Reynolds, J., Zhang, A. D., Wallach, J. D., & Ross, J. S. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-111989 · Cited by 11
Presence and consequences of positive words in scientific abstracts
Edlinger, M., Buchrieser, F., & Wood, G. M. D. O. (2023) · Scientometrics · doi:10.1007/s11192-023-04864-6 · Cited by 14
“Firstly, a certain degree of overinterpretation, exaggeration and misrepresentation of scientific findings is well documented in the literature (Chiu et al., 2017; Ochodo et al., 2013; Yavchitz et al., 2012).”
BackgroundResultQureshı, R., Naaman, K., Quan, N. G., Mayo‐Wilson, E., Page, M. J., Cornelius, V. R., Chou, R., Boutron, I., Golder, S., Bero, L. A., et al. (2024) · Annals of Internal Medicine · doi:10.7326/m24-0771 · Cited by 13
Self-citationPatel, S. V., Zhang, L., Elsolh, B., Yu, D., & Chadi, S. A. (2018) · Colorectal Disease · doi:10.1111/codi.14451 · Cited by 11
Jankowski, S., Boutron, I., & Clarke, M. J. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-056503 · Cited by 14
Boon, P. I. (2018) · Pacific Conservation Biology · doi:10.1071/pc17018 · Cited by 12
Bruton, S. V., Brown, M., & Sacco, D. F. (2019) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264619894435 · Cited by 13
“, 2017), presentational “spin” (Chiu et al., 2017), and several others.”
BackgroundSilva, F. M., Adegboye, A. R. A., Lachat, C. K., Curioni, C. C., Gomes, F. D. S., Collins, G. S., Kac, G., de Beyer, J. A., Cook, J. A., Ismail, L. C., et al. (2023) · JMIR Research Protocols · doi:10.2196/43537 · Cited by 10
“3% of systematic reviews (n=2) included spin in their main text [36].”
BackgroundKeserlioglu, K., Halil Kilicoglu, B., & ter Riet, G. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0078-2 · Cited by 16
Tsigaris, P., & da Silva, J. A. T. (2020) · Scientometrics · doi:10.1007/s11192-020-03353-4 · Cited by 10
Ong, Y. K., Double, K. L., Bero, L. A., & Diong, J. H. L. (2023) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00129-1 · Cited by 10
Self-citationJohn, S. D. (2018) · Synthese · doi:10.1007/s11229-018-02017-4 · Cited by 15
“For empirical research, see Chiu et al. (2017) and Vinkers et al. (2015). However, when scientists are less careful, the issues I explore below are irrelevant; the following epicycle of argument applies only when scientists do make hedged claims).”
BackgroundThe New Psychology of Expert Witness ProcedurePreprint
Chin, J. M., Roque, M. S., & McFadden, R. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3564796 · Cited by 11
Lunny, C., Jain, N., Nazari, T., Kosaner-Kließ, M., Santos, L. H. C. C., Goodman, I., Osman, A. A. M., Berrone, S., Dadam, M. N., Brenna, C. T. A., et al. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10032 · Cited by 15
Response to Medical Assistance in Dying, Palliative Care, Safety, and Structural Vulnerability
Gallagher, R. E., Coelho, R., Violette, P. D., Gaind, K. S., Chochinov, H. M., & Professionals, O. B. O. A. I. C. O. P. C. (2023) · Journal of Palliative Medicine · doi:10.1089/jpm.2023.0581 · Cited by 9
Open science precision medicine in Canada: Points to consider
Moreno, P. G., Ali‐Khan, S. E., Capps, B., Caulfield, T., Chalaud, D., Edwards, A. M., Gold, E. R., Rahimzadeh, V. N., Thorogood, A., Auld, D. S., et al. (2019) · FACETS · doi:10.1139/facets-2018-0034 · Cited by 13
Metadata
- Authors
- Chiu, K., Grundy, Q., & Bero, L.
- Affiliations
- The University of Sydney (AU)
- Corresponding author
- Bero, Lisa
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-09-11
- Volume
- 15
- Issue
- 9
- Pages
- e2002173
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5593172
- OpenAlex
- W2754718739
- Semantic Scholar
- 8427aa3a18732d88b2a30a5e5ed5714ea8013bbc
- Cited by
- 317
- References
- 51
- Citations by year
- 2026: 42 · 2025: 25 · 2024: 40 · 2023: 31 · 2022: 50 · 2021: 34 · 2020: 29 · 2019: 35 · 2018: 26 · 2017: 5
- FWCI
- 6.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- spin, research reporting practices, biomedical literature, industry funding, research funding conflicts of interest, clinical trials, observational studies, diagnostic accuracy studies, systematic reviews, meta-analysis, statistical significance reporting, causal language, peer review
- MeSH terms
- Prejudice, Propaganda, Public Relations, Publishing, Conflict of Interest, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

