Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias — An Updated Review
Open accessThe DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias and outcome reporting bias have been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. METHODOLOGY/PRINCIPAL FINDINGS: In this update, we review and summarise the evidence from cohort studies that have assessed study publication bias or outcome reporting bias in randomised controlled trials. Twenty studies were eligible of which four were newly identified in this update. Only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Fifteen of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: This update does not change the conclusions of the review in which 16 studies were included. Direct empirical evidence for the existence of study publication bias and outcome reporting bias is shown. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Figure 3 Status of approved protocols for Chan 2004b study [17].](https://figures.cochat.ai/paper-figures/83600bbc5644401caed195b486efac8f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-3.jpg)
![Figure 4 Status of approved protocols for Easterbrook 1991 study [24].](https://figures.cochat.ai/paper-figures/0a114dad26924772826758941018f42f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-4.jpg)
![Figure 5 Status of approved protocols for Dickersin 1992 study [23].](https://figures.cochat.ai/paper-figures/1453f80dcd014ca3b9b32399777cc8d3/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-5.jpg)
![Figure 6 Status of approved protocols for Dickersin 1993 study [3].](https://figures.cochat.ai/paper-figures/1e175d9e8b2a4f0390577db97b820ca8/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-6.jpg)
![Figure 7 Status of approved protocols for Stern 1997 study [4].](https://figures.cochat.ai/paper-figures/876f2f4683aa40a689e73241856ecb1f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-7.jpg)
![Figure 8 Status of approved protocols for Cooper 1997 study [19].](https://figures.cochat.ai/paper-figures/beceb71fe2a943b2ba35a9fc9d17293b/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-8.jpg)
![Figure 9 Status of trials for Wormald 1997 study [30].](https://figures.cochat.ai/paper-figures/f6a16e454252431f84d6cc28737b2e50/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-9.jpg)
![Figure 10 Status of approved protocols for Ioannidis 1998 study [5].](https://figures.cochat.ai/paper-figures/261662c83e664841aaa276cbc7c62394/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-10.jpg)
![Figure 11 Status of approved protocols for Pich 2003 study [27].](https://figures.cochat.ai/paper-figures/48fe85db48fc4b6ca22f25bb5580c0a7/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-11.jpg)
![Figure 12 Status of approved protocols for Cronin 2004 study [20].](https://figures.cochat.ai/paper-figures/8d211a89740e4b67b0c80783ab9c0582/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-12.jpg)
![Figure 13 Status of approved protocols for Decullier 2005 study [7].](https://figures.cochat.ai/paper-figures/c7868be91276448192f71187c860c7a5/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-13.jpg)
![Figure 14 Status of approved protocols for Decullier 2006 study [22].](https://figures.cochat.ai/paper-figures/4859f8920e714475a966997babd4cb7a/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-14.jpg)
![Figure 15 Status of approved protocols for Hahn 2002 study [26].](https://figures.cochat.ai/paper-figures/69f971391f504ed4bae3d24d4a05f2c1/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-15.jpg)
![Figure 16 Status of approved protocols for Chan 2004a study [18].](https://figures.cochat.ai/paper-figures/933f83ab86634ea581351235ceea1e11/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-16.jpg)
![Figure 17 Status of approved protocols for Ghersi 2006 study [25].](https://figures.cochat.ai/paper-figures/97881d16700f4ed48102dec8fc05b22b/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-17.jpg)
![Figure 18 Status of approved protocols for von Elm 2008 study [29].](https://figures.cochat.ai/paper-figures/90d1c2ab102849719682b2f8f8409206/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-18.jpg)
![Figure 19 Status of approved protocols for Turer 2007 study [28].](https://figures.cochat.ai/paper-figures/ef99b99be5ff4105970df8c239918ce4/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-19.jpg)
![Figure 20 Status of approved protocols for De Jong 2010 study [21].](https://figures.cochat.ai/paper-figures/bf16aa205a3c4592aa0e050025754624/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-20.jpg)
![Figure 21 Status of approved protocols for Blumle 2008 study [31].](https://figures.cochat.ai/paper-figures/f70bc7510f114d9ba3b2e1e1e342ba98/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-21.jpg)
![Figure 22 Status of approved protocols for Hall 2007 study [32].](https://figures.cochat.ai/paper-figures/577511f26e0441a6bbc7643a3998c183/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-22.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Clinical trial registries provide the ability to measure biases in the reporting of clinical trials that arise due to non-publication, delayed publication, or incomplete publication of results [14].”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Many publications of randomized clinical trials of hypnosis interventions have been unclear or incomplete in reporting of the design elements that are necessary for the evaluation of the quality of evidence, 13 or have not provided sufficient details for possible direct replication.14,15”
From Best Practice Recommendations for Conducting and Reporting Controlled Trials in Clinical Hypnosis Research (2024) · cites this paper as [13]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“studies with statistically non-significant results may not have been submitted for publication (publication bias), or particular results that were statistically non-significant may have been omitted from study reports (selective non-reporting bias).”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [83]
The cited source says what the claim attributes to it.
In the citing paper
“Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias.”
From Systematic review protocol assessing the processes for linking clinical trial registries and their published results (2016) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Despite providing important information relevant to patients, trials with statistically non-significant results are more prone to non-publication,114 or, when published, to a long delay to publication114 115 116—often referred to as publication bias.”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [116]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 12×
“Easterbrook et al [24] found that compared with unfunded studies, government funded studies were more likely to yield statistically significant results but government sponsorship was not found to have a statistically significant effect on the likelihood of publication and company sponsored trials were less likely to b…”
BackgroundMethodResultInfluentialSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435 · cited 1×
“Several studies investigated a cohort of trials submitted to drug licensing authorities [38,40,41,65] and all found that many of these trials remain unpublished, with one study demonstrating that trials with positive outcomes resulted more often in submission of a final report to the regulatory authority [40].”
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,412
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368 · cited 2×
“While much effort has been invested in trying to identify the former [2], it is equally important to understand the nature and frequency of missing data from the latter level.”
BackgroundChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 29×
“The main objective of the study by Blumle et al [31] was to consider how eligibility criteria stated in protocols was reported in subsequent reports, in doing so they noted that 52% of studies in their cohort were published, decreasing to 48% for RCTs only.”
BackgroundMethodInfluentialSystematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 6×
“Since the original version of this review was published [13], a Cochrane methodology review is now available on publication bias [64].”
BackgroundMethodInfluentialSelf-citationPublication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Self-citationDissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039 · cited 2×
“While much effort has been invested in trying to identify the former [1,2], it is equally important to understand the nature and frequency of missing data from the latter level.”
Background
Research works printed but not linked: 2
- Menzel S, Uebing B, Hucklenbroich P, Schober O (2007) Evaluation of clinical trials following an approval from a research ethics committee. Dtsch Med Wochenschr 132: 2313– 2317. 17957593
- Chappell L, Alfirevic Z, Chien P, Jarvis S, Thornton JG (2005) A comparison of the published version of randomized controlled trials in a specialist clinical journal with the original trial protocols; Chicago.
Cited by
Items 801–900 of 1,001
Thompson, T., Ahmed, B., Weldon, S. M., Efthimiou, O., & Stubbs, B. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-048298 · Cited by 2
“It is important to include unpublished data, since the well-known bias towards publication of significant findings can, when relying on published literature alone, lead to an overestimation of treatment effects and an underestimation of adverse effects [25].”
BackgroundHersh, W. (2020) · Health informatics · doi:10.1007/978-3-030-47686-1_2 · Cited by 2
Mheissen, S., Khan, H., Seehra, J., & Pandis, N. (2022) · Journal of Dentistry · doi:10.1016/j.jdent.2022.104182 · Cited by 2
Paladin, I., & Pranić, S. M. (2022) · F1000Research · doi:10.12688/f1000research.122125.1 · Cited by 2
Occupational exposure and cancer: an umbrella review
Guimarães, R. M., Dutra, V. G. P., Ayres, A. R. G., Garbin, H. B. D. R., Martins, T. C. D. F., & Meira, K. C. (2022) · Revista Brasileira de Saúde Ocupacional · doi:10.1590/2317-6369/37620en2022v47e14 · Cited by 3
Al-Durra, M., Nolan, R. P., Seto, E., & Cafazzo, J. A. (2022) · Digital Health · doi:10.1177/20552076221090034 · Cited by 2
Actes des Journées européennes de la science ouverte
Conference, O. S. E. (2022) · doi:10.4000/books.oep.15822 · Cited by 2
Marocolo, M., da Mota, G. R., Rodrigues, A. B., Leite, R. C., Hohl, R., da Paixão, R. C., de Souza, H. L. R., Meireles, A. A. F. D. M., & Arriel, R. A. (2023) · Sports Medicine International Open · doi:10.1055/a-2181-6798 · Cited by 2
“The dissemination of publications with this type of bias can create the misconception that negative or statistically insignificant results are due to negligent conduction, methodological failures, or inadequate experimental design [6, 7].”
BackgroundPrimary outcome reporting in clinical trials for older adults with depression
Rodrigues, M., Oprea, A., Johnson, K., Dufort, A., Sanger, N., Ghiassi, P., Sanger, S., Panesar, B., D’Elia, A., Parpia, S., et al. (2024) · BJPsych Open · doi:10.1192/bjo.2023.650 · Cited by 2
Difficult Terrains of Research Publications Faced by Researchers: A Cross-Sectional Study
Chirukandath, R., Sunil, G., Balakrishnan, V., Menon, R. A., Soorya Gayathry, P., Sulaiman, S. V., George, M., Mohan, K., & Joseph, D. M. (2024) · Cureus · doi:10.7759/cureus.64787 · Cited by 2
“Other documented reasons include journal rejections (6%), fear of non-acceptance (12%), lack of motivation, and low prioritisation of publication [8, 9].”
BackgroundShahabi, S., Lankarani, K. B., Ezati, R., & ShahAli, S. (2024) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2024.08.007 · Cited by 3
Pool, L., Luyten, C. R. D. P., van der Pluijm, R. W., Soentjens, P. H. P., Hänscheid, T., Grobusch, M. P., & Visser, B. J. (2024) · Malaria Journal · doi:10.1186/s12936-024-05115-6 · Cited by 2
Knowledge-Based Artificial Intelligence System for Drug Prioritization
Su, Y., Wu, J., Zhao, X., Hao, Y., Wang, Z., Zhang, Y., Tang, Y., Pan, B., Wang, G., Kong, Q., et al. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c00027 · Cited by 2
Measuring What Matters in Parkinson's Disease Research and Dysphagia: The Need for Core Outcome Sets
Walshe, M., Hirschwald, J., & Warnecke, T. (2025) · Movement Disorders · doi:10.1002/mds.30241 · Cited by 2
“24 Although we did not assess studies for selective outcome reporting bias systematically, we found evidence of this bias where outcomes listed in the methods sections were absent from the results in dysphagia intervention studies in PD. 17 Selective reporting of outcomes may lead to an…”
Bramley, P., Bird, C., Badgett, R. G., & DeVito, N. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111958 · Cited by 3
Promoting informed health choices: the long and winding road
Oxman, A. D., Chalmers, I., & Glasziou, P. (2025) · Journal of the Royal Society of Medicine · doi:10.1177/01410768251384317 · Cited by 2
“In 2006, the World Health Organization established the International Clinical Trials Registry Platform to link trial registries to ensure a single point of access and unambiguous identification of trials, and to establish standards for trial registries.”
15. Education and awareness raising
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.15 · Cited by 2
Bachelet, V. C., & Rada, G. (2013) · Medwave · doi:10.5867/medwave.2013.10.5846 · Cited by 3
Assessing the utility of an institutional publications officer: a pilot assessment
Cobey, K. D., Galipeau, J., Shamseer, L., & Moher, D. (2017) · PeerJ · doi:10.7717/peerj.3294 · Cited by 2
Research integrity and the law that never was
Mayer, M. G. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2018-110993 · Cited by 2
Ma, X., Gao, Y., Ji-pin, L., Zhang, D., & Tian, J. (2018) · Medicine · doi:10.1097/md.0000000000013181 · Cited by 2
Pieter, A., KEMMLER, W. K., Mayerl, J., & Fröhlich, M. (2020) · Springer eBooks · doi:10.1007/978-3-662-61039-8_9 · Cited by 2
Automating Data Analysis Methods in Epidemiology
Choueiry, G., & Salameh, P. (2021) · Journal of Data Science · doi:10.6339/jds.201901_17(1).0003 · Cited by 2
Tellum, T., Naftalin, J., Hirsch, M., Sarıdoğan, E., & Jurkovic, D. (2021) · Facts Views and Vision in ObGyn · doi:10.52054/fvvo.13.3.034 · Cited by 2
“The selection of outcomes based on researcher preference or the “cherry-picking” of attractive results for inclusion with the omission of less interesting results, is difficult to prove without a set of agreed core outcomes (Dwan et al., 2013).”
BackgroundKelly, A., Singh‐Grewal, D., Sumpton, D., Hasset, G., Manera, K., & Tong, A. (2022) · Clinical and Experimental Rheumatology · doi:10.55563/clinexprheumatol/3izscd · Cited by 4
Controlling Bias in Randomized Clinical Trials
BARTON, B. A. (2022) · Springer eBooks · doi:10.1007/978-3-319-52636-2_214 · Cited by 5
Publish without bias or perish without replications
Ventura, R. (2022) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2022.08.010 · Cited by 2
Linguistic spin in randomized controlled trials about age-related macular degeneration
Veldhuis, N., Nuijts, M. A., Isphording, L., Lee-Kong, F. V. Y. L., Imhof, S. M., & Stegeman, I. (2022) · Frontiers in Epidemiology · doi:10.3389/fepid.2022.961996 · Cited by 2
Science ouverte et évaluation académique dans un monde pluriel
Beigel, F. (2022) · doi:10.4000/books.oep.15986 · Cited by 2
Reasons for missing evidence in rehabilitation meta-analyses: a cross-sectional meta-research study
Lazzarini, S. G., Yousif, M. S., Bargeri, S., Castellini, G., & Gianola, S. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-02064-7 · Cited by 2
Sesgo de publicación: ¿qué pueden hacer las revistas científicas?
Baladía, E., & Martínez-Rodríguez, R. (2015) · Revista Española de Nutrición Humana y Dietética · doi:10.14306/renhyd.19.3.186 · Cited by 4
Editorial: Lessons Learned From a “Failed” Clinical Trial
Leijten, E. F. A., Radstake, T. R. D. J., & Reedquist, K. A. (2018) · Arthritis & Rheumatology · doi:10.1002/art.40526 · Cited by 2
“be pursued to publication, but it is uncommon for investigators to publicly reexamine their null hypothesis (8).”
BackgroundToo few trials or too few reported trials?
Viteri-García, A. A., DeVito, N., & Goldacre, B. M. (2018) · Evidence-Based Dentistry · doi:10.1038/sj.ebd.6401317 · Cited by 3
Methods for Open and Reproducible Materials SciencePreprint
Wilson, S. L., Altman, M., & Jaramillo, R. (2019) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/ag8zu · Cited by 3
Towards the best future for humankind: ZIPAR whitepaper.Preprint
Kovic, M., Caspar, C., & Rauchfleisch, A. (2018) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/y7mvj · Cited by 2
Leveraging Integrative Analyses to Advance the Science of HappinessPreprint
Ong, A. D., & Wilcox, K. T. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kxb54 · Cited by 2
A knowledge synthesis of health research reporting standards relevant to epilepsy surgery
Kwon, C., Chua, M. M. J., Jetté, N., & Rolston, J. D. (2024) · Epilepsia · doi:10.1111/epi.18047 · Cited by 1
Hanazono, A., Yasuda, K., Shimada, H., Takahashi, Y., Funasaka, H., Sanpei, Y., & Sugawara, M. (2024) · eNeurologicalSci · doi:10.1016/j.ensci.2024.100515 · Cited by 1
“Furthermore, “ negative ” studies are usually unpublished [21].”
BackgroundFocused Review of Sleep Wearable Technology and Its Application in Sports Performance
Kaufman, M. W., Shetty, M., Nguyen, C., Abas, J., Fredericson, M., & Zeitzer, J. M. (2025) · Current Sports Medicine Reports · doi:10.1249/jsr.0000000000001258 · Cited by 1
Tertiary prevention interventions for patients with stroke in African countries: a systematic review
Adam, L., Unverzagt, S., Ngeh, E. N., Wubete, B. Y., Frese, T., Kantelhardt, E. J., & Kroeber, E. S. (2025) · BMJ Open · doi:10.1136/bmjopen-2023-080585 · Cited by 1
Core Outcome Sets for Pain Disorders: A Systematic Review of Research and Reporting Quality
Cui, Y., Li, B., Jiang, S., Li, Y., & Wang, S. (2025) · Journal of Pain Research · doi:10.2147/jpr.s533561 · Cited by 1
“44 Registration can improve design robustness, reduce bias, and prevent duplication.”
Implementing a Cybersecurity Continuous User Evaluation Program
McNett, J., & McNett, J. (2025) · Journal of Cyber Security · doi:10.32604/jcs.2025.067514 · Cited by 1
The Importance and Persistent Challenges of Prospective Trial Registration
Cooke, C. R. (2025) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202508-835ed · Cited by 1
“Some investigators wrongly believe that only industry trials or trials testing drugs need to be registered (5).”
Contributing Factors to the Nonpublication of Head and Neck Cancer Clinical Trials
Lewis, E., Zolkind, P., Kallogjeri, D., & Piccirillo, J. F. (2025) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2025.2549 · Cited by 1
Tabassum, Akhtar, S., Azmi, S. N., Azhar, M., & Laskar, N. (2025) · Cogent Economics & Finance · doi:10.1080/23322039.2025.2559057 · Cited by 1
“One common concern is publication bias, where studies with positive or significant findings tend to get published more often than those with negative or inconclusive results (Dwan et al., 2013).”
Dückers, M. (2025) · Population Health Metrics · doi:10.1186/s12963-025-00429-2 · Cited by 1
“Others focused on criteria and tools to assess bias in clinical diagnostic accuracy [3, 4], observational studies [5], systematic reviews [6, 7], and publication and outcome reporting bias [8, 9].”
Abdi, A. A., Juarez, J. G., Harris, T., Magalhães, T., & Hamer, G. L. (2026) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0013914 · Cited by 1
Kyriazos, T. A., & Poga, M. (2026) · Behavior Research Methods · doi:10.3758/s13428-025-02920-y · Cited by 1
“…multiple quantitative research domains; its detectability and auditability under transparent reporting norms; and its suitability for simulation-based demonstration with realistic design parameters (Chan et al., 2004; Dwan et al., 2013; Fraser et al., 2018; Head et al., 2015; John et al., 2012).”
Farquhar, H. (2026) · Clinical Trials · doi:10.1177/17407745261491903 · Cited by 1
Reframing Basic Experimental Studies in Humans—Implications for Nutrition Science
Bremer, A. A. (2026) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2026.101345 · Cited by 1
Rothwell, W. J. (2026) · International Journal of AI in Pedagogy Innovation and Learning Futures · doi:10.46787/ijaipil.v1i1.7602 · Cited by 1
Navigating the Prescription Drug Information System
Wang, I. V., Davis, C., Forrest, R., Cherla, A., Siebert, M., Cowden, J., Walker, S. A., Krishnamurti, T., Bourgeois, F. T., Woloshin, S., et al. (2026) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.70401 · Cited by 1
Khriesat, M. W., Qandeel, M., Elrefae, A., & Alhalawani, A. (2026) · European Journal of Orthopaedic Surgery & Traumatology · doi:10.1007/s00590-026-04913-9 · Cited by 1
“When results remain unpublished, not only is this social contract violated, but it also introduces publication bias that distorts systematic reviews and clinical guidelines [19].”
Barrington, H., Craven, R., Williamson, P. R., & Young, B. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-111017 · Cited by 1
“24 Core outcome sets (COS) have been developed to address these three challenges in clinical trials.”
Self-citationAlviz-Meza, A., Valencia-Arias, A., Díaz, F., Motta, B., & Hernández, G. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8110349 · Cited by 1
Wainwright, L. D., Haddock, G., Dunster-Page, C., & Berry, K. (2021) · British Journal of Mental Health Nursing · doi:10.12968/bjmh.2018.0023 · Cited by 1
Protocol-writing support conferences for investigator-initiated clinical trials
Goto, M., Muragaki, Y., & Aruga, A. (2016) · Open Access Journal of Clinical Trials · doi:10.2147/oajct.s97792 · Cited by 1
“or omitted.(19) With appropriate outcome discussions, we might prevent changes.”
BackgroundHow publication bias and inadequate research transparency endanger medicine
Mayer, M. G. (2016) · JAAPA · doi:10.1097/01.jaa.0000483095.89264.81 · Cited by 1
7. Ethics in Clinical Research (2)
Nishimoto, N., & Ogasawara, K. (2017) · Japanese Journal of Radiological Technology · doi:10.6009/jjrt.2017_jsrt_73.1.69 · Cited by 1
Warum die Deutsche Gesellschaft für Neurologie einen industrieunabhängigen Kongress braucht
Lempert, T., Janzen, R. W. C., Diehl, R. R., Stark, E., Paul, F., Wilke, C., Tavakolian, R., Völzke, E., von Brevern, M., & Möller, P. (2018) · Aktuelle Neurologie · doi:10.1055/a-0584-5717 · Cited by 1
“Hinzu kommt ein Selektionsbias, der die Publikation positiver Ergebnisse favorisiert [8].”
BackgroundKim, S.-Y., Won, J., Park, H., & Lee, H. (2018) · Korean Journal of Acupuncture · doi:10.14406/acu.2018.009 · Cited by 1
Azouaghe, O. (2018) · Veterinary Record · doi:10.1136/vr.k2819 · Cited by 1
The science reproducibility crisis and the necessity to publish negative results
Martín-Moro, J. G. (2017) · Archivos de la Sociedad Española de Oftalmología (English Edition) · doi:10.1016/j.oftale.2017.07.009 · Cited by 1
Imrey, P. B. (2019) · Journal of the American Society of Nephrology · doi:10.1681/asn.2019010057 · Cited by 2
Bausell, R. B. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197536537.003.0002 · Cited by 1
Boonyapo, U., Rushton, A., Heneghan, N. R., Dilokthornsakul, P., Phungwattanakul, N., & Wiangkham, T. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060373 · Cited by 1
Vedula, S. S., Hróbjartsson, A., & Page, M. J. (2022) · Springer eBooks · doi:10.1007/978-3-319-52636-2_183 · Cited by 1
Liu, Y., Liu, S., Jia, X., & Liu, R. (2022) · Gene · doi:10.1016/j.gene.2022.146763 · Cited by 1
Hu, T., Long, Y., Chen, R., Yang, Z., Liu, L., Huang, L., Huang, J., Liao, G., & Du, L. (2022) · Acupuncture in Medicine · doi:10.1177/09645284221108215 · Cited by 2
“Range of motion (10): WOMAC stiffness score (8); stiffness (3); active knee flexion (2); passive range of motion (2)”
BackgroundPreregistration and Transparency in the Research Process
Mellor, D. J. (2021) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1679938 · Cited by 1
Un plan d’action pour l’édition Diamant
Borrell-Damián, L., & Rooryck, J. (2022) · doi:10.4000/books.oep.15942 · Cited by 1
Nair, S. (2022) · doi:10.4000/books.oep.15859 · Cited by 1
Open Science, Publications and Code
Harrison, M. (2022) · doi:10.4000/books.oep.16187 · Cited by 1
The role of Infrastructure for Software in Open Science
Lucke, U. (2022) · doi:10.4000/books.oep.16184 · Cited by 1
Gabriel, M. (2022) · doi:10.4000/books.oep.16089 · Cited by 1
Moutsinas, G. A., Καραματσούκη, Α., & Καραγιαννίδης, Χ. (2022) · Περιβαλλοντική Εκπαίδευση για την Αειφορία · doi:10.12681/ees.30637 · Cited by 1
Liu, H., Su, C., Li, Z., Yue, S., Cheng, S., & Peng, D. (2023) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12644 · Cited by 1
The need for core outcome sets in renal cancer clinical effectiveness research
MacLennan, S., Wintner, L. M., Omar, M. I., Beyer, K., Lawlor, A., Tripathee, S., Dabestani, S., Marconi, L. S., Giles, R. H., Woodward, R., et al. (2023) · Mini-invasive Surgery · doi:10.20517/2574-1225.2023.66 · Cited by 1
Tail Fan Necrosis syndrome in decapod crustaceans: A review
Jones, J. B., Brosnahan, C. L., & Pande, A. (2024) · Journal of Fish Diseases · doi:10.1111/jfd.13920 · Cited by 1
FAIR reporting of clinical trials for public health practice
Balas, E. A., Bussi, B. S., Asem, N., Amour, C., Mwanziva, C. E., Vasquez, J., Labib, N. A., Price, M., Mahande, M. J., Baskar, R., et al. (2024) · Proceedings of the European Academy of Sciences and Arts · doi:10.4081/peasa.19 · Cited by 2
“According to Dwan et al. 14 and Ioannidis, 15 51·8% and 55% of clinical trials yielding negative results remain unpublished, respectively.”
ResultNeves, M. M., Klein, S. G., Silva, R. C., Bernardes, L. M. M., Malta, S. M., Vieira, T. N., Rosa, R. B., de Lima, I. L., Ferreira, F. B., & da Silva, M. V. (2024) · Frontiers in Veterinary Science · doi:10.3389/fvets.2024.1394113 · Cited by 1
Corporate Corruption: A Scoping Review and a Dynamic Model of Its Antecedents
Fornerod, L., Mugellini, G., & Villeneuve, J. (2026) · Journal of Business Ethics · doi:10.1007/s10551-026-06431-4 · Cited by 1
Bias is the key challenge in orthodontic research
Saltaji, H. (2015) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2015.04.014 · Cited by 1
“These biases have been shown to overestimate the magnitude of the treatment effects of the clinical trials and can skew the overall conclusions in meta-analyses.(4) The most effective and efficient way to detect either of them is to review the trial registries.”
BackgroundWatson, A. D. (2016) · uO Research (University of Ottawa) · doi:10.20381/ruor-5731 · Cited by 1
“…they are more likely to submit their research for publication when it yields significant results, especially since studies that yield positive results are more often cited, thus attracting more professional clout, than publications with negative results (Dwan et al. 2013; Easterbrook et al. 1991).”
ResultReasons for scientific rigor and skepticism revisited
Levi, R. (2016) · Acta Neurochirurgica · doi:10.1007/s00701-016-2973-3 · Cited by 1
The genetic control of agricultural pests (Plutella xylostella, L. and Tribolium castaneum, Herbst)
Gregory, M. W. (2015) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-yebb5rp9o · Cited by 2
Designing a self-management intervention for stroke survivors with communication difficulties
Wray, F. (2017) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 1
Should You Register Your Study as a Clinical Trial?
Kovach, C. R. (2019) · Research in Gerontological Nursing · doi:10.3928/19404921-20190207-02 · Cited by 1
Lowering the P Value Threshold—Reply
Wayant, C., Scott, J., & Vassar, M. B. (2019) · JAMA · doi:10.1001/jama.2019.0574 · Cited by 1
Spillover and emergence of bat-origin viral infections
Glennon, E. E. (2021) · Apollo (University of Cambridge) · doi:10.17863/cam.72070 · Cited by 1
Souza, N. V. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.23.2021.tde-10112021-140837 · Cited by 1
Publication Bias and Evidential Value in Speech, Language, and Hearing ResearchPreprint
Alexander, J., & Green, J. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/vncbs · Cited by 1
Actions for Increasing the Credibility of Educational ResearchPreprint
Carvalho, P. F., Cook, B. G., de Leeuw, J. R., Fyfe, E. R., Gehlbach, H., Goldstone, R. L., Makel, M. C., Mellor, D. T., Montoya, A. K., Motz, B. A., et al. (2019) · EdArXiv (OSF Preprints) · doi:10.35542/osf.io/tv7rn · Cited by 2
Publication Bias in Psychology
Kühberger, A. (2023) · Oxford University Press eBooks · doi:10.1093/obo/9780199828340-0307 · Cited by 3
Being positive about negatives: why publishing negative results is good for veterinary science
Boxer, E. (2024) · Veterinary Record · doi:10.1002/vetr.4362 · Cited by 1
Evidence-based Methodological Framework for Machine Learning StudiesPreprint
Walczak, J. (2025) · doi:10.36227/techrxiv.174803567.76355063/v1 · Cited by 3
Scientist as Subject: How Researcher Behaviors Influence Psychological KnowledgePreprint
Fox, N. W. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6m7cn · Cited by 1
Replicability: Terminology, Measuring Success, and StrategyPreprint
Stahel, W. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.19070 · Cited by 1
“…Nelson and Simonsohn 2011) selecting, among different possibilities of analyzing the data, the one that gives the largest effect; • reporting bias (Dwan, Gamble, Williamson and Kirkham 2013) including confirmation bias (Munaf`o et al. 2017) focussing on the effects that appear most significant…”
Como tornar mais confiável a pesquisa publicada
Ioannidis, J. P. A. (2015) · Acimed · doi:10.36512/rcics.v26i2.791
Reporting N-of-1 Trials to Professional Audiences
Sampson, M., Shamseer, L., & Vohra, S. (2015) · Springer eBooks · doi:10.1007/978-94-017-7200-6_14
Metadata
- Authors
- Dwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group
- Affiliations
- University of Liverpool (GB)
- Corresponding author
- Dwan, Kerry
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-07-05
- Volume
- 8
- Issue
- 7
- Pages
- e66844
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3702538
- OpenAlex
- W2002062153
- Cited by
- 1,127
- References
- 69
- Citations by year
- 2026: 75 · 2025: 84 · 2024: 64 · 2023: 71 · 2022: 127 · 2021: 98 · 2020: 112 · 2019: 89 · 2018: 83 · 2017: 102 · 2016: 89 · 2015: 70 · 2014: 57 · 2013: 5
- FWCI
- 15.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- SERVAL (Université de Lausanne) (publishedVersion, cc-by)
- IRIS (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Tufts Medical Center
- King's College London
- University of Oxford
- University of Bristol
- University of Sydney
- Queen's University
- Women's College Hospital
- Centre Hospitalier Universitaire Vaudois
- Hospices Civils de Lyon
- Moorfields Eye Hospital NHS Foundation Trust
- School of Medicine, Stanford University
- Tufts University School of Medicine
- Medical Research Council
- National Health and Medical Research Council
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- publication bias, selective reporting, randomized controlled trials, meta-analysis validity, trial reporting quality, primary outcome reporting
- MeSH terms
- Humans, Publications, Cohort Studies, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.