Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias — An Updated Review
Open accessThe DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias and outcome reporting bias have been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. METHODOLOGY/PRINCIPAL FINDINGS: In this update, we review and summarise the evidence from cohort studies that have assessed study publication bias or outcome reporting bias in randomised controlled trials. Twenty studies were eligible of which four were newly identified in this update. Only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Fifteen of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: This update does not change the conclusions of the review in which 16 studies were included. Direct empirical evidence for the existence of study publication bias and outcome reporting bias is shown. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Figure 3 Status of approved protocols for Chan 2004b study [17].](https://figures.cochat.ai/paper-figures/83600bbc5644401caed195b486efac8f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-3.jpg)
![Figure 4 Status of approved protocols for Easterbrook 1991 study [24].](https://figures.cochat.ai/paper-figures/0a114dad26924772826758941018f42f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-4.jpg)
![Figure 5 Status of approved protocols for Dickersin 1992 study [23].](https://figures.cochat.ai/paper-figures/1453f80dcd014ca3b9b32399777cc8d3/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-5.jpg)
![Figure 6 Status of approved protocols for Dickersin 1993 study [3].](https://figures.cochat.ai/paper-figures/1e175d9e8b2a4f0390577db97b820ca8/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-6.jpg)
![Figure 7 Status of approved protocols for Stern 1997 study [4].](https://figures.cochat.ai/paper-figures/876f2f4683aa40a689e73241856ecb1f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-7.jpg)
![Figure 8 Status of approved protocols for Cooper 1997 study [19].](https://figures.cochat.ai/paper-figures/beceb71fe2a943b2ba35a9fc9d17293b/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-8.jpg)
![Figure 9 Status of trials for Wormald 1997 study [30].](https://figures.cochat.ai/paper-figures/f6a16e454252431f84d6cc28737b2e50/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-9.jpg)
![Figure 10 Status of approved protocols for Ioannidis 1998 study [5].](https://figures.cochat.ai/paper-figures/261662c83e664841aaa276cbc7c62394/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-10.jpg)
![Figure 11 Status of approved protocols for Pich 2003 study [27].](https://figures.cochat.ai/paper-figures/48fe85db48fc4b6ca22f25bb5580c0a7/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-11.jpg)
![Figure 12 Status of approved protocols for Cronin 2004 study [20].](https://figures.cochat.ai/paper-figures/8d211a89740e4b67b0c80783ab9c0582/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-12.jpg)
![Figure 13 Status of approved protocols for Decullier 2005 study [7].](https://figures.cochat.ai/paper-figures/c7868be91276448192f71187c860c7a5/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-13.jpg)
![Figure 14 Status of approved protocols for Decullier 2006 study [22].](https://figures.cochat.ai/paper-figures/4859f8920e714475a966997babd4cb7a/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-14.jpg)
![Figure 15 Status of approved protocols for Hahn 2002 study [26].](https://figures.cochat.ai/paper-figures/69f971391f504ed4bae3d24d4a05f2c1/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-15.jpg)
![Figure 16 Status of approved protocols for Chan 2004a study [18].](https://figures.cochat.ai/paper-figures/933f83ab86634ea581351235ceea1e11/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-16.jpg)
![Figure 17 Status of approved protocols for Ghersi 2006 study [25].](https://figures.cochat.ai/paper-figures/97881d16700f4ed48102dec8fc05b22b/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-17.jpg)
![Figure 18 Status of approved protocols for von Elm 2008 study [29].](https://figures.cochat.ai/paper-figures/90d1c2ab102849719682b2f8f8409206/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-18.jpg)
![Figure 19 Status of approved protocols for Turer 2007 study [28].](https://figures.cochat.ai/paper-figures/ef99b99be5ff4105970df8c239918ce4/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-19.jpg)
![Figure 20 Status of approved protocols for De Jong 2010 study [21].](https://figures.cochat.ai/paper-figures/bf16aa205a3c4592aa0e050025754624/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-20.jpg)
![Figure 21 Status of approved protocols for Blumle 2008 study [31].](https://figures.cochat.ai/paper-figures/f70bc7510f114d9ba3b2e1e1e342ba98/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-21.jpg)
![Figure 22 Status of approved protocols for Hall 2007 study [32].](https://figures.cochat.ai/paper-figures/577511f26e0441a6bbc7643a3998c183/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-22.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Clinical trial registries provide the ability to measure biases in the reporting of clinical trials that arise due to non-publication, delayed publication, or incomplete publication of results [14].”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Many publications of randomized clinical trials of hypnosis interventions have been unclear or incomplete in reporting of the design elements that are necessary for the evaluation of the quality of evidence, 13 or have not provided sufficient details for possible direct replication.14,15”
From Best Practice Recommendations for Conducting and Reporting Controlled Trials in Clinical Hypnosis Research (2024) · cites this paper as [13]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“studies with statistically non-significant results may not have been submitted for publication (publication bias), or particular results that were statistically non-significant may have been omitted from study reports (selective non-reporting bias).”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [83]
The cited source says what the claim attributes to it.
In the citing paper
“Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias.”
From Systematic review protocol assessing the processes for linking clinical trial registries and their published results (2016) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Despite providing important information relevant to patients, trials with statistically non-significant results are more prone to non-publication,114 or, when published, to a long delay to publication114 115 116—often referred to as publication bias.”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [116]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 12×
“Easterbrook et al [24] found that compared with unfunded studies, government funded studies were more likely to yield statistically significant results but government sponsorship was not found to have a statistically significant effect on the likelihood of publication and company sponsored trials were less likely to b…”
BackgroundMethodResultInfluentialSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435 · cited 1×
“Several studies investigated a cohort of trials submitted to drug licensing authorities [38,40,41,65] and all found that many of these trials remain unpublished, with one study demonstrating that trials with positive outcomes resulted more often in submission of a final report to the regulatory authority [40].”
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,412
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368 · cited 2×
“While much effort has been invested in trying to identify the former [2], it is equally important to understand the nature and frequency of missing data from the latter level.”
BackgroundChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 29×
“The main objective of the study by Blumle et al [31] was to consider how eligibility criteria stated in protocols was reported in subsequent reports, in doing so they noted that 52% of studies in their cohort were published, decreasing to 48% for RCTs only.”
BackgroundMethodInfluentialSystematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 6×
“Since the original version of this review was published [13], a Cochrane methodology review is now available on publication bias [64].”
BackgroundMethodInfluentialSelf-citationPublication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Self-citationDissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039 · cited 2×
“While much effort has been invested in trying to identify the former [1,2], it is equally important to understand the nature and frequency of missing data from the latter level.”
Background
Research works printed but not linked: 2
- Menzel S, Uebing B, Hucklenbroich P, Schober O (2007) Evaluation of clinical trials following an approval from a research ethics committee. Dtsch Med Wochenschr 132: 2313– 2317. 17957593
- Chappell L, Alfirevic Z, Chien P, Jarvis S, Thornton JG (2005) A comparison of the published version of randomized controlled trials in a specialist clinical journal with the original trial protocols; Chicago.
Cited by
Items 701–800 of 1,001
Chen, Y. S., Mollayeva, T., Fitzpatrick, R. L., Sant’Ana, T. T., Farina, F. R., Swiatek, D., Sopidou, K., Tabilo, E., Betka, M. M., Leroi, I., et al. (2025) · Brain and Behavior · doi:10.1002/brb3.71100 · Cited by 4
“To minimize the potential for such bias, we implemented several strategies, including conducting literature searches with attempts to locate grey literature and unpublished studies and assessing reporting bias in outcomes of included studies (Dwan et al. 2013).”
Karaca, F. A., Özkan, H., & Apay, S. E. (2026) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-025-08589-7 · Cited by 5
van Schie, K., & van Veen, S. C. (2025) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2025.102155 · Cited by 5
How long does it take to complete and publish a systematic review of animal studies?
Bugajska, J., Hild, B. F., Brüschweiler, D., Meier, E., Bannach‐Brown, A., Wever, K. E., & Ineichen, B. V. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02672-5 · Cited by 4
“This pattern has been observed in clinical trials, where studies with statistically significant or “positive” results are more likely to be published and published more quickly than those with non-significant findings [29, 30].”
Mayer, M. G. (2015) · F1000Research · doi:10.12688/f1000research.6878.1 · Cited by 5
50 Tips for Clinical Trialists
Harvey, L. A., Glinsky, J. V., & Herbert, R. (2017) · Brain Impairment · doi:10.1017/brimp.2017.30 · Cited by 5
Reporting Guidelines for Imaging Research
McInnes, M. D. F., Lim, C. S., van der Pol, C. B., Salameh, J., McGrath, T. A., & Frank, R. A. (2018) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2018.11.008 · Cited by 7
Infrequent use of clinical trials registries in published systematic reviews in urology
Aro, T., Koo, K., & Matlaga, B. R. (2019) · World Journal of Urology · doi:10.1007/s00345-019-02914-4 · Cited by 4
“Moreover, the terminology used by some studies in stating ‘no significant results’ may be ambiguous, potentially complicating interpretation and application to all outcomes, secondary outcomes, or other measures of harm or efficacy, which may result in overlap between publication bias and outcome reporting bias [4].”
Cuyúl-Vásquez, I., Leiva-Sepúlveda, A., Catalán-Medalla, O., & Berríos-Contreras, L. (2020) · Rehabilitación · doi:10.1016/j.rh.2020.01.005 · Cited by 5
Kleykamp, B. A., Ferguson, M. C., McNicol, E. D., Bixho, I., Matthews, M. L., Turk, D. C., Dworkin, R. H., & Strain, E. C. (2022) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2022.109447 · Cited by 5
Assessing the uptake of infertility core outcome set in IVF randomized controlled trials
Li, W., Jia, N., Chi, H., Zhan, S., & Zeng, L. (2024) · Human Reproduction · doi:10.1093/humrep/deae255 · Cited by 5
O’Kelly, F., Nason, G. J., Bell, S., Galbraith, A., McLoughlin, L. C., Quinlan, D. M., & Thornhill, J. A. (2015) · Journal of Clinical Urology · doi:10.1177/2051415814565200 · Cited by 5
Hernandez, H. P., Urrútia, G., Meerpohl, J. J., Marušić, A., Wager, E., & Bonfill, X. (2017) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12692 · Cited by 5
O’Brien, C. (2018) · Fisher Digital Publications (St. John Fisher College) · Cited by 5
Dunn, A. G., Orenstein, L., Coiera, E. W., Mandl, K. D., & Bourgeois, F. T. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.01.009 · Cited by 4
Bobbert, M., & Scherzinger, G. (2019) · Springer eBooks · doi:10.1007/978-3-658-24758-4_7 · Cited by 4
Ayorinde, A., Williams, I., Mannion, R., Song, F., Skrybant, M., Lilford, R. J., & Chen, Y. (2020) · Health Services and Delivery Research · doi:10.3310/hsdr08330 · Cited by 6
Suicidality among children and youth in Nordic child welfare services: A systematic review
Milde, A. M., Gramm, H. B., Paaske, I., Kleiven, P. G., Christiansen, Ø., & Havnen, K. J. S. (2021) · Child & Family Social Work · doi:10.1111/cfs.12832 · Cited by 4
“All the included studies are cohort studies, which are at the lower end of empirical evidence (Dwan et al. 2013).”
BackgroundMcGauran, N., & Wieseler, B. (2021) · Journal of European CME · doi:10.1080/21614083.2021.1989172 · Cited by 4
Riesgo de sesgo de publicación en intervenciones terapéuticas para la COVID-19
Hasdeu, S., & Tortosa, F. G. (2021) · Revista Panamericana de Salud Pública · doi:10.26633/rpsp.2021.157 · Cited by 4
Surian, D., Bourgeois, F. T., & Dunn, A. G. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01485-6 · Cited by 4
What’s Right and Wrong in Preclinical Science: A Matter of Principled Investigation
Smith, L. N. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.805661 · Cited by 4
What’s in Your File Drawer? The Case of the Missing Null in Criminology and Criminal Justice
Crow, M. S., Smykla, J. O., O’Brien, H., Cerna, T., Johnson, A., Pisaris, S., Suarez, M., & Wilder, J. (2022) · Crime & Delinquency · doi:10.1177/00111287221090959 · Cited by 4
“Scholars in the physical, social, and biological sciences have defined it similarly (Dickersin & Min, 1993; Dwan et al., 2013; Easterbrook et al., 1991; Fanelli, 2010a; Franco et al., 2014; Gerber & Malhotra, 2008a, 2008b; Krimsky, 2013; May, 2021; Rothstein, 2008; Scherer et al., 1994; West et al., 2020; Wooditch et…”
BackgroundSargeant, J. M., O'Connor, A. M. C., LeBlanc, S. J., & Winder, C. B. (2022) · Journal of Dairy Science · doi:10.3168/jds.2022-22015 · Cited by 5
“Comparisons of outcomes reported in trial protocols and in subsequent publications for human trials suggest that outcomes with statistically significant results are more likely to be reported (Dwan et al., 2013).”
ResultBryant, A., Grayling, M. J., Elattar, A., Gajjar, K. B., Craig, D., Vale, L. D., & Naik, R. (2022) · American Journal of Therapeutics · doi:10.1097/mjt.0000000000001548 · Cited by 4
Özkaya, P. G. (2022) · Ana Dili Eğitimi Dergisi · doi:10.16916/aded.1153302 · Cited by 4
Ramírez, M., Haddad, S., Carreto, A. P., Frutos, A. C. G. D., Núñez-Pereira, S., & Pellisé, F. (2023) · Spine · doi:10.1097/brs.0000000000004855 · Cited by 4
“15,16 This has motivated recent interest in developing a core measurement set for DCM 9,17,18 and the recommendations to use a set of multiple subjective and objective measures.”
BackgroundKowalski, C., Jena, S., Kliemann, D., & Antes, G. (2015) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2015.09.009 · Cited by 4
Knowledge Valorisation for Inclusive Innovation and Integrated African Development
Trust Saidi (2018) · Advances in African economic, social and political development · doi:10.1007/978-3-319-92180-8_7 · Cited by 4
Kanukula, R., Dhurjati, R., Vidyasagar, K., Rehana, N., Talari, A., Salam, A., Rodgers, A., & Page, M. J. (2021) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2021-111675 · Cited by 5
Mayo-Wilson, E., Chen, X., Qureshı, R., Dickinson, S., Golzarri‐Arroyo, L., Hong, H., Görg, C., & Li, T. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047785 · Cited by 4
F1000Research: Tics welcomes you to 21st century biomedical publishing
BLACK, K. J. (2014) · F1000Research · doi:10.12688/f1000research.5664.1 · Cited by 5
The need for consensus, consistency, and core outcome sets in perioperative research
Blazeby, J. M., Williamson, P. R., & Altman, D. G. (2015) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-015-0529-2 · Cited by 4
Self-citationIchikawa, I., & Clayton, E. W. (2016) · Accountability in Research · doi:10.1080/08989621.2016.1144478 · Cited by 4
“Physicians and investigators are quite susceptible to these practices, despite their protests to the contrary (Bero, 2013; Dwan et al., 2013).”
BackgroundPrincípios de Hong Kong para a Avaliação de Pesquisadores: Promovendo a Integridade em Pesquisa
Moher, D., Bouter, L. M., Kleinert, S., Glasziou, P., Sham, M. H., Barbour, V., Coriat, A., Foeger, N., & Dirnagl, U. (2020) · doi:10.21452/abec.2021.abec.001 · Cited by 5
“, resultados primários alterados sem divulgação, bem como spin) é de cerca de 30% [26].”
BackgroundProbabilistic forecasting of replication studiesPreprint
Pawel, S., & Held, L. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/fhwb7 · Cited by 4
Chu, T. L. (2018) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc1248411 · Cited by 15
Paludan-Müller, A. S., Ogden, M. C., Marquardsen, M., Jørgensen, K. J., & Gøtzsche, P. C. (2021) · BMC Medical Ethics · doi:10.1186/s12910-021-00681-9 · Cited by 3
Dong, H., Gerdle, B. U. C., & Dragioti, E. (2022) · Journal of Pain Research · doi:10.2147/jpr.s362913 · Cited by 4
“Lack of specificity on such outcome domains may also bias SR conclusions.(63) Reporting many outcomes in SRs did not increase the quality of the SRs as a negative correlation was found between AMSTAR2 rating and total number of outcomes.”
BackgroundGrancher, A., Cuissy, S., Girot, H., Gillibert, A., Fiore, F. D., & Guittet, L. (2024) · Molecular Oncology · doi:10.1002/1878-0261.13734 · Cited by 3
Xing, X., Lin, L., Murad, M. H., & Tong, J. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70047 · Cited by 4
“When meta ‐ analyses are conducted on this biased subset, the pooled estimate can be distorted and inflated, diverging from the true effect [10 – 12].”
Silva, F. M., Adegboye, A. R. A., Curioni, C. C., Gomes, F., Collins, G. S., Kac, G., Cook, J. A., Ismail, L. C., Page, M. J., Khandpur, N., et al. (2026) · Nutrition Reviews · doi:10.1093/nutrit/nuaf218 · Cited by 3
Medizinische Forschung – Qualität vor Quantität
Hostettler, S., Kraft, E., & Bosshard, C. (2015) · Bulletin des Médecins Suisses · doi:10.4414/saez.2015.04171 · Cited by 3
Protocol of a Clinical Trial: Elements, Concerns and Potential Solutions
Shrivastava, S. R. (2015) · Biology and Medicine · doi:10.4172/0974-8369.1000228 · Cited by 3
Redulla, R. R. (2016) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000089 · Cited by 3
Karlsson, P., Bergmark, A., & Lundström, T. (2016) · International Journal of Social Welfare · doi:10.1111/ijsw.12240 · Cited by 3
Metaepidemiologie und Qualitätssicherung klinischer Evidenzproduktion
Haring, R. (2017) · Springer eBooks · doi:10.1007/978-3-662-55377-0_4 · Cited by 3
El‐Boghdadly, K., Abdallah, F. W., Short, A., Vorobeichik, L., Memtsoudis, S. G., & Chan, V. W. S. (2019) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000000578 · Cited by 3
Maggin, D. M., Robertson, R. E., & Cook, B. G. (2020) · Behavioral Disorders · doi:10.1177/0198742920936619 · Cited by 5
“Evidence indicates publication bias is widespread across multiple fields of research (Chong et al., 2016; Dwan et al., 2013; Findley et al., 2016; Francis, 2012), including education and special education (e.”
BackgroundPublication Bias and Data Integrity: We All Have a Role to Play
Kaban, L. B., & Posnick, J. C. (2021) · Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.joms.2021.02.041 · Cited by 3
Keestra, S., Rodgers, F., Lenz, D., Osborne, R., Brückner, T., & Lee, S. (2021) · Trials · doi:10.1186/s13063-021-05330-5 · Cited by 3
“sults often remain unpublished, particularly if ‘negative’ or not statistically significant [2].”
BackgroundStudy Registration for the Field of Prevention Science: Considering Options and Paths Forward
Spybrook, J. K., Maynard, R. A., & Anderson, D. (2021) · Prevention Science · doi:10.1007/s11121-021-01290-z · Cited by 4
Cheng, X., Wang, H., Zheng, Z., Feng, K., Tang, S., Liu, Y., Chen, K., Bi, C., Gao, M., & Ji, L. (2021) · Medicine · doi:10.1097/md.0000000000028462 · Cited by 4
Density strips: visualisation of uncertainty in clinical data summaries and research findings
Weir, C. J., & BOWMAN, A. W. (2021) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2021-111746 · Cited by 3
“The density strip may be readily applied using R package denstrip , 4 or through the R functions used to create the figures in this article which are available in online supplemental file 3.”
MethodLiu, A., Yu, W., Chen, J., Guo, T., Niu, P., Feng, H., & Jia, Y. (2022) · Stem Cells and Development · doi:10.1089/scd.2022.0060 · Cited by 3
“Generally speaking, journals are more likely to publish positive results, while studies with negative results are often difficult to be published [99].”
Assessing the Risk of Bias in Randomized Trials
Page, M. J., Altman, D. G., & Egger, M. (2022) · Wiley eBooks · doi:10.1002/9781119099369.ch4 · Cited by 3
Kim, S., Mortera, M. H., Heyn, P. C., Sood, P., Wen, P.-S., Wong, D. C., Tanveer, S., & Hu, X. (2022) · Brain Injury · doi:10.1080/02699052.2022.2087102 · Cited by 4
“Studies with promising results are given more importance over the contrary; however, this should be discouraged as having publication bias can increase the possibility of overestimation of treatment effects (34,35).”
BackgroundZhong, L., Wu, C., Li, Y., Zeng, Q., Lai, L., Chen, S., & Tang, S. (2022) · Therapeutic Advances in Chronic Disease · doi:10.1177/20406223221083508 · Cited by 4
Khozin, S., & Stein, R. M. (2022) · Biochimica et Biophysica Acta (BBA) - Reviews on Cancer · doi:10.1016/j.bbcan.2022.188825 · Cited by 3
“Most formal recommendations and treatment guidelines rely on the same body of evidence, in addition to the published literature which routinely omits negative studies [23 – 25].”
The research status and progress of core outcome set in oral health
Song, Y., Ren, L., Liu, J., Zeng, X. Y., Chen, Q., & Dan, H. (2022) · Oral Surgery Oral Medicine Oral Pathology and Oral Radiology · doi:10.1016/j.oooo.2022.11.002 · Cited by 3
Sujatmika, S., Lestari, E. S., & Affandy, H. (2022) · EDUSAINS · doi:10.15408/es.v14i1.23526 · Cited by 4
Proceedings of the Paris Open Science European Conference: OSEC 2022
Conference, O. S. E. (2022) · doi:10.4000/books.oep.15829 · Cited by 5
Building the Software Pillar of Open Science
Cosmo, R. D. (2022) · doi:10.4000/books.oep.16182 · Cited by 3
Sargeant, J. M., O'Connor, A. M. C., O’Sullivan, T. L., & Ramirez, A. (2023) · Journal of Swine Health and Production · doi:10.54846/jshap/1313 · Cited by 4
On the Inconsistency between Practice and Reporting in Science: The Genesis of Scientific Articles
Gonçalves, T. D. (2023) · Social Epistemology · doi:10.1080/02691728.2023.2209536 · Cited by 3
Stoll, M., Lindner, S., Marquardt, B., Salholz‐Hillel, M., DeVito, N., Klemperer, D., & Lieb, K. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-01991-9 · Cited by 4
Rivero‐de‐Aguilar, A., Pérez‐Ríos, M., Mascareñas‐García, M., Ruano‐Raviña, A., Ross, J. S., Acción, B. C., & Varela‐Lema, L. (2024) · Multiple Sclerosis Journal · doi:10.1177/13524585241273089 · Cited by 3
“Although we did not aim to evaluate the selective outcome reporting bias (an undue concealment of unfavourable outcome measures 33,34 ), these findings encourage additional studies on the matter.”
Credibility Matters: Mind the Gap
Skelly, A. C. (2014) · Evidence-Based Spine-Care Journal · doi:10.1055/s-0034-1371445 · Cited by 3
Use of Clinical Trial Registries in Otolaryngology Systematic Reviews
Fuller, K., Arthur, W., Riddle, J., & Vassar, M. B. (2019) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2019.0521 · Cited by 3
Erfassung von Core-Outcomes in Handekzemstudien
Rönsch, H., Bauer, A., & Apfelbacher, C. (2019) · Der Hautarzt · doi:10.1007/s00105-019-4453-1 · Cited by 3
Decullier, É., Tang, P. V., Huot, L., & Maisonneuve, H. (2021) · Scientometrics · doi:10.1007/s11192-020-03775-0 · Cited by 3
“Despite this responsibility, a 2013 meta-analysis found that the proportion of published trials was rather low, (Dwan 2013) and that there was publication bias.”
BackgroundMoro‐Tejedor, M. N., & Regaira‐Martínez, E. (2021) · Enfermería Intensiva · doi:10.1016/j.enfi.2020.12.001 · Cited by 3
Tarfa, R. A., Melder, K. L., Mady, L. J., & Eibling, D. E. (2021) · American Journal of Otolaryngology · doi:10.1016/j.amjoto.2021.103236 · Cited by 3
Nieuwenhuis, J. (2022) · Asian journal of social science · doi:10.1016/j.ajss.2022.07.001 · Cited by 3
Haddon, L., Cino, D., & Doyle, M.-A. (2023) · Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique · doi:10.1177/07591063221141730 · Cited by 5
“One particular concern of the literature on publication bias, is that results that are statistically significant are more likely to be published (Dwan et al., 2013).”
BackgroundDissemination of Research Results
Haven, T. L., & Strech, D. (2023) · Collaborative bioethics · doi:10.1007/978-3-031-29455-6_5 · Cited by 3
The low statistical power of psychological research: Causes, consequences and potential remedies
Thorn, F. S. (2020) · Minerva Access (University of Melbourne) · Cited by 6
Progression‐free survival 2: Is it ready for prime time?
George, B., & Kurzrock, R. (2022) · Cancer · doi:10.1002/cncr.34086 · Cited by 4
“There was a publication bias: trials with negative results were more likely to remain unpublished and thus be excluded from surrogacy measures.(6,7)”
BackgroundKumar, J., Prakash, V., Hariohm, K., & Kumar, I. N. (2023) · Physiotherapy Practice and Research · doi:10.3233/ppr-230747 · Cited by 2
Investigation of reporting bias in interrupted time series (ITS) studies: a study protocol
Nguyen, P., Turner, S., Korevaar, E., Forbes, A. B., Page, M. J., & McKenzie, J. E. (2024) · F1000Research · doi:10.12688/f1000research.145927.1 · Cited by 3
A Scoping Review of School-Based Nutrition and Physical Activity Interventions Conducted in Mexico
Rudner, N., Aboul-Enein, B. H., Blanco, S., Keller, T., & Dodge, E. (2025) · American Journal of Lifestyle Medicine · doi:10.1177/15598276251338019 · Cited by 2
Antipas, H., Tamplin, J., Sousa, T. V., & Baker, F. A. (2025) · Psychology and Health · doi:10.1080/08870446.2025.2527069 · Cited by 3
“The resulting ecosystem is limited by the data available that met all inclusion criteria for the review and may be subject to selection and reporting bias (Dwan et al., 2013).”
Statistical Power in Musculoskeletal Research: A Meta-Review of 266 Randomised Controlled Trials
Bleakley, C., Klempel, N., Wagemans, J., Netterström-Wedin, F., & Smoliga, J. M. (2025) · Sports Medicine - Open · doi:10.1186/s40798-025-00908-8 · Cited by 3
“Such small N studies are also more sensitive to analytic changes ( a posteriori ), drop outs, and selective reporting [30], raising further questions around the validity of evidence in this field.”
Interventional clinical trials registered per million population per country worldwide
Bjerg, J., Nikolova, D., & Gluud, C. N. (2025) · Trials · doi:10.1186/s13063-025-09185-y · Cited by 3
“These actions, together with activities like the AllTrials initiative, The Cochrane Collaboration, and many others, have been of great importance to oppose publication bias and promote an increase in registrations of unfinished or abandoned trials due to mostly unsatisfactory results [12–16].”
Roberts, E., Kalk, N. J., & Strang, J. (2026) · Addiction · doi:10.1111/add.70334 · Cited by 2
“The composite observational evidence is also subject to potential selection bias, given the propensity to publish cases descriptions in which treat-ment has been deemed successful [63].”
Christensen, R., Berthelsen, D. B., Tugwell, P., Golder, S., Qureshi, R., Mayo‐Wilson, E., Simon, L. S., Kwong, J. S., Williamson, P. R., & Vohra, S. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112218 · Cited by 3
Self-citationSottie, O. K., Meuwissen, M. P. M., Zepeda, A. C., Gavai, A., & Koppenberg, M. (2026) · Agricultural Systems · doi:10.1016/j.agsy.2026.104687 · Cited by 2
Oyeyemi, A. L., Ogunleye, A. B., Okafor, A. C., Kollipara, N., Chinapaw, M. J. M., & Omotoso, D. R. (2026) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-026-01904-1 · Cited by 2
Albiña-Palmarola, P., Khanafer, A., & Henkes, H. H. (2026) · Journal of Vascular Diseases · doi:10.3390/jvd5020018 · Cited by 2
“In fields where outcome definitions are already heterogeneous, selective reporting can further obscure the balance between benefit and harm (Figure 2) [34,35].”
Pozzi, J., D’Argenzio, J., Carriero, S., Cè, M., D’Arrigo, D., Lanza, C., Biondetti, P., Angileri, S. A., Pavan, M., Catona, R., et al. (2026) · Diagnostics · doi:10.3390/diagnostics16142266 · Cited by 2
Bhattacharya, S., Singh, A. K., Singh, A. K., Rishi, N. N., Bharti, S., Gupta, S. K., Gupta, N., Singh, A. K., Saxena, D., Sahish, S., et al. (2026) · Journal of Family Medicine and Primary Care · doi:10.4103/jfmpc.jfmpc_427_26 · Cited by 2
“[18,19] Statistical corrections cannot fully compensate for unpublished data.”
Name segmentation using hidden Markov models and its application in record linkage
Gonçalves, R. D. C. B., & Freire, S. M. (2014) · Cadernos de Saúde Pública · doi:10.1590/0102-311x00191313 · Cited by 2
Taking the “Goal-Directed” Out of Early Goal-Directed Therapy for Sepsis?
Crager, S. E. (2015) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2015.01.003 · Cited by 2
Taking the “Goal-Directed” Out of Early Goal-Directed Therapy for Sepsis?
Crager, S. E. (2015) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2015.06.016 · Cited by 2
“Recent systematic review articles have provided evidence that statistically significant outcomes are more likely to be fully reported than nonsignificant outcomes.(46,47) Publishing a statistical analysis plan ahead of time ensures transparency by creating an obligation for authors to either adhere to the predetermine…”
BackgroundKelling, N., Ward, C. P., Malin, D. H., Buras, W. R., & Hetherington, S. A. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601633 · Cited by 2
Bias and sample size in intensive care unit trials: Protocol for a meta‐epidemiological study
Anthon, C. T., Granholm, A., Perner, A., Laake, J. H., & Møller, M. H. (2018) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13258 · Cited by 2
Controlling Bias in Randomized Clinical Trials
BARTON, B. A. (2019) · Springer eBooks · doi:10.1007/978-3-319-52677-5_214-1 · Cited by 2
Publication of Positive Studies in the Urologic Literature
Rapp, D. E., Tuong, M. N. E., Zillioux, J. M., Patel, N., Shah, J., & Ballantyne, C. C. (2020) · Urology · doi:10.1016/j.urology.2020.06.098 · Cited by 2
Analysis of institutional conflict of interest and bias in research findings and reporting
Varady, N. H., Worsham, C. M., & Jena, A. B. (2021) · Healthcare · doi:10.1016/j.hjdsi.2020.100515 · Cited by 3
Open Science and Special Education Research
Cook, B. G., Beahm, L. A., Myers, A. M., VanUitert, V. J., & Wilson, S. E. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0735-004x20210000031005 · Cited by 2
Metadata
- Authors
- Dwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group
- Affiliations
- University of Liverpool (GB)
- Corresponding author
- Dwan, Kerry
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-07-05
- Volume
- 8
- Issue
- 7
- Pages
- e66844
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3702538
- OpenAlex
- W2002062153
- Cited by
- 1,127
- References
- 69
- Citations by year
- 2026: 75 · 2025: 84 · 2024: 64 · 2023: 71 · 2022: 127 · 2021: 98 · 2020: 112 · 2019: 89 · 2018: 83 · 2017: 102 · 2016: 89 · 2015: 70 · 2014: 57 · 2013: 5
- FWCI
- 15.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- SERVAL (Université de Lausanne) (publishedVersion, cc-by)
- IRIS (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Tufts Medical Center
- King's College London
- University of Oxford
- University of Bristol
- University of Sydney
- Queen's University
- Women's College Hospital
- Centre Hospitalier Universitaire Vaudois
- Hospices Civils de Lyon
- Moorfields Eye Hospital NHS Foundation Trust
- School of Medicine, Stanford University
- Tufts University School of Medicine
- Medical Research Council
- National Health and Medical Research Council
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- publication bias, selective reporting, randomized controlled trials, meta-analysis validity, trial reporting quality, primary outcome reporting
- MeSH terms
- Humans, Publications, Cohort Studies, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.