Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias — An Updated Review
Open accessThe DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias and outcome reporting bias have been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. METHODOLOGY/PRINCIPAL FINDINGS: In this update, we review and summarise the evidence from cohort studies that have assessed study publication bias or outcome reporting bias in randomised controlled trials. Twenty studies were eligible of which four were newly identified in this update. Only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Fifteen of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: This update does not change the conclusions of the review in which 16 studies were included. Direct empirical evidence for the existence of study publication bias and outcome reporting bias is shown. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Figure 3 Status of approved protocols for Chan 2004b study [17].](https://figures.cochat.ai/paper-figures/83600bbc5644401caed195b486efac8f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-3.jpg)
![Figure 4 Status of approved protocols for Easterbrook 1991 study [24].](https://figures.cochat.ai/paper-figures/0a114dad26924772826758941018f42f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-4.jpg)
![Figure 5 Status of approved protocols for Dickersin 1992 study [23].](https://figures.cochat.ai/paper-figures/1453f80dcd014ca3b9b32399777cc8d3/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-5.jpg)
![Figure 6 Status of approved protocols for Dickersin 1993 study [3].](https://figures.cochat.ai/paper-figures/1e175d9e8b2a4f0390577db97b820ca8/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-6.jpg)
![Figure 7 Status of approved protocols for Stern 1997 study [4].](https://figures.cochat.ai/paper-figures/876f2f4683aa40a689e73241856ecb1f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-7.jpg)
![Figure 8 Status of approved protocols for Cooper 1997 study [19].](https://figures.cochat.ai/paper-figures/beceb71fe2a943b2ba35a9fc9d17293b/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-8.jpg)
![Figure 9 Status of trials for Wormald 1997 study [30].](https://figures.cochat.ai/paper-figures/f6a16e454252431f84d6cc28737b2e50/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-9.jpg)
![Figure 10 Status of approved protocols for Ioannidis 1998 study [5].](https://figures.cochat.ai/paper-figures/261662c83e664841aaa276cbc7c62394/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-10.jpg)
![Figure 11 Status of approved protocols for Pich 2003 study [27].](https://figures.cochat.ai/paper-figures/48fe85db48fc4b6ca22f25bb5580c0a7/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-11.jpg)
![Figure 12 Status of approved protocols for Cronin 2004 study [20].](https://figures.cochat.ai/paper-figures/8d211a89740e4b67b0c80783ab9c0582/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-12.jpg)
![Figure 13 Status of approved protocols for Decullier 2005 study [7].](https://figures.cochat.ai/paper-figures/c7868be91276448192f71187c860c7a5/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-13.jpg)
![Figure 14 Status of approved protocols for Decullier 2006 study [22].](https://figures.cochat.ai/paper-figures/4859f8920e714475a966997babd4cb7a/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-14.jpg)
![Figure 15 Status of approved protocols for Hahn 2002 study [26].](https://figures.cochat.ai/paper-figures/69f971391f504ed4bae3d24d4a05f2c1/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-15.jpg)
![Figure 16 Status of approved protocols for Chan 2004a study [18].](https://figures.cochat.ai/paper-figures/933f83ab86634ea581351235ceea1e11/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-16.jpg)
![Figure 17 Status of approved protocols for Ghersi 2006 study [25].](https://figures.cochat.ai/paper-figures/97881d16700f4ed48102dec8fc05b22b/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-17.jpg)
![Figure 18 Status of approved protocols for von Elm 2008 study [29].](https://figures.cochat.ai/paper-figures/90d1c2ab102849719682b2f8f8409206/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-18.jpg)
![Figure 19 Status of approved protocols for Turer 2007 study [28].](https://figures.cochat.ai/paper-figures/ef99b99be5ff4105970df8c239918ce4/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-19.jpg)
![Figure 20 Status of approved protocols for De Jong 2010 study [21].](https://figures.cochat.ai/paper-figures/bf16aa205a3c4592aa0e050025754624/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-20.jpg)
![Figure 21 Status of approved protocols for Blumle 2008 study [31].](https://figures.cochat.ai/paper-figures/f70bc7510f114d9ba3b2e1e1e342ba98/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-21.jpg)
![Figure 22 Status of approved protocols for Hall 2007 study [32].](https://figures.cochat.ai/paper-figures/577511f26e0441a6bbc7643a3998c183/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-22.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Clinical trial registries provide the ability to measure biases in the reporting of clinical trials that arise due to non-publication, delayed publication, or incomplete publication of results [14].”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Many publications of randomized clinical trials of hypnosis interventions have been unclear or incomplete in reporting of the design elements that are necessary for the evaluation of the quality of evidence, 13 or have not provided sufficient details for possible direct replication.14,15”
From Best Practice Recommendations for Conducting and Reporting Controlled Trials in Clinical Hypnosis Research (2024) · cites this paper as [13]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“studies with statistically non-significant results may not have been submitted for publication (publication bias), or particular results that were statistically non-significant may have been omitted from study reports (selective non-reporting bias).”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [83]
The cited source says what the claim attributes to it.
In the citing paper
“Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias.”
From Systematic review protocol assessing the processes for linking clinical trial registries and their published results (2016) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Despite providing important information relevant to patients, trials with statistically non-significant results are more prone to non-publication,114 or, when published, to a long delay to publication114 115 116—often referred to as publication bias.”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [116]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 12×
“Easterbrook et al [24] found that compared with unfunded studies, government funded studies were more likely to yield statistically significant results but government sponsorship was not found to have a statistically significant effect on the likelihood of publication and company sponsored trials were less likely to b…”
BackgroundMethodResultInfluentialSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435 · cited 1×
“Several studies investigated a cohort of trials submitted to drug licensing authorities [38,40,41,65] and all found that many of these trials remain unpublished, with one study demonstrating that trials with positive outcomes resulted more often in submission of a final report to the regulatory authority [40].”
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368 · cited 2×
“While much effort has been invested in trying to identify the former [2], it is equally important to understand the nature and frequency of missing data from the latter level.”
BackgroundChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 29×
“The main objective of the study by Blumle et al [31] was to consider how eligibility criteria stated in protocols was reported in subsequent reports, in doing so they noted that 52% of studies in their cohort were published, decreasing to 48% for RCTs only.”
BackgroundMethodInfluentialSystematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 6×
“Since the original version of this review was published [13], a Cochrane methodology review is now available on publication bias [64].”
BackgroundMethodInfluentialSelf-citationPublication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Self-citationDissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039 · cited 2×
“While much effort has been invested in trying to identify the former [1,2], it is equally important to understand the nature and frequency of missing data from the latter level.”
BackgroundFull publication of results initially presented in abstracts.
Scherer, R. W., Langenberg, P., & von Elm, E. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000005.pub3 · Cited by 997 · cited 1×
“The Cochrane review by Scherer et al [6] investigating the full publication of results initially presented in abstracts found that only 63% of results from abstracts describing randomized or controlled clinical trials are published in full and ’positive’ results were more frequently published than non ’positive’ resul…”
BackgroundPublication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898 · cited 2×
“Since the original version of this review was published [13], a Cochrane methodology review is now available on publication bias [64].”
BackgroundDickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854 · cited 7×
“Information could not be located for four empirical studies [3,19,23,28].”
BackgroundResultInfluentialPublication bias: evidence of delayed publication in a cohort study of clinical research projects
Stern, J. M., & Simes, R. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.640 · Cited by 818 · cited 11×
“Stern et al [4] reported that this finding was even stronger for their subgroup of clinical trials (Hazard Ratio (HR) 3.13 (95% confidence interval (CI) 1.76, 5.58), p = 0.0001) compared to all quantitative studies (HR 2.32 (95% CI 1.47, 3.66), p = 0.0003).”
BackgroundMethodResultInfluentialComparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715 · cited 2×
“Obviously those studies that are not submitted are not published and it was found by Dickersin et al [62] that non-publication was primarily a result of failure to write up and submit the trial results rather than rejection of submitted manuscripts.”
BackgroundMelander, H., Ahlqvist-Rastad, J., Meijer, G., & Beermann, B. (2003) · BMJ · doi:10.1136/bmj.326.7400.1171 · Cited by 635
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632 · cited 27×
“The main objective of the study by Blumle et al [31] was to consider how eligibility criteria stated in protocols was reported in subsequent reports, in doing so they noted that 52% of studies in their cohort were published, decreasing to 48% for RCTs only.”
BackgroundInfluentialOutcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Chan, A.-W. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1041086 · Cited by 444 · cited 30×
“The main objective of the study by Blumle et al [31] was to consider how eligibility criteria stated in protocols was reported in subsequent reports, in doing so they noted that 52% of studies in their cohort were published, decreasing to 48% for RCTs only.”
BackgroundInfluentialPublication Bias in Editorial Decision Making
Olson, C. M. (2002) · JAMA · doi:10.1001/jama.287.21.2825 · Cited by 395 · cited 2×
“Olson et al [63] conducted a prospective cohort study of manuscripts submitted to JAMA and assessed whether the submitted manuscripts were more likely to be published if they reported positive results.”
BackgroundOutcome Reporting in Industry-Sponsored Trials of Gabapentin for Off-Label Use
Vedula, S. S., Bero, L., Scherer, R. W., & Dickersin, K. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0906126 · Cited by 361
Outcome Reporting Among Drug Trials Registered in ClinicalTrials.gov
Bourgeois, F. T., Murthy, S., & Mandl, K. D. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-3-201008030-00006 · Cited by 332
Soares, H. P., Daniels, S., Kumar, A., Clarke, M., Scott, C., Swann, S., & Djulbegovic, B. (2004) · BMJ · doi:10.1136/bmj.328.7430.22 · Cited by 313
NIH clinical trials and publication bias.
Dickersin, K., & Min, Y. (1993) · PubMed · Cited by 300
Comparison of protocols and registry entries to published reports for randomised controlled trials
Dwan, K., Altman, D. G., Cresswell, L., Blundell, M., Gamble, C. L., & Williamson, P. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000031.pub2 · Cited by 243
Self-citationReporting in randomized clinical trials improved after adoption of the CONSORT statement
Kane, R. L., Wang, J., & Garrard, J. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.06.016 · Cited by 227 · cited 1×
“Randomised controlled trials (RCTs) are planned experiments, involving the random assignment of participants to interventions, and are seen as the gold standard of study designs to evaluate the effectiveness of a treatment in medical research in humans [11].”
BackgroundBias in Meta-Analysis Due to Outcome Variable Selection Within Studies
Hutton, J. L., & Williamson, P. R. (2000) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00197 · Cited by 194 · cited 1×
“It has been defined as the selection on the basis of the results of a subset of the original variables recorded for inclusion in a publication [10].”
BackgroundSelf-citationEvolution of treatment effects over time: Empirical insight from recursive cumulative metaanalyses
Ioannidis, J. P. A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.021529998 · Cited by 192 · cited 1×
“This ‘‘time lag bias’’ (or ‘‘pipeline bias’’) will tend to add to the bias since results from early available evidence tend to be inflated and exaggerated [7,8].”
Outcome selection bias in meta-analysis
Williamson, P. R., Gamble, C., Altman, D. G., & Hutton, J. L. (2005) · Statistical Methods in Medical Research · doi:10.1191/0962280205sm415oa · Cited by 188 · cited 1×
“For example, selective reporting of analyses may include intention-to–treat analyses versus per–protocol analyses, endpoint score versus change from baseline, different time points or subgroups [11].”
BackgroundSelf-citationEffect sizes in cumulative meta-analyses of mental health randomized trials evolved over time
Trikalinos, T. A., Churchill, R., Ferri, M., Leucht, S., Tuunainen, A., Wahlbeck, K., & Ioannidis, J. P. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.02.018 · Cited by 177 · cited 1×
“This ‘‘time lag bias’’ (or ‘‘pipeline bias’’) will tend to add to the bias since results from early available evidence tend to be inflated and exaggerated [8,9].”
Fate of biomedical research protocols and publication bias in France: retrospective cohort study
Decullier, E., Lhéritier, V., & Chapuis, F. (2005) · BMJ · doi:10.1136/bmj.38488.385995.8f · Cited by 154 · cited 11×
“Status of approved protocols for Decullier 2005 study [7].”
BackgroundMethodResultInfluentialSystematic review of publication bias in studies on publication bias
Dubben, H.-H., & Beck-Bornholdt, H.-P. (2005) · BMJ · doi:10.1136/bmj.38478.497164.f7 · Cited by 153 · cited 1×
“Dubben et al [61] looked at whether study publication bias exists in studies which investigate the problem of study publication bias.”
BackgroundThe Quality of Registration of Clinical Trials
Viergever, R. F., & Ghersi, D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0014701 · Cited by 150
Finding the missing science: The fate of studies submitted for review by a human subjects committee.
Cooper, H., DeNeve, K., & Charlton, K. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.4.447 · Cited by 144 · cited 8×
“Status of approved protocols for Cooper 1997 study [19].”
BackgroundInfluentialIdentification and impact of outcome selection bias in meta‐analysis
Williamson, P. R., & Gamble, C. (2005) · Statistics in Medicine · doi:10.1002/sim.2025 · Cited by 132
Self-citationPublication Bias and Research on Passive Smoking: Comparison of Published and Unpublished Studies
Misakian, A. L., & Bero, L. A. (1998) · JAMA · doi:10.1001/jama.280.3.250 · Cited by 127 · cited 20×
“The main objective of the study by Blumle et al [31] was to consider how eligibility criteria stated in protocols was reported in subsequent reports, in doing so they noted that 52% of studies in their cohort were published, decreasing to 48% for RCTs only.”
BackgroundInfluentialKirkham, J. J., Riley, R. D., & Williamson, P. R. (2012) · Statistics in Medicine · doi:10.1002/sim.5356 · Cited by 119
Self-citationBlümle, A., Huwiler, K., & Witschi, M. (2008) · Swiss Medical Weekly · doi:10.4414/smw.2008.12027 · Cited by 115
Huić, M., Marušić, M., & Marušić, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025258 · Cited by 114
Role of a research ethics committee in follow-up and publication of results
Pich, J., Carné, X., Arnaiz, J.-A., Gómez, B., Trilla, A., & Rodés, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12799-7 · Cited by 104
Clinical trials and drug promotion: Selective reporting of study 329
Jureidini, J. N., McHenry, L. B., & Mansfield, P. R. (2008) · International Journal of Risk and Safety in Medicine · doi:10.3233/jrs-2008-0426 · Cited by 98
Hahn, S., Williamson, P. R., & Hutton, J. L. (2002) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2002.00314.x · Cited by 97 · cited 11×
“Four cohorts included only RCTs [17,18,25,29]; in the remaining cohort [26] the proportion of included RCTs was 13%.”
BackgroundMethodResultInfluentialSelf-citationStudy of information submitted by drug companies to licensing authorities.
Hemminki, E. (1980) · BMJ · doi:10.1136/bmj.280.6217.833 · Cited by 94 · cited 1×
“Several studies investigated a cohort of trials submitted to drug licensing authorities [22,23,42] and all found that many of these trials remain unpublished, with one study demonstrating that trials with positive outcomes resulted more often in submission of a final report to the regulatory authority [22].”
Ramsey, S., & Scoggins, J. (2008) · The Oncologist · doi:10.1634/theoncologist.2008-0133 · Cited by 82
Bias in reporting clinical trials
Bardy, A. H. (1998) · British Journal of Clinical Pharmacology · doi:10.1046/j.1365-2125.1998.00759.x · Cited by 69 · cited 2×
“This review included five studies, only one of which was not included in our review as it was not an inception cohort [40].”
Optimism bias leads to inconclusive results—an empirical study
Djulbegovic, B., Kumar, A., Magazin, A., Schroen, A. T., Soares, H., Hozo, I., Clarke, M., Sargent, D., & Schell, M. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.09.007 · Cited by 64
Assessing the potential for outcome reporting bias in a review: a tutorial
Dwan, K., Gamble, C., Kolamunnage-Dona, R., Mohammed, S., Powell, C., & Williamson, P. R. (2010) · Trials · doi:10.1186/1745-6215-11-52 · Cited by 63
Self-citationRasmussen, N., Lee, K., & Bero, L. (2009) · Trials · doi:10.1186/1745-6215-10-116 · Cited by 62
Publication bias in the medical literature: A review by a Canadian research ethics board
Hall, R., de Antueno, C., & Webber, A. (2007) · Canadian Journal of Anesthesia · doi:10.1007/bf03022661 · Cited by 54 · cited 13×
“Thus in total, the search strategy identified 20 eligible empirical studies (Figure 2), of which, four were newly included in this update [21,28,31,32].”
BackgroundResultInfluentialUndisclosed Changes in Outcomes in Randomized Controlled Trials: An Observational Study
Ewart, R., Lausen, H., & Millian, N. (2009) · The Annals of Family Medicine · doi:10.1370/afm.1017 · Cited by 50
Reveiz, L., Chan, A.-W., Krleža-Jerić, K., Granados, C. E., Pinart, M., Etxeandia, I., Rada, D., Martinez, M., Bonfill, X., & Cardona, A. F. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012484 · Cited by 47
Blümle, A., Antes, G., Schumacher, M., Just, H., & von Elm, E. (2008) · Journal of Medical Ethics · doi:10.1136/jme.2008.024521 · Cited by 47
Comparison of protocols and registry entries to published reports for randomised controlled trials
Dwan, K. (2011) · Journal of Evidence-Based Medicine · doi:10.1111/j.1756-5391.2011.01149.x · Cited by 38 · cited 2×
“Studies comparing trial publications to protocols or trial registries are also accumulating evidence on the proportion of studies in which at least one primary outcome was changed, introduced, or omitted [16].”
BackgroundResultSelf-citationTharyan, P., George, A. T., Kirubakaran, R., & Barnabas, J. P. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.11.011 · Cited by 37
Revéiz, L., Bonfill, X., Glujovsky, D., Pinzón, C. E., Lobos, C. A., Cortés-Jofré, M., Cañón, M., Bardach, A., Comandé, D., & Cardona, A. F. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.09.003 · Cited by 31
Application and investigation of a bound for outcome reporting bias
Williamson, P. R., & Gamble, C. (2007) · Trials · doi:10.1186/1745-6215-8-9 · Cited by 26
Self-citationGhersi, D. (2006) · The Sydney eScholarship Repository (The University of Sydney) · Cited by 19
Turer, A. T., Mahaffey, K. W., Compton, K. L., Califf, R. M., & Schulman, K. A. (2007) · American Heart Journal · doi:10.1016/j.ahj.2007.01.005 · Cited by 19 · cited 28×
“The main objective of the study by Blumle et al [31] was to consider how eligibility criteria stated in protocols was reported in subsequent reports, in doing so they noted that 52% of studies in their cohort were published, decreasing to 48% for RCTs only.”
BackgroundInfluentialImpact of funding on biomedical research: a retrospective cohort study
Decullier, E., & Chapuis, F. (2006) · BMC Public Health · doi:10.1186/1471-2458-6-165 · Cited by 18 · cited 8×
“Also, the fact that in six empirical studies [3,4,7,21,22,24] follow-up of trials was less than 90% could mean that the problem of study publication bias is underestimated in these cohorts.”
BackgroundMethodInfluentialFactors influencing the publication of health research
Cronin, E., & Sheldon, T. (2004) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462304001175 · Cited by 18 · cited 9×
“Eleven of the empirical studies [4,7,19,21–24,27,28,31,32] assessed protocols approved by ethics committees, one [3] assessed those approved by health institutes, one assessed trials processed through a hospital pharmacy [30], one assessed studies funded by the NHS and commissioned by the North Thames Regional Office…”
BackgroundInfluentialde Jong, J. P., ter Riet, G., & Willems, D. L. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.01.018 · Cited by 12
Role of a research ethics committee in follow-up and publication of results
Martini, N., Tomino, C., & Liberati, A. (2003) · The Lancet · doi:10.1016/s0140-6736(03)13752-x · Cited by 12
Role of a research ethics committee in follow-up and publication of results
Suñé, P., & Ronsano, J. B. M. (2003) · The Lancet · doi:10.1016/s0140-6736(03)13751-8 · Cited by 11
Evaluation von Forschungsvorhaben nach einem positiven Votum einer Ethikkommission
Menzel, S., Uebing, B., Hucklenbroich, P., & Schober, O. (2007) · DMW - Deutsche Medizinische Wochenschrift · doi:10.1055/s-2007-991648 · Cited by 10 · cited 1×
“Excluded Studies Twenty five studies were excluded; eight were not inception cohorts [35–42]; in two studies, the authors of included RCTs were not contacted for information on publication [43,44]; in six, only published studies were included in the cohort [45–50]; in six studies, trial registries were investigated an…”
BackgroundOral presentation bias: a retrospective cohort study
Decullier, E., & Chapuis, F. (2007) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2006.048603 · Cited by 9 · cited 1×
“Excluded Studies Twenty five studies were excluded; eight were not inception cohorts [35–42]; in two studies, the authors of included RCTs were not contacted for information on publication [43,44]; in six, only published studies were included in the cohort [45–50]; in six studies, trial registries were investigated an…”
BackgroundRetrospective cohort study highlighted outcome reporting bias in UK publicly funded trials
Matthews, G. A., Dumville, J. C., Hewitt, C. E., & Torgerson, D. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.03.013 · Cited by 8
McKenzie, J. E., Herbison, P., Roth, P., & Paul, C. (2010) · Trials · doi:10.1186/1745-6215-11-28 · Cited by 6
Dissemination of results needs to be tracked as well as the funding is
McCormack, J. P., Loewen, P. S., & Jewesson, P. J. (2005) · BMJ · doi:10.1136/bmj.331.7514.456-a · Cited by 5 · cited 1×
“Excluded Studies Twenty five studies were excluded; eight were not inception cohorts [35–42]; in two studies, the authors of included RCTs were not contacted for information on publication [43,44]; in six, only published studies were included in the cohort [45–50]; in six studies, trial registries were investigated an…”
BackgroundMhaskar, R. S., Reljic, T., Wao, H., Kumar, A., Miladinović, B., & Djulbegović, B. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.07.006 · Cited by 5
Research works printed but not linked: 2
- Menzel S, Uebing B, Hucklenbroich P, Schober O (2007) Evaluation of clinical trials following an approval from a research ethics committee. Dtsch Med Wochenschr 132: 2313– 2317. 17957593
- Chappell L, Alfirevic Z, Chien P, Jarvis S, Thornton JG (2005) A comparison of the published version of randomized controlled trials in a specialist clinical journal with the original trial protocols; Chicago.
Cited by
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Self-citationPage, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200
“Because author decisions to report and editorial decisions to publish re-sults often depend on whether the P -value is above or below 0.05, selective reporting has been identified as a major problem in large segments of the scientific literature (Dwan et al. 2013; Page et al. 2014; You et al. 2012).”
BackgroundInfluentialCINeMA: an approach for assessing confidence in the results of a network meta-analysis
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003082 · Cited by 1,935
Metadata
- Authors
- Dwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group
- Affiliations
- University of Liverpool (GB)
- Corresponding author
- Dwan, Kerry
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-07-05
- Volume
- 8
- Issue
- 7
- Pages
- e66844
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3702538
- OpenAlex
- W2002062153
- Cited by
- 1,127
- References
- 69
- Citations by year
- 2026: 75 · 2025: 84 · 2024: 64 · 2023: 71 · 2022: 127 · 2021: 98 · 2020: 112 · 2019: 89 · 2018: 83 · 2017: 102 · 2016: 89 · 2015: 70 · 2014: 57 · 2013: 5
- FWCI
- 15.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- SERVAL (Université de Lausanne) (publishedVersion, cc-by)
- IRIS (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Tufts Medical Center
- King's College London
- University of Oxford
- University of Bristol
- University of Sydney
- Queen's University
- Women's College Hospital
- Centre Hospitalier Universitaire Vaudois
- Hospices Civils de Lyon
- Moorfields Eye Hospital NHS Foundation Trust
- School of Medicine, Stanford University
- Tufts University School of Medicine
- Medical Research Council
- National Health and Medical Research Council
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- publication bias, selective reporting, randomized controlled trials, meta-analysis validity, trial reporting quality, primary outcome reporting
- MeSH terms
- Humans, Publications, Cohort Studies, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.