Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias has been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. Until recently, outcome reporting bias has received less attention. METHODOLOGY/PRINCIPAL FINDINGS: We review and summarise the evidence from a series of cohort studies that have assessed study publication bias and outcome reporting bias in randomised controlled trials. Sixteen studies were eligible of which only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Eleven of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: Recent work provides direct empirical evidence for the existence of study publication bias and outcome reporting bias. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Figure 3 Status of approved protocols for Chan 2004b study [15].](https://figures.cochat.ai/paper-figures/59b15ebd40f546c6abdc941af3f030b5/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-3.jpg)
![Figure 4 Status of approved protocols for Easterbrook 1991 study [26].](https://figures.cochat.ai/paper-figures/14a7658864a940c2b24cb84c7e8cb605/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-4.jpg)
![Figure 5 Status of approved protocols for Dickersin 1992 study [27].](https://figures.cochat.ai/paper-figures/5c6595c5a1114b54a63fd775278bc099/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-5.jpg)
![Figure 6 Status of approved protocols for Dickersin 1993 study [3].](https://figures.cochat.ai/paper-figures/aa3d5c4186b24331b2c214488355f8a7/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-6.jpg)
![Figure 7 Status of approved protocols for Stern 1997 study [4].](https://figures.cochat.ai/paper-figures/04afce37877d467bbabff840c38d7301/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-7.jpg)
![Figure 8 Status of approved protocols for Cooper 1997 study [32].](https://figures.cochat.ai/paper-figures/f0cd16c328a14425a21a07beff12b5e9/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-8.jpg)
![Figure 9 Status of trials for Wormald 1997 study [21].](https://figures.cochat.ai/paper-figures/40fd118f57954ed5a014900d0265fe95/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-9.jpg)
![Figure 10 Status of approved protocols for Ioannidis 1998 study [5].](https://figures.cochat.ai/paper-figures/404ab188570a4eb3b98992e2a1cd5fbc/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-10.jpg)
![Figure 11 Status of approved protocols for Pich 2003 study [28].](https://figures.cochat.ai/paper-figures/d57aee050aa8429e955ea17eab36a5e4/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-11.jpg)
![Figure 12 Status of approved protocols for Cronin 2004 study [31].](https://figures.cochat.ai/paper-figures/4caeeb0c2bc944ef845ddb964c8a76bd/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-12.jpg)
![Figure 13 Status of approved protocols for Decullier 2005 study [29].](https://figures.cochat.ai/paper-figures/d5e27b13a4504b068f8b813f84a5792a/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-13.jpg)
![Figure 14 Status of approved protocols for Decullier 2006 study [30].](https://figures.cochat.ai/paper-figures/d623c2abf5114e8abea683517296a756/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-14.jpg)
![Figure 15 Status of approved protocols for Hahn 2002 study [13].](https://figures.cochat.ai/paper-figures/2dd3013142574a138ea802be74b77966/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-15.jpg)
![Figure 16 Status of approved protocols for Chan 2004a study [14].](https://figures.cochat.ai/paper-figures/632e7328c62f4e1e9fdcbb1e5767e34a/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-16.jpg)
![Figure 17 Status of approved protocols for Ghersi 2006 study [17].](https://figures.cochat.ai/paper-figures/efcfe899e56047d99ddb45bbd8091c51/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-17.jpg)
![Figure 18 Status of approved protocols for von Elm 2008 study [18].](https://figures.cochat.ai/paper-figures/3e7a281f19ef40dca07cbfc23dfeaaf3/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-18.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Unfortunately, attempted assessments frequently fail because authors of many trial reports neglect to provide lucid and complete descriptions of that critical information [2-4].”
From CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials (2010) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“and there are also reasons to believe that publication bias is more likely to affect low powered studies (25).”
From Statistical and Methodological Considerations for the Interpretation of Intranasal Oxytocin Studies (2016) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Empirical evidence suggests that authors often ignore, in the conduct and reporting of their trial, what they stated in the protocol [4,22].”
From CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. (2010) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Second, publication bias, selective data analysis and selective reporting of outcomes are more likely to affect low-powered studies.”
From Power failure: why small sample size undermines the reliability of neuroscience (2013) · cites this paper as [17]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Empirical evidence suggests that authors often ignore, in the conduct and reporting of their trial, what they stated in the protocol. [4],[22]”
From CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials (2010) · cites this paper as [4]
Experimental — accuracy not yet measured
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 12×
“The HTA report of Song et al [1] led to four potentially eligible empirical studies [3,4,26,27], all of which had been identified previously.”
BackgroundMethodResultInfluentialSelf-citationSystematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Self-citationPublication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 30×
“Status of approved protocols for Chan 2004b study [15].”
BackgroundMethodInfluentialSelf-citationSystematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Systematic Reviews in Health Care. Meta-analysis in Context.
Kleijnen, J., & Antes, G. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.3.697 · Cited by 1,363
Full publication of results initially presented in abstracts.
Scherer, R. W., Langenberg, P., & von Elm, E. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000005.pub3 · Cited by 997 · cited 1×
“The Cochrane review by Scherer et al [6] investigating the full publication of results initially presented in abstracts found that only 63% of results from abstracts describing randomized or controlled clinical trials are published in full and ‘positive’ results were more frequently published than non ‘positive’ resul…”
BackgroundPublication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias: evidence of delayed publication in a cohort study of clinical research projects
Stern, J. M., & Simes, R. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.640 · Cited by 818 · cited 11×
“Stern et al [4] reported that this finding was even stronger for their subgroup of clinical trials (Hazard Ratio (HR) 3.13 (95% confidence interval (CI) 1.76, 5.58), p = 0.0001) compared to all quantitative studies (HR 2.32 (95% CI 1.47, 3.66), p = 0.0003).”
BackgroundMethodResultInfluentialPublication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715 · cited 2×
“Obviously those studies that are not submitted are not published and it was found by Dickersin et al [36] that non-publication was primarily a result of failure to write up and submit the trial results rather than rejection of submitted manuscripts.”
BackgroundMelander, H., Ahlqvist-Rastad, J., Meijer, G., & Beermann, B. (2003) · BMJ · doi:10.1136/bmj.326.7400.1171 · Cited by 635
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632 · cited 28×
“Those studies containing exclusively nonRCTs were excluded.”
BackgroundInfluentialSelf-citationChan, A.-W., & Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.38356.424606.8f · Cited by 613 · cited 1×
“Recent work [13–19] has provided direct empirical evidence for the existence of outcome reporting bias.”
BackgroundSelf-citationPublication and Related Biases
Song, F., Eastwood, A., Gilbody, S., Duley, L., & Sutton, A. (2001) · The Advanced Handbook of Methods in Evidence Based Healthcare · doi:10.4135/9781848608344.n21 · Cited by 455 · cited 1×
“Study publication bias arises when studies are published or not depending on their results; it has received much attention”
BackgroundOutcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Chan, A.-W. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1041086 · Cited by 444 · cited 30×
“Those studies containing exclusively nonRCTs were excluded.”
BackgroundInfluentialSelf-citationPublication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Quality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397
Publication Bias in Editorial Decision Making
Olson, C. M. (2002) · JAMA · doi:10.1001/jama.287.21.2825 · Cited by 395 · cited 2×
“Olson et al [37] conducted a prospective cohort study of manuscripts submitted to JAMA and assessed whether the submitted manuscripts were more likely to be published if they reported positive results.”
BackgroundSoares, H. P., Daniels, S., Kumar, A., Clarke, M., Scott, C., Swann, S., & Djulbegovic, B. (2004) · BMJ · doi:10.1136/bmj.328.7430.22 · Cited by 313
How important is publication bias? A synthesis of available data.
Dickersin, K. (1997) · PubMed · Cited by 311
NIH clinical trials and publication bias.
Dickersin, K., & Min, Y. (1993) · PubMed · Cited by 300
Reporting in randomized clinical trials improved after adoption of the CONSORT statement
Kane, R. L., Wang, J., & Garrard, J. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.06.016 · Cited by 227 · cited 1×
“Randomised controlled trials (RCTs) are planned experiments, involving the random assignment of participants to interventions, and are seen as the gold standard of study designs to evaluate the effectiveness of a treatment in medical research in humans [11].”
BackgroundBias in Meta-Analysis Due to Outcome Variable Selection Within Studies
Hutton, J. L., & Williamson, P. R. (2000) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00197 · Cited by 194 · cited 1×
“It has been defined as the selection on the basis of the results of a subset of the original variables recorded for inclusion in a publication [9].”
BackgroundSelf-citationEvolution of treatment effects over time: Empirical insight from recursive cumulative metaanalyses
Ioannidis, J. P. A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.021529998 · Cited by 192 · cited 1×
“This ‘‘time lag bias’’ (or ‘‘pipeline bias’’) will tend to add to the bias since results from early available evidence tend to be inflated and exaggerated [7,8].”
Self-citationOutcome selection bias in meta-analysis
Williamson, P. R., Gamble, C., Altman, D. G., & Hutton, J. L. (2005) · Statistical Methods in Medical Research · doi:10.1191/0962280205sm415oa · Cited by 188 · cited 1×
“For example, selective reporting of analyses may include intention-to–treat analyses versus per–protocol analyses, endpoint score versus change from baseline, different time points or subgroups [10].”
BackgroundSelf-citationEffect sizes in cumulative meta-analyses of mental health randomized trials evolved over time
Trikalinos, T. A., Churchill, R., Ferri, M., Leucht, S., Tuunainen, A., Wahlbeck, K., & Ioannidis, J. P. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.02.018 · Cited by 177 · cited 1×
“This ‘‘time lag bias’’ (or ‘‘pipeline bias’’) will tend to add to the bias since results from early available evidence tend to be inflated and exaggerated [7,8].”
Self-citationSystematic review of publication bias in studies on publication bias
Dubben, H.-H., & Beck‐Bornholdt, H. (2005) · BMJ · doi:10.1136/bmj.38478.497164.f7 · Cited by 173
Fate of biomedical research protocols and publication bias in France: retrospective cohort study
Decullier, É., Lhéritier, V., & Chapuis, F. R. (2005) · BMJ · doi:10.1136/bmj.38488.385995.8f · Cited by 162 · cited 11×
“Seven empirical studies [3,21,26,27,29,30,32] described reasons why a study was not published as reported by the trialists.”
BackgroundMethodResultInfluentialFinding the missing science: The fate of studies submitted for review by a human subjects committee.
Cooper, H., DeNeve, K., & Charlton, K. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.4.447 · Cited by 144 · cited 13×
“Seven empirical studies [3,21,26,27,29,30,32] described reasons why a study was not published as reported by the trialists.”
BackgroundInfluentialPublication Bias and Research on Passive Smoking: Comparison of Published and Unpublished Studies
Misakian, A. L., & Bero, L. A. (1998) · JAMA · doi:10.1001/jama.280.3.250 · Cited by 141 · cited 18×
“Those studies containing exclusively nonRCTs were excluded.”
BackgroundInfluentialIdentification and impact of outcome selection bias in meta‐analysis
Williamson, P. R., & Gamble, C. (2005) · Statistics in Medicine · doi:10.1002/sim.2025 · Cited by 132 · cited 1×
“Reviewers should scrutinise trials with missing outcome data and ensure that an attempt to contact trialists is always made if the study does not report results. Also, the lack of reporting of specified outcome(s) should not be an automatic reason for exclusion of studies. Statisticians should be involved for the data…”
BackgroundSelf-citationBlümle, A., Huwiler, K., & Witschi, M. (2008) · Swiss Medical Weekly · doi:10.4414/smw.2008.12027 · Cited by 131
Role of a research ethics committee in follow-up and publication of results
Pich, J., Carné, X., Arnaiz, J.-A., Gómez, B., Trilla, A., & Rodés, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12799-7 · Cited by 104 · cited 28×
“Status of approved protocols for Pich 2003 study [28].”
BackgroundMethodInfluentialSelf-citationHahn, S., Williamson, P. R., & Hutton, J. L. (2002) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2002.00314.x · Cited by 97 · cited 9×
“Study ID Total published (percentage) Positive (percentage) Negative (percentage) Null (percentage) Easterbrook, 1991 [26] 138/285 (48%) 93/154 (60%) 12/34 (35%) 33/97 (34%) Dickersin, 1992 [27] 390/514 (76%) 260/314 (83%) 130/200 (65%) NI Dickersin, 1993 [3] 184/198 (93%) 121/124 (98%) 63/74 (85%) NI Stern, 1997 [4]…”
BackgroundMethodResultInfluentialSelf-citationStudy of information submitted by drug companies to licensing authorities.
Hemminki, E. (1980) · BMJ · doi:10.1136/bmj.280.6217.833 · Cited by 96
Evaluation of New Treatments in Radiation Oncology: Are They Better Than Standard Treatments?
Soares, H. P., Kumar, A., Daniels, S., Swann, S., Cantor, A. B., Hozo, I., Clark, M., Serdarević, F., Gwede, C. K., Trotti, A., et al. (2005) · JAMA · doi:10.1001/jama.293.8.970 · Cited by 92
Tannock, I. F. (1996) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/88.3-4.206 · Cited by 90 · cited 1×
“Researchers have considered selective outcome reporting to be a major problem, and deserving of substantially more attention than it currently receives [12].”
BackgroundBias in reporting clinical trials
Bardy, A. H. (1998) · British Journal of Clinical Pharmacology · doi:10.1046/j.1365-2125.1998.00759.x · Cited by 70 · cited 2×
“Four studies were excluded; two were not inception cohorts as they considered completed studies submitted to drug regulatory authorities [22,23], in one study authors were not contacted for information on publication [24] and in another we could not confirm if any of the included studies were RCTs [25].”
BackgroundPublication bias in clinical trials
Hopewell, S., Dickersin, K., Clarke, M. J., Oxman, A. D., & Loudon, K. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub2 · Cited by 60
Contopoulos‐Ioannidis, D. G., Alexiou, G. Α., Gouvias, T. C., & Ioannidis, J. P. A. (2006) · Pharmacogenetics and Genomics · doi:10.1097/01.fpc.0000236332.11304.8f · Cited by 54 · cited 1×
“Recent work [13–19] has provided direct empirical evidence for the existence of outcome reporting bias.”
BackgroundSelf-citationHaidich, A., & Ioannidis, J. P. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.9.873 · Cited by 44 · cited 1×
“Through contact with the authors, one reference [30] was located and found to be eligible and another [34] was identified Figure 2.”
BackgroundApplication and investigation of a bound for outcome reporting bias
Williamson, P. R., & Gamble, C. (2007) · Trials · doi:10.1186/1745-6215-8-9 · Cited by 26
Self-citationImpact of funding on biomedical research: a retrospective cohort study
Decullier, É., & Chapuis, F. R. (2006) · BMC Public Health · doi:10.1186/1471-2458-6-165 · Cited by 18 · cited 9×
“Seven empirical studies [3,21,26,27,29,30,32] described reasons why a study was not published as reported by the trialists.”
BackgroundMethodInfluentialFactors influencing the publication of health research
Cronin, E., & Sheldon, T. (2004) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462304001175 · Cited by 18 · cited 12×
“Study ID Total published (percentage) Positive (percentage) Negative (percentage) Null (percentage) Easterbrook, 1991 [26] 138/285 (48%) 93/154 (60%) 12/34 (35%) 33/97 (34%) Dickersin, 1992 [27] 390/514 (76%) 260/314 (83%) 130/200 (65%) NI Dickersin, 1993 [3] 184/198 (93%) 121/124 (98%) 63/74 (85%) NI Stern, 1997 [4]…”
BackgroundInfluentialSelf-citationGhersi, D. (2006) · The Sydney eScholarship Repository (The University of Sydney) · Cited by 16
Self-citationEvaluation von Forschungsvorhaben nach einem positiven Votum einer Ethikkommission
Menzel, S., Uebing, B., Hucklenbroich, P., & Schober, O. (2007) · DMW - Deutsche Medizinische Wochenschrift · doi:10.1055/s-2007-991648 · Cited by 10 · cited 1×
“Four studies were excluded; two were not inception cohorts as they considered completed studies submitted to drug regulatory authorities [22,23], in one study authors were not contacted for information on publication [24] and in another we could not confirm if any of the included studies were RCTs [25].”
BackgroundPublication bias in clinical trials
Olsen, K., Hopewell, S., Dickersin, K., Clarke, M. J., & Oxman, A. D. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006 · Cited by 6 · cited 2×
“Second, the lead reviewer of the protocol on the Cochrane library entitled ‘Publication bias in clinical trials’ [20] (Sally Hopewell) was contacted in November 2007 for references to studies included and excluded in their review.”
Method
Research works printed but not linked: 2
- E Von Elm, 2008, Selective reporting of outcomes of drug trials; Comparison of study protocols and published articles., Swiss Med Wkly, 138 (13–14), 197
- L Chappell, 2005, A comparison of the published version of randomized controlled trials in a specialist clinical journal with the original trial protocols.
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
“Bias from selective outcome reporting in randomized trials has been well documented [42,43].”
BackgroundInfluentialSelf-citationPRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Self-citationShamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Self-citation
Metadata
- Authors
- Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., Ghersi, D., Ioannidis, J. P. A., Simes, J., & Williamson, P. R.
- Affiliations
- University of Liverpool (GB)
- University of Oxford (GB)
- Hospital Clínic de Barcelona (ES)
- Moorfields Eye Hospital (GB)
- Canadian Institutes of Health Research (CA)
- King's College London (GB)
- University of Bern (CH)
- National Health and Medical Research Council (AU)
- Tufts University (US)
- The University of Sydney (AU)
- Corresponding author
- Dwan, Kerry
- ORCID
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2008-08-28
- Volume
- 3
- Issue
- 8
- Pages
- e3081
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC2518111
- OpenAlex
- W2091959199
- Cited by
- 1,546
- References
- 48
- Citations by year
- 2026: 45 · 2025: 51 · 2024: 67 · 2023: 51 · 2022: 76 · 2021: 118 · 2020: 90 · 2019: 72 · 2018: 96 · 2017: 90 · 2016: 129 · 2015: 121 · 2014: 109 · 2013: 131 · 2012: 103
- FWCI
- 20.77
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Research Portal (King's College London) (submittedVersion)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (submittedVersion, cc-by)
- Funders
- Cancer Research UK
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- publication bias, selective reporting, randomized controlled trials, outcome reporting, meta-analysis validity, clinical trial registration
- MeSH terms
- Clinical Trials as Topic, Humans, Publishing, Cohort Studies, Randomized Controlled Trials as Topic, Treatment Outcome, Publication Bias, Patient Selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.