Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias — An Updated Review
Open accessThe DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias and outcome reporting bias have been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. METHODOLOGY/PRINCIPAL FINDINGS: In this update, we review and summarise the evidence from cohort studies that have assessed study publication bias or outcome reporting bias in randomised controlled trials. Twenty studies were eligible of which four were newly identified in this update. Only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Fifteen of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: This update does not change the conclusions of the review in which 16 studies were included. Direct empirical evidence for the existence of study publication bias and outcome reporting bias is shown. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Figure 3 Status of approved protocols for Chan 2004b study [17].](https://figures.cochat.ai/paper-figures/83600bbc5644401caed195b486efac8f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-3.jpg)
![Figure 4 Status of approved protocols for Easterbrook 1991 study [24].](https://figures.cochat.ai/paper-figures/0a114dad26924772826758941018f42f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-4.jpg)
![Figure 5 Status of approved protocols for Dickersin 1992 study [23].](https://figures.cochat.ai/paper-figures/1453f80dcd014ca3b9b32399777cc8d3/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-5.jpg)
![Figure 6 Status of approved protocols for Dickersin 1993 study [3].](https://figures.cochat.ai/paper-figures/1e175d9e8b2a4f0390577db97b820ca8/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-6.jpg)
![Figure 7 Status of approved protocols for Stern 1997 study [4].](https://figures.cochat.ai/paper-figures/876f2f4683aa40a689e73241856ecb1f/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-7.jpg)
![Figure 8 Status of approved protocols for Cooper 1997 study [19].](https://figures.cochat.ai/paper-figures/beceb71fe2a943b2ba35a9fc9d17293b/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-8.jpg)
![Figure 9 Status of trials for Wormald 1997 study [30].](https://figures.cochat.ai/paper-figures/f6a16e454252431f84d6cc28737b2e50/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-9.jpg)
![Figure 10 Status of approved protocols for Ioannidis 1998 study [5].](https://figures.cochat.ai/paper-figures/261662c83e664841aaa276cbc7c62394/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-10.jpg)
![Figure 11 Status of approved protocols for Pich 2003 study [27].](https://figures.cochat.ai/paper-figures/48fe85db48fc4b6ca22f25bb5580c0a7/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-11.jpg)
![Figure 12 Status of approved protocols for Cronin 2004 study [20].](https://figures.cochat.ai/paper-figures/8d211a89740e4b67b0c80783ab9c0582/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-12.jpg)
![Figure 13 Status of approved protocols for Decullier 2005 study [7].](https://figures.cochat.ai/paper-figures/c7868be91276448192f71187c860c7a5/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-13.jpg)
![Figure 14 Status of approved protocols for Decullier 2006 study [22].](https://figures.cochat.ai/paper-figures/4859f8920e714475a966997babd4cb7a/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-14.jpg)
![Figure 15 Status of approved protocols for Hahn 2002 study [26].](https://figures.cochat.ai/paper-figures/69f971391f504ed4bae3d24d4a05f2c1/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-15.jpg)
![Figure 16 Status of approved protocols for Chan 2004a study [18].](https://figures.cochat.ai/paper-figures/933f83ab86634ea581351235ceea1e11/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-16.jpg)
![Figure 17 Status of approved protocols for Ghersi 2006 study [25].](https://figures.cochat.ai/paper-figures/97881d16700f4ed48102dec8fc05b22b/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-17.jpg)
![Figure 18 Status of approved protocols for von Elm 2008 study [29].](https://figures.cochat.ai/paper-figures/90d1c2ab102849719682b2f8f8409206/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-18.jpg)
![Figure 19 Status of approved protocols for Turer 2007 study [28].](https://figures.cochat.ai/paper-figures/ef99b99be5ff4105970df8c239918ce4/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-19.jpg)
![Figure 20 Status of approved protocols for De Jong 2010 study [21].](https://figures.cochat.ai/paper-figures/bf16aa205a3c4592aa0e050025754624/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-20.jpg)
![Figure 21 Status of approved protocols for Blumle 2008 study [31].](https://figures.cochat.ai/paper-figures/f70bc7510f114d9ba3b2e1e1e342ba98/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-21.jpg)
![Figure 22 Status of approved protocols for Hall 2007 study [32].](https://figures.cochat.ai/paper-figures/577511f26e0441a6bbc7643a3998c183/systematic-review-of-the-empirical-evidence-of-study-publication-bias-and-figure-22.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Clinical trial registries provide the ability to measure biases in the reporting of clinical trials that arise due to non-publication, delayed publication, or incomplete publication of results [14].”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Many publications of randomized clinical trials of hypnosis interventions have been unclear or incomplete in reporting of the design elements that are necessary for the evaluation of the quality of evidence, 13 or have not provided sufficient details for possible direct replication.14,15”
From Best Practice Recommendations for Conducting and Reporting Controlled Trials in Clinical Hypnosis Research (2024) · cites this paper as [13]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“studies with statistically non-significant results may not have been submitted for publication (publication bias), or particular results that were statistically non-significant may have been omitted from study reports (selective non-reporting bias).”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [83]
The cited source says what the claim attributes to it.
In the citing paper
“Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias.”
From Systematic review protocol assessing the processes for linking clinical trial registries and their published results (2016) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Despite providing important information relevant to patients, trials with statistically non-significant results are more prone to non-publication,114 or, when published, to a long delay to publication114 115 116—often referred to as publication bias.”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [116]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 12×
“Easterbrook et al [24] found that compared with unfunded studies, government funded studies were more likely to yield statistically significant results but government sponsorship was not found to have a statistically significant effect on the likelihood of publication and company sponsored trials were less likely to b…”
BackgroundMethodResultInfluentialSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435 · cited 1×
“Several studies investigated a cohort of trials submitted to drug licensing authorities [38,40,41,65] and all found that many of these trials remain unpublished, with one study demonstrating that trials with positive outcomes resulted more often in submission of a final report to the regulatory authority [40].”
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,412
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368 · cited 2×
“While much effort has been invested in trying to identify the former [2], it is equally important to understand the nature and frequency of missing data from the latter level.”
BackgroundChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 29×
“The main objective of the study by Blumle et al [31] was to consider how eligibility criteria stated in protocols was reported in subsequent reports, in doing so they noted that 52% of studies in their cohort were published, decreasing to 48% for RCTs only.”
BackgroundMethodInfluentialSystematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 6×
“Since the original version of this review was published [13], a Cochrane methodology review is now available on publication bias [64].”
BackgroundMethodInfluentialSelf-citationPublication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Self-citationDissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039 · cited 2×
“While much effort has been invested in trying to identify the former [1,2], it is equally important to understand the nature and frequency of missing data from the latter level.”
Background
Research works printed but not linked: 2
- Menzel S, Uebing B, Hucklenbroich P, Schober O (2007) Evaluation of clinical trials following an approval from a research ethics committee. Dtsch Med Wochenschr 132: 2313– 2317. 17957593
- Chappell L, Alfirevic Z, Chien P, Jarvis S, Thornton JG (2005) A comparison of the published version of randomized controlled trials in a specialist clinical journal with the original trial protocols; Chicago.
Cited by
Items 901–1,000 of 1,001
Wiewel, E. W. (2016) · CUNY Academic Works (City University of New York)
Response to Letter to the Editor, “Clinical Trial Registration in Oral Health Journals”
Smaïl‐Faugeron, V., Chabouis, H. F., & Durieux, P. (2014) · Journal of Dental Research · doi:10.1177/0022034514563955
“However, it would be interesting to compare published articles with the registered trial record and thus to assess the risk of selective outcome reporting bias in oral health RCTs, as has been done in other medical fields (Mathieu et al. 2009; Dwan et al. 2013).”
BackgroundPello, A. (2016) · Helda - University of Helsinki Institutional Repository
Ruan, X., Rubin, R. E., & Kaye, A. D. (2016) · Annals of Pharmacotherapy · doi:10.1177/1060028015627311
“Indeed, knowledge of the benefits and risks of prescription drugs is based mainly on published reports of clinical trials, yet the medical literature may present an incomplete and potentially biased sample of clinical trials.(4) In 2012, researchers at the biotechnology firm Amgen in Thousand Oaks, California, reporte…”
BackgroundBooth, A., & Jones-Diette, J. S. (2018) · Springer eBooks · doi:10.1007/978-3-319-78966-8_6
The value of publishing negative studies: Introducing IJS Short Reports
Agha, R. (2016) · IJS Short Reports · doi:10.4103/2468-7332.186170
de Vries, Y. A., Roest, A. M., Franzen, M., Munafo, M. R., & Bastiaansen, J. A. (2016) · Psychological Medicine · doi:10.1017/s003329171600218x
“…outcomes or analyses based on the statistical significance of the results) is likely to be at least as common in observational studies as it is in the clinical trials literature (Dwan et al. 2013), but in observational studies it is impossible to detect due to the lack of prospective registration.”
Moher, D., Shamseer, L., Clarke, M. J., Ghersi, D., Liberati, A., Petticrew, M. P., & Stewart, L. A. (2016) · Cited by 1
1.3 Threat: Energy production and mining
Sutherland, W. J., Dicks, L. V., Ockendon, N., & Smith, R. K. (2020) · Open Book Publishers
12. Habitat restoration and creation
Thornton, A., Morgan, W. H., Bladon, E., Smith, R. K., & Sutherland, W. J. (2025) · Open Book Publishers · doi:10.11647/obp.0453.12
3.8 Threat: Human intrusions and disturbance
Sutherland, W. J., Dicks, L. V., Ockendon, N., & Smith, R. K. (2015) · Open Book Publishers
4.5. Threat: Residential and commercial development
Sutherland, W. J., Dicks, L. V., Ockendon, N., & Smith, R. K. (2015) · Open Book Publishers
1.10. Threat: Climate change and severe weather
Sutherland, W. J., Dicks, L. V., Ockendon, N., & Smith, R. K. (2020) · Open Book Publishers
3.9 Threat: Natural system modifications
Sutherland, W. J., Dicks, L. V., Ockendon, N., & Smith, R. K. (2015) · Open Book Publishers
Education and awareness raising
Sutherland, W. J., Dicks, L. V., Ockendon, N., & Smith, R. K. (2014) · Pelagic Publishing eBooks · doi:10.2307/jj.28833756.20
Evidence for the Baby-Friendly Hospital Initiative to Support Breastfeeding—Reply
Flaherman, V. J., & Kohorn, I. V. (2017) · JAMA · doi:10.1001/jama.2016.20837
Chow, J. (2017) · Scholarship@Western (Western University)
Boutefnouchet, T., Laios, T., & Mathur, K. (2017) · Journal of Sports Medicine and Therapy · doi:10.29328/journal.jsmt.1001012
¿Es necesario un registro nacional de dislipemias?
Pedro‐Botet, J. (2017) · Clínica e Investigación en Arteriosclerosis · doi:10.1016/j.arteri.2017.10.001
Klinička praksa temeljena na dokazima: pregled prijetnji valjanosti dokaza i kako ih spriječiti
Garattini, S. K., Jakobsen, J. C., Wetterslev, J., Bertelè, V., Banzi, R., Rath, A., Neugebauer, E. A. M., Laville, M., Masson, Y., Hivert, V., et al. (2017) · Medicina Fluminensis · doi:10.21860/medflum2017_187362
Evaluating the Quality of Trial Reports in Iranian Nursing Journals
Heydari, A., & Sharifi, H. P. (2018) · Journal of North Khorasan University of Medical Sciences · doi:10.29252/nkjmd-090313
McAfee, A., Collins, T. F., & Foster, L. J. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/232249
Surrogate Endpoints for Overall Survival in Cancer Randomized Controlled Trials
Savina, M. (2017) · theses.fr (ABES) · doi:10.70675/9d372fa2z1d60z4f28za229z58254be9788c · Cited by 1
Working memory training and transcranial electrical brain stimulation
Byrne, E. M. (2018) · UEA Digital Repository (University of East Anglia) · doi:10.17863/cam.24394 · Cited by 1
Utvärdering av två handdesinfektionsmetoder Sterillium® i jämförelse med Hibiscrub®
Lindström, P. (2018) · Gothenburg University Publications Electronic Archive (Gothenburg University)
A CRITICAL EVALUATION OF BIOMECHANICAL RISK FACTORS FOR ACL INJURIES DURING DYNAMIC ACTIVITIES
Sharir, R. (2018) · Liverpool John Moores University · doi:10.24377/ljmu.t.00008822 · Cited by 3
Medizinische Autorität und Interessenkonflikt: Content is King
Herold, N. (2018) · Springer eBooks · doi:10.1007/978-3-662-57416-4_10
Lehrbuchgestaltung im Sinne von EbM und Cochrane Collaboration
Hecht, H., Berner, M. M., Rüther, A., Antes, G., & Berger, T. (2014) · Elsevier eBooks · doi:10.1016/b978-3-437-22484-3.00001-3
Wie verbessern Wissensmanagement und Open Data die Arzneimittelentwicklung und ‑zulassung?
Gül, R. (2018) · Information - Wissenschaft & Praxis · doi:10.1515/iwp-2018-0043
Muscle, fat and performance during androgen deprivation for prostate cancerPreprint
Owen, P. J. (2018) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/xthkv
Jakobsson, M. (2019) · Gothenburg University Publications Electronic Archive (Gothenburg University)
2.6. Threat: Biological resource use
Sutherland, W. J., Dicks, L. V., Ockendon, N., & Smith, R. K. (2015) · Open Book Publishers
Tomlin, E. M. (2018) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 6
de Rezende, L. F. M. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.5.2019.tde-16042019-120044 · Cited by 1
6.2. Threat: Agriculture and aquaculture
Sutherland, W. J., Dicks, L. V., Ockendon, N., Petrovan, S. O., & Smith, R. K. (2020) · Open Book Publishers
Lorenzo, C. D., & Nurko, S. (2019) · Journal of Pediatric Gastroenterology and Nutrition · doi:10.1097/mpg.0000000000002423
Die Rolle des Zweifels für das theoretische Selbstverständnis der Medizin
Marloth, M. (2018) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich)
Association of Adaptive Early Phase Study Design and Late Phase Study Results in Oncology
Levy, D. E. (2019) · ScholarWorks (Walden University)
Scoping review : teaching personal and social responsibility through physical activity (TPSR-MODEL)
Pienimäki, I. (2019) · Jyväskylä University Digital Archive (University of Jyväskylä) · Cited by 2
Bauer, F. (2019) · Unitec Research Bank (Unitec Institute of Technology)
Ubbink, D. T. (2019) · Wiley eBooks · doi:10.1002/9781118907283.ch58
Ponce, M. F. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3164259
Amirfakhryan, H. (2020) · Archive of Clinical Medicine · doi:10.21802/acm.2020.1.1
“In addition, statistically significant findings are more feasible, and earlier to be published than studies with non-significant findings [21, 22, 23].”
Biggane, A. M. (2020) · theses.fr (ABES) · doi:10.70675/7ce817c3ze739z4f55za028z9ae90e5e7d82 · Cited by 2
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.14
9. Threat: Invasive alien and other problematic species
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · OpenEdition (OpenEdition)
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.12
Transparency and replication in alcohol research
Drax, K., & Munafo, M. R. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-816720-5.00005-0
Editorial: Outcome reporting in midwifery research
Matvienko‐Sikar, K., & Homer, C. (2021) · Women and Birth · doi:10.1016/j.wombi.2021.04.001
Publication and Registration Bias in Randomized Clinical Trials
Al-Durra, M. (2019) · TSpace (University of Toronto) · Cited by 1
Enhancing Folic Acid Dietary Intervention Research in Mouse Models
Munezero, E. (2021) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2021-14593
Almeida, F. M. (2016) · Institutional Repository of the Federal University of Sergipe (Universidade Federal de Sergipe)
Glover, R. E. (2021) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · doi:10.17037/pubs.04663654 · Cited by 1
As eleições no Estado Novo: as eleiçõe presidenciais de 1949 e 1958
Ferreira, A. S. (2006) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Questionable Research Practices and Determinants of Their FrequencyPreprint
Alsalti, T. (2021) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/uqz2e
Questionable Research Practices and Determinants of Their FrequencyPreprint
Alsalti, T. (2021) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/mjvwu
Côté, P., Hartvigsen, J., Axén, I., Leboeuf‐Yde, C., Corso, M., Shearer, H. M., Wong, J. C. Y., Marchand, A.-A., Cassidy, J. D., French, S., et al. (2021) · Chiropractic & Manual Therapies · doi:10.1186/s12998-021-00380-7
5. Threat: Transportation and service corridors
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.05
13. Habitat restoration and creation
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.13
3. Threat: Agriculture and Aquaculture
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.03
6. Threat: Biological resource use
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.06
Development and Writing of Clinical Trial Protocol
Nikam, S. S., Inde, A., Jambhulkar, A., & Ghule, A. (2022) · International Journal of Pharmaceutical Sciences Review and Research · doi:10.47583/ijpsrr.2022.v72i01.011
11. Threat: Climate change and severe weather
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.11
8. Threat: Natural system modifications
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.08
4. Threat: Energy production and mining
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.04
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.10
9. Threat: Invasive alien and other problematic species
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.09
7. Threat: Human intrusions and disturbance
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.07
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.01
2. Threat: Residential and commercial development
Littlewood, N. A., Rocha, R., Smith, R. K., Martin, P. A., Lockhart, S. L., Schoonover, R. F., Wilman, E. N., Bladon, A. J., Sainsbury, K. A., Pimm, S. L., et al. (2020) · Open Book Publishers · doi:10.11647/obp.0234.02
Suh, A., Krosnick, J. A., Jussim, L. J., Stevens, S. T., & Anglin, S. M. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0001
Recording jaw injuries in wartime
(2014) · BDJ · doi:10.1038/sj.bdj.2014.721
Princípios de Hong Kong para a Avaliação de Pesquisadores: Promovendo a Integridade em Pesquisa
Moher, D., Bouter, L. M., Kleinert, S., Glasziou, P., Sham, M. H., Barbour, V., Coriat, A., Foeger, N., & Dirnagl, U. (2020) · doi:10.21452/rode2021.01
Addressing selective reporting of experiments – the case for predefined exclusion criteriaPreprint
Neves, K., & Amaral, O. B. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/a8gu5
Lehrbuchgestaltung im Sinne von EbM und Cochrane Collaboration
Hecht, H., Berner, M. M., Rüther, A., Antes, G., & Berger, T. (2019) · Elsevier eBooks · doi:10.1016/b978-3-437-22485-0.00001-4
Is a national registry of dyslipidaemia necessary?
Pedro‐Botet, J. (2017) · Clínica e Investigación en Arteriosclerosis (English Edition) · doi:10.1016/j.artere.2017.10.002
Quelle est la qualité de la recherche médicale?
(2015) · Bulletin des Médecins Suisses · doi:10.4414/bms.2015.04171
Akaike Memorial Lecture 2020: Some of the challenges of statistical applications
Copas, J. B. (2022) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-022-00831-9
“633 1 3 Akaike Memorial Lecture 2020 published than studies reporting non-significant results (Dwan et al., 2013).”
BackgroundZhang, Q., Lv, H., Fu, Y., Chen, B., Cai, Y., & Zhang, Q. (2022) · medRxiv · doi:10.1101/2022.05.21.22275363
Vedula, S. S., Hróbjartsson, A., & Page, M. J. (2021) · Springer eBooks · doi:10.1007/978-3-319-52677-5_183-1
Ethical research in public policy
Spicker, P. (2022) · Policy Press eBooks · doi:10.2307/j.ctv2tbwqd5.12
Conducting ethical research in crisis situations:
O’Mathúna, D. P. (2022) · Policy Press eBooks · doi:10.51952/9781447363972.ch012
The reporting quality of N‐of‐1 trials and protocols still needs improvement
Wei, Z., Chu, X., Han, J., Zhang, N., Li, Y., Yang, C., Wang, Q., Li, J., Belal, A. A., Yan, P., et al. (2022) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12484
Why is meta-research important for the progress of clinical and applied medical research?Preprint
Helal, L. C. A. S. (2022) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/2x3kh
Making Room for Everyone’s Talent
Huijpen, K. (2022) · doi:10.4000/books.oep.16171 · Cited by 1
Academic Publishing and Open Science – Where do we stand?
Mounier, P. (2022) · doi:10.4000/books.oep.16136
Policies to support Open Source and Open science
Choudhury, S. (2022) · doi:10.4000/books.oep.16192
Nair, S. (2022) · doi:10.4000/books.oep.16091
Construire le pilier logiciel de la science ouverte
Cosmo, R. D. (2022) · doi:10.4000/books.oep.16034 · Cited by 1
Science ouverte, édition et code
Harrison, M. (2022) · doi:10.4000/books.oep.16052
Metadata
- Authors
- Dwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group
- Affiliations
- University of Liverpool (GB)
- Corresponding author
- Dwan, Kerry
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-07-05
- Volume
- 8
- Issue
- 7
- Pages
- e66844
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3702538
- OpenAlex
- W2002062153
- Cited by
- 1,127
- References
- 69
- Citations by year
- 2026: 75 · 2025: 84 · 2024: 64 · 2023: 71 · 2022: 127 · 2021: 98 · 2020: 112 · 2019: 89 · 2018: 83 · 2017: 102 · 2016: 89 · 2015: 70 · 2014: 57 · 2013: 5
- FWCI
- 15.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- SERVAL (Université de Lausanne) (publishedVersion, cc-by)
- IRIS (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Tufts Medical Center
- King's College London
- University of Oxford
- University of Bristol
- University of Sydney
- Queen's University
- Women's College Hospital
- Centre Hospitalier Universitaire Vaudois
- Hospices Civils de Lyon
- Moorfields Eye Hospital NHS Foundation Trust
- School of Medicine, Stanford University
- Tufts University School of Medicine
- Medical Research Council
- National Health and Medical Research Council
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- publication bias, selective reporting, randomized controlled trials, meta-analysis validity, trial reporting quality, primary outcome reporting
- MeSH terms
- Humans, Publications, Cohort Studies, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.