Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
The DOI matches its Crossref record.
Abstract
Preface. Acknowledgements. Notes on Contributors. Chapter 1: Publication Bias in Meta-Analysis (Hannah R. Rothstein, Alexander J. Sutton and Michael Borenstein). Part A: Publication bias in context. Chapter 2: Publication Bias: Recognizing the Problem, Understanding Its Origins and Scope, and Preventing Harm (Kay Dickersin). Chapter 3: Preventing Publication Bias: Registries and Prospective Meta-Analysis (Jesse A. Berlin and Davina Ghersi). Chapter 4: Grey Literature and Systematic Reviews (Sally Hopewell, Mike Clarke and Sue Mallett). Part B: Statistical methods for assessing publication bias. Chapter 5: The Funnel Plot (Jonathan A.C. Sterne, Betsy Jane Becker and Matthias Egger). Chapter 6: Regression Methods to Detect Publication and Other Bias in Meta-Analysis (Jonathan A.C. Sterne and Matthias Egger). Chapter 7: Failsafe N or File-Drawer Number (Betsy Jane Becker). Chapter 8: The Trim and Fill Method (Sue Duval). Chapter 9: Selection Method Approaches (Larry V. Hedges and Jack Vevea). Chapter 10: Evidence Concerning the Consequences of Publication and Related Biases (Alexander J. Sutton). Chapter 11: Software for Publication Bias (Michael Borenstein). Part C: Advanced and emerging approaches. Chapter 12: Bias in Meta-Analysis Induced by Incompletely Reported Studies (Alexander J. Sutton and Therese D. Pigott). Chapter 13: Assessing the Evolution of Effect Sizes over Time (Thomas A. Trikalinos and John P.A. Ioannidis). Chapter 14: Do Systematic Reviews Based on Individual Patient Data Offer a Means of Circumventing Biases Associated with Trial Publications? (Lesley Stewart, Jayne Tierney and Sarah Burdett). Chapter 15: Differentiating Biases from Genuine Heterogeneity: Distinguishing Artifactual from Substantive Effects (John P.A. Ioannidis). Chapter 16: Beyond Conventional Publication Bias: Other Determinants of Data Suppression (Scott D. Halpern and Jesse A. Berlin). Appendices. Appendix A: Data Sets. Appendix B: Annotated Bibliography (Hannah R. Rothstein and Ashley Busing). Glossary. Index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Given that published studies, compared with unpublished studies, are more likely to report significant findings, meta-analyses can potentially overestimate effect sizes [35].”
From Comparing Executive Functions in Children and Adolescents with Autism and ADHD—A Systematic Review and Meta-Analysis (2024) · cites this paper as [35]
In the citing paper
“In order to minimise bias, robust variance estimation with small sample adjustments (RVE) 22,23 was implemented via the robumeta package in R 24 to account for unknown correlations among these non-independent samples whenever multiple end-points per study were used.”
From Childhood maltreatment and characteristics of adult depression: Meta-analysis (2017) · cites this paper as [24]
In the citing paper
“Publication bias was assessed by visual inspection of asymmetry of funnel plots to assess small study effects, where applicable (38).”
From Obstructive sleep apnea syndrome in polycystic ovary syndrome: a systematic review and meta-analysis (2025) · cites this paper as [38]
In the citing paper
“We did this so that we can provide readers with the maximum amount of information about current bridge programs and to avoid only focusing on programs that were most likely to produce favorable or statistically significant results (Rothstein et al., 2005).”
From Building Better Bridges into STEM: A Synthesis of 25 Years of Literature on STEM Summer Bridge Programs (2017) · cites this paper as Rothstein et al., 2005
In the citing paper
“Several alternative tests for bias have also been proposed, beyond the ones testing small study bias [215],[219],[220], but none can be considered a gold standard.”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [215]
Citations
Cites
Still being checked.
Cited by
Items 1,001–1,026 of 1,026
Influence of artificial intelligence tools on higher order thinking skills: a meta-analysis
Ilgun Dibek, M., Sahin Kursad, M., & Erdogan, T. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2402028 · Cited by 45
Bürkner, P.-C., Bittner, N., Holling, H., & Buhlmann, U. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173660 · Cited by 41
Inhibitory Control in Autism Spectrum Disorders: Meta-analyses on Indirect and Direct Measures
Tonizzi, I., Giofrè, D., & Usai, M. C. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05353-6 · Cited by 39
Associations of quality of life with service satisfaction in psychotic patients: a meta-analysis.
Petkari, E., & Pietschnig, J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0135267 · Cited by 35
Resilience interventions in physicians: A systematic review and meta-analysis
Angelopoulou, P., & Panagopoulou, E. (2022) · Applied Psychology: Health and Well-Being · doi:10.1111/aphw.12287 · Cited by 34
Zeisser, C., Stockwell, T. R., & Chikritzhs, T. (2014) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.12479 · Cited by 33
“If asymmetry is caused by publication bias we would expect that high standard errors (small studies) would be associated with larger effect sizes (Rothstein et al., 2006).”
BackgroundCeruti, C., Mingozzi, A., Scionti, N., & Marzocchi, G. M. (2024) · Children · doi:10.3390/children11040473 · Cited by 35
Crutzen, R., Viechtbauer, W., Kotz, D., & Spigt, M. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.03.019 · Cited by 32
Jackson, K. F., Hodge, D. R., & Vaughn, M. G. (2010) · Journal of Social Service Research · doi:10.1080/01488371003697780 · Cited by 30
Storm, L., Sherwood, S. J., Roe, C. A., Tressoldi, P. E., Rock, A. J., & Di Risio, L. (2017) · International Journal of Dream Research · doi:10.11588/ijodr.2017.2.34888 · Cited by 29
Has the evidence for moral licensing been inflated by publication bias?
Kuper, N., & Bott, A. (2019) · Meta-Psychology · doi:10.15626/mp.2018.878 · Cited by 30
Kamradt, J. M., Momany, A. M., & Nikolas, M. A. (2018) · ADHD Attention Deficit and Hyperactivity Disorders · doi:10.1007/s12402-017-0238-5 · Cited by 26
Brummer, L., de Boer, H., Mouw, J. M., & Strijbos, J.-W. (2024) · Learning Environments Research · doi:10.1007/s10984-024-09501-4 · Cited by 25
Koh, S. H. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1399902 · Cited by 21
Lynch, K., Gonzalez, K., Hill, H., & Merritt, R. (2025) · AERA Open · doi:10.1177/23328584251335302 · Cited by 21
Systematic reviews and meta‐analyses in coloproctology: interpretation and potential pitfalls
Wille‐Jørgensen, P., & Renehan, A. G. (2008) · Colorectal Disease · doi:10.1111/j.1463-1318.2007.01421.x · Cited by 19
Bayesian multivariate meta-analysis of multiple factors
Lin, L., & Chu, H. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1293 · Cited by 19
Selective outcome reporting: telling and detecting true lies. The state of the science
Macura, A., Abraha, I., Kirkham, J., Gensini, G. F., Moja, L., & Iorio, A. (2010) · Internal and Emergency Medicine · doi:10.1007/s11739-010-0371-z · Cited by 19
Not Published Is Not Perished: Addressing Publication Bias in Meta-Analytic Studies in Communication
Sun, Y., & Pan, Z. (2020) · Human Communication Research · doi:10.1093/hcr/hqz015 · Cited by 18
Littell, J. H., & Shlonsky, A. (2011) · Clinical Social Work Journal · doi:10.1007/s10615-010-0308-z · Cited by 13
Obstructive sleep apnea syndrome in polycystic ovary syndrome: a systematic review and meta-analysis
Abdul Jafar, N. K., Al Balushi, A., Subramanian, A., Lee, S. I., Bennett, C. J., Moran, L. J., Mousa, A., Tay, C. T., Teede, H. J., & Mansfield, D. R. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1532519 · Cited by 15
Consumer confusion: A meta-analytic review
Shahid, S., Maseeh, H. I., Jebarajakirthy, C., Kumar Sharma, B., Saha, R., & Gupta, S. (2025) · Journal of Business Research · doi:10.1016/j.jbusres.2025.115294 · Cited by 13
A Meta-analysis of STEM Integration on Student Academic Achievement
Zhou, S., Dong, Z., Wang, H. H., & Chiu, M. M. (2025) · Research in Science Education · doi:10.1007/s11165-024-10216-y · Cited by 8
The asymmetry of working memory training transfer: A systematic review and meta-analysis
Fu, J., Zhou, Y., Yuan, M., & Cai, Y. (2026) · Psychonomic Bulletin & Review · doi:10.3758/s13423-026-02994-5
Sun, P. P., Liang, J., Liu, Y., & Tao, R. (2026) · Language Teaching Research · doi:10.1177/13621688261499464
Human Fear Chemosignaling: Evidence from a Meta-Analysis
de Groot, J. H. B., & Smeets, M. A. M. (2017) · Chemical Senses · doi:10.1093/chemse/bjx049 · Cited by 88
Metadata
- Venue
- Wiley eBooks
- Publisher
- Wiley
- Published
- 2005-10-07
- OpenAlex
- W1590137713
- Cited by
- 2,368
- References
- 0
- Citations by year
- 2026: 91 · 2025: 118 · 2024: 119 · 2023: 132 · 2022: 133 · 2021: 203 · 2020: 174 · 2019: 124 · 2018: 124 · 2017: 150 · 2016: 137 · 2015: 138 · 2014: 144 · 2013: 104 · 2012: 93
- FWCI
- 21.41
- Type
- book
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- Locations
- Wiley eBooks (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- publication bias, meta-analysis, systematic reviews, grey literature, registry, funnel plot, trim and fill, selection methods, incomplete reporting, individual patient data, heterogeneity, data suppression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.