The DOI matches its Crossref record; 61 of the 63 references it cites were found in a registry or an index.
Modelling publication bias in meta-analysis: a review
Abstract
Meta-analysis is now a widely used technique for summarizing evidence from multiple studies. Publication bias, the bias induced by the fact that research with statistically significant results is potentially more likely to be submitted and published than work with null or non-significant results, poses a thereat to the validity of such analyses. The implication of this is that combining only the identified published studies uncritically may lead to an incorrect, usually over optimistic, conclusion. How publication bias should be addressed when carrying out a meta-analysis is currently a hotly debated subject. While statistical methods to test for its presence are starting be used, they do not address the problem of how to proceed if publication bias is suspected. This paper provides a review of methods, which can be employed as a sensitivity analysis to assess the likely impact of publication bias on a meta-analysis. It is hoped that this will raise awareness of such methods, and promote their use and development, as well as provide an agenda for future research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There are two main threats to the validity of meta-analytic results: the systematic omission of studies (e.g., publication bias suppressing studies with null results36,37), and the flexible selection of analysis approaches within each study inflating the rate of false positives (e.g., p-hacking38).”
From Accuracy prompts are a replicable and generalizable approach for reducing the spread of misinformation (2022) · cites this paper as [36]
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Journal of The American Statistical Association
Fienberg, S. E. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,289
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Research works printed but not linked: 8
- Chalmers TC., 1982, Transactions of the American Clinical Climatology Association, 94, 204
- 10.2307/1164832 · DOI · Paper page
- Champney TF. Adjustments for selection: publication bias in quantitative research synthesis. Doctoral thesis, University of Chicago, 1983.
- Hedges LV., 1998, Statistical analysis of medical data
- Wasserman L., 1998, Bayesian statistics 4, 483
- Eberly LE, 1996, Estimating the number of unseen studies
- Sugita M, 1992, Japnese Journal of Clinical Oncology, 22, 354
- Sugita M, 1994, Tokai Journal of Experimental Clinical Medicine, 19, 29
Cited by
Sorted by citations
Items 201–281 of 281
Bootstrap-Based Between-Study Heterogeneity Tests in Meta-Analysis
Du, H., Jiang, G., & Ke, Z. (2022) · Multivariate Behavioral Research · doi:10.1080/00273171.2021.1997701 · Cited by 7
Popay, J., & Roen, K. (2003) · Lancaster EPrints (Lancaster University) · Cited by 7
Dai, J., Chen, Y., Gong, Y., Wei, J., Cui, X., Yu, H., Zhao, W., Gu, D., & Chen, J. (2019) · Medicine · doi:10.1097/md.0000000000017384 · Cited by 6
La crisis de reproducibilidad de la ciencia y la necesidad de publicar los resultados negativos
Martín-Moro, J. G. (2017) · Archivos de la Sociedad Española de Oftalmología · doi:10.1016/j.oftal.2017.07.009 · Cited by 6
Challenges in Modelling the Cost Effectiveness of Various Interventions for Cardiovascular Disease
Burgers, L., Redekop, W., & Severens, J. (2014) · PharmacoEconomics (Auckland) · doi:10.1007/s40273-014-0155-9 · Cited by 5
Identification and assessment of ongoing trials in health technology assessment reviews.
Song, F., Fry-Smith, A., Davenport, C., Bayliss, S., Adi, Y., Wilson, J. S., & Hyde, C. (2004) · Health Technology Assessment · doi:10.3310/hta8440 · Cited by 7
Self-citationRule of law and economic performance: A meta-regression analysis
Shamugia, E. (2025) · European Journal of Political Economy · doi:10.1016/j.ejpoleco.2025.102677 · Cited by 5
Massacesi, C., Ceriello, L., Maturo, F., Porreca, A., Appignani, M., & Girolamo, E. D. (2021) · Heart Rhythm O2 · doi:10.1016/j.hroo.2021.09.012 · Cited by 5
Emast Frequency in Colorectal Cancer: A Meta-Analysis and Literature Review
Ranjbar, R., Esfahani, A. T., Mojarad, E. N., Olfatifar, M., Aghdaei, H. A., & Mohammadpour, S. (2020) · Biomarkers in Medicine · doi:10.2217/bmm-2020-0068 · Cited by 5
Publication bias in studies on the efficacy of hypnosis as a therapeutic tool
Moshagen, M., & Musch, J. (2008) · Contemporary Hypnosis · doi:10.1002/ch.355 · Cited by 4
The effect of weight function on hypothesis testing in weighted sampling
Karimi, M., & Alavi, S. M. R. (2014) · Journal of Applied Statistics · doi:10.1080/02664763.2014.920777 · Cited by 4
Guo, R., & Li, X. (2019) · BMC Urology · doi:10.1186/s12894-019-0503-3 · Cited by 4
Fajrudin, L., Fajari, L. E. W., Sa’diyah, H., & Aini, S. (2024) · Kalam Cendekia Jurnal Ilmiah Kependidikan · doi:10.20961/jkc.v12i2.86633 · Cited by 3
Adjusting for Publication Bias in Meta-Analysis with Continuous Outcomes: A Comparative Study
Almalik, O. (2025) · Mathematics · doi:10.3390/math13213487 · Cited by 3
Keeping Meta-Analyses Hygienic During the COVID-19 Pandemic
Boudesseul, J., Zerhouni, O., Harbert, A. L., & Rubiños, C. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.722458 · Cited by 3
Racionalidad científica, causalidad y metaanálisis de ensayos clínicos
De‐Regil, L. M., & Casanueva, E. (2008) · Salud Pública de México · doi:10.1590/s0036-36342008000600014 · Cited by 3
Dissertation R.C.M. van AertPreprint
van Aert, R. C. M. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/eqhjd · Cited by 3
Basic aspects of meta-analysis. Part 2
Tao, E., Nadinskaia, M. Y., Suvorov, А. Y., Bulanov, N. M., Sholomova, V. I., Петрович, П. П., Taratkin, M. S., & Brovko, M. (2024) · Sechenov Medical Journal · doi:10.47093/2218-7332.2024.15.2.4-12 · Cited by 2
Yes, You Can't! A Multi‐Method Examination of Publishing Null Findings in Sociological Research
Davis, A. P., Pfaffendorf, J., & Hill, T. D. (2025) · Sociology Compass · doi:10.1111/soc4.70104 · Cited by 2
Do Arbitrary Significance Levels Distort Published Results
Gerber, A. S. (2008) · Cited by 2
Bryant, A., Grayling, M. J., Hiu, S. K. W., Gajjar, K. B., Johnson, E. E., Elattar, A., Vale, L. D., Craig, D., & Naik, R. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060183 · Cited by 2
Preventing falls in older people
Conroy, S. (1999) · Nursing Standard · doi:10.7748/ns.13.20.28.s42 · Cited by 2
McNamara, R. L., & Shaw, C. (2007) · Wiley eBooks · doi:10.1002/9780470692127.ch14 · Cited by 2
Neonatal Early-Onset Sepsis Calculator and Antibiotic Therapy
Zhang, Q., & Niu, W. (2020) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2019.6260 · Cited by 2
A systematic review and meta-analysis of effect of mutant traits in chickens
Mhlabini, S., Tyasi, T. L., & Nemutandani, K. R. (2025) · Tropical Animal Health and Production · doi:10.1007/s11250-025-04624-z · Cited by 1
Garbero, A., & Stanghellini, E. (2025) · Journal of Development Effectiveness · doi:10.1080/19439342.2024.2436186 · Cited by 1
Master Thesis Financial Management
Meta-Analysis, A. (2012) · Cited by 1
Comparing Bayesian Posterior Passing with Meta-analysis
Pritsker, J. (2021) · Meta-Psychology · doi:10.15626/mp.2020.2539 · Cited by 1
Social class and elective caesareans in the English NHS
British Medical Journal Publishing Group (2004) · BMJ · doi:10.1136/bmj.329.7458.148 · Cited by 1
Comparison of bias adjustment in meta-analysis using data-based and opinion-based methods
Stone, J., Furuya‐Kanamori, L., Aromataris, E., Barker, T. H., & Doi, S. A. R. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00462 · Cited by 1
Burrett, J. A., & Lunn, D. (2011) · Journal of Evidence-Based Medicine · doi:10.1111/j.1756-5391.2011.01157.x · Cited by 1
The science reproducibility crisis and the necessity to publish negative results
Martín-Moro, J. G. (2017) · Archivos de la Sociedad Española de Oftalmología (English Edition) · doi:10.1016/j.oftale.2017.07.009 · Cited by 1
Saramago, P. (2012) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 1
Ali, U., & Tariq, M. A. (2021) · Asian Spine Journal · doi:10.31616/asj.2021.0395.r1 · Cited by 1
FDA rejects over the counter status for emergency contraceptive
(2004) · BMJ · doi:10.1136/bmj.329.7458.148-a · Cited by 1
Bayesian mixture modelling for characterising environmental exposures and outcomes
Wraith, D. (2008) · Cited by 1
Study Design and the Bias Issue
Källén, A. (2011) · Wiley eBooks · doi:10.1002/9781119992677.ch3
El Meta-Análisis: La Integración de los Resultados Científicos
Macbeth, G., de Kohan, N. C., & Razumiejczyk, E. (2007) · Revista Evaluar · doi:10.35670/1667-4545.v7.n1.508
Sensitivity methods for publication bias in a meta-analysis
Malley, P. (2026) · Warwick Research Archive Portal (University of Warwick) · doi:10.82444/warw.33491746
Análisis de sensibilidad en una revisión sistemática
Flores‐Mateo, G. (2007) · FMC - Formación Médica Continuada en Atención Primaria · doi:10.1016/s1134-2072(07)71867-4
Solomon, P., & Hutton, J. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000401
Reply to F. Catalá-López et al.
Escobar, C., Llisterri, J. L., Rodríguez-Roca, G. C., Alonso-Moreno, F. J., Prieto, M. A., & Barrios, V. (2013) · Journal of Hypertension · doi:10.1097/hjh.0b013e32835c6d3d
Publication Bias in Union-Productivity
Doucouliagos, H., Laroche, P., & Stanley, T. D. (2016)
Replace the Aortic Root? Homograft Implantation Techniques in the Aortic Position: To Preserve or
Athanasiou, T., Jones, C. M., Jin, R., & Grunkemeier, G. L. (2013)
A Bayesian Nonparametric Test of Significance-Chasing Biases
Karabatsos, G. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1269
The Methodology of Meta-Analyses and Its Potential Contribution to Patient Care
Gandini, S. (2017) · Springer eBooks · doi:10.1007/978-3-319-48848-6_80
Zhang, H., & Xiao, T. (2017) · Orthopedics · doi:10.3928/01477447-20171019-01
Notas sobre el Régimen Jurídico de los Equipamientos
Murgadas, E. A. I. (1983) · Revista de derecho urbanístico y medio ambiente/Revista de derecho urbanístico y medio ambiente
Combination Treatment With Proton Pump Inhibitor Plus Prokinetic for Gastroesophageal Reflux Disease
Tariq, M. A., & Ahmed, B. (2022) · Journal of Neurogastroenterology and Motility · doi:10.5056/jnm21134
ISRN Probability and Statistics
(2017) · ISRN Probability and Statistics · doi:10.1155/5079
PhD, R. B. H. M. M., & Goeree, R. A. (2015) · CRC Press eBooks · doi:10.1201/b18285-4
Preventing falls in older people
(2014) · Pharmaceutical journal/The pharmaceutical journal · doi:10.1211/pj.2014.20066844
Preventing falls in older people
(2015) · Nursing Standard · doi:10.7748/ns.29.34.19.s25
メタアナリシス入門 : 医学研究の場合を例として( データ中心科学の発展)
昌之, 逸. (2013) · システム/制御/情報 : システム制御情報学会誌 · doi:10.11509/isciesci.57.4_153
Drabo, E. F., & Dowdy, D. W. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780192896087.003.0016
Fabricant, P. D. (2024) · Springer eBooks · doi:10.1007/978-3-031-58380-3_6
Zhou, Y., Huang, A., & Hattori, S. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.14
We need to write about children
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.c1
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.c5
Children and collaborative writing
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.c2
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.toc
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.refs
Children and written corrective feedback
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.c3
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.c7
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.index
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.c4
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.glossary
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.c6
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.prelim
(2023) · Trends in language acquisition research · doi:10.1075/tilar.32.intro
Addressing Outcome Reporting Bias in Meta‐Analysis: A Selection Model Perspective
Saracini, A. G., & Held, L. (2025) · Statistics in Medicine · doi:10.1002/sim.70238
Additional file 1 of The prevalence of hip osteoarthritis: a systematic review and meta-analysis
Fan, Z., Yan, L., Liu, H., Li, X., Fan, K., Liu, Q., Li, J. J., & Wang, B. (2023) · Figshare · doi:10.6084/m9.figshare.22625912
song, H., xiang, P., Liu, Z., hu, S., & Jin, J. (2019) · doi:10.21203/rs.2.17584/v1
Bias-adjusted meta-analysis using the quality effects model: a Stata tutorial
Stone, J., Stern, C., Jia, R. M., Whitehorn, A., Ho, H. T., & Doi, S. A. R. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00083
Wu, Y., Zhang, Y., Li, Y. C., Tin, H., Li, Y., & Yan, X. (2026) · Obesity Reviews · doi:10.1111/obr.70130
Fabricant, P. D. (2026) · Springer eBooks · doi:10.1007/978-3-032-25094-0_6
Kalasua, D., & Sahu, G. P. (2026) · Management Review Quarterly · doi:10.1007/s11301-026-00637-6
Drouet, O., Schnitzler, C., & Lefèvre, L. (2026) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2026.1900203
Metadata
- Authors
- Sutton, A. J., Song, F., Gilbody, S. M., & Abrams, K. R.
- Affiliations
- Department of Epidemiology and Public Health, University of Leicester, Leicester, UK,
- University of York (GB)
- University of Leicester (GB)
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2000-10
- Volume
- 9
- Issue
- 5
- Pages
- 421-445
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W2009813561
- Cited by
- 288
- References
- 63
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 10 · 2023: 27 · 2022: 15 · 2021: 10 · 2020: 11 · 2019: 12 · 2018: 14 · 2017: 25 · 2016: 10 · 2015: 15 · 2014: 14 · 2013: 12 · 2012: 11
- FWCI
- 11.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistical Methods in Medical Research (publishedVersion)
- PubMed (publishedVersion)
- Leicester Research Archive (University of Leicester) (submittedVersion)
- UEA Digital Repository (University of East Anglia) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, meta-analysis, sensitivity analysis, bias correction, statistical significance, negative results, research validity
- MeSH terms
- Bayes Theorem, Data Interpretation, Statistical, United Kingdom, Meta-Analysis as Topic, Models, Statistical, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review