The DOI matches its Crossref record; 61 of the 63 references it cites were found in a registry or an index.
Modelling publication bias in meta-analysis: a review
Abstract
Meta-analysis is now a widely used technique for summarizing evidence from multiple studies. Publication bias, the bias induced by the fact that research with statistically significant results is potentially more likely to be submitted and published than work with null or non-significant results, poses a thereat to the validity of such analyses. The implication of this is that combining only the identified published studies uncritically may lead to an incorrect, usually over optimistic, conclusion. How publication bias should be addressed when carrying out a meta-analysis is currently a hotly debated subject. While statistical methods to test for its presence are starting be used, they do not address the problem of how to proceed if publication bias is suspected. This paper provides a review of methods, which can be employed as a sensitivity analysis to assess the likely impact of publication bias on a meta-analysis. It is hoped that this will raise awareness of such methods, and promote their use and development, as well as provide an agenda for future research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There are two main threats to the validity of meta-analytic results: the systematic omission of studies (e.g., publication bias suppressing studies with null results36,37), and the flexible selection of analysis approaches within each study inflating the rate of false positives (e.g., p-hacking38).”
From Accuracy prompts are a replicable and generalizable approach for reducing the spread of misinformation (2022) · cites this paper as [36]
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Journal of The American Statistical Association
Fienberg, S. E. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,289
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Research works printed but not linked: 8
- Chalmers TC., 1982, Transactions of the American Clinical Climatology Association, 94, 204
- 10.2307/1164832 · DOI · Paper page
- Champney TF. Adjustments for selection: publication bias in quantitative research synthesis. Doctoral thesis, University of Chicago, 1983.
- Hedges LV., 1998, Statistical analysis of medical data
- Wasserman L., 1998, Bayesian statistics 4, 483
- Eberly LE, 1996, Estimating the number of unseen studies
- Sugita M, 1992, Japnese Journal of Clinical Oncology, 22, 354
- Sugita M, 1994, Tokai Journal of Experimental Clinical Medicine, 19, 29
Cited by
Sorted by citations
A meta-analytic test of intergroup contact theory.
Pettigrew, T. F., & Tropp, L. R. (2006) · Journal of personality and social psychology · doi:10.1037/0022-3514.90.5.751 · Cited by 9,708
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Younossi, Z. M., Golabi, P., Paik, J. M., Henry, A., Van Dongen, C., & Henry, L. (2023) · Hepatology · doi:10.1097/hep.0000000000000004 · Cited by 3,383
Eagly, A. H., Johannesen‐Schmidt, M. C., & Engen, M. L. V. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.4.569 · Cited by 2,783
Younossi, Z. M., Golabi, P., de Avila, L., Paik, J. M., Srishord, M., Fukui, N., Qiu, Y., Burns, L., Afendy, A., & Nader, F. (2019) · Journal of Hepatology · doi:10.1016/j.jhep.2019.06.021 · Cited by 2,235
Metadata
- Authors
- Sutton, A. J., Song, F., Gilbody, S. M., & Abrams, K. R.
- Affiliations
- Department of Epidemiology and Public Health, University of Leicester, Leicester, UK,
- University of York (GB)
- University of Leicester (GB)
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2000-10
- Volume
- 9
- Issue
- 5
- Pages
- 421-445
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W2009813561
- Cited by
- 288
- References
- 63
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 10 · 2023: 27 · 2022: 15 · 2021: 10 · 2020: 11 · 2019: 12 · 2018: 14 · 2017: 25 · 2016: 10 · 2015: 15 · 2014: 14 · 2013: 12 · 2012: 11
- FWCI
- 11.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistical Methods in Medical Research (publishedVersion)
- PubMed (publishedVersion)
- Leicester Research Archive (University of Leicester) (submittedVersion)
- UEA Digital Repository (University of East Anglia) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, meta-analysis, sensitivity analysis, bias correction, statistical significance, negative results, research validity
- MeSH terms
- Bayes Theorem, Data Interpretation, Statistical, United Kingdom, Meta-Analysis as Topic, Models, Statistical, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review