CoChat

Publication and related bias in meta-analysis

Sterne, Jonathan A.C, Gavaghan, David, Egger, Matthias · 2000 · Journal of Clinical Epidemiology

The DOI matches its Crossref record, with a small difference in title or year; 67 of the 67 references it cites were found in a registry or an index.

Abstract

Publication and selection biases in meta-analysis are more likely to affect small studies, which also tend to be of lower methodological quality. This may lead to "small-study effects," where the smaller studies in a meta-analysis show larger treatment effects. Small-study effects may also arise because of between-trial heterogeneity. Statistical tests for small-study effects have been proposed, but their validity has been questioned. A set of typical meta-analyses containing 5, 10, 20, and 30 trials was defined based on the characteristics of 78 published meta-analyses identified in a hand search of eight journals from 1993 to 1997. Simulations were performed to assess the power of a weighted regression method and a rank correlation test in the presence of no bias, moderate bias or severe bias. We based evidence of small-study effects on P < 0.1. The power to detect bias increased with increasing numbers of trials. The rank correlation test was less powerful than the regression method. For example, assuming a control group event rate of 20% and no treatment effect, moderate bias was detected with the regression test in 13.7%, 23.5%, 40.1% and 51.6% of meta-analyses with 5, 10, 20 and 30 trials. The corresponding figures for the correlation test were 8.5%, 14.7%, 20.4% and 26.0%, respectively. Severe bias was detected with the regression method in 23.5%, 56.1%, 88.3% and 95.9% of meta-analyses with 5, 10, 20 and 30 trials, as compared to 11.9%, 31.1%, 45.3% and 65.4% with the…

Overview

Integrity signals

Registry

Crossref · 10.1016/s0895-4356(00)00242-0

Cites

67 of 67 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 67 references

Research works printed but not linked: 4

  1. Irwig, 1998, Graphical test is itself biased, Br Med J, 316, 470
  2. Egger, 1998, Bias in meta-analysis detected by a simple, graphical test—authors reply, Br Med J, 316, 470
  3. Thompson, 1999, Explaining heterogeneity in meta-analysis, Stat Med, 18, 2693, 10.1002/(SICI)1097-0258(19991030)18:20<2693::AID-SIM235>3.0.CO;2-V · doi:10.1002/(sici)1097-0258(19991030)18:20<2693::aid-sim235>3.0.co;2-v
  4. Steichen, 1998, sbe19.1, Stata Technical Bulletin, 44, 3

Cited by

See all 2,282

Metadata

Authors
Sterne, J. A. C., Gavaghan, D., & Egger, M.
Affiliations
University of Bristol (GB)
Corresponding author
Egger, Matthias
Venue
Journal of Clinical Epidemiology
Publisher
Elsevier BV
Published
2000-11
Volume
53
Issue
11
Pages
1119-1129
ISSN
0895-4356 (ISSN-L)
OpenAlex
W204046373
Cited by
2,282
References
67
Citations by year
2026: 114 · 2025: 157 · 2024: 178 · 2023: 145 · 2022: 164 · 2021: 179 · 2020: 124 · 2019: 131 · 2018: 115 · 2017: 124 · 2016: 101 · 2015: 102 · 2014: 102 · 2013: 88 · 2012: 82
FWCI
26.20
Type
journal article
Language
en
Open access
closed
Licence
www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations
  • Journal of Clinical Epidemiology (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords
publication bias, selection bias, small-study effects, statistical power, false positive rate, between-trial heterogeneity
MeSH terms
Clinical Trials as Topic, Regression Analysis, Statistics as Topic, Meta-Analysis as Topic, Reproducibility of Results, Bias, Publication Bias, Statistics, Nonparametric

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Publication and related bias in meta-analysis. https://app.cochat.ai/papers/10.1016/s0895-4356(00)00242-0
The paper
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000). Publication and related bias in meta-analysis. Journal of Clinical Epidemiology. https://doi.org/10.1016/s0895-4356(00)00242-0

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.