The DOI matches its Crossref record; 21 of the 22 references it cites were found in a registry or an index.
Funnel Plots in Meta-analysis
Open accessAbstract
Funnel plots are a visual tool for investigating publication and other bias in meta-analysis. They are simple scatterplots of the treatment effects estimated from individual studies (horizontal axis) against a measure of study size (vertical axis). The name “funnel plot” is based on the precision in the estimation of the underlying treatment effect increasing as the sample size of component studies increases. Therefore, in the absence of bias, results from small studies will scatter widely at the bottom of the graph, with the spread narrowing among larger studies. Publication bias (the association of publication probability with the statistical significance of study results) may lead to asymmetrical funnel plots. It is, however, important to realize that publication bias is only one of a number of possible causes of funnel-plot asymmetry-funnel plots should be seen as a generic means of examining small study effects (the tendency for the smaller studies in a meta-analysis to show larger treatment effects) rather than a tool to diagnose specific types of bias. This article introduces the metafunnel command, which produces funnel plots in Stata. In accordance with published recommendations, standard error is used as the measure of study size. Treatment effects expressed as ratio measures (for example risk ratios or odds ratios) may be plotted on a log scale.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We used funnel plots to graphically assess publication bias for each outcome in the meta-analysis (Sterne & Harbord, 2004).”
From Prospective Longitudinal Associations Between Adverse Childhood Experiences and Adult Mental Health Outcomes: Systematic Review and Meta-Analysis (2026) · cites this paper as Sterne & Harbord, 2004
In the citing paper
“due to the limited number of studies (less than 10) available for each specific outcome analysis, it was challenging to interpret any potential asymmetry in the funnel plot, and determining the presence of publication bias was not feasible (Sterne and Harbord, 2004)”
From The impact of physical activity on academic performance in children and adolescents: a meta-analysis (2026) · cites this paper as Sterne and Harbord, 2004
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · cited 6×
“The test proposed by Egger et al. (1997) is algebraically identical to a test that there is no linear association between the treatment effect and its standard error and, hence, that there is no straightline association in the funnel plot of treatment effect against its standard error (see Sterne,…”
InfluentialOperating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · cited 2×
“Statistical tests for funnel-plot asymmetry have been proposed by Begg and Mazumdar (1994) and by Egger et al.”
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779 · cited 1×
“Sterne and Egger (2001) consider choice of axis in funnel plots of meta-analyses with binary outcomes.”
Self-citationSystematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282 · cited 2×
“Sterne, Egger, and Davey Smith (2001) and Sterne, Gavaghan, and Egger (2000) have suggested that the funnel plot should be seen as a generic means of examining “smallstudy effects” (the tendency for the smaller studies in a meta-analysis to show larger treatment effects) rather than as a tool to…”
Self-citationComprehensive geriatric assessment: a meta-analysis of controlled trials
Stuck, A. E., Siu, A. L., Wieland, G. D., Rubenstein, L. Z., & Adams, J. (1993) · The Lancet · doi:10.1016/0140-6736(93)92884-v · Cited by 1,974 · cited 1×
“An experienced consultant geriatrician was more likely to be actively involved in the smaller trials and this may explain the larger treatment effects observed in these trials (Egger et al. 1997; Stuck et al. 1993).”
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181 · cited 1×
“Smaller studies are, on average, conducted and analyzed with less methodological rigor than larger studies (Egger et al. 2003), so asymmetry may also result from the overestimation of treatment effects in smaller studies of lower methodological quality (bottom graph of figure 1).”
Self-citationDirection and impact of language bias in meta-analyses of controlled trials: empirical study
Jüni, P., Holenstein, F., Sterne, J., Bartlett, C., & Egger, M. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.115 · Cited by 892 · cited 1×
“…affecting the selection of studies for inclusion in meta-analyses include the propensity for the results to affect the language of publication (Jüni et al. 2002); the possibility that results affect the frequency with which a study is cited and, hence, its probability of inclusion in a…”
BackgroundSelf-citation
Research works printed but not linked: 6
- Bradburn M. J., 1998, Stata Technical Bulletin, 44, 4
- 10.1002/1097-0258(20000715)19:13<1707::AID-SIM491>3.0.CO;2-P · doi:10.1002/1097-0258(20000715)19:13<1707::aid-sim491>3.0.co;2-p
- Sharp S., 1998, Stata Technical Bulletin, 42, 16
- Steichen T. J., 1998, Stata Technical Bulletin, 41, 9
- Steichen T. J., 1998, Stata Technical Bulletin, 44, 3
- 10.1002/(SICI)1097-0258(19991030)18:20<2693::AID-SIM235>3.0.CO;2-V · doi:10.1002/(sici)1097-0258(19991030)18:20<2693::aid-sim235>3.0.co;2-v
Cited by
Understanding Interaction Models: Improving Empirical Analyses
Brambor, T., Clark, W. R., & Golder, M. (2006) · Political Analysis · doi:10.1093/pan/mpi014 · Cited by 6,223
Walker, E. R., McGee, R. E., & Druss, B. G. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.2502 · Cited by 2,976
Controlled Interventions to Reduce Burnout in Physicians: A Systematic Review and Meta-analysis
Panagioti, M., Panagopoulou, E., Bower, P., Lewith, G., Kontopantelis, E., Chew-Graham, C., Dawson, S., van Marwijk, H., Geraghty, K., & Esmail, A. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.7674 · Cited by 1,395
Panagioti, M., Geraghty, K., Johnson, J., Zhou, A., Panagopoulou, E., Chew-Graham, C., Peters, D., Hodkinson, A., Riley, R., & Esmail, A. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3713 · Cited by 951
RetractedDebunking: A Meta-Analysis of the Psychological Efficacy of Messages Countering Misinformation
Chan, M.-P. S., Jones, C. R., Hall Jamieson, K., & Albarracín, D. (2017) · Psychological Science · doi:10.1177/0956797617714579 · Cited by 898
“Asymmetrical funnel plots suggest publication bias (Sterne & Harbord, 2004), and contour lines indicate levels of statistical significance.”
Background
Metadata
- Authors
- Sterne, J. A. C., & Harbord, R. M.
- Affiliations
- University of Bristol (GB)
- Venue
- The Stata Journal: Promoting communications on statistics and Stata
- Publisher
- SAGE Publications
- Published
- 2004-06
- Volume
- 4
- Issue
- 2
- Pages
- 127-141
- ISSN
- 1536-867X (ISSN-L)
- 1536-8734
- OpenAlex
- W1548668976
- Semantic Scholar
- 1d84c35bfd7d0ad56574dae998f0de5611eb11b8
- Cited by
- 708
- References
- 22
- Citations by year
- 2026: 53 · 2025: 84 · 2024: 66 · 2023: 65 · 2022: 50 · 2021: 51 · 2020: 48 · 2019: 38 · 2018: 25 · 2017: 34 · 2016: 30 · 2015: 35 · 2014: 21 · 2013: 21 · 2012: 21
- FWCI
- 6.79
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The Stata Journal Promoting communications on statistics and Stata (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- AgEcon Search (University of Minnesota, USA) (submittedVersion, cc-by-nc-nd)
- AgEcon Search (University of Minnesota, USA)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- funnel plot, publication bias, small-study effects, Stata, study size, treatment effect heterogeneity, relative risk, odds ratio
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Funnel Plots in Meta-analysis. https://app.cochat.ai/papers/10.1177/1536867x0400400204
- The paper
- Sterne, J. A. C., & Harbord, R. M. (2004). Funnel Plots in Meta-analysis. The Stata Journal: Promoting communications on statistics and Stata. https://doi.org/10.1177/1536867x0400400204
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.