The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials
Open accessAbstract
Funnel plots, and tests for funnel plot asymmetry, have been widely used to examine bias in the results of meta-analyses. Funnel plot asymmetry should not be equated with publication bias, because it has a number of other possible causes. This article describes how to interpret funnel plot asymmetry, recommends appropriate tests, and explains the implications for choice of meta-analysis model
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“so the non-significant tendencies to asymmetry and small study effects identified by the Eggers and Begg tests, presumably caused by the similar SEM of most of the studies, can be assumed to be trustworthy [30].”
From Are Dietary Proteins the Key to Successful Body Weight Management? A Systematic Review and Meta-Analysis of Studies Assessing Body Weight Outcomes after Interventions with Increased Dietary Protein (2021) · cites this paper as [30]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“publication bias was not assessed in this review because there was no forest plot with at least ten studies (Sterne et al. 2011).”
From The Effect of Mindfulness-Based and Acceptance Commitment Therapy-Based Interventions to Improve the Mental Well-Being Among Parents of Children with Developmental Disabilities: A Systematic Review and Meta-Analysis. (2022) · cites this paper as Sterne et al. 2011
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Publication bias was assessed using funnel plot analysis and Egger's test where the number of studies for the outcome of interest was ≥10”
From IVF/ICSI or surgery as first approach for the treatment of infertility associated with ovarian and deep infiltrating endometriosis? A systematic review and meta-analysis. (2026) · cites this paper as Sterne et al., 2011
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For those comparisons in which data were obtained from at least ten studies (Sterne et al. 2011), publication bias was assessed by visual inspection of funnel plot asymmetry.”
From Analysis of sex-based differences in energy substrate utilization during moderate-intensity aerobic exercise (2022) · cites this paper as Sterne et al. 2011
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Instead, the asymmetry likely represents a ‘small study bias’, where methodological approaches inherent in small studies lead to stronger effects with greater variance (Peters et al., 2008; Sterne et al., 2011).”
From The Distributed Practice Effect on Classroom Learning: A Meta-Analytic Review of Applied Research (2025) · cites this paper as Sterne et al., 2011
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Publication bias was assessed by visual inspection of funnel plot and by Egger test to assess asymmetry, as well as by Begg test to assess small study effects [29,30,31].”
From Are Dietary Proteins the Key to Successful Body Weight Management? A Systematic Review and Meta-Analysis of Studies Assessing Body Weight Outcomes after Interventions with Increased Dietary Protein (2021) · cites this paper as [30]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If a meta-analysis of a medication adherence measure had adequate power (ie, ≥10 cohorts), funnel plots were generated and visually inspected, and the Egger test was used to assess for small study effects (funnel plot asymmetry) potentially caused by reporting bias.30”
From Adherence to PCSK9 Inhibitors in Clinical Practice (2026) · cites this paper as [30]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“we only calculated bias statistics if the total number of correspondence audits for a given analysis equalled or exceeded ten, otherwise, the statistical power could be too low to detect asymmetry.”
From The state of hiring discrimination: A meta-analysis of (almost) all recent correspondence experiments (2023) · cites this paper as Sterne et al., 2011
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Because the symmetry of funnel plots could be influence by various factors, such as publication bias, and/or small-study effects, it was difficult to figure out the cause of asymmetry, especially when the sample size of each comparison was less than ten [82].”
From Efficacy and safety of curcuminoids alone in alleviating pain and dysfunction for knee osteoarthritis: a systematic review and meta-analysis of randomized controlled trials (2022) · cites this paper as [82]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“To assess risk of publication bias, we plotted each trial's effect against the standard errors (Sterne et al., 2011), creating a single effect size per study per outcome.”
From Shared Picture Book Reading Interventions for Child Language Development: A Systematic Review and Meta-Analysis (2020) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Notably, heterogeneity can also influence funnel plot asymmetry (Sterne et al., 2011).”
From The Distributed Practice Effect on Classroom Learning: A Meta-Analytic Review of Applied Research (2025) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Consequently, the Egger test was not employed to formally assess funnel plot asymmetry, as it is not recommended for such small numbers of studies [25].”
The cited source says what the claim attributes to it.
In the citing paper
“We were not able to explore possible publication bias through a funnel plot (Sterne 2011), as we did not combine a sufficient number of trials.”
From Mobile technologies to support healthcare provider to healthcare provider communication and management of care (2020) · cites this paper as Sterne 2011
The cited source says what the claim attributes to it.
In the citing paper
“Funnel plots were generated for visual assessment for asymmetry and potential publication bias 31 (see Figures S20–S29).”
From Systematic review and meta-analysis of protein intake to support muscle mass and function in healthy adults (2022) · cites this paper as [31]
The cited source says what the claim attributes to it.
In the citing paper
“Typically tests for funnel plot asymmetry should only be used where there are at least 10 studies in each meta-analysis (Sterne et al., 2011).”
From Nature-based outdoor activities for mental and physical health: Systematic review and meta-analysis (2021) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Presence of publication bias was assessed with funnel plots, 22 Rosenthal's fail-safe N , 23 and Egger's regression intercept. 24”
From Light Therapy for Patients With Bipolar Depression: Systematic Review and Meta-Analysis of Randomized Controlled Trials (2020) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“To explore publication and small study biases, a funnel plot and Egger ' s test for asymmetry was used where at least 10 different-sized studies were pooled. 62”
From High-velocity power training has similar effects to traditional resistance training for functional performance in older adults: a systematic review (2023) · cites this paper as [62]
The cited source says what the claim attributes to it.
In the citing paper
“Small study effects (e.g. publication bias) were assessed when there were 10 or more studies in the meta-analysis by visually examining the funnel plot, supplemented by Egger’s test of funnel plot asymmetry [39, 40]. Duval and Tweedie’s trim and fill procedure was used to estimate the effect size after imputing potentially missing studies [41].”
From Systematic review and meta-analysis of Mental Health First Aid training: Effects on knowledge, stigma, and helping behaviour (2018) · cites this paper as [40]
The cited source says what the claim attributes to it.
In the citing paper
“this asymmetry could exist due to chance, as the analysis contained few studies with few participants (Sterne et al., 2011).”
From The effects of physical activity on cortisol and sleep: A systematic review and meta-analysis. (2022) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“However, for each risk factor, no one included more than ten studies; these numbers were too small so that the test efficacy of funnel plots and egger's test was insufficient [31]. Therefore, funnel plots and Egger's test were not assessed to calculate the risk of bias.”
From Preoperative Risk Factors for Short-Term Postoperative Mortality of Acute Mesenteric Ischemia after Laparotomy: A Systematic Review and Meta-Analysis (2020) · cites this paper as [31]
The cited source says what the claim attributes to it.
In the citing paper
“We assessed the latter for evidence of asymmetry, and therefore possible publication bias or other small study effects, using the Egger test, 35 if there were suf fi cient ( 10) eligible studies included in the meta-analysis, in line with recommendations. 36”
From Efficacy of Probiotics in Irritable Bowel Syndrome: Systematic Review and Meta-analysis (2023) · cites this paper as [36]
The cited source says what the claim attributes to it.
In the citing paper
“According to Sterne et al. (2011) it is not recommended to use tests for funnel plot asymmetry when the number of studies included in the meta-analysis is <10 as statistical power is usually too low to distinguish chance from real asymmetry.”
From The effect of internet-delivered cognitive behavioral therapy for depression and anxiety on quality of life: A meta-analysis of randomized controlled trials (2023) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“However, not all asymmetric funnel plots are due to issues that impact meta-analytic inference (Sterne et al., 2011).”
From Can MRI measure myelin? Systematic review, qualitative assessment, and meta-analysis of studies validating microstructural imaging with myelin histology (2021) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Due to the small number of included studies, publication bias was not formally assessed using funnel plots or asymmetry tests, as these methods have low statistical power under such conditions (Sterne et al., 2011).”
From Efficacy and safety of small interfering RNA (siRNA) therapies for hypertriglyceridemia and mixed dyslipidemia: an updated systematic review and meta-analysis (2026) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Because the test for a publication is not advised for fewer than 10 studies, Egger’s test was not performed.20”
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“To assess risk of bias, the Cochrane Collaboration's risk-of-bias tool (Rob2) was used (Sterne et al., 2011).”
From Effects of voluntary slow breathing on heart rate and heart rate variability: A systematic review and a meta-analysis (2022) · cites this paper as Sterne et al., 2011
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Included studies exceeded the minimum number of effect sizes to be pooled [98].”
From Estimating the Effect of Aerobic Exercise Training on Novel Lipid Biomarkers: A Systematic Review and Multivariate Meta-Analysis of Randomized Controlled Trials (2023) · cites this paper as [98]
Experimental — accuracy not yet measuredIn the citing paper
“This may be due to several reasons, including true heterogeneity (i.e., smaller studies differ from larger ones in terms of study population, exposure levels, etc.), selection bias (i.e., the selective publication of small studies showing an effect), bias in design or analysis, or chance [77,78].”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [77]
In the citing paper
“Publication bias was examined by inspecting the funnel plot [44] and conducting the Egger test of the intercept with a one-tailed significance level of α=.05 [45]. In addition, we used Duval and Tweedie’s trim and fill procedure [46] to adjust the effect size for missing studies.”
In the citing paper
“Based on current recommendations, at least 10 studies are needed to examine reporting bias using funnel plots and, if the heterogeneity is high, the minimum number of studies may be substantially more than 10. 34”
From Global prevalence of sarcopenia and severe sarcopenia: a systematic review and meta‐analysis (2022) · cites this paper as [34]
In the citing paper
“Trialists may have implemented interventions less thoroughly in larger trials, thus explaining the more positive results in smaller trials 57 .”
From Investigating and dealing with publication bias and other reporting biases in meta-analyses of health research: a review (2021) · cites this paper as [57]
In the citing paper
“Small trials generally are conducted before larger trials are established, and in the intervening years standard, control treatments may have improved, which can reduce the relative efficacy of the experimental treatment.”
From Investigating and dealing with publication bias and other reporting biases in meta-analyses of health research: a review (2021) · cites this paper as [57]
In the citing paper
“Brief contact interventions reduce the number of suicide attempts per person but not the total number of suicide attempts or suicide deaths.9”
In the citing paper
“We constructed funnel plots for only 1 analysis due to the small number of studies included in each analysis (n<10) [63,64].”
From Tailored web-based interventions for pain: Systematic review and meta-analysis (2017) · cites this paper as [64]
In the citing paper
“Several reviews could not evaluate the presence of publication bias because of the small number of studies in the meta-analyses”
From Association between the reproductive health of young women and cardiovascular disease in later life: umbrella review (2020) · cites this paper as [123]
In the citing paper
“The Begg’s and Egger’s tests were not used because there were not more than 10 subjects in each group.15”
From A comprehensive analysis of the efficacy and safety of COVID-19 vaccines (2021) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Self-citationThe file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Self-citationDeeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Self-citationWood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
Self-citationSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Self-citationComparison of two methods to detect publication bias in meta-analysis.
Peters, J. L. (2006) · JAMA · doi:10.1001/jama.295.6.676 · Cited by 2,278
Self-citationA modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267
Self-citation
Flagged first, then by citations
1 of the 45 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Self-citationPage, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Self-citationBowden, J., Davey Smith, G., & Burgess, S. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv080 · Cited by 9,816
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citationThe MR-Base platform supports systematic causal inference across the human phenome
Hemani, G., Zheng, J., Elsworth, B., Wade, K. H., Haberland, V., Baird, D., Laurin, C., Burgess, S., Bowden, J., Langdon, R., et al. (2018) · eLife · doi:10.7554/elife.34408 · Cited by 7,959
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Lewis, K., Barry, M. J., Bennett, C. L., Eden, K. B., Holmes-Rovner, M., Llewellyn-Thomas, H., Lyddiatt, A., Thomson, R., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub5 · Cited by 6,685
How to perform a meta-analysis with R: a practical tutorial
Balduzzi, S., Rücker, G., & Schwarzer, G. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300117 · Cited by 5,827
Self-citationGlobal Prevalence of and Risk Factors for Irritable Bowel Syndrome: A Meta-analysis
Lovell, R. M., & Ford, A. C. (2012) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2012.02.029 · Cited by 2,155
Burgess, S., Bowden, J., Fall, T., Ingelsson, E., & Thompson, S. G. (2017) · Epidemiology · doi:10.1097/ede.0000000000000559 · Cited by 2,017
Wilmot, E. G., Edwardson, C. L., Achana, F. A., Davies, M. J., Gorely, T., Gray, L. J., Khunti, K., Yates, T., & Biddle, S. J. H. (2012) · Diabetologia · doi:10.1007/s00125-012-2677-z · Cited by 1,789
Singh, S., Allen, A. M., Wang, Z., Prokop, L. J., Murad, M. H., & Loomba, R. (2015) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2014.04.014 · Cited by 1,748
Te Morenga, L., Mallard, S., & Mann, J. (2012) · BMJ · doi:10.1136/bmj.e7492 · Cited by 1,629
Surgery for weight loss in adults
Colquitt, J. L., Pickett, K., Loveman, E., & Frampton, G. K. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003641.pub4 · Cited by 549
Seretny, M., Currie, G. L., Sena, E. S., Ramnarine, S., Grant, R., MacLeod, M. R., Colvin, L. A., & Fallon, M. (2014) · Pain · doi:10.1016/j.pain.2014.09.020 · Cited by 1,555
Quantifying publication bias in meta-analysis
Lin, L., & Chu, H. (2018) · Biometrics · doi:10.1111/biom.12817 · Cited by 1,674
Global prevalence of sarcopenia and severe sarcopenia: a systematic review and meta‐analysis
Petermann‐Rocha, F., Balntzi, V., Gray, S. R., Lara, J., Ho, F. K., Pell, J. P., & Celis‐Morales, C. (2022) · Journal of Cachexia, Sarcopenia and Muscle · doi:10.1002/jcsm.12783 · Cited by 1,499
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Col, N. F., Bennett, C. L., Barry, M. J., Eden, K., Holmes-Rovner, M. M., Llewellyn‐Thomas, H. A., Lyddiatt, A., Thomson, R., et al. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub4 · Cited by 1,540
Northey, J. M., Cherbuin, N., Pumpa, K. L., Smee, D. J., & Rattray, B. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2016-096587 · Cited by 1,380
Controlled Interventions to Reduce Burnout in Physicians: A Systematic Review and Meta-analysis
Panagioti, M., Panagopoulou, E., Bower, P., Lewith, G., Kontopantelis, E., Chew-Graham, C., Dawson, S., van Marwijk, H., Geraghty, K., & Esmail, A. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.7674 · Cited by 1,395
Rebar, A. L., Stanton, R., Geard, D., Short, C., Duncan, M. J., & Vandelanotte, C. (2015) · Health Psychology Review · doi:10.1080/17437199.2015.1022901 · Cited by 1,323
Exercise for preventing falls in older people living in the community
Sherrington, C., Fairhall, N., Wallbank, G., Tiedemann, A., Michaleff, Z. A., Howard, K., Clemson, L. M., Hopewell, S., & Lamb, S. E. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012424.pub2 · Cited by 1,295
A new improved graphical and quantitative method for detecting bias in meta-analysis
Furuya-Kanamori, L., Barendregt, J. J., & Doi, S. A. R. (2018) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000141 · Cited by 1,160
Horne, R., Chapman, S. C. E., Parham, R., Freemantle, N., Forbes, A., & Cooper, V. (2013) · PLoS ONE · doi:10.1371/journal.pone.0080633 · Cited by 1,174
Sisk, V. F., Burgoyne, A. P., Sun, J., Butler, J. L., & Macnamara, B. N. (2018) · Psychological Science · doi:10.1177/0956797617739704 · Cited by 1,159
The impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
The relationship between burnout, depression, and anxiety: a systematic review and meta-analysis.
Koutsimani, P., Montgomery, A., & Georganta, K. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00284 · Cited by 1,091
A systematic review of personality trait change through intervention.
Roberts, B. W., Luo, J., Briley, D. A., Chow, P. I., Su, R., & Hill, P. L. (2017) · Psychological Bulletin · doi:10.1037/bul0000088 · Cited by 1,047
Chen, J., & Hoek, G. (2020) · Environment International · doi:10.1016/j.envint.2020.105974 · Cited by 1,042
Dinu, M., Pagliai, G., Casini, A., & Sofi, F. (2018) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2017.58 · Cited by 1,016
Outdoor Particulate Matter Exposure and Lung Cancer: A Systematic Review and Meta-Analysis
Hamra, G. B., Guha, N., Cohen, A., Laden, F., Raaschou‐Nielsen, O., Samet, J. M., Vineis, P., Forastiere, F., Saldiva, P. H. N., Yorifuji, T., et al. (2014) · Environmental Health Perspectives · doi:10.1289/ehp/1408092 · Cited by 1,152
Bartsch, E., Medcalf, K. E., Park, A. L., & Ray, J. G. (2016) · BMJ · doi:10.1136/bmj.i1753 · Cited by 996
Lampit, A., Hallock, H., & Valenzuela, M. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001756 · Cited by 1,064
Lassale, C., Batty, G. D., Baghdadli, A., Jacka, F., Sánchez-Villegas, A., Kivimäki, M., & Akbaraly, T. (2019) · Molecular Psychiatry · doi:10.1038/s41380-018-0237-8 · Cited by 931
Faller, H., Schuler, M., Richard, M., Heckl, U., Weis, J., & Küffner, R. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2011.40.8922 · Cited by 912
Page, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916
Self-citationSuurmond, R., van Rhee, H., & Hak, T. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1260 · Cited by 881
Oka, P., Parr, H., Barberio, B., Black, C. J., Savarino, E. V., & Ford, A. C. (2020) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(20)30217-x · Cited by 882
Wang, Y.-H., Li, J.-Q., Shi, J.-F., Que, J.-Y., Liu, J.-J., Lappin, J. M., Leung, J., Ravindran, A. V., Chen, W.-Q., Qiao, Y.-L., et al. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0595-x · Cited by 885
The relationship between professional burnout and quality and safety in healthcare: a meta-analysis
Salyers, M. P., Bonfils, K. A., Luther, L., Firmin, R. L., White, D. A., Adams, E. L., & Rollins, A. L. (2017) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3886-9 · Cited by 843
Choice overload: A conceptual review and meta-analysis
Chernev, A., Böckenholt, U., & Goodman, J. (2015) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2014.08.002 · Cited by 858
Type 2 diabetes and cancer: umbrella review of meta-analyses of observational studies
Tsilidis, K. K., Kasimis, J. C., López, D. S., Ntzani, E., & Ioannidis, J. P. A. (2015) · BMJ · doi:10.1136/bmj.g7607 · Cited by 885
Self-citationNielsen, K. M., Nielsen, M. B., Ogbonnaya, C. N., Känsälä, M., Saari, E., & Isaksson, K. (2017) · Work & Stress · doi:10.1080/02678373.2017.1304463 · Cited by 1,038
Shi, L., & Lin, L. (2019) · Medicine · doi:10.1097/md.0000000000015987 · Cited by 818
Hill, N. T. M., Mowszowski, L., Naismith, S. L., Chadwick, V. L., Valenzuela, M., & Lampit, A. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16030360 · Cited by 782
Adiposity and cancer at major anatomical sites: umbrella review of the literature
Kyrgiou, M., Kalliala, I., Markozannes, G., Gunter, M. J., Paraskevaidis, E., Gabra, H., Martin-Hirsch, P., & Tsilidis, K. K. (2017) · BMJ · doi:10.1136/bmj.j477 · Cited by 803
Orellano, P. W., Reynoso, J. I., QUARANTA, N. E., Bardach, A., & Ciapponi, A. (2020) · Environment International · doi:10.1016/j.envint.2020.105876 · Cited by 857
Environmental Risk Factors for Inflammatory Bowel Diseases: An Umbrella Review of Meta-analyses
Piovani, D., Danese, S., Peyrin‐Biroulet, L., Nikolopoulos, G. K., Lytras, T., & Bonovas, S. (2019) · Gastroenterology · doi:10.1053/j.gastro.2019.04.016 · Cited by 837
Hunter, J. P., Saratzis, A., Sutton, A. J., Boucher, R. H., Sayers, R. D., & Bown, M. J. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.03.003 · Cited by 786
Self-citationPage, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catalá-López, F., Li, L., Reid, E. K., Sarkis-Onofre, R., et al. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002028 · Cited by 768
Self-citationBarberio, B., Zamani, M., Black, C. J., Savarino, E. V., & Ford, A. C. (2021) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(21)00014-5 · Cited by 758
Langford, R., Bonell, C. P., Jones, H. E., Pouliou, T., Murphy, S. M., Waters, E., Komro, K. A., Gibbs, L. F., Magnus, D., & Campbell, R. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008958.pub2 · Cited by 768
Hou, E., Luo, Y., Kuang, Y., Chen, C. R., Lu, X., Jiang, L., Luo, X., & Wen, D. (2020) · Nature Communications · doi:10.1038/s41467-020-14492-w · Cited by 763
Ford, A. C., Quigley, E. M. M., Lacy, B. E., Lembo, A. J., Saito, Y. A., Schiller, L. R., Soffer, E. E., Spiegel, B. M. R., & Moayyedi, P. (2014) · American Journal of Gastroenterology · doi:10.1038/ajg.2014.202 · Cited by 747
A guide to systematic review and meta-analysis of prognostic factor studies
Riley, R. D., Moons, K. G. M., Snell, K. I. E., Ensor, J., Hooft, L., Altman, D. G., Hayden, J. A., Collins, P. G. S., & Debray, T. P. A. (2019) · BMJ · doi:10.1136/bmj.k4597 · Cited by 771
Self-citationProbiotics for the prevention of Clostridium difficile-associated diarrhea in adults and children
Goldenberg, J. Z., Ma, S. S., Saxton, J. D., Martzen, M. R., Vandvik, P. O., Thorlund, K., Guyatt, G. H., & Johnston, B. C. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006095.pub3 · Cited by 741
Cupp, M. A., Cariolou, M., Tzoulaki, I., Aune, D., Evangelou, E., & Berlanga-Taylor, A. J. (2020) · BMC Medicine · doi:10.1186/s12916-020-01817-1 · Cited by 697
Salameh, J.-P., Bossuyt, P. M., McGrath, T. A., Thombs, B. D., Hyde, C. J., Macaskill, P., Deeks, J. J., Leeflang, M., Korevaar, D. A., Whiting, P., et al. (2020) · BMJ · doi:10.1136/bmj.m2632 · Cited by 719
Self-citationRisk factors for type 2 diabetes mellitus: An exposure-wide umbrella review of meta-analyses
Bellou, V., Belbasis, L., Tzoulaki, I., & Evangelou, E. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194127 · Cited by 713
The impact of study size on meta-analyses: examination of underpowered studies in Cochrane reviews
Turner, R. M., Bird, S. M., & Higgins, J. P. T. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059202 · Cited by 672
Self-citationBelbasis, L., Bellou, V., Εvangelou, Ε., Ioannidis, J. P. A., & Tzoulaki, I. (2015) · The Lancet Neurology · doi:10.1016/s1474-4422(14)70267-4 · Cited by 715
Self-citationFord, A. C., Moayyedi, P., Lacy, B. E., Lembo, A. J., Saito, Y. A., Schiller, L. R., Soffer, E., Spiegel, B. M. R., & Quigley, E. M. M. (2014) · The American Journal of Gastroenterology · doi:10.1038/ajg.2014.187 · Cited by 664
Noetel, M., Sanders, T., Gallardo-Gómez, D., Taylor, P., del Pozo Cruz, B., van den Hoek, D., Smith, J. J., Mahoney, J., Spathis, J., Moresi, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-075847 · Cited by 707
Groot, C., Hooghiemstra, A. M., Raijmakers, P. G. H. M., van Berckel, B. N. M., Scheltens, P., Scherder, E. J. A., van der Flier, W. M., & Ossenkoppele, R. (2016) · Ageing Research Reviews · doi:10.1016/j.arr.2015.11.005 · Cited by 616
Association of BCG, DTP, and measles containing vaccines with childhood mortality: systematic review
Higgins, J. P. T., Soares‐Weiser, K., López-López, J. A., Κακούρου, Α., Chaplin, K., Christensen, H., Martin, N. K., Sterne, J. A. C., & Reingold, A. L. (2016) · BMJ · doi:10.1136/bmj.i5170 · Cited by 635
Self-citationCrocker, J. C., Ricci‐Cabello, I., Parker, A., Hirst, J. A., Chant, A., Petit-Zeman, S., Evans, D., & Rees, S. (2018) · BMJ · doi:10.1136/bmj.k4738 · Cited by 650
Theeboom, T., Beersma, B., & van Vianen, A. E. M. (2014) · The Journal of Positive Psychology · doi:10.1080/17439760.2013.837499 · Cited by 771
Frontal midline theta reflects anxiety and cognitive control: Meta-analytic evidence
Cavanagh, J. F., & Shackman, A. J. (2014) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2014.04.003 · Cited by 684
Probiotics for the prevention of pediatric antibiotic-associated diarrhea
Goldenberg, J. Z., Lytvyn, L., Steurich, J., Parkin, P. C., Mahant, S., & Johnston, B. C. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004827.pub4 · Cited by 635
Ford, A. C., Harris, L. A., Lacy, B. E., Quigley, E. M. M., & Moayyedi, P. (2018) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.15001 · Cited by 619
Halpin, S. J., & Ford, A. C. (2012) · American Journal of Gastroenterology · doi:10.1038/ajg.2012.260 · Cited by 607
The Effect of Age on Mortality in Patients With COVID-19: A Meta-Analysis With 611,583 Subjects
Bonanad, C., García-Blas, S., Tarazona-Santabalbina, F., Sanchis, J., Bertomeu-González, V., Fácila, L., Ariza, A., Núñez, J., & Cordero, A. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2020.05.045 · Cited by 730
Boyland, E. J., Nevitt, S. J., Kelly, B., Smith, C. T., Jones, A., Halford, J. C. G., & Robinson, E. (2016) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.115.120022 · Cited by 605
Ford, A. C., Forman, D., Hunt, R. H., Yuan, Y., & Moayyedi, P. (2014) · BMJ · doi:10.1136/bmj.g3174 · Cited by 585
Twenty years of telemedicine in chronic disease management – an evidence synthesis
Wootton, R. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.120219 · Cited by 545
PRISMA harms checklist: improving harms reporting in systematic reviews
Zorzela, L., Loke, Y. K., Ioannidis, J. P., Golder, S., Santaguida, P., Altman, D. G., Moher, D., Vohra, S., & PRISMA harms group (2016) · BMJ · doi:10.1136/bmj.i157 · Cited by 557
Self-citationStatins for Prevention of Cardiovascular Disease in Adults
Chou, R., Dana, T., Blazina, I., Daeges, M., & Jeanne, T. L. (2016) · JAMA · doi:10.1001/jama.2015.15629 · Cited by 570
Pan, A., Wang, Y., Talaei, M., Hu, F. B., & Wu, T. (2015) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(15)00316-2 · Cited by 587
Food insecurity and mental health: A systematic review and meta-analysis
Pourmotabbed, A., Moradi, S., Babaei, A., Ghavami, A., Mohammadi, H., Jalili, C., Symonds, M. E., & Miraghajani, M. (2020) · Public Health Nutrition · doi:10.1017/s136898001900435x · Cited by 556
Influence of trial sample size on treatment effect estimates: meta-epidemiological study
Dechartres, A., Trinquart, L., Boutron, I., & Ravaud, P. (2013) · BMJ · doi:10.1136/bmj.f2304 · Cited by 544
Probiotics for the prevention of Clostridium difficile-associated diarrhea in adults and children
Goldenberg, J. Z., Yap, C., Lytvyn, L., Lo, C. K.-F., Beardsley, J., Mertz, D., & Johnston, B. C. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006095.pub4 · Cited by 550
Lok, A. S.-F., McMahon, B. J., Brown, R. S., Wong, J. B., Ahmed, A. T., Farah, W. H., Almasri, J., Alahdab, F., Benkhadra, K., Mouchli, M. A., et al. (2015) · Hepatology · doi:10.1002/hep.28280 · Cited by 552
Lahart, I. M., Metsios, G. S., Nevill, A. M., & Carmichael, A. R. (2015) · Acta Oncologica · doi:10.3109/0284186x.2014.998275 · Cited by 560
Carter, E. C., Kofler, L. M., Forster, D. E., & McCullough, M. E. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000083 · Cited by 594
The International Weight Management in Pregnancy (i-WIP) Collaborative Group (2017) · BMJ · doi:10.1136/bmj.j3119 · Cited by 529
Global prevalence of, and risk factors for, uninvestigated dyspepsia: a meta-analysis
Ford, A. C., Marwaha, A., Sood, R., & Moayyedi, P. (2014) · Gut · doi:10.1136/gutjnl-2014-307843 · Cited by 549
Dekkers, O. M., Vandenbroucke, J. P., Cevallos, M., Renehan, A. G., Altman, D. G., & Egger, M. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002742 · Cited by 525
Self-citationEvidence Relating Health Care Provider Burnout and Quality of Care
Tawfik, D. S., Scheid, A., Profit, J., Shanafelt, T. D., Trockel, M., Adair, K. C., Sexton, J. B., & Ioannidis, J. P. A. (2019) · Annals of Internal Medicine · doi:10.7326/m19-1152 · Cited by 592
Self-citationDelayed vs early umbilical cord clamping for preterm infants: a systematic review and meta-analysis
Fogarty, M., Osborn, D. A., Askie, L. M., Seidler, A. L., Hunter, K. E., Lui, K., Simes, R. J., & Tarnow‐Mordi, W. (2017) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2017.10.231 · Cited by 524
Intra-articular corticosteroid for knee osteoarthritis
Jüni, P., Hari, R., Rutjes, A. W., Fischer, R., Silletta, M. G., Reichenbach, S., & da Costa, B. R. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005328.pub3 · Cited by 548
Cecchini, M., & Warin, L. (2015) · Obesity Reviews · doi:10.1111/obr.12364 · Cited by 538
Mead, E., Brown, T. J., Rees, K., Azevedo, L. B., Whittaker, V., Jones, D., Olajide, J., Mainardi, G. M., Corpeleijn, E., O’Malley, C. L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012651 · Cited by 550
Self-citationAssociation Between Influenza Vaccination and Cardiovascular Outcomes in High-Risk Patients
Udell, J. A., Zawi, R., Bhatt, D. L., Keshtkar‐Jahromi, M., Gaughran, F., Phrommintikul, A., Ciszewski, A., Vakili, H., Hoffman, E. B., Farkouh, M. E., et al. (2013) · JAMA · doi:10.1001/jama.2013.279206 · Cited by 526
Umer, A., Kelley, G. A., Cottrell, L., Giacobbi, P. R., Innes, K. E., & Lilly, C. L. (2017) · BMC Public Health · doi:10.1186/s12889-017-4691-z · Cited by 563
A quantitative meta-analysis of neurocognitive functioning in posttraumatic stress disorder.
Scott, J. C., Matt, G. E., Wrocklage, K. M., Crnich, C., Jordan, J., Southwick, S. M., Krystal, J. H., & Schweinsburg, B. C. (2015) · Psychological Bulletin · doi:10.1037/a0038039 · Cited by 513
Homocysteine lowering interventions for preventing cardiovascular events
Martí-Carvajal, A. J., Solà, I., Lathyris, D., & Salanti, G. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006612.pub2 · Cited by 520
Neuenschwander, M., Ballon, A., Weber, K. S., Norat, T., Aune, D., Schwingshackl, L., & Schlesinger, S. (2019) · BMJ · doi:10.1136/bmj.l2368 · Cited by 531
Global epidemiology of Duchenne muscular dystrophy: an updated systematic review and meta-analysis
Crisafulli, S., Sultana, J., Fontana, A., Salvo, F., Messina, S., & Trifirò, G. (2020) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-020-01430-8 · Cited by 505
Davies, E. B., Morriss, R., & Glazebrook, C. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3142 · Cited by 499
Morgan, A. J., Ross, A., & Reavley, N. J. (2018) · PLOS ONE · doi:10.1371/journal.pone.0197102 · Cited by 461
The Status of Irritability in Psychiatry: A Conceptual and Quantitative Review
Vidal‐Ribas, P., Brotman, M. A., Valdivieso, I., Leibenluft, E., & Stringaris, A. K. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.04.014 · Cited by 493
Metadata
- Authors
- Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., Tetzlaff, J., Deeks, J. J., Peters, J., Macaskill, P., Schwarzer, G., Duval, S., Altman, D. G., Moher, D., & Higgins, J. P. T.
- Affiliations
- University of Bristol (GB)
- University of Leicester (GB)
- Stanford Medicine (US)
- Tufts University (US)
- London School of Hygiene & Tropical Medicine (GB)
- Ottawa Hospital Research Institute (CA)
- University of Birmingham (GB)
- University of Exeter (GB)
- The University of Sydney (AU)
- University of Freiburg (DE)
- University of Minnesota (US)
- University of Oxford (GB)
- Corresponding author
- Sterne, J. A. C.
- ORCID
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2011-07-22
- Volume
- 343
- Issue
- jul22 1
- Pages
- d4002-d4002
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W2119605658
- Semantic Scholar
- 660168dbe48731c1dae7dfd14a0525404d8e59e5
- Cited by
- 7,709
- References
- 45
- Citations by year
- 2026: 967 · 2025: 792 · 2024: 824 · 2023: 766 · 2022: 786 · 2021: 687 · 2020: 610 · 2019: 492 · 2018: 447 · 2017: 377 · 2016: 304 · 2015: 241 · 2014: 197 · 2013: 122 · 2012: 74
- FWCI
- 136.80
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ (publishedVersion)
- PubMed (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Leicester Research Archive (University of Leicester) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Explore Bristol Research (submittedVersion)
- Funders
- Cancer Research UK
- Deutsche Forschungsgemeinschaft (FOR 534)
- Canadian Institutes of Health Research
- Medical Research Council (U1052.00.011)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- funnel plot asymmetry, publication bias, meta-analysis bias, randomized controlled trials, heterogeneity
- MeSH terms
- Statistics as Topic, Meta-Analysis as Topic, Selection Bias, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
