The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials
Open accessAbstract
Funnel plots, and tests for funnel plot asymmetry, have been widely used to examine bias in the results of meta-analyses. Funnel plot asymmetry should not be equated with publication bias, because it has a number of other possible causes. This article describes how to interpret funnel plot asymmetry, recommends appropriate tests, and explains the implications for choice of meta-analysis model
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“so the non-significant tendencies to asymmetry and small study effects identified by the Eggers and Begg tests, presumably caused by the similar SEM of most of the studies, can be assumed to be trustworthy [30].”
From Are Dietary Proteins the Key to Successful Body Weight Management? A Systematic Review and Meta-Analysis of Studies Assessing Body Weight Outcomes after Interventions with Increased Dietary Protein (2021) · cites this paper as [30]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“publication bias was not assessed in this review because there was no forest plot with at least ten studies (Sterne et al. 2011).”
From The Effect of Mindfulness-Based and Acceptance Commitment Therapy-Based Interventions to Improve the Mental Well-Being Among Parents of Children with Developmental Disabilities: A Systematic Review and Meta-Analysis. (2022) · cites this paper as Sterne et al. 2011
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Publication bias was assessed using funnel plot analysis and Egger's test where the number of studies for the outcome of interest was ≥10”
From IVF/ICSI or surgery as first approach for the treatment of infertility associated with ovarian and deep infiltrating endometriosis? A systematic review and meta-analysis. (2026) · cites this paper as Sterne et al., 2011
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For those comparisons in which data were obtained from at least ten studies (Sterne et al. 2011), publication bias was assessed by visual inspection of funnel plot asymmetry.”
From Analysis of sex-based differences in energy substrate utilization during moderate-intensity aerobic exercise (2022) · cites this paper as Sterne et al. 2011
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Instead, the asymmetry likely represents a ‘small study bias’, where methodological approaches inherent in small studies lead to stronger effects with greater variance (Peters et al., 2008; Sterne et al., 2011).”
From The Distributed Practice Effect on Classroom Learning: A Meta-Analytic Review of Applied Research (2025) · cites this paper as Sterne et al., 2011
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Publication bias was assessed by visual inspection of funnel plot and by Egger test to assess asymmetry, as well as by Begg test to assess small study effects [29,30,31].”
From Are Dietary Proteins the Key to Successful Body Weight Management? A Systematic Review and Meta-Analysis of Studies Assessing Body Weight Outcomes after Interventions with Increased Dietary Protein (2021) · cites this paper as [30]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If a meta-analysis of a medication adherence measure had adequate power (ie, ≥10 cohorts), funnel plots were generated and visually inspected, and the Egger test was used to assess for small study effects (funnel plot asymmetry) potentially caused by reporting bias.30”
From Adherence to PCSK9 Inhibitors in Clinical Practice (2026) · cites this paper as [30]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“we only calculated bias statistics if the total number of correspondence audits for a given analysis equalled or exceeded ten, otherwise, the statistical power could be too low to detect asymmetry.”
From The state of hiring discrimination: A meta-analysis of (almost) all recent correspondence experiments (2023) · cites this paper as Sterne et al., 2011
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Because the symmetry of funnel plots could be influence by various factors, such as publication bias, and/or small-study effects, it was difficult to figure out the cause of asymmetry, especially when the sample size of each comparison was less than ten [82].”
From Efficacy and safety of curcuminoids alone in alleviating pain and dysfunction for knee osteoarthritis: a systematic review and meta-analysis of randomized controlled trials (2022) · cites this paper as [82]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“To assess risk of publication bias, we plotted each trial's effect against the standard errors (Sterne et al., 2011), creating a single effect size per study per outcome.”
From Shared Picture Book Reading Interventions for Child Language Development: A Systematic Review and Meta-Analysis (2020) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Notably, heterogeneity can also influence funnel plot asymmetry (Sterne et al., 2011).”
From The Distributed Practice Effect on Classroom Learning: A Meta-Analytic Review of Applied Research (2025) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Consequently, the Egger test was not employed to formally assess funnel plot asymmetry, as it is not recommended for such small numbers of studies [25].”
The cited source says what the claim attributes to it.
In the citing paper
“We were not able to explore possible publication bias through a funnel plot (Sterne 2011), as we did not combine a sufficient number of trials.”
From Mobile technologies to support healthcare provider to healthcare provider communication and management of care (2020) · cites this paper as Sterne 2011
The cited source says what the claim attributes to it.
In the citing paper
“Funnel plots were generated for visual assessment for asymmetry and potential publication bias 31 (see Figures S20–S29).”
From Systematic review and meta-analysis of protein intake to support muscle mass and function in healthy adults (2022) · cites this paper as [31]
The cited source says what the claim attributes to it.
In the citing paper
“Typically tests for funnel plot asymmetry should only be used where there are at least 10 studies in each meta-analysis (Sterne et al., 2011).”
From Nature-based outdoor activities for mental and physical health: Systematic review and meta-analysis (2021) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Presence of publication bias was assessed with funnel plots, 22 Rosenthal's fail-safe N , 23 and Egger's regression intercept. 24”
From Light Therapy for Patients With Bipolar Depression: Systematic Review and Meta-Analysis of Randomized Controlled Trials (2020) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“To explore publication and small study biases, a funnel plot and Egger ' s test for asymmetry was used where at least 10 different-sized studies were pooled. 62”
From High-velocity power training has similar effects to traditional resistance training for functional performance in older adults: a systematic review (2023) · cites this paper as [62]
The cited source says what the claim attributes to it.
In the citing paper
“Small study effects (e.g. publication bias) were assessed when there were 10 or more studies in the meta-analysis by visually examining the funnel plot, supplemented by Egger’s test of funnel plot asymmetry [39, 40]. Duval and Tweedie’s trim and fill procedure was used to estimate the effect size after imputing potentially missing studies [41].”
From Systematic review and meta-analysis of Mental Health First Aid training: Effects on knowledge, stigma, and helping behaviour (2018) · cites this paper as [40]
The cited source says what the claim attributes to it.
In the citing paper
“this asymmetry could exist due to chance, as the analysis contained few studies with few participants (Sterne et al., 2011).”
From The effects of physical activity on cortisol and sleep: A systematic review and meta-analysis. (2022) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“However, for each risk factor, no one included more than ten studies; these numbers were too small so that the test efficacy of funnel plots and egger's test was insufficient [31]. Therefore, funnel plots and Egger's test were not assessed to calculate the risk of bias.”
From Preoperative Risk Factors for Short-Term Postoperative Mortality of Acute Mesenteric Ischemia after Laparotomy: A Systematic Review and Meta-Analysis (2020) · cites this paper as [31]
The cited source says what the claim attributes to it.
In the citing paper
“We assessed the latter for evidence of asymmetry, and therefore possible publication bias or other small study effects, using the Egger test, 35 if there were suf fi cient ( 10) eligible studies included in the meta-analysis, in line with recommendations. 36”
From Efficacy of Probiotics in Irritable Bowel Syndrome: Systematic Review and Meta-analysis (2023) · cites this paper as [36]
The cited source says what the claim attributes to it.
In the citing paper
“According to Sterne et al. (2011) it is not recommended to use tests for funnel plot asymmetry when the number of studies included in the meta-analysis is <10 as statistical power is usually too low to distinguish chance from real asymmetry.”
From The effect of internet-delivered cognitive behavioral therapy for depression and anxiety on quality of life: A meta-analysis of randomized controlled trials (2023) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“However, not all asymmetric funnel plots are due to issues that impact meta-analytic inference (Sterne et al., 2011).”
From Can MRI measure myelin? Systematic review, qualitative assessment, and meta-analysis of studies validating microstructural imaging with myelin histology (2021) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Due to the small number of included studies, publication bias was not formally assessed using funnel plots or asymmetry tests, as these methods have low statistical power under such conditions (Sterne et al., 2011).”
From Efficacy and safety of small interfering RNA (siRNA) therapies for hypertriglyceridemia and mixed dyslipidemia: an updated systematic review and meta-analysis (2026) · cites this paper as Sterne et al., 2011
The cited source says what the claim attributes to it.
In the citing paper
“Because the test for a publication is not advised for fewer than 10 studies, Egger’s test was not performed.20”
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“To assess risk of bias, the Cochrane Collaboration's risk-of-bias tool (Rob2) was used (Sterne et al., 2011).”
From Effects of voluntary slow breathing on heart rate and heart rate variability: A systematic review and a meta-analysis (2022) · cites this paper as Sterne et al., 2011
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Included studies exceeded the minimum number of effect sizes to be pooled [98].”
From Estimating the Effect of Aerobic Exercise Training on Novel Lipid Biomarkers: A Systematic Review and Multivariate Meta-Analysis of Randomized Controlled Trials (2023) · cites this paper as [98]
Experimental — accuracy not yet measuredIn the citing paper
“This may be due to several reasons, including true heterogeneity (i.e., smaller studies differ from larger ones in terms of study population, exposure levels, etc.), selection bias (i.e., the selective publication of small studies showing an effect), bias in design or analysis, or chance [77,78].”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [77]
In the citing paper
“Publication bias was examined by inspecting the funnel plot [44] and conducting the Egger test of the intercept with a one-tailed significance level of α=.05 [45]. In addition, we used Duval and Tweedie’s trim and fill procedure [46] to adjust the effect size for missing studies.”
In the citing paper
“Based on current recommendations, at least 10 studies are needed to examine reporting bias using funnel plots and, if the heterogeneity is high, the minimum number of studies may be substantially more than 10. 34”
From Global prevalence of sarcopenia and severe sarcopenia: a systematic review and meta‐analysis (2022) · cites this paper as [34]
In the citing paper
“Trialists may have implemented interventions less thoroughly in larger trials, thus explaining the more positive results in smaller trials 57 .”
From Investigating and dealing with publication bias and other reporting biases in meta-analyses of health research: a review (2021) · cites this paper as [57]
In the citing paper
“Small trials generally are conducted before larger trials are established, and in the intervening years standard, control treatments may have improved, which can reduce the relative efficacy of the experimental treatment.”
From Investigating and dealing with publication bias and other reporting biases in meta-analyses of health research: a review (2021) · cites this paper as [57]
In the citing paper
“Brief contact interventions reduce the number of suicide attempts per person but not the total number of suicide attempts or suicide deaths.9”
In the citing paper
“We constructed funnel plots for only 1 analysis due to the small number of studies included in each analysis (n<10) [63,64].”
From Tailored web-based interventions for pain: Systematic review and meta-analysis (2017) · cites this paper as [64]
In the citing paper
“Several reviews could not evaluate the presence of publication bias because of the small number of studies in the meta-analyses”
From Association between the reproductive health of young women and cardiovascular disease in later life: umbrella review (2020) · cites this paper as [123]
In the citing paper
“The Begg’s and Egger’s tests were not used because there were not more than 10 subjects in each group.15”
From A comprehensive analysis of the efficacy and safety of COVID-19 vaccines (2021) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Self-citationThe file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Self-citationDeeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Self-citationWood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
Self-citationSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Self-citationComparison of two methods to detect publication bias in meta-analysis.
Peters, J. L. (2006) · JAMA · doi:10.1001/jama.295.6.676 · Cited by 2,278
Self-citationA modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267
Self-citation
Flagged first, then by citations
1 of the 45 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 901–1,000 of 1,118
Tailored web-based interventions for pain: Systematic review and meta-analysis
Martorella, G., Boitor, M., Berube, M., Fredericks, S., Le May, S., & Gélinas, C. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8826 · Cited by 88
Efficacy of Pregabalin in Acute Postoperative Pain Under Different Surgical Categories
Lam, D. M. H., Choi, S. W., Wong, S. S. C., Irwin, M. G., & Cheung, C. (2015) · Medicine · doi:10.1097/md.0000000000001944 · Cited by 89
Chang, W.-C., Lin, C. S., Lee, C., Sung, T.-L., Tung, T., & Liu, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0179105 · Cited by 89
Choi, E. K., Park, H. B., Lee, K. H., Park, J.-W., Eisenhut, M., van der Vliet, H. J., Kim, G., & Shin, J. I. (2017) · Annals of Oncology · doi:10.1093/annonc/mdx819 · Cited by 88
Shah, R., Nayyar, M., Jovin, I. S., Abdul-Rashid, H. A., Bondy, B. R., Fan, T. M., Flaherty, M. P., & Rao, S. V. (2018) · Annals of Internal Medicine · doi:10.7326/m17-2679 · Cited by 89
Honvo, G., Reginster, J., Rannou, F., Rygaert, X., Geerinck, A., Rabenda, V., McAlindon, T. E., Charles, A., Fuggle, N. R., Cooper, C. C., et al. (2019) · Drugs & Aging · doi:10.1007/s40266-019-00657-w · Cited by 90
Effects of computerised cognitive training on cognitive impairment: a meta-analysis
Hu, M., Wu, X., Shu, X., Hu, H., Chen, Q., Peng, L., & Feng, H. (2019) · Journal of Neurology · doi:10.1007/s00415-019-09522-7 · Cited by 89
Taylor, J. R., Bastos, M. L., Lachapelle-Chisholm, S., Mayo, N. E., Johnston, J. C., & Menzies, D. (2023) · EClinicalMedicine · doi:10.1016/j.eclinm.2023.101979 · Cited by 87
Bashashati, M., Moradi, M., & Sarosiek, I. (2017) · Cytokine · doi:10.1016/j.cyto.2017.08.017 · Cited by 91
Tham, T., Bardash, Y., Herman, S. W., & Costantino, P. D. (2018) · Head & Neck · doi:10.1002/hed.25324 · Cited by 89
Schwarzer, G. (2022) · Wiley eBooks · doi:10.1002/9781119099369.ch26 · Cited by 91
Self-citationWaller, B., Ogonowska-Słodownik, A., Vitor, M., Rodionova, K., Lambeck, J., Heinonen, A., & Daly, D. (2016) · Age and Ageing · doi:10.1093/ageing/afw102 · Cited by 88
Elsenburg, L. K., van Wijk, K. J. E., Liefbroer, A. C., & Smidt, N. (2017) · Obesity · doi:10.1002/oby.21797 · Cited by 84
Schwens, C., Zapkau, F. B., Bierwerth, M., Isidor, R., Knight, G., & Kabst, R. (2017) · Entrepreneurship Theory and Practice · doi:10.1111/etap.12280 · Cited by 97
RetractedThe efficacy and heterogeneity of antipsychotic response in schizophrenia: A meta-analysis
McCutcheon, R. A., Pillinger, T., Mizuno, Y., Montgomery, A., Pandian, H., Vano, L. J., Marques, T. R., & Howes, O. D. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0502-5 · Cited by 89
Effects of Baduanjin exercise for knee osteoarthritis: A systematic review and meta-analysis
Zeng, Z., Liu, Y.-B., Fang, J., Liu, Y., Luo, J. F., & Yang, M. (2019) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2019.102279 · Cited by 88
Does air pollution modify temperature-related mortality? A systematic review and meta-analysis.
Hu, X., Han, W., Wang, Y.-X., Aunan, K., Pan, X.-C., Huang, J., & Li, G. (2022) · Environmental Research · doi:10.1016/j.envres.2022.112898 · Cited by 73
Gianfredi, V., Dinu, M., Nucci, D., Eussen, S. J. P. M., Amerio, A., Schram, M. T., Schaper, N. C., & Odone, A. (2022) · Nutrition Reviews · doi:10.1093/nutrit/nuac058 · Cited by 90
Malin, G., Morris, R. K., Riley, R. D., Teune, M., & Khan, K. S. (2014) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.12517 · Cited by 88
Kelsall, H. L., Wijesinghe, M. S. D., Creamer, M. C., McKenzie, D. P., Forbes, A. B., Page, M. J., & Sim, M. R. (2015) · Epidemiologic Reviews · doi:10.1093/epirev/mxu014 · Cited by 97
Teixeira-Santos, A. C., Moreira, C. S., Magalhães, R., Magalhães, C., Pereira, D. R., Leite, J., Carvalho, S., & Sampaio, A. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.05.009 · Cited by 87
Lau, Y., Chee, D. G. H., Chow, X. P., Cheng, L. J., & Wong, S. N. (2020) · Preventive Medicine · doi:10.1016/j.ypmed.2020.106001 · Cited by 78
Gao, C., Guo, J., Gong, T.-T., Lv, J.-L., Li, X.-Y., Liu, F.-H., Zhang, M., Shan, Y.-T., Zhao, Y.-H., & Wu, Q.-J. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2021.813943 · Cited by 88
Tarver, J., Daley, D., Lockwood, J., & Sayal, K. (2014) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-014-0556-5 · Cited by 87
Kazemi, M., Kim, J. Y., Wan, C., Xiong, J. D., Michalak, J., Xavier, I. B., Ganga, K., Tay, C. T., Grieger, J. A., Parry, S. A., et al. (2022) · Human Reproduction Update · doi:10.1093/humupd/dmac023 · Cited by 89
Nieuwenhuijse, M. J., Nelissen, R. G. H. H., Schoones, J. W., & Sedrakyan, A. (2014) · BMJ · doi:10.1136/bmj.g5133 · Cited by 87
Attenuating Pregnancy Weight Gain—What Works and Why: A Systematic Review and Meta-Analysis
Walker, R., Bennett, C., Blumfield, M., Gwini, S. M., Ma, J., Wang, F., Wan, Y., & Truby, H. (2018) · Nutrients · doi:10.3390/nu10070944 · Cited by 90
Artusi, C. A., Dwivedi, A. K., Romagnolo, A., Pal, G. D., Kauffman, M. A., Mata, I. F., Patel, D., Vizcarra, J. A., Duker, A. P., Marsili, L., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.7800 · Cited by 85
Cugusi, L., Manca, A., Bergamin, M., Blasio, A. D., Monticone, M., Deriu, F., & Mercuro, G. G. (2019) · Journal of physiotherapy · doi:10.1016/j.jphys.2019.02.003 · Cited by 88
Prevention of Cisplatin-Induced Acute Kidney Injury: A Systematic Review and Meta-Analysis
Hamroun, A., Lenain, R., Bigna, J. J., Speyer, É., Bui, L., Chamley, P., Pottier, N., Cauffiez, C., Dewaeles, E., Dhalluin, X., et al. (2019) · Drugs · doi:10.1007/s40265-019-01182-1 · Cited by 88
Maturana, F. M., Martus, P., Zipfel, S., & Niess, A. M. (2020) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000002506 · Cited by 96
“Scratch”-ing computational thinking with Arduino: A meta-analysis
Fidai, A., Capraro, M. M., & Capraro, R. M. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100726 · Cited by 87
Irvine, C., Egan, K. J., Shubber, Z., Rompay, K. K. A. V., Beanland, R. L., & Ford, N. P. (2015) · Clinical Infectious Diseases · doi:10.1093/cid/civ069 · Cited by 89
Hyaluronan for knee osteoarthritis: an updated meta-analysis of trials with low risk of bias
Richette, P., Chevalier, X., Ea, H., Eymard, F., Henrotin, Y. E., Ornetti, P., Sellam, J., Cucherat, M., & Marty, M. (2015) · RMD Open · doi:10.1136/rmdopen-2015-000071 · Cited by 85
Prophylactic Early Erythropoietin for Neuroprotection in Preterm Infants: A Meta-analysis
Fischer, H. S., Reibel-Georgi, N. J., Bührer, C., & Dame, C. (2017) · PEDIATRICS · doi:10.1542/peds.2016-4317 · Cited by 86
Antwi, G. O., Jayawardene, W. P., Lohrmann, D. K., & Mueller, E. L. (2019) · Supportive Care in Cancer · doi:10.1007/s00520-019-04788-z · Cited by 86
Ford, A. C., Tsipotis, E., Yuan, Y., Leontiadis, G. I., & Moayyedi, P. (2022) · Gut · doi:10.1136/gutjnl-2021-326583 · Cited by 87
Pangestu, S., & Rencz, F. (2022) · Value in Health · doi:10.1016/j.jval.2022.07.017 · Cited by 86
Risk factors for preterm birth: an umbrella review of meta-analyses of observational studies
Mitrogiannis, I., Εvangelou, Ε., Efthymiou, A., Kanavos, T., Birbas, E., Makrydimas, G., & Papatheodorou, S. (2023) · BMC Medicine · doi:10.1186/s12916-023-03171-4 · Cited by 111
Malignant transformation of oral leukoplakia: Systematic review and comprehensive meta‐analysis
de Barros, L. A. P., Ramos‐García, P., González‐Moles, M. Á., Urízar, J. M. A., & Warnakulasuriya, S. (2024) · Oral Diseases · doi:10.1111/odi.15140 · Cited by 100
Intravesical Bacillus Calmette-Guérin versus mitomycin C for Ta and T1 bladder cancer
Shelley, M. D., Court, J. B., Kynaston, H., Wilt, T. J., Coles, B., & MASON, M. D. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003231.pub2 · Cited by 86
RetractedElraiyah, T. A., Sonbol, M. B., Wang, Z., Khairalseed, T., Asi, N., Undavalli, C., Nabhan, M., Firwana, B., Altayar, O., Prokop, L. J., et al. (2014) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2014-2262 · Cited by 88
Zheng, W., Cai, D.-B., Yang, X.-H., Ungvari, G. S., Ng, C. H., Müller, N., Ning, Y.-P., & Xiang, Y. (2017) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2017.04.004 · Cited by 86
Hennemann, S., Farnsteiner, S., & Sander, L. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.09.001 · Cited by 86
The Use of (Network) Meta-Analysis in Clinical Oncology
ter Veer, E., van Oijen, M. G. H., & van Laarhoven, H. W. M. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.00822 · Cited by 83
More Versus Less Intensive Blood Pressure–Lowering Strategy
Verdecchia, P., Angeli, F., Gentile, G., & Reboldi, G. (2016) · Hypertension · doi:10.1161/hypertensionaha.116.07608 · Cited by 86
Papola, D., Purgato, M., Gastaldon, C., Bovo, C., van Ommeren, M., Barbui, C., & Tol, W. A. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012417.pub2 · Cited by 91
Morina, N., Malek, M., Nickerson, A., & Bryant, R. A. (2017) · Depression and Anxiety · doi:10.1002/da.22618 · Cited by 85
Zhang, X., Liu, W., Jiang, H.-L., & Mao, B. (2018) · The American Journal of Chinese Medicine · doi:10.1142/s0192415x18500490 · Cited by 85
Dorcaratto, D., Mazzinari, G., Fernández‐Moreno, M., Forner, E. M., Garcés‐Albir, M., Ortega, J., & Sabater, L. (2019) · Annals of Surgery · doi:10.1097/sla.0000000000003254 · Cited by 85
Li, C., Liu, Y., Xue, D., & Chan, C. W. H. (2020) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2020.103684 · Cited by 87
Mathur, M. B., & VanderWeele, T. J. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1464 · Cited by 92
Al-Rasheed, M. M., Fekih‐Romdhane, F., Jahrami, H., Pires, G. N., Saif, Z., Alenezi, A. F., Humood, A. M., Chen, W., Dai, H., Bragazzi, N. L., et al. (2022) · Sleep Medicine · doi:10.1016/j.sleep.2022.06.020 · Cited by 92
Liu, H. Y., Huang, N., Zhao, C. M., & Li, J. H. (2023) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2023.109164 · Cited by 87
Choi, M., Mesa‐Frias, M., Nüesch, E., Hargreaves, J., Prieto‐Merino, D., Bowling, A., Smith, G. D., Ebrahim, S. B. J., Dale, C. E., & Casas, J. P. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu212 · Cited by 89
Jordan, R. E., Majothi, S., Heneghan, N. R., Blissett, D. B., Riley, R. D., Sitch, A. J., Price, M. J., Bates, E. J., Turner, A. M., Bayliss, S. E., et al. (2015) · Health Technology Assessment · doi:10.3310/hta19360 · Cited by 84
Can the common-sense model predict adherence in chronically ill patients? A meta-analysis
Brandes, K., & Mullan, B. A. (2013) · Health Psychology Review · doi:10.1080/17437199.2013.820986 · Cited by 84
Young, M. M., Stevens, A., Porath-Waller, A. J., Pirie, T., Garritty, C., Skidmore, B., Turner, L., Arratoon, C., Haley, N., Leslie, K., et al. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-22 · Cited by 85
Self-citationXie, Z., Wang, X., Peng, Y., Zhu, S., Ma, L., Xiang, B., Gong, W., Chen, J., You, X., Jiang, J., et al. (2014) · Hepatology Research · doi:10.1111/hepr.12450 · Cited by 84
Goldkuhle, M., Narayan, V. M., Weigl, A., Dahm, P., & Skoetz, N. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020869 · Cited by 85
Saglimbene, V. M., Wong, G., van Zwieten, A., Palmer, S. C., Ruospo, M., Natale, P., Campbell, K. L., Teixeira-Pinto, A. M., Craig, J. C., & Strippoli, G. F. (2019) · Clinical Nutrition · doi:10.1016/j.clnu.2019.02.041 · Cited by 89
Chadalawada, S., Sillau, S., Archuleta, S., Mundo, W., Bandali, M., Parra-Henao, G., Rodriguez-Morales, A. J., Villamil‐Gómez, W. E., Suárez, J. A., Shapiro, L., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.15072 · Cited by 84
Platelet-rich plasma for rotator cuff tendinopathy: A systematic review and meta-analysis
Hamid, M. S. A., & Ghazali, S. S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0251111 · Cited by 84
Zhang, Y., & Maconochie, M. K. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03183-3 · Cited by 94
Cognitive function in clinical burnout: A systematic review and meta-analysis
Gavelin, H. M., Domellöf, M. E., Åström, E., Nelson, A., Launder, N. H., Neely, A. S., & Lampit, A. (2021) · Work & Stress · doi:10.1080/02678373.2021.2002972 · Cited by 108
Genetics of autism spectrum disorder: an umbrella review of systematic reviews and meta-analyses
Qiu, S., Qiu, Y., Li, Y., & Cong, X. (2022) · Translational Psychiatry · doi:10.1038/s41398-022-02009-6 · Cited by 98
Bizzozero‐Peroni, B., Martínez‐Vizcaíno, V., Fernández‐Rodríguez, R., Jiménez‐López, E., de Arenas‐Arroyo, S. N., Saz‐Lara, A., Goñi, V. D., & Mesas, A. E. (2023) · Nutrition Reviews · doi:10.1093/nutrit/nuad176 · Cited by 92
Runge, N., Ahmed, I., Saueressig, T., Perea, J., Labie, C., Maîresse, O., Nijs, J., Malfliet, A., Verschueren, S., Assche, D. V., et al. (2024) · Pain · doi:10.1097/j.pain.0000000000003279 · Cited by 94
Vahidy, F., Rahbar, M. H., Zhu, H., Rowan, P. J., Bambhroliya, A. B., & Savitz, S. I. (2016) · Stroke · doi:10.1161/strokeaha.116.012701 · Cited by 84
Mowszowski, L., Lampit, A., Walton, C. C., & Naismith, S. L. (2016) · Neuropsychology Review · doi:10.1007/s11065-016-9329-x · Cited by 82
Yuan, W.-H., Hsu, H.-C., Chen, Y., & Wu, C. (2020) · British Journal of Cancer · doi:10.1038/s41416-020-0928-1 · Cited by 86
Riggott, C., Mikocka-Walus, A., Gracie, D. J., & Ford, A. C. (2023) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(23)00186-3 · Cited by 83
Digital training for building resilience: systematic review, meta-analysis, and meta-regression
Ang, W. H. D., Chew, H. S. J., Dong, J., Yi, H., Mahendren, R., & Lau, Y. (2022) · Stress and Health · doi:10.1002/smi.3154 · Cited by 83
Kitsiou, S., Vatani, H., Paré, G., Gerber, B. S., Buchholz, S. W., Kansal, M. M., Leigh, J. W., & Creber, R. M. (2021) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2021.02.015 · Cited by 83
Depression, anxiety, and stress in oral lichen planus: a systematic review and meta-analysis
Porras‐Carrique, T. D., González‐Moles, M. Á., Warnakulasuriya, S., & Ramos‐García, P. (2021) · Clinical Oral Investigations · doi:10.1007/s00784-021-04114-0 · Cited by 84
Cheng, Q., Xu, B., Ng, M. S. N., Duan, Y., & So, W. K. W. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104162 · Cited by 83
Peer support interventions for parents and carers of children with complex needs
Sartore, G., Pourliakas, A., & Lagioia, V. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010618.pub2 · Cited by 97
Diagnostic Performance of Electronic Noses in Cancer Diagnoses Using Exhaled Breath
Scheepers, M. H. M. C., Al-Difaie, Z., Brandts, L., Peeters, A., van Grinsven, B., & Bouvy, N. D. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.19372 · Cited by 83
Vakhshoori, M., Nemati, S., Sabouhi, S., Yavari, B., Shakarami, M., Bondariyan, N., Emami, S. A., & Shafie, D. (2023) · BMC Cardiovascular Disorders · doi:10.1186/s12872-023-03572-6 · Cited by 82
Arifin, Z., Sukarmin, S., Saputro, S., & Kamari, A. (2025) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/15988 · Cited by 231
Individual participant data meta-analysis of prognostic factor studies: state of the art?
Abo-Zaid, G., Sauerbrei, W., & Riley, R. D. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-56 · Cited by 83
Vasilev, M. R., & Angele, B. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1147-x · Cited by 92
Mollison, D., Sellar, R., Bastin, M. E., Mollison, D., Chandran, S., Wardlaw, J. M., & Connick, P. (2017) · PLoS ONE · doi:10.1371/journal.pone.0177727 · Cited by 83
Merriman, N. A., Sexton, E., McCabe, G., Walsh, M. E., Rohde, D., Gorman, A., Jeffares, I., Donnelly, N.-A., Pender, N. P., Williams, D. J., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024429 · Cited by 84
Carraça, E. V., Encantado, J., Battista, F., Beaulieu, K., Blundell, J. E., Busetto, L., van Baak, M., Dicker, D., Ermolao, A., Farpour‐Lambert, N., et al. (2021) · Obesity Reviews · doi:10.1111/obr.13261 · Cited by 97
Luthra, P., Peyrin‐Biroulet, L., & Ford, A. C. (2015) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.13215 · Cited by 82
Gjerdevik, M., & Heuch, I. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-109 · Cited by 82
Breckenridge, J. D., Ginn, K. A., Wallwork, S. B., & McAuley, J. H. (2018) · Journal of Pain · doi:10.1016/j.jpain.2018.07.004 · Cited by 82
Kristiansen, C. B., Kjær, J. N., Hjorth, P., Andersen, K., & Prina, M. A. (2019) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-019-01680-3 · Cited by 90
Tsivgoulis, G. K., Katsanos, A. H., Köhrmann, M., Caso, V., Perren, F., Palaiodimou, L., Deftereos, S. G., Giannopoulos, S., Ellul, J., Krogias, C., et al. (2019) · Journal of Stroke · doi:10.5853/jos.2019.01067 · Cited by 82
Patel, J. J., Levy, D. A., Nguyen, S. A., Knochelmann, H. M., & Day, T. A. (2019) · Head & Neck · doi:10.1002/hed.26036 · Cited by 83
Wu, X. S., Miles, A., & Braakhuis, A. J. (2020) · Healthcare · doi:10.3390/healthcare8040579 · Cited by 88
Oxidative and antioxidative stress markers in keratoconus: a systematic review and meta‐analysis
Navel, V., Malecaze, J., Pereira, B., Baker, J. S., Malecaze, F., Sapin, V., Chiambaretta, F., & Dutheil, F. (2020) · Acta Ophthalmologica · doi:10.1111/aos.14714 · Cited by 82
Ethnic Differences in Dementia Risk: A Systematic Review and Meta-Analysis
Shiekh, S. I., Cadogan, S. L., Lin, L.-Y., Mathur, R., Smeeth, L. L., & Warren‐Gash, C. (2021) · Journal of Alzheimer s Disease · doi:10.3233/jad-201209 · Cited by 85
Detecting publication selection bias through excess statistical significance
Stanley, T. D., Doucouliagos, H., Ioannidis, J. P. A., & Carter, E. C. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1512 · Cited by 83
Self-citationZamani, M., Alizadeh‐Tabari, S., Singh, S., & Loomba, R. S. (2022) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.16879 · Cited by 82
Murillo, C., Vo, T., Vansteelandt, S., Harrison, L. E., Cagnie, B. J., Coppieters, I., Chys, M., Timmers, I., & Meeus, M. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102160 · Cited by 90
Early childhood attachment stability and change: a meta-analysis
Opie, J. E., McIntosh, J. E., Esler, T. B., Duschinsky, R., George, C., Schore, A., Kothe, E. J., Tan, E. S., Greenwood, C. J., & Olsson, C. A. (2021) · Attachment & Human Development · doi:10.1080/14616734.2020.1800769 · Cited by 80
Nury, E., Schmucker, C., Nagavci, B., Motschall, E., Nitschke, K., Schulte, E., Wegwarth, O., & Meerpohl, J. J. (2022) · Pain · doi:10.1097/j.pain.0000000000002423 · Cited by 85
Hansen, T. T., Astrup, A., & Sjödin, A. (2021) · Nutrients · doi:10.3390/nu13093193 · Cited by 77
“There was no indication of bias in the funnel plot, so the non-significant tendencies to asymmetry and small study effects identified by the Eggers and Begg tests, presumably caused by the similar SEM of most of the studies, can be assumed to be trustworthy [30].”
Result
Metadata
- Authors
- Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., Tetzlaff, J., Deeks, J. J., Peters, J., Macaskill, P., Schwarzer, G., Duval, S., Altman, D. G., Moher, D., & Higgins, J. P. T.
- Affiliations
- University of Bristol (GB)
- University of Leicester (GB)
- Stanford Medicine (US)
- Tufts University (US)
- London School of Hygiene & Tropical Medicine (GB)
- Ottawa Hospital Research Institute (CA)
- University of Birmingham (GB)
- University of Exeter (GB)
- The University of Sydney (AU)
- University of Freiburg (DE)
- University of Minnesota (US)
- University of Oxford (GB)
- Corresponding author
- Sterne, J. A. C.
- ORCID
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2011-07-22
- Volume
- 343
- Issue
- jul22 1
- Pages
- d4002-d4002
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W2119605658
- Semantic Scholar
- 660168dbe48731c1dae7dfd14a0525404d8e59e5
- Cited by
- 7,709
- References
- 45
- Citations by year
- 2026: 967 · 2025: 792 · 2024: 824 · 2023: 766 · 2022: 786 · 2021: 687 · 2020: 610 · 2019: 492 · 2018: 447 · 2017: 377 · 2016: 304 · 2015: 241 · 2014: 197 · 2013: 122 · 2012: 74
- FWCI
- 136.80
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ (publishedVersion)
- PubMed (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Leicester Research Archive (University of Leicester) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Explore Bristol Research (submittedVersion)
- Funders
- Cancer Research UK
- Deutsche Forschungsgemeinschaft (FOR 534)
- Canadian Institutes of Health Research
- Medical Research Council (U1052.00.011)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- funnel plot asymmetry, publication bias, meta-analysis bias, randomized controlled trials, heterogeneity
- MeSH terms
- Statistics as Topic, Meta-Analysis as Topic, Selection Bias, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
