Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 1,401–1,500 of 1,710
Chu, S. T.-W., & Mak, W. W. S. (2020) · Mindfulness · doi:10.1007/s12671-019-01258-9 · Cited by 99
Cancer Diagnosis and Suicide Mortality: A Systematic Review and Meta-Analysis
Amiri, S., & Behnezhad, S. (2020) · Archives of Suicide Research · doi:10.1080/13811118.2019.1596182 · Cited by 98
Serrano-Ripoll, M. J., Zamanillo-Campos, R., Fiol-DeRoque, M. A., Castro, A., & Ricci-Cabello, I. (2022) · JMIR mHealth and uHealth · doi:10.2196/29621 · Cited by 96
“In a second sensitivity analysis excluding 33% (4/12) of the trials with high risk of bias, a moderate statistically significant effect was still observed (SMD −0.41, 95% CI −0.71 to −0.10; 781/2859, 27.31% of the participants; P=.009; I2=71.6%), with the absence of publication bias according to Egger test (P=.53) and…”
MethodInfluentialType 2 Diabetes Among People With Posttraumatic Stress Disorder: Systematic Review and Meta-Analysis
Vancampfort, D., Rosenbaum, S., Ward, P. B., Steel, Z., Lederman, O., Lamwaka, A. V., Richards, J. W., & Stubbs, B. (2016) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000297 · Cited by 97
Cross, A., & Sheffield, D. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1594332 · Cited by 97
Fan, L., Xu, W., Cai, Y., Hu, Y., & Wu, C. (2019) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.06.009 · Cited by 96
Zou, H., Yin, P., Liu, L., Liu, W., Zhang, Z., Yang, Y., Li, W., Zong, Q., & Yu, X. (2019) · Frontiers in Endocrinology · doi:10.3389/fendo.2019.00728 · Cited by 96
“Publication bias was assessed using both Egger’s and Begg’s tests (37, 38).”
MethodCao, W. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1212056 · Cited by 94
Sanada, K., Montero-Marin, J., Barceló-Soler, A., Ikuse, D., Ota, M., Hirata, A., Yoshizawa, A., Hatanaka, R., Valero, M. S., Demarzo, M., et al. (2020) · International Journal of Molecular Sciences · doi:10.3390/ijms21072484 · Cited by 96
Villar, J., Mackey, M. E., Carroli, G., & Donner, A. (2001) · Statistics in Medicine · doi:10.1002/sim.1096 · Cited by 96
Gu, D., Ou, S., & Liu, G. (2022) · Neuroepidemiology · doi:10.1159/000520966 · Cited by 94
Mannucci, E., Antenore, A., Giorgino, F., & Scavini, M. (2018) · Journal of Diabetes Science and Technology · doi:10.1177/1932296817719290 · Cited by 90
Meta-Analysis of the Association Between Whole Grain Intake and Coronary Heart Disease Risk
Tang, G., Wang, D., Long, J., Yang, F., & Si, L. (2015) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2014.12.015 · Cited by 94
Langlois, P., Perrochon, A., David, R., Rainville, P., Wood, C., Vanhaudenhuyse, A., Pageaux, B., Ounajim, A., Lavallière, M., Debarnot, U., et al. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104591 · Cited by 124
Álvarez-García, C., & Yaban, Z. Ş. (2020) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2019.101077 · Cited by 94
A system for rating the stability and strength of medical evidence
Treadwell, J. R., Tregear, S. J., Reston, J. T., & Turkelson, C. M. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-52 · Cited by 93
Khan, T. A., Tayyiba, M., Agarwal, A., Mejia, S. B., de Souza, R. J., Wolever, T. M. S., Leiter, L. A., Kendall, C. W. C., Jenkins, D. J. A., & Sievenpiper, J. L. (2019) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2019.05.034 · Cited by 93
“If 10 cohort comparisons were available, we assessed publication bias by visual inspection of funnel plots and using the Begg’s and the Egger’s tests.(38,39)”
MethodA meta-analysis of prevalence estimates and moderators of low bone mass in people with schizophrenia
Stubbs, B., De Hert, M., Sepehry, A. A., Correll, C. U., Mitchell, A. J., Soundy, A., Detraux, J., & Vancampfort, D. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12313 · Cited by 92
Amerio, A., Stubbs, B., Odone, A., Tonna, M., Marchesi, C., & Ghaemi, S. N. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.06.005 · Cited by 92
Stubbs, B., Mitchell, A. J., De Hert, M., Correll, C. U., Soundy, A., Stroobants, M., & Vancampfort, D. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.10.017 · Cited by 92
“Finally, we assessed risk of bias with a visual inspection of funnel plots and the Begg–Mazumdar Kendall's tau (Begg and Mazumdar, 1994) and Harbord bias test (Harbord et al., 2006).”
MethodRigabert, A., Motrico, E., Moreno-Peral, P., Resurrección, D. M., Conejo-Cerón, S., Cuijpers, P., Martín-Gómez, C., López-Del-Hoyo, Y., & Bellón, J. Á. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101931 · Cited by 92
Szeverenyi, C., Kekecs, Z., Johnson, A., Elkins, G., Csernatony, Z., & Varga, K. (2018) · The Journal of Pain · doi:10.1016/j.jpain.2018.05.006 · Cited by 87
Exercise intervention and inflammatory markers in coronary artery disease: A meta-analysis
Swardfager, W., Herrmann, N., Cornish, S., Mazereeuw, G., Marzolini, S., Sham, L., & Lanctôt, K. L. (2012) · American Heart Journal · doi:10.1016/j.ahj.2011.12.017 · Cited by 91
Oyama, H., Sakashita, T., Ono, Y., Goto, M., Fujita, M., & Koida, J. (2008) · Community Mental Health Journal · doi:10.1007/s10597-008-9132-0 · Cited by 90
Wu, L., Sun, D., & Tan, Y. (2018) · Sleep and Breathing · doi:10.1007/s11325-017-1527-0 · Cited by 90
“presence of publication bias was assessed by Begg’s and Egger’s tests [22, 23].”
MethodChu, D., Wu, J., Wang, K., Zhao, M., Wang, C., Li, L., & Guo, R. (2018) · BMC Cancer · doi:10.1186/s12885-018-4334-5 · Cited by 90
“The publication bias was examined visually by the symmetry of funnel plots and statistically by Egger’s or Begg’s tests [32, 33].”
MethodKollias, A., Ntineri, A., & Stergiou, G. S. (2017) · Journal of Hypertension · doi:10.1097/hjh.0000000000001189 · Cited by 90
“Publication bias was evaluated by means of Begg’s funnel plots and Begg’s and Egger’s statistical tests [28,29].”
MethodMeta-analysis of studies using metformin as a reducer for liver cancer risk in diabetic patients
Ma, S., Zheng, Y., Xiao, Y., Zhou, P., & Tan, H. (2017) · Medicine · doi:10.1097/md.0000000000006888 · Cited by 89
Olsen, C. M., Carroll, H. J., & Whiteman, D. C. (2010) · International Journal of Cancer · doi:10.1002/ijc.25243 · Cited by 89
“We evaluated publication bias by assessing funnel-plot asymmetry.(8,9) To estimate the PAF for each characteristic using the adjusted RR derived from meta-analysis, we used the method of Bruzzi et al.”
MethodSabag, A., Najafi, A., Michael, S., Esgin, T., Halaki, M., & Hackett, D. (2018) · Journal of Sports Sciences · doi:10.1080/02640414.2018.1464636 · Cited by 90
“A funnel plot and rank correlations between effect estimates and their standard errors (SE), using Kendall’s τ statistic (Begg & Mazumdar, 1994), were used to determine publication bias when a significant result (p 0.05) was found.”
MethodInfluentialKazemi, M., Kim, J. Y., Wan, C., Xiong, J. D., Michalak, J., Xavier, I. B., Ganga, K., Tay, C. T., Grieger, J. A., Parry, S. A., et al. (2022) · Human Reproduction Update · doi:10.1093/humupd/dmac023 · Cited by 89
Richman, M. J., & Unoka, Z. (2015) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.152108 · Cited by 89
Moradi, S., Ziaei, R., Foshati, S., Mohammadi, H., Nachvak, S. M., & Rouhani, M. H. (2019) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2019.102211 · Cited by 88
Work addiction and personality: A meta-analytic study
Kun, B., Takacs, Z. K., Richman, M. J., Griffiths, M. D., & Demetrovics, Z. (2021) · Journal of Behavioral Addictions · doi:10.1556/2006.2020.00097 · Cited by 88
“Following this, the symmetry of the funnel plot was used to assess possible publication bias as well as the Begg and Mazumdar (1994) and Egger, Smith, Schneider and Minder (1997) publication bias tests.”
MethodSabag, A., Barr, L., Armour, M., Armstrong, A., Baker, C. J., Twigg, S. M., Chang, D., Hackett, D. A., Keating, S. E., George, J., et al. (2022) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgab795 · Cited by 88
Rai, V. (2017) · Molecular Neurobiology · doi:10.1007/s12035-016-9722-8 · Cited by 88
“Different statistical tests such as Begg and Mazumdar rank correlation [35] and Egger’s regression intercept [36] were adopted to assess and quantify the publication bias and its impact on the analysis.”
MethodSquires, L. R., Rash, J. A., Fawcett, J., & Garland, S. N. (2022) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2022.101615 · Cited by 85
Solmi, M., Pigato, G., Kane, J. M., & Correll, C. (2018) · Drug Design Development and Therapy · doi:10.2147/dddt.s133205 · Cited by 88
The extent of dissociation in borderline personality disorder: A meta-analytic review
Scalabrini, A., Cavicchioli, M., Fossati, A., & Maffei, C. (2017) · Journal of Trauma & Dissociation · doi:10.1080/15299732.2016.1240738 · Cited by 86
Xie, L., Mo, M., Jia, H.-X., Liang, F., Yuan, J., & Zhu, J. (2016) · Oncotarget · doi:10.18632/oncotarget.10917 · Cited by 86
Pizarro, J. J., Zumeta, L. N., Bouchat, P., Włodarczyk, A., Rimé, B., Basabe, N., Amutio, A., & Páez, D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.974683 · Cited by 88
Giannou, F. K., Tsiara, C. G., Nikolopoulos, G. K., Talias, M., Benetou, V., Kantzanou, M., Bonovas, S., & Hatzakis, A. (2016) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.2016.1102635 · Cited by 85
“[17] The tests of Begg and Egger were used to investigate the presence of publication bias.[18,19] All p-values are two-tailed.”
MethodSubclinical Thyroid Dysfunction and the Risk for Fractures: A Systematic Review and Meta-analysis
Wirth, C. D., Blum, M. R., da Costa, B. R., Baumgartner, C., Collet, T.-H., Medici, M., Peeters, R. P., Aujesky, D., Bauer, D. C., & Rodondi, N. (2014) · Annals of Internal Medicine · doi:10.7326/m14-0125 · Cited by 85
Yeo, S., Walker, J. S., Caughey, M. C., Ferraro, A. M., & Asafu‐Adjei, J. K. (2017) · Obesity Reviews · doi:10.1111/obr.12511 · Cited by 85
“In addition, there was no significant evidence of publication bias (p > .05 for both Begg’s and Egger’s tests).”
MethodZhu, H., Zhu, Y., & Leung, S.-W. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010524 · Cited by 84
He, X.-J., Dai, R.-X., & Hu, C.-L. (2020) · Obesity Research & Clinical Practice · doi:10.1016/j.orcp.2020.01.004 · Cited by 84
With Little Power Comes Great Responsibility
Card, D., Henderson, P., Khandelwal, U., Jia, R., Mahowald, K., & Jurafsky, D. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.745 · Cited by 84
Zhang, K., Bai, P., Dai, H., & Deng, Z. (2021) · Primary Care Diabetes · doi:10.1016/j.pcd.2020.06.001 · Cited by 84
Broeders, J. A., Ahmed Ali, U., & Fischer, G. (2016) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2016.02.1228 · Cited by 84
Yapici Eser, H., Kacar, A. S., Kilciksiz, C. M., Yalçinay-Inan, M., & Ongur, D. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00229 · Cited by 83
“First, a publication bias analysis was conducted by visualization of the Funnel plots, Egger’s test (63) and the BeggMazumdar Kendall’s tau (64).”
MethodTully, P. J., Hanon, O., Cosh, S., & Tzourio, C. (2016) · Journal of Hypertension · doi:10.1097/hjh.0000000000000868 · Cited by 82
Blajman, J. E., Páez, R. B., Vinderola, C. G., Lingua, M. S., & Signorini, M. L. (2018) · Journal of Applied Microbiology · doi:10.1111/jam.14084 · Cited by 82
“An adjusted rank correlation test using the Egger method (Egger et al. 1997) and the Begg test (Begg and Mazumdar 1994) were used to assess publication bias.”
MethodKollias, A., Kyriakoulis, K. G., Stambolliu, E., Ntineri, A., Anagnostopoulos, I., & Stergiou, G. S. (2020) · Journal of Hypertension · doi:10.1097/hjh.0000000000002355 · Cited by 82
Sullivan, L. E., Tetrault, J. M., Braithwaite, R. S., Turner, B. J., & Fiellin, D. A. (2011) · The American Journal on Addictions · doi:10.1111/j.1521-0391.2011.00143.x · Cited by 81
Yamada, T., Shojima, N., Noma, H., Yamauchi, T., & Kadowaki, T. (2018) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.13260 · Cited by 81
Zhang, J., Fu, L., Shi, J., Chen, X., Li, Y., Ma, B., & Zhang, Y. (2013) · PLoS ONE · doi:10.1371/journal.pone.0078151 · Cited by 81
Maternal Body Mass Index and Risk of Autism Spectrum Disorders in Offspring: A Meta-analysis.
Wang, Y., Tang, S., Xu, S., Weng, S., & Liu, Z. (2016) · Scientific Reports · doi:10.1038/srep34248 · Cited by 81
Cai, H., Xu, Z., Xu, T., Yu, B., & Zou, Q. (2015) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.2582 · Cited by 80
“Publication bias was evaluated using funnel plots, the Begg–Mazumdar adjusted rank correlation test [21] and the Egger regression asymmetry test [22].”
MethodChow, J. C., & Ekholm, E. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9437-7 · Cited by 80
Dowlati, Y., Herrmann, N., Swardfager, W. L., Reim, E. K., & Lanctôt, K. L. (2010) · The Canadian Journal of Psychiatry · doi:10.1177/070674371005500205 · Cited by 79
Tully, P. J., & Cosh, S. M. (2013) · Journal of Health Psychology · doi:10.1177/1359105312467390 · Cited by 80
Hagan, K. E., Alasmar, A., Exum, A., Chinn, B., & Forbush, K. T. (2020) · Appetite · doi:10.1016/j.appet.2020.104710 · Cited by 79
Hu, H., Zhao, Y., Feng, Y., Yang, X., Li, Y., Wu, Y., Yuan, L., Zhang, J., Li, T., Huang, H., et al. (2023) · The American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2022.10.010 · Cited by 79
Neeleman, J. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.1.154 · Cited by 79
The association of placenta previa and assisted reproductive techniques: a meta-analysis
Karami, M., Jenabi, E., & Fereidooni, B. (2018) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.1080/14767058.2017.1332035 · Cited by 79
Hackett, D., Davies, T., Soomro, N., & Halaki, M. (2016) · British Journal of Sports Medicine · doi:10.1136/bjsports-2015-094951 · Cited by 78
Hansen, T. T., Astrup, A., & Sjödin, A. (2021) · Nutrients · doi:10.3390/nu13093193 · Cited by 77
Castro, A., Gili, M., Ricci-Cabello, I., Roca, M., Gilbody, S., Perez-Ara, M. Á., Seguí, A., & McMillan, D. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.09.023 · Cited by 78
Pharmacological treatment of attention deficit hyperactivity disorder with co-morbid drug dependence
Cunill, R., Castells, X., Tobias, A., & Capellà, D. (2015) · Journal of Psychopharmacology · doi:10.1177/0269881114544777 · Cited by 78
Jung, Y., Lee, A. M., McKee, S. A., & Picciotto, M. R. (2017) · Scientific Reports · doi:10.1038/s41598-017-04413-1 · Cited by 77
Ge, B., & Guo, X. (2015) · International Journal of Stroke · doi:10.1111/ijs.12398 · Cited by 77
A systematic review of modifiable risk factors in the progression of multiple sclerosis
Hempel, S., Graham, G. D., Fu, N., Estrada, E., Chen, A. Y., Miake-Lye, I., Miles, J. N. V., Shanman, R., Shekelle, P. G., Beroes, J. M., et al. (2017) · Multiple Sclerosis Journal · doi:10.1177/1352458517690270 · Cited by 77
Liu, Q., Ayoub‐Charette, S., Khan, T. A., Au‐Yeung, F., Blanco Mejia, S., de Souza, R. J., Wolever, T. M. S., Leiter, L. A., Kendall, C. W. C., & Sievenpiper, J. L. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.118.010977 · Cited by 65
Smoking and placenta previa: a meta-analysis
Shobeiri, F., & Jenabi, E. (2017) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.1080/14767058.2016.1271405 · Cited by 76
Yimam, Y., Nateghpour, M., Mohebali, M., & Abbaszadeh Afshar, M. J. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248245 · Cited by 75
“We assessed publication bias by visual inspection of the funnel plot and further validated using Egger’s regression test [26] and Begg’s correlation test [27].”
MethodHuang, Y., Li, W., Dong, L., Li, R., & Wu, Y. (2013) · Journal of Atherosclerosis and Thrombosis · doi:10.5551/jat.14001 · Cited by 76
Tao, D., & Or, C. K. (2013) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x13479701 · Cited by 68
Zheng, L., Luo, Y., & Chen, X. (2020) · Journal of Social and Personal Relationships · doi:10.1177/0265407520946482 · Cited by 73
Zou, X., Chow, E. P., Zhao, P., Xu, Y., Ling, L., & Zhang, L. (2014) · BMC Infectious Diseases · doi:10.1186/1471-2334-14-490 · Cited by 70
“A Begg and Mazumdar rank correlation test was used to assess publication bias [49].”
MethodParity and Cardiovascular Disease Mortality: a Dose-Response Meta-Analysis of Cohort Studies
Lv, H., Wu, H., Yin, J., Qian, J., & Ge, J. (2015) · Scientific Reports · doi:10.1038/srep13411 · Cited by 72
Barlinn, K., Kepplinger, J., Puetz, V., Illigens, B., Bodechtel, U., & Siepmann, T. (2014) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s63904 · Cited by 72
“We assessed publication bias by visual inspection of the funnel plot and the use of Egger’s linear regression and Begg’s rank correlation tests.(19,20) The Duval and Tweedie trim-and-fill method was applied to identify and adjust for significant small-study effects.”
Autoimmune diseases and adverse pregnancy outcomes: an umbrella review
Singh, M., Wambua, S., Lee, S. I., Okoth, K., Wang, Z., Fayaz, F. F. A., Eastwood, K.-A., Nelson-Piercy, C., Reynolds, J. A., Nirantharakumar, K., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03309-y · Cited by 71
Corona, G., Rastrelli, G., Burri, A., Jannini, E. A., & Maggi, M. (2016) · Expert Opinion on Drug Safety · doi:10.1517/14740338.2016.1130126 · Cited by 71
Heckman, B. W., Kovacs, M. A., Marquinez, N. S., Meltzer, L. R., Tsambarlis, M. E., Drobes, D. J., & Brandon, T. H. (2013) · Addiction · doi:10.1111/add.12284 · Cited by 71
Cunill, R., Castells, X., Tobias, A., & Capellà, D. (2013) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3473 · Cited by 70
Sitko, K., Bewick, B. M., Owens, D., & Masterson, C. (2020) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgaa023 · Cited by 70
“Publication bias was examined using the Begg and Mazumdar’s Rank Order Correlation test, 32 Egger’s regression intercept test, 33 and Duval and Tweedie’s trim-and-fill procedure 34 using the Comprehensive Meta-Analysis software (version 3).”
Sornpaisarn, B., Shield, K., Cohen, J., Schwartz, R., & Rehm, J. (2013) · The International Journal of Alcohol and Drug Research · doi:10.7895/ijadr.v2i1.50 · Cited by 69
“Publication bias was tested by the visual inspection of funnel plots for a skewed distribution, and by using a ranked correlation test proposed by Begg and Mazumdar (1994) and a weighted regression test proposed by Egger, Smith, Schneider, and Minder (1997).”
MethodBaer, R., Gu, J., Cavanagh, K., & Strauss, C. (2019) · Psychological Assessment · doi:10.1037/pas0000744 · Cited by 66
Chen, X., Liu, Y., Sun, X., Yin, Z., Li, H., Liu, X., Zhang, D., Cheng, C., Liu, L., Liu, F., et al. (2019) · Menopause · doi:10.1097/gme.0000000000001289 · Cited by 68
Effect of probiotics on oral candidiasis: a systematic review and meta-analysis
Mundula, T., Ricci, F., Barbetta, B., Baccini, M., & Amedei, A. (2019) · Nutrients · doi:10.3390/nu11102449 · Cited by 68
Wu, H., Brooke-Wavell, K., Fong, D. T. P., Paquette, M. R., & Blagrove, R. C. (2024) · Sports Medicine · doi:10.1007/s40279-024-01993-7 · Cited by 68
Sugar rush or sugar crash? A meta-analysis of carbohydrate effects on mood
Mantantzis, K., Schlaghecken, F., Sünram-Lea, S. I., & Maylor, E. A. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.03.016 · Cited by 67
Wu, L., Forbes, A., Griffiths, P., Milligan, P., & While, A. (2010) · Diabetic Medicine · doi:10.1111/j.1464-5491.2010.03113.x · Cited by 67
Stubbs, B., Vancampfort, D., Rosenbaum, S., Ward, P. B., Richards, J., Ussher, M., & Schuch, F. B. (2016) · Sports Medicine · doi:10.1007/s40279-015-0441-5 · Cited by 66
Is meat consumption associated with depression? A meta-analysis of observational studies
Zhang, Y., Yang, Y., Xie, M.-S., Ding, X., Li, H., Liu, Z.-C., & Peng, S.-F. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1540-7 · Cited by 66
Mannucci, E., Bonifazi, A., & Monami, M. (2021) · Nutrition, Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2021.02.030 · Cited by 64
Luo, X., Chen, Y., Chen, J., Zhang, Y., Li, M., Xiong, C., & Yan, J. (2022) · Supportive Care in Cancer · doi:10.1007/s00520-021-06568-0 · Cited by 57
“Moreover, Funnel plots [33], Begg’s [34], and Egger’s test [35] were used to assess publication bias when more than ten studies were available.”
MethodInfluentialWalking improves sleep in individuals with cancer: a meta-analysis of randomized, controlled trials
Chiu, H.-Y., Huang, H.-C., Chen, P.-Y., Hou, W.-H., & Tsai, P.-S. (2015) · Oncology Nursing Forum · doi:10.1188/15.onf.e54-e62 · Cited by 63
Rådmark, L., Sidorchuk, A., Osika, W., & Niemi, M. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8101638 · Cited by 63
Kodama*, S., Fujihara, K., Horikawa, C., Sato, T., Iwanaga, M., Yamada, T., Kato, K., Watanabe, K., Shimano, H., Izumi, T., et al. (2020) · ESC Heart Failure · doi:10.1002/ehf2.12782 · Cited by 63
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.