Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 1,501–1,600 of 1,708
A meta-analysis of mismatch negativity in children with attention deficit-hyperactivity disorders
Cheng, C.-H., Chan, P.-Y. S., Hsieh, Y.-W., & Chen, K.-F. (2016) · Neuroscience Letters · doi:10.1016/j.neulet.2015.11.033 · Cited by 60
Hsu, W.-T., Esmaily-Fard, A., Lai, C.-C., Zala, D., Lee, S.-H., Chang, S.-S., & Lee, C.-C. (2017) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2017.02.020 · Cited by 59
A meta-analysis of add-on use of spironolactone in patients with resistant hypertension
Zhao, D., Liu, H., Dong, P., & Zhao, J. (2017) · International Journal of Cardiology · doi:10.1016/j.ijcard.2016.12.158 · Cited by 60
Autonomic nervous system activity during positive emotions: a meta-analytic review
Behnke, M., Kreibig, S. D., Kaczmarek, L. D., Assink, M., & Gross, J. J. (2022) · Emotion Review · doi:10.1177/17540739211073084 · Cited by 60
“Significant positive values of both tests indicate that smaller studies with less precision are associated with larger effects, suggesting that publication bias is present (Begg & Mazumdar, 1994; Egger et al., 1997; Sterne et al., 2000).”
BackgroundMethodLa Touche, R., Martínez García, S., Serrano García, B., Proy Acosta, A., Adraos Juárez, D., Fernández Pérez, J. J., Angulo-Díaz-Parreño, S., Cuenca-Martínez, F., Paris-Alemany, A., & Suso-Martí, L. (2020) · Pain Medicine · doi:10.1093/pm/pnaa021 · Cited by 60
Lundberg, T. R., Feuerbacher, J. F., Sünkeler, M., & Schumann, M. (2022) · Sports Medicine · doi:10.1007/s40279-022-01688-x · Cited by 62
Santos, A., Braaten, K., MacPherson, M., Vasconcellos, D., Vis-Dunbar, M., Lonsdale, C., Lubans, D., & Jung, M. E. (2023) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-023-01535-w · Cited by 59
“In addition to visual inspection of funnel plots, the Begg & Mazumdar’s rank correlation test [49] was used to assess whether there was an inverse correlation between study size and treatment effect.”
BackgroundMethodInfluentialEfficacy of face-to-face versus self-guided treatments for disordered gambling: a meta-analysis
Goslar, M., Leibetseder, M., Muench, H. M., Hofmann, S. G., & Laireiter, A.-R. (2017) · Journal of Behavioral Addictions · doi:10.1556/2006.6.2017.034 · Cited by 58
Fang, H.-J., Zhou, Y.-H., Tian, Y.-J., Du, H.-Y., Sun, Y.-X., & Zhong, L.-Y. (2016) · International Journal of Cardiology · doi:10.1016/j.ijcard.2016.04.163 · Cited by 57
Amiri, M., Ramezani Tehrani, F., Nahidi, F., Bidhendi Yarandi, R., Behboudi‐Gandevani, S., & Azizi, F. (2017) · Clinical Endocrinology · doi:10.1111/cen.13389 · Cited by 57
Psychosocial effects of parent-child book reading interventions: A meta-analysis
Xie, Q.-W., Chan, C. H. Y., Ji, Q., & Chan, C. L. W. (2018) · Pediatrics · doi:10.1542/peds.2017-2675 · Cited by 56
Hu, J., Chen, J.-B., Cui, Y., Zhu, Y.-W., Ren, W.-B., Zhou, X., Liu, L.-F., Chen, H.-Q., & Zu, X.-B. (2018) · Medicine · doi:10.1097/md.0000000000011596 · Cited by 56
“Although we could not evaluate publication bias by Begg funnel plot or Egger test([18,19]) because of the small number of included studies, we conducted a sensitivity analysis by the leave-one-out cross validation to assess the stability of the presentmeta-analysis results.”
MethodYang, L.-B., Jiang, D.-Q., Qi, W.-B., Zhang, T., Feng, Y.-L., Gao, L., & Zhao, J. (2012) · European Journal of Endocrinology · doi:10.1530/eje-12-0015 · Cited by 56
Cosio, P. L., Crespo-Posadas, M., Velarde-Sotres, Á., & Pelaez, M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18052476 · Cited by 56
Yang, J., Song, Y., Gaskins, A. J., Li, L.-J., Huang, Z., Eriksson, J. G., Hu, F. B., Chong, Y. S., & Zhang, C. (2023) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.05.030 · Cited by 56
Hou, H., Wang, C., Sun, F., Zhao, L., Dun, A., & Sun, Z. (2015) · Inflammation Research · doi:10.1007/s00011-015-0850-9 · Cited by 55
“The possibility of publication bias was evaluated by funnel plots [45, 46].”
MethodWilde, A., Chan, H.-N., Rahman, B., Meiser, B., Mitchell, P. B., Schofield, P. R., & Green, M. J. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.01.014 · Cited by 55
Wang, Q., Jiang, X., Shen, Y., Yao, P., Chen, J., Zhou, Y., Gu, Y., Qian, Z., & Cao, X. (2020) · BMC Geriatrics · doi:10.1186/s12877-020-01721-6 · Cited by 53
“Publication bias was assessed qualitatively using funnel plot and quantitatively using the Egger’s and Begg’s tests [30, 31].”
MethodEdwards, C. J., Garety, P., & Hardy, A. (2019) · Psychological Medicine · doi:10.1017/s0033291719002381 · Cited by 54
Han, X., Peng, H., & Liu, M. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100714 · Cited by 70
Chan, R., Steel, Z., Brooks, R., Heung, T., Erlich, J., Chow, J., & Suranyi, M. (2011) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2011.05.002 · Cited by 54
Chen, W., Li, F., He, C., Zhu, Y., & Tan, W. (2014) · Irish Journal of Medical Science · doi:10.1007/s11845-013-1007-x · Cited by 53
“Egger’s linear regression [16] was generated, and Begg’s funnel plots [17] were used to examine potential publication bias related to the prevalence of abnormal glucose metabolism.”
MethodA meta-analysis of maternal smoking during pregnancy and autism spectrum disorder risk in offspring
Tang, S., Wang, Y., Gong, X., & Wang, G. (2015) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph120910418 · Cited by 53
“We used both Begg’s test [13] and Egger’s test [14] to detect publication bias.”
MethodOpioids contribute to fracture risk: a meta-analysis of 8 cohort studies
Teng, Z., Zhu, Y., Wu, F., Zhu, Y., Zhang, X., Zhang, C., Wang, S., & Zhang, L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0128232 · Cited by 53
“We used Egger’s test (linear regression method) [17] and Begg’s test (rank correlation method) [18] to assess the potential publication bias.”
MethodIntermittent fasting versus continuous calorie restriction: which is better for weight loss?
Zhang, Q., Zhang, C., Wang, H., Ma, Z., Liu, D., Guan, X., Liu, Y., Fu, Y., Cui, M., & Dong, J. (2022) · Nutrients · doi:10.3390/nu14091781 · Cited by 53
“Publication bias was assessed using Begg’s test [21] and Egger’s test [22].”
MethodNguyen, C. T. T., Sandhi, A., Lee, G. T., Nguyen, L. T. K., & Kuo, S.-Y. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.11.015 · Cited by 53
Zhang, W. Y., Nan, N., Song, X. T., Tian, J. F., & Yang, X. Y. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026445 · Cited by 53
“Publication bias Publication bias was assessed by means of Egger’s regression asymmetry test(25) and Begg’s test.(26) We used the funnel plot to examine whether sample sizes influenced the results of the meta-analysis.”
MethodQiu, S., & Jiang, C. (2019) · European Journal of Nutrition · doi:10.1007/s00394-018-1853-4 · Cited by 53
Huang, K.-C., Weng, H.-H., Yang, T.-Y., Chang, T.-S., Huang, T.-W., & Lee, M. S. (2016) · Medicine · doi:10.1097/md.0000000000002627 · Cited by 53
Yuan, L., Hu, H., Li, T., Zhang, J., Feng, Y., Yang, X., Li, Y., Wu, Y., Li, X., Huang, H., et al. (2023) · Food & Function · doi:10.1039/d2fo02628g · Cited by 53
Konstantinou, P., Ioannou, M., Melanthiou, D., Georgiou, K., Almas, I., Gloster, A. T., Kassianos, A. P., & Karekla, M. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.08.004 · Cited by 53
Meta-analysis, can it ever fail?
Kotiaho, J. S., & Tomkins, J. L. (2002) · Oikos · doi:10.1034/j.1600-0706.2002.960316.x · Cited by 52
Kamath, V., Sutherland, E. R., & Chaney, G.-A. (2020) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617719001115 · Cited by 51
“Using establishedmethods by Begg and Mazumdar (1994) and Egger, Davey Smith, Schneider, and Minder (1997), a funnel plot was generated for graphical representation as were adjusted rank-correlation tests.”
MethodTan, X., Li, S., Chang, Y., Fang, C., Liu, H., Zhang, X., & Wang, Y. (2016) · Clinical and Investigative Medicine · doi:10.25011/cim.v39i4.27091 · Cited by 51
Shi, R., Li, Z., Chen, D., Wu, Q., Zhou, X., & Tie, H. (2018) · Clinical Cardiology · doi:10.1002/clc.22951 · Cited by 51
“Publication bias was also detected by Begg and Egger tests.(15,16) A 2-tailed P < 0.”
MethodAssociation of progranulin polymorphism rs5848 with neurodegenerative diseases: a meta-analysis
Chen, Y., Li, S., Su, L., Sheng, J., Lv, W., Chen, G., & Xu, Z. (2015) · Journal of Neurology · doi:10.1007/s00415-014-7630-2 · Cited by 50
“Potential publication bias and sensitivity analysis Publication bias was first assessed by Begg’s test for the overall pooled analysis of different models of rs5848.”
MethodInfluentialFeng, L., Lin, X.-F., Wan, Z.-H., Hu, D., & Du, Y.-K. (2015) · Gynecological Endocrinology · doi:10.3109/09513590.2015.1041906 · Cited by 50
“To assess the extent of publication bias, we carried out Begg [31] test of nine endpoints. m Statistic obey the standard normal distribution, if m51.”
MethodCury, M. E. G., Berberian, A., Scarpato, B. S., Kerr-Gaffney, J., Santos, F. H., & Claudino, A. M. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00288 · Cited by 50
“In one study (56), individuals with BED showed poorer performance compared to normal weight controls on all indexes of the WCST, apart from perseverative errors.”
BackgroundMethodBödicker, C., Reinckens, J., Höfler, M., & Hoyer, J. (2022) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-021-00379-5 · Cited by 50
Kasturi, S., Oguoma, V. M., Grant, J. B., Niyonsenga, T., & Mohanty, I. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20010800 · Cited by 50
Doustmohammadian, A., Omidvar, N., & Shakibazadeh, E. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01339-0 · Cited by 50
“Small study effects (or publication bias) will be assessed by inspection of the funnel plots for asymmetry and with Egger’s test [48] and Begg’s test [49], with the results considered to indicate potential small study effects when P values are < 0.”
MethodMetformin use and the risk of colorectal adenoma: A systematic review and meta-analysis
Jung, Y. S., Park, C. H., Eun, C. S., Park, D. I., & Han, D. S. (2017) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.13639 · Cited by 49
Challenging the challenge hypothesis on testosterone in fathers: Limited meta-analytic support
Meijer, W. M., van IJzendoorn, M. H., & Bakermans - Kranenburg, M. J. (2019) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2019.104435 · Cited by 49
Johns, S. A., Tarver, W. L., Secinti, E., Mosher, C. E., Stutz, P. V., Carnahan, J. L., Talib, T. L., Shanahan, M. L., Faidley, M. T., Kidwell, K. M., et al. (2021) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2021.103290 · Cited by 48
Open versus Endoscopic Septoplasty Techniques: A Systematic Review and Meta-Analysis
Hong, C. J., Monteiro, E., Badhiwala, J., Lee, J., de Almeida, J. R., Vescan, A., & Witterick, I. J. (2016) · American Journal of Rhinology & Allergy · doi:10.2500/ajra.2016.30.4366 · Cited by 49
Collin, S., Rowse, G., Martinez, A. P., & Bentall, R. P. (2023) · Clinical Psychology Review · doi:10.1016/j.cpr.2023.102303 · Cited by 49
Mueller, K. F., Meerpohl, J. J., Briel, M., Antes, G., von Elm, E., Lang, B., Motschall, E., Schwarzer, G., & Bassler, D. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.015 · Cited by 48
Wahle, F., Bollhalder, L., Kowatsch, T., & Fleisch, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7381 · Cited by 48
“Additional testing utilizing the Begg and Mazumdar rank correlation method [88] confirmed that there is, in fact, evidence of publication bias (P=.”
MethodInfluentialChan, R., Brooks, R., Steel, Z., Heung, T., Erlich, J., Chow, J., & Suranyi, M. (2012) · Quality of Life Research · doi:10.1007/s11136-011-9973-9 · Cited by 48
Rotella, F., Cassioli, E., Calderani, E., Lazzeretti, L., Ragghianti, B., Ricca, V., & Mannucci, E. (2020) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2019.12.118 · Cited by 48
Albano, G., Rowlands, K., Baciadonna, L., Coco, G. L., & Cardi, V. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.09.039 · Cited by 48
Huang, A., Wu, K., Cai, Z., Lin, Y., Zhang, X., & Huang, Y. (2021) · Environmental Science and Pollution Research · doi:10.1007/s11356-020-11269-y · Cited by 48
Jayedi, A., Emadi, A., & Shab-Bidar, S. (2022) · Sports Medicine · doi:10.1007/s40279-022-01673-4 · Cited by 47
“Publication bias was tested using Egger’s test [25] and Begg’s test [26].”
MethodCai, X., Wang, C., Wang, S., Cao, G., Jin, C., Yu, J., Li, X., Yan, J., Wang, F., Yu, W., et al. (2015) · Asia Pacific Journal of Public Health · doi:10.1177/1010539514566742 · Cited by 47
Kou, T., Wang, Q., Cai, J., Song, J., Du, B., Zhao, K., Ma, Y., Geng, B., Zhang, Y., Han, X., et al. (2017) · Food & Function · doi:10.1039/c6fo01845a · Cited by 47
Wang, J., Chen, Y., Xu, W., Lu, N., Cao, J., & Yu, S. (2019) · PLOS ONE · doi:10.1371/journal.pone.0215362 · Cited by 45
Jia, X., Zhong, L., Song, Y., Hu, Y., Wang, G., & Sun, S. (2016) · Primary Care Diabetes · doi:10.1016/j.pcd.2015.12.004 · Cited by 46
“[27] C.”
MethodXie, H., Zhou, Z., & Liu, Q. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9442-x · Cited by 46
Consumption of nuts and legumes and risk of stroke: a meta-analysis of prospective cohort studies
Shi, Z. Q., Tang, J. J., Wu, H., Xie, C. Y., & He, Z. Z. (2014) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2014.06.009 · Cited by 46
Ruiz-Schutz, V. C., Gomes, L. M., Mariano, R. C., de Almeida, D. V. P., Pimenta, J. M., Dal Molin, G. Z., Kater, F. R., Yamamura, R., Correa Neto, N. F., Maluf, F. C., et al. (2019) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2019.06.012 · Cited by 46
Yoon, B.-H., Lee, Y., Oh, H. J., Kim, S. H., & Lee, Y.-K. (2019) · Journal of Bone Metabolism · doi:10.11005/jbm.2019.26.1.51 · Cited by 46
“We assessed the publication bias with Begg’s funnel plot [35] and Egger’s test [36].”
MethodPorchia, L. M., Hernandez-Garcia, S. C., Gonzalez-Mejia, M. E., & López-Bayghen, E. (2020) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2020.03.010 · Cited by 45
Leppanen, J., Ng, K. W., Kim, Y.-R., Tchanturia, K., & Treasure, J. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.08.041 · Cited by 45
“Publication bias based on funnel plot asymmetry was investigated with Begg’s rank correlation test (Begg and Mazumdar, 1994).”
MethodWu, P., Li, L., & Sun, W. (2018) · Bioscience Reports · doi:10.1042/bsr20181515 · Cited by 45
Mohamed, S. O. O., Elkhidir, I. H. E., Abuzied, A. I. H., Noureddin, A. A. M. H., Ibrahim, G. A. A., & Mahmoud, A. A. A. (2018) · BMC Research Notes · doi:10.1186/s13104-018-3950-0 · Cited by 43
Zorzela, L., Ardestani, S. K., McFarland, L. V., & Vohra, S. (2017) · Beneficial Microbes · doi:10.3920/bm2017.0032 · Cited by 44
Ma, Y., Yang, J. Y., Peng, X., Xiao, K. Y., Xu, Q., & Wang, C. (2020) · Journal of Digestive Diseases · doi:10.1111/1751-2980.12839 · Cited by 44
“Publication bias was assessed by examining the funnel plot asymmetries, with Harbord's test for binary variables(22) and Egger's tests for continuous variables.(23)”
MethodParial, L. L., Lam, S. C., Ho, J. Y. S., Suen, L. K. P., & Leung, A. Y. M. (2021) · Aging & Mental Health · doi:10.1080/13607863.2020.1786801 · Cited by 43
“Publication bias was analyzed using Begg-Mazumdar adjusted rank correlation test (Begg & Mazumdar, 1994).”
MethodThe efficacy of mindfulness-based interventions in acute pain: a systematic review and meta-analysis
Shires, A., Sharpe, L., Davies, J. N., & Newton-John, T. R. O. (2020) · Pain · doi:10.1097/j.pain.0000000000001877 · Cited by 43
Liao, C.-D., Huang, S.-W., Chen, H.-C., Huang, M.-H., Liou, T.-H., & Lin, C.-L. (2024) · Nutrients · doi:10.3390/nu16070941 · Cited by 45
“In addition, we performed the Begg–Mazumdar rank correlation test to identify any significant publication bias across all included RCTs in each outcome [73].”
MethodNetwork meta‐analysis of the relative efficacy of bariatric surgeries for diabetes remission
Kodama, S., Fujihara, K., Horikawa, C., Harada, M., Ishiguro, H., Kaneko, M., Furukawa, K., Matsubayashi, Y., Matsunaga, S., Shimano, H., et al. (2018) · Obesity Reviews · doi:10.1111/obr.12751 · Cited by 42
Xue, K., Li, F.-F., Chen, Y.-W., Zhou, Y.-H., & He, J. (2017) · European Journal of Cancer Prevention · doi:10.1097/cej.0000000000000231 · Cited by 40
“Egger’s (Egger et al., 1997) and Begg’s (Begg and Mazumdar, 1994) tests were also used to assess publication bias statistically.”
BackgroundMethodInfluentialNikolopoulos, G. K., Bagos, P. G., Tsangaris, I., Tsiara, C. G., Kopterides, P., Vaiopoulos, A., Kapsimali, V., Bonovas, S., & Tsantes, A. E. (2014) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2013-1124 · Cited by 42
Oliveira, C., Pacheco, M., Borges, J., Meira, L., & Santos, A. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100609 · Cited by 42
Exploring the Effectiveness of Flipped Classroom on STEM Student Achievement: A Meta-analysis
Gong, J., Cai, S., & Cheng, M. (2024) · Technology, Knowledge and Learning · doi:10.1007/s10758-023-09700-7 · Cited by 42
“…from publication bias, including: (1) assessing the funnel plot (Light & Pillemer, 1986); (2) computing the Begg & Mazumdar rank correlation (Begg & Mazumdar, 1994); (3) calculating Egger’s linear regression (Egger et al., 1997); (4) conducting the classic fail-safe N test (Rosenthal, 1979).”
Li, Z., Wang, Y.-H., Wang, L.-L., Hu, D.-T., Teng, Y., Zhang, T.-Y., Yan, Z.-Y., Wang, F., & Zou, Y.-F. (2022) · Scottish Medical Journal · doi:10.1177/00369330221107099 · Cited by 40
Aune, D., Sen, A., Norat, T., Riboli, E., & Folseraas, T. (2021) · Scientific Reports · doi:10.1038/s41598-021-90175-w · Cited by 40
Yang, Y.-L., Sui, G.-Y., Liu, G.-C., Huang, D.-S., Wang, S.-M., & Wang, L. (2014) · BMC Cancer · doi:10.1186/1471-2407-14-956 · Cited by 38
“So Begg’s test and Egger’s test were further used to more objectively test for its presence (as implemented in Stata v11) [33,34].”
MethodGao, T., Wu, L., Chang, F., & Cao, G. (2016) · Endocrine Journal · doi:10.1507/endocrj.ej15-0318 · Cited by 41
“Publication bias was evaluated via Egger’s test [22] and Begg’s test [23].”
Amiri, M., Kabir, A., Nahidi, F., Shekofteh, M., & Ramezani Tehrani, F. (2018) · The European Journal of Contraception & Reproductive Health Care · doi:10.1080/13625187.2018.1435779 · Cited by 40
“Publication bias was estimated by Begg’s test [25] and Egger’s test [26], in addition to funnel plot; using a significant level of p< .”
MethodHealth effects of desert dust and sand storms: a systematic review and meta-analysis protocol
Tobias, A., Karanasiou, A., Amato, F., Roqué, M., & Querol, X. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029876 · Cited by 40
“Assessment of reporting biases Publication bias will be assessed when at least 10 studies are included in the meta-analysis, using Begg’s rank correlation test and examined using funnel plots.(20)”
MethodTemperature and risk of infectious diarrhea: A systematic review and meta-analysis
Liang, M., Ding, X., Wu, Y., & Sun, Y. (2021) · Environmental Science and Pollution Research · doi:10.1007/s11356-021-15395-z · Cited by 40
Grünblatt, E., Werling, A. M., Roth, A., Romanos, M., & Walitza, S. (2019) · Journal of Neural Transmission · doi:10.1007/s00702-019-01998-x · Cited by 39
“Potential publication bias was assessed using Begg’s test (Begg and Mazumdar 1994) and Egger’s regression test (Egger et al.”
MethodMelatonin and agomelatine for preventing seasonal affective disorder
Kaminski-Hartenthaler, A., Nussbaumer, B., Forneris, C. A., Morgan, L. C., Gaynes, B. N., Sonis, J. H., Greenblatt, A., Wipplinger, J., Lux, L. J., Winkler, D., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011271.pub2 · Cited by 39
Su, D., McBride, C., Zhou, J., & Kelley, M. S. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15608297 · Cited by 39
Moon, S. J., Hwang, J., Hill, H. S., Kervin, R., Birtwell, K. B., Torous, J., McDougle, C. J., & Kim, J. W. (2020) · Archives of Disease in Childhood · doi:10.1136/archdischild-2019-318258 · Cited by 38
Montero-Marin, J., Garcia-Campayo, J., López-Montoyo, A., Zabaleta-del-Olmo, E., & Cuijpers, P. (2018) · Psychological Medicine · doi:10.1017/s0033291717003099 · Cited by 37
“The Begg and Mazumdar rank correlation test was applied to test whether the adjusted and observed ESs differed significantly from each other (Begg & Mazumdar, 1994), and Egger’s test of the intercept to contrast the null hypothesis of bias absence was also conducted (Egger et al. 1997).”
MethodEffect of design‐based learning on achievement in K‐12 education: A m eta‐analysis
Delen, I., & Sen, S. (2023) · Journal of Research in Science Teaching · doi:10.1002/tea.21800 · Cited by 37
Nishi, S. K., Kavanagh, M. E., Ramboanga, K., Ayoub-Charette, S., Modol, S., Dias, G. M., Kendall, C. W. C., Sievenpiper, J. L., & Chiavaroli, L. (2024) · eClinicalMedicine · doi:10.1016/j.eclinm.2024.102798 · Cited by 37
“48 If there was evidence of small-study effects (publication bias), we quanti fi ed the size of the potential publication bias or other causes of asymmetry by adjusting for the funnel plot asymmetry and assessing the effect of small-study effects using the trim-and-fi ll method of Duval and Tweedie.”
Jahangiry, L., Aune, D., & Farhangi, M. A. (2022) · Nutrition, Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2022.08.004 · Cited by 36
Opioids increase hip fracture risk: a meta-analysis
Ping, F., Wang, Y., Wang, J., Chen, J., Zhang, W., Zhi, H., & Liu, Y. (2017) · Journal of Bone and Mineral Metabolism · doi:10.1007/s00774-016-0755-x · Cited by 36
Chen, G., Li, W., Tzekov, R., Jiang, F., Mao, S., & Tong, Y. (2015) · Retina · doi:10.1097/iae.0000000000000301 · Cited by 36
“05 was considered representative of significant statistical publication bias).(18,19)”
BackgroundPing, W., Sun, W., Zu, Y., Chen, W., & Fu, X. (2014) · Tumor Biology · doi:10.1007/s13277-013-1579-0 · Cited by 36
“Begg’s funnel plot [33] and Egger’s test [34] were performed to identify publication bias.”
MethodEason, A. D., & Parris, B. A. (2019) · Psychology of Consciousness: Theory, Research, and Practice · doi:10.1037/cns0000173 · Cited by 36
Fornaro, M., Solmi, M., Stubbs, B., Veronese, N., Monaco, F., Novello, S., Fusco, A., Anastasia, A., De Berardis, D., Carvalho, A. F., et al. (2020) · The British Journal of Psychiatry · doi:10.1192/bjp.2019.5 · Cited by 35
Kamath, V., Chaney, G.-A. S., DeRight, J., & Onyike, C. U. (2019) · Psychological Medicine · doi:10.1017/s0033291718003604 · Cited by 35
Han, C., Liu, Y., Gong, X., Ye, X., & Zhou, J. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16081356 · Cited by 35
Colon neoplasia in patients with type 2 diabetes on metformin: A meta-analysis
Rokkas, T., & Portincasa, P. (2016) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2016.05.027 · Cited by 34
The Effectiveness of Concept Maps on Students’ Achievement in Science: A Meta-Analysis
Anastasiou, D., Wirngo, C. N., & Bagos, P. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09877-y · Cited by 36
“Publication bias was estimated using the rank correlation method (Begg & Mazumdar, 1994), the regression method of Egger’s, and its random effects analog (Egger et al., 1997).”
Van den Eynde, J., Derdeyn, E., Schuermans, A., Shivaram, P., Budts, W., Danford, D. A., & Kutty, S. (2022) · Journal of the American Heart Association · doi:10.1161/jaha.121.024036 · Cited by 34
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.