Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 1,601–1,700 of 1,710
The Effectiveness of Concept Maps on Students’ Achievement in Science: A Meta-Analysis
Anastasiou, D., Wirngo, C. N., & Bagos, P. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09877-y · Cited by 36
“Publication bias was estimated using the rank correlation method (Begg & Mazumdar, 1994), the regression method of Egger’s, and its random effects analog (Egger et al., 1997).”
Van den Eynde, J., Derdeyn, E., Schuermans, A., Shivaram, P., Budts, W., Danford, D. A., & Kutty, S. (2022) · Journal of the American Heart Association · doi:10.1161/jaha.121.024036 · Cited by 34
Shu, L., Zhang, X., Zhou, J., Zhu, Q., & Si, C. (2023) · Frontiers in Nutrition · doi:10.3389/fnut.2023.1211797 · Cited by 34
Bao, H. (2014) · Medical Science Monitor · doi:10.12659/msm.890102 · Cited by 33
“Finally, publication bias was assessed by using a visual inspection of the funnel plot of the fixed or random effect RR of each study on the x-axis and the standard error of the variance of the log RR on the y-axis, and then by both Begg and Egger’s tests [18,19].”
MethodMcFarland, L. V. (2013) · World Journal of Meta-Analysis · doi:10.13105/wjma.v1.i3.102 · Cited by 33
Zeisser, C., Stockwell, T. R., & Chikritzhs, T. (2014) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.12479 · Cited by 33
Predictive value of abnormal ankle-brachial index in patients with diabetes: A meta-analysis
Nie, F., He, J., Cao, H., & Hu, X. (2021) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2021.108723 · Cited by 32
Yu, D., Sui, L., & Zhang, N. (2020) · Journal of Ultrasound in Medicine · doi:10.1002/jum.15123 · Cited by 33
“echocardiography (7) Studies included in qualitative synthesis (n = 18) Yu et al—Echocardiography in Diagnosing Fetal Heart Defects”
MethodGrünblatt, E., Nemoda, Z., Werling, A. M., Roth, A., Angyal, N., Tarnok, Z., Thomsen, H., Peters, T., Hinney, A., Hebebrand, J., et al. (2019) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32695 · Cited by 32
Du, L., Wang, M., Kang, Y., Li, B., Guo, M., Cheng, Z., & Bi, C. (2017) · Oncotarget · doi:10.18632/oncotarget.14688 · Cited by 32
Pang, B., Lian, F.-M., Zhao, X.-Y., Zhao, X.-M., Jin, D., Lin, Y.-Q., Zheng, Y.-J., Ni, Q., & Tong, X.-L. (2017) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2017.07.020 · Cited by 32
Risk of schizophrenia in relatives of individuals affected by schizophrenia: A meta-analysis
LE, L., R, K., B, M., & MJ, G. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112852 · Cited by 32
Researcher Effects on Mortality Salience Research: A Meta-Analytic Moderator Analysis
Yen, C.-L., & Cheng, C.-P. (2013) · Death Studies · doi:10.1080/07481187.2012.682290 · Cited by 30
Jackson, K. F., Hodge, D. R., & Vaughn, M. G. (2010) · Journal of Social Service Research · doi:10.1080/01488371003697780 · Cited by 30
Amerio, A., Stubbs, B., Odone, A., Tonna, M., Marchesi, C., & Nassir Ghaemi, S. (2016) · Iranian Journal of Psychiatry and Behavioral Sciences · doi:10.17795/ijpbs-3604 · Cited by 31
Bahji, A., Ermacora, D., Stephenson, C., Hawken, E. R., & Vazquez, G. (2021) · The Canadian Journal of Psychiatry · doi:10.1177/0706743720970857 · Cited by 31
Rodrigues, P., da Silva, B., & Trevisan, G. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105401 · Cited by 31
Amiri, M., Bidhendi-Yarandi, R., Fallahzadeh, A., Marzban, Z., & Ramezani Tehrani, F. (2022) · International Journal of Reproductive BioMedicine (IJRM) · doi:10.18502/ijrm.v20i11.12357 · Cited by 31
“To assess publication bias, Begg’s test was used (22); it was found significant for p < 0.”
Mannucci, E., Caiulo, C., Naletto, L., Madama, G., & Monami, M. (2021) · Endocrine · doi:10.1007/s12020-021-02889-6 · Cited by 30
Hou, X., Chen, X., & Shi, J. (2015) · Gene · doi:10.1016/j.gene.2015.03.062 · Cited by 30
Hou, Y.-C., Hu, Q., Huang, J., Fang, J.-Y., & Xiong, H. (2017) · Oncotarget · doi:10.18632/oncotarget.13633 · Cited by 29
A meta-analysis of sunburn and basal cell carcinoma risk
Lashway, S. G., Worthen, A. D. M., Abuasbeh, J. N., Harris, R. B., Farland, L. V., O’Rourke, M. K., & Dennis, L. K. (2023) · Cancer Epidemiology · doi:10.1016/j.canep.2023.102379 · Cited by 28
Zamani, M., Zarei, M., Nikbaf-Shandiz, M., Hosseini, S., Shiraseb, F., & Asbaghi, O. (2022) · Frontiers in Nutrition · doi:10.3389/fnut.2022.1013055 · Cited by 28
“Studies examining the impact of BBR supplementation on CVD risk variables used the Begg’s and Eager tests according to the number of studies for every outcome and the funnel plot test to evaluate publication bias (31, 32).”
MethodZhu, H., Zhang, J., Wang, J., Zhao, X., & Gu, M. (2020) · Endocrine · doi:10.1007/s12020-019-02110-9 · Cited by 28
Coffee consumption and risk of esophageal cancer incidence: A meta-analysis of epidemiologic studies
Zhang, J., Zhou, B., & Hao, C. (2018) · Medicine · doi:10.1097/md.0000000000010514 · Cited by 28
Kunutsor, S. K., Seidu, S., & Laukkanen, J. A. (2022) · GeroScience · doi:10.1007/s11357-021-00491-2 · Cited by 26
“To explore for small study effects, we visually inspected constructed Begg’s funnel plots [30] and performed Egger’s regression symmetry test [31].”
MethodLiu, Y., Zhou, X., Zhu, D., Chen, J., Qin, B., Zhang, Y., Wang, X., Yang, D., Meng, H., Luo, Q., et al. (2015) · Human Psychopharmacology: Clinical and Experimental · doi:10.1002/hup.2465 · Cited by 26
“Publication bias was examined with the funnel plot method, Begg’s adjusted rank correlation test, and Egger’s regression asymmetry test (Begg and Mazumdar, 1994; Egger et al., 1997).”
MethodThe Impact of Simulation-Based Learning on Nursing Decision-Making Ability: A Meta-Analysis
ZHAO, W., XU, M.-M., TIAN, Q., HAN, Y.-J., WANG, Z.-Q., & ZHANG, W. (2024) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2024.101576 · Cited by 26
Li, Z., Zhou, X., & Fu, W. (2018) · European Journal of Clinical Nutrition · doi:10.1038/s41430-017-0059-9 · Cited by 25
“Begg’s [29] and Egger’s test [30] were used to evaluate the publication bias.”
MethodGoncy, E. A. (2020) · Psychology of Violence · doi:10.1037/vio0000266 · Cited by 25
Effects of low-dose thiazide diuretics on fasting plasma glucose and serum potassium-a meta-analysis
Mukete, B. N., & Rosendorff, C. (2013) · Journal of the American Society of Hypertension · doi:10.1016/j.jash.2013.05.004 · Cited by 25
Deprato, A., Garud, A., Azzolina, D., Murgia, N., Davenport, M. H., Kaul, P., Lacy, P., & Moitra, S. (2025) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2024.137028 · Cited by 25
Guo, Z., Gu, C., Li, S., Gan, S., Li, Y., Xiang, S., Gong, L., & Wang, S. (2021) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2020.11.022 · Cited by 24
Xu, Y., Bai, S. J., Lan, X. H., Qin, B., Huang, T., & Xie, P. (2016) · Brazilian Journal of Medical and Biological Research · doi:10.1590/1414-431x20164806 · Cited by 24
Pesta, B. J., Kirkegaard, E. O. W., te Nijenhuis, J., Lasker, J., & Fuerst, J. G. R. (2020) · Intelligence · doi:10.1016/j.intell.2019.101408 · Cited by 24
Efficacy and Safety of Hylan versus Hyaluronic Acid in the Treatment of Knee Osteoarthritis
Dai, W.-L., Lin, Z.-M., Guo, D.-H., Shi, Z.-J., & Wang, J. (2019) · The Journal of Knee Surgery · doi:10.1055/s-0038-1641142 · Cited by 24
Behnoush, A. H., Khalaji, A., Khanmohammadi, S., Alehossein, P., Saeedian, B., Shobeiri, P., Teixeira, A. L., & Rezaei, N. (2023) · PLOS ONE · doi:10.1371/journal.pone.0296103 · Cited by 24
Tak, L. M., Meijer, A., Manoharan, A., de Jonge, P., & Rosmalen, J. G. M. (2010) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181d714e1 · Cited by 23
Ammar, A., Trabelsi, K., Boujelbane, M. A., Boukhris, O., Glenn, J. M., Chtourou, H., & Schöllhorn, W. I. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100537 · Cited by 23
Constrained instruments and their application to Mendelian randomization with pleiotropy
Jiang, L., Oualkacha, K., Didelez, V., Ciampi, A., Rosa‐Neto, P., Benedet, A. L., Mathotaarachchi, S., Richards, J. B., Greenwood, C. M. T., & Initiative, A. F. T. A. D. N. (2019) · Genetic Epidemiology · doi:10.1002/gepi.22184 · Cited by 23
“There are tests for symmetry such as Beggs rank correlation test, although they have low statistical power (Begg and Mazumdar, 1994).”
The Effects of ALEKS on Mathematics Learning in K-12 and Higher Education: A Meta-Analysis
Sun, S., Else-Quest, N. M., Hodges, L. C., French, A. M., & Dowling, R. (2021) · Investigations in Mathematics Learning · doi:10.1080/19477503.2021.1926194 · Cited by 23
Kong, Q.-X., Ruan, Q., Fan, C., Liu, B.-L., Reng, L.-P., & Xu, W. (2021) · Endokrynologia Polska · doi:10.5603/ep.a2021.0031 · Cited by 22
Amiri, S., Mahmood, N., Junaidi, S., & Khan, M. A. (2024) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_1156_23 · Cited by 21
“[46] Publication bias evaluation was done with funnel plots, [47,48] Egger’s test, [49,50] and the Trim and fill.”
The Effect of Childhood Abuse on the Risk of Adult Obesity
Wang, Y., Wu, B., Yang, H., & Song, X. (2015) · Annals of Clinical Psychiatry · doi:10.1177/104012371502700303 · Cited by 21
Wang, F., Dou, P., Wei, W., & Liu, P. J. (2024) · Nutrition & Diabetes · doi:10.1038/s41387-024-00263-9 · Cited by 20
“When required, Egger ’ s test and funnel plots were used to investigate potential publication bias [29, 30].”
MethodAbbas-Hashemi, S. A., Hosseininasab, D., Rastgoo, S., Shiraseb, F., & Asbaghi, O. (2023) · Clinical Nutrition ESPEN · doi:10.1016/j.clnesp.2023.09.923 · Cited by 19
The Impacts of Intimate Partner Violence on Postpartum Depression: An Updated Meta-Analysis
Wei, X., Wang, W., Law, Y. W., & Zhang, H. (2024) · Trauma, Violence, & Abuse · doi:10.1177/15248380231188068 · Cited by 19
“Publication bias was assessed by Begg’s test (Begg & Mazumdar, 1994) and Egger’s test (Egger et al., 1997).”
MethodRelationship between intake of fruit separately from vegetables and triglycerides - A meta-analysis
Kodama, S., Horikawa, C., Fujihara, K., Ishii, D., Hatta, M., Takeda, Y., Kitazawa, M., Matsubayashi, Y., Shimano, H., Kato, K., et al. (2018) · Clinical Nutrition ESPEN · doi:10.1016/j.clnesp.2018.07.001 · Cited by 19
Pabalan, N., Salvador, A., Jarjanazi, H., Christofolini, D. M., Barbosa, C. P., & Bianco, B. (2014) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-014-3308-3 · Cited by 17
Enhancing the Peer-Feedback Process Through Instructional Support: A Meta-Analysis
Hornstein, J., Keller, M. V., Greisel, M., Dresel, M., & Kollar, I. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10017-3 · Cited by 18
“To test for publication bias, we used counter-enhanced funnel plots for visual inspection, the rank test as non-parametric version of robustness (Begg & Mazumdar, 1994), and Egger’s regression test (Egger et al., 1997) for statistical analysis.”
Jin, H., Xu, X., Pang, B., Yang, R., Sun, H., Jiang, C., Shao, D., & Shi, J. (2021) · Beneficial Microbes · doi:10.3920/bm2020.0183 · Cited by 18
Wolever, T. M., Zurbau, A., Koecher, K., & Au-Yeung, F. (2024) · The Journal of Nutrition · doi:10.1016/j.tjnut.2024.07.011 · Cited by 18
Kodama, S., Fujihara, K., Ishiguro, H., Horikawa, C., Ohara, N., Yachi, Y., Tanaka, S., Shimano, H., Kato, K., Hanyu, O., et al. (2018) · Journal of Epidemiology · doi:10.2188/jea.je20160151 · Cited by 18
Not Published Is Not Perished: Addressing Publication Bias in Meta-Analytic Studies in Communication
Sun, Y., & Pan, Z. (2020) · Human Communication Research · doi:10.1093/hcr/hqz015 · Cited by 18
Kolosky, T., Goldstein Shipper, A., Sun, K., Tozduman, B., Bentzen, S., Moosa, A. N., & Erdemir, G. (2024) · Epilepsia Open · doi:10.1002/epi4.13007 · Cited by 17
Metformina para la diabetes mellitus tipo 2. Revisión sistemática y metaanálisis
Sáenz Calvo, A., Fernández Esteban, I., Mataix Sanjuán, A., Ausejo Segura, M., Roqué, M., & Moher, D. (2005) · Atención Primaria · doi:10.1157/13078602 · Cited by 17
Meggiolaro, A., Sane Schepisi, M., Farina, S., Castagna, C., Mammone, A., Siddu, A., Stefanelli, P., Boccia, S., & Rezza, G. (2022) · Expert Review of Vaccines · doi:10.1080/14760584.2022.2130773 · Cited by 17
Leung, W. T., Tang, Z., Feng, Y., Guan, H., Huang, Z., & Zhang, W. (2022) · Nutrients · doi:10.3390/nu14245285 · Cited by 17
“Publication bias was indicated by the visualization of funnel plots and evaluated by Begg’s test and Egger’s tests [36,37].”
MethodWang, X.-M., Yu, D.-D., Yu, X.-H., Hwang, G.-J., & Li, F. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12641-y · Cited by 17
“The Egger’s test ( p = 0.638 > 0.05, t = 0.475 < 1.96) and Begg and Mazumdar’s rank correlation test ( p = 0.680 > 0.05, Z = 0.412 < 1.96) results support low publication bias (Begg & Mazumdar, 1994; Egger et al., 1997).”
InfluentialPrevalence of the Skipping Breakfast among the Iranian Students: A Review Article.
(2017) · PubMed Central · Cited by 17
The rodent object-in-context task: A systematic review and meta-analysis of important variables
Sep, M. S. C., Vellinga, M., Sarabdjitsingh, R. A., & Joëls, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0249102 · Cited by 17
Schefft, C., Guhn, A., Brakemeier, E. ‐., Sterzer, P., & Köhler, S. (2019) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12995 · Cited by 17
Rebello, C. J., Zhang, D., Kirwan, J. P., Lowe, A. C., Emerson, C. J., Kracht, C. L., Steib, L. C., Greenway, F. L., Johnson, W. D., & Brown, J. C. (2023) · International Journal of Obesity · doi:10.1038/s41366-023-01283-8 · Cited by 16
“Begg’s and Egger’s tests were used to examine publication bias [26].”
MethodPrediger, B., Mathes, T., Polus, S., Glatt, A., Bühn, S., Schiermeier, S., Neugebauer, E. A. M., & Pieper, D. (2020) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-020-03036-1 · Cited by 16
Li, W., Chuanlin, Z., Shaoyu, M., Yeh, C. H., Liqun, C., & Zeju, Z. (2018) · Revista Latino-Americana de Enfermagem · doi:10.1590/1518-8345.2309.2990 · Cited by 15
“The publication bias was tested using the Egger’s regression asymmetry test(17) and Begg adjusted rank correlation test(18).”
MethodWang, X.-B., Cui, N.-H., Yang, J., Qiu, X.-P., Gao, J.-J., Yang, N., & Zheng, F. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111406 · Cited by 15
Beba, M., Djafarian, K., & Shab-Bidar, S. (2019) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2019.08.002 · Cited by 15
Wai, K. M., Swe, T., Su Hninn, T. S., Paing, A. M., Naing, Y. L., Htay, Z. W., & Ihara, K. (2024) · Environmental Pollution · doi:10.1016/j.envpol.2023.123192 · Cited by 14
Li, M., Liu, S., Yu, B., Li, N., Lyu, A., Yang, H., He, H., Zhang, N., Ma, J., Sun, M., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/63209 · Cited by 12
“The symmetry of the generated funnel plots was assessed visually using the Egger test, together with adjusted rank correlation and regression asymmetry tests [48,49].”
Wang, X.-M., Wang, J.-L., Xu, S.-Y., & Xu, S.-J. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00554-2 · Cited by 14
“Further tests for publication bias, including Egger’s test ( p = 0.075 > 0.05, t = 1.84 < 1.96) and Begg and Mazumdar’s rank correlation test ( p = 0.680 > 0.05, Z = 0.412 < 1.96), confirmed that the likelihood of publication bias is low (Begg & Mazumdar, 1994; Egger et al., 1997).”
InfluentialInterpersonal psychotherapy for perinatal women: a systematic review and meta-analysis protocol
Bright, K. S., Charrois, E. M., Mughal, M. K., Wajid, A., McNeil, D., Stuart, S., Hayden, K. A., & Kingston, D. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1158-6 · Cited by 13
Yusufu, M., Zhang, X., Sun, X., Raat, H., & Wang, N. (2019) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2019.107834 · Cited by 12
Association between childhood exposure to family violence and telomere length: a meta-analysis
Chen, X. Y., Lo, C. K. M., Chan, K. L., Leung, W. C., & Ip, P. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191912151 · Cited by 12
“Finally, publication bias was visually examined by using a funnel plot delineating individual studies’ effect size against the standard error of the effect size and quantitatively tested by Egger’s regression and Begg–Mazumdar rank correlation [41,42].”
MethodSun, Y., Tian, Z., Ma, Y., Zhu, Q., Zheng, R., Guan, Y., & Zhang, X. (2025) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.13138 · Cited by 12
Setayesh, L., Haghighat, N., Rasaei, N., Rezaei, M., Casazza, K., Nadery, M., yamrali, I., Zamani, M., & Asbaghi, O. (2023) · Diabetes & Metabolic Syndrome: Clinical Research & Reviews · doi:10.1016/j.dsx.2023.102729 · Cited by 11
Catalá-López, F., Hutton, B., Page, M. J., Ridao, M., Driver, J. A., Alonso-Arroyo, A., Forés-Martos, J., Macías Saint-Gerons, D., Vieta, E., Valencia, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0581-9 · Cited by 11
“Small study effects will be investigated by visual inspection of funnel plots (where appropriate) and formally tested using Egger’s [31] and Begg’s test [32], with the results considered to indicate potential small study effects when P < 0.”
MethodMelatonin and agomelatine for preventing seasonal affective disorder
Kaminski-Hartenthaler, A., Nussbaumer, B., Forneris, C. A., Morgan, L. C., Gaynes, B. N., Sonis, J. H., Greenblatt, A., Wipplinger, J., Lux, L. J., Hofmann, J., et al. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011271 · Cited by 11
Liu, Z., & Kringos, N. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00580-0 · Cited by 11
“This visual impression was statistically supported by Begg’s test (Begg & Mazumdar, 1994), which yielded a p-value of 0.598, indicating no significant evidence of publication bias.”
InfluentialAssociations between estrogen receptor-beta polymorphisms and endometriosis risk: a meta-analysis
Guo, R., Zheng, N., Ding, S., Zheng, Y., & Feng, L. (2014) · Diagnostic Pathology · doi:10.1186/s13000-014-0184-x · Cited by 10
“05 considered statistically significant [28,29].”
Lee, J., & Song, J.-U. (2020) · Journal of Korean Medical Science · doi:10.3346/jkms.2020.35.e48 · Cited by 10
Porchia, L. M., Vazquez-Marroquin, G., Ochoa-Précoma, R., Pérez-Fuentes, R., & Gonzalez-Mejia, M. E. (2022) · European Journal of Clinical Nutrition · doi:10.1038/s41430-022-01135-0 · Cited by 10
Zakiei, A., Khazaie, H., Rostampour, M., Moradi, M.-T., Rezaie, L., Komasi, S., & Rafihi-Ferreira, R. E. (2024) · Current Sleep Medicine Reports · doi:10.1007/s40675-024-00293-w · Cited by 10
“Meta-regression was performed on all the subgroups along with the age mean of the samples and year of study using a method of moments estimator for random effect multivariate meta-analysis [54].”
Will metformin use lead to a decreased risk of thyroid cancer? A systematic review and meta-analyses
Li, H., Chen, Y., Hu, L., Yang, W., Gao, Z., Liu, M., Tao, H., & Li, J. (2023) · European Journal of Medical Research · doi:10.1186/s40001-023-01287-0 · Cited by 10
“05 was considered statistically significant [32, 33].”
Electroencephalographic Biomarkers of Relaxation: A Systematic Review and Meta-analysis
Sugimoto, K., Kurashiki, H., Xu, Y., Takemi, M., & Amano, K. (2026) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.a.2392 · Cited by 10
Musazadeh, V., Nezamoleslami, S., Faghfouri, A. H., Shidfar, F., & Aryaeian, N. (2025) · Diabetes & Metabolic Syndrome: Clinical Research & Reviews · doi:10.1016/j.dsx.2025.103241 · Cited by 9
Novak, A. S. (2019) · Journal of School Violence · doi:10.1080/15388220.2018.1512416 · Cited by 9
Liu, W., Zhang, S., Dong, C., Lv, X., Zheng, X., Zhao, W., Jamali, M., Abedi, R., & Saedisomeolia, A. (2025) · Nutrition & Metabolism · doi:10.1186/s12986-025-01002-2 · Cited by 9
“In addition to Begg’s adjusted rank correlation [19] and Egger’s regression asymmetry test was performed to examine the small-study effect.”
Atem, T. D., Singh, R., Newbury-Birch, D., Pal, B., & Chaudhary, V. (2025) · BMC Pediatrics · doi:10.1186/s12887-025-05676-8 · Cited by 8
“Potential publication bias was assessed by visually examining the funnel plot and confirmed through Egger’s test [24] and Begg’s test [25].”
Huda, M. H., Rahman, M. F., Zalaya, Y., Mukminin, M. A., Purnamasari, T., Hendarwan, H., Su’udi, A., Hasugian, A. R., Yuniar, Y., Handayani, R. S., et al. (2024) · PLOS ONE · doi:10.1371/journal.pone.0312001 · Cited by 8
Huang, Y., Zhou, W., Liu, S., Zeng, D., & Zhou, W. (2024) · Gene · doi:10.1016/j.gene.2024.148397 · Cited by 8
Man, S. S., Su, P., Xiao, C., Yun, H., & Chan, A. H. S. (2026) · Ergonomics · doi:10.1080/00140139.2025.2554243 · Cited by 7
“The fail-safe N value (Rosenthal 1979), Begg and Mazumdar rank correlation test (Begg and Mazumdar 1994) and Egger’s regression intercept test (Egger et al. 1997) were used to check the reliability and publication bias of the results.”
Kodama, S. (2007) · Archives of Internal Medicine · doi:10.1001/archinte.167.10.999 · Cited by 5
Rozen, N., & Aderka, I. M. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101874 · Cited by 5
Interventions to improve adherence to lipid-lowering drugs: a systematic review and meta-analysis
Yow, D. K. W., Ang, W. J., Yap, H. J., Ito, S., Liu, J., Ko, J., Tan, D. S.-Y., Lorenzatti, A., & Ang, C.-S. (2025) · eClinicalMedicine · doi:10.1016/j.eclinm.2025.103270 · Cited by 5
Sezgin, M. G., & Bektas, H. (2025) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.70064 · Cited by 5
Xun, X., Wang, R., Cheng, Q., & Gao, P. (2026) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2026.106132 · Cited by 5
Yu, D., Zhang, N., Sun, H., & Liu, M. (2023) · Journal of Clinical Ultrasound · doi:10.1002/jcu.23507 · Cited by 5
(2024) · PubMed Central · doi:10.36131/cnfioritieditore20240302 · Cited by 5
Guo, K., Jiang, Y., Zhou, Z., & Li, Y. (2020) · European Journal of Preventive Cardiology · doi:10.1177/2047487313501120 · Cited by 4
RetractedZhang, Y., Zhang, H., Zhang, Y., Yang, Z., Wang, L., Pan, W., Dai, R., Ju, Q., Ren, D., Bao, S., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281469 · Cited by 4
“Bergg’s and Egger’s tests will be used to help distinguish the asymmetry due to publication bias [25, 26].”
Method
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.