Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 1,101–1,200 of 1,710
False-Positive Results in Cancer Epidemiology: A Plea for Epistemological Modesty
Boffetta, P., McLaughlin, J. K., La Vecchia, C., Tarone, R. E., Lipworth, L., & Blot, W. J. (2008) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djn191 · Cited by 199
Scott-Sheldon, L. A. J., Carey, K. B., Elliott, J. C., Garey, L., & Carey, M. P. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035192 · Cited by 198
Alcohol consumption, unprovoked seizures, and epilepsy: A systematic review and meta‐analysis
Samokhvalov, A. V., Irving, H., Mohapatra, S., & Rehm, J. (2010) · Epilepsia · doi:10.1111/j.1528-1167.2009.02426.x · Cited by 198
Teasdale, S. B., Ward, P. B., Rosenbaum, S., Samaras, K., & Stubbs, B. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.177139 · Cited by 198
“Publication bias was assessed with a visual inspection of funnel plots and with the Begg-Mazumdar Kendall's tau [24] and Egger bias test [25].”
MethodFlooding risk and housing values: An economic assessment of environmental hazard
Daniel, V. E., Florax, R. J. G. M., & Rietveld, P. (2009) · Ecological Economics · doi:10.1016/j.ecolecon.2009.08.018 · Cited by 198
Gralnek, I. M., Dulai, G. S., Fennerty, M. B., & Spiegel, B. M. R. (2006) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2006.09.013 · Cited by 198
Vitamin D intake, blood 25(OH)D levels, and breast cancer risk or mortality: a meta-analysis
Kim, Y., & Je, Y. (2014) · British Journal of Cancer · doi:10.1038/bjc.2014.175 · Cited by 197
“Finally, publication bias was evaluated with the use of the Begg’s (Begg and Mazumdar, 1994) and Egger’s tests (Egger et al, 1997) and through visual inspection of a funnel plot.”
MethodInfluentialHotta, K., Matsuo, K., Ueoka, H., Kiura, K., Tabata, M., & Tanimoto, M. (2004) · Journal of Clinical Oncology · doi:10.1200/jco.2004.01.153 · Cited by 197
Auty, K. M., Cope, A., & Liebling, A. (2017) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x15602514 · Cited by 196
“The Begg and Mazumdar (1994) test statistic computes an adjusted rank correlation (Kendall’s tau-b) between the effect size and the standard error.”
BackgroundMethodYip, W., Sequeira, I., Plank, L., & Poppitt, S. (2017) · Nutrients · doi:10.3390/nu9111273 · Cited by 177
“Publication bias was assessed by the Begg-Mazumdar [82] and Egger et al.”
MethodInfluentialDisinfection by-products in drinking water and colorectal cancer: a meta-analysis
Rahman, M. B., Driscoll, T., Cowie, C., & Armstrong, B. K. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyp371 · Cited by 196
Ried, K., & Fakler, P. (2011) · Maturitas · doi:10.1016/j.maturitas.2010.11.018 · Cited by 196
Soltani, S., Jayedi, A., Shab-Bidar, S., Becerra-Tomás, N., & Salas-Salvadó, J. (2019) · Advances in Nutrition · doi:10.1093/advances/nmz041 · Cited by 196
“Publication bias was assessed by inspection of funnel plot asymmetry and tested by Egger’s asymmetry test (19) and Begg’s test (20) (P < 0.”
MethodMostofsky, E., Penner, E. A., & Mittleman, M. A. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu033 · Cited by 195
Biazus-Sehn, L. F., Schuch, F. B., Firth, J., & Stigger, F. D. S. (2020) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2020.104048 · Cited by 194
“27 studies provided complete data to enable inclusion within our meta-analysis (Baker et al., 2010; Begg & Mazumdar, 1994; Brinke et al., 2015; Damirchi et al., 2018; Davis et al., 2013; Duval & Tweedie, 2000; Egger et al., 1997; Fiatarone Singh et al., 2014; Heubel et al., 2018; Higgins et al.,…”
MethodResultInfluentialChen, S.-W., Zhong, X.-S., Jiang, L.-N., Zheng, X.-Y., Xiong, Y.-Q., Ma, S.-J., Qiu, M., Huo, S.-T., Ge, J., & Chen, Q. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.08.035 · Cited by 194
The association of folate and depression: A meta-analysis
Bender, A., Hagan, K. E., & Kingston, N. (2017) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2017.07.019 · Cited by 194
Post-stroke depression and lesion location: a systematic review
Wei, N., Yong, W., Li, X., Zhou, Y., Deng, M., Zhu, H., & Jin, H. (2015) · Journal of Neurology · doi:10.1007/s00415-014-7534-1 · Cited by 194
“Publication bias was evaluated using the Begg’s funnel plot and Egger’s test [15, 16].”
MethodLi, L., Wang, Z.-W., Li, J., Ge, X., Guo, L.-Z., Wang, Y., Guo, W.-H., Jiang, C.-X., & Ma, C.-S. (2014) · Europace · doi:10.1093/europace/euu066 · Cited by 194
Seiler, A., Klaas, V., Tröster, G., & Fagundes, C. P. (2017) · Psycho-Oncology · doi:10.1002/pon.4489 · Cited by 176
Meta-analysis of the effects of intranasal oxytocin on interpretation and expression of emotions
Leppanen, J., Ng, K. W., Tchanturia, K., & Treasure, J. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.04.010 · Cited by 188
Sedentary behaviour and risk of anxiety: A systematic review and meta-analysis
Allen, M. S., Walter, E. E., & Swann, C. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.08.081 · Cited by 192
Caffeine Intake and Dementia: Systematic Review and Meta-Analysis
Santos, C., Costa, J., Santos, J., Vaz-Carneiro, A., & Lunet, N. (2010) · Journal of Alzheimer's Disease · doi:10.3233/jad-2010-091387 · Cited by 192
Effect of vitamin D supplementation on serum lipid profiles: a systematic review and meta-analysis
Dibaba, D. T. (2019) · Nutrition Reviews · doi:10.1093/nutrit/nuz037 · Cited by 192
Zhan, P., Wang, J., Lv, X.-J., Wang, Q., Qiu, L.-X., Lin, X.-Q., Yu, L.-K., & Song, Y. (2009) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e3181a97e31 · Cited by 192
Koretsi, V., Zymperdikas, V. F., Papageorgiou, S. N., & Papadopoulos, M. A. (2015) · The European Journal of Orthodontics · doi:10.1093/ejo/cju071 · Cited by 191
Meta-analysis of corticosteroid treatment in acute myocardial infarction
Giugliano, G. R., Giugliano, R. P., Gibson, C. M., & Kuntz, R. E. (2003) · The American Journal of Cardiology · doi:10.1016/s0002-9149(03)00148-6 · Cited by 191
Thompson, T., Correll, C. U., Gallop, K., Vancampfort, D., & Stubbs, B. (2016) · The Journal of Pain · doi:10.1016/j.jpain.2016.08.007 · Cited by 191
Urban, M. C. (2024) · Science · doi:10.1126/science.adp4461 · Cited by 190
Galkanda‐Arachchige, H. S. C., Wilson, A. E., & Davis, D. A. (2020) · Reviews in Aquaculture · doi:10.1111/raq.12401 · Cited by 189
“To determine whether there was publication bias, funnel plots, Egger’s regression test (Egger et al. 1997) and Begg’s rank correlation test (Begg & Mazumdar 1994) were applied to the data set.”
MethodThe prevalence and incidence of dementia: a systematic review and meta-analysis
Fiest, K. M., Jetté, N., Roberts, J. I., Maxwell, C. J., Smith, E. E., Black, S. E., Blaikie, L., Cohen, A., Day, L., Holroyd-Leduc, J., et al. (2016) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/cjn.2016.18 · Cited by 188
(2013) · Europe PMC (PubMed Central) · doi:10.3978/j.issn.2225-319x.2013.07.16 · Cited by 188
Popat, S., & Houlston, R. S. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2005.04.039 · Cited by 187
“Publication bias was also formally assessed by the Egger [28] and Begg methods [29] and its effect assessed by the trim-and-fill method of Duval and Tweedie [30].”
MethodRødgaard, E.-M., Jensen, K., Vergnes, J.-N., Soulières, I., & Mottron, L. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.1956 · Cited by 185
Li, Y., Liu, C., Xiao, W., Song, T., & Wang, S. (2020) · Neurocritical Care · doi:10.1007/s12028-019-00773-w · Cited by 187
Andriulli, A., Festa, V., Botteri, E., Valvano, M. R., Koch, M., Bassi, C., Maisonneuve, P., & Sebastiano, P. D. (2012) · Annals of Surgical Oncology · doi:10.1245/s10434-011-2110-8 · Cited by 187
“and Begg and Mazumdar.(19,20) All analyses were performed by SAS software, version 8.”
MethodInfluentialThe role of social isolation in social anxiety disorder: a systematic review and meta-analysis
Teo, A. R., Lerrigo, R., & Rogers, M. A. M. (2013) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2013.03.010 · Cited by 184
Nierhoff, J., Chávez Ortiz, A. A., Herrmann, E., Zeuzem, S., & Friedrich-Rust, M. (2013) · European Radiology · doi:10.1007/s00330-013-2927-6 · Cited by 186
“The rank correlation test based on Kendall’s tau was performed to evaluate the significance of asymmetry [19].”
MethodChawla, S., Tessarolo Silva, F., Amaral Medeiros, S., Mekary, R., & Radenkovic, D. (2020) · Nutrients · doi:10.3390/nu12123774 · Cited by 185
“Using Begg’s test, possible publication bias was detected for LDL, total cholesterol, and triglycerides (all p 0.01).”
MethodInfluentialCorona, G., Giagulli, V. A., Maseroli, E., Vignozzi, L., Aversa, A., Zitzmann, M., Saad, F., Mannucci, E., & Maggi, M. (2016) · Journal of Endocrinological Investigation · doi:10.1007/s40618-016-0480-2 · Cited by 185
Sciarretta, S., Palano, F., Tocci, G., Baldini, R., & Volpe, M. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.427 · Cited by 185
The effect of experimental design on the measurement of mate choice: a meta-analysis
Dougherty, L. R., & Shuker, D. M. (2015) · Behavioral Ecology · doi:10.1093/beheco/aru125 · Cited by 185
“Finally, we tested for the nonparametric correlation between standardized effect size and study variance (Begg and Mazumdar 1994).”
MethodEffect of coenzyme Q10 supplementation on heart failure: a meta-analysis
Fotino, A. D., Thompson-Paul, A. M., & Bazzano, L. A. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.040741 · Cited by 185
“Begg’s rank correlation test was used to examine the asymmetry of the funnel plot, and Egger’s linear regression test was used to examine the association between the mean effect estimate and its variance (28, 29).”
MethodBrinsley, J., Schuch, F., Lederman, O., Girard, D., Smout, M., Immink, M. A., Stubbs, B., Firth, J., Davison, K., & Rosenbaum, S. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-101242 · Cited by 184
“35 Publication bias was assessed with Egger 36 and Begg and Mazumdar, 37 and corrected using Duval and Tweedie trim and fill analysis.”
MethodInfluentialWang, D., Li, W., Cui, X., Meng, Y., Zhou, M., Xiao, L., Ma, J., Yi, G., & Chen, W. (2016) · International Journal of Cardiology · doi:10.1016/j.ijcard.2016.06.027 · Cited by 184
Davies, T., Orr, R., Halaki, M., & Hackett, D. (2016) · Sports Medicine · doi:10.1007/s40279-015-0451-3 · Cited by 184
Red and processed meat consumption and risk of stroke: a meta-analysis of prospective cohort studies
Chen, G.-C., Lv, D.-B., Pang, Z., & Liu, Q.-F. (2013) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2012.180 · Cited by 184
Hepatitis B immunisation for newborn infants of hepatitis B surface antigen-positive mothers
Lee, C., Gong, Y., Brok, J., Boxall, E. H., & Gluud, C. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004790.pub2 · Cited by 184
Peyrin-Biroulet, L., Danese, S., Argollo, M., Pouillon, L., Peppas, S., Gonzalez-Lorenzo, M., Lytras, T., & Bonovas, S. (2019) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2018.06.026 · Cited by 181
Meta-analysis of studies on individual consumption of chlorinated drinking water and bladder cancer
Villanueva, C. M., Fernández, F., Malats, N., Grimalt, J. O., & Kogevinas, M. (2003) · Journal of Epidemiology and Community Health · doi:10.1136/jech.57.3.166 · Cited by 180
Cue-reactivity in behavioral addictions: a meta-analysis and methodological considerations
Starcke, K., Antons, S., Trotzke, P., & Brand, M. (2018) · Journal of Behavioral Addictions · doi:10.1556/2006.7.2018.39 · Cited by 180
“Then, Begg and Mazumdar ’ s (1994) rank correlation test was applied.”
BackgroundMethodFlückiger, C., Rubel, J., Del Re, A. C., Horvath, A. O., Wampold, B. E., Crits-Christoph, P., Atzil-Slonim, D., Compare, A., Falkenström, F., Ekeblad, A., et al. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000594 · Cited by 180
“We also examined the hypotheses that our search may be biased because we excluded unpublished studies with potentially low or nonsignificant results; we used funnel plots, rank correlation (Begg & Mazumdar, 1994), and regression tests (Egger, Smith, Schneider, & Minder, 1997).”
MethodSchwingshackl, L., Dias, S., Strasser, B., & Hoffmann, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082853 · Cited by 180
“Additionally, Begg’s and Egger regression tests were performed to detect small study effects [17,18].”
MethodXie, C., Zhu, R., Tian, Y., & Wang, K. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013983 · Cited by 180
Ciocanel, O., Power, K., Eriksen, A., & Gillings, K. (2017) · Journal of Youth and Adolescence · doi:10.1007/s10964-016-0555-6 · Cited by 179
Waddington, H., & Snilstveit, B. (2009) · Journal of Development Effectiveness · doi:10.1080/19439340903141175 · Cited by 179
“We also examined publication bias formally, noting that the statistical tests used are inconclusive given that they are at best only moderately powered under the present study sample sizes (Begg and Mazumdar 1994), and given the contextual heterogeneity.”
MethodWang, Y.-T., Gou, Y.-W., Jin, W.-W., Xiao, M., & Fang, H.-Y. (2016) · BMC Cancer · doi:10.1186/s12885-016-2241-1 · Cited by 179
“Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias.”
BackgroundMethodInfluentialSmoking and Suicide: A Meta-Analysis
Poorolajal, J., & Darvishi, N. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156348 · Cited by 179
“The possibility of publication bias was assessed using Begg's and Egger's tests and Trim & Fill analysis.”
MethodSun, Y., Ji, M., Leng, M., Li, X., Zhang, X., & Wang, Z. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2022.104204 · Cited by 176
Borenstein, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch11 · Cited by 178
Zuily, S., Regnault, V., Selton-Suty, C., Eschwège, V., Bruntz, J.-F., Bode-Dotto, E., De Maistre, E., Dotto, P., Perret-Guillaume, C., Lecompte, T., et al. (2011) · Circulation · doi:10.1161/circulationaha.111.028522 · Cited by 178
Intolerance of uncertainty, anxiety, and worry in children and adolescents: A meta-analysis
Osmanağaoğlu, N., Creswell, C., & Dodd, H. F. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.035 · Cited by 177
“Rank correlation (Begg & Mazumdar, 1994) and regression tests (Egger, Smith, Schneider, & Minder, 1997) were then conducted to assess the evidence of publication bias.”
Vancampfort, D., Mitchell, A. J., De Hert, M., Sienaert, P., Probst, M., Buys, R., & Stubbs, B. (2015) · Depression and Anxiety · doi:10.1002/da.22387 · Cited by 171
“We assessed publication bias with a visual inspection of funnel plots, yet gave priority to quantitative testing through the Begg–Mazumdar Kendall’s tau[29] and Egger bias test.”
MethodREVIEW: Accuracy of laparoscopy in the diagnosis of endometriosis: a systematic quantitative review
Wykes, C. B., Clark, T. J., & Khan, K. S. (2004) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2004.00433.x · Cited by 177
Liu, T., Krentz, A., Lu, L., & Curcin, V. (2025) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztae080 · Cited by 177
Fatemeh, G., Sajjad, M., Niloufar, R., Neda, S., Leila, S., & Khadijeh, M. (2022) · Journal of Neurology · doi:10.1007/s00415-020-10381-w · Cited by 177
Oral contraceptives and risk of endometriosis: a systematic review and meta-analysis
Vercellini, P., Eskenazi, B., Consonni, D., Somigliana, E., Parazzini, F., Abbiati, A., & Fedele, L. (2011) · Human Reproduction Update · doi:10.1093/humupd/dmq042 · Cited by 176
Fu, Y., Xia, Y., Yi, H., Xu, H., Guan, J., & Yin, S. (2017) · Sleep and Breathing · doi:10.1007/s11325-016-1393-1 · Cited by 176
Wang, Z., Lai, S.-T., Xie, L., Zhao, J.-D., Ma, N.-Y., Zhu, J., Ren, Z.-G., & Jiang, G.-L. (2014) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2014.04.007 · Cited by 176
Liu, Y., Zhong, G.-C., Tan, H.-Y., Hao, F.-B., & Hu, J.-J. (2019) · Scientific Reports · doi:10.1038/s41598-019-47687-3 · Cited by 176
Yan, E., Veitch, M., Saripella, A., Alhamdah, Y., Butris, N., Tang-Wai, D. F., Tartaglia, M. C., Nagappa, M., Englesakis, M., He, D., et al. (2023) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2023.111221 · Cited by 176
Holmgren, M., Gómez-Aparicio, L., Quero, J. L., & Valladares, F. (2012) · Oecologia · doi:10.1007/s00442-011-2196-5 · Cited by 176
“This meta-analysis aims to provide the empirical evidence supporting general emerging patterns and to highlight the current shortcomings in our understanding of key community ecology processes.”
BackgroundA systematic review and meta-analysis of tests to predict wound healing in diabetic foot.
Wang, Z., Hasan, R., Firwana, B., Elraiyah, T., Tsapas, A., Prokop, L., Mills, J. L., & Murad, M. H. (2016) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2015.10.004 · Cited by 173
Naslund, J. A., Whiteman, K. L., McHugo, G. J., Aschbrenner, K. A., Marsch, L. A., & Bartels, S. J. (2017) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2017.04.003 · Cited by 176
Zhang, Y., Sheng, J., Kang, S., Fang, W., Yan, Y., Hu, Z., Hong, S., Wu, X., Qin, T., Liang, W., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0107161 · Cited by 175
Ruiz-Goikoetxea, M., Cortese, S., Aznarez-Sanado, M., Magallón, S., Alvarez Zallo, N., Luis, E. O., de Castro-Manglano, P., Soutullo, C., & Arrondo, G. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.11.007 · Cited by 175
The prevalence of technology-facilitated sexual violence: A meta-analysis and systematic review
Patel, U., & Roesch, R. (2022) · Trauma, Violence, & Abuse · doi:10.1177/1524838020958057 · Cited by 175
“432 TRAUMA, VIOLENCE, & ABUSE 23(2) Begg’s rank correlations (Begg & Mazumdar, 1994) were performed using Comprehensive Meta Analysis 3.0 to assess for the presence of publication bias.”
MethodInfluentialReboussin, D. M., Allen, N. B., Griswold, M. E., Guallar, E., Hong, Y., Lackland, D. T., Miller, E. (. R., Polonsky, T., Thompson-Paul, A. M., & Vupputuri, S. (2018) · Hypertension · doi:10.1161/hyp.0000000000000067 · Cited by 175
Effects of exercise on fracture reduction in older adults: A systematic review and meta-analysis
Kemmler, W., Häberle, L., & von Stengel, S. (2013) · Osteoporosis International · doi:10.1007/s00198-012-2248-7 · Cited by 174
“We examined the data for potential publication bias by using both Egger’s test [24] and Begg’s test [25], as well as the Egger funnel plot in which trial effects are plotted against their precision (i.”
BackgroundMethodVan Dam, L., Smit, D., Wildschut, B., Branje, S. J. T., Rhodes, J. E., Assink, M., & Stams, G. J. J. M. (2018) · American Journal of Community Psychology · doi:10.1002/ajcp.12248 · Cited by 174
“Finally, the skewness of the effect size distribution was calculated in SPSS, because if publication bias is present, a skew distribution of the effect sizes would be expected (Begg & Mazumdar, 1994).”
MethodMonami, M., Dicembrini, I., Nardini, C., Fiordelli, I., & Mannucci, E. (2014) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12175 · Cited by 174
Halpern, S. C., Schuch, F. B., Scherer, J. N., Sordi, A. O., Pachado, M., Dalbosco, C., Fara, L., Pechansky, F., Kessler, F., & Von Diemen, L. (2018) · Child Abuse Review · doi:10.1002/car.2534 · Cited by 173
Gan, Y., Tong, X., Li, L., Cao, S., Yin, X., Gao, C., Herath, C., Li, W., Jin, Z., Chen, Y., et al. (2015) · International Journal of Cardiology · doi:10.1016/j.ijcard.2015.01.077 · Cited by 173
Bamberg, F., Sommer, W. H., Hoffmann, V., Achenbach, S., Nikolaou, K., Conen, D., Reiser, M. F., Hoffmann, U., & Becker, C. R. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2010.12.043 · Cited by 173
The effect of estrogen vs. combined estrogen‐progestogen therapy on the risk of colorectal cancer
Lin, K. J., Cheung, W. Y., Lai, J. Y., & Giovannucci, E. L. (2012) · International Journal of Cancer · doi:10.1002/ijc.26026 · Cited by 173
Short‐ and long‐term mortality after bariatric surgery: Asystematic review and meta‐analysis
Cardoso, L., Rodrigues, D., Gomes, L., & Carrilho, F. (2017) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12922 · Cited by 173
“This systematic review was reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.22 A detailed version of the study protocol can be found online in File S1.”
Supervised walking therapy in patients with intermittent claudication
Fakhry, F., van de Luijtgaarden, K. M., Bax, L., den Hoed, P. T., Hunink, M. G. M., Rouwet, E. V., & Spronk, S. (2012) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2012.04.046 · Cited by 172
Relationship between work–family conflict and turnover intention in nurses: A meta‐analytic review
Yildiz, B., Yildiz, H., & Ayaz Arda, O. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14846 · Cited by 172
Hansen, R., Gaynes, B., Thieda, P., Gartlehner, G., Deveaugh-Geiss, A., Krebs, E., & Lohr, K. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.10.1121 · Cited by 172
Dairy consumption and risk of breast cancer: a meta-analysis of prospective cohort studies
Dong, J.-Y., Zhang, L., He, K., & Qin, L.-Q. (2011) · Breast Cancer Research and Treatment · doi:10.1007/s10549-011-1467-5 · Cited by 172
“Potential publication bias was assessed by both Begg rank correlation test and Egger linear regression test [27, 28].”
BackgroundMethodSchelonka, R. L., Katz, B., Waites, K. B., & Benjamin, D. K. (2005) · The Pediatric Infectious Disease Journal · doi:10.1097/01.inf.0000190632.31565.83 · Cited by 172
“However, because systematic reviews are primarily explanatory and observational, formal inferences are not drawn from the presented 95% CI.(37)”
BackgroundBai, F., Zheng, W., Dong, Y., Wang, J., Garstka, M. A., Li, R., An, J., & Ma, H. (2018) · Oncotarget · doi:10.18632/oncotarget.22260 · Cited by 172
Kunutsor, S. K., Apekey, T. A., Seddoh, D., & Walley, J. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyt192 · Cited by 172
Kalil, A. C., Van Schooneveld, T. C., Fey, P. D., & Rupp, M. E. (2014) · JAMA · doi:10.1001/jama.2014.6364 · Cited by 172
Interventions for paracetamol (acetaminophen) overdose
Chiew, A. L., Gluud, C., Brok, J., & Buckley, N. A. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003328.pub3 · Cited by 170
Ronellenfitsch, U., Schwarzbach, M., Hofheinz, R., Kienle, P., Kieser, M., Slanger, T. E., Burmeister, B., Kelsen, D., Niedzwiecki, D., Schuhmacher, C., et al. (2013) · European Journal of Cancer · doi:10.1016/j.ejca.2013.05.029 · Cited by 171
Puli, S. R., Reddy, J. B. K., Bechtold, M. L., Choudhary, A., Antillon, M. R., & Brugge, W. R. (2009) · Annals of Surgical Oncology · doi:10.1245/s10434-009-0337-4 · Cited by 171
Saffari, M., Ghanizadeh, G., & Koenig, H. G. (2014) · Primary Care Diabetes · doi:10.1016/j.pcd.2014.03.004 · Cited by 170
A systematic review and meta-analysis of physical activity and endometrial cancer risk
Schmid, D., Behrens, G., Keimling, M., Jochem, C., Ricci, C., & Leitzmann, M. (2015) · European Journal of Epidemiology · doi:10.1007/s10654-015-0017-6 · Cited by 170
“Potential publication bias was assessed by visual inspection of a funnel plot and by using Egger’s regression test [23] and Begg’s rank correlation test [24].”
MethodZhang, C., Qin, Y.-Y., Wei, X., Yu, F.-F., Zhou, Y.-H., & He, J. (2015) · European Journal of Epidemiology · doi:10.1007/s10654-014-9960-x · Cited by 170
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.