Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 601–700 of 1,708
Brief mindfulness training for negative affectivity: A systematic review and meta-analysis.
Schumer, M. C., Lindsay, E. K., & Creswell, J. D. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000324 · Cited by 316
“Begg’s rank correlation test (Begg & Mazumdar, 1994) indicated a significant association between sample size and observed effect size for studies with negative affectivity outcomes (Kendall’s .40, p .001), indicating a risk for publication bias in this brief mindfulness training literature.”
Mitchell, A. J., Delaffon, V., Vancampfort, D., Correll, C. U., & De Hert, M. (2012) · Psychological Medicine · doi:10.1017/s003329171100105x · Cited by 332
“Publication bias was assessed using the Begg–Mazumdar statistic (Begg & Mazumdar, 1994), finding no bias in any area for any calculation (see Table 2).”
MethodA meta-analysis of plant physiological and growth responses to temperature and elevated CO2
Wang, D., Heckathorn, S. A., Wang, X., & Philpott, S. M. (2012) · Oecologia · doi:10.1007/s00442-011-2172-0 · Cited by 331
Global processing takes time: A meta-analysis on local–global visual processing in ASD.
Van der Hallen, R., Evers, K., Brewaeys, K., Van den Noortgate, W., & Wagemans, J. (2015) · Psychological Bulletin · doi:10.1037/bul0000004 · Cited by 329
Diabetes mellitus and risk of prostate cancer: a meta-analysis
Bonovas, S., Filioussi, K., & Tsantes, A. (2004) · Diabetologia · doi:10.1007/s00125-004-1415-6 · Cited by 327
Depression and Risk of Stroke: A Meta-Analysis of Prospective Studies
Dong, J.-Y., Zhang, Y.-H., Tong, J., & Qin, L.-Q. (2012) · Stroke · doi:10.1161/strokeaha.111.630871 · Cited by 327
Risk factors for child sexual abuse victimization: A meta-analytic review.
Assink, M., van der Put, C. E., Meeuwsen, M. W. C. M., de Jong, N. M., Oort, F. J., Stams, G. J. J. M., & Hoeve, M. (2019) · Psychological bulletin · doi:10.1037/bul0000188 · Cited by 322
Nishijima, T. F., Muss, H. B., Shachar, S. S., Tamura, K., & Takamatsu, Y. (2015) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2015.10.003 · Cited by 324
Carroll, S., & Dudfield, M. (2004) · Sports Medicine · doi:10.2165/00007256-200434060-00004 · Cited by 327
The Prevalence of Sexual Revictimization: A Meta-Analytic Review
Walker, H. E., Freud, J. S., Ellis, R. A., Fraine, S. M., & Wilson, L. C. (2019) · Trauma, Violence, & Abuse · doi:10.1177/1524838017692364 · Cited by 324
Wang, X., Ouyang, Y., Wang, Z., Zhao, G., Liu, L., & Bi, Y. (2013) · International Journal of Cardiology · doi:10.1016/j.ijcard.2013.08.088 · Cited by 324
Efficacy and safety of topiramate on weight loss: a meta‐analysis of randomized controlled trials
Kramer, C. K., Leitão, C. B., Pinto, L. C., Canani, L. H., Azevedo, M. J., & Gross, J. L. (2011) · Obesity Reviews · doi:10.1111/j.1467-789x.2010.00846.x · Cited by 323
Sex differences in long-term smoking cessation rates due to nicotine patch
Perkins, K., & Scott, J. (2008) · Nicotine & Tobacco Research · doi:10.1080/14622200802097506 · Cited by 324
Corona, G., Minhas, S., Giwercman, A., Bettocchi, C., Dinkelman-Smit, M., Dohle, G., Fusco, F., Kadioglou, A., Kliesch, S., Kopa, Z., et al. (2019) · Human Reproduction Update · doi:10.1093/humupd/dmz028 · Cited by 321
Physical activity decreases cardiovascular disease risk in women
Oguma, Y., & Shinoda-Tagawa, T. (2004) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2004.02.007 · Cited by 323
Garlic and cancer: A critical review of the epidemiologic literature
Fleischauer, A. T., & Arab, L. (2001) · The Journal of Nutrition · doi:10.1093/jn/131.3.1032s · Cited by 323
Maïano, C., Normand, C. L., Salvas, M., Moullec, G., & Aimé, A. (2016) · Autism Research · doi:10.1002/aur.1568 · Cited by 323
A Meta-Analysis of the Global Prevalence of Temporomandibular Disorders
Zieliński, G., Pająk-Zielińska, B., & Ginszt, M. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13051365 · Cited by 311
“Finally, we performed the rank correlation test established by Begg and Mazumdar [51] to investigate whether there was a correlation between the effect sizes (or outcomes) and their corresponding sample variances.”
MethodReproductive and developmental toxicity of formaldehyde: A systematic review
Duong, A., Steinmaus, C., McHale, C. M., Vaughan, C. P., & Zhang, L. (2011) · Mutation Research/Reviews in Mutation Research · doi:10.1016/j.mrrev.2011.07.003 · Cited by 322
Efficacy of Probiotic Use in Acute Diarrhea in Children: A Meta-Analysis
Huang, J. S., Bousvaros, A., Lee, J. W., Diaz, A., & Davidson, E. J. (2002) · Digestive Diseases and Sciences · doi:10.1023/a:1020501202369 · Cited by 320
Liu, X., Zhang, D., Liu, Y., Sun, X., Han, C., Wang, B., Ren, Y., Zhou, J., Zhao, Y., Shi, Y., et al. (2017) · Hypertension · doi:10.1161/hypertensionaha.116.08994 · Cited by 320
Implicit Theories of Intelligence and Academic Achievement: A Meta-Analytic Review
Costa, A., & Faria, L. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00829 · Cited by 318
Helicobacter pylori and Esophageal Cancer Risk: A Meta-analysis
Islami, F., & Kamangar, F. (2008) · Cancer Prevention Research · doi:10.1158/1940-6207.capr-08-0109 · Cited by 320
Sexual selection and sperm quantity: meta-analyses of strategic ejaculation
Kelly, C. D., & Jennions, M. D. (2011) · Biological Reviews · doi:10.1111/j.1469-185x.2011.00175.x · Cited by 318
Vancampfort, D., Wampers, M., Mitchell, A. J., Correll, C. U., De Herdt, A., Probst, M., & De Hert, M. (2013) · World Psychiatry · doi:10.1002/wps.20069 · Cited by 317
Heinrich, M. C., Häberle, L., Müller, V., Bautz, W., & Uder, M. (2009) · Radiology · doi:10.1148/radiol.2501080833 · Cited by 319
Ganji‐Arjenaki, M., & Rafieian‐Kopaei, M. (2018) · Journal of Cellular Physiology · doi:10.1002/jcp.25911 · Cited by 314
“…across trials by using the I2 statistic and also performed the Begg and Egger tests to assess the potential for publications bias of the efficacy of probiotics in types of IBD and created funnel plots to visualize possible asymmetry (Begg & Mazumdar, 1994; Egger, Smith, Schneider, & Minder, 1997).”
MethodSingh, S., Singh, P. P., Singh, A. G., Murad, M. H., & Sanchez, W. (2013) · American Journal of Gastroenterology · doi:10.1038/ajg.2013.5 · Cited by 320
Treatment of periodontal disease for glycaemic control in people with diabetes mellitus
Simpson, T. C., Weldon, J. C., Worthington, H. V., Needleman, I., Wild, S. H., Moles, D. R., Stevenson, B., Furness, S., & Iheozor-Ejiofor, Z. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004714.pub3 · Cited by 317
Navarro, P., Arias, Á., Arias‐González, L., Laserna‐Mendieta, E. J., Ruiz‐Ponce, M., & Lucendo, A. J. (2019) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.15231 · Cited by 318
Vancampfort, D., Correll, C. U., Wampers, M., Sienaert, P., Mitchell, A. J., De Herdt, A., Probst, M., Scheewe, T. W., & De Hert, M. (2014) · Psychological Medicine · doi:10.1017/s0033291713002778 · Cited by 317
“In addition, publication bias was tested using the Egger regression method (Egger et al. 1997) and the Begg–Mazumdar test (Begg & Mazumdar, 1994), with a p value<0.05 suggesting presence of bias.”
MethodInfluentialPCSK9R46L, Low-Density Lipoprotein Cholesterol Levels, and Risk of Ischemic Heart Disease
Benn, M., Nordestgaard, B. G., Grande, P., Schnohr, P., & Tybjærg-Hansen, A. (2010) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2010.02.044 · Cited by 314
Noninvasive ventilation in acute respiratory failure— A meta-analysis update
Peter, J. V., Moran, J. L., Phillips-Hughes, J., & Warn, D. (2002) · Critical Care Medicine · doi:10.1097/00003246-200203000-00010 · Cited by 319
Effects of digital game-based STEM education on students’ learning achievement: a meta-analysis
Wang, L.-H., Chen, B., Hwang, G.-J., Guan, J.-Q., & Wang, Y.-Q. (2022) · International Journal of STEM Education · doi:10.1186/s40594-022-00344-0 · Cited by 316
“In the Begg and Mazumdar rank correlation (Kendall’s Tau with a continuity correction), the results ( Z = 1.457 < 1.96, p = 0.145 > 0.05) indicate that there is insignificant publication bias (Begg & Mazumdar, 1994).”
ResultInfluentialPietschnig, J., Penke, L., Wicherts, J. M., Zeiler, M., & Voracek, M. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.09.017 · Cited by 316
Saam, T., Hetterich, H., Hoffmann, V., Yuan, C., Dichgans, M., Poppert, H., Koeppel, T., Hoffmann, U., Reiser, M. F., & Bamberg, F. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.06.015 · Cited by 314
Magill, M., Ray, L., Kiluk, B., Hoadley, A., Bernstein, M., Tonigan, J. S., & Carroll, K. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000447 · Cited by 315
“…removed (Baujat, Mahé, Pignon, & Hill, 2002) were also provided.3 Finally, to test for potential publication bias, the relationship between error and effect size was assessed using rank correlation (Begg & Mazumdar, 1994) and graphical methods (Egger, Davey Smith, Schneider, & Minder, 1997).”
MethodGordon, B. R., McDowell, C. P., Lyons, M., & Herring, M. P. (2017) · Sports Medicine · doi:10.1007/s40279-017-0769-0 · Cited by 306
“, smaller studies showing larger effects), Egger’s regression [31] and Begg’s rank correlation [32] analyses were performed, as well as visual inspection of a funnel plot.”
MethodJabre, P., Roger, V. L., Murad, M. H., Chamberlain, A. M., Prokop, L., Adnet, F., & Jouven, X. (2011) · Circulation · doi:10.1161/circulationaha.110.986661 · Cited by 314
Chen, L., Davey Smith, G., Harbord, R. M., & Lewis, S. J. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050052 · Cited by 314
“A small-study effect was also detected in the analysis of male DBP differences between ALDH2 genotypes (DBP: *1*1 versus *2*2 Begg's test p ¼ 0.05; Egger's test p ¼ 0.04), no other associations showed evidence of small study bias.”
MethodInfluentialAune, D., Navarro Rosenblatt, D. A., Chan, D. S., Vieira, A. R., Vieira, R., Greenwood, D. C., Vatten, L. J., & Norat, T. (2015) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.067157 · Cited by 314
Huedo-Medina, T. B., Kirsch, I., Middlemass, J., Klonizakis, M., & Siriwardena, A. N. (2012) · BMJ · doi:10.1136/bmj.e8343 · Cited by 313
Identification of behaviour change techniques to reduce excessive alcohol consumption
Michie, S., Whittington, C., Hamoudi, Z., Zarnani, F., Tober, G., & West, R. (2012) · Addiction · doi:10.1111/j.1360-0443.2012.03845.x · Cited by 288
Antidepressant-Induced Sexual Dysfunction
Gregorian, R. S., Golden, K. A., Bahce, A., Goodman, C., Kwong, W. J., & Khan, Z. M. (2002) · Annals of Pharmacotherapy · doi:10.1345/aph.1a195 · Cited by 320
Skeaff, C. M., & Miller, J. (2009) · Annals of Nutrition and Metabolism · doi:10.1159/000229002 · Cited by 310
Januel, J.-M., Chen, G., Ruffieux, C., Quan, H., Douketis, J. D., Crowther, M. A., Colin, C., Ghali, W. A., Burnand, B., & IMECCHI Group, F. T. (2012) · JAMA · doi:10.1001/jama.2011.2029 · Cited by 311
Kojima, G. (2016) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2015-206978 · Cited by 311
Meta-analyses of molecular association studies: Methodologic lessons for genetic epidemiology
Attia, J. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00011-8 · Cited by 311
Oral Human Papillomavirus in Healthy Individuals: A Systematic Review of the Literature
Kreimer, A. R., Bhatia, R. K., Messeguer, A. L., González, P., Herrero, R., & Giuliano, A. R. (2010) · Sexually Transmitted Diseases · doi:10.1097/olq.0b013e3181c94a3b · Cited by 312
Acute myocardial infarction and influenza: a meta-analysis of case–control studies
Barnes, M., Heywood, A. E., Mahimbo, A., Rahman, B., Newall, A. T., & Macintyre, C. R. (2015) · Heart · doi:10.1136/heartjnl-2015-307691 · Cited by 310
Banel, D. K., & Hu, F. B. (2009) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.2009.27457 · Cited by 310
Ma, F., Yang, Y., Li, X., Zhou, F., Gao, C., Li, M., & Gao, L. (2013) · PLoS ONE · doi:10.1371/journal.pone.0054685 · Cited by 309
Adherence to Highly Active Antiretroviral Therapy (HAART): A Meta-Analysis
Ortego, C., Huedo-Medina, T. B., Llorca, J., Sevilla, L., Santos, P., Rodríguez, E., Warren, M. R., & Vejo, J. (2011) · AIDS and Behavior · doi:10.1007/s10461-011-9942-x · Cited by 310
Johnson, L. F., & Lewis, D. A. (2008) · Sexually Transmitted Diseases · doi:10.1097/olq.0b013e3181812d15 · Cited by 311
Kedzior, K. K., & Laeber, L. T. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-136 · Cited by 309
Video game training enhances cognition of older adults: A meta-analytic study.
Toril, P., Reales, J. M., & Ballesteros, S. (2014) · Psychology and Aging · doi:10.1037/a0037507 · Cited by 308
Minozzi, S., Bonovas, S., Lytras, T., Pecoraro, V., González-Lorenzo, M., Bastiampillai, A. J., Gabrielli, E. M., Lonati, A. C., Moja, L., Cinquini, M., et al. (2016) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2016.1240783 · Cited by 308
A meta-analysis of the effect of high weight on asthma
Flaherman, V (2006) · Archives of Disease in Childhood · doi:10.1136/adc.2005.080390 · Cited by 307
Alcohol consumption and risk of incident human immunodeficiency virus infection: a meta-analysis
Baliunas, D., Rehm, J., Irving, H., & Shuper, P. (2010) · International Journal of Public Health · doi:10.1007/s00038-009-0095-x · Cited by 307
“Publication bias was assessed using the Begg’s test (Begg and Mazumdar 1994) and Egger’s test (Egger et al. 1997).”
MethodA systematic review and meta-analysis of ‘Systems for Social Processes' in eating disorders
Caglar-Nazali, H. P., Corfield, F., Cardi, V., Ambwani, S., Leppanen, J., Olabintan, O., Deriziotis, S., Hadjimichalis, A., Scognamiglio, P., Eshkevari, E., et al. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.12.002 · Cited by 294
Updated tests for small-study effects in meta-analyses
Harbord, R. M., Harris, R. J., & Sterne, J. A. C. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900202 · Cited by 307
Personality traits, empathy and bullying behavior: A meta-analytic approach
Mitsopoulou, E., & Giovazolias, T. (2015) · Aggression and Violent Behavior · doi:10.1016/j.avb.2015.01.007 · Cited by 307
Active Smoking and Breast Cancer Risk: Original Cohort Data and Meta-Analysis
Gaudet, M. M., Gapstur, S. M., Sun, J., Diver, W. R., Hannan, L. M., & Thun, M. J. (2013) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djt023 · Cited by 309
Mitsudomi, T., Hamajima, N., Ogawa, M., & Takahashi, T. (2000) · PubMed · Cited by 341
Metformin monotherapy for type 2 diabetes mellitus
Saenz, A., Fernandez-Esteban, I., Mataix, A., Ausejo Segura, M., Roqué i Figuls, M., & Moher, D. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002966.pub3 · Cited by 308
RetractedFiolet, T., Guihur, A., Rebeaud, M. E., Mulot, M., Peiffer-Smadja, N., & Mahamat-Saleh, Y. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.08.022 · Cited by 306
The distance dependence prediction of the Janzen‐Connell hypothesis: a meta‐analysis
Hyatt, L. A., Rosenberg, M. S., Howard, T. G., Bole, G., Fang, W., Anastasia, J., Brown, K., Grella, R., Hinman, K., Kurdziel, J. P., et al. (2003) · Oikos · doi:10.1034/j.1600-0706.2003.12235.x · Cited by 305
Mei, Z., Shi, L., Wang, B., Yang, J., Xiao, Z., Du, P., Wang, Q., & Yang, W. (2017) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2017.05.005 · Cited by 304
Guasch-Ferré, M., Satija, A., Blondin, S. A., Janiszewski, M., Emlen, E., O’Connor, L. E., Campbell, W. W., Hu, F. B., Willett, W. C., & Stampfer, M. J. (2019) · Circulation · doi:10.1161/circulationaha.118.035225 · Cited by 304
Alcohol Consumption and Risk of Atrial Fibrillation
Kodama, S., Saito, K., Tanaka, S., Horikawa, C., Saito, A., Heianza, Y., Anasako, Y., Nishigaki, Y., Yachi, Y., Iida, K. T., et al. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2010.08.641 · Cited by 303
How important are direct fitness benefits of sexual selection?
Møller, A., & Jennions, M. (2001) · Naturwissenschaften · doi:10.1007/s001140100255 · Cited by 303
Chambrone, L., Sukekava, F., Araújo, M. G., Pustiglioni, F. E., Chambrone, L. A., & Lima, L. A. (2010) · Journal of Periodontology · doi:10.1902/jop.2010.090540 · Cited by 303
Metaanalysis of the relationship between violent video game play and physical aggression over time
Prescott, A. T., Sargent, J. D., & Hull, J. G. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611617114 · Cited by 303
“Importantly, the analytical approaches used to arrive at this conclusion have been demonstrated to possess complementary qualities: the trim-and-fill technique has high statistical power but a high type I error rate, whereas the Begg and Mazumdar’s rank correlation test has lower power but yields virtually no type I e…”
MethodInfluentialEfficacy and safety of cholinesterase inhibitors in Alzheimer's disease: a meta-analysis.
Lanctôt, K. L., Herrmann, N., Yau, K. K., Khan, L. R., Liu, B. A., Loulou, M., & Einarson, T. R. (2003) · PubMed Central · Cited by 432
Endometriosis and cancer: a systematic review and meta-analysis
Kvaskoff, M., Mahamat-Saleh, Y., Farland, L. V., Shigesi, N., Terry, K. L., Harris, H. R., Roman, H., Becker, C. M., As-Sanie, S., Zondervan, K. T., et al. (2021) · Human Reproduction Update · doi:10.1093/humupd/dmaa045 · Cited by 303
“Study effects, such as publication bias, were visually assessed by examining funnel plots for asymmetry, and with Egger’s (Egger et al., 1997) and Begg’s tests (Begg and Mazumdar, 1994).”
MethodSterne, J. A. C., Bradburn, M. J., & Egger, M. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch18 · Cited by 297
Meta‐analysis on night shift work and risk of metabolic syndrome
Wang, F., Zhang, L., Zhang, Y., Zhang, B., He, Y., Xie, S., Li, M., Miao, X., Chan, E. Y. Y., Tang, J. L., et al. (2014) · Obesity Reviews · doi:10.1111/obr.12194 · Cited by 302
Psoriasis and smoking: a systematic review and meta‐analysis
Armstrong, A. W., Harskamp, C. T., Dhillon, J. S., & Armstrong, E. J. (2014) · British Journal of Dermatology · doi:10.1111/bjd.12670 · Cited by 302
Genetics of Leptin and Obesity: A HuGE Review
Paracchini, V., Pedotti, P., & Taioli, E. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi174 · Cited by 302
Chung, S. W., Hill, A. T., Rogasch, N. C., Hoy, K. E., & Fitzgerald, P. B. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.01.008 · Cited by 300
Varotto, A., & Spagnolli, A. (2017) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2017.03.011 · Cited by 302
Childhood trauma and suicide attempt: a meta-analysis of longitudinal studies from the last decade
Zatti, C., Rosa, V., Barros, A., Valdivia, L., Calegaro, V. C., Freitas, L. H., Ceresér, K. M. M., Rocha, N. S. D., Bastos, A. G., & Schuch, F. B. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.06.082 · Cited by 297
Li, H.-T., Zhou, Y.-B., & Liu, J.-M. (2013) · International Journal of Obesity · doi:10.1038/ijo.2012.195 · Cited by 301
The Influence of Operational Sex Ratio on the Intensity of Competition for Mates
Weir, L. K., Grant, J. W. A., & Hutchings, J. A. (2011) · The American Naturalist · doi:10.1086/657918 · Cited by 300
Ho, F. C., Tham, I. W., Earnest, A., Lee, K. M., & Lu, J. J. (2012) · BMC Cancer · doi:10.1186/1471-2407-12-98 · Cited by 300
Incentives in Web Studies: Methodological Issues and a Review
Göritz, A. S. (2006) · OPUS (Augsburg University) · Cited by 443
Nishijima, T. F., Shachar, S. S., Nyrop, K. A., & Muss, H. B. (2017) · The Oncologist · doi:10.1634/theoncologist.2016-0419 · Cited by 300
Bjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007176 · Cited by 302
Bazzano, L. A., Thompson, A. M., Tees, M. T., Nguyen, C. H., & Winham, D. M. (2011) · Nutrition, Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2009.08.012 · Cited by 300
“In addition, Begg's rank correlation test was used to examine the association between mean net change and its variance, and Egger's linear regression test, which regresses z statistics on the reciprocal of the standard error (SE) for each study, was also used to detect publication bias (34,35).”
Does tobacco use cause psychosis? Systematic review and meta-analysis
Gurillo, P., Jauhar, S., Murray, R. M., & MacCabe, J. H. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00152-2 · Cited by 300
Long-term psychodynamic psychotherapy in complex mental disorders: update of a meta-analysis
Leichsenring, F., & Rabung, S. (2011) · British Journal of Psychiatry · doi:10.1192/bjp.bp.110.082776 · Cited by 299
Sud, S., Friedrich, J. O., Adhikari, N. K. J., Taccone, P., Mancebo, J., Polli, F., Latini, R., Pesenti, A., Curley, M. A. Q., Fernandez, R., et al. (2014) · Canadian Medical Association Journal · doi:10.1503/cmaj.140081 · Cited by 301
Risk factors for stomach cancer: a systematic review and meta-analysis
Poorolajal, J., Moradi, L., Mohammadi, Y., Cheraghi, Z., & Gohari-Ensaf, F. (2020) · Epidemiology and Health · doi:10.4178/epih.e2020004 · Cited by 299
Nishijima, T. F., Muss, H. B., Shachar, S. S., & Moschos, S. J. (2016) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2016.02.006 · Cited by 293
“We evaluated publication bias regarding the primary outcome using funnel plots and with the Begg and Egger tests [21,22].”
MethodLemos, E. V., de la Hoz, F. P., Einarson, T. R., McGhan, W. F., Quevedo, E., Castañeda, C., & Kawai, K. (2014) · Clinical Microbiology and Infection · doi:10.1111/1469-0691.12363 · Cited by 296
Transcranial direct current stimulation in the treatment of major depression: a meta-analysis
Kalu, U. G., Sexton, C. E., Loo, C. K., & Ebmeier, K. P. (2012) · Psychological Medicine · doi:10.1017/s0033291711003059 · Cited by 299
Robenshtok, E., Gafter-Gvili, A., Goldberg, E., Weinberger, M., Yeshurun, M., Leibovici, L., & Paul, M. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2007.12.3851 · Cited by 298
Is birth weight a risk factor for ischemic heart disease in later life?
Huxley, R., Owen, C. G., Whincup, P. H., Cook, D. G., Rich-Edwards, J., Smith, G. D., & Collins, R. (2007) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/85.5.1244 · Cited by 296
Digoxin-associated mortality: a systematic review and meta-analysis of the literature
Vamos, M., Erath, J. W., & Hohnloser, S. H. (2015) · European Heart Journal · doi:10.1093/eurheartj/ehv143 · Cited by 298
Interferon-Induced Depression in Chronic Hepatitis C: A Systematic Review and Meta-Analysis
Udina, M., Castellví, P., Moreno-España, J., Navinés, R., Valdés, M., Forns, X., Langohr, K., Solà, R., Vieta, E., & Martín-Santos, R. (2012) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.12r07694 · Cited by 297
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.