Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 301–400 of 1,708
Shift work and diabetes mellitus: a meta-analysis of observational studies
Gan, Y., Yang, C., Tong, X., Sun, H., Cong, Y., Yin, X., Li, L., Cao, S., Dong, X., Gong, Y., et al. (2015) · Occupational and Environmental Medicine · doi:10.1136/oemed-2014-102150 · Cited by 526
Mocellin, S., Pasquali, S., Rossi, C. R., & Nitti, D. (2010) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djq009 · Cited by 527
Cigarette smoking and colorectal cancer incidence and mortality: Systematic review and meta‐analysis
Liang, P. S., Chen, T., & Giovannucci, E. (2009) · International Journal of Cancer · doi:10.1002/ijc.24191 · Cited by 524
A Pooled Analysis of Magnetic Fields, Wire Codes, and Childhood Leukemia
Greenland, S., Sheppard, A. R., Kaune, W. T., Poole, C., & Kelsh, M. A. (2000) · Epidemiology · doi:10.1097/00001648-200011000-00003 · Cited by 524
Lemmer, G., & Wagner, U. (2015) · European Journal of Social Psychology · doi:10.1002/ejsp.2079 · Cited by 522
Renal cell carcinoma in relation to cigarette smoking: Meta-analysis of 24 studies
Hunt, J. D., van der Hel, O. L., McMillan, G. P., Boffetta, P., & Brennan, P. (2005) · International Journal of Cancer · doi:10.1002/ijc.20618 · Cited by 525
Effect of cigarette smoking on major histological types of lung cancer: a meta-analysis
Khuder, S. A. (2001) · Lung Cancer · doi:10.1016/s0169-5002(00)00181-1 · Cited by 522
Jauhar, S., McKenna, P. J., Radua, J., Fung, E., Salvador, R., & Laws, K. R. (2014) · British Journal of Psychiatry · doi:10.1192/bjp.bp.112.116285 · Cited by 517
Daskalopoulou, C., Stubbs, B., Kralj, C., Koukounari, A., Prince, M., & Prina, A. M. (2017) · Ageing Research Reviews · doi:10.1016/j.arr.2017.06.003 · Cited by 501
“We also assessed publication bias with Begg-Mazumdar Kendall’s tau (Begg and Mazumdar, 1994) and Egger bias test (Egger et al., 1997).”
Systematic Review: Vitamin D and Calcium Supplementation in Prevention of Cardiovascular Events
Wang, L., Manson, J. E., Song, Y., & Sesso, H. D. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-5-201003020-00010 · Cited by 518
A Meta-Analysis of the Incidence of Non-AIDS Cancers in HIV-Infected Individuals
Shiels, M. S., Cole, S. R., Kirk, G. D., & Poole, C. (2009) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0b013e3181b327ca · Cited by 516
Infectious mononucleosis and risk for multiple sclerosis: A meta‐analysis
Thacker, E. L., Mirzaei, F., & Ascherio, A. (2006) · Annals of Neurology · doi:10.1002/ana.20820 · Cited by 517
Armstrong, A. W., Harskamp, C. T., & Armstrong, E. J. (2012) · Nutrition & Diabetes · doi:10.1038/nutd.2012.26 · Cited by 514
Creativity and academic achievement: A meta-analysis
Gajda, A., Karwowski, M., & Beghetto, R. A. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000133 · Cited by 515
“Based on the random effects model, assessing funnel plot asymmetry, and Begg and Mazumdar (1994) rank correlation test (nonsignificant ps .42 and .30, respectively), we concluded there was no evidence of publication bias.”
MethodSurvival of Blacks and Whites After a Cancer Diagnosis
Bach, P. B. (2002) · JAMA · doi:10.1001/jama.287.16.2106 · Cited by 513
Shekelle, P. G., Hardy, M. L., Morton, S. C., Maglione, M., Mojica, W. A., Suttorp, M. J., Rhodes, S. L., Jungvig, L., & Gagné, J. (2003) · JAMA · doi:10.1001/jama.289.12.1537 · Cited by 511
Depression and the risk of coronary heart disease: a meta-analysis of prospective cohort studies
Gan, Y., Gong, Y., Tong, X., Sun, H., Cong, Y., Dong, X., Wang, Y., Xu, X., Yin, X., Deng, J., et al. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0371-z · Cited by 502
“We used the Begg test [20], the Egger test [21] and visual inspection of a funnel plot to assess the publication bias.”
MethodThe relation of economic status to subjective well-being in developing countries: A meta-analysis.
Howell, R. T., & Howell, C. J. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.4.536 · Cited by 507
Afshin, A., Micha, R., Khatibzadeh, S., & Mozaffarian, D. (2014) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.076901 · Cited by 509
Maternal smoking during pregnancy and child overweight: systematic review and meta-analysis
Oken, E., Levitan, E. B., & Gillman, M. W. (2008) · International Journal of Obesity · doi:10.1038/sj.ijo.0803760 · Cited by 632
Taylor, B., Irving, H. M., Kanteres, F., Room, R., Borges, G., Cherpitel, C., Greenfield, T., & Rehm, J. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2010.02.011 · Cited by 509
Smoking and gastric cancer: systematic review and meta-analysis of cohort studies
Ladeiras-Lopes, R., Pereira, A. K., Nogueira, A., Pinheiro-Torres, T., Pinto, I., Santos-Pereira, R., & Lunet, N. (2008) · Cancer Causes & Control · doi:10.1007/s10552-008-9132-y · Cited by 511
Blood 25-Hydroxy Vitamin D Levels and Incident Type 2 Diabetes
Song, Y., Wang, L., Pittas, A. G., Del Gobbo, L. C., Zhang, C., Manson, J. E., & Hu, F. B. (2013) · Diabetes Care · doi:10.2337/dc12-0962 · Cited by 510
Ougrin, D., Tranah, T., Stahl, D., Moran, P., & Asarnow, J. R. (2015) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2014.10.009 · Cited by 508
Association Between Chronic Periodontal Disease and Obesity: A Systematic Review and Meta‐Analysis
Chaffee, B. W., & Weston, S. J. (2010) · Journal of Periodontology · doi:10.1902/jop.2010.100321 · Cited by 505
Global epidemiology of Duchenne muscular dystrophy: an updated systematic review and meta-analysis
Crisafulli, S., Sultana, J., Fontana, A., Salvo, F., Messina, S., & Trifirò, G. (2020) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-020-01430-8 · Cited by 500
Shiga, T., Wajima, Z., Apfel, C. C., Inoue, T., & Ohe, Y. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.13.1350 · Cited by 510
A systematic review and meta-analysis of set-shifting ability in eating disorders
ROBERTS, M. E., TCHANTURIA, K., STAHL, D., SOUTHGATE, L., & TREASURE, J. (2007) · Psychological Medicine · doi:10.1017/s0033291707009877 · Cited by 501
Meat consumption and colorectal cancer risk: Dose‐response meta‐analysis of epidemiological studies
Norat, T., Lukanova, A., Ferrari, P., & Riboli, E. (2002) · International Journal of Cancer · doi:10.1002/ijc.10126 · Cited by 501
Gordon, B. R., McDowell, C. P., Hallgren, M., Meyer, J. D., Lyons, M., & Herring, M. P. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.0572 · Cited by 498
Social cognitive theory and physical activity: a systematic review and meta‐analysis
Young, M. D., Plotnikoff, R. C., Collins, C. E., Callister, R., & Morgan, P. J. (2014) · Obesity Reviews · doi:10.1111/obr.12225 · Cited by 493
It's time: A meta-analysis on the self-control-deviance link
Vazsonyi, A. T., Mikuška, J., & Kelley, E. L. (2017) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2016.10.001 · Cited by 496
Lee, S. H., Nurmatov, U. B., Nwaru, B. I., Mukherjee, M., Grant, L., & Pagliari, C. (2016) · Journal of Global Health · doi:10.7189/jogh.06.010401 · Cited by 456
Sexual Abuse and Lifetime Diagnosis of Somatic Disorders: A Systematic Review and Meta-analysis
Paras, M. L., Murad, M. H., Chen, L. P., Goranson, E. N., Sattler, A. L., Colbenson, K. M., Elamin, M. B., Seime, R. J., Prokop, L. J., & Zirakzadeh, A. (2009) · JAMA · doi:10.1001/jama.2009.1091 · Cited by 490
Shekelle, P. G., Rich, M. W., Morton, S. C., Atkinson, C. S. W., Tu, W., Maglione, M., Rhodes, S., Barrett, M., Fonarow, G. C., Greenberg, B., et al. (2003) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(03)00262-6 · Cited by 492
Meta-Analysis: Antibiotic Prophylaxis Reduces Mortality in Neutropenic Patients
Gafter-Gvili, A., Fraser, A., Paul, M., & Leibovici, L. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_1-200506210-00008 · Cited by 499
Goto, A., Arah, O. A., Goto, M., Terauchi, Y., & Noda, M. (2013) · BMJ · doi:10.1136/bmj.f4533 · Cited by 492
Finckh, A., Liang, M. H., van Herckenrode, C. M., & de Pablo, P. (2006) · Arthritis Care & Research · doi:10.1002/art.22353 · Cited by 492
A meta-analysis of diabetes mellitus and the risk of prostate cancer
Kasper, J. S., & Giovannucci, E. (2006) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-06-0410 · Cited by 491
Aune, D., Greenwood, D. C., Chan, D. S. M., Vieira, R., Vieira, A. R., Navarro Rosenblatt, D. A., Cade, J. E., Burley, V. J., & Norat, T. (2012) · Annals of Oncology · doi:10.1093/annonc/mdr398 · Cited by 488
De Velasco, G., Je, Y., Bossé, D., Awad, M. M., Ott, P. A., Moreira, R. B., Schutz, F., Bellmunt, J., Sonpavde, G. P., Hodi, F. S., et al. (2017) · Cancer Immunology Research · doi:10.1158/2326-6066.cir-16-0237 · Cited by 486
Nachega, J. B., Uthman, O. A., Anderson, J., Peltzer, K., Wampold, S., Cotton, M. F., Mills, E. J., Ho, Y.-S., Stringer, J. S. A., McIntyre, J. A., et al. (2012) · AIDS · doi:10.1097/qad.0b013e328359590f · Cited by 488
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Vevea, J. L., & Woods, C. M. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.428 · Cited by 461
Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy
Song, F., Khan, K. S., Dinnes, J., & Sutton, A. J. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.88 · Cited by 484
A Meta-analysis of oxidative stress markers in depression
Liu, T., Zhong, S., Liao, X., Chen, J., He, T., Lai, S., & Jia, Y. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138904 · Cited by 485
Efficacy of peer support interventions for depression: a meta-analysis
Pfeiffer, P. N., Heisler, M., Piette, J. D., Rogers, M. A. M., & Valenstein, M. (2011) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.10.002 · Cited by 484
The international incidence of traumatic brain injury: a systematic review and meta-analysis
Nguyen, R., Fiest, K. M., McChesney, J., Kwon, C.-S., Jette, N., Frolkis, A. D., Atta, C., Mah, S., Dhaliwal, H., Reid, A., et al. (2016) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/cjn.2016.290 · Cited by 484
Saving lives: A meta-analysis of team training in healthcare.
Hughes, A. M., Gregory, M. E., Joseph, D. L., Sonesh, S. C., Marlow, S. L., Lacerenza, C. N., Benishek, L. E., King, H. B., & Salas, E. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000120 · Cited by 484
Night work and breast cancer risk: A systematic review and meta-analysis
Megdal, S. P., Kroenke, C. H., Laden, F., Pukkala, E., & Schernhammer, E. S. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2005.05.010 · Cited by 482
“First, we conducted the Begg and Mazumdar adjusted rank correlation test for publication bias [24] and generated a Begg plot.”
MethodAngiotensin-receptor blockade and risk of cancer: meta-analysis of randomised controlled trials
Sipahi, I., Debanne, S. M., Rowland, D. Y., Simon, D. I., & Fang, J. C. (2010) · The Lancet Oncology · doi:10.1016/s1470-2045(10)70106-6 · Cited by 481
A review of the relationships between human population density and biodiversity
Luck, G. W. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00028.x · Cited by 479
Darwinian sex roles confirmed across the animal kingdom
Janicke, T., Häderer, I. K., Lajeunesse, M. J., & Anthes, N. (2016) · Science Advances · doi:10.1126/sciadv.1500983 · Cited by 475
Parenting Stress through the Lens of Different Clinical Groups: a Systematic Review & Meta-Analysis
Barroso, N. E., Mendez, L., Graziano, P. A., & Bagner, D. M. (2018) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-017-0313-6 · Cited by 478
Meta-analysis: Subclinical Thyroid Dysfunction and the Risk for Coronary Heart Disease and Mortality
Ochs, N., Auer, R., Bauer, D. C., Nanchen, D., Gussekloo, J., Cornuz, J., & Rodondi, N. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-11-200806030-00225 · Cited by 477
Micha, R., Shulkin, M. L., Peñalvo, J. L., Khatibzadeh, S., Singh, G. M., Rao, M., Fahimi, S., Powles, J., & Mozaffarian, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175149 · Cited by 476
Assendelft, W. J. J., Morton, S. C., Yu, E. I., Suttorp, M. J., & Shekelle, P. G. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-11-200306030-00008 · Cited by 440
Acetylcysteine for prevention of contrast nephropathy: meta-analysis
Birck, R., Krzossok, S., Markowetz, F., Schnülle, P., van der Woude, F. J., & Braun, C. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14189-x · Cited by 477
A Meta-Analysis of Probiotic Efficacy for Gastrointestinal Diseases
Ritchie, M. L., & Romanuk, T. N. (2012) · PLoS ONE · doi:10.1371/journal.pone.0034938 · Cited by 474
The Prognostic Value of Normal Exercise Myocardial Perfusion Imaging and Exercise Echocardiography
Metz, L. D., Beattie, M., Hom, R., Redberg, R. F., Grady, D., & Fleischmann, K. E. (2007) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2006.08.048 · Cited by 471
Armstrong, E. J., Harskamp, C. T., & Armstrong, A. W. (2013) · Journal of the American Heart Association · doi:10.1161/jaha.113.000062 · Cited by 470
Verhagen, M., van der Meij, A., van Deurzen, P. A. M., Janzing, J. G. E., Arias-Vásquez, A., Buitelaar, J. K., & Franke, B. (2010) · Molecular Psychiatry · doi:10.1038/mp.2008.109 · Cited by 470
Liang, M., Gao, L., Cheng, C., Zhou, Q., Uy, J. P., Heiner, K., & Sun, C. (2020) · Travel Medicine and Infectious Disease · doi:10.1016/j.tmaid.2020.101751 · Cited by 470
Viani, G. A., Stefano, E. J., & Afonso, S. L. (2009) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2008.10.091 · Cited by 469
Slade, T., Chapman, C., Swift, W., Keyes, K., Tonks, Z., & Teesson, M. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011827 · Cited by 463
The Association between Time Spent Outdoors and Myopia in Children and Adolescents
Sherwin, J. C., Reacher, M. H., Keogh, R. H., Khawaja, A. P., Mackey, D. A., & Foster, P. J. (2012) · Ophthalmology · doi:10.1016/j.ophtha.2012.04.020 · Cited by 469
Owen, C. G., Martin, R. M., Whincup, P. H., Smith, G. D., & Cook, D. G. (2006) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/84.5.1043 · Cited by 467
Developmental Fluoride Neurotoxicity: A Systematic Review and Meta-Analysis
Choi, A. L., Sun, G., Zhang, Y., & Grandjean, P. (2012) · Environmental Health Perspectives · doi:10.1289/ehp.1104912 · Cited by 468
Owen, C. G., Martin, R. M., Whincup, P. H., Davey-Smith, G., Gillman, M. W., & Cook, D. G. (2005) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/82.6.1298 · Cited by 466
Foroutan, F., Guyatt, G., Zuk, V., Vandvik, P. O., Alba, A. C., Mustafa, R., Vernooij, R., Arevalo-Rodriguez, I., Munn, Z., Roshanov, P., et al. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.12.023 · Cited by 465
Dyadic coping and relationship satisfaction: A meta-analysis
Falconier, M. K., Jackson, J. B., Hilpert, P., & Bodenmann, G. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.07.002 · Cited by 462
Alcohol-Related Risk of Suicidal Ideation, Suicide Attempt, and Completed Suicide: A Meta-Analysis
Darvishi, N., Farhadi, M., Haghtalab, T., & Poorolajal, J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126870 · Cited by 464
Rose, A. K., & Stanley, T. D. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00251.x · Cited by 463
Economou, M., Trikalinos, T. A., Loizou, K. T., Tsianos, E. V., & Ioannidis, J. P. A. (2004) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2004.40304.x · Cited by 465
Empirical Comparison of Publication Bias Tests in Meta-Analysis
Lin, L., Chu, H., Murad, M. H., Hong, C., Qu, Z., Cole, S. R., & Chen, Y. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4425-7 · Cited by 464
de Menthon, M., LaValley, M. P., Maldini, C., Guillevin, L., & Mahr, A. (2009) · Arthritis Care & Research · doi:10.1002/art.24642 · Cited by 462
Endovascular Thrombectomy for Acute Ischemic Stroke: A Meta-analysis
Badhiwala, J. H., Nassiri, F., Alhazzani, W., Selim, M. H., Farrokhyar, F., Spears, J., Kulkarni, A. V., Singh, S., Alqahtani, A., Rochwerg, B., et al. (2015) · JAMA · doi:10.1001/jama.2015.13767 · Cited by 461
The association of telomere length and cancer: a meta-analysis
Wentzensen, I. M., Mirabello, L., Pfeiffer, R. M., & Savage, S. A. (2011) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-11-0005 · Cited by 458
“Begg’s statistical test was used to assess publication bias (42).”
MethodPsoriasis and metabolic syndrome: A systematic review and meta-analysis of observational studies
Armstrong, A. W., Harskamp, C. T., & Armstrong, E. J. (2013) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2012.08.015 · Cited by 459
Mycoplasma genitalium Infection and Female Reproductive Tract Disease: A Meta-analysis
Lis, R., Rowhani-Rahbar, A., & Manhart, L. E. (2015) · Clinical Infectious Diseases · doi:10.1093/cid/civ312 · Cited by 460
Lavia, C., Dallorto, L., Maule, M., Ceccarelli, M., & Fea, A. M. (2017) · PLOS ONE · doi:10.1371/journal.pone.0183142 · Cited by 455
Methods for testing publication bias in ecological and evolutionary meta‐analyses
Nakagawa, S., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Sánchez‐Tójar, A., Yang, Y., & O'Dea, R. E. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13724 · Cited by 399
Buscemi, N., Vandermeer, B., Hooton, N., Pandya, R., Tjosvold, L., Hartling, L., Vohra, S., Klassen, T. P., & Baker, G. (2006) · BMJ · doi:10.1136/bmj.38731.532766.f6 · Cited by 454
McMullan, R. D., Berle, D., Arnáez, S., & Starcevic, V. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.11.037 · Cited by 436
Physical Activity and Mortality in Cancer Survivors: A Systematic Review and Meta-Analysis
Friedenreich, C. M., Stone, C. R., Cheung, W. Y., & Hayes, S. C. (2020) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkz080 · Cited by 453
Chronic Subdural Hematoma Management: A Systematic Review and Meta-analysis of 34829 Patients
Almenawer, S. A., Farrokhyar, F., Hong, C., Alhazzani, W., Manoranjan, B., Yarascavitch, B., Arjmand, P., Baronia, B., Reddy, K., Murty, N., et al. (2014) · Annals of Surgery · doi:10.1097/sla.0000000000000255 · Cited by 451
Singh, S., Singh, P. P., Singh, A. G., Murad, M. H., & Sanchez, W. (2013) · Gastroenterology · doi:10.1053/j.gastro.2012.10.005 · Cited by 452
Erectile Dysfunction and Risk of Cardiovascular Disease
Dong, J.-Y., Zhang, Y.-H., & Qin, L.-Q. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2011.06.024 · Cited by 451
Cumberbatch, M. G., Rota, M., Catto, J. W. F., & La Vecchia, C. (2016) · European Urology · doi:10.1016/j.eururo.2015.06.042 · Cited by 451
Heissel, A., Heinen, D., Brokmeier, L. L., Skarabis, N., Kangas, M., Vancampfort, D., Stubbs, B., Firth, J., Ward, P. B., Rosenbaum, S., et al. (2023) · British Journal of Sports Medicine · doi:10.1136/bjsports-2022-106282 · Cited by 449
The Efficacy and Safety of Drug Treatments for Chronic Insomnia in Adults: A Meta-Analysis of RCTs
Buscemi, N., Vandermeer, B., Friesen, C., Bialy, L., Tubman, M., Ospina, M., Klassen, T. P., & Witmans, M. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0251-z · Cited by 448
Investigating and Dealing with Publication and Other Biases
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch11 · Cited by 449
Wade, T. J., Pai, N., Eisenberg, J. N. S., & Colford, J. M. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.6241 · Cited by 450
Dai, W.-L., Zhou, A.-G., Zhang, H., & Zhang, J. (2017) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2016.09.024 · Cited by 444
Zhao, J., Xu, X., Jiang, H., & Ding, Y. (2020) · BMC Medical Education · doi:10.1186/s12909-020-1994-z · Cited by 445
Farvid, M. S., Sidahmed, E., Spence, N. D., Mante Angua, K., Rosner, B. A., & Barnett, J. B. (2021) · European Journal of Epidemiology · doi:10.1007/s10654-021-00741-9 · Cited by 447
“To evaluate publication bias, we used visual inspection of a funnel plot [40] and the Begg and Mazumdar test [41].”
MethodAbete, I., Romaguera, D., Vieira, A. R., Lopez de Munain, A., & Norat, T. (2014) · British Journal of Nutrition · doi:10.1017/s000711451400124x · Cited by 448
“We assessed publication bias using Egger’s test((33)) and Begg’s test((34)); the results were considered to indicate publication bias when P,0·10((6)).”
PREDATOR HUNTING MODE AND HABITAT DOMAIN ALTER NONCONSUMPTIVE EFFECTS IN PREDATOR–PREY INTERACTIONS
Preisser, E. L., Orrock, J. L., & Schmitz, O. J. (2007) · Ecology · doi:10.1890/07-0260.1 · Cited by 444
Environmental Risk Factors and Parkinson's Disease: A Metaanalysis
Priyadarshi, A., Khuder, S. A., Schaub, E. A., & Priyadarshi, S. S. (2001) · Environmental Research · doi:10.1006/enrs.2001.4264 · Cited by 446
Sazawal, S., & Black, R. E. (2003) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(03)00737-0 · Cited by 444
Arcsine test for publication bias in meta‐analyses with binary outcomes
Rücker, G., Schwarzer, G., & Carpenter, J. (2008) · Statistics in Medicine · doi:10.1002/sim.2971 · Cited by 444
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.