Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 901–1,000 of 1,708
Chen, Y., Wang, X., Wang, J., Yan, Z., & Luo, J. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2012.02.063 · Cited by 248
Abdominal Wall following Free TRAM or DIEP Flap Reconstruction: A Meta-Analysis and Critical Review
Man, L.-X., Selber, J. C., & Serletti, J. M. (2009) · Plastic and Reconstructive Surgery · doi:10.1097/prs.0b013e31818b7533 · Cited by 246
Munafò, M. R., Matheson, I. J., & Flint, J. (2007) · Molecular Psychiatry · doi:10.1038/sj.mp.4001938 · Cited by 249
Cardiovascular safety of sulfonylureas: a meta‐analysis of randomized clinical trials
Monami, M., Genovese, S., & Mannucci, E. (2013) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12116 · Cited by 251
Aggarwal, R., Sentz, J., & Miller, M. A. (2007) · Pediatrics · doi:10.1542/peds.2006-3481 · Cited by 249
Prospective Studies of Dairy Product and Calcium Intakes and Prostate Cancer Risk: A Meta-Analysis
Gao, X., LaValley, M. P., & Tucker, K. L. (2005) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/dji402 · Cited by 249
Wu, N., Xu, B., Xiang, Y., Wu, L., Zhang, Y., Ma, X., Tong, S., Shu, M., Song, Z., Li, Y., et al. (2013) · International Journal of Cardiology · doi:10.1016/j.ijcard.2013.08.078 · Cited by 247
Costa, J., Lunet, N., Santos, C., Santos, J., & Vaz-Carneiro, A. (2010) · Journal of Alzheimer's Disease · doi:10.3233/jad-2010-091525 · Cited by 247
Antipsychotics for Treating Delirium in Hospitalized Adults: A Systematic Review
Nikooie, R., Neufeld, K. J., Oh, E. S., Wilson, L. M., Zhang, A., Robinson, K. A., & Needham, D. M. (2019) · Annals of Internal Medicine · doi:10.7326/m19-1860 · Cited by 246
Zinc in depression: a meta-analysis
Swardfager, W., Herrmann, N., Mazereeuw, G., Goldberger, K., Harimoto, T., & Lanctôt, K. L. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.05.008 · Cited by 246
“Risk of publication bias was assessed visually with funnel plots and quantitatively with Egger’s test (24,25).”
MethodAdiposity and risk of thyroid cancer: A systematic review and meta-analysis
Schmid, D., Ricci, C., Behrens, G., & Leitzmann, M. F. (2015) · Obesity Reviews · doi:10.1111/obr.12321 · Cited by 244
Rosenbaum, S., Stubbs, B., Ward, P. B., Steel, Z., Lederman, O., & Vancampfort, D. (2015) · Metabolism · doi:10.1016/j.metabol.2015.04.009 · Cited by 246
“[25] Begg CB, Mazumdar M.”
MethodWang, Q., Xi, B., Liu, M., Zhang, Y., & Fu, M. (2012) · Hypertension Research · doi:10.1038/hr.2012.91 · Cited by 246
Meta-Analysis: The Effect of Statins on Albuminuria
Douglas, K., O'Malley, P. G., & Jackson, J. L. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-2-200607180-00009 · Cited by 247
Conraths, F. J., Probst, C., Possenti, A., Boufana, B., Saulle, R., La Torre, G., Busani, L., & Casulli, A. (2017) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0005801 · Cited by 246
Monitoring blood glucose control in diabetes mellitus: a systematic review.
Coster, Gulliford, Seed, Powrie, & Swaminathan (2000) · Health Technology Assessment · doi:10.3310/hta4120 · Cited by 245
Hayashino, Y., Jackson, J. L., Hirata, T., Fukumori, N., Nakamura, F., Fukuhara, S., Tsujii, S., & Ishii, H. (2014) · Metabolism · doi:10.1016/j.metabol.2013.08.018 · Cited by 244
Fertility and Women’s Employment: A Meta-analysis: Fécondité et travail des femmes: une méta-analyse
Matysiak, A., & Vignoli, D. (2008) · European Journal of Population / Revue européenne de Démographie · doi:10.1007/s10680-007-9146-2 · Cited by 245
Ibrahim, E. M., Al-Foheidi, M. E., Al-Mansour, M. M., & Kazkaz, G. A. (2014) · Breast Cancer Research and Treatment · doi:10.1007/s10549-014-3185-2 · Cited by 245
“Publication bias was also quantified by the Begg and Mazumdar rank correlation method— Kendall’s tau statistics with continuity correction—that examines the association between the effect estimates and their variances or their standard errors [22].”
MethodThyrotropin and Thyroid Cancer Diagnosis: A Systematic Review and Dose-Response Meta-Analysis
McLeod, D. S. A., Watters, K. F., Carpenter, A. D., Ladenson, P. W., Cooper, D. S., & Ding, E. L. (2012) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2012-1083 · Cited by 243
Pooled Analysis and Meta-analysis of Glutathione S-Transferase M1 and Bladder Cancer: A HuGE Review
Engel, L. S. (2002) · American Journal of Epidemiology · doi:10.1093/aje/kwf018 · Cited by 245
Effects of stress on decisions under uncertainty: A meta-analysis.
Starcke, K., & Brand, M. (2016) · Psychological Bulletin · doi:10.1037/bul0000060 · Cited by 244
Häuser, W., Kosseva, M., Üceyler, N., Klose, P., & Sommer, C. (2011) · Arthritis Care & Research · doi:10.1002/acr.20328 · Cited by 244
Physical Activity and the Risk of Preeclampsia: A Systematic Review and Meta-Analysis
Aune, D., Saugstad, O. D., Henriksen, T., & Tonstad, S. (2014) · Epidemiology · doi:10.1097/ede.0000000000000036 · Cited by 244
Sensitivity to reward and punishment in eating disorders
Harrison, A., O'Brien, N., Lopez, C., & Treasure, J. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2009.06.010 · Cited by 244
“The presence of publication bias was assessed by visual inspection of funnel plots and corroborated by Egger's (Egger et al., 1997) and Begg's adjusted rank test (Begg and Mazumdar, 1994) and implemented in metabias.”
MethodSud, S., Sud, M., Friedrich, J. O., Meade, M. O., Ferguson, N. D., Wunsch, H., & Adhikari, N. K. J. (2010) · BMJ · doi:10.1136/bmj.c2327 · Cited by 246
Parkinson’s disease and cancer risk: a systematic review and meta-analysis
Bajaj, A., Driver, J. A., & Schernhammer, E. S. (2010) · Cancer Causes & Control · doi:10.1007/s10552-009-9497-6 · Cited by 244
Frolkis, A. D., Lipton, D. S., Fiest, K. M., Negrón, M. E., Dykeman, J., deBruyn, J., Jette, N., Frolkis, T., Rezaie, A., Seow, C. H., et al. (2014) · American Journal of Gastroenterology · doi:10.1038/ajg.2014.297 · Cited by 243
Cumberbatch, M. G. K., Cox, A., Teare, D., & Catto, J. W. F. (2015) · JAMA Oncology · doi:10.1001/jamaoncol.2015.3209 · Cited by 242
The Effects of Family Therapies for Adolescent Delinquency and Substance Abuse: A Meta‐analysis
Baldwin, S. A., Christian, S., Berkeljon, A., & Shadish, W. R. (2012) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.2011.00248.x · Cited by 244
“…assess for publication bias with funnel plots (Peters, Sutton, Jones, Abrams, & Ruston, 2008; Sterne & Harbord, 2004), Begg’s rank correlation test (Begg & Mazumdar, 1994), and Egger’s regression test (Egger, Smith, Schnieder, & Minder, 1997), trim-and-fill analysis (Duval & Tweedie, 2000a,b),…”
Linking personality and cognition: a meta-analysis
Dougherty, L. R., & Guillette, L. M. (2018) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2017.0282 · Cited by 243
Trabert, B., Ness, R. B., Lo-Ciganic, W.-H., Murphy, M. A., Goode, E. L., Poole, E. M., Brinton, L. A., Webb, P. M., Nagle, C. M., Jordan, S. J., et al. (2014) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djt431 · Cited by 243
Brownrigg, J. R. W., Davey, J., Holt, P. J., Davis, W. A., Thompson, M. M., Ray, K. K., & Hinchliffe, R. J. (2012) · Diabetologia · doi:10.1007/s00125-012-2673-3 · Cited by 243
“To assess publication bias, we produced a funnel plot with its statistical analogue, the Begg-adjusted rank correlation test [6], and performed Egger’s regression asymmetry test [7].”
MethodHorikawa, C., Kodama, S., Yachi, Y., Heianza, Y., Hirasawa, R., Ibe, Y., Saito, K., Shimano, H., Yamada, N., & Sone, H. (2011) · Preventive Medicine · doi:10.1016/j.ypmed.2011.08.030 · Cited by 243
Benishek, L. A., Dugosh, K. L., Kirby, K. C., Matejkowski, J., Clements, N. T., Seymour, B. L., & Festinger, D. S. (2014) · Addiction · doi:10.1111/add.12589 · Cited by 242
Chen, Y., Liu, L., Wang, X., Wang, J., Yan, Z., Cheng, J., Gong, G., & Li, G. (2013) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-13-0042 · Cited by 243
Altobelli, E., Rapacchietta, L., Profeta, V. F., & Fagnano, R. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15122805 · Cited by 240
del-Pino-Casado, R., Rodríguez Cardosa, M., López-Martínez, C., & Orgeta, V. (2019) · PLOS ONE · doi:10.1371/journal.pone.0217648 · Cited by 238
Signaling text-picture relations in multimedia learning: A comprehensive meta-analysis
Richter, J., Scheiter, K., & Eitel, A. (2016) · Educational Research Review · doi:10.1016/j.edurev.2015.12.003 · Cited by 242
Garlic consumption and cancer prevention: meta-analyses of colorectal and stomach cancers
Fleischauer, A. T., Poole, C., & Arab, L. (2000) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/72.4.1047 · Cited by 242
Zhang, X., Li, Y., Del Gobbo, L. C., Rosanoff, A., Wang, J., Zhang, W., & Song, Y. (2016) · Hypertension · doi:10.1161/hypertensionaha.116.07664 · Cited by 242
“Publication bias was evaluated first by visual inspection of the funnel plots and then by Begg adjusted rank correlation test.(18) A restricted cubic spline regression analysis was performed to assess possible dose and time responses of BPs and serum Mg to Mg supplementation.”
MethodBahji, A., Mazhar, M. N., Hudson, C. C., Nadkarni, P., MacNeil, B. A., & Hawken, E. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.01.007 · Cited by 241
Vitamin D treatment for the prevention of falls in older adults: systematic review and meta-analysis
Kalyani, R. R., Stein, B., Valiyil, R., Manno, R., Maynard, J. W., & Crews, D. C. (2010) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2010.02949.x · Cited by 241
Hooper, L., Brown, T. J., Elliott, R., Payne, K., Roberts, C., & Symmons, D. (2004) · BMJ · doi:10.1136/bmj.38232.680567.eb · Cited by 244
Zhang, Z.-J., Zheng, Z.-J., Shi, R., Su, Q., Jiang, Q., & Kip, K. E. (2012) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2012-1267 · Cited by 241
Parasite infection and host group size: a meta-analytical review
PATTERSON, J. E. H., & RUCKSTUHL, K. E. (2013) · Parasitology · doi:10.1017/s0031182012002259 · Cited by 240
Niven, D. J., Gaudet, J. E., Laupland, K. B., Mrklas, K. J., Roberts, D. J., & Stelfox, H. T. (2015) · Annals of Internal Medicine · doi:10.7326/m15-1150 · Cited by 240
The association between teacher leadership and student achievement: A meta-analysis
Shen, J., Wu, H., Reeves, P., Zheng, Y., Ryan, L., & Anderson, D. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100357 · Cited by 238
Monami, M., Nreu, B., Scatena, A., Cresci, B., Andreozzi, F., Sesti, G., & Mannucci, E. (2017) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12926 · Cited by 243
“In order to estimate possible publication/disclosure bias we used funnel plots and the Begg adjusted rank correlation test (31, 32), including published and unpublished, but disclosed, trials.”
MethodSudden gains during psychological treatments of anxiety and depression: A meta-analysis
Aderka, I. M., Nickerson, A., Bøe, H. J., & Hofmann, S. G. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0026455 · Cited by 240
Pentoxifylline for treating venous leg ulcers
Jull, A. B., Arroll, B., Parag, V., & Waters, J. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001733.pub3 · Cited by 231
Isoniazid Preventive Therapy and Risk for Resistant Tuberculosis
Balcells, M. E., Thomas, S. L., Godfrey-Faussett, P., & Grant, A. D. (2006) · Emerging Infectious Diseases · doi:10.3201/eid1205.050681 · Cited by 238
Sipahi, I., Akay, M. H., Dagdelen, S., Blitz, A., & Alhan, C. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.12844 · Cited by 239
Tekelab, T., Chojenta, C., Smith, R., & Loxton, D. (2019) · PLOS ONE · doi:10.1371/journal.pone.0222566 · Cited by 236
Climate warming promotes pesticide resistance through expanding overwintering range of a global pest
Ma, C.-S., Zhang, W., Peng, Y., Zhao, F., Chang, X.-Q., Xing, K., Zhu, L., Ma, G., Yang, H.-P., & Rudolf, V. H. W. (2021) · Nature Communications · doi:10.1038/s41467-021-25505-7 · Cited by 236
Lomas, T., Medina, J. C., Ivtzan, I., Rupprecht, S., & Eiroa-Orosa, F. J. (2019) · The Journal of Positive Psychology · doi:10.1080/17439760.2018.1519588 · Cited by 236
The Psychology of Replication and Replication in Psychology
Francis, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459520 · Cited by 238
“This probability is below the .1 criterion that is typically used to indicate publication bias (Begg & Mazumdar, 1994; Ioannidis & Trikalinos, 2007; Sterne, Gavaghan, & Egger, 2000).”
MethodDiabetes mellitus and risk of hip fractures: a meta-analysis
Fan, Y., Wei, F., Lang, Y., & Liu, Y. (2016) · Osteoporosis International · doi:10.1007/s00198-015-3279-7 · Cited by 237
Stubbs, B., Vancampfort, D., De Hert, M., & Mitchell, A. J. (2015) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12439 · Cited by 238
Paige, N. M., Miake-Lye, I. M., Booth, M. S., Beroes, J. M., Mardian, A. S., Dougherty, P., Branson, R., Tang, B., Morton, S. C., & Shekelle, P. G. (2017) · JAMA · doi:10.1001/jama.2017.3086 · Cited by 238
Guzeller, C. O., & Celiker, N. (2019) · International Journal of Culture, Tourism and Hospitality Research · doi:10.1108/ijcthr-05-2019-0094 · Cited by 234
Schuch, F. B., Vancampfort, D., Rosenbaum, S., Richards, J., Ward, P. B., Veronese, N., Solmi, M., Cadore, E. L., & Stubbs, B. (2016) · Revista Brasileira de Psiquiatria · doi:10.1590/1516-4446-2016-1915 · Cited by 226
Cheng, W., Zhang, Z., Cheng, W., Yang, C., Diao, L., & Liu, W. (2018) · European Journal of Preventive Cardiology · doi:10.1177/2047487318795194 · Cited by 221
Kosiba, J. D., Maisto, S. A., & Ditre, J. W. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.06.005 · Cited by 237
“The Begg-Mazumdar (Kendall's tau) rank correlation test and Egger's test were used to further probe for publication bias, by testing statistical significance of observed asymmetry in the relationship between study size and magnitude of the observed prevalence rate (Egger et al., 1997; Begg and Mazumdar, 1994).”
MethodAlcohol and Condom Use: A Meta-Analysis of Event-Level Studies
LEIGH, B. C. (2002) · Sexually Transmitted Diseases · doi:10.1097/00007435-200208000-00008 · Cited by 236
Gartlehner, G., Gaynes, B. N., Hansen, R. A., Thieda, P., DeVeaugh-Geiss, A., Krebs, E. E., Moore, C. G., Morgan, L., & Lohr, K. N. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-10-200811180-00008 · Cited by 237
Soberon, F., & Van Amburgh, M. E. (2013) · Journal of Animal Science · doi:10.2527/jas.2012-5834 · Cited by 237
Do Animals Living in Larger Groups Experience Greater Parasitism? A Meta-Analysis
Rifkin, J. L., Nunn, C. L., & Garamszegi, L. Z. (2012) · The American Naturalist · doi:10.1086/666081 · Cited by 237
Madewell, Z. J., Yang, Y., Longini, I. M., Halloran, M. E., & Dean, N. E. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.9317 · Cited by 236
Maternal smoking during pregnancy and offspring obesity: meta-analysis
Ino, T. (2010) · Pediatrics International · doi:10.1111/j.1442-200x.2009.02883.x · Cited by 236
Brooks, S., Prince, A., Stahl, D., Campbell, I. C., & Treasure, J. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.006 · Cited by 236
Kshirsagar, A. V., Poole, C., Mottl, A., Shoham, D., Franceschini, N., Tudor, G., Agrawal, M., Denu-Ciocca, C., Magnus Ohman, E., & Finn, W. F. (2004) · Journal of the American Society of Nephrology · doi:10.1097/01.asn.0000116241.47678.49 · Cited by 238
Vassos, E., Collier, D. A., & Fazel, S. (2014) · Molecular Psychiatry · doi:10.1038/mp.2013.31 · Cited by 234
Infectious agents associated with schizophrenia: A meta-analysis
Arias, I., Sorlozano, A., Villegas, E., Luna, J. D. D., McKenney, K., Cervilla, J., Gutierrez, B., & Gutierrez, J. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2011.10.026 · Cited by 235
Review of methodology of quantitative reviews using meta‐analysis in ecology
Gates, S. (2002) · Journal of Animal Ecology · doi:10.1046/j.1365-2656.2002.00634.x · Cited by 235
ABO Blood Group and Risk of Coronary Heart Disease in Two Prospective Cohort Studies
He, M., Wolpin, B., Rexrode, K., Manson, J. E., Rimm, E., Hu, F. B., & Qi, L. (2012) · Arteriosclerosis, Thrombosis, and Vascular Biology · doi:10.1161/atvbaha.112.248757 · Cited by 235
Kastrati, A., Dibra, A., & Eberle, S. (2005) · ACC Current Journal Review · doi:10.1016/j.accreview.2005.10.047 · Cited by 235
Selenium Exposure and Cancer Risk: an Updated Meta-analysis and Meta-regression
Cai, X., Wang, C., Yu, W., Fan, W., Wang, S., Shen, N., Wu, P., Li, X., & Wang, F. (2016) · Scientific Reports · doi:10.1038/srep19213 · Cited by 236
Aune, D., Feng, T., Schlesinger, S., Janszky, I., Norat, T., & Riboli, E. (2018) · Journal of Diabetes and its Complications · doi:10.1016/j.jdiacomp.2018.02.004 · Cited by 234
Saghazadeh, A., Ataeinia, B., Keynejad, K., Abdolalizadeh, A., Hirbod-Mobarakeh, A., & Rezaei, N. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.05.019 · Cited by 235
Armstrong, A. W., Harskamp, C. T., & Armstrong, E. J. (2013) · Journal of Hypertension · doi:10.1097/hjh.0b013e32835bcce1 · Cited by 235
“Publication bias was assessed using visual inspection of a funnel plot of the study size versus standard error, with formal statistical testing using the Begg adjusted rank correlation test [33,34].”
MethodIncreased Risk of High-Grade Hypertension With Bevacizumab in Cancer Patients: A Meta-Analysis
Ranpura, V., Pulipati, B., Chu, D., Zhu, X., & Wu, S. (2010) · American Journal of Hypertension · doi:10.1038/ajh.2010.25 · Cited by 235
Figueiredo, F. E. D., Martins-Filho, P. R. S., & Faria-e-Silva, A. L. (2015) · Journal of Endodontics · doi:10.1016/j.joen.2014.10.006 · Cited by 234
Benjamin, D. K., Poole, C., Steinbach, W. J., Rowen, J. L., & Walsh, T. J. (2003) · Pediatrics · doi:10.1542/peds.112.3.634 · Cited by 236
Puli, S. R., Bechtold, M. L., Reddy, J. B. K., Choudhary, A., Antillon, M. R., & Brugge, W. R. (2009) · Annals of Surgical Oncology · doi:10.1245/s10434-008-0231-5 · Cited by 235
Soy Food Consumption and Risk of Prostate Cancer: A Meta-Analysis of Observational Studies
Hwang, Y. W., Kim, S. Y., Jee, S. H., Kim, Y. N., & Nam, C. M. (2009) · Nutrition and Cancer · doi:10.1080/01635580902825639 · Cited by 234
“The possibility of publication bias was assessed using the Egger test and visual inspection of a funnel plot (18,19).”
MethodCamargo, M. C., Mera, R., Correa, P., Peek, R. M., Fontham, E. T. H., Goodman, K. J., Piazuelo, M. B., Sicinschi, L., Zabaleta, J., & Schneider, B. G. (2006) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-06-0189 · Cited by 234
“For each polymorphism, publication bias was evaluated by the Begg’s and Egger’s funnel plot asymmetry tests (46, 47).”
MethodLi, X., You, R., Wang, X., Liu, C., Xu, Z., Zhou, J., Yu, B., Xu, T., Cai, H., & Zou, Q. (2016) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-15-1465 · Cited by 234
Kim, S. R., Kim, K., Lee, S. A., Kwon, S. O., Lee, J.-K., Keum, N., & Park, S. M. (2019) · Nutrients · doi:10.3390/nu11040826 · Cited by 232
Lee, Y., Lui, L. M. W., Chen-Li, D., Liao, Y., Mansur, R. B., Brietzke, E., Rosenblat, J. D., Ho, R., Rodrigues, N. B., Lipsitz, O., et al. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.04.050 · Cited by 234
Sehgal, I. S., Dhooria, S., Ram, B., Singh, N., Aggarwal, A. N., Gupta, D., Behera, D., & Agarwal, R. (2015) · Respiratory Care · doi:10.4187/respcare.03976 · Cited by 230
Shuper, P. A., Joharchi, N., Irving, H., & Rehm, J. (2009) · AIDS and Behavior · doi:10.1007/s10461-009-9589-z · Cited by 232
Wu, H.-Y., Huang, J.-W., Lin, H.-J., Liao, W.-C., Peng, Y.-S., Hung, K.-Y., Wu, K.-D., Tu, Y.-K., & Chien, K.-L. (2013) · BMJ · doi:10.1136/bmj.f6008 · Cited by 233
Trépo, E., Nahon, P., Bontempi, G., Valenti, L., Falleti, E., Nischalke, H.-D., Hamza, S., Corradini, S. G., Burza, M. A., Guyot, E., et al. (2014) · Hepatology · doi:10.1002/hep.26767 · Cited by 233
“To assess the extent of publication bias, Egger’s and the Begg and Mazumdar’s tests were used on unadjusted analyses.(34,36) A P value less than 0.”
MethodBonovas, S., Filioussi, K., Tsavaris, N., & Sitaras, N. M. (2005) · Journal of Clinical Oncology · doi:10.1200/jco.2005.02.7045 · Cited by 233
Posttraumatic growth and adjustment among individuals with cancer or HIV/AIDS: A meta-analysis
Sawyer, A., Ayers, S., & Field, A. P. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.02.004 · Cited by 230
Crumley, J. J., Stetler, C. A., & Horhota, M. (2014) · Psychology and Aging · doi:10.1037/a0035908 · Cited by 232
Text Messaging-Based Interventions for Smoking Cessation: A Systematic Review and Meta-Analysis
Scott-Sheldon, L. A. J., Lantini, R., Jennings, E. G., Thind, H., Rosen, R. K., Salmoirago-Blotcher, E., & Bock, B. C. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5436 · Cited by 231
Corona, G., Pizzocaro, A., Vena, W., Rastrelli, G., Semeraro, F., Isidori, A. M., Pivonello, R., Salonia, A., Sforza, A., & Maggi, M. (2021) · Reviews in Endocrine and Metabolic Disorders · doi:10.1007/s11154-021-09630-8 · Cited by 232
Hospitalisation rates and predictors in people with dementia: a systematic review and meta-analysis
Shepherd, H., Livingston, G., Chan, J., & Sommerlad, A. (2019) · BMC Medicine · doi:10.1186/s12916-019-1369-7 · Cited by 232
“10 indicating risk of publication bias [15], using STATA 14.”
Method
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.