Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 1,001–1,100 of 1,710
Relationship Between Helicobacter pylori Infection and Esophageal Neoplasia: A Meta-analysis
Rokkas, T., Pistiolas, D., Sechopoulos, P., Robotis, I., & Margantinis, G. (2007) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2007.08.010 · Cited by 232
Exposure to particulate matter and adverse birth outcomes: a comprehensive review and meta-analysis
Sapkota, A., Chelikowsky, A. P., Nachman, K. E., Cohen, A. J., & Ritz, B. (2012) · Air Quality, Atmosphere & Health · doi:10.1007/s11869-010-0106-3 · Cited by 231
“Publication bias was evaluated with both the Begg's and the Egger's tests (Begg and Mazumdar 1994; Egger et al. 1997).”
MethodKoreth, J., Cutler, C. S., Djulbegovic, B., Behl, R., Schlossman, R. L., Munshi, N. C., Richardson, P. G., Anderson, K. C., Soiffer, R. J., & Alyea, E. P. (2007) · Biology of Blood and Marrow Transplantation · doi:10.1016/j.bbmt.2006.09.010 · Cited by 230
Central coherence in eating disorders: a systematic review
Lopez, C., Tchanturia, K., Stahl, D., & Treasure, J. (2008) · Psychological Medicine · doi:10.1017/s0033291708003486 · Cited by 230
“The presence of publication bias was assessed informally by visual inspection of funnel plots that were corroborated by its corresponding statistical analogue, Begg’s adjusted rank test (Begg & Mazumdar, 1994), and additionally by Egger’s test (Egger et al. 1997) as implemented in metabias.”
MethodDietary fiber and breast cancer risk: a systematic review and meta-analysis of prospective studies
Aune, D., Chan, D. S. M., Greenwood, D. C., Vieira, A. R., Rosenblatt, D. A. N., Vieira, R., & Norat, T. (2012) · Annals of Oncology · doi:10.1093/annonc/mdr589 · Cited by 230
“[44] with results considered to indicate potential small-study bias when P < 0.”
BackgroundThe five factor model of personality and emotion regulation: A meta-analysis
Barańczuk, U. (2019) · Personality and Individual Differences · doi:10.1016/j.paid.2018.11.025 · Cited by 225
Macadam, S. A., Gandhi, R., Bezuhly, M., & Lefaivre, K. A. (2008) · The Journal of Hand Surgery · doi:10.1016/j.jhsa.2008.03.006 · Cited by 228
Iguacel, I., Miguel-Berges, M. L., Gómez-Bruton, A., Moreno, L. A., & Julián, C. (2019) · Nutrition Reviews · doi:10.1093/nutrit/nuy045 · Cited by 222
Interventions for generalized anxiety disorder in older adults: Systematic review and meta-analysis
Gonçalves, D. C., & Byrne, G. J. (2012) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2011.08.010 · Cited by 227
Social anxiety and internet use – a meta-analysis: what do we know? What are we missing?
Prizant-Passal, S., Shechner, T., & Aderka, I. M. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.04.003 · Cited by 227
Meta-analysis of gene–environment interactions in developmental psychopathology
Taylor, A., & Kim-Cohen, J. (2007) · Development and Psychopathology · doi:10.1017/s095457940700051x · Cited by 227
Water, sanitation and hygiene interventions to combat childhood diarrhoea in developing countries
(3ie), I. I. F. I. E., Waddington, H., Snilstveit, B., (3ie), I. I. F. I. E., White, H., (3ie), I. I. F. I. E., Fewtrell, L., & Aberystwyth University (2012) · doi:10.23846/sr0017 · Cited by 227
“However, we note that the statistical tests used are inconclusive given they are at best only moderately powered under the present study sample sizes (Begg and Mazumdar, 1994), and the substantial heterogeneity in context across studies.”
MethodChiavaroli, L., Nishi, S. K., Khan, T. A., Braunstein, C. R., Glenn, A. J., Mejia, S. B., Rahelić, D., Kahleová, H., Salas-Salvadó, J., Jenkins, D. J. A., et al. (2018) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2018.05.004 · Cited by 226
Dong, J.-Y., Qin, L.-Q., Zhang, Z., Zhao, Y., Wang, J., Arigoni, F., & Zhang, W. (2011) · American Heart Journal · doi:10.1016/j.ahj.2011.09.012 · Cited by 227
Grant, S., Colaiaco, B., Motala, A., Shanman, R., Booth, M., Sorbero, M., & Hempel, S. (2017) · Journal of Addiction Medicine · doi:10.1097/adm.0000000000000338 · Cited by 220
Williams, R. M., Puetz, T. W., Giza, C. C., & Broglio, S. P. (2015) · Sports Medicine · doi:10.1007/s40279-015-0325-8 · Cited by 226
Kodama, S., Horikawa, C., Fujihara, K., Heianza, Y., Hirasawa, R., Yachi, Y., Sugawara, A., Tanaka, S., Shimano, H., Iida, K. T., et al. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kws172 · Cited by 226
Vancampfort, D., Rosenbaum, S., Schuch, F. B., Ward, P. B., Probst, M., & Stubbs, B. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.11.008 · Cited by 225
Cardiorespiratory fitness in severe mental illness: a systematic review and meta-analysis
Vancampfort, D., Rosenbaum, S., Schuch, F., Ward, P. B., Richards, J., Mugisha, J., Probst, M., & Stubbs, B. (2017) · Sports Medicine · doi:10.1007/s40279-016-0574-1 · Cited by 224
van Vulpen, J. K., Peeters, P. H. M., Velthuis, M. J., van der Wall, E., & May, A. M. (2016) · Maturitas · doi:10.1016/j.maturitas.2015.12.007 · Cited by 223
Owen, C. G., Whincup, P. H., Gilg, J. A., & Cook, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7425.1189 · Cited by 223
Boffetta, P., & Straif, K. (2009) · BMJ · doi:10.1136/bmj.b3060 · Cited by 222
Qian, F., Korat, A. A., Malik, V., & Hu, F. B. (2016) · Diabetes Care · doi:10.2337/dc16-0513 · Cited by 222
“Publication bias was assessed visually with funnel plots and with Egger and Begg-Mazudumar regression tests (11,12).”
MethodWakefield, S., Kellett, S., Simmonds‐Buckley, M., Stockton, D., Bradbury, A., & Delgadillo, J. (2021) · British Journal of Clinical Psychology · doi:10.1111/bjc.12259 · Cited by 222
Dietary patterns and colorectal cancer: systematic review and meta-analysis
Magalhães, B., Peleteiro, B., & Lunet, N. (2012) · European Journal of Cancer Prevention · doi:10.1097/cej.0b013e3283472241 · Cited by 222
“Publication bias was examined through visual inspection of the funnel plots, the Begg adjusted rank correlation test (Begg and Mazumdar, 1994) and the Egger regression asymmetry test (Egger et al., 1997).”
MethodZhu, Y., Bo, Y., & Liu, Y. (2019) · Lipids in Health and Disease · doi:10.1186/s12944-019-1035-2 · Cited by 222
Stimulant Medication and Substance Use Outcomes: A Meta-analysis
Humphreys, K. L., Eng, T., & Lee, S. S. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.1273 · Cited by 221
Reboussin, D. M., Allen, N. B., Griswold, M. E., Guallar, E., Hong, Y., Lackland, D. T., Miller, E. (. R., Polonsky, T., Thompson-Paul, A. M., & Vupputuri, S. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2017.11.004 · Cited by 221
“We used the Begg rank correlation test to calculate Kendall’s Tau and p value to examine funnel plot asymmetry (53).”
MethodLang, B. H.-H., Ng, S.-H., Lau, L. L. H., Cowling, B. J., Wong, K. P., & Wan, K. Y. (2013) · Thyroid · doi:10.1089/thy.2012.0608 · Cited by 221
Jiang, Y., Ben, Q., Shen, H., Lu, W., Zhang, Y., & Zhu, J. (2011) · European Journal of Epidemiology · doi:10.1007/s10654-011-9617-y · Cited by 221
Burström, L., Nilsson, T., & Wahlström, J. (2015) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-014-0971-4 · Cited by 221
Differential Effects of Exercise on Cancer-Related Fatigue During and Following Treatment
Puetz, T. W., & Herring, M. P. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.04.027 · Cited by 219
Manual versus powered toothbrushing for oral health
Heanue, M., Deacon, S., Deery, C., Robinson, P., Walmsley, A., Worthington, H., & Shaw, W. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002281 · Cited by 220
Facial emotion perception in depression and bipolar disorder: A quantitative review
Kohler, C. G., Hoffman, L. J., Eastman, L. B., Healey, K., & Moberg, P. J. (2011) · Psychiatry Research · doi:10.1016/j.psychres.2011.04.019 · Cited by 220
Jiyad, Z., Olsen, C. M., Burke, M. T., Isbel, N. M., & Green, A. C. (2016) · American Journal of Transplantation · doi:10.1111/ajt.13863 · Cited by 219
“Publication bias was assessed by visual inspection of funnel plots and the Begg and Egger tests (34,35).”
MethodRodakowski, J., Rocco, P. B., Ortiz, M., Folb, B., Schulz, R., Morton, S. C., Leathers, S. C., Hu, L., & James, A. E. (2017) · Journal of the American Geriatrics Society · doi:10.1111/jgs.14873 · Cited by 219
Dong, Y., Zhou, J., Zhu, Y., Luo, L., He, T., Hu, H., Liu, H., Zhang, Y., Luo, D., Xu, S., et al. (2017) · Bioscience Reports · doi:10.1042/bsr20170945 · Cited by 219
How to conduct a meta-analysis in eight steps: A practical guide
Hansen, C., Steinmetz, H., & Block, J. (2022) · Management Review Quarterly · doi:10.1007/s11301-021-00247-4 · Cited by 218
Hariyanto, T. I., Japar, K. V., Kwenandar, F., Damay, V., Siregar, J. I., Lugito, N. P. H., Tjiang, M. M., & Kurniawan, A. (2021) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2020.12.076 · Cited by 218
Machado, M., Bajcar, J., Guzzo, G. C., & Einarson, T. R. (2007) · Annals of Pharmacotherapy · doi:10.1345/aph.1k151 · Cited by 218
Mao, Y., Qu, Q., Zhang, Y., Liu, J., Chen, X., & Shen, K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115103 · Cited by 218
Zhan, J., Liu, Y.-J., Cai, L.-B., Xu, F.-R., Xie, T., & He, Q.-Q. (2017) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2015.1008980 · Cited by 217
Corona, G., Giagulli, V. A., Maseroli, E., Vignozzi, L., Aversa, A., Zitzmann, M., Saad, F., Mannucci, E., & Maggi, M. (2016) · European Journal of Endocrinology · doi:10.1530/eje-15-0262 · Cited by 217
Kodama, S., Tanaka, S., Heianza, Y., Fujihara, K., Horikawa, C., Shimano, H., Saito, K., Yamada, N., Ohashi, Y., & Sone, H. (2013) · Diabetes Care · doi:10.2337/dc12-0783 · Cited by 212
A century of research on conscientiousness at work
Wilmot, M. P., & Ones, D. S. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1908430116 · Cited by 215
Publication bias as a threat to the validity of meta-analytic results
Rothstein, H. R. (2008) · Journal of Experimental Criminology · doi:10.1007/s11292-007-9046-9 · Cited by 216
Vlietstra, L., Hendrickx, W., & Waters, D. L. (2018) · Australasian Journal on Ageing · doi:10.1111/ajag.12521 · Cited by 216
Iftikhar, I. H., Valentine, C. W., Bittencourt, L. R. A., Cohen, D. L., Fedson, A. C., Gíslason, T., Penzel, T., Phillips, C. L., Yu-sheng, L., Pack, A. I., et al. (2014) · Journal of Hypertension · doi:10.1097/hjh.0000000000000372 · Cited by 215
“Publication bias was assessed with the construction of a funnel plot, and further assessed by Eggers test of the intercept and the Begg and Mazumdar rank correlation test [27].”
MethodMeta-analysis of cannabis based treatments for neuropathic and multiple sclerosis-related pain
Iskedjian, M., Bereza, B., Gordon, A., Piwko, C., & Einarson, T. R. (2007) · Current Medical Research and Opinion · doi:10.1185/030079906x158066 · Cited by 216
Nguyen, S. P., Bent, S., Chen, Y.-H., & Terdiman, J. P. (2009) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2009.01.008 · Cited by 216
Wu, Q. J., Yang, Y., Vogtmann, E., Wang, J., Han, L. H., Li, H. L., & Xiang, Y. B. (2013) · Annals of Oncology · doi:10.1093/annonc/mds601 · Cited by 216
Ncube, C. N., Enquobahrie, D. A., Albert, S. M., Herrick, A. L., & Burke, J. G. (2016) · Social Science & Medicine · doi:10.1016/j.socscimed.2016.02.014 · Cited by 216
“Publication bias was examined using the Egger's regression asymmetry test (Egger et al., 1997) and Begg's adjusted rank correlation test (Begg and Mazumdar, 1994).”
Cucchi, A., Ryan, D., Konstantakopoulos, G., Stroumpa, S., Kaçar, A. Ş., Renshaw, S., Landau, S., & Kravariti, E. (2016) · Psychological Medicine · doi:10.1017/s0033291716000027 · Cited by 216
“The presence of publication bias was examined using tests for asymmetry proposed by Begg & Mazumdar (1994).”
MethodNuñez, N. A., Joseph, B., Pahwa, M., Kumar, R., Resendez, M. G., Prokop, L. J., Veldic, M., Seshadri, A., Biernacka, J. M., Frye, M. A., et al. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.12.134 · Cited by 215
A Systematic Review and Meta-Analysis of Magnetic Resonance Imaging Studies in Late-Life Depression
Sexton, C. E., Mackay, C. E., & Ebmeier, K. P. (2013) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2012.10.019 · Cited by 210
Kim, Y., & Je, Y. (2016) · Archives of Cardiovascular Diseases · doi:10.1016/j.acvd.2015.09.005 · Cited by 212
Chiavaroli, L., Lee, D., Ahmed, A., Cheung, A., Khan, T. A., Blanco, S., Mejia, Mirrahimi, A., Jenkins, D. J. A., Livesey, G., et al. (2021) · BMJ · doi:10.1136/bmj.n1651 · Cited by 215
Thompson, A. M. (2011) · JAMA · doi:10.1001/jama.2011.250 · Cited by 215
Cigarette Smoking and the Risk of Colorectal Cancer: A Meta-analysis of Prospective Cohort Studies
Tsoi, K. K. F., Pau, C. Y. Y., Wu, W. K. K., Chan, F. K. L., Griffiths, S., & Sung, J. J. Y. (2009) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2009.02.016 · Cited by 215
Su, C., Lichtenstein, G. R., Krok, K., Brensinger, C. M., & Lewis, J. D. (2004) · Gastroenterology · doi:10.1053/j.gastro.2004.01.024 · Cited by 212
Foy, R., Hempel, S., Rubenstein, L., Suttorp, M., Seelig, M., Shanman, R., & Shekelle, P. G. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-4-201002160-00010 · Cited by 214
“We examined publication bias by using the Begg rank correlation test (43) and the Egger regression asymmetry test (44).”
MethodPublication bias and the failure of replication in experimental psychology
Francis, G. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0322-y · Cited by 213
“As a compromise between these competing demands, tests of publication bias frequently use a criterion of .1 (Begg & Mazumdar, 1994; Ioannidis & Trikalinos, 2007; Sterne, Gavaghan, & Egger, 2000).”
MethodStockwell, S., Schofield, P., Fisher, A., Firth, J., Jackson, S. E., Stubbs, B., & Smith, L. (2019) · Experimental Gerontology · doi:10.1016/j.exger.2019.02.020 · Cited by 212
“Second, the Begg-Mazumdar Kendall's tau (Begg and Mazumdar, 1994) and Egger bias test (Egger et al., 1997) to quantify publication bias were calculated.”
Antecedents and Effects of Parasocial Relationships: A Meta-Analysis
Tukachinsky, R., Walter, N., & Saucier, C. J. (2020) · Journal of Communication · doi:10.1093/joc/jqaa034 · Cited by 212
Kumagai, K., Rouvelas, I., Tsai, J. A., Mariosa, D., Klevebro, F., Lindblad, M., Ye, W., Lundell, L., & Nilsson, M. (2014) · British Journal of Surgery · doi:10.1002/bjs.9418 · Cited by 212
Ahmed Ali, U., Keus, F., Heikens, J. T., Bemelman, W. A., Berdah, S. V., Gooszen, H. G., & van Laarhoven, C. J. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006267.pub2 · Cited by 212
Rygård, S. L., Butler, E., Granholm, A., Møller, M. H., Cohen, J., Finfer, S., Perner, A., Myburgh, J., Venkatesh, B., & Delaney, A. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5197-6 · Cited by 211
Alcohol intake and colorectal cancer risk: A dose–response meta‐analysis of published cohort studies
Moskal, A., Norat, T., Ferrari, P., & Riboli, E. (2007) · International Journal of Cancer · doi:10.1002/ijc.22299 · Cited by 210
Subclinical Hypothyroidism and the Risk of Coronary Heart Disease: A Meta-Analysis
Rodondi, N., Aujesky, D., Vittinghoff, E., Cornuz, J., & Bauer, D. C. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.09.028 · Cited by 209
Dietary patterns and colorectal cancer
Tayyem, R. F., Bawadi, H. A., Shehadah, I., Agraib, L. M., AbuMweis, S. S., Al-Jaberi, T., Al-Nusairr, M., Bani-Hani, K. E., & Heath, D. D. (2017) · Clinical Nutrition · doi:10.1016/j.clnu.2016.04.029 · Cited by 209
Creativity and Well‐being: A Meta‐analysis
Acar, S., Tadik, H., Myers, D., van der Sman, C., & Uysal, R. (2021) · The Journal of Creative Behavior · doi:10.1002/jocb.485 · Cited by 208
Night-shift work and risk of breast cancer: a systematic review and meta-analysis
Kamdar, B. B., Tergas, A. I., Mateen, F. J., Bhayani, N. H., & Oh, J. (2013) · Breast Cancer Research and Treatment · doi:10.1007/s10549-013-2433-1 · Cited by 208
Allergen immunotherapy for the prevention of allergy: A systematic review and meta‐analysis
Kristiansen, M., Dhami, S., Netuveli, G., Halken, S., Muraro, A., Roberts, G., Larenas‐Linnemann, D., Calderón, M. A., Penagos, M., Du Toit, G., et al. (2017) · Pediatric Allergy and Immunology · doi:10.1111/pai.12661 · Cited by 208
He, Y., Yang, L., Qian, C., Li, T., Su, Z., Zhang, Q., & Hou, X. (2023) · Journal of Medical Internet Research · doi:10.2196/43862 · Cited by 213
“We applied different methods to examine publication bias (funnel plot, Begg and Mazumdar rank correlation test [74], Egger regression test [75], and Duval and Tweedie trim-and-fill procedure [76]).”
DOMINGUES, A. R., PIRES, S. M., HALASA, T., & HALD, T. (2012) · Epidemiology and Infection · doi:10.1017/s0950268811002676 · Cited by 207
“The publication bias was assessed using Duval & Tweedie’s trim-and-fill method [16], Begg & Mazumdar’s rank correlation test [17] and”
Mindfulness-based interventions for teachers: a meta-analysis of the emerging evidence base.
Klingbeil, D. A., & Renshaw, T. L. (2018) · School Psychology Quarterly · doi:10.1037/spq0000291 · Cited by 207
Too good to be true: Publication bias in two prominent studies from experimental psychology
Francis, G. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0227-9 · Cited by 206
“…powers of these experiments, the probability of getting a set of experiments with nine or more rejections by chance is .058, which is less than the .1 criterion frequently used for tests of publication bias (Begg & Mazumdar, 1994; Ioannidis & Trikalinos, 2007; Stern, Gavaghan, & Egger, 2000).”
MethodXie, Y., Wang, K., & Kong, Y. (2021) · Science and Engineering Ethics · doi:10.1007/s11948-021-00314-9 · Cited by 205
“Using Kendall’s tau, Begg’s adjusted rank method, a rank correlation test, was adopted to assess the presence of publication bias, (Begg & Mazumdar, 1994).”
MethodModerate alcohol consumption and cognitive risk
Neafsey, E., & Collins, M. (2011) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s23159 · Cited by 205
“31,32 The tops of the funnel plots are labeled with the P -values of two tests for funnel plot asymmetry, the regression test 31 on the left and the rank correlation test 33 on the right.”
Statin Use and Risk of Prostate Cancer: A Meta-Analysis of Observational Studies
Bansal, D., Undela, K., D'Cruz, S., & Schifano, F. (2012) · PLoS ONE · doi:10.1371/journal.pone.0046691 · Cited by 205
Association of trauma exposure with proinflammatory activity: a transdiagnostic meta-analysis
Tursich, M., Neufeld, R. W. J., Frewen, P. A., Harricharan, S., Kibler, J. L., Rhind, S. G., & Lanius, R. A. (2014) · Translational Psychiatry · doi:10.1038/tp.2014.56 · Cited by 204
Ye, Y., Li, J., & Yuan, Z. (2013) · PLoS ONE · doi:10.1371/journal.pone.0056803 · Cited by 204
Tomasello, G., Petrelli, F., Ghidini, M., Russo, A., Passalacqua, R., & Barni, S. (2017) · JAMA Oncology · doi:10.1001/jamaoncol.2017.0278 · Cited by 204
A meta-analysis of the relations between personality and workplace deviance: Big Five versus HEXACO
Pletzer, J. L., Bentvelzen, M., Oostrom, J. K., & de Vries, R. E. (2019) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2019.04.004 · Cited by 204
“Publication bias would be present if precision and the study effect sizes differ significantly according to a rank correlation test (Begg & Mazumdar, 1994) or according to a regression test for funnel plot asymmetry (Egger et al., 1997).”
MethodTrikudanathan, G., Navaneethan, U., Njei, B., Vargo, J. J., & Parsi, M. A. (2014) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2013.09.015 · Cited by 203
Effect of garlic on serum lipids: an updated meta-analysis
Ried, K., Toben, C., & Fakler, P. (2013) · Nutrition Reviews · doi:10.1111/nure.12012 · Cited by 203
Alcohol intake and risk of stroke: a dose-response meta-analysis of prospective studies
Zhang, C., Qin, Y.-Y., Chen, Q., Jiang, H., Chen, X.-Z., Xu, C.-L., Mao, P.-J., He, J., & Zhou, Y.-H. (2014) · International Journal of Cardiology · doi:10.1016/j.ijcard.2014.04.225 · Cited by 203
The effect of publication bias magnitude and direction on the certainty in evidence
Murad, M. H., Chu, H., Lin, L., & Wang, Z. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2018-110891 · Cited by 203
“8 15 Both methods examine the association between the observed effect sizes and their precisions.”
MethodDeng, Y., Wang, M., Tian, T., Lin, S., Xu, P., Zhou, L., Dai, C., Hao, Q., Wu, Y., Zhai, Z., et al. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.00024 · Cited by 203
“Begg’s funnel plot and Egger’s test were used to estimate publication bias (10, 11).”
MethodThe link between school climate and violence in school: A meta-analytic review
Steffgen, G., Recchia, S., & Viechtbauer, W. (2013) · Aggression and Violent Behavior · doi:10.1016/j.avb.2012.12.001 · Cited by 203
Osteoarthritis and mortality: A prospective cohort study and systematic review with meta-analysis
Veronese, N., Cereda, E., Maggi, S., Luchini, C., Solmi, M., Smith, T., Denkinger, M., Hurley, M., Thompson, T., Manzato, E., et al. (2016) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2016.04.002 · Cited by 202
de la Iglesia-García, D., Huang, W., Szatmary, P., Baston-Rey, I., Gonzalez-Lopez, J., Prada-Ramallal, G., Mukherjee, R., Nunes, Q. M., Domínguez-Muñoz, J. E., Sutton, R., et al. (2017) · Gut · doi:10.1136/gutjnl-2016-312529 · Cited by 202
“All seven high-quality studies 35 38 41 45 – 48 were double-blinded.”
Fiest, K. M., Walker, J. R., Bernstein, C. N., Graff, L. A., Zarychanski, R., Abou-Setta, A. M., Patten, S. B., Sareen, J., Bolton, J. M., Marriott, J. J., et al. (2016) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2015.10.004 · Cited by 198
Umbrella reviews: what they are and why we need them
Papatheodorou, S. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00505-6 · Cited by 201
The efficacy of exercise in reducing depressive symptoms among cancer survivors: a meta-analysis
Brown, J. C., Huedo-Medina, T. B., Pescatello, L. S., Ryan, S. M., Pescatello, S. M., Moker, E., LaCroix, J. M., Ferrer, R. A., & Johnson, B. T. (2012) · PLoS ONE · doi:10.1371/journal.pone.0030955 · Cited by 201
Wang, Q., Shelton, R. C., & Dwivedi, Y. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.08.066 · Cited by 201
Star Wars: The Empirics Strike Back
Brodeur, A., Lé, M., Sangnier, M., & Zylberberg, Y. (2016) · American Economic Journal: Applied Economics · doi:10.1257/app.20150044 · Cited by 430
Zintzaras, E., Stefanidis, I., Santos, M., & Vidal, F. (2006) · Hepatology · doi:10.1002/hep.21023 · Cited by 201
Obesity as a Risk Factor for Low Back Pain: A Meta-Analysis
Zhang, T.-T., Liu, Z., Liu, Y.-L., Zhao, J.-J., Liu, D.-W., & Tian, Q.-B. (2018) · Clinical Spine Surgery: A Spine Publication · doi:10.1097/bsd.0000000000000468 · Cited by 201
“05 was considered to be representative of a statistically significant publication bias).(19,20) We also conducted a sensitivity analysis in which 1 study was removed and the rest were analyzed to confirm the stability of the overall result.”
MethodSala, G., & Gobet, F. (2017) · Educational Research Review · doi:10.1016/j.edurev.2016.11.005 · Cited by 200
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.