Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 801–900 of 1,708
Rao, G., Lopez-Jimenez, F., Boyd, J., D’Amico, F., Durant, N. H., Hlatky, M. A., Howard, G., Kirley, K., Masi, C., Powell-Wiley, T. M., et al. (2017) · Circulation · doi:10.1161/cir.0000000000000523 · Cited by 269
van Loon, K., Voor in ‘t holt, A. F., & Vos, M. C. (2018) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.01730-17 · Cited by 269
Social support and subjective burden in caregivers of adults and older adults: A meta-analysis
del-Pino-Casado, R., Frías-Osuna, A., Palomino-Moral, P. A., Ruzafa-Martínez, M., & Ramos-Morcillo, A. J. (2018) · PLOS ONE · doi:10.1371/journal.pone.0189874 · Cited by 272
Xiang, J., Yan, H., Li, J., Wang, X., Chen, H., & Zheng, X. (2019) · World Journal of Surgical Oncology · doi:10.1186/s12957-019-1573-0 · Cited by 272
Schwingshackl, L., & Hoffmann, G. (2013) · Nutrition, Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2013.04.008 · Cited by 271
Breast cancer and NSAID use: a meta-analysis
Khuder, S. A., & Mutgi, A. B. (2001) · British Journal of Cancer · doi:10.1054/bjoc.2000.1709 · Cited by 273
Kunutsor, S. K., Apekey, T. A., & Khan, H. (2014) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2014.06.006 · Cited by 272
Sipahi, I., Chou, J. C., Hyden, M., Rowland, D. Y., Simon, D. I., & Fang, J. C. (2012) · American Heart Journal · doi:10.1016/j.ahj.2011.11.014 · Cited by 271
Estimating genetic benefits of polyandry from experimental studies: a meta‐analysis
Slatyer, R. A., Mautz, B. S., Backwell, P. R. Y., & Jennions, M. D. (2012) · Biological Reviews · doi:10.1111/j.1469-185x.2011.00182.x · Cited by 271
McCool, M. E., Zuelke, A., Theurich, M. A., Knuettel, H., Ricci, C., & Apfelbacher, C. (2016) · Sexual Medicine Reviews · doi:10.1016/j.sxmr.2016.03.002 · Cited by 270
Zhang, T., Pang, C., Li, N., Zhou, E., & Zhao, K. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-1 · Cited by 270
Self-Compassion and Coping: a Meta-Analysis
Ewert, C., Vater, A., & Schröder-Abé, M. (2021) · Mindfulness · doi:10.1007/s12671-020-01563-8 · Cited by 270
Kilgore, T. W., Abdinoor, A. A., Szary, N. M., Schowengerdt, S. W., Yust, J. B., Choudhary, A., Matteson, M. L., Puli, S. R., Marshall, J. B., & Bechtold, M. L. (2011) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2011.02.007 · Cited by 270
Ursodeoxycholic acid for primary biliary cirrhosis
Rudic, J. S., Poropat, G., Krstic, M. N., Bjelakovic, G., & Gluud, C. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000551.pub3 · Cited by 270
Is subjective social status a unique correlate of physical health? A meta-analysis.
Cundiff, J. M., & Matthews, K. A. (2017) · Health Psychology · doi:10.1037/hea0000534 · Cited by 268
The effect of early mobilization in critically ill patients: A meta‐analysis
Zang, K., Chen, B., Wang, M., Chen, D., Hui, L., Guo, S., Ji, T., & Shang, F. (2020) · Nursing in Critical Care · doi:10.1111/nicc.12455 · Cited by 268
A meta-analysis of how signaling affects learning with media
Schneider, S., Beege, M., Nebel, S., & Rey, G. D. (2018) · Educational Research Review · doi:10.1016/j.edurev.2017.11.001 · Cited by 268
How to review the evidence: systematic identification and review of the scientific literature
Glasziou, P., Irwig, L., Bain, C., & Colditz, G. A. (2000) · Cited by 293
Dipeptidyl Peptidase-4 Inhibitors and Bone Fractures
Monami, M., Dicembrini, I., Antenore, A., & Mannucci, E. (2011) · Diabetes Care · doi:10.2337/dc11-1099 · Cited by 268
Preterm low birth weight and maternal periodontal status: a meta-analysis
Vergnes, J.-N., & Sixou, M. (2007) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2006.09.028 · Cited by 266
Dai, W., Ye, L., Liu, A., Wen, S. W., Deng, J., Wu, X., & Lai, Z. (2017) · Medicine · doi:10.1097/md.0000000000008179 · Cited by 268
Pulmonary Valve Replacement After Operative Repair of Tetralogy of Fallot
Ferraz Cavalcanti, P. E., Sá, M. P. B. O., Santos, C. A., Esmeraldo, I. M., Escobar, R. R. D., Menezes, A. M. D., Azevedo, O. M. D., Vasconcelos Silva, F. P. D., Lins, R. F. D. A., & Lima, R. D. C. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.04.107 · Cited by 267
Cheraghi, Z., Poorolajal, J., Hashem, T., Esmailnasab, N., & Doosti Irani, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051446 · Cited by 265
Låg, T., & Sæle, R. G. (2019) · AERA Open · doi:10.1177/2332858419870489 · Cited by 265
Quantitative ultrasound of the heel and fracture risk assessment: An updated meta-analysis
Moayyeri, A., Adams, J. E., Adler, R. A., Krieg, M.-A., Hans, D., Compston, J., & Lewiecki, E. M. (2012) · Osteoporosis International · doi:10.1007/s00198-011-1817-5 · Cited by 266
“Inversevariance weights for the included studies were calculated and potential for publication bias was evaluated using funnel plots derived from the Begg–Mazumdar test [22].”
MethodUnger, J. M., Hershman, D. L., Till, C., Minasian, L. M., Osarogiagbon, R. U., Fleury, M. E., & Vaidya, R. (2021) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djaa155 · Cited by 262
Meta-analysis using effect size distributions of only statistically significant studies.
van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2015) · Psychological Methods · doi:10.1037/met0000025 · Cited by 265
Effect of acute hypoxia on cognition: A systematic review and meta-regression analysis
McMorris, T., Hale, B. J., Barwood, M., Costello, J., & Corbett, J. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.01.019 · Cited by 262
Obesity and anxiety symptoms: a systematic review and meta-analysis
Amiri, S., & Behnezhad, S. (2019) · neuropsychiatrie · doi:10.1007/s40211-019-0302-9 · Cited by 265
Schwingshackl, L., Missbach, B., Dias, S., König, J., & Hoffmann, G. (2014) · Diabetologia · doi:10.1007/s00125-014-3303-z · Cited by 264
“Additionally, Begg’s and Egger’s regression tests were performed to detect small study effects [22, 23].”
MethodGreen and Black Tea Consumption and Risk of Stroke: A Meta-Analysis
Arab, L., Liu, W., & Elashoff, D. (2009) · Stroke · doi:10.1161/strokeaha.108.538470 · Cited by 264
Liang, H., Li, X., Yu, X., Guan, P., Yin, Z., He, Q., & Zhou, B. (2009) · International Journal of Cancer · doi:10.1002/ijc.24636 · Cited by 265
Dong, M., Zeng, L.-N., Lu, L., Li, X.-H., Ungvari, G. S., Ng, C. H., Chow, I. H. I., Zhang, L., Zhou, Y., & Xiang, Y.-T. (2019) · Psychological Medicine · doi:10.1017/s0033291718002301 · Cited by 263
“Publication bias was estimated with funnel plots and Begg’s test (Begg and Mazumdar, 1994).”
MethodImpact of the Everolimus-Eluting Stent on Stent Thrombosis
Baber, U., Mehran, R., Sharma, S. K., Brar, S., Yu, J., Suh, J.-W., Kim, H.-S., Park, S.-J., Kastrati, A., de Waha, A., et al. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2011.06.049 · Cited by 263
Subclinical hypothyroidism and type 2 diabetes: A systematic review and meta-analysis
Han, C., He, X., Xia, X., Li, Y., Shi, X., Shan, Z., & Teng, W. (2015) · PLoS ONE · doi:10.1371/journal.pone.0135233 · Cited by 258
Forouhi, N. G., Ye, Z., Rickard, A. P., Khaw, K. T., Luben, R., Langenberg, C., & Wareham, N. J. (2012) · Diabetologia · doi:10.1007/s00125-012-2544-y · Cited by 261
Shu, X., Lin, T., Wang, H., Zhao, Y., Jiang, T., Peng, X., & Yue, J. (2022) · Journal of Cachexia, Sarcopenia and Muscle · doi:10.1002/jcsm.12890 · Cited by 250
Bliziotis, I. A., Destounis, A., & Stergiou, G. S. (2012) · Journal of Hypertension · doi:10.1097/hjh.0b013e3283531eaf · Cited by 261
“Small studies’ effect (‘publication bias’ according to some authors) was evaluated using Beggs and Egger’s statistical tests [15,16] and Egger’s funnel plots with standard error of the effect, which accounts for both the sample size and the effect size.”
MethodObesity and Mortality in Critically Ill Adults: A Systematic Review and Meta‐analysis
Oliveros, H., & Villamor, E. (2008) · Obesity · doi:10.1038/oby.2007.102 · Cited by 261
Vitamin D and risk of future hypertension: meta-analysis of 283,537 participants
Kunutsor, S. K., Apekey, T. A., & Steur, M. (2013) · European Journal of Epidemiology · doi:10.1007/s10654-013-9790-2 · Cited by 261
Sathorn, C., Parashos, P., & Messer, H. (2007) · International Endodontic Journal · doi:10.1111/j.1365-2591.2006.01197.x · Cited by 261
Quintana, D. S. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01549 · Cited by 260
Does pre‐exercise static stretching inhibit maximal muscular performance? A meta‐analytical review
Simic, L., Sarabon, N., & Markovic, G. (2013) · Scandinavian Journal of Medicine & Science in Sports · doi:10.1111/j.1600-0838.2012.01444.x · Cited by 261
Lu, W. L., Jansen, L., Post, W. J., Bonnema, J., Van de Velde, J. C., & De Bock, G. H. (2009) · Breast Cancer Research and Treatment · doi:10.1007/s10549-008-0023-4 · Cited by 265
Winck, J. C., Azevedo, L. F., Costa-Pereira, A., Antonelli, M., & Wyatt, J. C. (2006) · Critical Care · doi:10.1186/cc4905 · Cited by 265
Gilbert, R., Salanti, G., Harden, M., & See, S. (2005) · International Journal of Epidemiology · doi:10.1093/ije/dyi088 · Cited by 261
Kojima, G., Taniguchi, Y., Iliffe, S., & Walters, K. (2016) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2016.05.013 · Cited by 261
Constantino, M. J., Vîslă, A., Coyne, A. E., & Boswell, J. F. (2018) · Psychotherapy · doi:10.1037/pst0000169 · Cited by 257
The MASH Research Team, Scott-Sheldon, L. A. J., Carey, K. B., Cunningham, K., Johnson, B. T., & Carey, M. P. (2016) · AIDS and Behavior · doi:10.1007/s10461-015-1108-9 · Cited by 260
Diener, M. J., & Monroe, J. M. (2011) · Psychotherapy · doi:10.1037/a0022425 · Cited by 260
Ssentongo, P., Ssentongo, A. E., Voleti, N., Groff, D., Sun, A., Ba, D. M., Nunez, J., Parent, L. J., Chinchilli, V. M., & Paules, C. I. (2022) · BMC Infectious Diseases · doi:10.1186/s12879-022-07418-y · Cited by 260
“Publication bias was quantitatively evaluated with Egger’s linear regression and Begg’s rank test [15, 16] and qualitatively with funnel plots.”
MethodDebunking Myths and Urban Legends About Meta-Analysis
Aguinis, H., Pierce, C. A., Bosco, F. A., Dalton, D. R., & Dalton, C. M. (2011) · Organizational Research Methods · doi:10.1177/1094428110375720 · Cited by 259
Brimble, K. S., Walker, M., Margetts, P. J., Kundhal, K. K., & Rabbat, C. G. (2006) · Journal of the American Society of Nephrology · doi:10.1681/asn.2006030194 · Cited by 260
Pita-Fernández, S., Alhayek-Aí, M., González-Martín, C., López-Calviño, B., Seoane-Pillado, T., & Pértega-Díaz, S. (2015) · Annals of Oncology · doi:10.1093/annonc/mdu543 · Cited by 260
The Nomological Net of the HEXACO Model of Personality: A Large-Scale Meta-Analytic Investigation
Zettler, I., Thielmann, I., Hilbig, B. E., & Moshagen, M. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691619895036 · Cited by 257
Ssentongo, P., Hehnly, C., Birungi, P., Roach, M. A., Spady, J., Fronterre, C., Wang, M., Murray-Kolb, L. E., Al-Shaar, L., Chinchilli, V. M., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.20736 · Cited by 258
Savarese, G., Paolillo, S., Costanzo, P., D'Amore, C., Cecere, M., Losco, T., Musella, F., Gargiulo, P., Marciano, C., & Perrone-Filardi, P. (2012) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2012.01.083 · Cited by 261
Diabetes and Risk of Hearing Impairment in Adults: A Meta-Analysis
Horikawa, C., Kodama, S., Tanaka, S., Fujihara, K., Hirasawa, R., Yachi, Y., Shimano, H., Yamada, N., Saito, K., & Sone, H. (2013) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2012-2119 · Cited by 259
Kramer, C. K., Zinman, B., & Retnakaran, R. (2013) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(13)70006-8 · Cited by 257
Monami, M., Ahrén, B., Dicembrini, I., & Mannucci, E. (2013) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12000 · Cited by 259
McCulloch, M., See, C., Shu, X.-J., Broffman, M., Kramer, A., Fan, W.-Y., Gao, J., Lieb, W., Shieh, K., & Colford, J. M. (2006) · Journal of Clinical Oncology · doi:10.1200/jco.2005.03.6392 · Cited by 257
Invited review: Use of meta-analysis in animal health and reproduction: Methods and applications
Lean, I. J., Rabiee, A. R., Duffield, T. F., & Dohoo, I. R. (2009) · Journal of Dairy Science · doi:10.3168/jds.2009-2140 · Cited by 257
Systematic Review and Meta-analysis of the Impact of Restaurant Menu Calorie Labeling
Long, M. W., Tobias, D. K., Cradock, A. L., Batchelder, H., & Gortmaker, S. L. (2015) · American Journal of Public Health · doi:10.2105/ajph.2015.302570 · Cited by 257
“We assessed publication bias through visual inspection of the funnel plot and the Begg’s test, which tests for a rank correlation between standardized intervention effects and standard errors.(33) We performed all analyses with Stata version 13.”
MethodTiming of perioperative antibiotics for cesarean delivery: a metaanalysis
Costantine, M. M., Rahman, M., Ghulmiyah, L., Byers, B. D., Longo, M., Wen, T., Hankins, G. D. V., & Saade, G. R. (2008) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2008.06.077 · Cited by 257
Hartling, L., Liang, Y., & Lacaze-Masmonteil, T. (2012) · Archives of Disease in Childhood - Fetal and Neonatal Edition · doi:10.1136/adc.2010.210187 · Cited by 260
Li, M., Hu, X., Fan, Y., Li, K., Zhang, X., Hou, W., & Tang, Z. (2016) · Scientific Reports · doi:10.1038/srep19520 · Cited by 257
Yu, H.-F., Chen, H.-S., Rao, D.-P., & Gong, J. (2016) · Medicine · doi:10.1097/md.0000000000004863 · Cited by 257
Systematic review and meta-analysis: fussing and crying durations and prevalence of colic in infants
Wolke, D., Bilgin, A., & Samara, M. (2017) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2017.02.020 · Cited by 255
Active and passive smoking and risk of breast cancer: a meta-analysis
Macacu, A., Autier, P., Boniol, M., & Boyle, P. (2015) · Breast Cancer Research and Treatment · doi:10.1007/s10549-015-3628-4 · Cited by 256
Zhang, B., Mo, Z., Du, W., Wang, Y., Liu, L., & Wei, Y. (2015) · Oral Oncology · doi:10.1016/j.oraloncology.2015.08.005 · Cited by 256
Smith, S. R., Deshpande, B. R., Collins, J. E., Katz, J. N., & Losina, E. (2016) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2016.01.135 · Cited by 256
Fang, X., Wang, K., Han, D., He, X., Wei, J., Zhao, L., Imam, M. U., Ping, Z., Li, Y., Xu, Y., et al. (2016) · BMC Medicine · doi:10.1186/s12916-016-0742-z · Cited by 255
Prevalence of chronic pain in developing countries: systematic review and meta-analysis
Sá, K. N., Moreira, L., Baptista, A. F., Yeng, L. T., Teixeira, M. J., Galhardoni, R., & de Andrade, D. C. (2019) · PAIN Reports · doi:10.1097/pr9.0000000000000779 · Cited by 255
Physical activity and suicidal ideation: A systematic review and meta-analysis
Vancampfort, D., Hallgren, M., Firth, J., Rosenbaum, S., Schuch, F. B., Mugisha, J., Probst, M., Van Damme, T., Carvalho, A. F., & Stubbs, B. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.08.070 · Cited by 255
Russell, K. F., Liang, Y., O'Gorman, K., Johnson, D. W., & Klassen, T. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001955.pub3 · Cited by 234
Sexual selection and speciation: the comparative evidence revisited
Kraaijeveld, K., Kraaijeveld-Smit, F. J. L., & Maan, M. E. (2011) · Biological Reviews · doi:10.1111/j.1469-185x.2010.00150.x · Cited by 255
Effect of garlic on blood pressure: A systematic review and meta-analysis
Ried, K., Frank, O. R., Stocks, N. P., Fakler, P., & Sullivan, T. (2008) · BMC Cardiovascular Disorders · doi:10.1186/1471-2261-8-13 · Cited by 254
Hansen, R. A., Gartlehner, G., Lohr, K. N., Gaynes, B. N., & Carey, T. S. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-143-6-200509200-00006 · Cited by 255
Methods for Exploring Heterogeneity in Meta-Analysis
Song, F., Sheldon, T. A., Sutton, A. J., Abrams, K. R., & Jones, D. R. (2001) · Evaluation & the Health Professions · doi:10.1177/01632780122034849 · Cited by 253
Benhamou, S., Lee, W. J., Alexandrie, A.-K., Boffetta, P., Bouchardy, C., Butkiewicz, D., Brockmöller, J., Clapper, M. L., Daly, A., Dolzan, V., et al. (2002) · Carcinogenesis · doi:10.1093/carcin/23.8.1343 · Cited by 255
Jennions, M. D., & Møller, A. P. (2002) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.2001.1832 · Cited by 255
Gupta, A., Nadkarni, G., Yang, W.-T., Chandrasekhar, A., Gupte, N., Bisson, G. P., Hosseinipour, M., & Gummadi, N. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028691 · Cited by 254
Mayorga-Vega, D., Merino-Marbán, R., & Viciana, J. (2014) · Europe PMC (PubMed Central) · Cited by 484
Sexton, C. E., Betts, J. F., Demnitz, N., Dawes, H., Ebmeier, K. P., & Johansen-Berg, H. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.071 · Cited by 254
Probiotics for the prevention of pediatric antibiotic-associated diarrhea
Johnston, B. C., Goldenberg, J. Z., Vandvik, P. O., Sun, X., & Guyatt, G. H. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004827.pub3 · Cited by 222
Short sleep duration predicts risk of metabolic syndrome: A systematic review and meta-analysis
Xi, B., He, D., Zhang, M., Xue, J., & Zhou, D. (2014) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2013.06.001 · Cited by 252
Jayedi, A., Soltani, S., Motlagh, S. Z.-T., Emadi, A., Shahinfar, H., Moosavi, H., & Shab-Bidar, S. (2022) · BMJ · doi:10.1136/bmj-2021-067516 · Cited by 253
Issues in Comparisons Between Meta-analyses and Large Trials
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.14.1089 · Cited by 253
Lee, I., Agarwal, R. K., Lee, B. Y., Fishman, N. O., & Umscheid, C. A. (2010) · Infection Control & Hospital Epidemiology · doi:10.1086/657134 · Cited by 252
Statistical methods for dealing with publication bias in meta‐analysis
Jin, Z., Zhou, X., & He, J. (2015) · Statistics in Medicine · doi:10.1002/sim.6342 · Cited by 252
Kyzas, P. A., Cunha, I. W., & Ioannidis, J. P. A. (2005) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-04-1870 · Cited by 252
Microvolt T-Wave Alternans for the Risk Stratification of Ventricular Tachyarrhythmic Events
Gehi, A. K., Stein, R. H., Metz, L. D., & Gomes, J. A. (2005) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2005.03.059 · Cited by 252
Veronese, N., Facchini, S., Stubbs, B., Luchini, C., Solmi, M., Manzato, E., Sergi, G., Maggi, S., Cosco, T., & Fontana, L. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.11.017 · Cited by 251
“Publication bias was assessed by visually inspecting funnel plots and by using the BeggMazumdar Kendall tau (Begg and Mazumdar, 1994) and the Egger bias tests (Egger et al., 1997).”
MethodRowlands, M., Gunnell, D., Harris, R., Vatten, L. J., Holly, J. M. P., & Martin, R. M. (2009) · International Journal of Cancer · doi:10.1002/ijc.24202 · Cited by 251
FDG-PET for management of cervical and ovarian cancer
Havrilesky, L. J., Kulasingam, S. L., Matchar, D. B., & Myers, E. R. (2005) · Gynecologic Oncology · doi:10.1016/j.ygyno.2004.12.007 · Cited by 253
Coulter, I. D., Crawford, C., Hurwitz, E. L., Vernon, H., Khorsan, R., Suttorp Booth, M., & Herman, P. M. (2018) · The Spine Journal · doi:10.1016/j.spinee.2018.01.013 · Cited by 249
He, X., Li, J., Wang, B., Yao, Q., Li, L., Song, R., Shi, X., & Zhang, J.-A. (2017) · Endocrine · doi:10.1007/s12020-016-1168-2 · Cited by 250
Kraiss, J. T., ten Klooster, P. M., Moskowitz, J. T., & Bohlmeijer, E. T. (2020) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2020.152189 · Cited by 252
“Since the funnel plot merely allows a visual and subjective decision about the presence of publication bias, we also conducted Begg and Mazumdar's rank correlation test [76] to quantitatively estimate the probability of publication bias.”
BackgroundMethodAlonso-Ruiz, A., Pijoan, J. I., Ansuategui, E., Urkaregi, A., Calabozo, M., & Quintana, A. (2008) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-9-52 · Cited by 250
Effects of Exercise Training on Sleep Apnea: A Meta-analysis
Iftikhar, I. H., Kline, C. E., & Youngstedt, S. D. (2014) · Lung · doi:10.1007/s00408-013-9511-3 · Cited by 250
“To check for publication bias, we constructed funnel plots of effect size and standard error [32, 34] and also analyzed results by using the Begg and Mazumdar rank correlation test [35].”
Method
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.