Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
“Various tests for funnel plot asymmetry of this form have been suggested in the literature, including the rank correlation test by Begg and Mazumdar (1994) and the regression test by Egger et al. (1997).”
MethodDuval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Whelton, P. K., Carey, R. M., Aronow, W. S., Casey, D. E., Collins, K. J., Dennison Himmelfarb, C., DePalma, S. M., Gidding, S., Jamerson, K. A., Jones, D. W., et al. (2018) · Hypertension · doi:10.1161/hyp.0000000000000065 · Cited by 7,391
Emotion-regulation strategies across psychopathology: A meta-analytic review
Aldao, A., Nolen-Hoeksema, S., & Schweizer, S. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.11.004 · Cited by 6,686
A Meta-Analysis of Cytokines in Major Depression
Dowlati, Y., Herrmann, N., Swardfager, W., Liu, H., Sham, L., Reim, E. K., & Lanctôt, K. L. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.09.033 · Cited by 4,729
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Kodama, S. (2009) · JAMA · doi:10.1001/jama.2009.681 · Cited by 3,035
The global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013
Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J. W., Patel, V., & Silove, D. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu038 · Cited by 2,846
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
“Other, more quantitative methods of detecting publication bias have been proposed, ranging from a simplistic method-of-moments approach (Sugita 1992, 1994) to more sophisticated methods such as a rank correlation test (Begg 1994; Begg and Mazumdar 1994) based on the form of a biased funnel plot as in Figure l(b), a me…”
BackgroundMethodDeeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Salk, R. H., Hyde, J. S., & Abramson, L. Y. (2017) · Psychological Bulletin · doi:10.1037/bul0000102 · Cited by 2,622
“Nonetheless, we used the Begg and Mazumdar (1994) rank correlation test to evaluate asymmetry in the funnel plots.”
Quantitative Synthesis in Systematic Reviews
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-9-199711010-00008 · Cited by 2,517
Meta-analysis of the heritability of human traits based on fifty years of twin studies
Polderman, T. J. C., Benyamin, B., de Leeuw, C. A., Sullivan, P. F., van Bochoven, A., Visscher, P. M., & Posthuma, D. (2015) · Nature Genetics · doi:10.1038/ng.3285 · Cited by 2,467
Accelerating extinction risk from climate change
Urban, M. C. (2015) · Science · doi:10.1126/science.aaa4984 · Cited by 2,436
Aune, D., Giovannucci, E., Boffetta, P., Fadnes, L. T., Keum, N., Norat, T., Greenwood, D. C., Riboli, E., Vatten, L. J., & Tonstad, S. (2017) · International Journal of Epidemiology · doi:10.1093/ije/dyw319 · Cited by 2,419
Cognitive and Behavioral Outcomes of School-Aged Children Who Were Born Preterm: A Meta-analysis
Bhutta, A. T., Cleves, M. A., Casey, P. H., Cradock, M. M., & Anand, K. J. S. (2002) · JAMA · doi:10.1001/jama.288.6.728 · Cited by 2,392
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229
Comparison of two methods to detect publication bias in meta-analysis.
Peters, J. L. (2006) · JAMA · doi:10.1001/jama.295.6.676 · Cited by 2,278
A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Younossi, Z. M., Golabi, P., de Avila, L., Paik, J. M., Srishord, M., Fukui, N., Qiu, Y., Burns, L., Afendy, A., & Nader, F. (2019) · Journal of Hepatology · doi:10.1016/j.jhep.2019.06.021 · Cited by 2,235
Bjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2007) · JAMA · doi:10.1001/jama.297.8.842 · Cited by 2,275
Investigating and dealing with publication and other biases in meta-analysis
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · BMJ · doi:10.1136/bmj.323.7304.101 · Cited by 2,225
Sugar-Sweetened Beverages and Risk of Metabolic Syndrome and Type 2 Diabetes
Malik, V. S., Popkin, B. M., Bray, G. A., Després, J.-P., Willett, W. C., & Hu, F. B. (2010) · Diabetes Care · doi:10.2337/dc10-1079 · Cited by 2,116
“The potential for publication bias was evaluated using Begg and Egger tests and visual inspection of the Begg funnel plot (22,23).”
MethodPeters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.010 · Cited by 2,053
Cosgrove, S. E., Sakoulas, G., Perencevich, E. N., Schwaber, M. J., Karchmer, A. W., & Carmeli, Y. (2003) · Clinical Infectious Diseases · doi:10.1086/345476 · Cited by 1,964
Grote, N. K., Bridge, J. A., Gavin, A. R., Melville, J. L., Iyengar, S., & Katon, W. J. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.111 · Cited by 1,882
Prevalence and incidence of epilepsy: A systematic review and meta-analysis of international studies
Fiest, K. M., Sauro, K. M., Wiebe, S., Patten, S. B., Kwon, C.-S., Dykeman, J., Pringsheim, T., Lorenzetti, D. L., & Jetté, N. (2017) · Neurology · doi:10.1212/wnl.0000000000003509 · Cited by 1,902
GRADE guidelines: 5. Rating the quality of evidence—publication bias
Guyatt, G. H., Oxman, A. D., Montori, V., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Djulbegovic, B., Atkins, D., Falck-Ytter, Y., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.011 · Cited by 1,819
Physical Activity and Incident Depression: A Meta-Analysis of Prospective Cohort Studies
Schuch, F. B., Vancampfort, D., Firth, J., Rosenbaum, S., Ward, P. B., Silva, E. S., Hallgren, M., Ponce De Leon, A., Dunn, A. L., Deslandes, A. C., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17111194 · Cited by 1,763
The case of the misleading funnel plot
Lau, J., Ioannidis, J. P. A., Terrin, N., Schmid, C. H., & Olkin, I. (2006) · BMJ · doi:10.1136/bmj.333.7568.597 · Cited by 1,766
Correll, C. U., Solmi, M., Veronese, N., Bortolato, B., Rosson, S., Santonastaso, P., Thapa‐Chhetri, N., Fornaro, M., Gallicchio, D., Collantoni, E., et al. (2017) · World Psychiatry · doi:10.1002/wps.20420 · Cited by 1,729
Prevalence of Depression During Pregnancy: Systematic Review
Bennett, H. A., Einarson, A., Taddio, A., Koren, G., & Einarson, T. R. (2004) · Obstetrics & Gynecology · doi:10.1097/01.aog.0000116689.75396.5f · Cited by 1,725
Ford, E. S. (2005) · Diabetes Care · doi:10.2337/diacare.28.7.1769 · Cited by 1,710
Malik, V. S., Pan, A., Willett, W. C., & Hu, F. B. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.058362 · Cited by 1,668
Quantifying publication bias in meta-analysis
Lin, L., & Chu, H. (2018) · Biometrics · doi:10.1111/biom.12817 · Cited by 1,674
Fewtrell, L., Kaufmann, R. B., Kay, D., Enanoria, W., Haller, L., & Colford, J. M. (2005) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(04)01253-8 · Cited by 1,670
2009 updated method guidelines for systematic reviews in the Cochrane Back Review Group
Furlan, A. D., Pennick, V., Bombardier, C., & van Tulder, M. (2009) · Spine · doi:10.1097/brs.0b013e3181b1c99f · Cited by 1,663
Wang, X., Ouyang, Y., Liu, J., Zhu, M., Zhao, G., Bao, W., & Hu, F. B. (2014) · BMJ · doi:10.1136/bmj.g4490 · Cited by 1,596
Ronksley, P. E., Brien, S. E., Turner, B. J., Mukamal, K. J., & Ghali, W. A. (2011) · BMJ · doi:10.1136/bmj.d671 · Cited by 1,610
Exercise as a treatment for depression: a meta-analysis adjusting for publication bias
Schuch, F. B., Vancampfort, D., Richards, J., Rosenbaum, S., Ward, P. B., & Stubbs, B. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.02.023 · Cited by 1,529
“Publication bias was assessed with a visual inspection of funnel plots and with the Begg-Mazumdar Kendall's tau (Begg and Mazumdar, 1994) and Egger bias test (Egger et al., 1997).”
MethodPhysician Staffing Patterns and Clinical Outcomes in Critically Ill Patients: A Systematic Review
Pronovost, P. J., Angus, D. C., Dorman, T., Robinson, K. A., Dremsizov, T. T., & Young, T. L. (2002) · JAMA · doi:10.1001/jama.288.17.2151 · Cited by 1,506
Jeon, C. Y., & Murray, M. B. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050152 · Cited by 1,486
Nanni, V., Uher, R., & Danese, A. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11020335 · Cited by 1,480
Porter, M., & Haslam, N. (2005) · JAMA · doi:10.1001/jama.294.5.602 · Cited by 1,793
Anxiety Disorders in Children and Adolescents with Autistic Spectrum Disorders: A Meta-Analysis
van Steensel, F. J. A., Bögels, S. M., & Perrin, S. (2011) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-011-0097-0 · Cited by 1,463
“Publication bias is typically assessed via visual inspection of funnel plots (Munafò et al. 2004), tests of funnel plot asymmetry (Egger et al. 1997), or rank correlation methods (Begg and Mazumdar 1994).”
MethodEmpirical assessment of effect of publication bias on meta-analyses
Sutton, A. J. (2000) · BMJ · doi:10.1136/bmj.320.7249.1574 · Cited by 1,398
Meta-analysis: Excess Mortality After Hip Fracture Among Older Women and Men
Haentjens, P., Magaziner, J., Colón-Emeric, C. S., Vanderschueren, D., Milisen, K., Velkeniers, B., & Boonen, S. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-6-201003160-00008 · Cited by 1,398
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
Fitting three-level meta-analytic models in R: A step-by-step tutorial
Assink, M., & Wibbelink, C. J. M. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p154 · Cited by 1,330
Publication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
A comparison of methods to detect publication bias in meta‐analysis
Macaskill, P., Walter, S. D., & Irwig, L. (2001) · Statistics in Medicine · doi:10.1002/sim.698 · Cited by 1,286
Ali, S., Stone, M. A., Peters, J. L., Davies, M. J., & Khunti, K. (2006) · Diabetic Medicine · doi:10.1111/j.1464-5491.2006.01943.x · Cited by 1,276
Active Smoking and the Risk of Type 2 Diabetes: A Systematic Review and Meta-analysis
Willi, C., Bodenmann, P., Ghali, W. A., Faris, P. D., & Cornuz, J. (2007) · JAMA · doi:10.1001/jama.298.22.2654 · Cited by 1,268
Vancampfort, D., Stubbs, B., Mitchell, A. J., De Hert, M., Wampers, M., Ward, P. B., Rosenbaum, S., & Correll, C. U. (2015) · World Psychiatry · doi:10.1002/wps.20252 · Cited by 1,271
Meta-analysis of risk factors for cutaneous melanoma: II. Sun exposure
Gandini, S., Sera, F., Cattaruzza, M. S., Pasquini, P., Picconi, O., Boyle, P., & Melchi, C. F. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2004.10.016 · Cited by 1,266
“P-values for the fit of the funnel plot in the sensitivity analysis published by Copas and Shi [26], P-values for the rank correlation test proposed by Begg (Spearman s q values) [27] and P-values for Egger s weighted-linear regression method are presented [28].”
MethodGender differences in emotion expression in children: A meta-analytic review.
Chaplin, T. M., & Aldao, A. (2013) · Psychological Bulletin · doi:10.1037/a0030737 · Cited by 1,247
Micha, R., Wallace, S. K., & Mozaffarian, D. (2010) · Circulation · doi:10.1161/circulationaha.109.924977 · Cited by 1,244
Jones, L., Bellis, M. A., Wood, S., Hughes, K., McCoy, E., Eckley, L., Bates, G., Mikton, C., Shakespeare, T., & Officer, A. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60692-8 · Cited by 1,239
Mozaffarian, D., Micha, R., & Wallace, S. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000252 · Cited by 1,215
Appealing to fear: A meta-analysis of fear appeal effectiveness and theories
Tannenbaum, M. B., Hepler, J., Zimmerman, R. S., Saul, L., Jacobs, S., Wilson, K., & Albarracín, D. (2015) · Psychological Bulletin · doi:10.1037/a0039729 · Cited by 1,315
Rosenberg, M. S. (2005) · Evolution · doi:10.1111/j.0014-3820.2005.tb01004.x · Cited by 1,285
Neoadjuvant Versus Adjuvant Systemic Treatment in Breast Cancer: A Meta-Analysis
Mauri, D., Pavlidis, N., & Ioannidis, J. P. A. (2005) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dji021 · Cited by 1,200
The relation between different dimensions of alcohol consumption and burden of disease: an overview
Rehm, J., Baliunas, D., Borges, G. L. G., Graham, K., Irving, H., Kehoe, T., Parry, C. D., Patra, J., Popova, S., Poznyak, V., et al. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.02899.x · Cited by 1,174
Wood, A. M., Kaptoge, S., Butterworth, A. S., Willeit, P., Warnakula, S., Bolton, T., Paige, E., Paul, D. S., Sweeting, M., Burgess, S., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30134-x · Cited by 1,188
“33 Evidence of small study effects was assessed visually with funnel plots and by Begg and Mazumdar’s test 34 and Egger’s test.”
Perinatal outcomes in singletons following in vitro fertilization: a meta–analysis
Jackson, R. A., Gibson, K. A., Wu, Y. W., & Croughan, M. S. (2004) · Obstetrics & Gynecology · doi:10.1097/01.aog.0000114989.84822.51 · Cited by 1,160
Owen, C. G., Martin, R. M., Whincup, P. H., Smith, G. D., & Cook, D. G. (2005) · Pediatrics · doi:10.1542/peds.2004-1176 · Cited by 1,168
Objectively measured physical capability levels and mortality: systematic review and meta-analysis
Cooper, R., Kuh, D., Hardy, R., Mortality Review Group, & teams, O. B. O. T. F. A. H. S. (2010) · BMJ · doi:10.1136/bmj.c4467 · Cited by 1,166
Chang, J. T., Morton, S. C., Rubenstein, L. Z., Mojica, W. A., Maglione, M., Suttorp, M. J., Roth, E. A., & Shekelle, P. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.680 · Cited by 1,168
Sedative hypnotics in older people with insomnia: meta-analysis of risks and benefits
Glass, J., Lanctôt, K. L., Herrmann, N., Sproule, B. A., & Busto, U. E. (2005) · BMJ · doi:10.1136/bmj.38623.768588.47 · Cited by 1,161
Field, A. P., & Gillett, R. (2010) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711010x502733 · Cited by 1,162
Health Message Framing Effects on Attitudes, Intentions, and Behavior: A Meta-analytic Review
Gallagher, K. M., & Updegraff, J. A. (2012) · Annals of Behavioral Medicine · doi:10.1007/s12160-011-9308-7 · Cited by 1,147
Aune, D., Chan, D. S. M., Lau, R., Vieira, R., Greenwood, D. C., Kampman, E., & Norat, T. (2011) · BMJ · doi:10.1136/bmj.d6617 · Cited by 1,146
Association Between Smoking and Risk of Bladder Cancer Among Men and Women
Freedman, N. D. (2011) · JAMA · doi:10.1001/jama.2011.1142 · Cited by 1,141
A Meta-Analysis of Cytokines in Alzheimer's Disease
Swardfager, W., Lanctôt, K., Rothenburg, L., Wong, A., Cappell, J., & Herrmann, N. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.06.012 · Cited by 1,108
Inflammation and frailty in the elderly: A systematic review and meta-analysis
Soysal, P., Stubbs, B., Lucato, P., Luchini, C., Solmi, M., Peluso, R., Sergi, G., Isik, A. T., Manzato, E., Maggi, S., et al. (2016) · Ageing Research Reviews · doi:10.1016/j.arr.2016.08.006 · Cited by 1,089
“Publication bias was assessed by visually inspecting funnel plots and using the Begg-Mazumdar Kendall tau (Begg and Mazumdar, 1994) and the Egger bias test (Egger et al.”
MethodYeung, S. S. Y., Reijnierse, E. M., Pham, V. K., Trappenburg, M. C., Lim, W. K., Meskers, C. G. M., & Maier, A. B. (2019) · Journal of Cachexia Sarcopenia and Muscle · doi:10.1002/jcsm.12411 · Cited by 1,115
Overweight, Obesity, and Incident Asthma
Beuther, D. A., & Sutherland, E. R. (2007) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200611-1717oc · Cited by 1,107
Prognostic value of sarcopenia in adults with solid tumours: A meta-analysis and systematic review
Shachar, S. S., Williams, G. R., Muss, H. B., & Nishijima, T. F. (2016) · European Journal of Cancer · doi:10.1016/j.ejca.2015.12.030 · Cited by 1,099
Anxiety Disorders are Associated with Reduced Heart Rate Variability: A Meta-Analysis
Chalmers, J. A., Quintana, D. S., Abbott, M. J.-A., & Kemp, A. H. (2014) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2014.00080 · Cited by 1,067
Bridge, J. A., Iyengar, S., Salary, C. B., Barbe, R. P., Birmaher, B., Pincus, H. A., Ren, L., & Brent, D. A. (2007) · JAMA · doi:10.1001/jama.297.15.1683 · Cited by 1,086
STATISTICAL ISSUES IN ECOLOGICAL META-ANALYSES
Gurevitch, J., & Hedges, L. V. (1999) · Ecology · doi:10.1890/0012-9658(1999)080[1142:siiema]2.0.co;2 · Cited by 1,081
Sexual abuse and lifetime diagnosis of psychiatric disorders: Systematic review and meta-analysis
Chen, L. P., Murad, M. H., Paras, M. L., Colbenson, K. M., Sattler, A. L., Goranson, E. N., Elamin, M. B., Seime, R. J., Shinozaki, G., Prokop, L. J., et al. (2010) · Mayo Clinic Proceedings · doi:10.4065/mcp.2009.0583 · Cited by 1,056
The appropriateness of asymmetry tests for publication bias in meta-analyses: A large survey
Ioannidis, J. P. A., & Trikalinos, T. A. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.060410 · Cited by 1,052
MAESTRE, F. T., VALLADARES, F., & REYNOLDS, J. F. (2005) · Journal of Ecology · doi:10.1111/j.1365-2745.2005.01017.x · Cited by 1,059
Dose Response Between Physical Activity and Risk of Coronary Heart Disease: A Meta-Analysis
Sattelmair, J., Pertman, J., Ding, E. L., Kohl, H. W., Haskell, W., & Lee, I.-M. (2011) · Circulation · doi:10.1161/circulationaha.110.010710 · Cited by 1,052
Methodological issues and advances in biological meta-analysis
Nakagawa, S., & Santos, E. S. A. (2012) · Evolutionary Ecology · doi:10.1007/s10682-012-9555-5 · Cited by 1,032
Delayed reward discounting and addictive behavior: a meta-analysis
MacKillop, J., Amlung, M. T., Few, L. R., Ray, L. A., Sweet, L. H., & Munafò, M. R. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2229-0 · Cited by 1,021
“Funnel plots of the relationship between effect size and standard error were examined, employing the Begg–Mazumdar rank correlation test (Begg and Mazumdar 1994) using Kendall’s τ with continuity correction and Egger’s test (Egger et al.”
MethodType 2 diabetes incidence and socio-economic position: a systematic review and meta-analysis
Agardh, E., Allebeck, P., Hallqvist, J., Moradi, T., & Sidorchuk, A. (2011) · International Journal of Epidemiology · doi:10.1093/ije/dyr029 · Cited by 1,014
Lee, Y.-C., Chiang, T.-H., Chou, C.-K., Tu, Y.-K., Liao, W.-C., Wu, M.-S., & Graham, D. Y. (2016) · Gastroenterology · doi:10.1053/j.gastro.2016.01.028 · Cited by 1,013
Adiponectin Levels and Risk of Type 2 Diabetes: A Systematic Review and Meta-analysis
Li, S., Shin, H. J., Ding, E. L., & van Dam, R. M. (2009) · JAMA · doi:10.1001/jama.2009.976 · Cited by 991
Kramer, C. K., Campbell, S., & Retnakaran, R. (2019) · Diabetologia · doi:10.1007/s00125-019-4840-2 · Cited by 965
Vancampfort, D., Firth, J., Schuch, F. B., Rosenbaum, S., Mugisha, J., Hallgren, M., Probst, M., Ward, P. B., Gaughran, F., De Hert, M., et al. (2017) · World Psychiatry · doi:10.1002/wps.20458 · Cited by 957
Fear in animals: a meta-analysis and review of risk assessment
Stankowich, T., & Blumstein, D. T. (2005) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2005.3251 · Cited by 981
Chapter 10: Addressing reporting biases
Egger, M., & Moher, D. (2011) · Cited by 997
Rizos, E. C., Ntzani, E. E., Bika, E., Kostapanos, M. S., & Elisaf, M. S. (2012) · JAMA · doi:10.1001/2012.jama.11374 · Cited by 960
Aune, D., Sen, A., Prasad, M., Norat, T., Janszky, I., Tonstad, S., Romundstad, P., & Vatten, L. J. (2016) · BMJ · doi:10.1136/bmj.i2156 · Cited by 953
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.