Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 1,201–1,300 of 1,710
Psychotropic Drugs and Falls in the Elderly People: Updated Literature Review and Meta-Analysis
Bloch, F., Thibaud, M., Dugué, B., Brèque, C., Rigaud, A.-S., & Kemoun, G. (2011) · Journal of Aging and Health · doi:10.1177/0898264310381277 · Cited by 170
Endogenous Testosterone Levels and Cardiovascular Risk: Meta-Analysis of Observational Studies
Corona, G., Rastrelli, G., Di Pasquale, G., Sforza, A., Mannucci, E., & Maggi, M. (2018) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2018.06.012 · Cited by 170
Chandler, M. J., Parks, A. C., Marsiske, M., Rotblatt, L. J., & Smith, G. E. (2016) · Neuropsychology Review · doi:10.1007/s11065-016-9330-4 · Cited by 169
The role of parenting behaviors in childhood post-traumatic stress disorder: A meta-analytic review
Williamson, V., Creswell, C., Fearon, P., Hiller, R. M., Walker, J., & Halligan, S. L. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.01.005 · Cited by 168
Göhler, A., Januzzi, J. L., Worrell, S. S., Osterziel, K. J., Scott Gazelle, G., Dietz, R., & Siebert, U. (2006) · Journal of Cardiac Failure · doi:10.1016/j.cardfail.2006.03.003 · Cited by 168
Flanigan, C., Sheikh, A., DunnGalvin, A., Brew, B. K., Almqvist, C., & Nwaru, B. I. (2018) · Clinical & Experimental Allergy · doi:10.1111/cea.13091 · Cited by 168
“We used funnel plots to evaluate the potential for publication bias and small study 212 effects and calculated the Begg and Egger’s test for this purpose.(18) Meta-analysis was 213”
MethodDoes incarceration-based drug treatment reduce recidivism? A meta-analytic synthesis of the research
Mitchell, O., Wilson, D. B., & MacKenzie, D. L. (2007) · Journal of Experimental Criminology · doi:10.1007/s11292-007-9040-2 · Cited by 168
Akinkuolie, A. O., Ngwa, J. S., Meigs, J. B., & Djoussé, L. (2011) · Clinical Nutrition · doi:10.1016/j.clnu.2011.08.013 · Cited by 167
Jackson, J. N. S., & MacKillop, J. (2016) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.01.007 · Cited by 167
McComb, C. A., Vanman, E. J., & Tobin, S. J. (2023) · Media Psychology · doi:10.1080/15213269.2023.2180647 · Cited by 167
Mullen, P. D., Ramírez, G., Strouse, D., Hedges, L. V., & Sogolow, E. (2002) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/00042560-200207011-00009 · Cited by 167
Probiotics in Helicobacter pylori eradication therapy: A systematic review and meta-analysis
Zhang, M.-M. (2015) · World Journal of Gastroenterology · doi:10.3748/wjg.v21.i14.4345 · Cited by 167
Chen, G.-C., Tong, X., Xu, J.-Y., Han, S.-F., Wan, Z.-X., Qin, J.-B., & Qin, L.-Q. (2016) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.115.122432 · Cited by 167
Liu, J., Wang, J., Leng, Y., & Lv, C. (2013) · International Journal of Cancer · doi:10.1002/ijc.28024 · Cited by 166
Li, D., Zhao, H., & Gelernter, J. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.02.024 · Cited by 165
“0002, and Kendall's tau (Begg and Mazumdar rank correlation)(89) P value (1-tailed) was 0.”
BackgroundA historical review of publication bias
Marks‐Anglin, A., & Chen, Y. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1452 · Cited by 165
Schuch, F. B., Vancampfort, D., Rosenbaum, S., Richards, J., Ward, P. B., & Stubbs, B. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.04.054 · Cited by 165
Su, D., Zhou, J., Kelley, M. S., Michaud, T. L., Siahpush, M., Kim, J., Wilson, F., Stimpson, J. P., & Pagán, J. A. (2016) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2016.04.019 · Cited by 164
Signorini, M. L., Soto, L. P., Zbrun, M. V., Sequeira, G. J., Rosmini, M. R., & Frizzo, L. S. (2012) · Research in Veterinary Science · doi:10.1016/j.rvsc.2011.05.001 · Cited by 164
“An adjusted rank correlation test using the Egger method (which examines the correlation between study size and effect) (Egger et al., 1997) and the Begg test (which examines the association between study size and effect) (Begg and Mazumdar, 1994) was used to assess publication bias.”
MethodWang, S., Sun, Q., Zhai, L., Bai, Y., Wei, W., & Jia, L. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16030340 · Cited by 164
Fitton, L., Yu, R., & Fazel, S. (2020) · Trauma, Violence, & Abuse · doi:10.1177/1524838018795269 · Cited by 164
“Publication bias was assessed using Begg’s test that assesses the correlation between the log-OR and the study weight (Begg & Mazumdar, 1994).”
MethodMorgado, M. P., Morgado, S. R., Mendes, L. C., Pereira, L. J., & Castelo-Branco, M. (2011) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp090656 · Cited by 164
Liang, W., Wang, D., Ling, X., Allen Kao, A., Kong, Y., Shang, Y., Guo, Z., & He, X. (2012) · Liver Transplantation · doi:10.1002/lt.22441 · Cited by 164
Association between Benzodiazepine Use and Dementia: A Meta-Analysis
Zhong, G., Wang, Y., Zhang, Y., & Zhao, Y. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127836 · Cited by 164
Brom, C., Stárková, T., & D'Mello, S. K. (2018) · Educational Research Review · doi:10.1016/j.edurev.2018.09.004 · Cited by 163
Riley, R. D., Burchill, S. A., Abrams, K. R., Heney, D., Lambert, P. C., Jones, D. R., Sutton, A. J., Young, B., Wailoo, A. J., & Lewis, I. J. (2003) · Health Technology Assessment · doi:10.3310/hta7050 · Cited by 163
Li, A., Liu, W., Cao, P., Zheng, Y., Bu, Z., & Zhou, T. (2017) · World Neurosurgery · doi:10.1016/j.wneu.2017.01.022 · Cited by 163
A meta-analysis on the impact of different matrix structures on species movement rates
Eycott, A. E., Stewart, G. B., Buyung-Ali, L. M., Bowler, D. E., Watts, K., & Pullin, A. S. (2012) · Landscape Ecology · doi:10.1007/s10980-012-9781-9 · Cited by 163
“2001) using data aggregated to study level (the unit of publication) and a Begg’s test for significance (Begg and Mazumdar 1994).”
Mirrahimi, A., de Souza, R. J., Chiavaroli, L., Sievenpiper, J. L., Beyene, J., Hanley, A. J., Augustin, L. S. A., Kendall, C. W. C., & Jenkins, D. J. A. (2012) · Journal of the American Heart Association · doi:10.1161/jaha.112.000752 · Cited by 161
“134) tests approached significance for evidence of publication bias.(39,40) CHD indicates coronary heart disease; GL, glycemic load.”
BackgroundMethodInfluentialStubbs, B., Rosenbaum, S., Vancampfort, D., Ward, P. B., & Schuch, F. B. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.10.010 · Cited by 163
“Publication bias was assessed with the Begg-Mazumdar (Begg and Mazumdar, 1994)and Egger (Egger et al., 1997) tests.”
MethodIntake of Fruit Juice and Incidence of Type 2 Diabetes: A Systematic Review and Meta-Analysis
Xi, B., Li, S., Liu, Z., Tian, H., Yin, X., Huai, P., Tang, W., Zhou, D., & Steffen, L. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0093471 · Cited by 161
Xiao, Y., Xia, J., Li, L., Ke, Y., Cheng, J., Xie, Y., Chu, W., Cheung, P., Kim, J. H., Colditz, G. A., et al. (2019) · Breast Cancer Research · doi:10.1186/s13058-019-1096-1 · Cited by 161
Sanada, K., Montero-Marin, J., Alda Díez, M., Salas-Valero, M., Pérez-Yus, M. C., Morillo, H., Demarzo, M. M. P., García-Toro, M., & García-Campayo, J. (2016) · Frontiers in Physiology · doi:10.3389/fphys.2016.00471 · Cited by 161
“The Begg and Mazumdar rank correlation test was also applied to test whether the adjusted and observed ESs differed significantly from each other (Begg and Mazumbar, 1994).”
MethodDietary Salt Restriction in Chronic Kidney Disease: A Meta-Analysis of Randomized Clinical Trials
Garofalo, C., Borrelli, S., Provenzano, M., De Stefano, T., Vita, C., Chiodini, P., Minutolo, R., Nicola, L. D., & Conte, G. (2018) · Nutrients · doi:10.3390/nu10060732 · Cited by 161
“Restricted maximum likelihood estimators were used to estimate model parameters [22].”
MethodBálint, S., Czobor, P., Komlósi, S., Mészáros, Á., Simon, V., & Bitter, I. (2009) · Psychological Medicine · doi:10.1017/s0033291708004236 · Cited by 161
“Our results indicated no significant effect (publication bias) using the Begg & Mazumdar (1994) approach for any of the variables (p>0.05 in all analyses).”
InfluentialKodama, S., Saito, K., Tanaka, S., Maki, M., Yachi, Y., Sato, M., Sugawara, A., Totsuka, K., Shimano, H., Ohashi, Y., et al. (2009) · Diabetes Care · doi:10.2337/dc08-1716 · Cited by 160
Insfran-Rivarola, A., Tlapa, D., Limon-Romero, J., Baez-Lopez, Y., Miranda-Ackerman, M., Arredondo-Soto, K., & Ontiveros, S. (2020) · Foods · doi:10.3390/foods9091169 · Cited by 160
“We also assessed the evidence of risk of publication bias through a funnel plot and statistical tests, including Egger’s test [71] and the Begg’s test [72] (with a 95% confidence interval).”
MethodMeta-analysis: Inhibition of renin-angiotensin system prevents new-onset atrial fibrillation
Anand, K., Mooss, A. N., Hee, T. T., & Mohiuddin, S. M. (2006) · American Heart Journal · doi:10.1016/j.ahj.2006.01.007 · Cited by 160
Liu, A.-N., Wang, L.-L., Li, H.-P., Gong, J., & Liu, X.-H. (2017) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000605 · Cited by 160
Alcohol consumption as a risk factor for pneumonia: a systematic review and meta-analysis
SAMOKHVALOV, A. V., IRVING, H. M., & REHM, J. (2010) · Epidemiology and Infection · doi:10.1017/s0950268810000774 · Cited by 159
“To test for publication bias, we used the Stata command METABIAS, which performs Egger’s regression asymmetry test [11] and the Begg-adjusted rank correlation test [12].”
MethodBahji, A., Hawken, E. R., Sepehry, A. A., Cabrera, C. A., & Vazquez, G. (2019) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12994 · Cited by 159
Vancampfort, D., Firth, J., Schuch, F., Rosenbaum, S., De Hert, M., Mugisha, J., Probst, M., & Stubbs, B. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.05.020 · Cited by 159
“Publication bias was assessed with the Begg-Mazumdar Kendall's tau (Begg and Mazumdar, 1994).”
MethodXing, X. X., Zhu, C., Liang, H. Y., Wang, K., Chu, Y. Q., Zhao, L. B., Jiang, D. C., Wang, Y. Q., & Yan, S. Y. (2019) · Annals of Pharmacotherapy · doi:10.1177/1060028019853069 · Cited by 159
Wurst, K. E., Poole, C., Ephross, S. A., & Olshan, A. F. (2010) · Birth Defects Research Part A: Clinical and Molecular Teratology · doi:10.1002/bdra.20627 · Cited by 159
Sun, Y., Neelakantan, N., Wu, Y., Lote-Oke, R., Pan, A., & van Dam, R. M. (2015) · The Journal of Nutrition · doi:10.3945/jn.115.210575 · Cited by 159
Breastfeeding and ovarian cancer risk: a meta-analysis of epidemiologic studies
Luan, N.-N., Wu, Q.-J., Gong, T.-T., Vogtmann, E., Wang, Y.-L., & Lin, B. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.062794 · Cited by 159
“Publication bias was evaluated via Egger’s linear regression (61), Begg’s rank-correlation methods (62), and funnel plots.”
MethodMental Disorders Among Gifted and Nongifted Youth: A Selected Review of the Epidemiologic Literature
Martin, L. T., Burns, R. M., & Schonlau, M. (2010) · Gifted Child Quarterly · doi:10.1177/0016986209352684 · Cited by 158
Li, D., Zhao, H., & Gelernter, J. (2012) · Human Genetics · doi:10.1007/s00439-011-1116-4 · Cited by 158
“Publication bias and fail-safe analyses In the present study, no evidence of signiWcant publication bias was found in either allelic or genotypic analysis [P values > 0.05 in both Egger’s regression and Begg’s rank correlation (Kendall’s tau) (Begg and Mazumdar 1994] tests).”
MethodInfluentialTan, B. W. Z., Pooley, J. A., & Speelman, C. P. (2016) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-016-2854-x · Cited by 157
Pan, J., Xin, L., Ma, Y.-F., Hu, L.-H., & Li, Z.-S. (2016) · American Journal of Gastroenterology · doi:10.1038/ajg.2015.418 · Cited by 158
Hall, J., Kellett, S., Berrios, R., Bains, M. K., & Scott, S. (2016) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2016.06.006 · Cited by 157
Dietary Fiber Intake Reduces Risk for Colorectal Adenoma: A Meta-analysis
Ben, Q., Sun, Y., Chai, R., Qian, A., Xu, B., & Yuan, Y. (2014) · Gastroenterology · doi:10.1053/j.gastro.2013.11.003 · Cited by 156
Meta-Analysis of Sex Differences in ADHD Symptoms and Associated Cognitive Deficits
Loyer Carbonneau, M., Demers, M., Bigras, M., & Guay, M.-C. (2021) · Journal of Attention Disorders · doi:10.1177/1087054720923736 · Cited by 156
“Publication biases were assessed using Begg’s rank correlation test (Begg & Mazumdar, 1994) and Egger’s test (Egger et al., 1997).”
MethodDepression increases the risk of mortality in patients with heart failure: a meta-analysis.
Gathright, E. C., Goldstein, C. M., Josephson, R. A., & Hughes, J. W. (2017) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2017.01.010 · Cited by 156
“Begg and Mazumdar’s rank correlation was used to assess the rank correlation between the standardized effect size and the standard errors of the effects16, 17 (Begg and Mazumdar, 1994; Begg, 1994).”
MethodXu, S., Wan, Y., Xu, M., Ming, J., Xing, Y., An, F., & Ji, Q. (2015) · BMC Pulmonary Medicine · doi:10.1186/s12890-015-0102-3 · Cited by 154
“Furthermore, the Begg’s test [24] and Egger’s test [25] were used to evaluate publication bias, which was further assessed by using funnel plots.”
MethodThe efficacy of mindfulness-based interventions in primary care: a meta-analytic review.
Demarzo, M. M. P., Montero-Marin, J., Cuijpers, P., Zabaleta-del-Olmo, E., Mahtani, K. R., Vellinga, A., Vicens, C., Lopez-del-Hoyo, Y., & Garcia-Campayo, J. (2015) · The Annals of Family Medicine · doi:10.1370/afm.1863 · Cited by 152
“The test of Egger et al 33 was significant, with a high risk of publication bias, for MBCT, follow-up of less than 6 months, and use of intention-to-treat analysis, whereas the test of Begg and Mazumdar 34 was not significant for any factors.”
Veronese, N., Watutantrige-Fernando, S., Luchini, C., Solmi, M., Sartore, G., Sergi, G., Manzato, E., Barbagallo, M., Maggi, S., & Stubbs, B. (2016) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2016.154 · Cited by 153
Kovács, I., Richman, M. J., Janka, Z., Maraz, A., & Andó, B. (2017) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2017.09.023 · Cited by 151
Gao, S.-Y., Wu, Q.-J., Sun, C., Zhang, T.-N., Shen, Z.-Q., Liu, C.-X., Gong, T.-T., Xu, X., Ji, C., Huang, D.-H., et al. (2018) · BMC Medicine · doi:10.1186/s12916-018-1193-5 · Cited by 152
Tonetti, L., Natale, V., & Randler, C. (2015) · Chronobiology International · doi:10.3109/07420528.2015.1049271 · Cited by 156
A meta-analytic review on social relationships and suicidal ideation among older adults
Chang, Q., Chan, C. H., & Yip, P. S. F. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.09.003 · Cited by 152
“Finally, we 226 examined publication bias by a funnel plot and tested by Egger’s regression and 227 Begg–Mazumdar rank correlation (Begg & Mazumdar, 1994; Sterne, Egger, & Smith, 228 2001).”
MethodLomas, T., Medina, J. C., Ivtzan, I., Rupprecht, S., & Eiroa-Orosa, F. J. (2019) · Mindfulness · doi:10.1007/s12671-018-1062-5 · Cited by 152
Tsabouri, S., Tseretopoulou, X., Priftis, K., & Ntzani, E. E. (2014) · The Journal of Allergy and Clinical Immunology: In Practice · doi:10.1016/j.jaip.2014.02.001 · Cited by 151
Obesity and Risk of Hip Fracture in Adults: A Meta-Analysis of Prospective Cohort Studies
Tang, X., Liu, G., Kang, J., Hou, Y., Jiang, F., Yuan, W., & Shi, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0055077 · Cited by 150
Meng, X.-F., Yu, J.-T., Wang, H.-F., Tan, M.-S., Wang, C., Tan, C.-C., & Tan, L. (2014) · Journal of Alzheimer s Disease · doi:10.3233/jad-140954 · Cited by 150
Lin, X., Zhang, I., Li, A., Manson, J. E., Sesso, H. D., Wang, L., & Liu, S. (2016) · The Journal of Nutrition · doi:10.3945/jn.116.237644 · Cited by 150
“Begg s and Egger s tests formally tested for publication bias (26, 27).”
BackgroundDybvik, J. S., Svendsen, M., & Aune, D. (2023) · European Journal of Nutrition · doi:10.1007/s00394-022-02942-8 · Cited by 150
“Egger ́s test [41], Begg ́s test [42], and inspection of the funnel plots [43] were used to investigate publication bias, and we considered a p value < 0.”
MethodMayhew, A. J., de Souza, R. J., Meyre, D., Anand, S. S., & Mente, A. (2016) · British Journal Of Nutrition · doi:10.1017/s0007114515004316 · Cited by 147
Chongmelaxme, B., Lee, S., Dhippayom, T., Saokaew, S., Chaiyakunapruk, N., & Dilokthornsakul, P. (2019) · The Journal of Allergy and Clinical Immunology: In Practice · doi:10.1016/j.jaip.2018.07.015 · Cited by 147
Chen, L.-W., Wu, Y., Neelakantan, N., Chong, M. F.-F., Pan, A., & van Dam, R. M. (2014) · BMC Medicine · doi:10.1186/s12916-014-0174-6 · Cited by 147
Guasch-Ferré, M., Li, J., Hu, F. B., Salas-Salvadó, J., & Tobias, D. K. (2018) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqy091 · Cited by 147
“05 to indicate significant asymmetry (17, 18).”
Chen, L., Zhang, G., Hu, M., & Liang, X. (2015) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000306 · Cited by 147
“Funnel plots, Begg’s tests, and Egger tests were used to estimate potential publication bias (Begg and Mazumdar, 1994; Egger et al., 1997).”
MethodNavaneethan, U., Njei, B., Venkatesh, P. G. K., Vargo, J. J., & Parsi, M. A. (2014) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2013.11.001 · Cited by 146
Schumann, M., Feuerbacher, J. F., Sünkeler, M., Freitag, N., Rønnestad, B. R., Doma, K., & Lundberg, T. R. (2022) · Sports Medicine · doi:10.1007/s40279-021-01587-7 · Cited by 156
Work Stress and the Risk of Cancer: A Meta-Analysis of Observational Studies
Yang, T., Qiao, Y., Xiang, S., Li, W., Gan, Y., & Chen, Y. (2019) · International Journal of Cancer · doi:10.1002/ijc.31955 · Cited by 145
“Publication bias was assessed with the Egger’s and Begg’s tests and by inspecting the symmetry of funnel plots, as the Cochrane handbook recommended.(16,17) Subgroup analyses for exposure measurement, study design, gender, study location, cancer site, smoking, drinking, body mass index (BMI), and physical activity wer…”
MethodPsychosocial interventions for informal caregivers of people living with cancer
Treanor, C. J., Santin, O., Prue, G., Coleman, H., Cardwell, C. R., O'Halloran, P., & Donnelly, M. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009912.pub2 · Cited by 145
Efficacy of vitamin D supplementation in depression in adults: a systematic review
Li, G., Mbuagbaw, L., Samaan, Z., Falavigna, M., Zhang, S., Adachi, J. D., Cheng, J., Papaioannou, A., & Thabane, L. (2014) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2013-3450 · Cited by 144
Lycopene and Risk of Prostate Cancer: A Systematic Review and Meta-Analysis
Chen, P., Zhang, W., Wang, X., Zhao, K., Negi, D. S., Zhuo, L., Qi, M., Wang, X., & Zhang, X. (2015) · Medicine · doi:10.1097/md.0000000000001260 · Cited by 143
Williams, P. F., Olsen, C. M., Hayward, N. K., & Whiteman, D. C. (2011) · International Journal of Cancer · doi:10.1002/ijc.25804 · Cited by 143
Wilson, G., Farrell, D., Barron, I., Hutchins, J., Whybrow, D., & Kiernan, M. D. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00923 · Cited by 145
Linking big five personality traits to sexuality and sexual health: A meta-analytic review
Allen, M. S., & Walter, E. E. (2018) · Psychological Bulletin · doi:10.1037/bul0000157 · Cited by 142
Moradi, S., Entezari, M. H., Mohammadi, H., Jayedi, A., Lazaridi, A.-V., Kermani, M. A. H., & Miraghajani, M. (2023) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2021.1946005 · Cited by 142
“Publication bias was assessed by the visual inspection of funnel plots, formal testing by the Egger’s regression asymmetry and Begg’s rank correlation tests (Begg and Mazumdar 1994; Egger et al. 1997) and results were considered significant at p< 0.050.”
MethodInfluentialPetretta, M., Costanzo, P., Perrone-Filardi, P., & Chiariello, M. (2010) · International Journal of Cardiology · doi:10.1016/j.ijcard.2008.08.001 · Cited by 141
Camfield, D. A., Stough, C., Farrimond, J., & Scholey, A. B. (2014) · Nutrition Reviews · doi:10.1111/nure.12120 · Cited by 155
Dietary fiber intake and total mortality: A meta-analysis of prospective cohort studies
Kim, Y., & Je, Y. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu174 · Cited by 141
Stubbs, B., Thompson, T., Acaster, S., Vancampfort, D., Gaughran, F., & Correll, C. U. (2015) · Pain · doi:10.1097/j.pain.0000000000000304 · Cited by 141
“Kendall's tau [4]and Egger bias test [17].”
Incidence of chronic atrophic gastritis: systematic review and meta-analysis of follow-up studies
Adamu, M. A., Weck, M. N., Gao, L., & Brenner, H. (2010) · European Journal of Epidemiology · doi:10.1007/s10654-010-9482-0 · Cited by 140
Bahji, A., Ermacora, D., Stephenson, C., Hawken, E. R., & Vazquez, G. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.03.030 · Cited by 139
Metaanalysis of mood and substance use disorders in proximal risk for suicide deaths
Conner, K. R., Bridge, J. A., Davidson, D. J., Pilcher, C., & Brent, D. A. (2019) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12422 · Cited by 140
“Publication bias was assessed visually using funnel plots and quantitatively using an adjusted rank correlation test (Begg & Mazumdar, 1994) and a regression procedure to measure funnel plot asymmetry (Egger, Davey Smith, Schneider, & Minder, 1997).”
The relationship between sense of coherence and post-traumatic stress: a meta-analysis
Schäfer, S. K., Becker, N., King, L., Horsch, A., & Michael, T. (2019) · European Journal of Psychotraumatology · doi:10.1080/20008198.2018.1562839 · Cited by 140
“To identify a possible bias in the data, funnel plots (Light & Pillemer, 1984) and rank correlations (Begg & Mazumdar, 1994) were used.”
Methodde Heus, R. A. A., Tzourio, C., Lee, E. J. L., Opozda, M., Vincent, A. D., Anstey, K. J., Hofman, A., Kario, K., Lattanzi, S., Launer, L. J., et al. (2021) · Hypertension · doi:10.1161/hypertensionaha.121.17797 · Cited by 138
Pjrek, E., Friedrich, M.-E., Cambioli, L., Dold, M., Jäger, F., Komorowski, A., Lanzenberger, R., Kasper, S., & Winkler, D. (2020) · Psychotherapy and Psychosomatics · doi:10.1159/000502891 · Cited by 136
Pharmacotherapy of adult attention deficit hyperactivity disorder (ADHD): a meta-analysis
Mészáros, Á., Czobor, P., Bálint, S., Komlósi, S., Simon, V., & Bitter, I. (2009) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145709990198 · Cited by 138
“Publication bias was investigated on the basis of funnel plots using Begg & Mazumdar’s rank correlation approach (Begg & Mazumdar, 1994).”
MethodYe, X., Kong, W., Zafar, M. I., & Chen, L.-L. (2019) · Cardiovascular Diabetology · doi:10.1186/s12933-019-0851-z · Cited by 138
Meng, Y., Li, S., Khan, J., Dai, Z., Li, C., Hu, X., Shen, Q., & Xue, Y. (2021) · Nutrients · doi:10.3390/nu13082636 · Cited by 138
“The potential publication biases were evaluated by using funnel plots and further tested by Begg’s test [33] and Egger’s test [34].”
MethodAllen, M. S., & Walter, E. E. (2018) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2018.02.008 · Cited by 137
Testosterone and Cardiovascular Risk: Meta-Analysis of Interventional Studies
Corona, G., Rastrelli, G., Di Pasquale, G., Sforza, A., Mannucci, E., & Maggi, M. (2018) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2018.04.641 · Cited by 138
Fish consumption and all-cause mortality: a meta-analysis of cohort studies
Zhao, L.-G., Sun, J.-W., Yang, Y., Ma, X., Wang, Y.-Y., & Xiang, Y.-B. (2016) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2015.72 · Cited by 132
Zhou, D., Yu, H., He, F., Reilly, K. H., Zhang, J., Li, S., Zhang, T., Wang, B., Ding, Y., & Xi, B. (2014) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.079152 · Cited by 137
Jayedi, A., Rashidy-Pour, A., Parohan, M., Zargar, M. S., & Shab-Bidar, S. (2018) · Advances in Nutrition · doi:10.1093/advances/nmy040 · Cited by 137
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.