Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 101–200 of 1,708
Tang, K. L., Caffrey, N. P., Nóbrega, D. B., Cork, S. C., Ronksley, P. E., Barkema, H. W., Polachek, A. J., Ganshorn, H., Sharma, N., Kellner, J. D., et al. (2017) · The Lancet Planetary Health · doi:10.1016/s2542-5196(17)30141-9 · Cited by 942
Emotion regulation strategies in depressive and anxiety symptoms in youth: A meta-analytic review
Schäfer, J. Ö., Naumann, E., Holmes, E. A., Tuschen-Caffier, B., & Samson, A. C. (2017) · Journal of Youth and Adolescence · doi:10.1007/s10964-016-0585-0 · Cited by 941
Rueger, S. Y., Malecki, C. K., Pyun, Y., Aycock, C., & Coyle, S. (2016) · Psychological Bulletin · doi:10.1037/bul0000058 · Cited by 946
Rebbeck, T. R., Kauff, N. D., & Domchek, S. M. (2009) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djn442 · Cited by 939
Birth Weight and Risk of Type 2 Diabetes: A Systematic Review
(2008) · JAMA · doi:10.1001/jama.2008.886 · Cited by 941
Popova, S., Lange, S., Probst, C., Gmel, G., & Rehm, J. (2017) · The Lancet Global Health · doi:10.1016/s2214-109x(17)30021-9 · Cited by 937
Facial Emotion Perception in Schizophrenia: A Meta-analytic Review
Kohler, C. G., Walker, J. B., Martin, E. A., Healey, K. M., & Moberg, P. J. (2010) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn192 · Cited by 930
Bjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007176.pub2 · Cited by 924
Jonas, D. E., Amick, H. R., Feltner, C., Bobashev, G., Thomas, K., Wines, R., Kim, M. M., Shanahan, E., Gass, C. E., Rowe, C. J., et al. (2014) · JAMA · doi:10.1001/jama.2014.3628 · Cited by 923
Sookoian, S., & Pirola, C. J. (2011) · Hepatology · doi:10.1002/hep.24283 · Cited by 920
Fibroids and infertility: an updated systematic review of the evidence
Pritts, E. A., Parker, W. H., & Olive, D. L. (2009) · Fertility and Sterility · doi:10.1016/j.fertnstert.2008.01.051 · Cited by 913
The Association Between Obesity and Low Back Pain: A Meta-Analysis
Shiri, R., Karppinen, J., Leino-Arjas, P., Solovieva, S., & Viikari-Juntura, E. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwp356 · Cited by 909
Metabolomics in Prediabetes and Diabetes: A Systematic Review and Meta-analysis
Guasch-Ferré, M., Hruby, A., Toledo, E., Clish, C. B., Martínez-González, M. A., Salas-Salvadó, J., & Hu, F. B. (2016) · Diabetes Care · doi:10.2337/dc15-2251 · Cited by 905
Kelley, J. M., Kraft-Todd, G., Schapira, L., Kossowsky, J., & Riess, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094207 · Cited by 902
Work stress in the etiology of coronary heart disease—a meta-analysis
Kivimäki, M., Virtanen, M., Elovainio, M., Kouvonen, A., Väänänen, A., & Vahtera, J. (2006) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.1049 · Cited by 905
Meta-analysis of the Association Between the Level of Cannabis Use and Risk of Psychosis
Marconi, A., Di Forti, M., Lewis, C. M., Murray, R. M., & Vassos, E. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw003 · Cited by 899
Song, P., Zha, M., Yang, Q., Zhang, Y., Li, X., & Rudan, I. (2021) · Journal of Global Health · doi:10.7189/jogh.11.04009 · Cited by 896
Shiga, T., Wajima, Z., Inoue, T., & Sakamoto, A. (2005) · Anesthesiology · doi:10.1097/00000542-200508000-00027 · Cited by 902
Frolkis, A. D., Dykeman, J., Negrón, M. E., deBruyn, J., Jette, N., Fiest, K. M., Frolkis, T., Barkema, H. W., Rioux, K. P., Panaccione, R., et al. (2013) · Gastroenterology · doi:10.1053/j.gastro.2013.07.041 · Cited by 892
The impact of diabetes on tuberculosis treatment outcomes: A systematic review
Baker, M. A., Harries, A. D., Jeon, C. Y., Hart, J. E., Kapur, A., Lönnroth, K., Ottmani, S.-E., Goonesekera, S. D., & Murray, M. B. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-81 · Cited by 881
Koreth, J., Schlenk, R., Kopecky, K. J., Honda, S., Sierra, J., Djulbegovic, B. J., Wadleigh, M., DeAngelo, D. J., Stone, R. M., Sakamaki, H., et al. (2009) · JAMA · doi:10.1001/jama.2009.813 · Cited by 886
The relationship between materialism and personal well-being: A meta-analysis
Dittmar, H., Bond, R., Hurst, M., & Kasser, T. (2014) · Journal of Personality and Social Psychology · doi:10.1037/a0037409 · Cited by 890
“The rank correlation between standard error and effect size (Begg & Mazumdar, 1994) was".08 and not significant.”
Iorio, A., Spencer, F. A., Falavigna, M., Alba, C., Lang, E., Burnand, B., McGinn, T., Hayden, J., Williams, K., Shea, B., et al. (2015) · BMJ · doi:10.1136/bmj.h870 · Cited by 880
Suicide Rates Among Physicians: A Quantitative and Gender Assessment (Meta-Analysis)
Schernhammer, E. S., & Colditz, G. A. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.12.2295 · Cited by 876
Lee, S. S., Humphreys, K. L., Flory, K., Liu, R., & Glass, K. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.01.006 · Cited by 875
“In addition to calculating the mean effect size and its 95% confidence interval, we estimated heterogeneity of effects using the standard Cochran's Q Test and publication bias using Egger's (Egger, Smith, Schneider, & Minder, 1997) and Begg's tests (Begg & Mazumdar, 1994).”
MethodMcFarland, L. V. (2006) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2006.00465.x · Cited by 872
“A funnel plot as well as an adjusted rank correlation test using the Begg and Mazumdar method were used to assess publication bias (29, 30).”
MethodNewberry, S. J. (2012) · JAMA · doi:10.1001/jama.2012.3507 · Cited by 870
Haider, B. A., Olofin, I., Wang, M., Spiegelman, D., Ezzati, M., Fawzi, W. W., & on behalf of Nutrition Impact Model Study Group (anaemia) (2013) · BMJ · doi:10.1136/bmj.f3443 · Cited by 871
Sex differences in impulsivity: A meta-analysis.
Cross, C. P., Copping, L. T., & Campbell, A. (2011) · Psychological Bulletin · doi:10.1037/a0021591 · Cited by 866
Predicting psychological and subjective well-being from personality: A meta-analysis
Anglim, J., Horwood, S., Smillie, L. D., Marrero, R. J., & Wood, J. K. (2020) · Psychological Bulletin · doi:10.1037/bul0000226 · Cited by 855
Yu, Z., Han, S., Zhu, J., Sun, X., Ji, C., & Guo, X. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061627 · Cited by 858
Stress-related and basic determinants of hair cortisol in humans: a meta-analysis
Stalder, T., Steudte-Schmiedgen, S., Alexander, N., Klucken, T., Vater, A., Wichmann, S., Kirschbaum, C., & Miller, R. (2017) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2016.12.017 · Cited by 855
Prati, G., & Mancini, A. D. (2021) · Psychological Medicine · doi:10.1017/s0033291721000015 · Cited by 842
Meta-analysis of risk factors for cutaneous melanoma: I. Common and atypical naevi
Gandini, S., Sera, F., Cattaruzza, M. S., Pasquini, P., Abeni, D., Boyle, P., & Melchi, C. F. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2004.10.015 · Cited by 842
Migraine and cardiovascular disease: systematic review and meta-analysis
Schurks, M., Rist, P. M., Bigal, M. E., Buring, J. E., Lipton, R. B., & Kurth, T. (2009) · BMJ · doi:10.1136/bmj.b3914 · Cited by 841
Association Between Bullying and Psychosomatic Problems: A Meta-analysis
Gini, G., & Pozzoli, T. (2009) · Pediatrics · doi:10.1542/peds.2008-1215 · Cited by 833
A social comparison theory meta-analysis 60+ years on.
Gerber, J. P., Wheeler, L., & Suls, J. (2018) · Psychological Bulletin · doi:10.1037/bul0000127 · Cited by 808
Bolen, S., Feldman, L., Vassy, J., Wilson, L., Yeh, H.-C., Marinopoulos, S., Wiley, C., Selvin, E., Wilson, R., Bass, E. B., et al. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-6-200709180-00178 · Cited by 823
Depression and Risk of Stroke Morbidity and Mortality: A Meta-analysis and Systematic Review
Pan, A., Sun, Q., Okereke, O. I., Rexrode, K. M., & Hu, F. B. (2011) · JAMA · doi:10.1001/jama.2011.1282 · Cited by 819
Prevalence of depression during the COVID-19 outbreak: A meta-analysis of community-based studies
Bueno-Notivol, J., Gracia-García, P., Olaya, B., Lasheras, I., López-Antón, R., & Santabárbara, J. (2021) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2020.07.007 · Cited by 820
Revised standards for statistical evidence
Johnson, V. E. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1313476110 · Cited by 808
Inflammation and sarcopenia: A systematic review and meta-analysis
Bano, G., Trevisan, C., Carraro, S., Solmi, M., Luchini, C., Stubbs, B., Manzato, E., Sergi, G., & Veronese, N. (2017) · Maturitas · doi:10.1016/j.maturitas.2016.11.006 · Cited by 801
Meta-analysis: chronic disease self-management programs for older adults
Chodosh, J., Morton, S. C., Mojica, W., Maglione, M., Suttorp, M. J., Hilton, L., Rhodes, S., & Shekelle, P. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-143-6-200509200-00007 · Cited by 790
Brien, S. E., Ronksley, P. E., Turner, B. J., Mukamal, K. J., & Ghali, W. A. (2011) · BMJ · doi:10.1136/bmj.d636 · Cited by 791
Environmental Risk Factors for Inflammatory Bowel Diseases: An Umbrella Review of Meta-analyses
Piovani, D., Danese, S., Peyrin-Biroulet, L., Nikolopoulos, G. K., Lytras, T., & Bonovas, S. (2019) · Gastroenterology · doi:10.1053/j.gastro.2019.04.016 · Cited by 784
Zhai, L., Zhang, H., & Zhang, D. (2015) · Depression and Anxiety · doi:10.1002/da.22386 · Cited by 786
Gandini, S., Sera, F., Cattaruzza, M. S., Pasquini, P., Zanetti, R., Masini, C., Boyle, P., & Melchi, C. F. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2005.03.034 · Cited by 787
Domestic violence during the COVID-19 pandemic—evidence from a systematic review and meta-analysis
Piquero, A. R., Jennings, W. G., Jemison, E., Kaukinen, C., & Knaul, F. M. (2021) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2021.101806 · Cited by 759
“…(for example, Ashby, 2020; Nix & Richards, 2021). publication bias/small study effects were formally evaluated with the Begg test (Begg & Mazumdar, 1994), 5 and the result from this test did not detect any significant publication bias/small study effects (Begg: z = (cid:0) 0.37,…”
InfluentialSmoking and Colorectal Cancer: A Meta-analysis
Botteri, E., Iodice, S., Bagnardi, V., Raimondi, S., Lowenfels, A. B., & Maisonneuve, P. (2008) · JAMA · doi:10.1001/jama.2008.839 · Cited by 778
Is diabetes mellitus associated with mortality and severity of COVID-19? A meta-analysis
Kumar, A., Arora, A., Sharma, P., Anikhindi, S. A., Bansal, N., Singla, V., Khare, S., & Srivastava, A. (2020) · Diabetes & Metabolic Syndrome: Clinical Research & Reviews · doi:10.1016/j.dsx.2020.04.044 · Cited by 776
Meta-Analysis: Pharmacologic Treatment of Obesity
Li, Z., Maglione, M., Tu, W., Mojica, W., Arterburn, D., Shugarman, L. R., Hilton, L., Suttorp, M., Solomon, V., Shekelle, P. G., et al. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-7-200504050-00012 · Cited by 774
Bidirectional Association Between Depression and Metabolic Syndrome
Pan, A., Keum, N., Okereke, O. I., Sun, Q., Kivimaki, M., Rubin, R. R., & Hu, F. B. (2012) · Diabetes Care · doi:10.2337/dc11-2055 · Cited by 772
The Risk of Lymphoma Development in Autoimmune Diseases: A Meta-analysis
Zintzaras, E. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.20.2337 · Cited by 771
Latthe, P., Latthe, M., Say, L., Gülmezoglu, M., & Khan, K. S. (2006) · BMC Public Health · doi:10.1186/1471-2458-6-177 · Cited by 764
Nishino, M., Giobbie-Hurder, A., Hatabu, H., Ramaiya, N. H., & Hodi, F. S. (2016) · JAMA Oncology · doi:10.1001/jamaoncol.2016.2453 · Cited by 758
Physical Activity of Moderate Intensity and Risk of Type 2 Diabetes
Jeon, C. Y., Lokken, R. P., Hu, F. B., & van Dam, R. M. (2007) · Diabetes Care · doi:10.2337/dc06-1842 · Cited by 758
“The Egger and Begg tests provided no evidence for publication bias for the BMIunadjusted (P & 0.63 and P & 0.84, respectively) and BMI-adjusted (P & 0.83 and P & 0.40) association between moderately intense physical activity and risk of type 2 diabetes.”
MethodInfluentialCochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy
(2023) · doi:10.1002/9781119756194 · Cited by 757
Is there publication bias in the reporting of cancer risk in Barrett's esophagus?
Shaheen, N. J., Crosby, M. A., Bozymski, E. M., & Sandler, R. S. (2000) · Gastroenterology · doi:10.1053/gast.2000.9302 · Cited by 758
Decreased risk of suicides and attempts during long‐term lithium treatment: a meta‐analytic review
Baldessarini, R. J., Tondo, L., Davis, P., Pompili, M., Goodwin, F. K., & Hennen, J. (2006) · Bipolar Disorders · doi:10.1111/j.1399-5618.2006.00344.x · Cited by 753
An exploratory test for an excess of significant findings
Ioannidis, J. P., & Trikalinos, T. A. (2007) · Clinical Trials · doi:10.1177/1740774507079441 · Cited by 751
“10, as in proposed publication bias tests [13,16].”
BackgroundStanley, T. D. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00250.x · Cited by 742
Associations between Hemodialysis Access Type and Clinical Outcomes: A Systematic Review
Ravani, P., Palmer, S. C., Oliver, M. J., Quinn, R. R., MacRae, J. M., Tai, D. J., Pannu, N. I., Thomas, C., Hemmelgarn, B. R., Craig, J. C., et al. (2013) · Journal of the American Society of Nephrology · doi:10.1681/asn.2012070643 · Cited by 738
Koren, G., Pastuszak, A., & Ito, S. (1998) · New England Journal of Medicine · doi:10.1056/nejm199804163381607 · Cited by 748
Fast track surgery versus conventional recovery strategies for colorectal surgery
Spanjersberg, W. R., Reurings, J., Keus, F., & van Laarhoven, C. J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007635.pub2 · Cited by 735
Tobacco Smoke, Indoor Air Pollution and Tuberculosis: A Systematic Review and Meta-Analysis
Lin, H.-H., Ezzati, M., & Murray, M. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040020 · Cited by 739
Global Prevalence of Hypertension in Children: A Systematic Review and Meta-analysis
Song, P., Zhang, Y., Yu, J., Zha, M., Zhu, Y., Rahimi, K., & Rudan, I. (2019) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2019.3310 · Cited by 732
Barker, T. H., Migliavaca, C. B., Stein, C., Colpani, V., Falavigna, M., Aromataris, E., & Munn, Z. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01381-z · Cited by 738
“Tests to evaluate publication bias, such as Egger’s test [49], Begg’s test [50] and funnel plots, were developed in the context of comparative data.”
MethodPrenatal risk factors for autism: comprehensive meta-analysis
Gardener, H., Spiegelman, D., & Buka, S. L. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.051672 · Cited by 736
de Munter, J. S. L., Hu, F. B., Spiegelman, D., Franz, M., & van Dam, R. M. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040261 · Cited by 734
Wulsin, L. R., & Singal, B. M. (2003) · Psychosomatic Medicine · doi:10.1097/01.psy.0000058371.50240.e3 · Cited by 730
Petrelli, F., Tomasello, G., Borgonovo, K., Ghidini, M., Turati, L., Dallera, P., Passalacqua, R., Sgroi, G., & Barni, S. (2017) · JAMA Oncology · doi:10.1001/jamaoncol.2016.4227 · Cited by 729
Childhood maltreatment and obesity: systematic review and meta-analysis
Danese, A., & Tan, M. (2014) · Molecular Psychiatry · doi:10.1038/mp.2013.54 · Cited by 709
Opioids for Chronic Noncancer Pain: A Systematic Review and Meta-analysis
Busse, J. W., Wang, L., Kamaleldin, M., Craigie, S., Riva, J. J., Montoya, L., Mulla, S. M., Lopes, L. C., Vogel, N., Chen, E., et al. (2018) · JAMA · doi:10.1001/jama.2018.18472 · Cited by 716
Yin, J., Jin, X., Shan, Z., Li, S., Huang, H., Li, P., Peng, X., Peng, Z., Yu, K., Bao, W., et al. (2017) · Journal of the American Heart Association · doi:10.1161/jaha.117.005947 · Cited by 721
Semkovska, M., & McLoughlin, D. M. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.06.009 · Cited by 718
Household Transmission of SARS-CoV-2: A Systematic Review and Meta-analysis
Madewell, Z. J., Yang, Y., Longini, I. M., Halloran, M. E., & Dean, N. E. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.31756 · Cited by 716
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2007) · Statistics in Medicine · doi:10.1002/sim.2889 · Cited by 716
O'Dea, R. E., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Gurevitch, J., Page, M. J., Stewart, G., Moher, D., et al. (2021) · Biological Reviews · doi:10.1111/brv.12721 · Cited by 697
Contact investigation for tuberculosis: a systematic review and meta-analysis
Fox, G. J., Barry, S. E., Britton, W. J., & Marks, G. B. (2013) · European Respiratory Journal · doi:10.1183/09031936.00070812 · Cited by 709
Bertholet, N. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.9.986 · Cited by 710
The relationship between nature connectedness and eudaimonic well-being: A meta-analysis
Pritchard, A., Richardson, M., Sheffield, D., & McEwan, K. (2020) · Journal of Happiness Studies · doi:10.1007/s10902-019-00118-6 · Cited by 702
“This was explored further using two more tests for publication bias: the Begg test (Begg and Mazumdar 1994) and the Egger test (Egger et al.”
MethodSterne, J. A. C., & Harbord, R. M. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400204 · Cited by 708
“Statistical tests for funnel-plot asymmetry have been proposed by Begg and Mazumdar (1994) and by Egger et al.”
Petti, S., Glendor, U., & Andersson, L. (2018) · Dental Traumatology · doi:10.1111/edt.12389 · Cited by 698
Interventions for treating oral mucositis for patients with cancer receiving treatment
Clarkson, J. E., Worthington, H. V., Furness, S., McCabe, M., Khalid, T., & Meyer, S. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001973.pub4 · Cited by 674
2015 Updated Method Guideline for Systematic Reviews in the Cochrane Back and Neck Group
Furlan, A. D., Malmivaara, A., Chou, R., Maher, C. G., Deyo, R. A., Schoene, M., Bronfort, G., & van Tulder, M. W. (2015) · Spine · doi:10.1097/brs.0000000000001061 · Cited by 704
Alcohol as a Risk Factor for Type 2 Diabetes
Baliunas, D. O., Taylor, B. J., Irving, H., Roerecke, M., Patra, J., Mohapatra, S., & Rehm, J. (2009) · Diabetes Care · doi:10.2337/dc09-0227 · Cited by 703
Fact-checking: a meta-analysis of what works and for whom
Walter, N., Cohen, J., Holbert, R. L., & Morag, Y. (2020) · Political Communication · doi:10.1080/10584609.2019.1668894 · Cited by 690
Magill, M., & Ray, L. A. (2009) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2009.70.516 · Cited by 694
Interpretation of tests of heterogeneity and bias in meta-analysis
Ioannidis, J. P. A. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.00986.x · Cited by 696
Fulton, J. J., Calhoun, P. S., Wagner, H. R., Schry, A. R., Hair, L. P., Feeling, N., Elbogen, E., & Beckham, J. C. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.02.003 · Cited by 693
Beydoun, M. A., Beydoun, H. A., Gamaldo, A. A., Teel, A., Zonderman, A. B., & Wang, Y. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-643 · Cited by 671
“This type of bias was also formally tested using the Begg-adjusted rank correlation tests [264] and the Egger’s regression asymmetry test [265].”
MethodMeta‐Analysis in Medical Research: The Handbook for the Understanding and Practice of Meta‐Analysis
(2005) · Wiley eBooks · doi:10.1002/9780470994894 · Cited by 687
Do Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials
Vickers, A., Goyal, N., Harland, R., & Rees, R. (1998) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00150-5 · Cited by 683
Nochaiwong, S., Ruengorn, C., Thavorn, K., Hutton, B., Awiphan, R., Phosuya, C., Ruanta, Y., Wongpakaran, N., & Wongpakaran, T. (2021) · Scientific Reports · doi:10.1038/s41598-021-89700-8 · Cited by 681
Gender differences in the prevalence of nonsuicidal self-injury: A meta-analysis
Bresin, K., & Schoenleber, M. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.02.009 · Cited by 678
Vitamin D supplementation for prevention of mortality in adults
Bjelakovic, G., Gluud, L. L., Nikolova, D., Whitfield, K., Wetterslev, J., Simonetti, R. G., Bjelakovic, M., & Gluud, C. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007470.pub3 · Cited by 695
Beydoun, H. A., Beydoun, M. A., Kaufman, J. S., Lo, B., & Zonderman, A. B. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.04.025 · Cited by 680
Fedirko, V., Tramacere, I., Bagnardi, V., Rota, M., Scotti, L., Islami, F., Negri, E., Straif, K., Romieu, I., La Vecchia, C., et al. (2011) · Annals of Oncology · doi:10.1093/annonc/mdq653 · Cited by 682
Allergen injection immunotherapy for seasonal allergic rhinitis
Calderon, M. A., Alves, B., Jacobson, M., Hurwitz, B., Sheikh, A., & Durham, S. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001936.pub2 · Cited by 678
The journal of maternal-fetal & neonatal medicine
Societies, O. P. (2002) · Cited by 675
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.