Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 1,301–1,400 of 1,710
Liu, J.-W., Tu, Y.-K., Lai, Y.-F., Lee, H.-C., Tsai, P.-S., Chen, T.-J., Huang, H.-C., Chen, Y.-T., & Chiu, H.-Y. (2019) · Sleep · doi:10.1093/sleep/zsz054 · Cited by 137
Spencer, N. J., Blackburn, C. M., & Read, J. M. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-007062 · Cited by 137
Detecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132
“Broadly, tests fall into two classes: (i) non-parametric tests using rank-correlation methods, going back to Begg and Mazumdar (1994) and (ii) regression tests, represented by a test proposed by Egger et al. (1997a).”
MethodKandelouei, T., Abbasifard, M., Imani, D., Aslani, S., Razi, B., Fasihi, M., Shafiekhani, S., Mohammadi, K., Jamialahmadi, T., Reiner, Ž., et al. (2022) · Mediators of Inflammation · doi:10.1155/2022/8732360 · Cited by 136
Post-traumatic growth following acquired brain injury: a systematic review and meta-analysis
Grace, J. J., Kinsella, E. L., Muldoon, O. T., & Fortune, D. G. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01162 · Cited by 136
Effects of digital games on student motivation in mathematics: A meta‐analysis in K‐12
Fadda, D., Pellegrini, M., Vivanet, G., & Zandonella Callegher, C. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12618 · Cited by 135
Perinetti, G., Primožič, J., Franchi, L., & Contardo, L. (2015) · PLoS ONE · doi:10.1371/journal.pone.0141198 · Cited by 138
Warschkow, R., Tarantino, I., Ukegjini, K., Beutner, U., Güller, U., Schmied, B. M., Müller, S. A., Schultes, B., & Thurnheer, M. (2013) · Obesity Surgery · doi:10.1007/s11695-012-0852-4 · Cited by 135
Chio, F. H. N., Mak, W. W. S., & Yu, B. C. L. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.101986 · Cited by 135
Huang, X.-Z., Gao, P., Song, Y.-X., Xu, Y., Sun, J.-X., Chen, X.-W., Zhao, J.-H., & Wang, Z.-N. (2019) · OncoImmunology · doi:10.1080/2162402x.2019.1665973 · Cited by 132
“15).(38-40) To assess the bias risk of an individual study on the results and to investigate the stability and consistency of our results, sensitivity analyses were conducted to investigate whether a single study dominated the results by a leave-one-out approach (individually omitting each study).”
ResultObesity and risk of bladder cancer: A dose-response meta-analysis of 15 cohort studies
Sun, J.-W., Zhao, L.-G., Yang, Y., Ma, X., Wang, Y.-Y., & Xiang, Y.-B. (2015) · PLOS ONE · doi:10.1371/journal.pone.0119313 · Cited by 133
Zhang, C., Jiang, J., Tian, F., Zhao, J., Zhang, H., Zhai, Q., & Chen, W. (2020) · Clinical Nutrition · doi:10.1016/j.clnu.2020.01.005 · Cited by 131
The MASH Research Team, Scott-Sheldon, L. A. J., Carey, K. B., Johnson, B. T., & Carey, M. P. (2017) · AIDS and Behavior · doi:10.1007/s10461-017-1886-3 · Cited by 133
Suksatan, W., Moradi, S., Naeini, F., Bagheri, R., Mohammadi, H., Talebi, S., Mehrabani, S., Hojjati Kermani, M. A., & Suzuki, K. (2021) · Nutrients · doi:10.3390/nu14010174 · Cited by 133
“Publication bias was assessed by the visual inspection of funnel plots, formal testing by Egger’s regression asymmetry, and Begg’s rank correlation tests [31,32]; results were considered significant at p < 0.”
MethodSagoo, G. S., Tatt, I., Salanti, G., Butterworth, A. S., Sarwar, N., van Maarle, M., Jukema, J. W., Wiman, B., Kastelein, J. J. P., Bennet, A. M., et al. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn235 · Cited by 132
“Funnel plots and associated statistical tests (42, 43) were used to assess assumptions involved in metaanalysis and to explore the relation between precision and magnitude of association.”
MethodLederman, O., Ward, P. B., Firth, J., Maloney, C., Carney, R., Vancampfort, D., Stubbs, B., Kalucy, M., & Rosenbaum, S. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.11.004 · Cited by 128
The relationship between acceptance of cancer and distress: A meta-analytic review
Secinti, E., Tometich, D. B., Johns, S. A., & Mosher, C. E. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2019.05.001 · Cited by 132
Clerx, L., Visser, P. J., Verhey, F., & Aalten, P. (2012) · Journal of Alzheimer s Disease · doi:10.3233/jad-2011-110797 · Cited by 132
When Is Silence Golden? A Meta-analysis on Antecedents and Outcomes of Employee Silence
Hao, L., Zhu, H., He, Y., Duan, J., Zhao, T., & Meng, H. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-021-09788-7 · Cited by 132
“We used the random-effects trim-and-fill method (Duval & Tweedie, 2000), fail-safe N (Rosenthal, 1979), and the Begg and Mazumdar’s rank correlation test (Begg & Mazumdar, 1994) to estimate the extent of publication bias in the meta-analytic analyses.”
MethodGong, Y., Huang, Z., Christensen, E., & Gluud, C. (2007) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2007.01235.x · Cited by 131
“We explored publication bias and other bias according to Begg’s and Egger’s methods (24, 25) with STATA.”
MethodBisphosphonates in multiple myeloma: a network meta-analysis
Mhaskar, R., Redzepovic, J., Wheatley, K., Clark, O. A. C., Miladinovic, B., Glasmacher, A., Kumar, A., & Djulbegovic, B. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003188.pub3 · Cited by 130
Laughter-inducing therapies: systematic review and meta-analysis.
van der Wal, C. N., & Kok, R. N. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.02.018 · Cited by 131
Shadish, W. R., Zelinsky, N. A. M., Vevea, J. L., & Kratochwill, T. R. (2016) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.308 · Cited by 130
Levine, T. R., Asada, K. J., & Carpenter, C. (2009) · Communication Monographs · doi:10.1080/03637750903074685 · Cited by 131
A Meta-analysis of the Segmenting Effect
Rey, G. D., Beege, M., Nebel, S., Wirzberger, M., Schmitt, T. H., & Schneider, S. (2019) · Educational Psychology Review · doi:10.1007/s10648-018-9456-4 · Cited by 131
Dissociation and emotion regulation strategies: A meta-analytic review
Cavicchioli, M., Scalabrini, A., Northoff, G., Mucci, C., Ogliari, A., & Maffei, C. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.09.011 · Cited by 146
Li, W., Wang, D., Cao, S., Yin, X., Gong, Y., Gan, Y., Zhou, Y., & Lu, Z. (2016) · International Journal of Cardiology · doi:10.1016/j.ijcard.2016.08.302 · Cited by 130
Identification and impact of outcome selection bias in meta‐analysis
Williamson, P. R., & Gamble, C. (2005) · Statistics in Medicine · doi:10.1002/sim.2025 · Cited by 132
Wu, J., Yao, X.-Y., Shi, R.-X., Liu, S.-F., & Wang, X.-Y. (2018) · Reproductive Health · doi:10.1186/s12978-018-0519-2 · Cited by 130
The prevalence of pain in bipolar disorder: a systematic review and large-scale meta-analysis
Stubbs, B., Eggermont, L., Mitchell, A. J., De Hert, M., Correll, C. U., Soundy, A., Rosenbaum, S., & Vancampfort, D. (2015) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12325 · Cited by 129
So, M., Yamaguchi, S., Hashimoto, S., Sado, M., Furukawa, T. A., & McCrone, P. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-113 · Cited by 129
“Begg’s [33] and Egger’s [34] tests were also conducted for statistical checking.”
MethodHaug, T., Nordgreen, T., Öst, L. G., & Havik, O. E. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.04.002 · Cited by 128
Ampoorter, E., de Schrijver, A., van Nevel, L., Hermy, M., & Verheyen, K. (2012) · Annals of Forest Science · doi:10.1007/s13595-012-0199-y · Cited by 129
Muche, A. A., Olayemi, O. O., & Gete, Y. K. (2019) · Archives of Public Health · doi:10.1186/s13690-019-0362-0 · Cited by 128
“objectively and funnel plot subjectively [36, 37].”
Apolipoprotein E and Dementia in Parkinson Disease: A Meta-analysis
Huang, X., Chen, P., Kaufer, D. I., Tröster, A. I., & Poole, C. (2006) · Archives of Neurology · doi:10.1001/archneur.63.2.189 · Cited by 128
Mwanri, A. W., Kinabo, J., Ramaiya, K., & Feskens, E. J. M. (2015) · Tropical Medicine & International Health · doi:10.1111/tmi.12521 · Cited by 128
JOURNAL QUALITY, EFFECT SIZE, AND PUBLICATION BIAS IN META-ANALYSIS
Murtaugh, P. A. (2002) · Ecology · doi:10.1890/0012-9658(2002)083[1162:jqesap]2.0.co;2 · Cited by 126
“…this \publication bias" has been gathered with a variety of methods (Light and Pillemer 1984; Begg and Berlin 1988; Dear and Begg 1992; Begg 1994; Begg and Mazumdar 1994; Sterling, 2 Rosenbaum and Weinkam 1995; Palmer 1999), and several approaches have been suggested for altering the execution…”
Costa, R., Carneiro, B. A., Agulnik, M., Rademaker, A. W., Pai, S. G., Villaflor, V. M., Cristofanilli, M., Sosman, J. A., & Giles, F. J. (2017) · Oncotarget · doi:10.18632/oncotarget.13315 · Cited by 123
Kollias, A., Dafni, M., Poulidakis, E., Ntineri, A., & Stergiou, G. S. (2014) · Journal of Hypertension · doi:10.1097/hjh.0000000000000384 · Cited by 125
“Publication bias was evaluated by means of Begg’s funnel plots and Begg’s and Egger’s statistical tests [12,13].”
MethodThe Effect of Parent Involvement in the Treatment of Anxiety Disorders in Children: A Meta-Analysis
Thulin, U., Svirsky, L., Serlachius, E., Andersson, G., & Öst, L.-G. (2014) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2014.923928 · Cited by 124
Davies, T. B., Kuang, K., Orr, R., Halaki, M., & Hackett, D. (2017) · Sports Medicine · doi:10.1007/s40279-017-0676-4 · Cited by 117
Dong, J.-Y., Zhang, L., Zhang, Y.-H., & Qin, L.-Q. (2011) · British Journal Of Nutrition · doi:10.1017/s000711451100540x · Cited by 124
Solmi, M., Veronese, N., Correll, C. U., Favaro, A., Santonastaso, P., Caregaro, L., Vancampfort, D., Luchini, C., De Hert, M., & Stubbs, B. (2016) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12556 · Cited by 124
Yang, Z.-S., Lin, N.-N., Li, L., & Li, Y. (2016) · Clinical Reviews in Allergy & Immunology · doi:10.1007/s12016-016-8560-9 · Cited by 123
Li, L., Han, Z., Niu, X., Zhang, G., Jia, Y., Zhang, S., & He, C. (2019) · American Journal of Clinical Dermatology · doi:10.1007/s40257-018-0404-3 · Cited by 122
Schoenfeld, B. J., Ogborn, D. I., Vigotsky, A. D., Franchi, M. V., & Krieger, J. W. (2017) · Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000001983 · Cited by 122
Seidu, S., Kunutsor, S. K., Ajjan, R. A., & Choudhary, P. (2024) · Diabetes Care · doi:10.2337/dc23-1520 · Cited by 124
Automated blood pressure measurement in atrial fibrillation: a systematic review and meta-analysis
Stergiou, G. S., Kollias, A., Destounis, A., & Tzamouranis, D. (2012) · Journal of Hypertension · doi:10.1097/hjh.0b013e32835850d7 · Cited by 120
“4); however, both Begg’s and Egger’s [12,13] testing did not identify a significant publication bias (P> 0.05).”
BackgroundMethodInfluentialA meta-analysis of multicultural competencies and psychotherapy process and outcome.
Tao, K. W., Owen, J., Pace, B. T., & Imel, Z. E. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000086 · Cited by 120
Je, Y., Liu, W., & Giovannucci, E. (2009) · International Journal of Cancer · doi:10.1002/ijc.24124 · Cited by 119
Malerba, S., Turati, F., Galeone, C., Pelucchi, C., Verga, F., La Vecchia, C., & Tavani, A. (2013) · European Journal of Epidemiology · doi:10.1007/s10654-013-9834-7 · Cited by 119
Is Obstructive Sleep Apnea Associated with Cardiovascular and All-Cause Mortality?
Ge, X., Han, F., Huang, Y., Zhang, Y., Yang, T., Bai, C., & Guo, X. (2013) · PLoS ONE · doi:10.1371/journal.pone.0069432 · Cited by 119
Ramos-Sanchez, C. P., Schuch, F. B., Seedat, S., Louw, Q. A., Stubbs, B., Rosenbaum, S., Firth, J., van Winkel, R., & Vancampfort, D. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114046 · Cited by 118
Krieglstein, F., Beege, M., Rey, G. D., Ginns, P., Krell, M., & Schneider, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09683-4 · Cited by 118
“The non-significant rank correlations across all examined cognitive load scales seems to indicate that there is no publication bias (Begg & Mazumdar, 1994).”
BackgroundMethodInfluentialTaylor, B., & Rehm, J. (2012) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2012.01785.x · Cited by 117
Samara, M., Da Silva Nascimento, B., El-Asam, A., Hammuda, S., & Khattab, N. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18052209 · Cited by 117
“Secondly, the Begg and Mazumbar Rank Correlation Test (Kendall’s tau b) [58] examines study sample size where small studies and large effect sizes indicate large variances.”
MethodKhosravipour, M., Khanlari, P., Khazaie, S., Khosravipour, H., & Khazaie, H. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101427 · Cited by 117
Height at diagnosis and birth-weight as risk factors for osteosarcoma
Mirabello, L., Pfeiffer, R., Murphy, G., Daw, N. C., Patiño-Garcia, A., Troisi, R. J., Hoover, R. N., Douglass, C., Schüz, J., Craft, A. W., et al. (2011) · Cancer Causes & Control · doi:10.1007/s10552-011-9763-2 · Cited by 116
Allen, M. S., & Walter, E. E. (2019) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2019.01.314 · Cited by 116
Moreno-Peral, P., Conejo-Cerón, S., Rubio-Valera, M., Fernández, A., Navas-Campaña, D., Rodríguez-Morejón, A., Motrico, E., Rigabert, A., Luna, J. D. D., Martín-Pérez, C., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.2509 · Cited by 115
Allergen Immunotherapy for Insect Venom Allergy: A Systematic Review and Meta-Analysis
Dhami, S., Zaman, H., Varga, E.-M., Sturm, G. J., Muraro, A., Akdis, C. A., Antolín-Amérigo, D., Bilò, M. B., Bokanovic, D., Calderon, M. A., et al. (2017) · Allergy · doi:10.1111/all.13077 · Cited by 115
Jenkins, D. J. A., Willett, W. C., Yusuf, S., Hu, F. B., Glenn, A. J., Liu, S., Mente, A., Miller, V., Bangdiwala, S. I., Gerstein, H. C., et al. (2024) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(23)00344-3 · Cited by 117
Does night-shift work increase the risk of prostate cancer? a systematic review and meta-analysis
Xie, L., Rao, D., Yu, H., Bai, Y., & Zheng, X. (2015) · OncoTargets and Therapy · doi:10.2147/ott.s89769 · Cited by 114
Vancampfort, D., Rosenbaum, S., Ward, P. B., & Stubbs, B. (2015) · Schizophrenia Research · doi:10.1016/j.schres.2015.09.029 · Cited by 113
“Publication bias was assessed with the Begg–Mazumdar (Begg and Mazumdar, 1994) and Egger (Egger et al., 1997) tests.”
MethodWang, Z., Wang, P., Liu, H., He, X., Zhang, J., Yan, H., Xu, D., & Wang, B. (2013) · Obesity Reviews · doi:10.1111/obr.12025 · Cited by 111
Bonovas, S., Fiorino, G., Allocca, M., Lytras, T., Tsantes, A., Peyrin-Biroulet, L., & Danese, S. (2016) · Medicine · doi:10.1097/md.0000000000002308 · Cited by 113
Collyer, H., Eisler, I., & Woolgar, M. (2020) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-018-1265-2 · Cited by 112
Aune, D., Chan, D. S. M., Vieira, A. R., Navarro Rosenblatt, D. A., Vieira, R., Greenwood, D. C., Cade, J. E., Burley, V. J., & Norat, T. (2012) · Annals of Oncology · doi:10.1093/annonc/mds076 · Cited by 111
“Small study effects, such as publication bias, was assessed by inspection of the funnel plots and with Egger’s test [38] and with Beggapos;s test [39], and the results were considered to indicate small study effects when P < 0.”
MethodNakaoka, H., & Inoue, I. (2009) · Journal of Human Genetics · doi:10.1038/jhg.2009.95 · Cited by 111
Zhu, S., Zhang, B., Jiang, X., Li, Z., Zhao, S., Cui, L., & Chen, Z.-J. (2019) · Fertility and Sterility · doi:10.1016/j.fertnstert.2018.09.013 · Cited by 109
Ultrasound Guidance Facilitates Radial Artery Catheterization
Gu, W.-J., Wu, X.-D., Wang, F., Ma, Z.-L., & Gu, X.-P. (2016) · Chest · doi:10.1378/chest.15-1784 · Cited by 109
McFarland, L. (2015) · Antibiotics · doi:10.3390/antibiotics4020160 · Cited by 109
“To assess for publication bias, a funnel plot, as well as a weighted regression (Egger’s test) and a rank correlation test (Begg’s test for small study effects) were conducted [52,55].”
MethodLiu, Y., Tang, C., Hung, T., Tsai, P., & Lin, M. (2018) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12282 · Cited by 109
“Publication bias may occur while researchers have a tendency to include and publish studies that have significant results (Harrison, 1996); thus, funnel plot as a visual recognition method and two statistical tests, Begg’s (Begg & Mazumdar, 1994) and Egger’s tests (Egger, Smith, Schneider, & Minder, 1997), were used t…”
BackgroundMethodInfluentialAntipsychotics for Preventing Delirium in Hospitalized Adults: A Systematic Review
Oh, E. S., Needham, D. M., Nikooie, R., Wilson, L. M., Zhang, A., Robinson, K. A., & Neufeld, K. J. (2019) · Annals of Internal Medicine · doi:10.7326/m19-1859 · Cited by 108
Cotelli, M., Manenti, R., Ferrari, C., Gobbi, E., Macis, A., & Cappa, S. F. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.12.003 · Cited by 108
Grist, R., & Cavanagh, K. (2013) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-013-9243-y · Cited by 100
“However, Begg and Mazumdar’s (1994) rank correlation test was significant, indicating a possible publication bias (s (N = 49) = 0.”
BackgroundPatterns of Comorbidity Among Girls With ADHD: A Meta-analysis
Tung, I., Li, J. J., Meza, J. I., Jezior, K. L., Kianmahd, J. S. V., Hentschel, P. G., O’Neil, P. M., & Lee, S. S. (2016) · Pediatrics · doi:10.1542/peds.2016-0430 · Cited by 108
Yu, M., Liang, C., Kong, Q., Wang, Y., & Li, M. (2020) · Lipids in Health and Disease · doi:10.1186/s12944-019-1182-5 · Cited by 107
Macpherson, H., Pipingas, A., & Pase, M. P. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.049304 · Cited by 107
Is Concurrent Training Efficacious Antihypertensive Therapy? A Meta-Analysis
CORSO, L. M. L., MACDONALD, H. V., JOHNSON, B. T., FARINATTI, P., LIVINGSTON, J., ZALESKI, A. L., BLANCHARD, A., & PESCATELLO, L. S. (2016) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001056 · Cited by 107
The prevalence of metabolic syndrome in alcohol use disorders: a systematic review and meta-analysis
Vancampfort, D., Hallgren, M., Mugisha, J., De Hert, M., Probst, M., Monsieur, D., & Stubbs, B. (2016) · Alcohol and Alcoholism · doi:10.1093/alcalc/agw040 · Cited by 107
“, 1997) and Begg-Mazumdar test (Begg and Mazumdar, 1994) , with a P value < 0.”
MethodInfluentialHuang, J., Wang, X., & Zhang, Y. (2017) · Journal of Diabetes Investigation · doi:10.1111/jdi.12537 · Cited by 106
Farmer, A. J., McSharry, J., Rowbotham, S., McGowan, L., Ricci‐Cabello, I., & French, D. P. (2016) · Diabetic Medicine · doi:10.1111/dme.12987 · Cited by 106
Monami, M., Dicembrini, I., Nardini, C., Fiordelli, I., & Mannucci, E. (2014) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2014.01.010 · Cited by 106
“1), the Begg adjusted rank correlation test [11,12], including published and unpublished, but disclosed, trials.”
Catheter Ablation for Atrial Fibrillation in Heart Failure Patients
Al Halabi, S., Qintar, M., Hussein, A., Alraies, M. C., Jones, D. G., Wong, T., MacDonald, M. R., Petrie, M. C., Cantillon, D., Tarakji, K. G., et al. (2015) · JACC. Clinical electrophysiology · doi:10.1016/j.jacep.2015.02.018 · Cited by 105
Gogate, P., Optom, J. J., Deshpande, S., & Naidoo, K. (2015) · Middle East African Journal of Ophthalmology · doi:10.4103/0974-9233.159763 · Cited by 106
Zhao, T.-T., Jin, F., Li, J.-G., Xu, Y.-Y., Dong, H.-T., Liu, Q., Xing, P., Zhu, G.-L., Xu, H., & Miao, Z.-F. (2019) · Clinical Nutrition · doi:10.1016/j.clnu.2017.12.006 · Cited by 105
Moraros, J., Nwankwo, C., Patten, S. B., & Mousseau, D. D. (2017) · Depression and Anxiety · doi:10.1002/da.22584 · Cited by 105
“( 2 0 1 2 ) X X − − X − X X X X X ,r ep o rt ed in st u d y; – ,n o t re p o rt ed in st u d y. calculating Begg’s test (Begg & Mazumdar, 1994).”
MethodChen, L.-W., Wu, Y., Neelakantan, N., Chong, M. F.-F., Pan, A., & van Dam, R. M. (2016) · Public Health Nutrition · doi:10.1017/s1368980015002463 · Cited by 100
Semnani-Azad, Z., Khan, T. A., Blanco Mejia, S., de Souza, R. J., Leiter, L. A., Kendall, C. W. C., Hanley, A. J., & Sievenpiper, J. L. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.9993 · Cited by 103
Yan, D., Jiao, Y., Yan, H., Liu, T., Yan, H., & Yuan, J. (2022) · Environmental Health · doi:10.1186/s12940-022-00858-8 · Cited by 104
Jenkins, R. J., McAlaney, J., & McCambridge, J. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.09.016 · Cited by 103
Goal conflict and psychological well-being: a meta-analysis.
Gray, J. S., Ozer, D. J., & Rosenthal, R. (2017) · Journal of Research in Personality · doi:10.1016/j.jrp.2016.12.003 · Cited by 103
Tea consumption and risk of type 2 diabetes: a dose–response meta-analysis of cohort studies
Yang, W.-S., Wang, W.-Y., Fan, W.-Y., Deng, Q., & Wang, X. (2014) · British Journal of Nutrition · doi:10.1017/s0007114513003887 · Cited by 103
Schaefert, R., Klose, P., Moser, G., & Häuser, W. (2014) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000039 · Cited by 103
Tea consumption and the risk of depression: a meta-analysis of observational studies
Dong, X., Yang, C., Cao, S., Gan, Y., Sun, H., Gong, Y., Yang, H., Yin, X., & Lu, Z. (2015) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867414567759 · Cited by 102
“The Begg rank correlation test (Begg and Mazumdar, 1994), the Egger linear regression test (Egger et al., 1997), and funnel plots were used to assess the publication bias.”
MethodExposure to Acrylamide and Human Cancer—A Review and Meta-Analysis of Epidemiologic Studies
Pelucchi, C., La Vecchia, C., Bosetti, C., Boyle, P., & Boffetta, P. (2011) · Annals of Oncology · doi:10.1093/annonc/mdq610 · Cited by 101
“Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias.”
MethodInfluentialChen, W., Li, M., Li, H., Lin, Y., & Feng, Z. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1236050 · Cited by 102
Aune, D., Navarro Rosenblatt, D. A., Chan, D. S. M., Abar, L., Vingeliene, S., Vieira, A. R., Greenwood, D. C., & Norat, T. (2015) · International Journal of Cancer · doi:10.1002/ijc.29207 · Cited by 100
The Prognostic and Clinical Value of CD44 in Colorectal Cancer: A Meta-Analysis
Wang, Z., Tang, Y., Xie, L., Huang, A., Xue, C., Gu, Z., Wang, K., & Zong, S. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.00309 · Cited by 100
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.