Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 501–600 of 1,708
Immigration and Crime: Assessing a Contentious Issue
Ousey, G. C., & Kubrin, C. E. (2018) · Annual Review of Criminology · doi:10.1146/annurev-criminol-032317-092026 · Cited by 381
Puli, S. R., Reddy, J. B., Bechtold, M. L., Antillon, D., Ibdah, J. A., & Antillon, M. R. (2008) · World Journal of Gastroenterology · doi:10.3748/wjg.14.1479 · Cited by 387
Trauma coping strategies and psychological distress: A meta‐analysis
Littleton, H., Horsley, S., John, S., & Nelson, D. V. (2007) · Journal of Traumatic Stress · doi:10.1002/jts.20276 · Cited by 380
Weiss, H. A., Thomas, S. L., Munabi, S. K., & Hayes, R. J. (2006) · Sexually Transmitted Infections · doi:10.1136/sti.2005.017442 · Cited by 382
Aune, D., Sen, A., Norat, T., Janszky, I., Romundstad, P., Tonstad, S., & Vatten, L. J. (2016) · Circulation · doi:10.1161/circulationaha.115.016801 · Cited by 376
Machado, M., Bajcar, J., Guzzo, G. C., & Einarson, T. R. (2007) · Annals of Pharmacotherapy · doi:10.1345/aph.1k311 · Cited by 378
Evaluating the Impact of Attempts to Correct Health Misinformation on Social Media: A Meta-Analysis
Walter, N., Brooks, J. J., Saucier, C. J., & Suresh, S. (2021) · Health Communication · doi:10.1080/10410236.2020.1794553 · Cited by 374
Liu, M., Wu, L., & Yao, S. (2016) · British Journal of Sports Medicine · doi:10.1136/bjsports-2015-095084 · Cited by 364
Tobias, D. K., Chen, M., Manson, J. E., Ludwig, D. S., Willett, W., & Hu, F. B. (2015) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(15)00367-8 · Cited by 373
“Results were similar when restricted studies conducting to intention-to-treat analyses (Appendix pages 3–4) and when excluding smaller trials of 100 total participants, although few non-weight loss or weight maintenance trials remained eligible according to these criteria.”
ResultOccupational moral injury and mental health: systematic review and meta-analysis
Williamson, V., Stevelink, S. A. M., & Greenberg, N. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.55 · Cited by 375
Zhang, L., Rana, I., Shaffer, R. M., Taioli, E., & Sheppard, L. (2019) · Mutation Research/Reviews in Mutation Research · doi:10.1016/j.mrrev.2019.02.001 · Cited by 374
Suicidal risk factors and completed suicide: meta-analyses based on psychological autopsy studies
Yoshimasu, K., Kiyohara, C., Miyashita, K., & The Stress Research Group of the Japanese Society for Hygiene (2008) · Environmental Health and Preventive Medicine · doi:10.1007/s12199-008-0037-x · Cited by 375
Is Diabetes Mellitus an Independent Risk Factor for Colon Cancer and Rectal Cancer?
Yuhara, H., Steinmaus, C., Cohen, S. E., Corley, D. A., Tei, Y., & Buffler, P. A. (2011) · American Journal of Gastroenterology · doi:10.1038/ajg.2011.301 · Cited by 377
Vu, T., Farish, S., Jenkins, M., & Kelly, H. (2002) · Vaccine · doi:10.1016/s0264-410x(02)00041-5 · Cited by 376
Guided tissue regeneration for periodontal infra-bony defects
Needleman, I., Worthington, H. V., Giedrys-Leeper, E., & Tucker, R. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001724.pub2 · Cited by 373
RetractedDo sperm DNA integrity tests predict pregnancy with in vitro fertilization?
Collins, J. A., Barnhart, K. T., & Schlegel, P. N. (2008) · Fertility and Sterility · doi:10.1016/j.fertnstert.2007.04.055 · Cited by 372
Sobhy, S., Arroyo-Manzano, D., Murugesu, N., Karthikeyan, G., Kumar, V., Kaur, I., Fernandez, E., Gundabattula, S. R., Betran, A. P., Khan, K., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(18)32386-9 · Cited by 369
Johnston, B. C., Ma, S. S. Y., Goldenberg, J. Z., Thorlund, K., Vandvik, P. O., Loeb, M., & Guyatt, G. H. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-12-201212180-00563 · Cited by 367
Sunburns and risk of cutaneous melanoma: does age matter? A comprehensive meta-analysis
Dennis, L. K., Vanbeek, M. J., Beane Freeman, L. E., Smith, B. J., Dawson, D. V., & Coughlin, J. A. (2008) · Annals of Epidemiology · doi:10.1016/j.annepidem.2008.04.006 · Cited by 370
“Funnel plots showed inconclusive evidence regarding possible publication bias, but Begg’s test (80) for publication bias using rank correlation based on Kendall’s tau for all time-periods combined suggested publication bias (p<0.”
MethodGennari, A., Sormani, M. P., Pronzato, P., Puntoni, M., Colozza, M., Pfeffer, U., & Bruzzi, P. (2008) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djm252 · Cited by 371
Allergen immunotherapy for allergic rhinoconjunctivitis: A systematic review and meta‐analysis
Dhami, S., Nurmatov, U., Arasi, S., Khan, T., Asaria, M., Zaman, H., Agarwal, A., Netuveli, G., Roberts, G., Pfaar, O., et al. (2017) · Allergy · doi:10.1111/all.13201 · Cited by 369
Spinal manipulative therapy for low-back pain
Assendelft, W. J., Morton, S. C., Yu, E. I., Suttorp, M. J., & Shekelle, P. G. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000447.pub2 · Cited by 369
RetractedWeinmayr, G., Romeo, E., De Sario, M., Weiland, S. K., & Forastiere, F. (2010) · Environmental Health Perspectives · doi:10.1289/ehp.0900844 · Cited by 366
Mihura, J. L., Meyer, G. J., Dumitrascu, N., & Bombel, G. (2013) · Psychological Bulletin · doi:10.1037/a0029406 · Cited by 363
Evidence for publication bias in video game violence effects literature: A meta-analytic review
Ferguson, C. J. (2007) · Aggression and Violent Behavior · doi:10.1016/j.avb.2007.01.001 · Cited by 363
A systematic review and meta-analysis of the association between depression and insulin resistance
Kan, C., Silva, N., Golden, S. H., Rajala, U., Timonen, M., Stahl, D., & Ismail, K. (2013) · Diabetes Care · doi:10.2337/dc12-1442 · Cited by 322
Hotta, K., Matsuo, K., Ueoka, H., Kiura, K., Tabata, M., & Tanimoto, M. (2004) · Journal of Clinical Oncology · doi:10.1200/jco.2004.02.109 · Cited by 364
Linear and generalized linear mixed models
Bolker, B. M. (2015) · Ecological Statistics · doi:10.1093/acprof:oso/9780199672547.003.0014 · Cited by 339
Prevalence and Risk Factors for Diabetes Mellitus in Nigeria: A Systematic Review and Meta-Analysis
Uloko, A. E., Musa, B. M., Ramalan, M. A., Gezawa, I. D., Puepet, F. H., Uloko, A. T., Borodo, M. M., & Sada, K. B. (2018) · Diabetes Therapy · doi:10.1007/s13300-018-0441-1 · Cited by 359
Garofalo, C., Borrelli, S., Minutolo, R., Chiodini, P., De Nicola, L., & Conte, G. (2017) · Kidney International · doi:10.1016/j.kint.2016.12.013 · Cited by 363
“Publication bias was assessed by funnel plot, and the Begg and Egger test.(73) Summary estimates combining the 3 previously mentioned renal outcomes were calculated; when multiple outcomes were analyzed in a particular study, the method of Borenstein et al.”
Morres, I. D., Hatzigeorgiadis, A., Stathi, A., Comoutos, N., Arpin-Cribbie, C., Krommidas, C., & Theodorakis, Y. (2019) · Depression and Anxiety · doi:10.1002/da.22842 · Cited by 350
Mantovani, A., Petracca, G., Beatrice, G., Csermely, A., Tilg, H., Byrne, C. D., & Targher, G. (2022) · Gut · doi:10.1136/gutjnl-2021-324191 · Cited by 363
Does Tea Affect Cardiovascular Disease? A Meta-Analysis
Peters, U. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.6.495 · Cited by 364
Winkley, K., Landau, S., Eisler, I., & Ismail, K. (2006) · BMJ · doi:10.1136/bmj.38874.652569.55 · Cited by 359
Zhong, G., Wang, Y., Zhang, Y., Guo, J. J., & Zhao, Y. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118333 · Cited by 362
Drummond, M. B., Dasenbrook, E. C., Pitz, M. W., Murphy, D. J., & Fan, E. (2008) · JAMA · doi:10.1001/jama.2008.717 · Cited by 364
A comprehensive meta-analysis on Problematic Facebook Use
Marino, C., Gini, G., Vieno, A., & Spada, M. M. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.02.009 · Cited by 378
Locher, C., Koechlin, H., Zion, S. R., Werner, C., Pine, D. S., Kirsch, I., Kessler, R. C., & Kossowsky, J. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.2432 · Cited by 360
Li, J.-Q., Tan, L., Wang, H.-F., Tan, M.-S., Tan, L., Xu, W., Zhao, Q.-F., Wang, J., Jiang, T., & Yu, J.-T. (2016) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2014-310095 · Cited by 359
The prevalence of primary dystonia: A systematic review and meta‐analysis
Steeves, T. D., Day, L., Dykeman, J., Jette, N., & Pringsheim, T. (2012) · Movement Disorders · doi:10.1002/mds.25244 · Cited by 358
Prenatal, perinatal, and postnatal factors associated with autism: A meta-analysis
Wang, C., Geng, H., Liu, W., & Zhang, G. (2017) · Medicine · doi:10.1097/md.0000000000006696 · Cited by 348
Failure rates and associated risk factors of orthodontic miniscrew implants: A meta-analysis
Papageorgiou, S. N., Zogakis, I. P., & Papadopoulos, M. A. (2012) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2012.05.016 · Cited by 362
Television Viewing and Time Spent Sedentary in Relation to Cancer Risk: A Meta-Analysis
Schmid, D., & Leitzmann, M. F. (2014) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/dju098 · Cited by 359
Diabetes and breast cancer risk: A meta-analysis
Boyle, P., Boniol, M., Koechlin, A., Robertson, C., Valentini, F., Coppens, K., Fairley, L.-L., Boniol, M., Zheng, T., Zhang, Y., et al. (2012) · British Journal of Cancer · doi:10.1038/bjc.2012.414 · Cited by 358
“To complete this visual analysis, the three main publication bias tests were computed, namely Begg’s test (rank correlation test; Begg and Mazumdar, 1994), Egger’s test (weighted linear regression test for funnel plot symmetry; Egger et al, 1997) and Macaskill’s test (Macaskill et al, 2001).”
MethodPoorolajal, J., Haghtalab, T., Farhadi, M., & Darvishi, N. (2016) · Journal of public health · doi:10.1093/pubmed/fdv148 · Cited by 346
Aune, D., Ursin, G., & Veierød, M. B. (2009) · Diabetologia · doi:10.1007/s00125-009-1481-x · Cited by 358
Zhou, X., Yao, Z., Yang, H., Liang, N., Zhang, X., & Zhang, F. (2020) · BMC Medicine · doi:10.1186/s12916-020-01549-2 · Cited by 353
Del Gobbo, L. C., Imamura, F., Wu, J. H., de Oliveira Otto, M. C., Chiuve, S. E., & Mozaffarian, D. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.053132 · Cited by 355
Puli, S. R., Reddy, J. B. K., Bechtold, M. L., Antillon, M. R., & Brugge, W. R. (2009) · Digestive Diseases and Sciences · doi:10.1007/s10620-008-0651-x · Cited by 356
Determinants of linear judgment: A meta-analysis of lens model studies.
Karelaia, N., & Hogarth, R. M. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.3.404 · Cited by 352
Ligthart-Melis, G. C., Luiking, Y. C., Kakourou, A., Cederholm, T., Maier, A. B., & de van der Schueren, M. A. E. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2020.03.006 · Cited by 348
Gillet, E., Meys, J. F., Verstraelen, H., Bosire, C., De Sutter, P., Temmerman, M., & Broeck, D. V. (2011) · BMC Infectious Diseases · doi:10.1186/1471-2334-11-10 · Cited by 354
“Evidence of publication bias was ruled out by funnel plot [29] and statistically evaluated for asymmetry using the Begg rank correlation [30].”
MethodNeuropsychological test administration by videoconference: a systematic review and meta-analysis
Brearly, T. W., Shura, R. D., Martindale, S. L., Lazowski, R. A., Luxton, D. D., Shenal, B. V., & Rowland, J. A. (2017) · Neuropsychology Review · doi:10.1007/s11065-017-9349-1 · Cited by 353
Use of PCR for diagnosis of invasive aspergillosis: systematic review and meta-analysis
Mengoli, C., Cruciani, M., Barnes, R. A., Loeffler, J., & Donnelly, J. P. (2009) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(09)70019-2 · Cited by 354
The potential of immersive virtual reality to enhance learning: A meta-analysis
Coban, M., Bolat, Y. I., & Goksu, I. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100452 · Cited by 354
Mesas, A. E., Leon-Muñoz, L. M., Rodriguez-Artalejo, F., & Lopez-Garcia, E. (2011) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.111.016667 · Cited by 350
Gourlan, M., Bernard, P., Bortolon, C., Romain, A. J., Lareyre, O., Carayol, M., Ninot, G., & Boiché, J. (2016) · Health Psychology Review · doi:10.1080/17437199.2014.981777 · Cited by 353
“The publication bias was assessed using multiple methods, including funnel plot identification, Begg and Mazumdar (1994) adjusted rank correlation and Egger’s regression intercept (Egger, Smith, Schneider, & Minder, 1997).”
MethodMagnesium Intake and Risk of Type 2 Diabetes
Dong, J.-Y., Xun, P., He, K., & Qin, L.-Q. (2011) · Diabetes Care · doi:10.2337/dc11-0518 · Cited by 351
Lara, E., Martín-María, N., De la Torre-Luque, A., Koyanagi, A., Vancampfort, D., Izquierdo, A., & Miret, M. (2019) · Ageing Research Reviews · doi:10.1016/j.arr.2019.03.002 · Cited by 351
Fisher, J. C., Bang, H., & Kapiga, S. H. (2007) · Sexually Transmitted Diseases · doi:10.1097/olq.0b013e318067b4fd · Cited by 350
Cardi, V., Leppanen, J., & Treasure, J. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.011 · Cited by 349
Duan, J., Cui, L., Zhao, X., Bai, H., Cai, S., Wang, G., Zhao, Z., Zhao, J., Chen, S., Song, J., et al. (2020) · JAMA Oncology · doi:10.1001/jamaoncol.2019.5367 · Cited by 349
Media use and ADHD-related behaviors in children and adolescents: A meta-analysis
Nikkelen, S. W. C., Valkenburg, P. M., Huizinga, M., & Bushman, B. J. (2014) · Developmental Psychology · doi:10.1037/a0037318 · Cited by 339
Testing for funnel plot asymmetry of standardized mean differences
Pustejovsky, J. E., & Rodgers, M. A. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1332 · Cited by 354
Pierdomenico, S. D., & Cuccurullo, F. (2011) · American Journal of Hypertension · doi:10.1038/ajh.2010.203 · Cited by 349
Loh, R., Stamatakis, E., Folkerts, D., Allgrove, J. E., & Moir, H. J. (2020) · Sports Medicine · doi:10.1007/s40279-019-01183-w · Cited by 326
“10 Publication Bias Funnel plots, Begg and Mazumdar’s rank correlation test [53], Egger’s regression test [54] and Rosenthal’s fail-safe N [55] were used to assess publication bias if more than ten studies were included in the meta-analysis [26, 56].”
MethodBody Mass Index and Gastroesophageal Reflux Disease: A Systematic Review and Meta-Analysis
Corley, D. A., & Kubo, A. (2006) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2006.00849.x · Cited by 349
Meinel, F. G., Nance, J. W., Schoepf, U. J., Hoffmann, V. S., Thierfelder, K. M., Costello, P., Goldhaber, S. Z., & Bamberg, F. (2015) · The American Journal of Medicine · doi:10.1016/j.amjmed.2015.01.023 · Cited by 351
Taylor, B., Irving, H. M., Baliunas, D., Roerecke, M., Patra, J., Mohapatra, S., & Rehm, J. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02694.x · Cited by 346
“To assess publication bias three independent tests were used—Begg’s and Egger’s regression asymmetry tests [29,30] and the Duval & Tweedie non-parametric ‘trim and fill’ method [31].”
MethodRehm, J., Shield, K. D., Joharchi, N., & Shuper, P. A. (2012) · Addiction · doi:10.1111/j.1360-0443.2011.03621.x · Cited by 344
Pavia, M., Pileggi, C., Nobile, C. G., & Angelillo, I. F. (2006) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/83.5.1126 · Cited by 345
Omega-3 fatty acids and incident type 2 diabetes: A systematic review and meta-analysis
Wu, J. H. Y., Micha, R., Imamura, F., Pan, A., Biggs, M. L., Ajaz, O., Djousse, L., B. Hu, F., & Mozaffarian, D. (2012) · British Journal Of Nutrition · doi:10.1017/s0007114512001602 · Cited by 340
Qin, P., Li, Q., Zhao, Y., Chen, Q., Sun, X., Liu, Y., Li, H., Wang, T., Chen, X., Zhou, Q., et al. (2020) · European Journal of Epidemiology · doi:10.1007/s10654-020-00655-y · Cited by 323
Magee, G. M., Bilous, R. W., Cardwell, C. R., Hunter, S. J., Kee, F., & Fogarty, D. G. (2009) · Diabetologia · doi:10.1007/s00125-009-1268-0 · Cited by 345
Previous Lung Diseases and Lung Cancer Risk: A Systematic Review and Meta-Analysis
Brenner, D. R., McLaughlin, J. R., & Hung, R. J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017479 · Cited by 343
Psoriasis and the Risk of Diabetes Mellitus: A Systematic Review and Meta-analysis
Armstrong, A. W., Harskamp, C. T., & Armstrong, E. J. (2013) · JAMA Dermatology · doi:10.1001/2013.jamadermatol.406 · Cited by 342
“Publication bias was assessed using visual inspection of a funnel plot of the study size vs standard error, with formal statistical testing using the Begg adjusted-rank correlation test.(13,14) To explore sources of study heterogeneity, we performed metaregression using prespecified variables and random-effects metaan…”
MethodSong, P., Yu, J., Chan, K. Y., Theodoratou, E., & Rudan, I. (2018) · Journal of Global Health · doi:10.7189/jogh.08.010803 · Cited by 341
Meta-analysis of probiotics for the treatment of irritable bowel syndrome
McFarland, L. V., & Dublin, S. (2008) · World Journal of Gastroenterology · doi:10.3748/wjg.14.2650 · Cited by 341
Moja, L., Kwag, K. H., Lytras, T., Bertizzolo, L., Brandt, L., Pecoraro, V., Rigon, G., Vaona, A., Ruggiero, F., Mangia, M., et al. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.302164 · Cited by 339
Infant Feeding and Blood Cholesterol: A Study in Adolescents and a Systematic Review
Owen, C. G., Whincup, P. H., Odoki, K., Gilg, J. A., & Cook, D. G. (2002) · Pediatrics · doi:10.1542/peds.110.3.597 · Cited by 340
The Prevalence of Military Sexual Trauma: A Meta-Analysis
Wilson, L. C. (2018) · Trauma, Violence, & Abuse · doi:10.1177/1524838016683459 · Cited by 339
Fruit and vegetable consumption and risk of stroke: A meta-analysis of cohort studies
Dauchet, L., Amouyel, P., & Dallongeville, J. (2005) · Neurology · doi:10.1212/01.wnl.0000180600.09719.53 · Cited by 339
Psychological trauma and PTSD in HIV-positive women: a meta-analysis
Machtinger, E. L., Wilson, T. C., Haberer, J. E., & Weiss, D. S. (2012) · AIDS and Behavior · doi:10.1007/s10461-011-0127-4 · Cited by 339
Risk factors for persistent delinquent behavior among juveniles: A meta-analytic review
Assink, M., van der Put, C. E., Hoeve, M., de Vries, S. L. A., Stams, G. J. J. M., & Oort, F. J. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.08.002 · Cited by 338
Random-Effects Meta-Analyses Are Not Always Conservative
Poole, C., & Greenland, S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010035 · Cited by 338
Sedentary behaviors and risk of depression: a meta-analysis of prospective studies
Huang, Y., Li, L., Gan, Y., Wang, C., Jiang, H., Cao, S., & Lu, Z. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0715-z · Cited by 336
Dairy consumption and risk of type 2 diabetes mellitus: a meta-analysis of cohort studies
Tong, X., Dong, J.-Y., Wu, Z.-W., Li, W., & Qin, L.-Q. (2011) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2011.62 · Cited by 337
Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis
van Aert, R. C. M., Wicherts, J. M., & van Assen, M. A. L. M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0215052 · Cited by 334
Large Trials vs Meta-analysis of Smaller Trials: How Do Their Results Compare?
Cappelleri, J. C. (1996) · JAMA · doi:10.1001/jama.1996.03540160054033 · Cited by 336
Alpha-glucosidase inhibitors for type 2 diabetes mellitus
Van de Laar, F. A., Lucassen, P. L., Akkermans, R. P., Van de Lisdonk, E. H., Rutten, G. E., & Van Weel, C. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003639.pub2 · Cited by 335
Risk Stratification of Individuals with the Brugada Electrocardiogram: A Meta‐Analysis
GEHI, A. K., DUONG, T. D., METZ, L. D., GOMES, J. A., & MEHTA, D. (2006) · Journal of Cardiovascular Electrophysiology · doi:10.1111/j.1540-8167.2006.00455.x · Cited by 336
Preisser, E. L., & Bolnick, D. I. (2008) · PLoS ONE · doi:10.1371/journal.pone.0002465 · Cited by 334
Del Gobbo, L. C., Falk, M. C., Feldman, R., Lewis, K., & Mozaffarian, D. (2015) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.115.110965 · Cited by 335
Wang, L., Guyatt, G. H., Kennedy, S. A., Romerosa, B., Kwon, H. Y., Kaushal, A., Chang, Y., Craigie, S., de Almeida, C. P. B., Couban, R. J., et al. (2016) · Canadian Medical Association Journal · doi:10.1503/cmaj.151276 · Cited by 334
Drugs Commonly Associated With Weight Change: A Systematic Review and Meta-analysis
Domecq, J. P., Prutsky, G., Leppin, A., Sonbol, M. B., Altayar, O., Undavalli, C., Wang, Z., Elraiyah, T., Brito, J. P., Mauck, K. F., et al. (2015) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2014-3421 · Cited by 334
Verdecchia, P., Reboldi, G., Angeli, F., Gattobigio, R., Bentivoglio, M., Thijs, L., Staessen, J. A., & Porcellati, C. (2005) · Hypertension · doi:10.1161/01.hyp.0000174591.42889.a2 · Cited by 338
Hsu, W.-Y., Ku, Y., Zanto, T. P., & Gazzaley, A. (2015) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2015.04.016 · Cited by 330
Dairy products and colorectal cancer risk: a systematic review and meta-analysis of cohort studies
Aune, D., Lau, R., Chan, D. S. M., Vieira, R., Greenwood, D. C., Kampman, E., & Norat, T. (2012) · Annals of Oncology · doi:10.1093/annonc/mdr269 · Cited by 333
Rosenbaum, S., Vancampfort, D., Steel, Z., Newby, J., Ward, P. B., & Stubbs, B. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.10.017 · Cited by 333
Rothberg, M. B., Celestin, C., Fiore, L. D., Lawler, E., & Cook, J. R. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-143-4-200508160-00005 · Cited by 334
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.