Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 201–300 of 1,708
Physical activity and risk of cardiovascular disease—a meta-analysis of prospective cohort studies
Li, J., & Siegrist, J. (2012) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph9020391 · Cited by 674
“To detect publication biases we explored heterogeneity in funnel plots and the degree of asymmetry by using Begg’s asymmetry method [15].”
MethodLange, S., Probst, C., Gmel, G., Rehm, J., Burd, L., & Popova, S. (2017) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2017.1919 · Cited by 669
Weiss, H. A., Quigley, M. A., & Hayes, R. J. (2000) · AIDS · doi:10.1097/00002030-200010200-00018 · Cited by 671
Fitness vs. Fatness on All-Cause Mortality: A Meta-Analysis
Barry, V. W., Baruth, M., Beets, M. W., Durstine, J. L., Liu, J., & Blair, S. N. (2014) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2013.09.002 · Cited by 671
Stubbs, B., Vancampfort, D., Rosenbaum, S., Firth, J., Cosco, T., Veronese, N., Salum, G. A., & Schuch, F. B. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2016.12.020 · Cited by 666
Alcohol as a risk factor for liver cirrhosis: A systematic review and meta‐analysis
REHM, J., TAYLOR, B., MOHAPATRA, S., IRVING, H., BALIUNAS, D., PATRA, J., & ROERECKE, M. (2010) · Drug and Alcohol Review · doi:10.1111/j.1465-3362.2009.00153.x · Cited by 668
Shiga, T., Wajima, Z., & Ohe, Y. (2008) · Canadian Journal of Anesthesia/Journal canadien d'anesthésie · doi:10.1007/bf03016088 · Cited by 666
Perinatal and Neonatal Risk Factors for Autism: A Comprehensive Meta-analysis
Gardener, H., Spiegelman, D., & Buka, S. L. (2011) · Pediatrics · doi:10.1542/peds.2010-1036 · Cited by 665
Probiotics in prevention of antibiotic associated diarrhoea: meta-analysis
D'Souza, A. L., Rajkumar, C., Cooke, J., & Bulpitt, C. J. (2002) · BMJ · doi:10.1136/bmj.324.7350.1361 · Cited by 664
Muka, T., Glisic, M., Milic, J., Verhoog, S., Bohlius, J., Bramer, W., Chowdhury, R., & Franco, O. H. (2020) · European Journal of Epidemiology · doi:10.1007/s10654-019-00576-5 · Cited by 660
Schuch, F., Vancampfort, D., Firth, J., Rosenbaum, S., Ward, P., Reichert, T., Bagatini, N. C., Bgeginski, R., & Stubbs, B. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.050 · Cited by 663
“We assessed heterogeneity using the I² statistics for each analysis (Higgins, 2011) and the publication bias with the Begg- Mazumdar Kendall's tau (Begg and Mazumdar, 1994).”
MethodPrognostic significance of tumor-infiltrating T cells in ovarian cancer: A meta-analysis
Hwang, W.-T., Adams, S. F., Tahirovic, E., Hagemann, I. S., & Coukos, G. (2012) · Gynecologic Oncology · doi:10.1016/j.ygyno.2011.09.039 · Cited by 661
Myopia as a Risk Factor for Open-Angle Glaucoma: A Systematic Review and Meta-Analysis
Marcus, M. W., de Vries, M. M., Montolio, F. G. J., & Jansonius, N. M. (2011) · Ophthalmology · doi:10.1016/j.ophtha.2011.03.012 · Cited by 658
Kangaroo Mother Care and Neonatal Outcomes: A Meta-analysis
Boundy, E. O., Dastjerdi, R., Spiegelman, D., Fawzi, W. W., Missmer, S. A., Lieberman, E., Kajeepeta, S., Wall, S., & Chan, G. J. (2016) · Pediatrics · doi:10.1542/peds.2015-2238 · Cited by 661
Marino, C., Gini, G., Vieno, A., & Spada, M. M. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.10.007 · Cited by 658
Vancampfort, D., Correll, C. U., Galling, B., Probst, M., De Hert, M., Ward, P. B., Rosenbaum, S., Gaughran, F., Lally, J., & Stubbs, B. (2016) · World Psychiatry · doi:10.1002/wps.20309 · Cited by 659
Association of loneliness with all-cause mortality: A meta-analysis
Rico-Uribe, L. A., Caballero, F. F., Martín-María, N., Cabello, M., Ayuso-Mateos, J. L., & Miret, M. (2018) · PLOS ONE · doi:10.1371/journal.pone.0190033 · Cited by 648
Reaction time variability in ADHD: A meta-analytic review of 319 studies
Kofler, M. J., Rapport, M. D., Sarver, D. E., Raiker, J. S., Orban, S. A., Friedman, L. M., & Kolomeyer, E. G. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.06.001 · Cited by 648
Dwamena, B. A., Sonnad, S. S., Angobaldo, J. O., & Wahl, R. L. (1999) · Radiology · doi:10.1148/radiology.213.2.r99nv46530 · Cited by 649
Physical activity and colon cancer prevention: a meta-analysis
Wolin, K. Y., Yan, Y., Colditz, G. A., & Lee, I.-M. (2009) · British Journal of Cancer · doi:10.1038/sj.bjc.6604917 · Cited by 649
Evidence on the long-term effects of breastfeeding SYSTEMATIC REVIEWS AND META-ANALYSES
Horta, B. L. (2007) · Cited by 1,107
Comita, L. S., Queenborough, S. A., Murphy, S. J., Eck, J. L., Xu, K., Krishnadas, M., Beckman, N., & Zhu, Y. (2014) · Journal of Ecology · doi:10.1111/1365-2745.12232 · Cited by 636
Meta-analysis: Exposure to Early Life Stress and Risk for Depression in Childhood and Adolescence
LeMoult, J., Humphreys, K. L., Tracy, A., Hoffmeister, J.-A., Ip, E., & Gotlib, I. H. (2020) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2019.10.011 · Cited by 576
Introduction to systematic review and meta-analysis
Ahn, E., & Kang, H. (2018) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2018.71.2.103 · Cited by 628
Meta-analysis of dropout in treatments for posttraumatic stress disorder
Imel, Z. E., Laska, K., Jakupcak, M., & Simpson, T. L. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0031474 · Cited by 633
“The rank correlation test (Begg & Mazumdar, 1994) indicated a significant correlation between the proportion of dropout and sampling variance, r .28, p .003, indicating that smaller studies tended to have a higher proportion of patients dropping out of active treatment.”
Horsthuis, K., Bipat, S., Bennink, R. J., & Stoker, J. (2008) · Radiology · doi:10.1148/radiol.2471070611 · Cited by 634
Parenting behavior and the risk of becoming a victim and a bully/victim: A meta-analysis study
Lereya, S. T., Samara, M., & Wolke, D. (2013) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2013.03.001 · Cited by 629
García-Closas, M., Malats, N., Silverman, D., Dosemeci, M., Kogevinas, M., Hein, D. W., Tardón, A., Serra, C., Carrato, A., García-Closas, R., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67137-1 · Cited by 627
Amlung, M., Vedelago, L., Acker, J., Balodis, I., & MacKillop, J. (2017) · Addiction · doi:10.1111/add.13535 · Cited by 626
“Presence of publication bias was based on consideration of five indices: Rosenthal’s classic fail-safe N [44]; Orwin’s fail-safe N [45]; examination of the funnel plots of sample size and effect size using the two-tailed Begg–Mazumdar test [46] and the one-tailed Egger’s test [47]; and metaregression between publicati…”
Schmid, D., & Leitzmann, M. F. (2014) · Annals of Oncology · doi:10.1093/annonc/mdu012 · Cited by 625
Probiotics for the prevention of pediatric antibiotic-associated diarrhea
Goldenberg, J. Z., Lytvyn, L., Steurich, J., Parkin, P., Mahant, S., & Johnston, B. C. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004827.pub4 · Cited by 607
Noninvasive Ventilation in Acute Cardiogenic Pulmonary Edema: Systematic Review and Meta-analysis
Masip, J., Roque, M., Sánchez, B., Fernández, R., Subirana, M., & Expósito, J. A. (2005) · JAMA · doi:10.1001/jama.294.24.3124 · Cited by 633
Baruh, L., Secinti, E., & Cemalcilar, Z. (2017) · Journal of Communication · doi:10.1111/jcom.12276 · Cited by 618
Laparoscopic versus open cholecystectomy for patients with symptomatic cholecystolithiasis
Keus, F., de Jong, J., Gooszen, H. G., & Laarhoven, C. J. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006231 · Cited by 616
Interventions That Increase Use of Adult Immunization and Cancer Screening Services: A Meta-Analysis
Stone, E. G., Morton, S. C., Hulscher, M. E., Maglione, M. A., Roth, E. A., Grimshaw, J. M., Mittman, B. S., Rubenstein, L. V., Rubenstein, L. Z., & Shekelle, P. G. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-9-200205070-00006 · Cited by 613
Bennett, W. L., Maruthur, N. M., Singh, S., Segal, J. B., Wilson, L. M., Chatterjee, R., Marinopoulos, S. S., Puhan, M. A., Ranasinghe, P., Block, L., et al. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-9-201105030-00336 · Cited by 609
“We tested for publication bias by using the Begg and Mazumdar test (20) and the Egger test (21).”
MethodDietary patterns and depression risk: a meta-analysis
Li, Y., Lv, M.-R., Wei, Y.-J., Sun, L., Zhang, J.-X., Zhang, H.-G., & Li, B. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.04.020 · Cited by 599
Natural history of cerebral arteriovenous malformations: a meta-analysis: Clinical article
Gross, B. A., & Du, R. (2013) · Journal of Neurosurgery · doi:10.3171/2012.10.jns121280 · Cited by 605
Augé, R. M., Toler, H. D., & Saxton, A. M. (2015) · Mycorrhiza · doi:10.1007/s00572-014-0585-4 · Cited by 603
Publication Bias in Meta‐Analysis
Rothstein, H. R., Sutton, A. J., & Borenstein, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch1 · Cited by 603
Lactobacillus Therapy for Acute Infectious Diarrhea in Children: A Meta-analysis
Van Niel, C. W., Feudtner, C., Garrison, M. M., & Christakis, D. A. (2002) · Pediatrics · doi:10.1542/peds.109.4.678 · Cited by 599
Socioeconomic Status and Bullying: A Meta-Analysis
Tippett, N., & Wolke, D. (2014) · American Journal of Public Health · doi:10.2105/ajph.2014.301960 · Cited by 598
Jacobson, N. C., & Newman, M. G. (2017) · Psychological Bulletin · doi:10.1037/bul0000111 · Cited by 576
Serrano-Ripoll, M. J., Meneses-Echavez, J. F., Ricci-Cabello, I., Fraile-Navarro, D., Fiol-deRoque, M. A., Pastor-Moreno, G., Castro, A., Ruiz-Pérez, I., Zamanillo Campos, R., & Gonçalves-Bradley, D. C. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.08.034 · Cited by 592
“Publication bias was examined with funnel plots and presence of asymmetry tested with Begg (Begg and Mazumdar, 1994) and Egger tests (Egger et al.”
The Association between Smoking and Low Back Pain: A Meta-analysis
Shiri, R., Karppinen, J., Leino-Arjas, P., Solovieva, S., & Viikari-Juntura, E. (2010) · The American Journal of Medicine · doi:10.1016/j.amjmed.2009.05.028 · Cited by 590
Schwingshackl, L., & Hoffmann, G. (2014) · Nutrition, Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2014.03.003 · Cited by 584
Recent developments in meta‐analysis
Sutton, A. J., & Higgins, J. P. T. (2008) · Statistics in Medicine · doi:10.1002/sim.2934 · Cited by 590
Jelleyman, C., Yates, T., O'Donovan, G., Gray, L. J., King, J. A., Khunti, K., & Davies, M. J. (2015) · Obesity Reviews · doi:10.1111/obr.12317 · Cited by 588
“If publication bias was apparent, Begg & Egger tests were used as a secondary determinant (44,45).”
MethodEffectiveness of Long-term Psychodynamic Psychotherapy: A Meta-analysis
Leichsenring, F. (2008) · JAMA · doi:10.1001/jama.300.13.1551 · Cited by 65
Prevalence of paternal depression in pregnancy and the postpartum: an updated meta-analysis
Cameron, E. E., Sedov, I. D., & Tomfohr-Madsen, L. M. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.07.044 · Cited by 586
Armstrong, M. J., Mottershead, T. A., Ronksley, P. E., Sigal, R. J., Campbell, T. S., & Hemmelgarn, B. R. (2011) · Obesity Reviews · doi:10.1111/j.1467-789x.2011.00892.x · Cited by 586
“There was no evidence of publication bias with Begg and Mazumdar’s test (P = 0.30), Egger et al.’s test (P = 0.62) or with visual Ta b le 3 S tu d y q ua lit y ch ar ac te ris tic s R ef er en ce (fi rs t au th or an d ye ar ) In cl us io n/ ex cl us io n cr ite ria R an d om iz at io n d es cr ib ed A llo ca tio n co…”
MethodInfluentialThe incidence and prevalence of Huntington's disease: A systematic review and meta‐analysis
Pringsheim, T., Wiltshire, K., Day, L., Dykeman, J., Steeves, T., & Jette, N. (2012) · Movement Disorders · doi:10.1002/mds.25075 · Cited by 587
Genetic associations in large versus small studies: an empirical assessment
Ioannidis, J. P., Trikalinos, T. A., Ntzani, E. E., & Contopoulos-Ioannidis, D. G. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12516-0 · Cited by 579
Kirtane, A. J., Gupta, A., Iyengar, S., Moses, J. W., Leon, M. B., Applegate, R., Brodie, B., Hannan, E., Harjai, K., Jensen, L. O., et al. (2009) · Circulation · doi:10.1161/circulationaha.108.826479 · Cited by 577
Unger, J. M., Vaidya, R., Hershman, D. L., Minasian, L. M., & Fleury, M. E. (2019) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djy221 · Cited by 570
Destination image and tourist behavioural intentions: A meta-analysis
Afshardoost, M., & Eshaghi, M. S. (2020) · Tourism Management · doi:10.1016/j.tourman.2020.104154 · Cited by 567
Prevalence and determinants of adolescent pregnancy in Africa: a systematic review and Meta-analysis
Kassa, G. M., Arowojolu, A. O., Odukogbe, A. A., & Yalew, A. W. (2018) · Reproductive Health · doi:10.1186/s12978-018-0640-2 · Cited by 569
Systematic Review and Meta-Analysis of Practice Facilitation Within Primary Care Settings
Baskerville, N. B., Liddy, C., & Hogg, W. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1312 · Cited by 571
Taylor, L. E., Swerdfeger, A. L., & Eslick, G. D. (2014) · Vaccine · doi:10.1016/j.vaccine.2014.04.085 · Cited by 583
When combinations of humans and AI are useful: A systematic review and meta-analysis
Vaccaro, M., Almaatouq, A., & Malone, T. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02024-1 · Cited by 570
“We visually inspected the plots and performed Egger’s regression test 70 as well as the rank correlation test 71 to evaluate the results in the funnel plots.”
Meta-analysis of the P300 and P50 waveforms in schizophrenia
BRAMON, E. (2004) · Schizophrenia Research · doi:10.1016/j.schres.2004.01.004 · Cited by 569
Moral disengagement among children and youth: A meta‐analytic review of links to aggressive behavior
Gini, G., Pozzoli, T., & Hymel, S. (2014) · Aggressive Behavior · doi:10.1002/ab.21502 · Cited by 568
Haentjens, P. (2007) · Archives of Internal Medicine · doi:10.1001/archinte.167.8.757 · Cited by 569
Beydoun, M. A., Beydoun, H. A., & Wang, Y. (2008) · Obesity Reviews · doi:10.1111/j.1467-789x.2008.00473.x · Cited by 563
“We also assessed publication bias by two formal tests, the Begg-adjusted rank correlation tests (23) and the Egger’s regression asymmetry test (22).”
Sud, S., Friedrich, J. O., Taccone, P., Polli, F., Adhikari, N. K. J., Latini, R., Pesenti, A., Guérin, C., Mancebo, J., Curley, M. A. Q., et al. (2010) · Intensive Care Medicine · doi:10.1007/s00134-009-1748-1 · Cited by 563
Sazawal, S., Hiremath, G., Dhingra, U., Malik, P., Deb, S., & Black, R. E. (2006) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(06)70495-9 · Cited by 561
Efficacy of PD-1 or PD-L1 inhibitors and PD-L1 expression status in cancer: meta-analysis
Shen, X., & Zhao, B. (2018) · BMJ · doi:10.1136/bmj.k3529 · Cited by 559
Influence of Resistance Exercise on Lean Body Mass in Aging Adults: A Meta-Analysis
PETERSON, M. D., SEN, A., & GORDON, P. M. (2011) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3181eb6265 · Cited by 558
“As a formal check for publication bias, the tests of Begg and Mazumdar (14) and of Egger et al.”
MethodHillmayr, D., Ziernwald, L., Reinhold, F., Hofer, S. I., & Reiss, K. M. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103897 · Cited by 574
“This inverse correlation is expected because studies with smaller sample sizes are more often included in meta-analysis if they show large treatment effects (Begg & Mazumdar, 1994).”
MethodA meta-analysis of work–family conflict and social support.
French, K. A., Dumani, S., Allen, T. D., & Shockley, K. M. (2018) · Psychological Bulletin · doi:10.1037/bul0000120 · Cited by 555
Weight management using a meal replacement strategy: meta and pooling analysis from six studies.
Heymsfield, S. B., van Mierlo, C. A. J., van der Knaap, H. C. M., Heo, M., & Frier, H. I. (2003) · International Journal of Obesity · doi:10.1038/sj.ijo.0802258 · Cited by 557
Handwashing and risk of respiratory infections: a quantitative systematic review
Rabie, T., & Curtis, V. (2006) · Tropical Medicine & International Health · doi:10.1111/j.1365-3156.2006.01568.x · Cited by 556
Does plyometric training improve vertical jump height? A meta-analytical review
Markovic, G. (2007) · British Journal of Sports Medicine · doi:10.1136/bjsm.2007.035113 · Cited by 553
Patra, J., Bakker, R., Irving, H., Jaddoe, V., Malini, S., & Rehm, J. (2011) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2011.03050.x · Cited by 555
How much variance can be explained by ecologists and evolutionary biologists?
Møller, A., & Jennions, M. D. (2002) · Oecologia · doi:10.1007/s00442-002-0952-2 · Cited by 553
Association Between Serum Uric Acid and Development of Type 2 Diabetes
Kodama, S., Saito, K., Yachi, Y., Asumi, M., Sugawara, A., Totsuka, K., Saito, A., & Sone, H. (2009) · Diabetes Care · doi:10.2337/dc09-0288 · Cited by 549
Wu, B., Yu, X., & Gu, X. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.13023 · Cited by 544
Allotey, J., Zamora, J., Cheong‐See, F., Kalidindi, M., Arroyo‐Manzano, D., Asztalos, E., van der Post, J., Mol, B., Moore, D., Birtles, D., et al. (2018) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14832 · Cited by 551
Systematic review and meta-analysis of Saccharomyces boulardii in adult patients
McFarland, L. V. (2010) · World Journal of Gastroenterology · doi:10.3748/wjg.v16.i18.2202 · Cited by 545
RESPONSE Re: Markers of DNA Repair and Susceptibility to Cancer in Humans: an Epidemiologic Review
Berwick, M. (2000) · Journal of the National Cancer Institute · doi:10.1093/jnci/92.18.1537 · Cited by 545
Lautenbacher, S., Peters, J. H., Heesen, M., Scheel, J., & Kunz, M. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.01.039 · Cited by 536
Bazzano, L. A., Khan, Z., Reynolds, K., & He, J. (2007) · Hypertension · doi:10.1161/hypertensionaha.106.085175 · Cited by 543
Comorbidity of fetal alcohol spectrum disorder: a systematic review and meta-analysis
Popova, S., Lange, S., Shield, K., Mihic, A., Chudley, A. E., Mukherjee, R. A. S., Bekmuradov, D., & Rehm, J. (2016) · The Lancet · doi:10.1016/s0140-6736(15)01345-8 · Cited by 541
Arias, Á., González-Cervera, J., Tenias, J. M., & Lucendo, A. J. (2014) · Gastroenterology · doi:10.1053/j.gastro.2014.02.006 · Cited by 543
Bachmann, S., Finger, C., Huss, A., Egger, M., Stuck, A. E., & Clough-Gorr, K. M. (2010) · BMJ · doi:10.1136/bmj.c1718 · Cited by 537
Aune, D., Norat, T., Romundstad, P., & Vatten, L. J. (2013) · European Journal of Epidemiology · doi:10.1007/s10654-013-9852-5 · Cited by 539
Clostridium difficile-associated diarrhea and proton pump inhibitor therapy: a meta-analysis
Janarthanan, S., Ditah, I., Adler, D. G., & Ehrinpreis, M. N. (2012) · American Journal of Gastroenterology · doi:10.1038/ajg.2012.179 · Cited by 538
R??TTINGEN, J.-A., WILLIAM CAMERON, D., & GARNETT, G. P. (2001) · Sexually Transmitted Diseases · doi:10.1097/00007435-200110000-00005 · Cited by 540
Li, Y., Scherer, N., Felix, L., & Kuper, H. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246454 · Cited by 536
Boonen, S., Lips, P., Bouillon, R., Bischoff-Ferrari, H. A., Vanderschueren, D., & Haentjens, P. (2007) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2006-1404 · Cited by 537
Ismail, K., Winkley, K., & Rabe-Hesketh, S. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16202-8 · Cited by 531
Navaneethan, U., Njei, B., Lourdusamy, V., Konjeti, R., Vargo, J. J., & Parsi, M. A. (2015) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2014.09.017 · Cited by 533
Systematic Review and Meta-Analysis of Methotrexate Use and Risk of Cardiovascular Disease
Micha, R., Imamura, F., Wyler von Ballmoos, M., Solomon, D. H., Hernán, M. A., Ridker, P. M., & Mozaffarian, D. (2011) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2011.06.054 · Cited by 535
Effect of aerobic exercise on hippocampal volume in humans: A systematic review and meta-analysis
Firth, J., Stubbs, B., Vancampfort, D., Schuch, F., Lagopoulos, J., Rosenbaum, S., & Ward, P. B. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.11.007 · Cited by 526
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Petrelli, F., Cortellini, A., Indini, A., Tomasello, G., Ghidini, M., Nigro, O., Salati, M., Dottorini, L., Iaculli, A., Varricchio, A., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.3520 · Cited by 530
Dawel, A., O’Kearney, R., McKone, E., & Palermo, R. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.08.006 · Cited by 530
Birth weight and subsequent risk of obesity: a systematic review and meta‐analysis
Yu, Z. B., Han, S. P., Zhu, G. Z., Zhu, C., Wang, X. J., Cao, X. G., & Guo, X. R. (2011) · Obesity Reviews · doi:10.1111/j.1467-789x.2011.00867.x · Cited by 529
Predicting the Big 5 personality traits from digital footprints on social media: A meta-analysis
Azucar, D., Marengo, D., & Settanni, M. (2018) · Personality and Individual Differences · doi:10.1016/j.paid.2017.12.018 · Cited by 526
Micha, R., Karageorgou, D., Bakogianni, I., Trichia, E., Whitsel, L. P., Story, M., Peñalvo, J. L., & Mozaffarian, D. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194555 · Cited by 526
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.