Operating Characteristics of a Rank Correlation Test for Publication Bias
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An adjusted rank correlation test is proposed as a technique for identifying publication bias in a meta-analysis, and its operating characteristics are evaluated via simulations. The test statistic is a direct statistical analogue of the popular "funnel-graph." The number of component studies in the meta-analysis, the nature of the selection mechanism, the range of variances of the effect size estimates, and the true underlying effect size are all observed to be influential in determining the power of the test. The test is fairly powerful for large meta-analyses with 75 component studies, but has only moderate power for meta-analyses with 25 component studies. However, in many of the configurations in which there is low power, there is also relatively little bias in the summary effect size estimate. Nonetheless, the test must be interpreted with caution in small meta-analyses. In particular, bias cannot be ruled out if the test is not significant. The proposed technique has potential utility as an exploratory tool for meta-analysts, as a formal procedure to complement the funnel-graph.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined the publication bias by examining a symmetry of the funnel plot of the trials using Eggers tests and regression asymmetry tests (Begg and Mazumdar, 1994; Egger et al., 1997). In case of asymmetry we applied the trim and fill method for all outcome measures (Begg and Mazumdar, 1994).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Begg and Mazumdar, 1994
In the citing paper
“The rank correlation was r = −.02, p = .67. Thus, there is no evidence of retrieval or inclusion bias.”
From Appealing to fear: A meta-analysis of fear appeal effectiveness and theories (2015) · cites this paper as Begg & Mazumdar, 1994
In the citing paper
“As shown in Figure 2, it is hard to conclude that the dots are symmetrically distributed, indicating the presence of publication bias.”
From A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries (2023) · cites this paper as Begg and Mazumdar (1994)
In the citing paper
“Funnel plots were used as another type of sensitivity analysis to test for publication bias.”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
In the citing paper
“Kendall’s τb for 1-tailed test with continuity correction suggested low publication bias in the compliance meta-analysis (τb = 0.131, p = .062).”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [49]
25 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“A more recent study by Easterbrook et al. (1991), in which studies identified from the records of hospital ethics committees were evaluated, demonstrated publication rates of 74% for studies with statistically significant outcomes and 45% for nonsignificant outcomes.”
BackgroundSumming up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Self-citationChlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
Publication Bias and Dissemination of Clinical Research
Begg, C. B., & Berlin, J. A. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.2.107 · Cited by 440
Self-citationSelection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K. B. G., & Begg, C. B. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 191
Self-citationPassive smoking and lung cancer: a publication bias?
Vandenbroucke, J. P. (1988) · BMJ · doi:10.1136/bmj.296.6619.391 · Cited by 83
Cited by
Items 701–800 of 1,708
Koutnikova, H., Genser, B., Monteiro-Sepulveda, M., Faurie, J.-M., Rizkalla, S., Schrezenmeir, J., & Clément, K. (2019) · BMJ Open · doi:10.1136/bmjopen-2017-017995 · Cited by 299
Corona, G., Maseroli, E., Rastrelli, G., Isidori, A. M., Sforza, A., Mannucci, E., & Maggi, M. (2014) · Expert Opinion on Drug Safety · doi:10.1517/14740338.2014.950653 · Cited by 297
“To estimate possible publication or disclosure bias, the authors used funnel plots and the Begg adjusted rank correlation test [134,135].”
MethodZymperdikas, V. F., Koretsi, V., Papageorgiou, S. N., & Papadopoulos, M. A. (2016) · The European Journal of Orthodontics · doi:10.1093/ejo/cjv034 · Cited by 297
The impact of the coronary collateral circulation on mortality: a meta-analysis
Meier, P., Hemingway, H., Lansky, A. J., Knapp, G., Pitt, B., & Seiler, C. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehr308 · Cited by 294
Hauk, N., Hüffmeier, J., & Krumm, S. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.01.020 · Cited by 294
Huo, R., Du, T., Xu, Y., Xu, W., Chen, X., Sun, K., & Yu, X. (2015) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2014.243 · Cited by 296
Broeders, J. A. J. L., Mauritz, F. A., Ahmed Ali, U., Draaisma, W. A., Ruurda, J. P., Gooszen, H. G., Smout, A. J. P. M., Broeders, I. A. M. J., & Hazebroek, E. J. (2010) · British Journal of Surgery · doi:10.1002/bjs.7174 · Cited by 298
Prosocial Consequences of Interpersonal Synchrony: A Meta-Analysis
Rennung, M., & Göritz, A. S. (2016) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000252 · Cited by 295
A Meta-Analysis of β-Convergence: the Legendary 2%
Abreu, M., de Groot, H. L. F., & Florax, R. J. G. M. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00253.x · Cited by 294
Ferguson, C. J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.11.002 · Cited by 295
“Again, it has been amply argued (e.g., Baumrind et al., 2002; Larzelere & Kuhn, 2005) that the operationalization of spanking and CP across studies has generally been weak, and clear delineations among open-handed spanking, other spanking, CP, and injurious abuse are absent.”
BackgroundSipahi, I. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.247 · Cited by 295
Sperm recovery and ICSI outcomes in Klinefelter syndrome: a systematic review and meta-analysis
Corona, G., Pizzocaro, A., Lanfranco, F., Garolla, A., Pelliccione, F., Vignozzi, L., Ferlin, A., Foresta, C., Jannini, E. A., Maggi, M., et al. (2017) · Human Reproduction Update · doi:10.1093/humupd/dmx008 · Cited by 297
The Effects of Writing on Learning in Science, Social Studies, and Mathematics: A Meta-Analysis
Graham, S., Kiuhara, S. A., & MacKay, M. (2020) · Review of Educational Research · doi:10.3102/0034654320914744 · Cited by 292
Page, M. J., Sterne, J. A. C., Higgins, J. P. T., & Egger, M. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1468 · Cited by 294
Preterm delivery and asthma: A systematic review and meta-analysis
Jaakkola, J. J. K., Ahmed, P., Ieromnimon, A., Goepfert, P., Laiou, E., Quansah, R., & Jaakkola, M. S. (2006) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2006.06.043 · Cited by 293
Jafri, N. S., Hornung, C. A., & Howden, C. W. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-12-200806170-00226 · Cited by 296
Kollias, A., Lagou, S., Zeniodi, M. E., Boubouchairopoulou, N., & Stergiou, G. S. (2016) · Hypertension · doi:10.1161/hypertensionaha.115.06066 · Cited by 287
Periodontal diseases and cardiovascular events: meta-analysis of observational studies
Blaizot, A., Vergnes, J.-N., Nuwwareh, S., Amar, J., & Sixou, M. (2009) · International Dental Journal · doi:10.1016/s0020-6539(20)33890-9 · Cited by 292
Sugar-sweetened beverages and risk of hypertension and CVD: a dose-response meta-analysis
Xi, B., Huang, Y., Reilly, K. H., Li, S., Zheng, R., Barrio-Lopez, M. T., Martinez-Gonzalez, M. A., & Zhou, D. (2015) · British Journal Of Nutrition · doi:10.1017/s0007114514004383 · Cited by 292
Kuyah, S., Whitney, C. W., Jonsson, M., Sileshi, G. W., Öborn, I., Muthuri, C. W., & Luedeling, E. (2019) · Agronomy for Sustainable Development · doi:10.1007/s13593-019-0589-8 · Cited by 288
Navaneethan, U., Hasan, M. K., Lourdusamy, V., Njei, B., Varadarajulu, S., & Hawes, R. H. (2015) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2015.04.030 · Cited by 288
Reduced Risk of Colorectal Cancer With Metformin Therapy in Patients With Type 2 Diabetes
Zhang, Z.-J., Zheng, Z.-J., Kan, H., Song, Y., Cui, W., Zhao, G., & Kip, K. E. (2011) · Diabetes Care · doi:10.2337/dc11-0512 · Cited by 291
Clark, T. (2002) · BJOG: An International Journal of Obstetrics and Gynaecology · doi:10.1016/s1470-0328(02)01088-1 · Cited by 292
Congestive Heart Failure Risk in Patients With Breast Cancer Treated With Bevacizumab
Choueiri, T. K., Mayer, E. L., Je, Y., Rosenberg, J. E., Nguyen, P. L., Azzi, G. R., Bellmunt, J., Burstein, H. J., & Schutz, F. A. B. (2011) · Journal of Clinical Oncology · doi:10.1200/jco.2010.31.9129 · Cited by 293
Venkatachalapathy, S., Sundararaj, D., Tandon, A., & Pereira, A. (2015) · Journal of International Society of Preventive and Community Dentistry · doi:10.4103/2231-0762.167719 · Cited by 287
P53 abnormalities and outcomes in colorectal cancer: a systematic review
Munro, A. J., Lain, S., & Lane, D. P. (2005) · British Journal of Cancer · doi:10.1038/sj.bjc.6602358 · Cited by 289
Yanada, M., Matsuo, K., Suzuki, T., Kiyoi, H., & Naoe, T. (2005) · Leukemia · doi:10.1038/sj.leu.2403838 · Cited by 289
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Rucker, G., Schwarzer, G., Carpenter, J. R., Binder, H., & Schumacher, M. (2011) · Biostatistics · doi:10.1093/biostatistics/kxq046 · Cited by 286
Kelly, H., Weiss, H. A., Benavente, Y., de Sanjose, S., Mayaud, P., Qiao, Y.-L., Feng, R.-M., DeVuyst, H., Tenet, V., Jaquet, A., et al. (2018) · The Lancet HIV · doi:10.1016/s2352-3018(17)30149-2 · Cited by 285
Arenas, D. J., Thomas, A., Wang, J., & DeLisser, H. M. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05202-4 · Cited by 289
Conde-Agudelo, A., & Romero, R. (2022) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2021.07.009 · Cited by 289
Aune, D., Navarro Rosenblatt, D. A., Chan, D. S. M., Vingeliene, S., Abar, L., Vieira, A. R., Greenwood, D. C., Bandera, E. V., & Norat, T. (2015) · Annals of Oncology · doi:10.1093/annonc/mdv142 · Cited by 288
Modelling publication bias in meta-analysis: a review
Sutton, A. J., Song, F., Gilbody, S. M., & Abrams, K. R. (2000) · Statistical Methods in Medical Research · doi:10.1177/096228020000900503 · Cited by 288
Eradication therapy for peptic ulcer disease in Helicobacter pylori -positive people
Ford, A. C., Gurusamy, K. S., Delaney, B., Forman, D., & Moayyedi, P. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003840.pub5 · Cited by 287
Lu, B., Kumar, A., Castellsagué, X., & Giuliano, A. R. (2011) · BMC Infectious Diseases · doi:10.1186/1471-2334-11-13 · Cited by 283
Detecting Selection Bias in Meta-Analyses with Multiple Outcomes: A Simulation Study
Fernández-Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2021) · The Journal of Experimental Education · doi:10.1080/00220973.2019.1582470 · Cited by 285
Antibody Tests in Detecting SARS-CoV-2 Infection: A Meta-Analysis
Kontou, P. I., Braliou, G. G., Dimou, N. L., Nikolopoulos, G., & Bagos, P. G. (2020) · Diagnostics · doi:10.3390/diagnostics10050319 · Cited by 288
Aune, D., Sen, A., ó'Hartaigh, B., Janszky, I., Romundstad, P. R., Tonstad, S., & Vatten, L. J. (2017) · Nutrition, Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2017.04.004 · Cited by 284
Crowley, M. J., Diamantidis, C. J., McDuffie, J. R., Cameron, C. B., Stanifer, J. W., Mock, C. K., Wang, X., Tang, S., Nagi, A., Kosinski, A. S., et al. (2017) · Annals of Internal Medicine · doi:10.7326/m16-1901 · Cited by 287
The socio-emotional processing stream in Anorexia Nervosa
Oldershaw, A., Hambrook, D., Stahl, D., Tchanturia, K., Treasure, J., & Schmidt, U. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.11.001 · Cited by 287
Yahagi, M., Okabayashi, K., Hasegawa, H., Tsuruta, M., & Kitagawa, Y. (2016) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-015-3026-6 · Cited by 286
Chang, R., Elhusseiny, K. M., Yeh, Y.-C., & Sun, W.-Z. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246318 · Cited by 287
Mauri, D., Pavlidis, N., Polyzos, N. P., & Ioannidis, J. P. A. (2006) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djj357 · Cited by 286
The placebo effect in irritable bowel syndrome trials: a meta‐analysis1
Patel, S. M., Stason, W. B., Legedza, A., Ock, S. M., Kaptchuk, T. J., Conboy, L., Canenguez, K., Park, J. K., Kelly, E., Jacobson, E., et al. (2005) · Neurogastroenterology & Motility · doi:10.1111/j.1365-2982.2005.00650.x · Cited by 285
Treatment of periodontal disease for glycaemic control in people with diabetes
Simpson, T. C., Needleman, I., Wild, S. H., Moles, D. R., & Mills, E. J. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004714.pub2 · Cited by 283
Stubbs, B., Vancampfort, D., Rosenbaum, S., Ward, P. B., Richards, J., Soundy, A., Veronese, N., Solmi, M., & Schuch, F. B. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.10.019 · Cited by 284
“Publication bias was assessed with a visual inspection of funnel plots and with the BeggMazumdar Kendall's tau (Begg and Mazumdar, 1994) and Egger bias test (Egger et al., 1997).”
MethodHow sedentary are people with psychosis? A systematic review and meta-analysis
Stubbs, B., Williams, J., Gaughran, F., & Craig, T. (2016) · Schizophrenia Research · doi:10.1016/j.schres.2016.01.034 · Cited by 284
Kastrati, A., Dibra, A., Eberle, S., Mehilli, J., Suárez de Lezo, J., Goy, J.-J., Ulm, K., & Schömig, A. (2005) · JAMA · doi:10.1001/jama.294.7.819 · Cited by 282
Cardiorespiratory fitness as predictor of cancer mortality: a systematic review and meta-analysis
Schmid, D., & Leitzmann, M. F. (2015) · Annals of Oncology · doi:10.1093/annonc/mdu250 · Cited by 276
Wu, Y., Yao, X., Vespasiani, G., Nicolucci, A., Dong, Y., Kwong, J., Li, L., Sun, X., Tian, H., & Li, S. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6522 · Cited by 283
“Publication bias was examined in Begg funnel plots and with the Egger linear regression test [33,34].”
Monami, M., Nardini, C., & Mannucci, E. (2014) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12244 · Cited by 284
The Effectiveness of School-Based Anti-Bullying Programs: A Meta-Analytic Review
Ferguson, C. J., Miguel, C. S., Kilburn, J. C., & Sanchez, P. (2007) · Criminal Justice Review · doi:10.1177/0734016807311712 · Cited by 282
Systematic review of the impact of N-acetylcysteine on contrast nephropathy
Pannu, N., Manns, B., Lee, H., & Tonelli, M. (2004) · Kidney International · doi:10.1111/j.1523-1755.2004.00516.x · Cited by 284
Sex Hormones, Hormonal Interventions, and Gastric Cancer Risk: A Meta-analysis
Camargo, M. C., Goto, Y., Zabaleta, J., Morgan, D. R., Correa, P., & Rabkin, C. S. (2012) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-11-0834 · Cited by 283
Changes in suicide rates following media reports on celebrity suicide: a meta-analysis
Niederkrotenthaler, T., Fu, K.-W., Yip, P. S. F., Fong, D. Y. T., Stack, S., Cheng, Q., & Pirkis, J. (2012) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2011-200707 · Cited by 281
Understanding of the impact of chemicals on amphibians: a meta‐analytic review
Egea‐Serrano, A., Relyea, R. A., Tejedo, M., & Torralva, M. (2012) · Ecology and Evolution · doi:10.1002/ece3.249 · Cited by 279
Meta-Analysis of the Prevalence of Unacknowledged Rape
Wilson, L. C., & Miller, K. E. (2016) · Trauma, Violence, & Abuse · doi:10.1177/1524838015576391 · Cited by 279
Duffield, T. F., Merrill, J. K., & Bagg, R. N. (2012) · Journal of Animal Science · doi:10.2527/jas.2011-5018 · Cited by 280
Pelucchi, C., Chatenoud, L., Turati, F., Galeone, C., Moja, L., Bach, J.-F., & La Vecchia, C. (2012) · Epidemiology · doi:10.1097/ede.0b013e31824d5da2 · Cited by 281
Zhao, G., Huang, L., Song, M., & Song, Y. (2013) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2013.08.023 · Cited by 282
van de Velde, H. J. K., Liu, X., Chen, G., Cakana, A., Deraedt, W., & Bayssas, M. (2007) · Haematologica · doi:10.3324/haematol.11534 · Cited by 283
Ros, R., & Graziano, P. A. (2018) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2016.1266644 · Cited by 277
The association between smartphone use, stress, and anxiety: A meta‐analytic review
Vahedi, Z., & Saiphoo, A. (2018) · Stress and Health · doi:10.1002/smi.2805 · Cited by 280
Demands, control, and support: A meta-analytic review of work characteristics interrelationships.
Luchman, J. N., & González-Morales, M. G. (2013) · Journal of Occupational Health Psychology · doi:10.1037/a0030541 · Cited by 279
Greenhouse gas emissions and crop yield in no-tillage systems: A meta-analysis
Huang, Y., Ren, W., Wang, L., Hui, D., Grove, J. H., Yang, X., Tao, B., & Goff, B. (2018) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2018.09.002 · Cited by 278
The use of ketamine as an antidepressant: a systematic review and meta‐analysis
Coyle, C. M., & Laws, K. R. (2015) · Human Psychopharmacology: Clinical and Experimental · doi:10.1002/hup.2475 · Cited by 279
Je, Y., Schutz, F. A., & Choueiri, T. K. (2009) · The Lancet Oncology · doi:10.1016/s1470-2045(09)70222-0 · Cited by 280
Effect of Exercise Training on Peak Oxygen Consumption in Patients with Cancer: A Meta-Analysis
Jones, L. W., Liang, Y., Pituskin, E. N., Battaglini, C. L., Scott, J. M., Hornsby, W. E., & Haykowsky, M. (2011) · The Oncologist · doi:10.1634/theoncologist.2010-0197 · Cited by 276
Isaacs, A. M., Riva-Cambrin, J., Yavin, D., Hockley, A., Pringsheim, T. M., Jette, N., Lethebe, B. C., Lowerison, M., Dronyk, J., & Hamilton, M. G. (2018) · PLOS ONE · doi:10.1371/journal.pone.0204926 · Cited by 276
Kuester, A., Niemeyer, H., & Knaevelsrud, C. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.11.004 · Cited by 261
James, M. T., Samuel, S. M., Manning, M. A., Tonelli, M., Ghali, W. A., Faris, P., Knudtson, M. L., Pannu, N., & Hemmelgarn, B. R. (2013) · Circulation: Cardiovascular Interventions · doi:10.1161/circinterventions.112.974493 · Cited by 277
Donor-Specific Antibodies Adversely Affect Kidney Allograft Outcomes
Mohan, S., Palanisamy, A., Tsapepas, D., Tanriover, B., Crew, R. J., Dube, G., Ratner, L. E., Cohen, D. J., & Radhakrishnan, J. (2012) · Journal of the American Society of Nephrology · doi:10.1681/asn.2012070664 · Cited by 277
Pletzer, J. L., Nikolova, R., Kedzior, K. K., & Voelpel, S. C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130005 · Cited by 274
Soy consumption and prostate cancer risk in men: a revisit of a meta-analysis
Yan, L., & Spitznagel, E. L. (2009) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.2008.27029 · Cited by 276
Yang, Y., Gao, P., Song, Y., Sun, J., Chen, X., Zhao, J., Ma, B., & Wang, Z. (2016) · European Journal of Surgical Oncology (EJSO) · doi:10.1016/j.ejso.2016.05.029 · Cited by 276
Understanding the Third-Person Perception: Evidence From a Meta-Analysis
Sun, Y., Pan, Z., & Shen, L. (2008) · Journal of Communication · doi:10.1111/j.1460-2466.2008.00385.x · Cited by 276
Martín-María, N., Miret, M., Caballero, F. F., Rico-Uribe, L. A., Steptoe, A., Chatterji, S., & Ayuso-Mateos, J. L. (2017) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000444 · Cited by 274
Socioeconomic status and inflammation: a meta-analysis
Muscatell, K. A., Brosso, S. N., & Humphreys, K. L. (2020) · Molecular Psychiatry · doi:10.1038/s41380-018-0259-2 · Cited by 274
CXCR4 over-expression and survival in cancer: A system review and meta-analysis
Zhao, H., Guo, L., Zhao, H., Zhao, J., Weng, H., & Zhao, B. (2015) · Oncotarget · doi:10.18632/oncotarget.3217 · Cited by 274
Publication bias in ecology and evolution: an empirical assessment using the ‘trim and fill’ method
JENNIONS, M. D., & MØLLER, A. P. (2002) · Biological Reviews · doi:10.1017/s1464793101005875 · Cited by 230
Ramsden, C. E., Hibbeln, J. R., Majchrzak, S. F., & Davis, J. M. (2010) · British Journal of Nutrition · doi:10.1017/s0007114510004010 · Cited by 275
Yu, R., Geddes, J. R., & Fazel, S. (2012) · Journal of Personality Disorders · doi:10.1521/pedi.2012.26.5.775 · Cited by 275
Dynamic Resistance Training as Stand‐Alone Antihypertensive Lifestyle Therapy: A Meta‐Analysis
MacDonald, H. V., Johnson, B. T., Huedo‐Medina, T. B., Livingston, J., Forsyth, K. C., Kraemer, W. J., Farinatti, P. T. V., & Pescatello, L. S. (2016) · Journal of the American Heart Association · doi:10.1161/jaha.116.003231 · Cited by 273
The intergenerational transmission of child maltreatment: A three-level meta-analysis
Assink, M., Spruit, A., Schuts, M., Lindauer, R., van der Put, C. E., & Stams, G.-J. J. M. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.07.037 · Cited by 275
Face masks to prevent transmission of COVID-19: A systematic review and meta-analysis
Li, Y., Liang, M., Gao, L., Ayaz Ahmed, M., Uy, J. P., Cheng, C., Zhou, Q., & Sun, C. (2021) · American Journal of Infection Control · doi:10.1016/j.ajic.2020.12.007 · Cited by 275
Pregnancy outcome after first-trimester exposure to metformin: a meta-analysis
Gilbert, C., Valois, M., & Koren, G. (2006) · Fertility and Sterility · doi:10.1016/j.fertnstert.2006.02.098 · Cited by 274
Tian, S., & Xu, Y. (2016) · Geriatrics & Gerontology International · doi:10.1111/ggi.12579 · Cited by 274
Steep discounting of delayed monetary and food rewards in obesity: a meta-analysis
Amlung, M., Petker, T., Jackson, J., Balodis, I., & MacKillop, J. (2016) · Psychological Medicine · doi:10.1017/s0033291716000866 · Cited by 274
“Funnel plots of effect size and standard error were examined via the two-tailed Begg–Mazumdar test (Begg & Mazumdar, 1994), which reports the rank correlation between effect size and standard error, and the one-tailed Egger’s test (Egger et al. 1997), which regresses the standardized effect size on…”
MethodKlassen, J. A., Liang, Y., Tjosvold, L., Klassen, T. P., & Hartling, L. (2008) · Ambulatory Pediatrics · doi:10.1016/j.ambp.2007.12.005 · Cited by 272
Kim, T. J., & von dem Knesebeck, O. (2016) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-015-1107-1 · Cited by 271
Tsaousis, I. (2016) · Aggression and Violent Behavior · doi:10.1016/j.avb.2016.09.005 · Cited by 273
Singh, R. G., Yoon, H. D., Wu, L. M., Lu, J., Plank, L. D., & Petrov, M. S. (2017) · Metabolism · doi:10.1016/j.metabol.2016.12.012 · Cited by 271
Shen, N. T., Maw, A., Tmanova, L. L., Pino, A., Ancy, K., Crawford, C. V., Simon, M. S., & Evans, A. T. (2017) · Gastroenterology · doi:10.1053/j.gastro.2017.02.003 · Cited by 273
Treatment of fibromyalgia with cyclobenzaprine: A meta‐analysis
Tofferi, J. K., Jackson, J. L., & O'Malley, P. G. (2004) · Arthritis Care & Research · doi:10.1002/art.20076 · Cited by 273
Cognitive behavioural therapies for fibromyalgia
Bernardy, K., Klose, P., Busch, A. J., Choy, E. H., & Häuser, W. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009796.pub2 · Cited by 272
Banks, G. C., Batchelor, J. H., Seers, A., O'Boyle, E. H., Pollack, J. M., & Gower, K. (2014) · Journal of Organizational Behavior · doi:10.1002/job.1885 · Cited by 272
Efficacy and safety of convex probe EBUS-TBNA in sarcoidosis: A systematic review and meta-analysis
Agarwal, R., Srinivasan, A., Aggarwal, A. N., & Gupta, D. (2012) · Respiratory Medicine · doi:10.1016/j.rmed.2012.02.014 · Cited by 272
Exercise Interventions for Cancer Survivors: A Meta-Analysis of Quality of Life Outcomes
Ferrer, R. A., Huedo-Medina, T. B., Johnson, B. T., Ryan, S., & Pescatello, L. S. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9225-1 · Cited by 272
Fiest, K. M., Roberts, J. I., Maxwell, C. J., Hogan, D. B., Smith, E. E., Frolkis, A., Cohen, A., Kirk, A., Pearson, D., Pringsheim, T., et al. (2016) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/cjn.2016.36 · Cited by 272
Almadi, M. A., Barkun, A., & Martel, M. (2017) · American Journal of Gastroenterology · doi:10.1038/ajg.2016.512 · Cited by 270
Metadata
- Authors
- Begg, C. B., & Mazumdar, M.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- ORCID
- Begg, Colin B.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1994-12
- Volume
- 50
- Issue
- 4
- Pages
- 1088
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1964435302
- Cited by
- 16,955
- References
- 11
- Citations by year
- 2026: 746 · 2025: 891 · 2024: 1122 · 2023: 1105 · 2022: 1221 · 2021: 1349 · 2020: 1206 · 2019: 1053 · 2018: 1015 · 2017: 968 · 2016: 976 · 2015: 1076 · 2014: 957 · 2013: 803 · 2012: 587
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (CA08748, P30CA008748)
- U.S. National Library of Medicine (LM-05527)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- publication bias, funnel plot, meta-analysis, statistical power, selection bias, effect size heterogeneity
- MeSH terms
- Chlamydia Infections, Chlorine, Contraceptives, Oral, Female, Humans, Lung Neoplasms, Mathematics, Neoplasms, Publishing, Tobacco Smoke Pollution, Water Supply, Meta-Analysis as Topic, Models, Statistical, Bias, Odds Ratio, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.