Updated tests for small-study effects in meta-analyses
Open accessAbstract
This article describes an updated version of the metabias command, which provides statistical tests for funnel plot asymmetry. In addition to the previously implemented tests, metabias implements two new tests that are recommended in the recently updated Cochrane Handbook for Systematic Reviews of Interventions (Higgins and Green 2008). The first new test, proposed by Harbord, Egger, and Sterne (2006, Statistics in Medicine 25: 3443–3457), is a modified version of the commonly used test proposed by Egger et al. (1997, British Medical Journal 315: 629–634). It regresses Z/[Formula: see text] against [Formula: see text], where Z is the efficient score and V is Fisher's information (the variance of Z under the null hypothesis). The second new test is Peters’ test, which is based on a weighted linear regression of the intervention effect estimate on the reciprocal of the sample size. Both of these tests maintain better control of the false-positive rate than the test proposed by Egger at al., while retaining similar power.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Publication bias was assessed by using Deeks' and Harbord's regression tests for the pooled absolute and relative accuracy estimates, respectively.
“We assessed publication bias by using Deeks' and Harbord's regression tests for the pooled absolute and relative accuracy estimates, respectively.36 37”
From Detecting cervical precancer and reaching underscreened women by using HPV testing on self samples: updated meta-analyses (2018) · cites this paper as [37]
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · see citing works
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · see citing works
Conducting Meta-Analyses in <i>R</i> with the <b>metafor</b> Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · see citing works
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · see citing works
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779 · see citing works
Self-citationDeeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910 · see citing works
ON ESTIMATING THE RELATION BETWEEN BLOOD GROUP AND DISEASE
Woolf, B. (1955) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1955.tb01348.x · Cited by 2,739 · see citing works
Nicotine replacement therapy for smoking cessation
Stead, L. F., Perera, R., Bullen, C., Mant, D., Hartmann‐Boyce, J., Cahill, K., & Lancaster, T. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000146.pub4 · Cited by 2,514 · see citing works
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282 · see citing works
Self-citationComparison of two methods to detect publication bias in meta-analysis.
Peters, J. L. (2006) · JAMA · doi:10.1001/jama.295.6.676 · Cited by 2,278 · see citing works
A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267 · cited 4× · see citing works
“If, as seems more realistic, n0 and n1 are considered fixed but d and h are not, the correlation remains lower than that between φ and its variance as calculated by the Woolf formula, leading to reduced false-positive rates (Harbord, Egger, and Sterne 2006).”
InfluentialSelf-citationChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · see citing works
The Cochrane Database of Systematic Reviews
Handoll, H. H. (2004) · The British Journal of Hand Therapy · doi:10.1177/175899830400900201 · Cited by 1,516 · see citing works
Summing up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,486 · see citing works
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,422 · see citing works
A comparison of methods to detect publication bias in meta‐analysis
Macaskill, P., Walter, S. D., & Irwig, L. (2001) · Statistics in Medicine · doi:10.1002/sim.698 · Cited by 1,286 · see citing works
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814 · see citing works
A general parametric approach to the meta‐analysis of randomized clinical trials
Whitehead, A., & Whitehead, J. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101105 · Cited by 750 · see citing works
Sterne, J. A. C., & Harbord, R. M. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400204 · Cited by 708 · see citing works
Self-citationA note on graphical presentation of estimated odds ratios from several clinical trials
Galbraith, R. F. (1988) · Statistics in Medicine · doi:10.1002/sim.4780070807 · Cited by 663 · see citing works
Sterne, J. A., Egger, M., & Moher, D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch10 · Cited by 651 · see citing works
Self-citationThe Design and Analysis of Sequential Clinical Trials.
Harrington, D. T., & Whitehead, J. (1985) · Journal of the American Statistical Association · doi:10.2307/2288093 · Cited by 637 · see citing works
Arcsine test for publication bias in meta‐analyses with binary outcomes
Rücker, G., Schwarzer, G., & Carpenter, J. R. (2007) · Statistics in Medicine · doi:10.1002/sim.2971 · Cited by 444 · see citing works
Contour-Enhanced Funnel Plots for Meta-Analysis
Palmer, T., Sutton, A. J., Peters, J., & Moreno, S. G. (2008) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800206 · Cited by 256 · see citing works
Bias in meta-analysis detected by a simple, graphical test. Graphical test is itself biased.
Irwig, L., Macaskill, P., Berry, G., & Glasziou, P. (1998) · PubMed Central · Cited by 240 · see citing works
Tests for publication bias in meta-analysis
Steichen, T. J. (1998) · Stata technical bulletin · Cited by 103 · see citing works
British Medical Journal Publishing Group (1898) · BMJ · doi:10.1136/bmj.1.1938.509 · Cited by 14 · see citing works
Biostatistical aspects for the use of evidence based medicine in health technology assessment
Freemantle, N. (2008) · The European Journal of Health Economics · doi:10.1007/s10198-008-0123-4 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Interventions for preventing obesity in children
Brown, T. J., Moore, T. H., Hooper, L., Gao, Y., Zayegh, A. M., Ijaz, S., Elwenspoek, M. M. C., Foxen, S. C., Magee, L., O’Malley, C. L., et al. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001871.pub4 · Cited by 2,996 · see citing works
Walker, E. R., McGee, R. E., & Druss, B. G. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.2502 · Cited by 2,976 · see citing works
Controlled Interventions to Reduce Burnout in Physicians: A Systematic Review and Meta-analysis
Panagioti, M., Panagopoulou, E., Bower, P., Lewith, G., Kontopantelis, E., Chew-Graham, C., Dawson, S., van Marwijk, H., Geraghty, K., & Esmail, A. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.7674 · Cited by 1,395 · see citing works
“The pooled SMDs and the forest plots were computed using the metaan command inStata 14.(27)Themainmeta-analysis evaluated the effectivenessof the interventions inreducingburnout.”
MethodPanagioti, M., Geraghty, K., Johnson, J., Zhou, A. Y., Panagopoulou, E. P., Chew-Graham, C. A., Peters, D. H., Hodkinson, A., Riley, R. A., & Esmail, A. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3713 · Cited by 989 · see citing works
RetractedSpanking and child outcomes: Old controversies and new meta-analyses.
Gershoff, E. T., & Grogan-Kaylor, A. (2016) · Journal of Family Psychology · doi:10.1037/fam0000191 · Cited by 931 · see citing works
“…study to be used in moderator analyses: (a) study design (experimental, longitudinal, cross-sectional, or retrospective); (b) measure of spanking (observation, parent report, child report, child retrospective, or both parent and child reports); (c) index of spanking (when used [either observed…”
MethodPanagioti, M., Khan, K., Keers, R. N., Abuzour, A., Phipps, D., Kontopantelis, E., Bower, P., Campbell, S., Haneef, R., Avery, A. J., et al. (2019) · BMJ · doi:10.1136/bmj.l4185 · Cited by 874 · see citing works
Arbyn, M., Smith, S. B., Temin, S., Sultana, F., & Castle, P. (2018) · BMJ · doi:10.1136/bmj.k4823 · Cited by 851 · see citing works
Arbyn, M., Verdoodt, F., Snijders, P. J. F., Verhoef, V. M. J., Suonio, E., Dillner, L., Minozzi, S., Bellisario, C., Banzi, R., Zhao, F.-H., et al. (2014) · The Lancet Oncology · doi:10.1016/s1470-2045(13)70570-9 · Cited by 674 · see citing works
Arbyn, M., Xu, L., Simoens, C., & Martin-Hirsch, P. P. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009069.pub3 · Cited by 621 · see citing works
Lauersen, J. B., Bertelsen, D. M., & Andersen, L. B. (2013) · British Journal of Sports Medicine · doi:10.1136/bjsports-2013-092538 · Cited by 580 · see citing works
Kirkbride, J. B., Errázuriz, A., Croudace, T. J., Morgan, C., Jackson, D., Boydell, J. E., Murray, R. M., & Jones, P. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031660 · Cited by 535 · see citing works
Henderson, J. T., Whitlock, E. P., O’Connor, E., Senger, C. A., Thompson, J. H., & Rowland, M. G. (2014) · Annals of Internal Medicine · doi:10.7326/m13-2844 · Cited by 500 · see citing works
Stockings, E., Campbell, G., Hall, W. D., Nielsen, S., Zagic, D., Rahman, R., Murnion, B., Farrell, M., Weier, M., & Degenhardt, L. (2018) · Pain · doi:10.1097/j.pain.0000000000001293 · Cited by 460 · see citing works
Mindfulness treatment for substance misuse: A systematic review and meta-analysis
Li, W., Howard, M. O., Garland, E. L., McGovern, P., & Lazar, M. (2017) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2017.01.008 · Cited by 446 · see citing works
Fusar-Poli, P., Cappucciati, M., Borgwardt, S., Woods, S. W., Addington, J., Nelson, B., Nieman, D. H., Stahl, D. R., Rutigliano, G., Riecher-Rössler, A., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2324 · Cited by 440 · see citing works
Long-Term Unemployment and Suicide: A Systematic Review and Meta-Analysis
Milner, A., Page, A., & LaMontagne, A. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0051333 · Cited by 407 · see citing works
Balk, E. M., Earley, A., Raman, G., Avendano, E. A., Pittas, A. G., & Remington, P. L. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0452 · Cited by 371 · see citing works
Suicide by occupation: Systematic review and meta-analysis
Milner, A., Spittal, M. J., Pirkis, J., & LaMontagne, A. D. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.113.128405 · Cited by 387 · see citing works
Nisa, C. F., Bélanger, J. J., Schumpe, B. M., & Faller, D. G. (2019) · Nature Communications · doi:10.1038/s41467-019-12457-2 · Cited by 349 · see citing works
Fusar‐Poli, P., Tantardini, M., Simone, S. D., Ramella‐Cravaro, V., Oliver, D., Kingdon, J., Kotlicka‐Antczak, M., Valmaggia, L., Lee, J., Millan, M. J., et al. (2016) · European Psychiatry · doi:10.1016/j.eurpsy.2016.09.003 · Cited by 307 · see citing works
Zhou, A. Y., Panagioti, M., Esmail, A., Agius, R., Van Tongeren, M., & Bower, P. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.13761 · Cited by 292 · see citing works
Newer generation antidepressants for depressive disorders in children and adolescents
Hetrick, S. E., McKenzie, J. E., Cox, G. R., Simmons, M. B., & Merry, S. N. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004851.pub3 · Cited by 291 · see citing works
International incidence of psychotic disorders, 2002–17: a systematic review and meta-analysis
Jongsma, H. E., Turner, C., Kirkbride, J. B., & Jones, P. B. (2019) · The Lancet Public Health · doi:10.1016/s2468-2667(19)30056-8 · Cited by 289 · see citing works
Discacciati, A., Orsini, N., & Wolk, A. (2012) · Annals of Oncology · doi:10.1093/annonc/mdr603 · Cited by 276 · see citing works
Bosco, C., Bosnyák, Z., Malmberg, A., Adolfsson, J., Keating, N. L., & Hemelrijck, M. V. (2014) · European Urology · doi:10.1016/j.eururo.2014.11.039 · Cited by 264 · see citing works
Milner, A., Page, A., & LaMontagne, A. D. (2014) · Psychological Medicine · doi:10.1017/s0033291713001621 · Cited by 255 · see citing works
Perinatal outcomes associated with maternal HIV infection: a systematic review and meta-analysis
Wedi, C. O. O., Kirtley, S., Hopewell, S., Corrigan, R. A., Kennedy, S., & Hemelaar, J. (2015) · The Lancet HIV · doi:10.1016/s2352-3018(15)00207-6 · Cited by 257 · see citing works
Liu, Y., & Pásztor, A. (2022) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2022.101069 · Cited by 400 · see citing works
Gingival crevicular fluid levels of cytokines/chemokines in chronic periodontitis: a meta‐analysis
Stadler, A. F., Angst, P. D. M., Arce, R. M., Gomes, S. C., Oppermann, R. V., & Susin, C. (2016) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.12557 · Cited by 235 · see citing works
Oldershaw, A., Lavender, T., Sallis, H., Stahl, D., & Schmidt, U. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.04.005 · Cited by 222 · see citing works
Stokes, J., Panagioti, M., Alam, R., Checkland, K., Cheraghi‐Sohi, S., & Bower, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0132340 · Cited by 222 · see citing works
Tyson, M. D., & Chang, S. S. (2016) · European Urology · doi:10.1016/j.eururo.2016.05.031 · Cited by 221 · see citing works
Koh, W. C., Naing, L., Chaw, L., Rosledzana, M. A., Alikhan, M. F., Jamaludin, S. A., Amin, F., Omar, A., Shazli, A., Griffith, M., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0240205 · Cited by 207 · see citing works
Milner, A. J., Carter, G., Pirkis, J., Robinson, J., & Spittal, M. J. (2015) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.147819 · Cited by 211 · see citing works
Galkanda‐Arachchige, H. S. C., Wilson, A. E., & Davis, D. A. (2019) · Reviews in Aquaculture · doi:10.1111/raq.12401 · Cited by 190 · see citing works
Kyrgiou, M., Mitra, A., Arbyn, M., Stasinou, S. M., Martin-Hirsch, P., Bennett, P., & Paraskevaidis, E. (2014) · BMJ · doi:10.1136/bmj.g6192 · Cited by 188 · see citing works
Daily iron supplementation for improving anaemia, iron status and health in menstruating women
Low, M. S. Y., Speedy, J., Styles, C. E., De-Regil, L. M., & Pasricha, S.-R. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009747.pub2 · Cited by 178 · see citing works
Wilson, S. J., Tanner-Smith, E. E., Lipsey, M. W., Steinka-Fry, K., & Morrison, J. (2011) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2011.8 · Cited by 173 · see citing works
Tefikow, S., Barth, J., Maichrowitz, S., Beelmann, A., Strauss, B., & Rosendahl, J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.03.005 · Cited by 170 · see citing works
Merlotti, C., Morabito, A., & Pontiroli, A. E. (2014) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12270 · Cited by 165 · see citing works
Interventions to Reduce Compulsory Psychiatric Admissions: A Systematic Review and Meta-analysis
de Jong, M. H., Kamperman, A. M., Oorschot, M., Priebe, S., Bramer, W., van de Sande, R., Van Gool, A. R., & Mulder, C. L. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.0501 · Cited by 167 · see citing works
Dang, Y., Reinhardt, J. D., Zhou, X., & Zhang, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111030 · Cited by 168 · see citing works
Harris, K. M., Kneale, D., Lasserson, T. J., McDonald, V. M., Grigg, J., & Thomas, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011651.pub2 · Cited by 169 · see citing works
Thomas, K. H., Martin, R. M., Knipe, D. W., Higgins, J. P. T., & Gunnell, D. (2015) · BMJ · doi:10.1136/bmj.h1109 · Cited by 155 · see citing works
Concussion Guidelines Step 2: Evidence for Subtype Classification
Lumba‐Brown, A., Teramoto, M., Bloom, O. J., Brody, D. L., Chesnutt, J. C., Clugston, J. R., Collins, M. W., Gioia, G. A., Kontos, A. P., Lal, A., et al. (2019) · Neurosurgery · doi:10.1093/neuros/nyz332 · Cited by 158 · see citing works
Ayieko, J., Abuogi, L., Simchowitz, B., Bukusi, E. A., Smith, A. H., & Reingold, A. L. (2014) · BMC Infectious Diseases · doi:10.1186/1471-2334-14-91 · Cited by 152 · see citing works
Prognosis of Brief Psychotic Episodes: A Meta-analysis
Fusar-Poli, P., Cappucciati, M., Bonoldi, I., Hui, L. M. C., Rutigliano, G., Stahl, D. R., Borgwardt, S., Politi, P., Mishara, A. L., Lawrie, S. M., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2313 · Cited by 151 · see citing works
Lau, D., Hu, J., Majumdar, S. R., Storie, D., Rees, S. E., & Johnson, J. A. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1405 · Cited by 143 · see citing works
A meta‐analysis of pica and micronutrient status
Miao, D., Young, S. L., & Golden, C. D. W. (2014) · American Journal of Human Biology · doi:10.1002/ajhb.22598 · Cited by 137 · see citing works
Egert, F., Dederer, V., & Fukkink, R. G. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.100309 · Cited by 160 · see citing works
A hands-on practical tutorial on performing meta-analysis with Stata
Chaimani, A., Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101967 · Cited by 134 · see citing works
Morris, R. K., Bilagi, A., Devani, P., & Kilby, M. D. (2016) · Prenatal Diagnosis · doi:10.1002/pd.5001 · Cited by 123 · see citing works
Johnson, J., & Panagioti, M. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002308 · Cited by 123 · see citing works
Schmalenberger, K., Eisenlohr-Moul, T., Würth, L., Schneider, E., Thayer, J., Ditzen, B., & Jarczok, M. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8111946 · Cited by 104 · see citing works
Multimorbidity and Patient Safety Incidents in Primary Care: A Systematic Review and Meta-Analysis
Panagioti, M., Stokes, J., Esmail, A., Coventry, P. A., Cheraghi‐Sohi, S., Alam, R., & Bower, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0135947 · Cited by 119 · see citing works
A meta-analysis of residential water demand studies
Sebri, M. (2013) · Environment Development and Sustainability · doi:10.1007/s10668-013-9490-9 · Cited by 112 · see citing works
Smoking cessation interventions for adults aged 50 or older: A systematic review and meta-analysis
Chen, D., & Wu, L.-T. T. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.06.004 · Cited by 109 · see citing works
Salazar de Pablo, G., Catalan, A., & Fusar-Poli, P. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.3561 · Cited by 103 · see citing works
Morris, R. K., Meller, C., Tamblyn, J. A., Malin, G., Riley, R. D., Kilby, M. D., Robson, S. C., & Khan, K. S. (2014) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.12589 · Cited by 103 · see citing works
Immunosuppressive treatment for idiopathic membranous nephropathy in adults with nephrotic syndrome
Chen, Y., Schieppati, A., Chen, X., Cai, G., Zamora, J., Giuliano, G. A., Braun, N., & Perna, A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004293.pub3 · Cited by 103 · see citing works
Salehi-Vaziri, ., Sadeghi, F., Almasi‐Hashiani, A., Fesharaki, M. G., & Alavian, S. M. (2016) · Hepatitis Monthly · doi:10.5812/hepatmon.35577 · Cited by 101 · see citing works
Ngamaba, K. H., Armitage, C. J., Panagioti, M., & Hodkinson, A. (2020) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2020.101522 · Cited by 100 · see citing works
East, K. A., McNeill, A. D., Thrasher, J. F., & Hitchman, S. C. (2021) · Addiction · doi:10.1111/add.15427 · Cited by 100 · see citing works
Bastien, R. J., Jongsma, H. E., Kabadayi, M., & Billings, J. (2020) · Psychological Medicine · doi:10.1017/s0033291720002007 · Cited by 94 · see citing works
Taouk, Y., Spittal, M. J., LaMontagne, A. D., & Milner, A. J. (2019) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.3854 · Cited by 97 · see citing works
Exploring and accounting for publication bias in mental health: a brief overview of methods
Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2013-101700 · Cited by 90 · see citing works
Do drug courts reduce the use of incarceration?: A meta-analysis
Sevigny, E. L., Fuleihan, B., & Ferdik, F. V. (2013) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2013.06.005 · Cited by 89 · see citing works
Doorn, R. R. V., Mukhtarova, N., Flyke, I. P., Lasarev, M. R., Kim, K., Hennekens, C. H., & Hoppe, K. K. (2021) · PLoS ONE · doi:10.1371/journal.pone.0247782 · Cited by 96 · see citing works
Malin, G., Morris, R. K., Riley, R. D., Teune, M., & Khan, K. S. (2014) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.12517 · Cited by 88 · see citing works
Blood loss in spinal tumour surgery and surgery for metastatic spinal disease
Chen, Y., Tai, B. C., Nayak, D. V., Kumar, N., Chua, K. H., Lim, J.-L., Goy, R., & Wong, H. K. (2013) · The Bone & Joint Journal · doi:10.1302/0301-620x.95b5.31270 · Cited by 86 · see citing works
Promoting Sustainable Hotel Guest Behavior: A Systematic Review and Meta-Analysis
Nisa, C. F., Varum, C., & Botelho, A. (2017) · Cornell Hospitality Quarterly · doi:10.1177/1938965517704371 · Cited by 81 · see citing works
Edgcomb, J. B., & Zima, B. T. (2018) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2018.0040 · Cited by 78 · see citing works
Reyher, K. K., Haine, D., Dohoo, I. R., & Revie, C. W. (2012) · Journal of Dairy Science · doi:10.3168/jds.2012-5594 · Cited by 77 · see citing works
Psychiatric readmission of children and adolescents: a systematic review and meta-analysis.
Edgcomb, J. B., Sorter, M., Lorberg, B., & Zima, B. T. (2020) · Psychiatric Services · doi:10.1176/appi.ps.201900234 · Cited by 77 · see citing works
Roussel, C., Witt, K. L., Shaw, P. B., & Connor, T. H. (2017) · Mutation Research/Reviews in Mutation Research · doi:10.1016/j.mrrev.2017.08.002 · Cited by 74 · see citing works
Gavriilidis, P., Azoulay, D., & Taflampas, P. (2018) · Surgery Today · doi:10.1007/s00595-018-1708-x · Cited by 71 · see citing works
Welding fumes and lung cancer: a meta-analysis of case-control and cohort studies
Honaryar, M. K., Lunn, R. M., Luce, D., Ahrens, W., Mannetje, A. ’., Hansen, J., Bouaoun, L., LOOMIS, D. P., Byrnes, G. B., Vilahur, N., et al. (2019) · Occupational and Environmental Medicine · doi:10.1136/oemed-2018-105447 · Cited by 70 · see citing works
Pellowski, J. A., Price, D. M., Harrison, A. D., Tuthill, E. L., Myer, L., Operario, D., & Lurie, M. N. (2018) · AIDS and Behavior · doi:10.1007/s10461-018-2341-9 · Cited by 69 · see citing works
Papp, M., Kiss, N., Baka, M., Trásy, D., Zubek, L., Fehérvári, P., Harnos, A., Turan, C., Hegyi, P. J., & Molnár, Z. (2023) · Critical Care · doi:10.1186/s13054-023-04677-2 · Cited by 69 · see citing works
Chen, Y., Abbate, M., Tang, L., Cai, G., Gong, Z., Wei, R., Zhou, J., & Chen, X. (2013) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.062802 · Cited by 69 · see citing works
Calorie delivery and clinical outcomes in the critically ill: a systematic review and meta-analysis
Parikh, H. G., Miller, A., Chapman, M., Moran, J. L., & Peake, S. L. (2016) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)00927-4 · Cited by 69 · see citing works
The impacts of family treatment drug court on child welfare core outcomes: A meta-analysis
Zhang, S., Huang, H., Wu, Q., Li, Y., & Liu, M. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.10.014 · Cited by 68 · see citing works
Adane, A. A., Bailey, H. D., Morgan, V. A., Galbally, M., Farrant, B. M., Marriott, R., White, S. W., & Shepherd, C. (2021) · Archives of Women s Mental Health · doi:10.1007/s00737-020-01099-9 · Cited by 69 · see citing works
Adewumi, A. D., Hollingworth, S., Maravilla, J. C., Connor, J. P., & Alati, R. (2018) · CNS Drugs · doi:10.1007/s40263-018-0499-3 · Cited by 66 · see citing works
Zuo, X., Tang, Y., Chen, Y., & Zhou, Z. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1259250 · Cited by 86 · see citing works
Aronis, K. N., Khan, S. M., & Mantzoros, C. S. (2012) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.040576 · Cited by 64 · see citing works
Immunosuppression for Membranous Nephropathy
Chen, Y., Schieppati, A., Cai, G., Chen, X., Zamora, J., Giuliano, G. A., Braun, N., & Perna, A. (2013) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.07570712 · Cited by 61 · see citing works
Tourniquet use for knee replacement surgery
Ahmed, I., Chawla, A., Underwood, M. R., Price, A. J., Metcalfe, A. J., Hutchinson, C. E., Warwick, J., Seers, K., Parsons, H. M., & Wall, P. D. H. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012874.pub2 · Cited by 58 · see citing works
Hosseini‐Hooshyar, S., Hajarizadeh, B., Bajis, S., Law, M. G., Janjua, N. Z., Fierer, D. S., Chromy, D., Rockstroh, J. K., Martin, T., Ingiliz, P., et al. (2021) · SSRN Electronic Journal · doi:10.1016/s2352-3018(22)00077-7 · Cited by 59 · see citing works
Millgate, E., Hide, O., Lawrie, S. M., Murray, R. M., MacCabe, J. H., & Kravariti, E. (2021) · Psychological Medicine · doi:10.1017/s0033291721004128 · Cited by 57 · see citing works
Sarmanova, A., Hall, M. C., Moses, J. P., Doherty, M., & Zhang, W. (2016) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2016.03.004 · Cited by 59 · see citing works
Sarcopenic obesity and health outcomes: An umbrella review of systematic reviews with meta‐analysis
Veronese, N., Ragusa, F. S., Pegreffi, F., Dominguez, L. J., Barbagallo, M., Zanetti, M., & Cereda, E. (2024) · Journal of Cachexia, Sarcopenia and Muscle · doi:10.1002/jcsm.13502 · Cited by 56 · see citing works
Veronese, N., Gallo, U., Boccardi, V., Demurtas, J., Michielon, A., Taci, X., Zanchetta, G., Davis, S. E. C., Chiumente, M., Venturini, F., et al. (2024) · Ageing Research Reviews · doi:10.1016/j.arr.2024.102237 · Cited by 57 · see citing works
Georgescu, R., Fodor, L. A., Dobrean, A., & Cristea, I. A. (2020) · Psychological Medicine · doi:10.1017/s0033291719001855 · Cited by 53 · see citing works
O’Connor, L. E., Kim, J. E., Clark, C. M., Zhu, W., & Campbell, W. W. (2020) · Advances in Nutrition · doi:10.1093/advances/nmaa096 · Cited by 53 · see citing works
Funa, A. A., & Prudente, M. S. (2021) · International Journal of Instruction · doi:10.29333/iji.2021.1445a · Cited by 53 · see citing works
Ayenew, T., Gete, M., Gedfew, M., Getie, ፟., Afenigus, A. D., Edmealem, A., Amha, H., Alem, G., Tiruneh, B. G., & Messelu, M. A. (2025) · PLoS ONE · doi:10.1371/journal.pone.0323311 · Cited by 53 · see citing works
Hu, M.-B., Xu, H., Bai, P., Jiang, H., & Ding, Q. (2014) · Medical Oncology · doi:10.1007/s12032-013-0829-8 · Cited by 53 · see citing works
Wang, X., Cai, J., Huang, C., Huang, X., & Yin, X. (2020) · HPB · doi:10.1016/j.hpb.2020.07.001 · Cited by 53 · see citing works
Tyler, B., Walford, H., Tamblyn, J. A., Keay, S. D., Mavrelos, D., Yasmin, E., & Wattar, B. H. A. (2022) · Human Reproduction Update · doi:10.1093/humupd/dmac009 · Cited by 52 · see citing works
- Authors
- Harbord, R. M., Harris, R. J., & Sterne, J. A. C.
- Affiliations
- University of Bristol (GB)
- Health Protection Agency (GB)
- Corresponding author
- Harbord, Roger M.
- Harris, Ross J.
- Venue
- The Stata Journal: Promoting communications on statistics and Stata
- Publisher
- SAGE Publications
- Published
- 2009-08
- Volume
- 9
- Issue
- 2
- Pages
- 197-210
- ISSN
- 1536-867X (ISSN-L)
- 1536-8734
- OpenAlex
- W1566635326
- Cited by
- 307
- References
- 28
- Citations by year
- 2026: 12 · 2025: 26 · 2024: 45 · 2023: 25 · 2022: 19 · 2021: 23 · 2020: 19 · 2019: 28 · 2018: 22 · 2017: 8 · 2016: 20 · 2015: 13 · 2014: 21 · 2013: 13 · 2012: 8
- FWCI
- 4.97
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Stata Journal Promoting communications on statistics and Stata (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- AgEcon Search (University of Minnesota, USA) (submittedVersion, cc-by-nc-nd)
- Explore Bristol Research (submittedVersion)
- AgEcon Search (University of Minnesota, USA)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- small-study effects, funnel plot asymmetry, publication bias, Stata, Egger's test, false positive rate control, meta-analysis software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
