How to perform a meta-analysis with R: a practical tutorial
Open accessAbstract
OBJECTIVE: Meta-analysis is of fundamental importance to obtain an unbiased assessment of the available evidence. In general, the use of meta-analysis has been increasing over the last three decades with mental health as a major research topic. It is then essential to well understand its methodology and interpret its results. In this publication, we describe how to perform a meta-analysis with the freely available statistical software environment R, using a working example taken from the field of mental health. METHODS: R package meta is used to conduct standard meta-analysis. Sensitivity analyses for missing binary outcome data and potential selection bias are conducted with R package metasens. All essential R commands are provided and clearly described to conduct and report analyses. RESULTS: The working example considers a binary outcome: we show how to conduct a fixed effect and random effects meta-analysis and subgroup analysis, produce a forest and funnel plot and to test and adjust for funnel plot asymmetry. All these steps work similar for other outcome types. CONCLUSIONS: R represents a powerful and flexible tool to conduct meta-analyses. This publication gives a brief glimpse into the topic and provides directions to more advanced meta-analysis methods available in R.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Among major modifiable risk factors of stillbirths, the risk attributed to malaria is approximately 8% and can be prevented if exposure is minimized.
“Amongst the major modifiable risk factors of stillbirths, risk attributed to malaria is approximately 8% which can be prevented if exposure minimized [30].”
From Malaria in pregnancy: Meta-analyses of prevalence and associated complications (2024) · cites this paper as [30]
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Conducting Meta-Analyses in <i>R</i> with the <b>metafor</b> Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799 · see citing works
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709 · see citing works
Self-citationFeature Selection with the <b>Boruta</b> Package
Kursa, M. B., & Rudnicki, W. R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i11 · Cited by 5,659 · see citing works
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955 · see citing works
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · see citing works
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368 · see citing works
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282 · see citing works
A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267 · see citing works
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.010 · Cited by 2,053 · see citing works
Analysing Data and Undertaking Meta‐Analyses
Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch9 · Cited by 1,800 · see citing works
Methods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685 · see citing works
Advanced methods in meta‐analysis: multivariate approach and meta‐regression
van Houwelingen, H. C., Arends, L. R., & Stijnen, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1040 · Cited by 1,574 · see citing works
Fitting three-level meta-analytic models in R: A step-by-step tutorial
Assink, M., & Wibbelink, C. J. M. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p154 · Cited by 1,330 · see citing works
Schwarzer, G., Carpenter, J. R., & Rücker, G. (2015) · Use R! · doi:10.1007/978-3-319-21416-0 · Cited by 1,230 · see citing works
Self-citationConsensus Values and Weighting Factors
Paule, R. C., & Mandel, J. (1982) · Journal of Research of the National Bureau of Standards · doi:10.6028/jres.087.022 · Cited by 580 · see citing works
Davey, J., Turner, R. M., Clarke, M. J., & Higgins, J. P. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-160 · Cited by 404 · see citing works
Imputation methods for missing outcome data in meta-analysis of clinical trials
Higgins, J. P. T., White, I. R., & Wood, A. (2008) · Clinical Trials · doi:10.1177/1740774508091600 · Cited by 352 · see citing works
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Rücker, G., Schwarzer, G., Carpenter, J. R., Binder, H., & Schumacher, M. C. (2010) · Biostatistics · doi:10.1093/biostatistics/kxq046 · Cited by 284 · see citing works
Self-citationA sensitivity analysis for publication bias in systematic reviews
Copas, J. B., & Shi, J. Q. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000402 · Cited by 260 · see citing works
Uncertainty method improved on best–worst case analysis in a binary meta-analysis
Gamble, C. L., & Hollis, S. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.013 · Cited by 239 · see citing works
Haloperidol versus placebo for schizophrenia
Adams, C. E., Bergman, H., Irving, C. B., & Lawrie, S. M. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003082.pub3 · Cited by 157 · see citing works
Demystifying fixed and random effects meta-analysis
Nikolakopoulou, A., Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101795 · Cited by 157 · see citing works
A hands-on practical tutorial on performing meta-analysis with Stata
Chaimani, A., Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101967 · Cited by 134 · see citing works
Detecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132 · see citing works
Self-citationNetwork Meta-Analysis using Frequentist Methods
Rücker, G., Schwarzer, G., Krahn, U., & König, J. (2015) · Cited by 106 · see citing works
Self-citationAddressing missing outcome data in meta-analysis
Mavridis, D., Chaimani, A., Efthimiou, O., Leucht, S., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101900 · Cited by 81 · see citing works
Haloperidol versus placebo for schizophrenia
Joy, C., Adams, C., & Lawrie, S. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003082 · Cited by 31 · see citing works
Advanced Statistical Methods to Model and Adjust for Bias inMeta-Analysis
Schwarzer, G., Carpenter, J. R., & Rücker, G. (2014) · Cited by 7 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Male sex identified by global COVID-19 meta-analysis as a risk factor for death and ITU admission
Peckham, H., de Gruijter, N. M., Raine, C., Radziszewska, A., Ciurtin, C., Wedderburn, L. R., Rosser, E. C., Webb, K., & Deakin, C. T. (2020) · Nature Communications · doi:10.1038/s41467-020-19741-6 · Cited by 1,503 · see citing works
Fatigue and cognitive impairment in Post-COVID-19 Syndrome: a systematic review and meta-analysis
Ceban, F., Ling, S., Lui, L. M. W., Lee, Y., Gill, H., Teopiz, K. M., Rodrigues, N. B., Subramaniapillai, M., Di Vincenzo, J. D., Cao, B., et al. (2022) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2021.12.020 · Cited by 1,554 · see citing works
Scott, A. J., Webb, T. L., Martyn-St James, M., Rowse, G., & Weich, S. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101556 · Cited by 1,094 · see citing works
Buitrago‐García, D., Egli-Gany, D., Counotte, M. J., Hossmann, S., Imeri, H., Ipekci, A. M., Salanti, G., & Low, N. N. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003346 · Cited by 963 · see citing works
Characterising long COVID: a living systematic review
Michelen, M., Cheng, V., Manoharan, L., Elkheir, N., Dagens, A., Hastie, C., O’Hara, M. E., Suett, J. C., Dahmash, D. T., Bugaeva, P., et al. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2021-005427 · Cited by 957 · see citing works
Global prevalence of cerebral palsy: A systematic analysis
McIntyre, S. J., Goldsmith, S. C., Webb, A., Ehlinger, V., Hollung, S. J., McConnell, K., Arnaud, C., Smithers‐Sheedy, H., Oskoui, M., Khandaker, G., et al. (2022) · Developmental Medicine & Child Neurology · doi:10.1111/dmcn.15346 · Cited by 837 · see citing works
Perturbations in Gut Microbiota Composition in Psychiatric Disorders
Nikolova, V. L., Smith, M. R. B., Hall, L. J., Cleare, A. J., Stone, J. M., & Young, A. H. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.2573 · Cited by 759 · see citing works
Romano, S., Savva, G. M., Bedarf, J. R., Charles, I. G., Hildebrand, F., & Narbad, A. (2021) · npj Parkinson's Disease · doi:10.1038/s41531-021-00156-z · Cited by 707 · see citing works
Hodkinson, A., Zhou, Johnson, J., Geraghty, K., Riley, R., Zhou, A., Panagopoulou, E., Chew-Graham, C. A., Peters, D., Esmail, A., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070442 · Cited by 618 · see citing works
Booth, A., Reed, A. B., Ponzo, S., Yassaee, A., Aral, M., Plans, D., Labrique, A. B., & Mohan, D. (2021) · PLoS ONE · doi:10.1371/journal.pone.0247461 · Cited by 553 · see citing works
<b>netmeta</b> : An <i>R</i> Package for Network Meta-Analysis Using Frequentist Methods
Balduzzi, S., Rücker, G., Nikolakopoulou, A., Papakonstantinou, T., Salanti, G., Efthimiou, O., & Schwarzer, G. (2023) · Journal of Statistical Software · doi:10.18637/jss.v106.i02 · Cited by 532 · see citing works
Self-citationSultan, S., Altayar, O., Siddique, S. M., Davitkov, P., Feuerstein, J. D., Lim, J. K., Falck-Ytter, Y., & El-Serag, H. B. (2020) · Gastroenterology · doi:10.1053/j.gastro.2020.05.001 · Cited by 437 · see citing works
Biological subtypes of Alzheimer disease
Ferreira, D., Nordberg, A. K., & Westman, E. (2020) · Neurology · doi:10.1212/wnl.0000000000009058 · Cited by 427 · see citing works
Uribe, S. E., Innes, N., & Maldupa, I. (2021) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.12783 · Cited by 466 · see citing works
Thilen, S. R., Weigel, W. A., Todd, M. M., Dutton, R. P., Lien, C. A., Grant, S. A., Szokol, J. W., Eriksson, L. I., Yaster, M., Grant, M. D., et al. (2022) · Anesthesiology · doi:10.1097/aln.0000000000004379 · Cited by 423 · see citing works
Psychological interventions to foster resilience in healthcare professionals
Kunzler, A. M., Helmreich, I., Chmitorz, A., König, J., Binder, H., Wessa, M., & Lieb, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012527.pub2 · Cited by 390 · see citing works
Etzelmueller, A., Vis, C., Karyotaki, E., Baumeister, H., Titov, N., Berking, M., Cuijpers, P., Riper, H., & Ebert, D. D. (2020) · Journal of Medical Internet Research · doi:10.2196/18100 · Cited by 356 · see citing works
Yin, S., & Yu, Y. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.132608 · Cited by 388 · see citing works
Severe COVID-19 Infection and Pediatric Comorbidities: A Systematic Review and Meta-Analysis
Tsankov, B. K., Allaire, J. M., Irvine, M. A., Lopez, A., Sauve, L. J., Vallance, B. A., & Jacobson, K. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.11.163 · Cited by 361 · see citing works
Joshi, G. P., Abdelmalak, B. B., Weigel, W. A., Harbell, M. W., Kuo, C. I., Soriano, S. G., Stricker, P. A., Tipton, T., Grant, M. D., Marbella, A. M., et al. (2023) · Anesthesiology · doi:10.1097/aln.0000000000004381 · Cited by 375 · see citing works
Zhang, N., Wang, J., Li, Y., & Jiang, B. (2021) · Scientific Reports · doi:10.1038/s41598-021-92971-w · Cited by 368 · see citing works
Cuijpers, P., Miguel, C., Harrer, M., Plessen, C. Y., Ciharova, M., Ebert, D., & Karyotaki, E. (2023) · World Psychiatry · doi:10.1002/wps.21069 · Cited by 354 · see citing works
Detecting the skewness of data from the five-number summary and its application in meta-analysis
Shi, J., Luo, D., Wan, X., Liu, Y., Liu, J., Bian, Z., & Tong, T. (2023) · Statistical Methods in Medical Research · doi:10.1177/09622802231172043 · Cited by 341 · see citing works
Jahrami, H., Alhaj, O. A., Humood, A. M., Alenezi, A. F., Fekih‐Romdhane, F., Al-Rasheed, M. M., Saif, Z., Bragazzi, N. L., Pandi-Perumal, S. R., BaHammam, A. S., et al. (2022) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2022.101591 · Cited by 344 · see citing works
Stone, G. W., Christiansen, E. H., Ali, Z. A., Andreasen, L. N., Maehara, A., Ahmad, Y., Landmesser, U., & Holm, N. R. (2024) · The Lancet · doi:10.1016/s0140-6736(23)02454-6 · Cited by 345 · see citing works
Whole-genome sequencing reveals host factors underlying critical COVID-19
Kousathanas, A., Pairo‐Castineira, E., Rawlik, K., Stuckey, A., Odhams, C. A., Walker, S., Russell, C. D., Malinauskas, T., Wu, Y., Millar, J. E., et al. (2022) · Nature · doi:10.1038/s41586-022-04576-6 · Cited by 329 · see citing works
A Meta-Analysis of the Global Prevalence of Temporomandibular Disorders
Zieliński, G., Pająk-Zielińska, B., & Ginszt, M. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13051365 · Cited by 347 · see citing works
Estimating the global burden of Epstein–Barr virus-related cancers
Wong, Y., Meehan, M. T., Burrows, S. R., Doolan, D. L., & Miles, J. J. (2021) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-021-03824-y · Cited by 319 · see citing works
Bergeri, I., Whelan, M. G., Ware, H., Subissi, L., Nardone, A., Lewis, H. C., Li, Z., Ma, X., Valenciano, M., Cheng, B., et al. (2022) · PLoS Medicine · doi:10.1371/journal.pmed.1004107 · Cited by 313 · see citing works
Efficacy and safety of COVID-19 vaccines
Graña, C., Ghosn, L., Evrenoglou, T., Jarde, A., Minozzi, S., Bergman, H., Buckley, B. S., Probyn, K., Villanueva, G., Henschke, N., et al. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015477 · Cited by 310 · see citing works
Thomson, R., Igelström, E., Purba, A. K., Shimonovich, M., Thomson, H., McCartney, G., Reeves, A., Leyland, A. H., Pearce, A., & Katikireddi, S. V. (2022) · The Lancet Public Health · doi:10.1016/s2468-2667(22)00058-5 · Cited by 330 · see citing works
Fiolet, T., Guihur, A., Rebeaud, M. E., Mulot, M., Peiffer‐Smadja, N., & Mahamat‐Saleh, Y. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.08.022 · Cited by 306 · see citing works
Friedrich, M., Pohin, M., Jackson, M. A., Korsunsky, I., Bullers, S. J., Rue-Albrecht, K., Christoforidou, Z., Sathananthan, D., Thomas, T. R., Ravindran, R. P., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01520-5 · Cited by 307 · see citing works
Izmirly, P., Parton, H. B., Wang, L., McCune, W. J., Lim, S. S., Drenkard, C., Ferucci, E. D., Dall’Era, M., Gordon, C., Helmick, C. G., et al. (2021) · Arthritis & Rheumatology · doi:10.1002/art.41632 · Cited by 303 · see citing works
Baunwall, S. M. D., Lee, M. M., Eriksen, M. K., Mullish, B. H., Marchesi, J. R., Dahlerup, J. F., & Hvas, C. L. (2020) · EClinicalMedicine · doi:10.1016/j.eclinm.2020.100642 · Cited by 302 · see citing works
Outcomes Following Taxation of Sugar-Sweetened Beverages
Andreyeva, T., Marple, K., Marinello, S., Moore, T. E., & Powell, L. M. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.15276 · Cited by 297 · see citing works
Bayesian Random-Effects Meta-Analysis Using the <b>bayesmeta</b> <i>R</i> Package
Röver, C. (2020) · Journal of Statistical Software · doi:10.18637/jss.v093.i06 · Cited by 310 · see citing works
Hu, H., Ou, Y., Shen, X., Qu, Y., Ma, Y., Wang, Z.-T., Dong, Q., Tan, L., & Yu, J. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.11.007 · Cited by 290 · see citing works
Zhang, J. J. Y., Lee, K. S., Ang, L. W., Leo, Y., & Young, B. E. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa576 · Cited by 282 · see citing works
Solmi, M., Monaco, F., Højlund, M., Monteleone, A. M., Trott, M., Firth, J., Carfagno, M., Eaton, M., Toffol, M. D., Vergine, M., et al. (2024) · World Psychiatry · doi:10.1002/wps.21182 · Cited by 283 · see citing works
Thompson, R., Smith, R. B., Karim, Y. B., Shen, C., Drummond, K., Teng, C., & Toledano, M. B. (2021) · Environment International · doi:10.1016/j.envint.2021.106905 · Cited by 282 · see citing works
Pellicane, M. J., & Ciesla, J. A. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102113 · Cited by 281 · see citing works
Global seroprevalence of SARS-CoV-2 antibodies: A systematic review and meta-analysis
Bobrovitz, N., Arora, R. K., Cao, C., Boucher, E., Liu, M., Donnici, C., Yanes-Lane, M., Whelan, M., Perlman-Arrow, S., Chen, J., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0252617 · Cited by 246 · see citing works
Adjunctive Psychotherapy for Bipolar Disorder
Miklowitz, D. J., Efthimiou, O., Furukawa, T. A., Scott, J. L., McLaren, R., Geddes, J. R., & Cipriani, A. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.2993 · Cited by 286 · see citing works
Peery, A. F., Kelly, C. R., Kao, D. H., Vaughn, B. P., Lebwohl, B., Singh, S. S., Imdad, A., & Altayar, O. (2024) · Gastroenterology · doi:10.1053/j.gastro.2024.01.008 · Cited by 282 · see citing works
Risk factors of postoperative delirium after cardiac surgery: a meta-analysis
Chen, H., Mo, L., Hu, H., Ou, Y., & Luo, J. (2021) · Journal of Cardiothoracic Surgery · doi:10.1186/s13019-021-01496-w · Cited by 265 · see citing works
Level of IL-6, TNF, and IL-1β and age-related diseases: a systematic review and meta-analysis
Tylutka, A., Walas, Ł., & Zembroń-Łacny, A. (2024) · Frontiers in Immunology · doi:10.3389/fimmu.2024.1330386 · Cited by 279 · see citing works
Association of Hearing Aids and Cochlear Implants With Cognitive Decline and Dementia
Yeo, B. S. Y., Song, H. J. J. M. D., Toh, E. M. S., Ng, L. S., Ho, C. S. H., Ho, R., Merchant, R. A., Tan, B. K. J., & Loh, W. S. (2022) · JAMA Neurology · doi:10.1001/jamaneurol.2022.4427 · Cited by 263 · see citing works
How Common is Essential Tremor? Update on the Worldwide Prevalence of Essential Tremor
Louis, E. D., & McCreary, M. (2021) · Tremor and Other Hyperkinetic Movements · doi:10.5334/tohm.632 · Cited by 254 · see citing works
Bairkdar, M., Rossides, M., Westerlind, H., Hesselstrand, R., Arkema, E. V., & Holmqvist, M. E. (2021) · Lara D. Veeken · doi:10.1093/rheumatology/keab190 · Cited by 249 · see citing works
Schulten, S. F. M., Claas-Quax, M. J., Weemhoff, M., van Eijndhoven, H. W., van Leijsen, S. A., Vergeldt, T. F., IntHout, J., & Kluivers, K. B. (2022) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2022.04.046 · Cited by 245 · see citing works
Li, C., Wang, P., Martín-Moratinos, M., Bella-Fernández, M., & Blasco-Fontecilla, H. (2022) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-022-02128-x · Cited by 309 · see citing works
Neoadjuvant Chemoimmunotherapy for NSCLC
Sorin, M., Prosty, C. J., Ghaleb, L., Nie, K., Katergi, K., Shahzad, M. H., Dubé, L.-R., Atallah, A., Swaby, A. M., Dankner, M., et al. (2024) · JAMA Oncology · doi:10.1001/jamaoncol.2024.0057 · Cited by 247 · see citing works
Belsky, J. A., Tullius, B. P., Lamb, M. G., Sayegh, R., Stanek, J. R., & Auletta, J. J. (2021) · Journal of Infection · doi:10.1016/j.jinf.2021.01.022 · Cited by 239 · see citing works
Tieges, Z., MacLullich, A. M. J., Anand, A., Brookes, C., Cassarino, M., O’connor, M., Ryan, D., Saller, T., Arora, R. C., Chang, Y., et al. (2020) · Age and Ageing · doi:10.1093/ageing/afaa224 · Cited by 236 · see citing works
Lee, Y. L., Lui, L. M. W., Chen-Li, D. C. J., Liao, Y., Mansur, R. B., Brietzke, E. M., Rosenblat, J. D., Ho, R., Rodrigues, N. B., Lipsitz, O., et al. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.04.050 · Cited by 237 · see citing works
Wijnia, L., Noordzij, G., Arends, L. R., Rikers, R. M. J. P., & Loyens, S. M. M. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09864-3 · Cited by 455 · see citing works
Risk factors for suicide in prisons: a systematic review and meta-analysis
Zhong, S., Senior, M., Yu, R., Perry, A., Hawton, K. E., Shaw, J. J., & Fazel, S. (2021) · The Lancet Public Health · doi:10.1016/s2468-2667(20)30233-4 · Cited by 243 · see citing works
Hoppen, T. H., Priebe, S., Vetter, I., & Nexhmedin Morina, B. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2021-006303 · Cited by 250 · see citing works
Li, X., Ostropolets, A., Makadia, R., Shoaibi, A., Rao, G., Sena, A. G., Martinez-Hernandez, E., Delmestri, A., Verhamme, K., Rijnbeek, P. R., et al. (2021) · BMJ · doi:10.1136/bmj.n1435 · Cited by 219 · see citing works
Pirtea, P., Cicinelli, E., Nola, R. D., de Ziegler, D., & Ayoubi, J. M. (2021) · Fertility and Sterility · doi:10.1016/j.fertnstert.2020.12.010 · Cited by 226 · see citing works
Western, M. J., Armstrong, M. E. G., Islam, I., Morgan, K., Jones, U., & Kelson, M. J. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01218-4 · Cited by 218 · see citing works
Association Between Exposure to Tobacco Content on Social Media and Tobacco Use
Donaldson, S. I., Dormanesh, A., Pérez, C., Majmundar, A., & Allem, J.-P. (2022) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2022.2223 · Cited by 215 · see citing works
Silver, S. A., Beaubien‐Souligny, W., Shah, P. S., Harel, S., Blum, D., Kishibe, T., Meraz-Muñoz, A., Wald, R., & Harel, Z. (2020) · Kidney Medicine · doi:10.1016/j.xkme.2020.11.008 · Cited by 207 · see citing works
Hannum, M. E., Ramirez, V. A., Lipson, S. J., Herriman, R. D., Toskala, A. K., Lin, C., Joseph, P. V., & Reed, D. R. (2020) · Chemical Senses · doi:10.1093/chemse/bjaa064 · Cited by 204 · see citing works
Soil Organic Carbon Sequestration after Biochar Application: A Global Meta-Analysis
Groß, A., Bromm, T., & Glaser, B. (2021) · Agronomy · doi:10.3390/agronomy11122474 · Cited by 215 · see citing works
meta: General Package for Meta-Analysis
Schwarzer, G. (2006) · CRAN: Contributed Packages · doi:10.32614/cran.package.meta · Cited by 202 · see citing works
Self-citationKim, A. Y., Marduy, A., de Melo, P. S., Gianlorenço, A. C., Kim, C. K., Choi, S., Song, J., & Fregni, F. (2022) · Scientific Reports · doi:10.1038/s41598-022-25864-1 · Cited by 202 · see citing works
Lehrer, E. J., Singh, R. B., Wang, M., Chinchilli, V. M., Trifiletti, D. M., Ost, P., Siva, S., Meng, M.-B., Tchelebi, L. T., & Zaorsky, N. G. (2020) · JAMA Oncology · doi:10.1001/jamaoncol.2020.6146 · Cited by 198 · see citing works
Sharma, E., Sharma, L. P., Balachander, S., Lin, B., Manohar, H., Khanna, P., Lu, C., Garg, K., Thomas, T. L., Au, A. C. L., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.703701 · Cited by 202 · see citing works
Jena, A., Mishra, S., Deepak, P., Kumar, P. M., Sharma, A., Patel, Y. I., Kennedy, N. A., Kim, A. H. J., Sharma, V., & Sebastian, S. (2021) · Autoimmunity Reviews · doi:10.1016/j.autrev.2021.102927 · Cited by 191 · see citing works
Hanson, K. E., Caliendo, A. M., Arias, C. A. D., Hayden, M. K., Englund, J. A., Lee, M. J., Loeb, M. B., Patel, R., Alayli, A. E., Altayar, O., et al. (2021) · Clinical Infectious Diseases · doi:10.1093/cid/ciab048 · Cited by 181 · see citing works
Coronavirus Disease 2019 as Cause of Viral Sepsis: A Systematic Review and Meta-Analysis*
Karakike, E., Giamarellos‐Bourboulis, E. J., Kyprianou, M., Fleischmann-Struzek, C., Pletz, M. W., Netea, M. G., Reinhart, K., & Kyriazopoulou, E. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000005195 · Cited by 182 · see citing works
Currier, B. S., Mcleod, J. C., Banfield, L., Beyene, J., Welton, N. J., D'Souza, A. C., Keogh, J. A. J., Lin, L., Coletta, G., Yang, A., et al. (2023) · British Journal of Sports Medicine · doi:10.1136/bjsports-2023-106807 · Cited by 179 · see citing works
Hanson, K. E., Caliendo, A. M., Arias, C. A. D., Englund, J. A., Hayden, M. K., Lee, M. J., Loeb, M. B., Patel, R., Altayar, O., Alayli, A. E., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa1343 · Cited by 179 · see citing works
Chaudhry, D., Chaudhry, A., Peracha, J., & Sharif, A. (2022) · BMJ · doi:10.1136/bmj-2021-068769 · Cited by 178 · see citing works
Relationship between work–family conflict and turnover intention in nurses: A meta‐analytic review
Yildiz, B., Yildiz, H., & Ayaz Arda, O. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14846 · Cited by 172 · see citing works
Prevalence and Incidence of Dry Eye and Meibomian Gland Dysfunction in the United States
McCann, P., Abraham, A. G., Mukhopadhyay, A., Panagiotopoulou, K., Chen, H., Rittiphairoj, T., Gregory, D. G., Hauswirth, S. G., Ifantides, C., Qureshı, R., et al. (2022) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2022.4394 · Cited by 178 · see citing works
Social media use, mental health and sleep: A systematic review with meta-analyses
Ahmed, O., Walsh, E. I., Dawel, A., Alateeq, K., Espinoza Oyarce, D. A., & Cherbuin, N. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.08.193 · Cited by 188 · see citing works
Overuse of diagnostic testing in healthcare: a systematic review
Müskens, J. L. J. M., Kool, R. B., van Dulmen, S. A., & Westert, G. P. (2021) · BMJ Quality & Safety · doi:10.1136/bmjqs-2020-012576 · Cited by 186 · see citing works
Association of Very Preterm Birth or Very Low Birth Weight With Intelligence in Adulthood
Eves, R., Mendonça, M., Baumann, N., Ni, Y., Darlow, B. A., Horwood, L. J., Woodward, L. J., Doyle, L. W., Cheong, J. L. Y., Anderson, P. J., et al. (2021) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2021.1058 · Cited by 170 · see citing works
Karcher, N., Nigro, E., Punčochář, M., Blanco-Míguez, A., Ciciani, M., Manghi, P., Zolfo, M., Cumbo, F., Manara, S., Golzato, D., et al. (2021) · Genome Biology · doi:10.1186/s13059-021-02427-7 · Cited by 159 · see citing works
Psychological interventions to foster resilience in healthcare students
Kunzler, A. M., Helmreich, I., König, J., Chmitorz, A., Wessa, M., Binder, H., & Lieb, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013684 · Cited by 172 · see citing works
Whiting, D., Gulati, G., Geddes, J. R., & Fazel, S. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.3721 · Cited by 177 · see citing works
Siafis, S., Wu, H., Wang, D., Burschinski, A., Nomura, N., Takeuchi, H., Schneider‐Thoma, J., Davis, J. M., & Leucht, S. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02203-y · Cited by 166 · see citing works
Zech, A., Hollander, K., Junge, A., Steib, S., Groll, A., Heiner, J., Nowak, F., Pfeiffer, D., & Rahlf, A. L. (2021) · Journal of sport and health science/Journal of Sport and Health Science · doi:10.1016/j.jshs.2021.04.003 · Cited by 173 · see citing works
Hong, T., El-Omar, E. M., Kuo, Y., Wu, J., Chen, M., Chen, C., Fang, Y., Leow, A. H., Lü, H., Lin, J., et al. (2023) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(23)00281-9 · Cited by 164 · see citing works
Bastos, M. L., Perlman‐Arrow, S., Menzies, D., & Campbell, J. R. (2021) · Annals of Internal Medicine · doi:10.7326/m20-6569 · Cited by 163 · see citing works
Zieliński, G., Pająk, A., & Wójcicki, M. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13144259 · Cited by 162 · see citing works
Wu, A., Scult, M. A., Barnes, E. D., Betancourt, J. A., Falk, A. E., & Gunning, F. M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00386-8 · Cited by 164 · see citing works
Jutzeler, C. R., Bourguignon, L., Weis, C., Tong, B., Wong, C., Rieck, B., Pargger, H., Tschudin‐Sutter, S., Egli, A., Borgwardt, K. M., et al. (2020) · Travel Medicine and Infectious Disease · doi:10.1016/j.tmaid.2020.101825 · Cited by 162 · see citing works
Incidence and Outcomes of COVID-19 in People With CKD: A Systematic Review and Meta-analysis
Chung, E. Y. M., Palmer, S. C., Natale, P., Krishnan, A., Cooper, T. E., Saglimbene, V. M., Ruospo, M., Au, E. H. K., Jayanti, S., Liang, A. C., et al. (2021) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2021.07.003 · Cited by 161 · see citing works
Genetic testing for the epilepsies: A systematic review
Sheidley, B. R., Malinowski, J. R., Bergner, A. L., Bier, L., Gloss, D. S., Mu, W., Mulhern, M., Partack, E., & Poduri, A. (2021) · Epilepsia · doi:10.1111/epi.17141 · Cited by 156 · see citing works
Liu, S., Cao, Y., Du, T., & Zhi, Y. (2020) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2020.11.054 · Cited by 155 · see citing works
Chaabene, H., Prieske, O., Herz, M., Moran, J., Höhne, J., Kliegl, R., Ramirez-Campillo, R., Behm, D. G., Hortobágyi, T., & Granacher, U. (2021) · Ageing Research Reviews · doi:10.1016/j.arr.2021.101265 · Cited by 146 · see citing works
Oldroyd, A. G. S., Allard, A., Callen, J. P., Chinoy, H., Chung, L. S., Fiorentino, D. F., George, M., Gordon, P., Kolstad, K., Kurtzman, D. J. B., et al. (2021) · Lara D. Veeken · doi:10.1093/rheumatology/keab166 · Cited by 153 · see citing works
Qazi, A., Hasan, N., Abayomi‐Alli, O., Hardaker, G., Scherer, R., Sarker, Y., Paul, S. K., & Maitama, J. Z. (2021) · Education and Information Technologies · doi:10.1007/s10639-021-10775-x · Cited by 193 · see citing works
Rare and common genetic determinants of metabolic individuality and their effects on human health
Surendran, P., Stewart, I. D., Auyeung, V. P. W., Pietzner, M., Raffler, J., Wörheide, M. A., Li, C., Smith, R. F., Wittemans, L. B. L., Bomba, L., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-02046-0 · Cited by 150 · see citing works
Gadot, R., Najera, R., Hirani, S., Anand, A., Storch, E., Goodman, W. K., Shofty, B., & Sheth, S. A. (2022) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2021-328738 · Cited by 148 · see citing works
Ribas‐Maynou, J., Yeste, M., Becerra‐Tomás, N., Aston, K. I., James, E. R., & Salas‐Huetos, A. (2021) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12700 · Cited by 149 · see citing works
- Authors
- Balduzzi, S., Rücker, G., & Schwarzer, G.
- Affiliations
- University of Freiburg (DE)
- Corresponding author
- Balduzzi, Sara
- Venue
- Evidence Based Mental Health
- Publisher
- BMJ
- Published
- 2019-09-28
- Volume
- 22
- Issue
- 4
- Pages
- 153-160
- ISSN
- 1362-0347 (ISSN-L)
- 1468-960X
- PMC
- PMC10231495
- OpenAlex
- W2975424845
- Cited by
- 5,827
- References
- 31
- Citations by year
- 2026: 1019 · 2025: 1163 · 2024: 1107 · 2023: 876 · 2022: 885 · 2021: 574 · 2020: 200
- FWCI
- 84.22
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Evidence-Based Mental Health (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Artificial Intelligence › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- meta-analysis, R software, meta-package, sensitivity analysis, selection bias, fixed effects model, random effects models, subgroup analysis, forest plots, funnel plot asymmetry, binary outcomes, mental health research
- MeSH terms
- Humans, Software, Meta-Analysis as Topic, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
