The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
How to perform a meta-analysis with R: a practical tutorial
Open accessAbstract
OBJECTIVE: Meta-analysis is of fundamental importance to obtain an unbiased assessment of the available evidence. In general, the use of meta-analysis has been increasing over the last three decades with mental health as a major research topic. It is then essential to well understand its methodology and interpret its results. In this publication, we describe how to perform a meta-analysis with the freely available statistical software environment R, using a working example taken from the field of mental health. METHODS: R package meta is used to conduct standard meta-analysis. Sensitivity analyses for missing binary outcome data and potential selection bias are conducted with R package metasens. All essential R commands are provided and clearly described to conduct and report analyses. RESULTS: The working example considers a binary outcome: we show how to conduct a fixed effect and random effects meta-analysis and subgroup analysis, produce a forest and funnel plot and to test and adjust for funnel plot asymmetry. All these steps work similar for other outcome types. CONCLUSIONS: R represents a powerful and flexible tool to conduct meta-analyses. This publication gives a brief glimpse into the topic and provides directions to more advanced meta-analysis methods available in R.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Amongst the major modifiable risk factors of stillbirths, risk attributed to malaria is approximately 8% which can be prevented if exposure minimized [30].”
From Malaria in pregnancy: Meta-analyses of prevalence and associated complications (2024) · cites this paper as [30]
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,893
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709
Self-citationFeature Selection with the Boruta Package
Kursa, M. B., & Rudnicki, W. R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i11 · Cited by 5,659
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.010 · Cited by 2,053
Analysing Data and Undertaking Meta‐Analyses
Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch9 · Cited by 1,800
Methods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685
Advanced methods in meta‐analysis: multivariate approach and meta‐regression
van Houwelingen, H. C., Arends, L. R., & Stijnen, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1040 · Cited by 1,599
Fitting three-level meta-analytic models in R: A step-by-step tutorial
Assink, M., & Wibbelink, C. J. M. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p154 · Cited by 1,330
Schwarzer, G., Carpenter, J. R., & Rücker, G. (2015) · Use R! · doi:10.1007/978-3-319-21416-0 · Cited by 1,230
Self-citationConsensus Values and Weighting Factors
Paule, R. C., & Mandel, J. (1982) · Journal of Research of the National Bureau of Standards · doi:10.6028/jres.087.022 · Cited by 580
Davey, J., Turner, R. M., Clarke, M. J., & Higgins, J. P. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-160 · Cited by 404
Imputation methods for missing outcome data in meta-analysis of clinical trials
Higgins, J. P. T., White, I. R., & Wood, A. (2008) · Clinical Trials · doi:10.1177/1740774508091600 · Cited by 352
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Rücker, G., Schwarzer, G., Carpenter, J. R., Binder, H., & Schumacher, M. C. (2010) · Biostatistics · doi:10.1093/biostatistics/kxq046 · Cited by 295
Self-citationA sensitivity analysis for publication bias in systematic reviews
Copas, J. B., & Shi, J. Q. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000402 · Cited by 264
Uncertainty method improved on best–worst case analysis in a binary meta-analysis
Gamble, C. L., & Hollis, S. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.013 · Cited by 239
Haloperidol versus placebo for schizophrenia
Adams, C. E., Bergman, H., Irving, C. B., & Lawrie, S. M. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003082.pub3 · Cited by 157
Demystifying fixed and random effects meta-analysis
Nikolakopoulou, A., Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101795 · Cited by 157
A hands-on practical tutorial on performing meta-analysis with Stata
Chaimani, A., Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101967 · Cited by 134
Detecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132
Self-citationNetwork Meta-Analysis using Frequentist Methods
Rücker, G., Schwarzer, G., Krahn, U., & König, J. (2015) · Cited by 106
Self-citationAddressing missing outcome data in meta-analysis
Mavridis, D., Chaimani, A., Efthimiou, O., Leucht, S., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101900 · Cited by 79
Haloperidol versus placebo for schizophrenia
Joy, C., Adams, C., & Lawrie, S. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003082 · Cited by 31
Advanced Statistical Methods to Model and Adjust for Bias inMeta-Analysis
Schwarzer, G., Carpenter, J. R., & Rücker, G. (2014) · Cited by 7
Self-citation
Research works printed but not linked: 1
- Schwarzer, 2007, meta: an R package for meta-analysis, R News, 7, 40
Cited by
Sorted by citations
Male sex identified by global COVID-19 meta-analysis as a risk factor for death and ITU admission
Peckham, H., de Gruijter, N. M., Raine, C., Radziszewska, A., Ciurtin, C., Wedderburn, L. R., Rosser, E. C., Webb, K., & Deakin, C. T. (2020) · Nature Communications · doi:10.1038/s41467-020-19741-6 · Cited by 1,503
Fatigue and cognitive impairment in Post-COVID-19 Syndrome: a systematic review and meta-analysis
Ceban, F., Ling, S., Lui, L. M. W., Lee, Y., Gill, H., Teopiz, K. M., Rodrigues, N. B., Subramaniapillai, M., Di Vincenzo, J. D., Cao, B., et al. (2022) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2021.12.020 · Cited by 1,554
Scott, A. J., Webb, T. L., Martyn-St James, M., Rowse, G., & Weich, S. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101556 · Cited by 1,094
Buitrago‐García, D., Egli-Gany, D., Counotte, M. J., Hossmann, S., Imeri, H., Ipekci, A. M., Salanti, G., & Low, N. N. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003346 · Cited by 1,000
Characterising long COVID: a living systematic review
Michelen, M., Cheng, V., Manoharan, L., Elkheir, N., Dagens, A., Hastie, C., O’Hara, M. E., Suett, J. C., Dahmash, D. T., Bugaeva, P., et al. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2021-005427 · Cited by 1,004
Metadata
- Authors
- Balduzzi, S., Rücker, G., & Schwarzer, G.
- Affiliations
- University of Freiburg (DE)
- Corresponding author
- Balduzzi, Sara
- Venue
- Evidence Based Mental Health
- Publisher
- BMJ
- Published
- 2019-09-28
- Volume
- 22
- Issue
- 4
- Pages
- 153-160
- ISSN
- 1362-0347 (ISSN-L)
- 1468-960X
- PMC
- PMC10231495
- OpenAlex
- W2975424845
- Cited by
- 5,827
- References
- 31
- Citations by year
- 2026: 1019 · 2025: 1163 · 2024: 1107 · 2023: 876 · 2022: 885 · 2021: 574 · 2020: 200
- FWCI
- 84.22
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Evidence-Based Mental Health (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- meta-analysis, R software, meta-package, sensitivity analysis, selection bias, fixed effects model, random effects models, subgroup analysis, forest plots, funnel plot asymmetry, binary outcomes, mental health research
- MeSH terms
- Humans, Software, Meta-Analysis as Topic, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review