Demystifying fixed and random effects meta-analysis
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Objective: Systematic reviewers often need to choose between two statistical methods when synthesising evidence in a meta-analysis: the fixed effect and the random effects models. The two approaches entail different assumptions about the treatment effect in the included studies. The aim of this paper was to explain the assumptions underlying each model and their implications in the interpretation of summary results. Methods: We discussed the key assumptions underlying the two methods and the subsequent implications on interpreting results. We used two illustrative examples from a published meta-analysis and highlighted differences in results. Results: The two meta-analytic approaches may yield similar or contradicting results. Even if results between the two models are similar, summary estimates should be interpreted in a different way. Conclusions: Selection between fixed or random effects should be based on the clinical relevance of the assumptions that characterise each approach. Researchers should consider the implications of the analysis model in the interpretation of the findings and use prediction intervals in the random effects meta-analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793 · cited 3×
“Hence, systematic reviewers can employ an FE model when two conditions are met; there is strong evidence that all trials are functionally identical and inference is limited to the population included in the analysis.(1) This assumption should be stated explicitly in the protocol of a systematic review.”
MethodResultInfluentialFixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Interpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 1×
“Predictive intervals refer to the 95% of the possible treatment effects in individual settings and can be interpreted as the predicted range for the ‘true’ treatment effect in a new study.(7) 15 CIs and predictive intervals are not interchangeable; CIs reflect uncertainty about the estimation of the mean whereas predi…”
BackgroundLeucht, S., Cipriani, A., Spineli, L., Mavridis, D., Örey, D., Richter, F., Samara, M., Barbui, C., Engel, R. R., Geddes, J. R., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60733-3 · Cited by 2,561
Self-citationSystematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017
Turner, R. M., Davey, J., Clarke, M. J., Thompson, S. G., & Higgins, J. P. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys041 · Cited by 837 · cited 1×
“Recent empirical evidence pinpointed what constitutes a large, average or small heterogeneity value for dichotomous outcomes.(17) Another measure that is often used to quantify heterogeneity and is also a standard output in most software used for meta-analysis is an index, denoted by I(2), reflecting the proportion of…”
Background
Cited by
How to perform a meta-analysis with R: a practical tutorial
Balduzzi, S., Rücker, G., & Schwarzer, G. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300117 · Cited by 5,827
The WHO Rapid Evidence Appraisal for COVID-19 Therapies (REACT) Working Group, Domingo, P., Mur, I., Mateo, G. M., Gutierrez, M. D. M., Pomar, V., de Benito, N., Corbacho, N., Herrera, S., Millan, L., et al. (2021) · JAMA · doi:10.1001/jama.2021.11330 · Cited by 678
Muka, T., Glisic, M., Milic, J., Verhoog, S., Bohlius, J., Bramer, W., Chowdhury, R., & Franco, O. H. (2020) · European Journal of Epidemiology · doi:10.1007/s10654-019-00576-5 · Cited by 660
Practical guide to the meta-analysis of rare events
Efthimiou, O. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102911 · Cited by 231
Furukawa, T. A., Cipriani, A., Atkinson, L. Z., Leucht, S., Ogawa, Y., Takeshima, N., Hayasaka, Y., Chaimani, A., & Salanti, G. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30307-8 · Cited by 219
Self-citationKiekkas, P., Tzenalis, A., Gklava, V., Stefanopoulos, N., Voyagis, G., & Aretha, D. (2022) · BioMed Research International · doi:10.1155/2022/4083494 · Cited by 59
Telomere length and frailty in older adults-a systematic review and meta-analysis
Araújo Carvalho, A. C., Tavares Mendes, M. L., da Silva Reis, M. C., Santos, V. S., Tanajura, D. M., & Martins-Filho, P. R. S. (2019) · Ageing Research Reviews · doi:10.1016/j.arr.2019.100914 · Cited by 44
Shinohara, K., Efthimiou, O., Ostinelli, E. G., Tomlinson, A., Geddes, J. R., Nierenberg, A. A., Ruhe, H. G., Furukawa, T. A., & Cipriani, A. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-027574 · Cited by 27
Metadata
- Authors
- Nikolakopoulou, A., Mavridis, D., & Salanti, G.
- Venue
- Evidence Based Mental Health
- Publisher
- BMJ
- Published
- 2014-04-01
- Volume
- 17
- Issue
- 2
- Pages
- 53-57
- ISSN
- 1362-0347 (ISSN-L)
- 1468-960X
- OpenAlex
- W2332470030
- Cited by
- 156
- References
- 8
- FWCI
- 5.77
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.