The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
An extended mixed‐effects framework for meta‐analysis
Abstract
Standard methods for meta‐analysis are limited to pooling tasks in which a single effect size is estimated from a set of independent studies. However, this setting can be too restrictive for modern meta‐analytical applications. In this contribution, we illustrate a general framework for meta‐analysis based on linear mixed‐effects models, where potentially complex patterns of effect sizes are modeled through an extended and flexible structure of fixed and random terms. This definition includes, as special cases, a variety of meta‐analytical models that have been separately proposed in the literature, such as multivariate, network, multilevel, dose‐response, and longitudinal meta‐analysis and meta‐regression. The availability of a unified framework for meta‐analysis, complemented with the implementation in a freely available and fully documented software, will provide researchers with a flexible tool for addressing nonstandard pooling problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Small sample inference for fixed effects from restricted maximum likelihood
Kenward, M. G., & Roger, J. H. (1997) · Biometrics · doi:10.2307/2533558 · Cited by 4,552 · cited 1×
“Solutions can be found in the LME models literature, such as the use of t or F distributions, 18 adjustments for standard errors and degrees of freedom, 64 and use of mixture distributions.”
Interpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480998 · Cited by 2,667
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 2×
“26 The pooled estimate can be derived under fixed-effects or random-effects assumptions, 27,28 with random-effects models incorporating the underlying between-study variation into the weights.”
Courgeau, D., & Goldstein, H. (1997) · Population (French Edition) · doi:10.2307/1534624 · Cited by 2,562
Methods for Trend Estimation from Summarized Dose-Response Data, with Applications to Meta-Analysis
Greenland, S., & Longnecker, M. P. (1992) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116237 · Cited by 2,353
Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies
Higgins, J. P. T., Jackson, D., Barrett, J. K., Lu, G., Ades, A. E., & White, I. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1044 · Cited by 2,098
Efficacy of BCG Vaccine in the Prevention of Tuberculosis: Meta-analysis of the Published Literature
Colditz, G. A. (1994) · JAMA · doi:10.1001/jama.1994.03510330076038 · Cited by 1,918
Meta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701
Advanced methods in meta‐analysis: multivariate approach and meta‐regression
van Houwelingen, H. C., Arends, L. R., & Stijnen, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1040 · Cited by 1,580
Early thrombolytic treatment in acute myocardial infarction: reappraisal of the golden hour
Boersma, E., Maas, A. C., Deckers, J. W., & Simoons, M. L. (1996) · The Lancet · doi:10.1016/s0140-6736(96)02514-7 · Cited by 1,299
Orsini, N., Li, R., Wolk, A., Khudyakov, P., & Spiegelman, D. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kwr265 · Cited by 1,280
Generalized Least Squares for Trend Estimation of Summarized Dose–response Data
Orsini, N., Bellocco, R., & Greenland, S. (2006) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0600600103 · Cited by 1,241
Three-level meta-analysis of dependent effect sizes
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0261-6 · Cited by 1,130
White, I. R., Barrett, J. K., Jackson, D., & Higgins, J. P. T. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1045 · Cited by 1,114
Missing Data in Clinical Studies
Molenberghs, G., & Kenward, M. G. (2007) · Wiley eBooks · doi:10.1002/9780470510445 · Cited by 962
Mixed-Effects Models in S and S-PLUS
(2000) · Statistics and Computing · doi:10.1007/b98882 · Cited by 930
A random‐effects regression model for meta‐analysis
Berkey, C. S., Hoaglin, D. C., Mosteller, F., & Colditz, G. A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140406 · Cited by 879
Fine, H. A., Dear, K. B. G., Loeffler, J. S., Mc Black, P. L., & Canellos, G. P. (1993) · Cancer · doi:10.1002/1097-0142(19930415)71:8<2585::aid-cncr2820710825>3.0.co;2-s · Cited by 864
Multilevel mixed linear model analysis using iterative generalized least squares
GOLDSTEIN, H. (1986) · Biometrika · doi:10.1093/biomet/73.1.43 · Cited by 802
Multivariate meta-analysis for non-linear and other multi-parameter associations
Gasparrini, A., Armstrong, B., & Kenward, M. G. (2012) · Statistics in Medicine · doi:10.1002/sim.5471 · Cited by 772
Stijnen, T., Hamza, T. H., & Özdemir, P. (2010) · Statistics in Medicine · doi:10.1002/sim.4040 · Cited by 757
Bayesian methods in meta-analysis and evidence synthesis
Sutton, A. J., & Abrams, K. R. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000404 · Cited by 710
Hamling, J., Lee, P., Weitkunat, R., & Ambühl, M. (2008) · Statistics in Medicine · doi:10.1002/sim.3013 · Cited by 651
Recent developments in meta‐analysis
Sutton, A. J., & Higgins, J. P. T. (2008) · Statistics in Medicine · doi:10.1002/sim.2934 · Cited by 590
Meta-analysis of Epidemiologic Dose-Response Data
Berlin, J. A., Longnecker, M. P., & Greenland, S. (1993) · Epidemiology · doi:10.1097/00001648-199305000-00005 · Cited by 571
Linear Mixed Models in Practice
Verbeke, G., & Molenberghs, G. (1997) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2294-1 · Cited by 555
Burke, D. L., Ensor, J., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7141 · Cited by 538
Multivariate meta‐analysis: Potential and promise
Jackson, D., Riley, R., & White, I. R. (2011) · Statistics in Medicine · doi:10.1002/sim.4172 · Cited by 530
Fixed effects and variance components estimation in three-level meta-analysis
Konstantopoulos, S. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.35 · Cited by 521
Alcohol Intake and Colorectal Cancer: A Pooled Analysis of 8 Cohort Studies
Cho, E., Smith-Warner, S. A., Ritz, J., van den Brandt, P. A., Colditz, G. A., Folsom, A. R., Freudenheim, J. L., Giovannucci, E., Goldbohm, R. A., Graham, S., et al. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-8-200404200-00007 · Cited by 501
Stochastically dependent effect sizes.
Gleser, L. J., & Olkin, I. (1994) · Cited by 485
Meta-analysis of multiple outcomes: a multilevel approach
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0527-2 · Cited by 450
Multivariate Random-effects Meta-regression: Updates to Mvmeta
White, I. R. (2011) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1101100206 · Cited by 400
One-stage dose–response meta-analysis for aggregated data
Crippa, A., Discacciati, A., Bottai, M., Spiegelman, D., & Orsini, N. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218773122 · Cited by 365
Efficacy of BCG vaccine in the prevention of tuberculosis. Meta-analysis of the published literature
Colditz, G. A. (1994) · JAMA · doi:10.1001/jama.271.9.698 · Cited by 355
A re‐evaluation of fixed effect(s) meta‐analysis
Rice, K., Higgins, J. P. T., & Lumley, T. (2018) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12275 · Cited by 287
Meta-analysis of multiple outcomes by regression with random effects
Berkey, C. S., Hoaglin, D. C., Antczak-Bouckoms, A., Mosteller, F., & Colditz, G. A. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19981130)17:22<2537::aid-sim953>3.0.co;2-c · Cited by 280
A multilevel model framework for meta-analysis of clinical trials with binary outcomes
Turner, R. M., Omar, R. Z., Yang, M., Goldstein, H., & Thompson, S. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001230)19:24<3417::aid-sim614>3.0.co;2-l · Cited by 265
Riley, R. D., Jackson, D., Salanti, G., Burke, D. L., Price, M., Kirkham, J., & White, I. R. (2017) · BMJ · doi:10.1136/bmj.j3932 · Cited by 247
A multivariate mixed linear model for meta-analysis.
Kalaian, H. A., & Raudenbush, S. W. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.3.227 · Cited by 229
Multivariate Dose-Response Meta-Analysis: The dosresmetaR Package
Crippa, A., & Orsini, N. (2016) · Journal of Statistical Software · doi:10.18637/jss.v072.c01 · Cited by 204
A comparison of seven random‐effects models for meta‐analyses that estimate the summary odds ratio
Jackson, D., Law, M., Stijnen, T., Viechtbauer, W., & White, I. R. (2018) · Statistics in Medicine · doi:10.1002/sim.7588 · Cited by 203
Riley, R. D., Abrams, K. R., Lambert, P. C., Sutton, A. J., & Thompson, J. R. (2007) · Statistics in Medicine · doi:10.1002/sim.2524 · Cited by 199
Meta-Analysis of Published Data Using a Linear Mixed-Effects Model
Stram, D. O. (1996) · Biometrics · doi:10.2307/2532893 · Cited by 158
Nam, I., Mengersen, K., & Garthwaite, P. (2003) · Statistics in Medicine · doi:10.1002/sim.1410 · Cited by 153
Restricted Unbiased Iterative Generalized Least-Squares Estimation
Goldstein, H. (1989) · Biometrika · doi:10.1093/biomet/76.3.622 · Cited by 142
Meta-Analysis Using Multilevel Models with an Application to the Study of Class Size Effects
Goldstein, H., Yang, M., Omar, R., Turner, R., & Thompson, S. G. (2000) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00200 · Cited by 141
Cooper, H., Valentine, J. C., Charlton, K., & Melson, A. (2003) · Review of Educational Research · doi:10.3102/00346543073001001 · Cited by 138
Valid Inference in Random Effects Meta‐Analysis
Follmann, D. A., & Proschan, M. A. (1999) · Biometrics · doi:10.1111/j.0006-341x.1999.00732.x · Cited by 128
Meta-analysis of longitudinal studies
Ishak, K. J., Platt, R. W., Joseph, L., Hanley, J. A., & Caro, J. J. (2007) · Clinical Trials · doi:10.1177/1740774507083567 · Cited by 124
Estimating within‐study covariances in multivariate meta‐analysis with multiple outcomes
Wei, Y., & Higgins, J. P. T. (2012) · Statistics in Medicine · doi:10.1002/sim.5679 · Cited by 121
Mixed models for longitudinal data
Cecílio‐Fernandes, D., Tio, R. A., & Jaarsma, D. A. D. C. (2016) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 119
Liu, Q., Cook, N. R., Bergström, A., & Hsieh, C. (2009) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2009.05.001 · Cited by 110
Multilevel models for meta-analysis, and their application to absolute risk differences
Thompson, S. G., Turner, R., & Warn, D. E. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000602 · Cited by 102
Hierarchical Dependence in Meta-Analysis
Stevens, J. R., & Taylor, A. (2008) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998607309080 · Cited by 97
Bayesian multivariate meta‐analysis with multiple outcomes
Wei, Y., & Higgins, J. P. T. (2013) · Statistics in Medicine · doi:10.1002/sim.5745 · Cited by 95
Meta‐analysis of repeated measures study designs
Peters, J., & Mengersen, K. L. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01010.x · Cited by 83
Rota, M., Bellocco, R., Scotti, L., Tramacere, I., Jenab, M., Corrao, G., Vecchia, C. L., Boffetta, P., & Bagnardi, V. (2010) · Statistics in Medicine · doi:10.1002/sim.4041 · Cited by 83
Generalized linear mixed models for meta-analysis
Platt, R. W., Leroux, B. G., & Breslow, N. E. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990330)18:6<643::aid-sim76>3.0.co;2-m · Cited by 74
Meta-analysis of binary outcomes via generalized linear mixed models: a simulation study
Bakbergenuly, I., & Kulinskaya, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0531-9 · Cited by 74
Statistical methods for multivariate meta-analysis of diagnostic tests: An overview and tutorial
Ma, X., Nie, L., Cole, S. R., & Chu, H. (2013) · Statistical Methods in Medical Research · doi:10.1177/0962280213492588 · Cited by 70
Meta-analysis of effect sizes reported at multiple time points: A multivariate approach
Trikalinos, T. A., & Olkin, I. (2012) · Clinical Trials · doi:10.1177/1740774512453218 · Cited by 69
Ahn, J. E., & French, J. L. (2010) · Journal of Pharmacokinetics and Pharmacodynamics · doi:10.1007/s10928-010-9152-6 · Cited by 68
Meta‐analysis of Gaussian individual patient data: Two‐stage or not two‐stage?
Morris, T. P., Fisher, D. J., Kenward, M. G., & Carpenter, J. R. (2018) · Statistics in Medicine · doi:10.1002/sim.7589 · Cited by 41
Meta-Analysis of Effect Sizes Reported at Multiple Time Points Using General Linear Mixed Model
Musekiwa, A., Manda, S., Mwambi, H. G., & Chen, D. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164898 · Cited by 29
Meta‐analysis in Stata using gllamm
Bagos, P. G. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1157 · Cited by 28
Computationally efficient methods for fitting mixed models to electronic health records data
Rhodes, K. M., Turner, R., Payne, R., & White, I. R. (2018) · Statistics in Medicine · doi:10.1002/sim.7944 · Cited by 1
Cited by
The burden of heat-related mortality attributable to recent human-induced climate change
Vicedo-Cabrera, A. M., Scovronick, N., Sera, F., Royé, D., Schneider, R., Tobias, A., Astrom, C., Guo, Y., Honda, Y., Hondula, D. M., et al. (2021) · Nature Climate Change · doi:10.1038/s41558-021-01058-x · Cited by 1,347
Self-citationHeat-related mortality in Europe during the summer of 2022
Ballester, J., Quijal-Zamorano, M., Méndez Turrubiates, R. F., Pegenaute, F., Herrmann, F. R., Robine, J. M., Basagaña, X., Tonne, C., Antó, J. M., & Achebak, H. (2023) · Nature Medicine · doi:10.1038/s41591-023-02419-z · Cited by 1,018
netmeta : An R Package for Network Meta-Analysis Using Frequentist Methods
Balduzzi, S., Rücker, G., Nikolakopoulou, A., Papakonstantinou, T., Salanti, G., Efthimiou, O., & Schwarzer, G. (2023) · Journal of Statistical Software · doi:10.18637/jss.v106.i02 · Cited by 532
“While netmeta offers a comprehensive set of functions for NMA and an easy to use interface, it lacks on flexibility compared to the more general R packages metafor (Viechtbauer 2010) and mixmeta (Sera et al. 2019).”
Alahmad, B., Khraishah, H., Royé, D., Vicedo-Cabrera, A. M., Guo, Y., Papatheodorou, S. I., Achilleos, S., Acquaotta, F., Armstrong, B., Bell, M. L., et al. (2023) · Circulation · doi:10.1161/circulationaha.122.061832 · Cited by 448
Self-citationSARS-CoV-2 vaccination and myocarditis in a Nordic cohort study of 23 million residents
Karlstad, Ø., Hovi, P., Husby, A., Härkänen, T., Selmer, R. M., Pihlström, N., Hansen, J. V., Nohynek, H., Gunnes, N., Sundström, A., et al. (2022) · JAMA Cardiology · doi:10.1001/jamacardio.2022.0583 · Cited by 221
Metadata
- Authors
- Sera, F., Armstrong, B., Blangiardo, M., & Gasparrini, A.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2019-10-24
- Volume
- 38
- Issue
- 29
- Pages
- 5429-5444
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2982160553
- Cited by
- 323
- References
- 77
- FWCI
- 13.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
