Avoiding zero between‐study variance estimates in random‐effects meta‐analysis
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Fixed‐effects meta‐analysis has been criticized because the assumption of homogeneity is often unrealistic and can result in underestimation of parameter uncertainty. Random‐effects meta‐analysis and meta‐regression are therefore typically used to accommodate explained and unexplained between‐study variability. However, it is not unusual to obtain a boundary estimate of zero for the (residual) between‐study standard deviation, resulting in fixed‐effects estimates of the other parameters and their standard errors. To avoid such boundary estimates, we suggest using Bayes modal (BM) estimation with a gamma prior on the between‐study standard deviation. When no prior information is available regarding the magnitude of the between‐study standard deviation, a weakly informative default prior can be used (with shape parameter 2 and rate parameter close to 0) that produces positive estimates but does not overrule the data, leading to only a small decrease in the log likelihood from its maximum. We review the most commonly used estimation methods for meta‐analysis and meta‐regression including classical and Bayesian methods and apply these methods, as well as our BM estimator, to real datasets. We then perform simulations to compare BM estimation with the other methods and find that BM estimation performs well by (i) avoiding boundary estimates; (ii) having smaller root mean squared error for the between‐study standard deviation; and (iii) better coverage for the overall effects than the other methods when the true model has at least a small or moderate amount of unexplained heterogeneity. Copyright © 2013 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Collaboration, A. T. (2002) · BMJ · doi:10.1136/bmj.324.7329.71 · Cited by 6,943
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 3×
“First, the studies tend to be diverse [3,4], whereas the fixed-effects approach assumes that they are ‘functionally equivalent’ [5, p.”
BackgroundMethodBias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 2×
“However, we argue, along with Higgins et al. [4, p.149], that ‘such a null hypothesis is typically untenable’ and agree with Borenstein et al. [5], Curcio and Verde, [15], Draper [13], Hardy and Thompson [16], Overton [17], Viechtbauer [18], and others that the choice of model should not be based solely on a test of h…”
BackgroundAssessment and Propagation of Model Uncertainty
Draper, D. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02015.x · Cited by 1,599 · cited 3×
“However, we argue, along with Higgins et al. [4, p.149], that ‘such a null hypothesis is typically untenable’ and agree with Borenstein et al. [5], Curcio and Verde, [15], Draper [13], Hardy and Thompson [16], Overton [17], Viechtbauer [18], and others that the choice of model should not be based solely on a test of h…”
BackgroundParametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448 · cited 1×
“Morris [31] suggests an approximate REML estimator in the empirical Bayes framework, which requires an iterative method.”
MethodControlling the risk of spurious findings from meta-regression
Higgins, J. P. T., & Thompson, S. G. (2004) · Statistics in Medicine · doi:10.1002/sim.1752 · Cited by 1,267 · cited 1×
“Exercise for depression data We demonstrate the boundary estimation problem by using data on 10 randomized clinical trials of exercise as an intervention in the management of depression [22, 23].”
MethodLawlor, D. A., & Hopker, S. W. (2001) · BMJ · doi:10.1136/bmj.322.7289.763 · Cited by 1,230
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017 · cited 1×
“If heterogeneity is substantial, sources of heterogeneity should ideally be investigated [6, 7].”
BackgroundEFRON, B., & HINKLEY, D. V. (1978) · Biometrika · doi:10.1093/biomet/65.3.457 · Cited by 952
Harbord, R. M., & Higgins, J. P. T. (2008) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800403 · Cited by 897 · cited 1×
“The model with and without covariates was estimated by maximum likelihood (ML) and restricted (or residualized) maximum likelihood (REML [24]) by using the metaan [25] and metareg [26] commands in Stata.”
Method
Cited by
Methods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685
“…2005) and their CIs (Jackson, 2013; Knapp et al., 2006; Viechtbauer, 2007), while many published empirical and simulation studies suggest different methods (Chung et al., 2014; Kontopantelis et al., 2013; Novianti et al., 2014; Sidik and Jonkman, 2007; Thorlund et al., 2011; Viechtbauer, 2007).”
InfluentialThe heterogeneity statistic I2 can be biased in small meta-analyses
von Hippel, P. T. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0024-z · Cited by 1,229
A comparison of heterogeneity variance estimators in simulated random‐effects meta‐analyses
Langan, D., Higgins, J. P. T., Jackson, D., Bowden, J., Veroniki, A. A., Kontopantelis, E., Viechtbauer, W., & Simmonds, M. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1316 · Cited by 1,074
Suurmond, R., van Rhee, H., & Hak, T. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1260 · Cited by 881
Quintana, D. S., & Williams, D. R. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1761-4 · Cited by 408
Metadata
- Authors
- Chung, Y., Rabe‐Hesketh, S., & Choi, I.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2013-05-13
- Volume
- 32
- Issue
- 23
- Pages
- 4071-4089
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2166546590
- Cited by
- 108
- References
- 16
- FWCI
- 4.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Avoiding zero between‐study variance estimates in random‐effects meta‐analysis. https://app.cochat.ai/papers/10.1002/sim.5821
- The paper
- Chung, Y., Rabe‐Hesketh, S., & Choi, I. (2013). Avoiding zero between‐study variance estimates in random‐effects meta‐analysis. Statistics in Medicine. https://doi.org/10.1002/sim.5821
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.