The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Confidence intervals for the overall effect size in random-effects meta-analysis.
Abstract
One of the main objectives in meta-analysis is to estimate the overall effect size by calculating a confidence interval (CI). The usual procedure consists of assuming a standard normal distribution and a sampling variance defined as the inverse of the sum of the estimated weights of the effect sizes. But this procedure does not take into account the uncertainty due to the fact that the heterogeneity variance (tau2) and the within-study variances have to be estimated, leading to CIs that are too narrow with the consequence that the actual coverage probability is smaller than the nominal confidence level. In this article, the performances of 3 alternatives to the standard CI procedure are examined under a random-effects model and 8 different tau2 estimators to estimate the weights: the t distribution CI, the weighted variance CI (with an improved variance), and the quantile approximation method (recently proposed). The results of a Monte Carlo simulation showed that the weighted variance CI outperformed the other methods regardless of the tau2 estimator, the value of tau2, the number of studies, and the sample size.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 8×
“…heterogeneity variance by maximum likelihood under a random-effects model is given by ̂ML 2 i ŵi 2 ̂i ̂ML 2 ̂i 2 i ŵi 2 (28) (Sidik & Jonkman, 2007; Viechtbauer, 2005, p. 268), with ŵi 1/ ̂ 2 ̂i 2 , where ̂2 is initially estimated by any of the noniterative estimators of the heterogeneity…”
BackgroundMethodResultInfluentialA simple confidence interval for meta-analysis
Sidik, K., & Jonkman, J. N. (2002) · Statistics in Medicine · doi:10.1002/sim.1262 · Cited by 431 · cited 10×
“On the one hand, the understatement of the nominal confidence level found for the z distribution CI coincided with the results of previous simulation studies (Brockwell & Gordon, 2007; Follmann & Proschan, 1999; Hartung & Makambi, 2003; Makambi, 2004; Sidik & Jonkman, 2002, 2003, 2005, 2006).”
BackgroundMethodResultInfluentialA comparison of heterogeneity variance estimators in combining results of studies
Sidik, K., & Jonkman, J. N. (2007) · Statistics in Medicine · doi:10.1002/sim.2688 · Cited by 380
Empirical bayes meta-analysis.
Raudenbush, S. W., & Bryk, A. S. (1985) · Journal of Educational Statistics · doi:10.3102/10769986010002075 · Cited by 299 · cited 1×
“Two iterative estimators proposed in the meta-analytic literature to estimate the heterogeneity variance are based on maximum likelihood and restricted maximum likelihood estimation (Brockwell & Gordon, 2001; DerSimonian & Laird, 1986; Hardy & Thompson, 1996; Raudenbush & Bryk, 1985).”
MethodRobust variance estimation for random effects meta-analysis
Sidik, K., & Jonkman, J. N. (2006) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2005.07.019 · Cited by 138
Cited by
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949
IntHout, J., Ioannidis, J. P., & Borm, G. F. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-25 · Cited by 2,419
A comparison of heterogeneity variance estimators in simulated random‐effects meta‐analyses
Langan, D., Higgins, J. P. T., Jackson, D., Bowden, J., Veroniki, A. A., Kontopantelis, E., Viechtbauer, W., & Simmonds, M. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1316 · Cited by 1,074
Suurmond, R., van Rhee, H., & Hak, T. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1260 · Cited by 881
Hoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Diaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 770
Metadata
- Authors
- Sánchez-Meca, J., & Marín-Martínez, F.
- Venue
- Psychological Methods
- Published
- 2008
- Volume
- 13
- Issue
- 1
- Pages
- 31-48
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2112224121
- Cited by
- 242
- References
- 7
- FWCI
- 10.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Confidence intervals for the overall effect size in random-effects meta-analysis. https://app.cochat.ai/papers/10.1037/1082-989x.13.1.31
- The paper
- Sánchez-Meca, J., & Marín-Martínez, F. (2008). Confidence intervals for the overall effect size in random-effects meta-analysis. Psychological Methods. https://doi.org/10.1037/1082-989x.13.1.31
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.