The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Confidence intervals for the amount of heterogeneity in meta‐analysis
Abstract
Effect size estimates to be combined in a systematic review are often found to be more variable than one would expect based on sampling differences alone. This is usually interpreted as evidence that the effect sizes are heterogeneous. A random‐effects model is then often used to account for the heterogeneity in the effect sizes. A novel method for constructing confidence intervals for the amount of heterogeneity in the effect sizes is proposed that guarantees nominal coverage probabilities even in small samples when model assumptions are satisfied. A variety of existing approaches for constructing such confidence intervals are summarized and the various methods are applied to an example to illustrate their use. A simulation study reveals that the newly proposed method yields the most accurate coverage probabilities under conditions more analogous to practice, where assumptions about normally distributed effect size estimates and known sampling variances only hold asymptotically. Copyright © 2006 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Linear Statistical Inference and its Applications: Second Editon
Rao, C. R. (1973) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316436 · Cited by 10,489
Self, S. G., & Liang, K.-Y. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478472 · Cited by 2,661
(2000) · Queen Mary Research Online (Queen Mary University of London) · Cited by 1,795
Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699
Self-citationAdvanced methods in meta‐analysis: multivariate approach and meta‐regression
van Houwelingen, H. C., Arends, L. R., & Stijnen, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1040 · Cited by 1,580
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448
Cited by
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Self-citationA Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
“Some methods allow quantification of uncertainty in the estimate, including a full likelihood approach to the meta-analysis (Hardy and Thompson, 1996), and a method based on a x2-distribution for a random-effects version of the Q-statistic (Viechtbauer, 2007; Knapp et al., 2006); Viechtbauer (2007) reviewed several me…”
MethodMethods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685
Self-citationUndue reliance on I 2 in assessing heterogeneity may mislead
Rücker, G., Schwarzer, G., Carpenter, J. R., & Schumacher, M. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-79 · Cited by 1,287
Kane, R. L., Shamliyan, T. A., Mueller, C., Duval, S., & Wilt, T. J. (2007) · Medical Care · doi:10.1097/mlr.0b013e3181468ca3 · Cited by 1,097
Impact of Intraoperative Stimulation Brain Mapping on Glioma Surgery Outcome: A Meta-Analysis
De Witt Hamer, P. C., Robles, S. G., Zwinderman, A. H., Duffau, H., & Berger, M. S. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.38.4818 · Cited by 1,044
Commentary: Heterogeneity in meta-analysis should be expected and appropriately quantified
Higgins, J. P. T. (2008) · International Journal of Epidemiology · doi:10.1093/ije/dyn204 · Cited by 995
Turner, R. M., Davey, J., Clarke, M. J., Thompson, S. G., & Higgins, J. P. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys041 · Cited by 837
Association of frailty with survival: A systematic literature review
Shamliyan, T., Talley, K. M. C., Ramakrishnan, R., & Kane, R. L. (2013) · Ageing Research Reviews · doi:10.1016/j.arr.2012.03.001 · Cited by 666
Mol, S. E., Bus, A. G., & de Jong, M. T. (2009) · Review of Educational Research · doi:10.3102/0034654309332561 · Cited by 635
Recent developments in meta‐analysis
Sutton, A. J., & Higgins, J. P. T. (2008) · Statistics in Medicine · doi:10.1002/sim.2934 · Cited by 590
Bowden, J., Tierney, J. F., Copas, A. J., & Burdett, S. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-41 · Cited by 553
Röver, C., Knapp, G., & Friede, T. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0091-1 · Cited by 527
Global epidemiology of Duchenne muscular dystrophy: an updated systematic review and meta-analysis
Crisafulli, S., Sultana, J., Fontana, A., Salvo, F., Messina, S., & Trifirò, G. (2020) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-020-01430-8 · Cited by 500
Turner, R. M., Jackson, D., Wei, Y., Thompson, S. G., & Higgins, J. P. T. (2015) · Statistics in Medicine · doi:10.1002/sim.6381 · Cited by 410
Rhodes, K. M., Turner, R. M., & Higgins, J. P. T. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.012 · Cited by 395
Evidence‐based practice in clinical psychology: What it is, why it matters; what you need to know
Spring, B. (2007) · Journal of Clinical Psychology · doi:10.1002/jclp.20373 · Cited by 388
Misunderstandings about Q and ‘Cochran's Q test' in meta‐analysis
Hoaglin, D. C. (2016) · Statistics in Medicine · doi:10.1002/sim.6632 · Cited by 310
Nikolakopoulou, A., White, I. R., & Salanti, G. (2020) · Handbook of Meta-Analysis · doi:10.1201/9781315119403-10 · Cited by 303
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Rucker, G., Schwarzer, G., Carpenter, J. R., Binder, H., & Schumacher, M. (2011) · Biostatistics · doi:10.1093/biostatistics/kxq046 · Cited by 286
Shamliyan, T. A., Kane, R. L., Wyman, J., & Wilt, T. J. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-6-200803180-00211 · Cited by 281
Veroniki, A. A., Jackson, D., Bender, R., Kuss, O., Langan, D., Higgins, J. P. T., Knapp, G., & Salanti, G. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1319 · Cited by 236
Cheung, M. W.-L. (2008) · Psychological Methods · doi:10.1037/a0013163 · Cited by 175
Mitchell, L. J., Bisdounis, L., Ballesio, A., Omlin, X., & Kyle, S. D. (2019) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2019.06.002 · Cited by 171
Management of Sarcopenia: A Network Meta-Analysis of Randomized Controlled Trials
Negm, A. M., Lee, J., Hamidian, R., Jones, C. A., & Khadaroo, R. G. (2022) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2022.01.057 · Cited by 137
Detecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132
Stice, E., Onipede, Z. A., & Marti, C. N. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102046 · Cited by 132
Bayesian Meta-Analysis with Weakly Informative Prior Distributions
Williams, D. R., Rast, P., & Bürkner, P. C. (2018) · doi:10.31234/osf.io/7tbrm · Cited by 124
Physical Therapy Interventions for Knee Pain Secondary to Osteoarthritis: A Systematic Review
Wang, S.-Y., Olson-Kellogg, B., Shamliyan, T. A., Choi, J.-Y., Ramakrishnan, R., & Kane, R. L. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-9-201211060-00007 · Cited by 108
Pantalone, D. W., Nelson, K. M., Batchelder, A. W., Chiu, C., Gunn, H. A., & Horvath, K. J. (2020) · The Journal of Sex Research · doi:10.1080/00224499.2020.1728514 · Cited by 81
“We conducted meta-analyses using random effects models to compute the pooled estimates for the trials, given the high degree of heterogeneity between studies (Viechtbauer, 2007).”
MethodArntz, F., Markov, A., Behm, D. G., Behrens, M., Negra, Y., Nakamura, M., Moran, J., & Chaabene, H. (2023) · Sports Medicine · doi:10.1007/s40279-022-01806-9 · Cited by 82
Current methods for meta-analysis
Schulze, R. (2007) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.215.2.90 · Cited by 79
Bayesian estimation in random effects meta‐analysis using a non‐informative prior
Bodnar, O., Link, A., Arendacká, B., Possolo, A., & Elster, C. (2017) · Statistics in Medicine · doi:10.1002/sim.7156 · Cited by 73
Goralczyk, A. D., Hauke, N., Bari, N., Y. Tsui, T., Lorf, T., & Obed, A. (2011) · Hepatology · doi:10.1002/hep.24385 · Cited by 72
Georgescu, R., Fodor, L. A., Dobrean, A., & Cristea, I. A. (2020) · Psychological Medicine · doi:10.1017/s0033291719001855 · Cited by 53
Thomann, H., & Deutscher, V. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100686 · Cited by 40
A meta-analysis of sunburn and basal cell carcinoma risk
Lashway, S. G., Worthen, A. D. M., Abuasbeh, J. N., Harris, R. B., Farland, L. V., O’Rourke, M. K., & Dennis, L. K. (2023) · Cancer Epidemiology · doi:10.1016/j.canep.2023.102379 · Cited by 28
Bouguezzi, R., Sammoud, S., Markov, A., Negra, Y., & Chaabene, H. (2023) · Youth · doi:10.3390/youth3010010 · Cited by 23
Heterogeneity and Meta-Regression
Schwarzer, G., Carpenter, J. R., & Rücker, G. (2015) · Use R! · doi:10.1007/978-3-319-21416-0_4 · Cited by 18
McIsaac, D. I., Hutton, B., Veroniki, A., Gill, M., Boland, L., Branje, K., Grudzinski, A. L., Hladkowicz, E., Shaw, J., & Gillis, C. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-068797 · Cited by 7
Metadata
- Authors
- Viechtbauer, W.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2006-02-06
- Volume
- 26
- Issue
- 1
- Pages
- 37-52
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2006979162
- Cited by
- 394
- References
- 35
- FWCI
- 10.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.