The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
How to understand and report heterogeneity in a meta-analysis: The difference between I-squared and prediction intervals
Open accessAbstract
In any meta-analysis it is important to report not only the mean effect size but also how the effect size varies across studies. A treatment that has a moderate clinical impact in all studies is very different than a treatment where the impact is moderate on average, but in some studies is large and in others is trivial (or even harmful). A treatment that has no impact in any studies is very different than a treatment that has no impact on average because it is helpful in some studies but harmful in others. The majority of meta-analyses use the I-squared index to quantify heterogeneity. While this practice is common it is nevertheless incorrect. I-squared does not tell us how much the effect size varies (except when I-squared is zero percent). The statistic that does convey this information is the prediction interval. It allows us to report, for example, that a treatment has a clinically trivial or moderate effect in roughly 10 % of studies, a large effect in roughly 50 %, and a very large effect in roughly 40 %. This is the information that researchers or clinicians have in mind when they ask about heterogeneity. It is the information that researchers believe (incorrectly) is provided by I-squared.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Basics of meta‐analysis: I 2 is not an absolute measure of heterogeneity
Borenstein, M., Higgins, J. P. T., Hedges, L. V., & Rothstein, H. R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1230 · Cited by 1,848
Self-citationBorenstein, M., Hedges, L. V., Higgins, J. P. T., Rothstein, H. R., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.121 · Cited by 1,215
Self-citationBorenstein, M. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1678 · Cited by 183
Self-citationAlpha blockers for treatment of ureteric stones: systematic review and meta-analysis
Hollingsworth, J. M., Canales, B. K., Rogers, M. A. M., Sukumar, S., Yan, P. L., Kuntz, G. M., & Dahm, P. (2016) · BMJ · doi:10.1136/bmj.i6112 · Cited by 146
In a meta-analysis, the I-squared statistic does not tell us how much the effect size varies
Borenstein, M. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.10.003 · Cited by 141
Self-citation
Metadata
- Authors
- Borenstein, M.
- Venue
- Integrative Medicine Research
- Publisher
- Elsevier BV
- Published
- 2023-12
- Volume
- 12
- Issue
- 4
- Pages
- 101014
- ISSN
- 2213-4220 (ISSN-L)
- OpenAlex
- W4389097280
- Cited by
- 262
- References
- 8
- FWCI
- 48.10
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How to understand and report heterogeneity in a meta-analysis: The difference between I-squared and prediction intervals. https://app.cochat.ai/papers/10.1016/j.imr.2023.101014
- The paper
- Borenstein, M. (2023). How to understand and report heterogeneity in a meta-analysis: The difference between I-squared and prediction intervals. Integrative Medicine Research. https://doi.org/10.1016/j.imr.2023.101014
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.