CoChat

Comparison of four heterogeneity measures for meta‐analysis

Lin, Lifeng · 2020 · Journal of Evaluation in Clinical Practice
Cited by 184

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

Abstract

Rationale, aims, and objectives: Heterogeneity is a critical issue in meta‐analysis, because it implies the appropriateness of combining the collected studies and impacts the reliability of the synthesized results. The Q test is a traditional method to assess heterogeneity; however, because it does not have an intuitive interpretation for clinicians and often has low statistical power, many meta‐analysts alter to use some measures, such as the I2 statistic, to quantify the extent of heterogeneity. This article aims at providing a summary of available tools to assess heterogeneity and comparing their performance. Methods: We reviewed four heterogeneity measures (I2, , , and ) and illustrated how they could be treated as test statistics like the Q statistic. These measures were compared with respect to statistical power based on simulations driven by three real‐data examples. The pairwise agreement among the four measures was also evaluated using Cohen's κ coefficient. Results: Generally, was slightly more powerful than the Q test, while its type I error rate might be slightly inflated. The power of I2 was fairly close to that of Q. The and statistics might have low powers in some cases. Because the differences between the powers of I2, , and Q were often tiny, meta‐analysts might not expect I2 and to yield significant heterogeneity if the Q test failed to do so. In addition, I2 and had fairly good agreement based on the simulated meta‐analyses, but all other pairs of heterogeneity measures generally had poor agreement. Conclusion: The I2 and statistics are recommended for measuring heterogeneity. Meta‐analysts should use the heterogeneity measures as descriptive statistics which have intuitive interpretations from the clinical perspective, instead of determining the significance of heterogeneity simply based on their magnitudes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/jep.13159

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 17 references

Cited by

See all 184

Metadata

Authors
Lin, L.
Venue
Journal of Evaluation in Clinical Practice
Publisher
Wiley
Published
2019-06-24
Volume
26
Issue
1
Pages
376-384
ISSN
  • 1356-1294 (ISSN-L)
  • 1365-2753
OpenAlex
W2955544044
Cited by
184
References
17
FWCI
4.51
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Comparison of four heterogeneity measures for meta‐analysis. https://app.cochat.ai/papers/10.1111/jep.13159
The paper
Lin, L. (2020). Comparison of four heterogeneity measures for meta‐analysis. Journal of Evaluation in Clinical Practice. https://doi.org/10.1111/jep.13159

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.