Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Evaluation of Old and New Tests of Heterogeneity in Epidemiologic Meta-Analysis

Open access
Takkouche, B., Cadarso-Suarez, C., Spiegelman, D. · 1999 · American Journal of Epidemiology

Abstract

The identification of heterogeneity in effects between studies is a key issue in meta-analyses of observational studies, since it is critical for determining whether it is appropriate to pool the individual results into one summary measure. The result of a hypothesis test is often used as the decision criterion. In this paper, the authors use a large simulation study patterned from the key features of five published epidemiologic meta-analyses to investigate the type I error and statistical power of five previously proposed asymptotic homogeneity tests, a parametric bootstrap version of each of the tests, and tau2-bootstrap, a test proposed by the authors. The results show that the asymptotic DerSimonian and Laird Q statistic and the bootstrap versions of the other tests give the correct type I error under the null hypothesis but that all of the tests considered have low statistical power, especially when the number of studies included in the meta-analysis is small (<20). From the point of view of validity, power, and computational ease, the Q statistic is clearly the best choice. The authors found that the performance of all of the tests considered did not depend appreciably upon the value of the pooled odds ratio, both for size and for power. Because tests for heterogeneity will often be underpowered, random effects models can be used routinely, and heterogeneity can be quantified by means of R(I), the proportion of the total variance of the pooled effect measure due to between-study variance, and CV(B), the between-study coefficient of variation.

Overview

Integrity signals

Registry

Crossref · 10.1093/oxfordjournals.aje.a009981

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 20 references

Cited by

See all 380

Metadata

Authors
Takkouche, B., Cadarso-Suarez, C., & Spiegelman, D.
Affiliations
  • Universidade de Santiago de Compostela (ES)
  • Harvard University (US)
Venue
American Journal of Epidemiology
Published
1999-07-15
Volume
150
Issue
2
Pages
206-215
ISSN
  • 0002-9262 (ISSN-L)
  • 1476-6256
OpenAlex
W2049217505
Cited by
380
References
20
Citations by year
2026: 5 · 2025: 14 · 2024: 15 · 2023: 13 · 2022: 14 · 2021: 18 · 2020: 19 · 2019: 13 · 2018: 13 · 2017: 16 · 2016: 16 · 2015: 18 · 2014: 20 · 2013: 19 · 2012: 20
FWCI
11.62
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • American Journal of Epidemiology (publishedVersion)
  • PubMed (publishedVersion)
  • Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
Funders
  • Xunta de Galicia
  • Universidade de Santiago de Compostela
  • National Institutes of Health
  • National Cancer Institute (CA-55075)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords
heterogeneity testing, meta-analysis, parametric bootstrap, type I error, statistical power, random effects models, between-study variance, coefficient of variation, pooled odds ratio, simulation study
MeSH terms
Epidemiologic Methods, Humans, Meta-Analysis as Topic, Models, Statistical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evaluation of Old and New Tests of Heterogeneity in Epidemiologic Meta-Analysis. https://app.cochat.ai/papers/10.1093/oxfordjournals.aje.a009981
The paper
Takkouche, B., Cadarso-Suarez, C., & Spiegelman, D. (1999). Evaluation of Old and New Tests of Heterogeneity in Epidemiologic Meta-Analysis. American Journal of Epidemiology. https://doi.org/10.1093/oxfordjournals.aje.a009981

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.