Cited by 1,017Meta-analysis and systematic reviewsStatistical Methods in EpidemiologyDelphi Technique in Research

Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated

Open access
Thompson, S G·1994·BMJ

Abstract

Although meta-analysis is now well established as a method of reviewing evidence, an uncritical use of the technique can be very misleading. One common problem is the failure to investigate appropriately the sources of heterogeneity, in particular the clinical differences between the studies included. This paper distinguishes between the concepts of clinical and statistical heterogeneity and exemplifies the importance of investigating heterogeneity by using published meta-analyses of epidemiological studies of serum cholesterol concentration and clinical trials of its reduction. Although not without some dangers of speculative conclusions, prompted by overzealous inspection of the data to hand, a sensible investigation of sources of heterogeneity should increase both the scientific and the clinical relevance of the results of meta-analyses.

Integrity signals

Registry

Crossref · 10.1136/bmj.309.6965.1351

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Cites

Flagged first, then by citations

1 of the 32 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Thompson, S. G.
Affiliations
London School of Hygiene & Tropical Medicine (GB)
Corresponding author
Thompson, S G
Venue
BMJ
Publisher
BMJ
Published
1994-11-19
Volume
309
Issue
6965
Pages
1351-1355
ISSN
  • 0007-1447 (ISSN-L)
  • 0959-8138
  • 1468-5833
OpenAlex
W1511524925
Cited by
1,017
References
32
Citations by year
2026: 23 · 2025: 35 · 2024: 38 · 2023: 29 · 2022: 30 · 2021: 47 · 2020: 38 · 2019: 32 · 2018: 36 · 2017: 26 · 2016: 24 · 2015: 24 · 2014: 31 · 2013: 48 · 2012: 51
FWCI
3.70
Type
journal article
Language
en
Open access
Locations
  • BMJ (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords
meta-analysis heterogeneity, clinical heterogeneity, statistical heterogeneity, serum cholesterol, cholesterol lowering, meta-analysis methodology, overfitting
MeSH terms
Adult, Aged, Aging, Cholesterol, Clinical Trials as Topic, Humans, Middle Aged, Neoplasms, Research Design, Meta-Analysis as Topic, Randomized Controlled Trials as Topic, Risk Assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review