CoChat
Sign Up
Cited by 222Meta-analysis and systematic reviewsDelphi Technique in ResearchClinical practice guidelines implementation

The DOI matches its Crossref record; 127 of the 127 references it cites were found in a registry or an index.

Investigating clinical heterogeneity in systematic reviews: a methodologic review of guidance in the literature

Open access
Gagnier, Joel J, Moher, David, Boon, Heather, Beyene, Joseph, Bombardier, Claire·2012·BMC Medical Research Methodology
DOI 10.1186/1471-2288-12-111PMC PMC3564789
Open this paper in CoChat — free accountOpen PDF

Abstract

BACKGROUND: While there is some consensus on methods for investigating statistical and methodological heterogeneity, little attention has been paid to clinical aspects of heterogeneity. The objective of this study is to summarize and collate suggested methods for investigating clinical heterogeneity in systematic reviews. METHODS: We searched databases (Medline, EMBASE, CINAHL, Cochrane Library, and CONSORT, to December 2010) and reference lists and contacted experts to identify resources providing suggestions for investigating clinical heterogeneity between controlled clinical trials included in systematic reviews. We extracted recommendations, assessed resources for risk of bias, and collated the recommendations. RESULTS: One hundred and one resources were collected, including narrative reviews, methodological reviews, statistical methods papers, and textbooks. These resources generally had a low risk of bias, but there was minimal consensus among them. Resources suggested that planned investigations of clinical heterogeneity should be made explicit in the protocol of the review; clinical experts should be included on the review team; a set of clinical covariates should be chosen considering variables from the participant level, intervention level, outcome level, research setting, or others unique to the research question; covariates should have a clear scientific rationale; there should be a sufficient number of trials per covariate; and results of any such investigations should be interpreted with caution. CONCLUSIONS: Though the consensus was minimal, there were many recommendations in the literature for investigating clinical heterogeneity in systematic reviews. Formal recommendations for investigating clinical heterogeneity in systematic reviews of controlled trials are required.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1471-2288-12-111

Cites

127 of 127 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Search and inclusion results.
Figure 1 Search and inclusion results.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 2

  1. British Medical Journal. 2009, Available at: http://clinicalevidence.bmj.com/ceweb/about/index.jsp . Accessed February 16, 2009
  2. Glasziou P, Chalmers I, Altman DG, et al: Taking healthcare interventions from trial to practice. BMJ. 2010, 341: 384-387.

Cited by

Sorted by citations

See all 222

Related

See all

Metadata

Authors
Gagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C.
Affiliations
  • University of Michigan (US)
  • University of Ottawa (CA)
  • University of Toronto (CA)
  • Hospital for Sick Children (CA)
Corresponding author
Gagnier, Joel J
ORCID
Venue
BMC Medical Research Methodology
Publisher
Springer Science and Business Media LLC
Published
2012-07-30
Volume
12
Issue
1
Pages
111-111
ISSN
1471-2288 (ISSN-L)
DOI
10.1186/1471-2288-12-111
PMC
PMC3564789
OpenAlex
W1990368073
Cited by
222
References
127
Citations by year
2026: 17 · 2025: 24 · 2024: 24 · 2023: 21 · 2022: 24 · 2021: 37 · 2020: 19 · 2019: 22 · 2018: 5 · 2017: 7 · 2016: 5 · 2015: 9 · 2014: 5 · 2013: 3
FWCI
1.50
Type
journal article
Language
en
Open access
Licence
Locations
  • BMC Medical Research Methodology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Deep Blue (University of Michigan) (submittedVersion)
  • TSpace (University of Toronto) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • uO Research (University of Ottawa) (submittedVersion, public-domain)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
Keywords
clinical heterogeneity, covariate selection, risk of bias, methodological recommendations, subgroup analysis
MeSH terms
Systematic Reviews as Topic, Bayes Theorem, Clinical Trials as Topic, Data Interpretation, Statistical, Humans, Meta-Analysis as Topic, Epidemiologic Research Design, Bias, Databases, Bibliographic, Controlled Clinical Trials as Topic, Evidence-Based Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review