CoChat

Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research

Open access
Chan, A.-W. · 2004 · Canadian Medical Association Journal

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

BACKGROUND: The reporting of outcomes within published randomized trials has previously been shown to be incomplete, biased and inconsistent with study protocols. We sought to determine whether outcome reporting bias would be present in a cohort of government-funded trials subjected to rigorous peer review. METHODS: We compared protocols for randomized trials approved for funding by the Canadian Institutes of Health Research (formerly the Medical Research Council of Canada) from 1990 to 1998 with subsequent reports of the trials identified in journal publications. Characteristics of reported and unreported outcomes were recorded from the protocols and publications. Incompletely reported outcomes were defined as those with insufficient data provided in publications for inclusion in meta-analyses. An overall odds ratio measuring the association between completeness of reporting and statistical significance was calculated stratified by trial. Finally, primary outcomes specified in trial protocols were compared with those reported in publications. RESULTS: We identified 48 trials with 68 publications and 1402 outcomes. The median number of participants per trial was 299, and 44% of the trials were published in general medical journals. A median of 31% (10th-90th percentile range 5%-67%) of outcomes measured to assess the efficacy of an intervention (efficacy outcomes) and 59% (0%-100%) of those measured to assess the harm of an intervention (harm outcomes) per trial were incompletely reported. Statistically significant efficacy outcomes had a higher odds than nonsignificant efficacy outcomes of being fully reported (odds ratio 2.7; 95% confidence interval 1.5-5.0). Primary outcomes differed between protocols and publications for 40% of the trials. INTERPRETATION: Selective reporting of outcomes frequently occurs in publications of high-quality government-funded trials.

Overview

Integrity signals

Registry

Crossref · 10.1503/cmaj.1041086

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

3 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Cited by

See all 444

Metadata

Authors
Chan, A.-W.
Affiliations
Canadian Institutes of Health Research (CA)
Corresponding author
Chan, A.-W.
Venue
Canadian Medical Association Journal
Published
2004-09-28
Volume
171
Issue
7
Pages
735-740
ISSN
  • 0820-3946 (ISSN-L)
  • 1488-2329
OpenAlex
W2159096825
Cited by
444
References
18
Citations by year
2026: 5 · 2025: 9 · 2024: 9 · 2023: 14 · 2022: 14 · 2021: 15 · 2020: 13 · 2019: 16 · 2018: 21 · 2017: 17 · 2016: 20 · 2015: 23 · 2014: 16 · 2013: 27 · 2012: 42
FWCI
25.89
Type
journal article
Language
en
Open access
Locations
  • Canadian Medical Association Journal (publishedVersion)
  • Europe PMC (PubMed Central) (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • DigitalGeorgetown (Georgetown University Library) (submittedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
Keywords
selective reporting, selective outcome reporting, Canadian Institutes of Health Research, primary outcome reporting, efficacy outcomes, publication bias
MeSH terms
Canada, Government Agencies, Humans, Research Support as Topic, Randomized Controlled Trials as Topic, Treatment Outcome, Publication Bias

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.