CoChat

Comparison of registered and published outcomes in randomized controlled trials: a systematic review

Open access
Jones, Christopher W., Keil, Lukas G., Holland, Wesley C., Caughey, Melissa C., Platts-Mills, Timothy F. · 2015 · BMC Medicine

The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Clinical trial registries can improve the validity of trial results by facilitating comparisons between prospectively planned and reported outcomes. Previous reports on the frequency of planned and reported outcome inconsistencies have reported widely discrepant results. It is unknown whether these discrepancies are due to differences between the included trials, or to methodological differences between studies. We aimed to systematically review the prevalence and nature of discrepancies between registered and published outcomes among clinical trials. METHODS: We searched MEDLINE via PubMed, EMBASE, and CINAHL, and checked references of included publications to identify studies that compared trial outcomes as documented in a publicly accessible clinical trials registry with published trial outcomes. Two authors independently selected eligible studies and performed data extraction. We present summary data rather than pooled analyses owing to methodological heterogeneity among the included studies. RESULTS: Twenty-seven studies were eligible for inclusion. The overall risk of bias among included studies was moderate to high. These studies assessed outcome agreement for a median of 65 individual trials (interquartile range [IQR] 25-110). The median proportion of trials with an identified discrepancy between the registered and published primary outcome was 31%; substantial variability in the prevalence of these primary outcome discrepancies was observed among the included studies (range 0% (0/66) to 100% (1/1), IQR 17-45%). We found less variability within the subset of studies that assessed the agreement between prospectively registered outcomes and published outcomes, among which the median observed discrepancy rate was 41% (range 30% (13/43) to 100% (1/1), IQR 33-48%). The nature of observed primary outcome discrepancies also varied substantially between included studies. Among the studies providing detailed descriptions of these outcome discrepancies, a median of 13 % of trials introduced a new, unregistered outcome in the published manuscript (IQR 5-16%). CONCLUSIONS: Discrepancies between registered and published outcomes of clinical trials are common regardless of funding mechanism or the journals in which they are published. Consistent reporting of prospectively defined outcomes and consistent utilization of registry data during the peer review process may improve the validity of clinical trial publications.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12916-015-0520-3

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Flowchart of study selection process
Fig. 1 Flowchart of study selection processCC BY · PubMed Central
Fig. 2 Forest plot showing the proportion of registered and published primary outcome discrepancies among included studies. Horizontal bars indicate 95 % confidence intervals (CI) for proportions
Fig. 2 Forest plot showing the proportion of registered and published primary outcome discrepancies among included studies. Horizontal bars indicate 95 % confidence intervals (CI) for proportionsCC BY · PubMed Central
Fig. 3 Forest plot showing the proportion of trials with primary outcome changes favoring statistically significant published outcomes. Horizontal bars indicate 95 % confidence intervals (CI) for proportions
Fig. 3 Forest plot showing the proportion of trials with primary outcome changes favoring statistically significant published outcomes. Horizontal bars indicate 95 % confidence intervals (CI) for proportionsCC BY · PubMed Central
Fig. 4 Forest plot showing the proportion of primary outcome discrepancies among prospectively registered trials. Horizontal bars indicate 95 % confidence intervals (CI) for proportions
Fig. 4 Forest plot showing the proportion of primary outcome discrepancies among prospectively registered trials. Horizontal bars indicate 95 % confidence intervals (CI) for proportionsCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

5 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 43 references

Cited by

See all 242

Metadata

Authors
Jones, C. W., Keil, L. G., Holland, W. C., Caughey, M. C., & Platts-Mills, T. F.
Affiliations
  • Cooper Medical School of Rowan University (US)
  • University of North Carolina at Chapel Hill (US)
Corresponding author
Jones, Christopher W.
Venue
BMC Medicine
Published
2015-11-18
Volume
13
Issue
1
Pages
282-282
ISSN
1741-7015 (ISSN-L)
OpenAlex
W2180048566
Cited by
237
References
44
Citations by year
2026: 11 · 2025: 7 · 2024: 20 · 2023: 17 · 2022: 15 · 2021: 30 · 2020: 30 · 2019: 30 · 2018: 32 · 2017: 27 · 2016: 17
FWCI
4.17
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • BMC Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
Funders
National Institute on Aging (K23AG038548)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
Keywords
clinical trial registries, clinical trial registration, reporting bias, peer review, trial validity
MeSH terms
Humans, Peer Review, Publications, Registries, Bias, Randomized Controlled Trials as Topic, Treatment Outcome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Comparison of registered and published outcomes in randomized controlled trials: a systematic review. https://app.cochat.ai/papers/10.1186/s12916-015-0520-3
The paper
Jones, C. W., Keil, L. G., Holland, W. C., Caughey, M. C., & Platts-Mills, T. F. (2015). Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Medicine. https://doi.org/10.1186/s12916-015-0520-3

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.