CoChat

A systematic review of the processes used to link clinical trial registrations to their published results

Open access
Bashir, Rabia, Bourgeois, Florence T., Dunn, Adam G. · 2017 · Systematic Reviews

The DOI matches its Crossref record; the references it cites are not checked yet; 9 of the 28 sources its claims cite were checked for support.

Abstract

Studies measuring the completeness and consistency of trial registration and reporting rely on linking registries with bibliographic databases. In this systematic review, we quantified the processes used to identify these links. PubMed and Embase databases were searched from inception to May 2016 for studies linking trial registries with bibliographic databases. The processes used to establish these links were categorised as automatic when the registration identifier was available in the bibliographic database or publication, or manual when linkage required inference or contacting of trial investigators. The number of links identified by each process was extracted where available. Linear regression was used to determine whether the proportions of links available via automatic processes had increased over time. In 43 studies that examined cohorts of registry entries, 24 used automatic and manual processes to find articles; 3 only automatic; and 11 only manual (5 did not specify). Twelve studies reported results for both manual and automatic processes and showed that a median of 23% (range from 13 to 42%) included automatic links to articles, while 17% (range from 5 to 42%) of registry entries required manual processes to find articles. There was no evidence that the proportion of registry entries with automatic links had increased (R 2 = 0.02, p = 0.36). In 39 studies that examined cohorts of articles, 21 used automatic and manual processes; 9 only automatic; and 2 only manual (7 did not specify). Sixteen studies reported numbers for automatic and manual processes and indicated that a median of 49% (range from 8 to 97%) of articles had automatic links to registry entries, and 10% (range from 0 to 28%) required manual processes to find registry entries. There was no evidence that the proportion of articles with automatic links to registry entries had increased (R 2 = 0.01, p = 0.73). The linkage of trial registries to their corresponding publications continues to require extensive manual processes. We did not find that the use of automatic linkage has increased over time. Further investigation is needed to inform approaches that will ensure publications are properly linked to trial registrations, thus enabling efficient monitoring of trial reporting.

Overview

CoChat Summary

TL;DR

This systematic review quantified how studies link clinical trial registry entries to published articles and found that linkage still frequently requires manual processes. It found no evidence that automatic linkage has increased over time.

Key findings

  • Across 43 studies starting from registry-entry cohorts, 24/43 used both automatic and manual processes, 3/43 used automatic only, 11/43 used manual only, and 5 did not specify; among 12 studies reporting both, a median of 23% (range 13–42%) of published articles were found automatically, while manual processes found a further median of 17% (range 5–42%).
  • Across 39 studies starting from publication cohorts, 21/39 used both automatic and manual processes, 9/39 used automatic only, 2/39 used manual only, and 7 did not specify; among 16 studies reporting both, a median of 49% (range 8–97%) of articles had automatic links to registry entries, while manual processes identified a further median of 10% (range 0–28%).
  • There was no evidence that automatic linkage increased over time: registry-entry cohorts showed R² = 0.02, p = 0.36; publication cohorts showed R² = 0.01, p = 0.73.
  • The authors conclude that manual processes remain extensive and that automatic links alone are useful but insufficient for monitoring trial reporting.

Methods

  • Systematic review following a published protocol; PubMed and Embase were searched from inception to May 27, 2016, for primary studies linking WHO ICTRP registries with bibliographic databases.
  • Two reviewers screened and extracted data; linkage processes were categorized as automatic, inferred, or inquired, and proportions of links by process were extracted where available.
  • Linear regression using study publication year tested whether automatic-link proportions increased over time; analyses used SPSS version 24.0, and no pooled analysis was performed because of heterogeneity and incomplete reporting.

Limitations

  • The paper states that excluding non-English studies may have missed studies examining WHO ICTRP registries from non-English-speaking countries.
  • The paper states that using study publication year as a proxy for change over time did not account for the period each study covered, because many studies did not report the range and distribution of publication and registration dates.
  • Evident from the text: many included studies did not specify the linkage processes or the proportions found by each process, limiting the analyses; the authors also note heterogeneity in study designs and therefore did not pool results.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s13643-017-0518-3

Cites

Statistics

Nothing to recompute.

Figures

Fig. 1 PRISMA flow diagram of study selection for a search and screening process that resulted in the inclusion of 81 studies
Fig. 1 PRISMA flow diagram of study selection for a search and screening process that resulted in the inclusion of 81 studiesCC BY · PubMed Central
Fig. 2 The processes used to identify links in 81 included studies, including studies that examined automatic links only (red), both automatic and manual processes (purple), manual processes only (blue), and studies that did not report the processes used (grey)
Fig. 2 The processes used to identify links in 81 included studies, including studies that examined automatic links only (red), both automatic and manual processes (purple), manual processes only (blue), and studies that did not report the processes used (grey)CC BY · PubMed Central
Fig. 3 The proportions of published articles identified in cohorts of registry entries (top, 43 studies, ranging from 34 to 8907 registry entries) and the proportions of registry entries found in cohorts of published articles (bottom, 39 studies, ranging from 54 to 698 articles), with studies that only considered automatic links (red) and all other studies (blue). The circle areas are proportional to the study size
Fig. 3 The proportions of published articles identified in cohorts of registry entries (top, 43 studies, ranging from 34 to 8907 registry entries) and the proportions of registry entries found in cohorts of published articles (bottom, 39 studies, ranging from 54 to 698 articles), with studies that only considered automatic links (red) and all other studies (blue). The circle areas are proportional to the study sizeCC BY · PubMed Central
Fig. 4 The proportions of published articles found in cohorts of registry entries (12 studies, top) and the proportions of registry entries found in cohorts of published articles (16 studies, bottom), by automatic links (grey) and manual processes (blue)
Fig. 4 The proportions of published articles found in cohorts of registry entries (12 studies, top) and the proportions of registry entries found in cohorts of published articles (16 studies, bottom), by automatic links (grey) and manual processes (blue)CC BY · PubMed Central

Verification

Claims the paper makes

5 Valid · 1 Not valid · 8 Not checked · 49 Own results and interpretations

36 more claims

Create a free account to see all 63 claims and to verify the 19 references still open.

See all claims — free account
  • Probably not a substantial claim. 14
  • It may state two separate claims as one. 14

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

4 of 4

Citations

The citation lists are queued

They are fetched later and appear here then.

References 147 · Cited by 47

Research works printed but not linked: 1

  1. No R: 536/2014 of the European Parliament and the Council of 16 April 2014 on clinical trials on medicinal products for human use, and repealing Directive 2001/20. EC Official Journal of the European Union, L 2014, 158(27.5).

Metadata

Authors
Bashir, R., Bourgeois, F. T., & Dunn, A. G.
Affiliations
  • Macquarie University (AU)
  • Boston Children's Hospital (US)
Corresponding author
Bashir, Rabia
Venue
Systematic Reviews
Published
2017-07-03
Volume
6
Issue
1
Pages
123-123
ISSN
2046-4053 (ISSN-L)
OpenAlex
W2728356165
Cited by
47
References
147
Citations by year
2026: 2 · 2025: 2 · 2024: 5 · 2023: 1 · 2022: 7 · 2021: 7 · 2020: 4 · 2019: 3 · 2018: 9 · 2017: 6
FWCI
1.47
Type
journal article
Language
en
Open access
Licence
Locations
  • Systematic Reviews (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Agency for Healthcare Research and Quality (R03HS024798)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
Keywords
clinical trial registration, clinical trial registries, bibliographic databases, PubMed, Embase
MeSH terms
Clinical Trials as Topic, Humans, Publishing, Registries, Research Design, Databases, Bibliographic, Publication Bias, Biomedical Research, Research Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A systematic review of the processes used to link clinical trial registrations to their published results. https://app.cochat.ai/papers/10.1186/s13643-017-0518-3
The paper
Bashir, R., Bourgeois, F. T., & Dunn, A. G. (2017). A systematic review of the processes used to link clinical trial registrations to their published results. Systematic Reviews. https://doi.org/10.1186/s13643-017-0518-3

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.