A systematic review of the processes used to link clinical trial registrations to their published results
Open accessThe DOI matches its Crossref record; the references it cites are not checked yet; 9 of the 28 sources its claims cite were checked for support.
Abstract
Studies measuring the completeness and consistency of trial registration and reporting rely on linking registries with bibliographic databases. In this systematic review, we quantified the processes used to identify these links. PubMed and Embase databases were searched from inception to May 2016 for studies linking trial registries with bibliographic databases. The processes used to establish these links were categorised as automatic when the registration identifier was available in the bibliographic database or publication, or manual when linkage required inference or contacting of trial investigators. The number of links identified by each process was extracted where available. Linear regression was used to determine whether the proportions of links available via automatic processes had increased over time. In 43 studies that examined cohorts of registry entries, 24 used automatic and manual processes to find articles; 3 only automatic; and 11 only manual (5 did not specify). Twelve studies reported results for both manual and automatic processes and showed that a median of 23% (range from 13 to 42%) included automatic links to articles, while 17% (range from 5 to 42%) of registry entries required manual processes to find articles. There was no evidence that the proportion of registry entries with automatic links had increased (R 2 = 0.02, p = 0.36). In 39 studies that examined cohorts of articles, 21 used automatic and manual processes; 9 only automatic; and 2 only manual (7 did not specify). Sixteen studies reported numbers for automatic and manual processes and indicated that a median of 49% (range from 8 to 97%) of articles had automatic links to registry entries, and 10% (range from 0 to 28%) required manual processes to find registry entries. There was no evidence that the proportion of articles with automatic links to registry entries had increased (R 2 = 0.01, p = 0.73). The linkage of trial registries to their corresponding publications continues to require extensive manual processes. We did not find that the use of automatic linkage has increased over time. Further investigation is needed to inform approaches that will ensure publications are properly linked to trial registrations, thus enabling efficient monitoring of trial reporting.
Overview
CoChat Summary
TL;DR
This systematic review quantified how studies link clinical trial registry entries to published articles and found that linkage still frequently requires manual processes. It found no evidence that automatic linkage has increased over time.
Key findings
- Across 43 studies starting from registry-entry cohorts, 24/43 used both automatic and manual processes, 3/43 used automatic only, 11/43 used manual only, and 5 did not specify; among 12 studies reporting both, a median of 23% (range 13–42%) of published articles were found automatically, while manual processes found a further median of 17% (range 5–42%).
- Across 39 studies starting from publication cohorts, 21/39 used both automatic and manual processes, 9/39 used automatic only, 2/39 used manual only, and 7 did not specify; among 16 studies reporting both, a median of 49% (range 8–97%) of articles had automatic links to registry entries, while manual processes identified a further median of 10% (range 0–28%).
- There was no evidence that automatic linkage increased over time: registry-entry cohorts showed R² = 0.02, p = 0.36; publication cohorts showed R² = 0.01, p = 0.73.
- The authors conclude that manual processes remain extensive and that automatic links alone are useful but insufficient for monitoring trial reporting.
Methods
- Systematic review following a published protocol; PubMed and Embase were searched from inception to May 27, 2016, for primary studies linking WHO ICTRP registries with bibliographic databases.
- Two reviewers screened and extracted data; linkage processes were categorized as automatic, inferred, or inquired, and proportions of links by process were extracted where available.
- Linear regression using study publication year tested whether automatic-link proportions increased over time; analyses used SPSS version 24.0, and no pooled analysis was performed because of heterogeneity and incomplete reporting.
Limitations
- The paper states that excluding non-English studies may have missed studies examining WHO ICTRP registries from non-English-speaking countries.
- The paper states that using study publication year as a proxy for change over time did not account for the period each study covered, because many studies did not report the range and distribution of publication and registration dates.
- Evident from the text: many included studies did not specify the linkage processes or the proportions found by each process, limiting the analyses; the authors also note heterogeneity in study designs and therefore did not pool results.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
5 Valid · 1 Not valid · 8 Not checked · 49 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Previous studies that examined the availability of automatic links provided a broad analysis of automatic links made available through ClinicalTrials.gov and PubMed but did not systematically evaluate the proportion of links that could additionally be resolved using manual processes [15, 16, 63].”
§ A systematic review of the processes used to link clinical trial registrations to their published results > Discussion
What the sources say
- Partly supportedcites [15] Huser V, Cimino JJ. Linking ClinicalTrials. gov and PubMed to track results of interventional human clinical trials. PLoS One. 2013;8(7):e68409. sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Disputedcites [16] Huser V, Cimino JJ. Evaluating adherence to the International Committee of Medical Journal Editors’ policy of mandatory, timely clinical trial registration. J Am Med Inform Assoc. 2013;20(e1):e169–74. sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 0 partially supported, 2 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
- Not checked yetcites [63] Huser V, Cimino JJ. Precision and negative predictive value of links between ClinicalTrials. gov and PubMed. AMIA Annu Symp Proc. 2012;2012:400–8.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These links can be established in an automatic fashion if the publication abstract or metadata includes the registry identifier [15, 16].”
§ A systematic review of the processes used to link clinical trial registrations to their published results > Background
What the sources say
- Supportedcites [15] Huser V, Cimino JJ. Linking ClinicalTrials. gov and PubMed to track results of interventional human clinical trials. PLoS One. 2013;8(7):e68409. source
The Introduction subsection 'Links between Trials and Journal Articles' states that when an article includes a trial ID in its abstract, that ID yields an explicit structured (abstract) link 'extracted through simple text processing of the article abstract', and that 'PubMed's current indexing process automatically does so' for ClinicalTrials.gov and ISRCTN. The Introduction subsection 'PubMed' reinforces this: NLM extracts those trial IDs from the abstract into the PubMed secondary ID ([SI]) field, 'creating computable abstract links' that permit automated retrieval. The only caveat is that the paper's other structured link type, the registry link, is created manually by the trial record manager rather than automatically, but the claim's conditional (identifier present in the publication abstract/metadata) matches the abstract-link mechanism exactly. (LLM, conf=0.85)
- Partly supportedcites [16] Huser V, Cimino JJ. Evaluating adherence to the International Committee of Medical Journal Editors’ policy of mandatory, timely clinical trial registration. J Am Med Inform Assoc. 2013;20(e1):e169–74. sourceExperimental — accuracy not yet measured
The source clearly supports the metadata half of the claim: its 'Criterion 1: inclusion of trial ID' method and results sections describe automated extraction of registry identifiers from Medline's secondary identifier (SI) field via the PubMed API, which automatically linked 616 of 698 trial articles (88.3%), and the 'Implications' section frames this as a possible automated quality-control mechanism once Medline indexing occurs. However, the 'abstract' route is qualified in the source: the 'Limitations' section states the automated process relied on Medline indexing and that the SI field covers only two registries (CTG and ISRCTN), so identifiers appearing only as free text in abstracts (an additional 15 CTG/ISRCTN articles plus 29 from other ICMJE-approved registries, ~4%) had to be found by manual review, and 'Implications' notes that NLP augmentation would be needed to extend coverage to all WHO primary registries. Thus the unconditional claim that abstract-included identifiers suffice for automatic linking overstates what this paper demonstrates. (LLM, conf=0.68)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Clinical trial registries provide the ability to measure biases in the reporting of clinical trials that arise due to non-publication, delayed publication, or incomplete publication of results [14].”
§ A systematic review of the processes used to link clinical trial registrations to their published results > Background
What the sources say
- Partly supportedcites [14] Dwan K, Gamble C, Williamson PR, Kirkham JJ. Systematic review of the empirical evidence of study publication bias and outcome reporting bias—an updated review. PLoS One. 2013;8(7):e66844. sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) says that comparing trial registries with publications can reveal omitted or changed outcomes, supporting the incomplete-publication part. The Results describe measurements of non-publication and publication delays, but attribute those analyses to trial inception cohorts rather than specifically to registries. The paper therefore does not establish the full claim about what registries can measure. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“This may be a consequence of journals that have not yet established standards for registration [65] or have not implemented standards for incorporating registry identifiers in the information they pass to bibliographic databases.”
§ A systematic review of the processes used to link clinical trial registrations to their published results > Discussion > Implications
What the sources say
- Supportedcites [65] Wager E, Williams P. “Hardly worth the effort”? Medical journals’ policies and their editors’ and publishers’ views on trial registration and publication bias: quantitative and qualitative study. BMJ. 2013;347:f5248. source
The citation is attached to the clause about journals that have not yet established standards for registration. Our copy supports this directly: the Results (Quantitative study) report that of 200 sampled journals, 142 (71%) did not require registration (or at least did not mention it on their website), with 55 (28%) requiring it and 3 (2%) merely encouraging it. The Introduction likewise states that other medical journals have since adopted ICMJE-like policies 'but by no means all'. The second clause of the citing sentence (registry identifiers passed to bibliographic databases) carries no citation and is the citing authors' own speculation, so it is not judged against this source. (LLM, conf=0.85)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Twelve studies reported results for both manual and automatic processes and showed that a median of 23% (range from 13 to 42%) included automatic links to articles, while 17% (range from 5 to 42%) of registry entries required manual processes to find articles.”
- Also stated in: § Studies identifying published articles from cohorts of registry entries · plain
“Among these studies, automatic links were used to identify between 13 and 42% (median 23%) of the published articles, and manual processes were used to find a further 5–42% (median 17%) articles that were not available via automatic links.”
§ A systematic review of the processes used to link clinical trial registrations to their published results > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Studies identifying published articles from cohorts of registry entries · plain
36 more claims
Create a free account to see all 63 claims and to verify the 19 references still open.
- Probably not a substantial claim. 14
- It may state two separate claims as one. 14
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Published methods exist, for example, to identify published articles from records included in clinical trial registries [44,45].”
From A narrative review of recent tools and innovations toward automating living systematic reviews and evidence syntheses (2023) · cites this paper as [44]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A systematic review of the processes used to link clinical trial registrations to their published results > Results > Studies identifying registry entries from cohorts of publications
“These studies included a range of 51–698 (median 181) published articles.”
§ A systematic review of the processes used to link clinical trial registrations to their published results > Results > Studies identifying published articles from cohorts of registry entries
“bottom, 39 studies, ranging from 54 to 698 articles”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A systematic review of the processes used to link clinical trial registrations to their published results > Results > Studies identifying registry entries from cohorts of publications
“| McGee [128] | 74 | 307 | ICTRP | To determine whether trial is registered and declared registration in the publication | 2016 | Kidney transplantation | Automatic = 44Inferred = 30 |”
§ A systematic review of the processes used to link clinical trial registrations to their published results > References
“128. McGee R Su M Kelly P Higgins G Craig J Webster A Trial registration and declaration of registration by authors of randomized controlled trials Transplantation 2011 92 10 1094 1100”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A systematic review of the processes used to link clinical trial registrations to their published results > Results
“These included links to or from protocols [34–37]”
§ A systematic review of the processes used to link clinical trial registrations to their published results > Results > Studies identifying registry entries from cohorts of publications
“| Chan [34] | 519 | 553 | Unknown | Outcome reporting bias | 2005 | RCTs indexed in PubMed | Inferred and inquired = unknown |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A systematic review of the processes used to link clinical trial registrations to their published results > Results > Studies identifying registry entries from cohorts of publications
“| Lee [114] | 8 | 83 | Unknown | Assessment of compliance of randomized controlled trials in trauma surgery with the CONSORT statement | 2013 | Trauma surgery | Automatic = 8 |”
§ A systematic review of the processes used to link clinical trial registrations to their published results > Results > Studies identifying registry entries from cohorts of publications
“ranging from 10% (8 registrations from a cohort of 83 published articles)”
Citations
The citation lists are queued
They are fetched later and appear here then.
References 147 · Cited by 47
Research works printed but not linked: 1
- No R: 536/2014 of the European Parliament and the Council of 16 April 2014 on clinical trials on medicinal products for human use, and repealing Directive 2001/20. EC Official Journal of the European Union, L 2014, 158(27.5).
Metadata
- Authors
- Bashir, R., Bourgeois, F. T., & Dunn, A. G.
- Affiliations
- Macquarie University (AU)
- Boston Children's Hospital (US)
- Corresponding author
- Bashir, Rabia
- Venue
- Systematic Reviews
- Published
- 2017-07-03
- Volume
- 6
- Issue
- 1
- Pages
- 123-123
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC5494826
- OpenAlex
- W2728356165
- Cited by
- 47
- References
- 147
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 5 · 2023: 1 · 2022: 7 · 2021: 7 · 2020: 4 · 2019: 3 · 2018: 9 · 2017: 6
- FWCI
- 1.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Agency for Healthcare Research and Quality (R03HS024798)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- clinical trial registration, clinical trial registries, bibliographic databases, PubMed, Embase
- MeSH terms
- Clinical Trials as Topic, Humans, Publishing, Registries, Research Design, Databases, Bibliographic, Publication Bias, Biomedical Research, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic review of the processes used to link clinical trial registrations to their published results. https://app.cochat.ai/papers/10.1186/s13643-017-0518-3
- The paper
- Bashir, R., Bourgeois, F. T., & Dunn, A. G. (2017). A systematic review of the processes used to link clinical trial registrations to their published results. Systematic Reviews. https://doi.org/10.1186/s13643-017-0518-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.