Systematic review protocol assessing the processes for linking clinical trial registries and their published results
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index; 14 of the 23 sources its claims cite were checked for support.
Abstract
Introduction: Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias. Our aim is to survey and quantify the processes that have been used to identify links between clinical trial registries and published trial reports in studies that rely on these links to evaluate the completeness and accuracy of trial reporting. Methods and analysis: We will identify studies that describe a process for identifying the links between a trial registry included in the WHO International Clinical Trial Registry Platform and published trial results, and use those links to evaluate the completeness and accuracy of trial reporting. Information extracted from the studies will include the purpose and application domain of the study, registries used or searched, processes by which the links were identified, the study period and proportions for which links were found. We will summarise what is known about the number and availability of links between clinical trial registries and published results, and examine how automatic linking, inference and inquiry processes have been used to identify links since the introduction of trial registries. Ethics and dissemination: The systematic review is focused on the analysis of secondary data and does not require ethics approval. The results of the systematic review will be used to inform standard processes used to identify links to and from clinical trial registries in studies that evaluate the completeness and accuracy of clinical trial reports, as well as systematic reviews. Our findings will be disseminated by publishing the systematic review in a peer-reviewed journal, and by engaging with stakeholders from clinical trial registries and bibliographic databases.
Overview
CoChat Summary
TL;DR
This protocol outlines a systematic review to quantify how studies link WHO ICTRP clinical trial registry entries to published trial results, classifying links as automatic, inferred, or inquired. It reports no review results yet; it specifies planned searches, extraction, and synthesis methods.
Key findings
- No empirical review findings are reported; this is a protocol. Its stated objective is to quantify the processes used to link clinical trial registrations to published results in studies examining the completeness and accuracy of trial reporting.
- The protocol will classify links as automatic (using a unique registry identifier), inferred (using trial characteristics to search and reconcile links), or inquired (contacting trial investigators or authors).
- It will pool overall proportions of trials for which links were identified, separately for studies starting from registry entries versus published reports, and will use linear regression relative to midpoints of data collection periods to examine changes over time.
- The search strategy was developed using 50 known eligible articles and was designed to return all 50 without an unmanageable number of irrelevant articles.
Methods
- Design: systematic review protocol. Inclusion: English-language studies using one or more WHO ICTRP registries to compare registered and published information, determine the proportion of published trial reports that were registered, or the proportion of registered trials that were published. Exclusion: studies not reporting the number of trials for which links were identified, or studies describing a trial or reviewing clinical evidence.
- Data sources: PubMed and EMBASE, plus hand-searching reference lists of included studies. Two reviewers will screen articles; disagreements will be resolved by a third author and discussion. Duplicates will be removed by comparing DOIs where possible and manually checking titles, authors, and journal names.
- Extraction and synthesis: two reviewers will independently extract data on registry entries, published reports, registries used, study purpose, application domain, link-identification processes, and proportions of links found. Proportions will be pooled separately by direction of linkage, with contributions of automatic, inferred, and inquired links estimated where available.
Limitations
- Stated: excluding non-English studies may miss articles describing registries based in non-English-speaking countries.
- Stated: many included studies are designed for purposes other than identifying links, so descriptions of link processes may be limited, potentially limiting the ability to determine proportions captured automatically, by inference, or by inquiry.
- Evident from the text: as a protocol, no review results or conclusions are yet available.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 0 Not valid · 2 Not checked · 9 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The manner in which these processes are used vary from study to study and are known to be time-consuming.9 26 27”
- Also stated in: § Ethics and dissemination · plain
“The processes used to link clinical trial registries to published reports of clinical trials vary across studies that rely on those links to evaluate the accuracy and completeness of trial reports, and this systematic review will quantify these differences to inform the way this is performed in the future.”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Introduction
What the sources say
- Not checked yetcites [9] source
- Not checked yetcites [26] source
- Partly supportedcites [27] sourceExperimental — accuracy not yet measured
Our copy of Walker et al. (2014) illustrates, rather than asserts, that registry-to-publication linkage procedures differ between studies: the Methods (p. n/a) describe their own route ('using the trial registration number in the published paper where it was available. Where a trial registration number was unavailable, we searched ... ISRCTN, ClinicalTrials.gov (NCT) and the registry of the country of the first author'), and the Discussion contrasts Ewart et al.'s snapshot approach with their own use of archived registry data. However, no passage in our copy states that these processes are time-consuming (searched: time-consuming/laborious/effort/resources; the only 'wastes resources' remark is a quotation from Dickersin and Chalmers about biased reporting, not about linkage procedures), so that half of the citing sentence is not supported by this source. (LLM, conf=0.68)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Ethics and dissemination · plain
None of the sources cited for this claim have been checked yet.
In the paper
“The manner in which these processes are used vary from study to study and are known to be time-consuming.9 26 27”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Introduction
What the sources say
- Not checked yetcites [9] source
- Not checked yetcites [26] source
- Could not verifycites [27] sourceExperimental — accuracy not yet measured
Our copy of Walker et al. (2014) is complete and describes how registry records were matched to publications (Methods: reading full-text RCTs, comparing registry information with the corresponding publication, examining archived registry data), and it shows the approach differing between studies (Discussion: Ewart et al. examined registry data only as it appeared on the day of examination and did not use the archive, whereas the authors did; papers examined by a single author each). However, no passage — searched for 'time-consuming', 'labour-intensive', burden/workload of linking registries to reports — states or implies that these processes are time-consuming, which is the point the citation is offered for. Nothing in our copy contradicts it either, so the claim cannot be settled from this source. (LLM, conf=0.70)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias.”
- Also stated in: § Introduction · plain
“a number of studies have examined publication bias6–17 and outcome reporting bias,18–27 using one or more of the registries.”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Abstract > Introduction
What the sources say
- Partly supportedcites [6] sourceExperimental — accuracy not yet measured
The Introduction says trial registration allows comparison of published trials with all registered trials to assess publication bias. The Methods (“Trial results”) also describes checking whether results were provided for outcomes in the original registry, but the paper does not say it used registries to measure outcome reporting bias. (LLM, conf=0.84)
- Supportedcites [7] source
In the Discussion (Implications; page unavailable), the paper explicitly describes trial registries as tools for exploring publication bias and selective reporting of outcomes. The Discussion also reports a previous study that assessed publication of registered trials, while this paper compares results posted at ClinicalTrials.gov with published reports. (LLM, conf=0.88)
- Supportedcites [8] source
The Introduction says studies compare trial publications with registry entries to investigate changed or omitted outcomes. The Results (Excluded Studies) also notes investigations of trial registries; its references include work on underpublication of registered trials and outcome reporting among registered trials. Although registry-based studies were excluded from this review’s inception-cohort analysis, the paper supports the claim that registries have been used to assess both biases. (LLM, conf=0.86)
- Not checked yetcites [9] source
- Partly supportedcites [10] sourceExperimental — accuracy not yet measured
The Methods describe using ClinicalTrials.gov records to identify trials and determine whether their results were published, supporting the publication-bias part of the claim. The paper does not report using registry records to measure outcome reporting bias, such as discrepancies between registered and published outcomes. No page numbers are available in our copy. (LLM, conf=0.88)
- Not checked yetcites [11] source
- Not checked yetcites [12] source
- Partly supportedcites [13] Ross, 2013, Time to publication among completed clinical trials, JAMA Intern Med sourceExperimental — accuracy not yet measured
The Methods describe using ClinicalTrials.gov identifiers to link trials to publications, and the Discussion reports that 30%–50% of registered studies are never published. This supports using registries to examine publication, but the paper does not report using them to measure outcome reporting bias; that term appears only in a reference title. (LLM, conf=0.87)
- Partly supportedcites [14] sourceExperimental — accuracy not yet measured
The Introduction and Discussion use ClinicalTrials.gov registrations to assess whether completed trials were published, supporting the publication-bias part of the claim. The Discussion says incomplete primary-outcome information made outcome reporting bias difficult or impossible to detect in this study; it does not establish that registries were used to measure that bias. (LLM, conf=0.87)
- Partly supportedcites [15] sourceExperimental — accuracy not yet measured
The Methods (Publication status; page not provided) describe using ClinicalTrials.gov records to track whether registered trials were published, supporting the publication-tracking part of the claim. The Methods (Study variables; page not provided) list registered outcome measures, but the paper does not compare those measures with published outcomes to measure outcome reporting bias. (LLM, conf=0.84)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Introduction · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These databases were selected because they are known to have good coverage of clinical research,39 40”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Methods > Search strategy
What the sources say
- Supportedcites [39] source
The Abstract Results report 92.3% coverage for MEDLINE alone and 97.5% for Embase and MEDLINE combined among references included in 120 systematic reviews. The paper measures MEDLINE rather than PubMed directly, but its findings support the broad claim that these clinical-research databases have good coverage. (LLM, conf=0.88)
- Partly supportedcites [40] Preston, 2015, Improving search efficiency for systematic reviews of diagnostic test accuracy: an exploratory study to assess the viability of limiting to MEDLINE, EMBASE and reference checking, Syst Rev sourceExperimental — accuracy not yet measured
The Background describes MEDLINE and EMBASE as major general bibliographic databases in the health sciences. The Results report that they indexed 91% and 92%, respectively, of citations in nine diagnostic-test-accuracy reviews. The paper does not establish comparable coverage for PubMed specifically or for clinical research generally. (LLM, conf=0.82)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Clinical trial registries are sometimes used to identify trials for inclusion in systematic reviews.30–32”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Introduction
What the sources say
- Supportedcites [30] Jones, 2014, Clinical trials registries are under-utilized in the conduct of systematic reviews: a cross-sectional analysis, Syst Rev source
The Background states the authors' objective was to determine what proportion of systematic review authors 'searched clinical trials registries in order to identify relevant unpublished studies', and notes that commonly referenced guidelines recommend a registry search as part of a comprehensive search strategy. The Abstract Results (p. 1) quantify actual use: 41 of 117 reviews (35%) reported searching a registry, and of the 29 giving detailed results, 15 (52%) identified at least one completed trial and 18 (62%) at least one ongoing trial. The Discussion adds that registry searches 'may reveal the existence of ongoing or recently completed trials'. Together these support the hedged claim that registries are sometimes used to identify trials for systematic reviews. (LLM, conf=0.85)
- Supportedcites [31] source
The Methods (Literature search) section lists the Cochrane central register of controlled trials among the databases searched in April 2012 to identify studies for this systematic review, and the Abstract (Methods) repeats that the search covered 10 databases including the Cochrane Library. The paper therefore exemplifies the hedged claim that trial registers are sometimes used to identify trials for inclusion in systematic reviews. Our copy does not discuss prospective trial registries such as ClinicalTrials.gov, but the claim only requires an instance of the practice. (LLM, conf=0.80)
- Supportedcites [32] source
The Introduction (our copy) lists national/international trial registers (e.g. clinicaltrials.gov) among the sources the Cochrane handbook suggests for finding unpublished data for reviews, and the Discussion reports that trial registers were actually used by review authors (non-commercial registers 6.3%, company-owned registers 0.9% of respondents as sources of information), with the authors stating 'Trial registers should always be consulted' and that 'Searching a trial register (clinicaltrials.gov or similar) is also a good idea.' This directly supports the claim that registries are sometimes used to identify trials for systematic reviews (here, Cochrane reviews), though the paper frames registry use as a route to unpublished data rather than measuring registry searching across all systematic reviews. (LLM, conf=0.85)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
2 more claims
Create a free account to see all 15 claims and to verify the 9 references still open.
- Probably not a substantial claim. 6
- It may state two separate claims as one. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The protocol for this systematic review was published in 2016 [22] (see Additional file 3).”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [22]
Citations
Cites
Publication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Dwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group (2013) · PLoS ONE · doi:10.1371/journal.pone.0066844 · Cited by 1,127
The ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838
Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
When and how to update systematic reviews: consensus and checklist
Garner, P., Hopewell, S., Chandler, J., MacLehose, H., Schünemann, H. J., Akl, E. A., Beyene, J., Chang, S., Churchill, R., Dearness, K., et al. (2016) · BMJ · doi:10.1136/bmj.i3507 · Cited by 426
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401
Cited by
Gicquel, L., Ordonneau, P., Blot, E., Toillon, C., Ingrand, P., & Romo, L. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00094 · Cited by 112
Time-to-update of systematic reviews relative to the availability of new evidence
Bashir, R., Surian, D., & Dunn, A. G. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0856-9 · Cited by 72
Self-citationPowell-Smith, A., & Goldacre, B. M. (2016) · F1000Research · doi:10.12688/f1000research.10010.1 · Cited by 60
Lameijer, C. M., ten Duis, H. J., van Dusseldorp, I., Dijkstra, P. U., & van der Sluis, C. K. (2017) · Archives of Orthopaedic and Trauma Surgery · doi:10.1007/s00402-017-2765-0 · Cited by 52
Bashir, R., Bourgeois, F. T., & Dunn, A. G. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0518-3 · Cited by 47
Self-citation
Metadata
- Authors
- Bashir, R., & Dunn, A. G.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Bashir, Rabia
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2016-10
- Volume
- 6
- Issue
- 10
- Pages
- e013048
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5073522
- OpenAlex
- W2529217325
- Semantic Scholar
- e4c1f98bd04834d99674f5494b06887134069e05
- Cited by
- 10
- References
- 41
- Citations by year
- 2022: 1 · 2021: 1 · 2018: 2 · 2017: 5 · 2016: 1
- FWCI
- 0.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (acceptedVersion)
- Funders
- Macquarie University
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- clinical trial registries, publication bias, selective reporting, automatic linking, bibliographic databases
- MeSH terms
- Systematic Reviews as Topic, Humans, Publishing, Registries, Research Design, Databases, Bibliographic, Information Storage and Retrieval, Publication Bias, Biomedical Research, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Systematic review protocol assessing the processes for linking clinical trial registries and their published results. https://app.cochat.ai/papers/10.1136/bmjopen-2016-013048
- The paper
- Bashir, R., & Dunn, A. G. (2016). Systematic review protocol assessing the processes for linking clinical trial registries and their published results. BMJ Open. https://doi.org/10.1136/bmjopen-2016-013048
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.