Completeness of clinical evidence citation in trial protocols: A cross-sectional analysis
Open accessAbstract
Background Human protection policies require assessment of how proposed clinical trials relate to prior and ongoing studies testing similar hypotheses. We assessed the extent to which clinical trial protocols cited relevant published and ongoing clinical trials that would have been easily accessible with reference searches.Methods We created a random sample of trial protocols using ClinicalTrials.gov, stratifying by industry and non-industry-sponsored studies. We then conducted reference searches to determine the extent to which protocols cited clinical trials with identical intervention-indication pairings that were accessible in PubMed and ClinicalTrials.gov at the time of trial initiation.Findings Of the 101 trial protocols evaluated, 73 had at least one identified citable trial. None contained statements suggesting a systematic search for relevant clinical evidence. Of industry-sponsored trial protocols with at least one identified citable trial, 7 of 23 (30.4%) did not cite any published clinical trials and 10 of 33 (30.3%) did not cite any ongoing relevant trials. Of the non-industry-sponsored trial protocols with at least one identified citable trial, 5 of 28 (17.9%) did not cite any published clinical trials and 14 of 19 (73.7%) did not cite any ongoing trials.Conclusions Clinical trial protocols undercite accessible, relevant trials and do not document systematic searches for relevant clinical trials. Consequently, ethics review committees often receive an incomplete picture of the research landscape if they review protocols similar to those deposited on ClinicalTrials.gov.Funding This study was funded by the Canadian Institutes of Health Research and the Greenwall Foundation.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Previous reviews of trial protocols have found that many do not cite the systematic reviews or trials that exist on the same topic.
“Previous reviews of trial protocols have found that many do not cite the systematic reviews or trials that exist on the same topic.152 153 154”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [153]
The citation lists haven’t been fetched yet
References 37 · Cited by 7
- Authors
- Sheng, J., Feldhake, E., Zarin, D. A., & Kimmelman, J.
- Affiliations
- McGill University (CA)
- Brigham and Women's Hospital (US)
- Corresponding author
- Kimmelman, Jonathan
- Venue
- Med
- Publisher
- Elsevier BV
- Published
- 2022-05
- Volume
- 3
- Issue
- 5
- Pages
- 335-343.e6
- ISSN
- 2666-6340 (ISSN-L)
- OpenAlex
- W4225661123
- Cited by
- 7
- References
- 37
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 4
- FWCI
- 1.05
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 377 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Locations
- Med (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research
- Greenwall Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Keywords
- reference searching, systematic search, research ethics committees, industry-sponsored trials, ClinicalTrials.gov, research ethics oversight
- MeSH terms
- Clinical Trial Protocols as Topic, Canada, Cross-Sectional Studies, Humans, Research Design, PubMed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review