Cited by 7Meta-analysis and systematic reviewsPharmaceutical industry and healthcareEthics in Clinical Research

Completeness of clinical evidence citation in trial protocols: A cross-sectional analysis

Open access
Sheng, Jacky, Feldhake, Emma, Zarin, Deborah A., Kimmelman, Jonathan·2022·Med

Abstract

Background Human protection policies require assessment of how proposed clinical trials relate to prior and ongoing studies testing similar hypotheses. We assessed the extent to which clinical trial protocols cited relevant published and ongoing clinical trials that would have been easily accessible with reference searches.Methods We created a random sample of trial protocols using ClinicalTrials.gov, stratifying by industry and non-industry-sponsored studies. We then conducted reference searches to determine the extent to which protocols cited clinical trials with identical intervention-indication pairings that were accessible in PubMed and ClinicalTrials.gov at the time of trial initiation.Findings Of the 101 trial protocols evaluated, 73 had at least one identified citable trial. None contained statements suggesting a systematic search for relevant clinical evidence. Of industry-sponsored trial protocols with at least one identified citable trial, 7 of 23 (30.4%) did not cite any published clinical trials and 10 of 33 (30.3%) did not cite any ongoing relevant trials. Of the non-industry-sponsored trial protocols with at least one identified citable trial, 5 of 28 (17.9%) did not cite any published clinical trials and 14 of 19 (73.7%) did not cite any ongoing trials.Conclusions Clinical trial protocols undercite accessible, relevant trials and do not document systematic searches for relevant clinical trials. Consequently, ethics review committees often receive an incomplete picture of the research landscape if they review protocols similar to those deposited on ClinicalTrials.gov.Funding This study was funded by the Canadian Institutes of Health Research and the Greenwall Foundation.

Integrity signals

Registry

Crossref · 10.1016/j.medj.2022.03.002

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The citation lists haven’t been fetched yet

References 37 · Cited by 7

Authors
Sheng, J., Feldhake, E., Zarin, D. A., & Kimmelman, J.
Affiliations
  • McGill University (CA)
  • Brigham and Women's Hospital (US)
Corresponding author
Kimmelman, Jonathan
Venue
Med
Publisher
Elsevier BV
Published
2022-05
Volume
3
Issue
5
Pages
335-343.e6
ISSN
2666-6340 (ISSN-L)
OpenAlex
W4225661123
Cited by
7
References
37
Citations by year
2025: 2 · 2024: 1 · 2023: 4
FWCI
1.05
Type
journal article
Language
en
Open access
Locations
  • Med (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • Canadian Institutes of Health Research
  • Greenwall Foundation
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
Keywords
reference searching, systematic search, research ethics committees, industry-sponsored trials, ClinicalTrials.gov, research ethics oversight
MeSH terms
Clinical Trial Protocols as Topic, Canada, Cross-Sectional Studies, Humans, Research Design, PubMed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review