The citation of relevant systematic reviews and randomised trials in published reports of trial protocols
Open accessAbstract
BACKGROUND: It is important that planned randomised trials are justified and placed in the context of the available evidence. The SPIRIT guidelines for reporting clinical trial protocols recommend that a recent and relevant systematic review should be included. The aim of this study was to assess the use of the existing evidence in order to justify trial conduct. METHODS: Protocols of randomised trials published over a 1-month period (December 2015) indexed in PubMed were obtained. Data on trial characteristics relating to location, design, funding, conflict of interest and type of evidence included for trial justification was extracted in duplicate and independently by two investigators. The frequency of citation of previous research including relevant systematic reviews and randomised trials was assessed. RESULTS: Overall, 101 protocols for RCTs were identified. Most proposed trials were parallel-group (n = 74; 73.3%). Reference to an earlier systematic review with additional randomised trials was found in 9.9% (n = 10) of protocols and without additional trials in 30.7% (n = 31), while reference was made to randomised trials in isolation in 21.8% (n = 22). Explicit justification for the proposed randomised trial on the basis of being the first to address the research question was made in 17.8% (n = 18) of protocols. A randomised controlled trial was not cited in 10.9% (95% CI: 5.6, 18.7) (n = 11), while in 8.9% (95% CI: 4.2, 16.2) (n = 9) of the protocols a systematic review was cited but did not inform trial design. CONCLUSIONS: A relatively high percentage of protocols of randomised trials involves prior citation of randomised trials, systematic reviews or both. However, improvements are required to ensure that it is explicit that clinical trials are justified and shaped by contemporary best evidence.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Previous reviews of trial protocols have found that many do not cite the systematic reviews or trials that exist on the same topic.
“Previous reviews of trial protocols have found that many do not cite the systematic reviews or trials that exist on the same topic.152 153 154”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [152]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 18 · Cited by 18
- Authors
- Pandis, N., Fleming, P. S., Koletsi, D., & Hopewell, S.
- Affiliations
- University of Bern (CH)
- Queen Mary University of London (GB)
- University of London (GB)
- University of Oxford (GB)
- Corresponding author
- Pandis, Nikolaos
- Venue
- Trials
- Published
- 2016-12
- Volume
- 17
- Issue
- 1
- Pages
- 581-581
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC5142318
- OpenAlex
- W2559832221
- Cited by
- 18
- References
- 18
- Citations by year
- 2025: 2 · 2022: 9 · 2021: 3 · 2019: 2 · 2018: 1 · 2017: 1
- FWCI
- 0.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Trials (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- BORIS (University Library Bern) (submittedVersion, cc-by)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- systematic reviews, randomised trials, evidence base, research funding, conflicts of interest, trial design
- MeSH terms
- Systematic Reviews as Topic, Clinical Protocols, Humans, Periodicals as Topic, Research Design, Bibliometrics, Randomized Controlled Trials as Topic, Guidelines as Topic, Evidence-Based Medicine, Guideline Adherence, Editorial Policies, PubMed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review