Cited by 22Meta-analysis and systematic reviewsStatistical Methods in Clinical TrialsAcademic Publishing and Open Access

Reporting quality of clinical trial protocols: a repeated cross-sectional study about the Adherence to SPIrit Recommendations in Switzerland, CAnada and GErmany (ASPIRE-SCAGE)

Open access
Gryaznov, Dmitry, von Niederhäusern, Belinda, Speich, Benjamin, Kasenda, Benjamin, Ojeda-Ruiz, Elena, Blümle, Anette, Schandelmaier, Stefan, Mertz, Dominik +28 more·2022·BMJ Open

Abstract

Objectives: Comprehensive protocols are key for the planning and conduct of randomised clinical trials (RCTs). Evidence of low reporting quality of RCT protocols led to the publication of the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist in 2013. We aimed to examine the quality of reporting of RCT protocols from three countries before and after the publication of the SPIRIT checklist. Design: Repeated cross sectional study. Setting: Swiss, German and Canadian research ethics committees (RECs). Participants: RCT protocols approved by RECs in 2012 (n=257) and 2016 (n=292). Primary and secondary outcome measures: The primary outcomes were the proportion of reported SPIRIT items per protocol and the proportion of trial protocols reporting individual SPIRIT items. We compared these outcomes in protocols approved in 2012 and 2016, and built regression models to explore factors associated with adherence to SPIRIT. For each protocol, we also extracted information on general trial characteristics and assessed whether individual SPIRIT items were reported Results: The median proportion of reported SPIRIT items among RCT protocols showed a non-significant increase from 72% (IQR, 63%–79%) in 2012 to 77% (IQR, 68%–82%) in 2016. However, in a preplanned subgroup analysis, we detected a significant improvement in investigator-sponsored protocols: the median proportion increased from 64% (IQR, 55%–72%) in 2012 to 76% (IQR, 64%–83%) in 2016, while for industry-sponsored protocols median adherence was 77% (IQR 72%–80%) for both years. The following trial characteristics were independently associated with lower adherence to SPIRIT: single-centre trial, no support from a clinical trials unit or contract research organisation, and investigator-sponsorship. Conclusions: In 2012, industry-sponsored RCT protocols were reported more comprehensively than investigator-sponsored protocols. After publication of the SPIRIT checklist, investigator-sponsored protocols improved to the level of industry-sponsored protocols, which did not improve.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2021-053417

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Trial protocols vary in their completeness and often do not adequately describe important elements including primary outcomes, treatment allocation methods, blinding, adverse event measurement, sample size calculations, data analysis methods, dissemination policies, and roles of sponsors and investigators.

    “However, trial protocols vary in their completeness and often do not address key elements of design and conduct.”
  • The reporting of protocols for randomised trials has improved somewhat since 2013 but remains far from adequate.

    “Although the reporting of protocols for randomised trials has improved somewhat since 2013 it remains far from adequate.9 10 11 12”
  • In two samples of 108 and 292 trial protocols from 2016, 98% and 92% respectively reported steering committee membership and roles.

    “Reviews of two samples of 108 and 292 trial protocols from 2016 found that 98% and 92%, respectively, reported the steering committee membership and roles.9 10”
  • The naming of authors and a description of their roles are standard for protocols published in journals such as Trials and BMJ Open, but they are less common for unpublished protocols.

    “The naming of authors and a description of their roles are standard for protocols published in journals such as Trials and BMJ Open, but they are less common for unpublished protocols.”
  • Reviews of two samples of 108 and 292 trial protocols from 2016 found that 61% and 39%, respectively, reported the role of the sponsor and funder.

    “Reviews of two samples of 108 and 292 trial protocols from 2016 found that 61% and 39%, respectively, reported the role of the sponsor and funder.9 10”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Gryaznov, D., von Niederhäusern, B., Speich, B., Kasenda, B., Ojeda-Ruiz, E., Blümle, A., Schandelmaier, S., Mertz, D., Odutayo, A., Tomonaga, Y., Amstutz, A., Pauli-Magnus, C., Gloy, V., Lohner, S., Bischoff, K., Wollmann, K., Rehner, L., Meerpohl, J. J., Nordmann, A., Klatte, K., Ghosh, N., Taji Heravi, A., Wong, J., Chow, N., Hong, P., McCord - De Iaco, K. A., Sricharoenchai, S., Busse, J. W., Agarwal, A., Saccilotto, R., Schwenkglenks, M., Moffa, G., Hemkens, L., Hopewell, S., Von Elm, E., & Briel, M.
Affiliations
  • University of Basel (CH)
  • Department of Clinical Research, Clinical Trial Unit, University Hospital Basel and University of Basel, Basel, Switzerland
  • Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
  • University of Freiburg (DE)
  • McMaster University (CA)
  • University of Oxford (GB)
  • University of Zurich (CH)
  • University of Pecs (HU)
  • Canadian Memorial Chiropractic College (CA)
  • University of Ottawa (CA)
  • Cochrane Switzerland, Centre for Primary Care and Public Health (unisanté), University of Lausanne, Lausanne, Switzerland
Corresponding author
Briel, Matthias
Venue
BMJ Open
Publisher
BMJ
Published
2022-05
Volume
12
Issue
5
Pages
e053417
ISSN
2044-6055 (ISSN-L)
OpenAlex
W4281479985
Cited by
22
References
26
Citations by year
2026: 2 · 2025: 13 · 2024: 3 · 2023: 1 · 2022: 3
FWCI
3.01
Type
journal article
Language
en
Open access
Locations
  • BMJ Open (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • Bristol Research (University of Bristol) (publishedVersion, cc-by-nc)
  • Explore Bristol Research (publishedVersion, cc-by-nc)
  • SERVAL (Université de Lausanne) (publishedVersion, cc-by-nc)
  • edoc (University of Basel) (acceptedVersion)
  • IRIS (submittedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by-nc)
Funders
  • Swiss National Science Foundation ((P300PB_177933))
  • Swiss Federal Office of Public Health (No grant number)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
Keywords
SPIRIT checklist, reporting quality, randomized controlled trials, research ethics committees, industry-sponsored trials, clinical trial units, contract research organizations, trial characteristics
MeSH terms
Canada, Cross-Sectional Studies, Germany, Humans, Switzerland, Ethics Committees, Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review