Cited by 299Meta-analysis and systematic reviewsStatistical Methods in Clinical TrialsAcademic Publishing and Open Access

Guidelines for Reporting Trial Protocols and Completed Trials Modified Due to the COVID-19 Pandemic and Other Extenuating Circumstances: The CONSERVE 2021 Statement

Open access
Orkin, Aaron M., Gill, Peter J., Ghersi, Davina, Campbell, Lisa, Sugarman, Jeremy, Emsley, Richard, Steg, Philippe Gabriel, Weijer, Charles +70 more·2021·JAMA

Abstract

Importance: Extenuating circumstances can trigger unplanned changes to randomized trials and introduce methodological, ethical, feasibility, and analytical challenges that can potentially compromise the validity of findings. Numerous randomized trials have required changes in response to the COVID-19 pandemic, but guidance for reporting such modifications is incomplete. Objective: As a joint extension for the CONSORT and SPIRIT reporting guidelines, CONSERVE (CONSORT and SPIRIT Extension for RCTs Revised in Extenuating Circumstances) aims to improve reporting of trial protocols and completed trials that undergo important modifications in response to extenuating circumstances. Evidence: A panel of 37 international trial investigators, patient representatives, methodologists and statisticians, ethicists, funders, regulators, and journal editors convened to develop the guideline. The panel developed CONSERVE following an accelerated, iterative process between June 2020 and February 2021 involving (1) a rapid literature review of multiple databases (OVID Medline, OVID EMBASE, and EBSCO CINAHL) and gray literature sources from 2003 to March 2021; (2) consensus-based panelist meetings using a modified Delphi process and surveys; and (3) a global survey of trial stakeholders. Findings: The rapid review yielded 41 673 citations, of which 38 titles were relevant, including emerging guidance from regulatory and funding agencies for managing the effects of the COVID-19 pandemic on trials. However, no generalizable guidance for all circumstances in which trials and trial protocols might face unanticipated modifications were identified. The CONSERVE panel used these findings to develop a consensus reporting guidelines following 4 rounds of meetings and surveys. Responses were received from 198 professionals from 34 countries, of whom 90% (n = 178) indicated that they understood the concept definitions and 85.4% (n = 169) indicated that they understood and could use the implementation tool. Feedback from survey respondents was used to finalize the guideline and confirm that the guideline's core concepts were applicable and had utility for the trial community. CONSERVE incorporates an implementation tool and checklists tailored to trial reports and trial protocols for which extenuating circumstances have resulted in important modifications to the intended study procedures. The checklists include 4 sections capturing extenuating circumstances, important modifications, responsible parties, and interim data analyses. Conclusions and Relevance: CONSERVE offers an extension to CONSORT and SPIRIT that could improve the transparency, quality, and completeness of reporting important modifications to trials in extenuating circumstances such as COVID-19.

AI snapshot

Written from the paper’s full text.

TL;DR

CONSERVE 2021 is a joint CONSORT and SPIRIT extension providing reporting guidance for randomized trial protocols and completed trials that undergo important modifications due to extenuating circumstances such as the COVID-19 pandemic. It offers implementation tools and checklists covering extenuating circumstances, important modifications, responsible parties, and interim data.

Key findings

  • The rapid review yielded 41,673 citations, of which 38 titles were relevant; it identified no comprehensive guidance overlapping with CONSERVE’s purpose.
  • A 37-member international panel developed CONSERVE between June 2020 and February 2021 using a rapid review, modified Delphi process, and global survey.
  • The global survey received responses from 198 professionals from 34 countries, including 61 respondents from low- and middle-income countries; 90% (178/198) understood the concept definitions and 85.4% (169/198) understood and could use the implementation tool.
  • CONSERVE checklists have 4 sections: extenuating circumstances, important modifications including impacts and mitigating strategies, responsible parties, and interim data.

Methods

  • Guideline development followed a registered protocol with 3 main elements: a rapid review, consensus-based meetings and surveys, and a global survey of the trials community.
  • The rapid review searched OVID Medline, OVID EMBASE, and EBSCO CINAHL plus gray literature sources from 2003 to March 2021; database searches were updated February 26, 2021, and gray literature searches to March 10, 2021.
  • The panel convened through 4 virtual meetings using a modified Delphi process and online surveys; consensus was defined as no panelist calling for further revisions.

Limitations

  • The paper states CONSERVE was developed rapidly using a modified process that substituted virtual meetings for in-person discussions.
  • The paper states that because many ongoing trials affected by the pandemic have not yet been published, only a few reports described how investigators responded to extenuating circumstances, limiting COVID-19 examples.
  • The paper states that despite international representation, including respondents from low- and middle-income countries, the global survey may not have captured all relevant perspectives.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1001/jama.2021.9941

Cites

Statistics

Nothing to recompute.

Claims the paper makes

0 of 70 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    85.4% (169/198) of survey respondents indicated that they understood and could use the CONSERVE implementation tool.

    “85.4% (n = 169) indicated that they understood and could use the implementation tool”
    • Also stated in: § Global Survey of Trials Community · plain
      “85.4% (169/198) indicated that they understood and could use the CONSERVE implementation tool”
    Quote in the paperNot a substantial claim
  • Findingown data

    90% (178/198) of survey respondents indicated that they understood the CONSERVE concept definitions.

    “90% (n = 178) indicated that they understood the concept definitions”
    • Also stated in: § Global Survey of Trials Community · plain
      “90% (178/198) of respondents indicated that they understood the CONSERVE concept definitions”
    Quote in the paperNot a substantial claim
  • Findingown data

    The rapid review identified no comprehensive guidance overlapping with the purpose and intent of CONSERVE.

    “The rapid review identified no comprehensive guidance overlapping with the purpose and intent of CONSERVE.”
    Quote in the paperSubstantial claim
  • Findingcitation

    The trial by Vaillancourt et al on out-of-hospital cervical spine immobilization was stopped early when regional authorities enacted a new policy mandating a modified immobilization rule and adopting many aspects of the trial's experimental intervention as standard of care.

    “The trial by Vaillancourt et al 20 on out-of-hospital cervical spine immobilization was stopped early when regional authorities enacted a new policy mandating a modified immobilization rule and adopting many aspects of the trial's experimental intervention as standard of care (Table).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • Findingreasoning

    The CONSERVE checklists incorporate a list of all items from the SPIRIT and CONSORT statements.

    “Because extenuating circumstances can potentially lead to modifications in any aspect of a trial, the CONSERVE checklists incorporate a list of all items from the SPIRIT and CONSORT statements.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [9] source

      Not checked in the free run.

    • cites [10] source

      Not checked in the free run.

    • Rests on an assumption: Extenuating circumstances can potentially lead to modifications in any aspect of a trial.
  • May combine two claims. 50
  • Classified as probably not a substantial claim. 74
  • May combine two claims.

    Findingown data

    Responses were received from 198 professionals from 34 countries, including 61 respondents from low- and middle-income countries.

    “Responses were received from 198 professionals from 34 countries”
    • Also stated in: § Global Survey of Trials Community · plain
      “Responses were received from 198 professionals from 34 countries, including 61 respondents from low-and middle-income countries.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Feedback from survey respondents was used to finalize the guideline and confirm that the core concepts were suited for widespread implementation.

    “Feedback from survey respondents was used to finalize the guideline and confirm that the guideline's core concepts were applicable and had utility for the trial community.”
    • Also stated in: § Global Survey of Trials Community · plain
      “Feedback from survey respondents was used to finalize the guideline and confirm that the core concepts were suited for widespread implementation.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The rapid review yielded 41,673 citations, of which 38 titles were relevant.

    “The rapid review yielded 41 673 citations, of which 38 titles were relevant”
    • Also stated in: § Rapid Review · plain
      “The search yielded 41 673 citations, of which 3735 were duplicates, and panelists conducted independent and dupli- cate screening of titles and abstracts using Covidence software, yield- ing 38 relevant titles”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingcitation

    The James et al investigators' mitigating strategies included new exclusion criteria for patients with contraindications to celecoxib use, changes in the intervention duration, and revisions to the consent materials.

    “The investigators' mitigating strategies included new exclusion criteria for patients with contraindications to celecoxib use (SPIRIT item 10; CONSORT item 4), changes in the intervention duration (SPIRIT item 11; CONSORT item 5), and revisions to the consent materials (SPIRIT item 26).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Findingnone given

    The CONSERVE implementation tool provides a pathway to determine when CONSERVE should be used to report on trials and trial protocols and provides guidance for its application.

    “The CONSERVE implementation tool (Figure ) provides a pathway to determine when CONSERVE should be used to report on trials and trial protocols and provides guidance for its application.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    In one reported case, the extenuating circumstance was terrorism, which affected the outcomes, data collection methods, and participant flow.

    “In this case, the extenuating circumstance was terrorism, which affected the outcomes, data collection methods, and participant flow (SPIRIT items 12 and 18; CONSORT items 13 and 17).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Findingreasoning

    CONSERVE provides 2 checklists: CONSERVE-CONSORT for completed trial results and CONSERVE-SPIRIT for trial protocols.

    “CONSERVE provides 2 checklists to support authors in reporting how their trial addressed important modifications in extenuating circumstances.CONSERVE-CONSORT is designed for reporting completed trial results, while CONSERVE-SPIRIT is for reporting trial protocols.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    The trial was reported without these details.

    “The trial was reported without these details.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [22] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Findingreasoning

    CONSERVE is designed to guide reporting for trials that have undergone important modifications in extenuating circumstances.

    “CONSERVE is designed to guide reporting for trials that have undergone important modifications in extenuating circumstances (Figure).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    The CONSERVE checklists consist of 4 sections: (1) extenuating circumstances, (2) important modifications including impacts and mitigating strategies, (3) responsible parties, and (4) interim data.

    “The checklists include 4 sections capturing extenuating circumstances, important modifications, responsible parties, and interim data analyses.”
    • Also stated in: § CONSERVE Checklists · plain
      “The CONSERVE checklists consist of 4 sections: (1) extenuating circumstances, (2) important modifications including impacts and mitigating strategies, (3) responsible parties, and (4) interim data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    In a trial by James et al involving celecoxib for hormone-sensitive prostate cancer, investigators were unable to implement the intended intervention because of unanticipated regulatory changes concerning the use of celecoxib in trials.

    “In a trial by James et al 23 involving celecoxib for hormone-sensitive prostate cancer, investigators were unable to implement the intended intervention because of unanticipated regulatory changes concerning the use of celecoxib in trials (Table).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    In the Vaillancourt example, the extenuating circumstance was regional policy change, and the impacts affected both the interventions and the numbers analyzed.

    “In this example, the extenuating circumstance was regional policy change, and the impacts affected both the interventions (SPIRIT item 11; CONSORT item 5) and the numbers analyzed (SPIRIT item 20; CONSORT item 16).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Although some health regulatory agencies released guidance on trial modifications due to the COVID-19 pandemic, no consensus exists on how such changes and their implications should be reported.

    “Although some health regulatory agencies released guidance on trial modifications due to the COVID-19 pandemic, no consensus exists on how such changes and their implications should be reported.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [5] source

      Not checked in the free run.

    • cites [6] source

      Not checked in the free run.

    • cites [7] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationnone given

    The CONSERVE approach is applicable to other extenuating circumstances that result in important modifications to a trial, such as natural disaster, strikes and other personnel disruptions, regulatory changes, or changes to the clinical standard of care.

    “Although the COVID-19 pandemic is the exemplar that prompted the development of CONSERVE, the approach is applicable to other extenuating circumstances that result in important modifications to a trial, such as natural disaster, strikes and other personnel disruptions, regulatory changes, or changes to the clinical standard of care.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    As of January 29, 2021, 2043 trials registered with ClinicalTrials.gov had been terminated, withdrawn, or suspended because of COVID-19, affecting more than 129,000 participants and interrupting plans to recruit more than 4 million future participants.

    “As of January 29, 2021, 2043 trials registered with ClinicalTrials.govhad been terminated, withdrawn, or suspended because of COVID-19, affecting more than 129 000 participants and interrupting plans to recruit more than 4 million future participants.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [4] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Panelists conducted independent and duplicate screening of titles and abstracts using Covidence software.

    “panelists conducted independent and dupli- cate screening of titles and abstracts using Covidence software”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductcitation

    The panel wrote and registered a protocol for the guideline development process involving 3 main elements: (1) rapid review, (2) consensus-based meetings and surveys, and (3) a global survey of the trials community.

    “The panel wrote and registered a protocol (available through the Open Science Framework at https://osf.io/ms8bz) 12 for the guideline development process involving 3 main elements: (1) rapid review, (2) consensus-based meetings and surveys, and (3) a global survey of the trials community.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [12] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    A review protocol and search strategy was registered through the Open Science Framework.

    “A review protocol and search strategy was registered through the Open Science Framework.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [15] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Amendments to trial procedures are common, and circumstances such as new safety or efficacy information, regulatory requirements, or changes in the standard of care can make those changes unavoidable.

    “Amendments to trial procedures are common, and circumstances such as new safety or efficacy information, regulatory requirements, or changes in the standard of care can make those changes unavoidable.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [1]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Through a fourth, final meeting, the panel refined the resulting guideline and checklists by incorporating the results of the rapid literature review and survey of the global trials community.

    “Through a fourth, final meeting, the panel refined the resulting guideline and checklists by incorporating the results of the rapid literature review and survey of the global trials community.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductcitation

    Searches were conducted by a health research librarian and peer reviewed using the Peer Review of Electronic Search Strategies (PRESS) guideline.

    “Searches were conducted by a health research librarian and peer reviewed using the Peer Review of Electronic Search Strategies (PRESS) guideline.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [16] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Panelists were recruited through professional networks to ensure global and interprofessional representation.

    “Panelists were recruited through professional networks to ensure global and interprofessional representation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The CONSERVE panel achieved consensus following 3 meetings.

    “The panel achieved consensus following 3 meetings.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Modifications to trial procedures can introduce biases, raising doubts about the validity of the conclusion of a clinical trial.

    “Modifications can also introduce biases, raising doubts about the validity of the conclusion of a clinical trial.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [2] source

      Not checked in the free run.

    • cites [3] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    CONSERVE is based on the observations that protocol amendments are common and that in some circumstances important modifications can be necessary, unavoidable, or beneficial.

    “CONSERVE is based on the observations that protocol amendments are common and that in some circumstances important modifications can be necessary, unavoidable, or beneficial.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [1]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Although the guideline development timeline was extended, the guideline development process proceeded per protocol.

    “Although the guideline development timeline was extended, the guideline development process proceeded per protocol.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The CONSERVE Panel that convened to develop the guideline was composed of 37 trial investigators, trial methodologists, patient representatives, ethicists, funders, regulators, and journal editors, including CONSORT and SPIRIT executive committee members.

    “The CONSERVE Panel that convened to develop the guideline was composed of 37 trial investigators, trial methodologists, patient representatives, ethicists, funders, regulators, and journal editors, including CONSORT and SPIRIT executive committee members.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    While CONSORT 2010 and SPIRIT 2013 guide reporting for completed trials and trial protocols, respectively, there is limited guidance for reporting trial modifications.

    “While CONSORT (Consolidated Standards of Reporting Trials) 2010 and SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) 2013 guide reporting for completed trials and trial protocols, respectively, there is limited guidance for reporting trial modifications.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [9] source

      Not checked in the free run.

    • cites [10] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Extenuating circumstances share elements with the contract law concept of force majeure, referring to external events such as wars, strikes, riots, or epidemics that prevent parties from fulfilling their contractual obligations.

    “Extenuating circumstances share elements with the contract law concept of force majeure, referring to external events such as wars, strikes, riots, or epidemics that prevent parties from fulfilling their contractual obligations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [8] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    The entire CONSERVE panel convened through a series of 4 virtual meetings to revise the prototype and build consensus.

    “The entire CONSERVE panel convened through a series of 4 virtual meetings to revise this prototype and build consensus.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductcitation

    CONSERVE was developed between June 2020 and February 2021 following a process adapted from the reporting guideline development procedure of Moher et al, modified to replace face-to-face meetings with virtual meetings and emphasizing rapid completion given the unprecedented disruption of trials in the context of the COVID-19 pandemic.

    “CONSERVE was developed between June 2020 and February 2021 following a process adapted from the reporting guideline development procedure of Moher et al, 11 modified to replace face-to-face meetings with virtual meetings and emphasizing rapid completion given the unprecedented disruption of trials in the context of the COVID-19 pandemic.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [11] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Thorough and consistent reporting of trials that undergo modifications could enhance trial interpretation and transparency, reduce research waste, and facilitate understanding of how trialists respond and adjust to unforeseen circumstances related to major disruptions, such as the COVID-19 pandemic.

    “Thorough and consistent reporting of trials that undergo modifications could enhance trial interpretation and transparency, reduce research waste, and facilitate understanding of how trialists respond and adjust to unforeseen circumstances related to major disruptions, such as the COVID-19 pandemic.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductcitation

    The guideline development process did not involve human subjects research as defined by the Tri-Council Policy Statement (Canada) and therefore was outside the scope of research ethics committee review.

    “The guideline development process did not involve human subjects research as defined by the Tri-Council Policy Statement (Canada) and therefore was outside the scope of research ethics committee review.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Participants were listed as lost to follow-up because they could not access outcome assessment facilities per protocol.

    “Participants were listed as lost to follow-up because they could not access outcome assessment facilities per protocol.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [22] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    The overall implications for the trial were that recruitment was likely slowed by the highly publicized safety concerns and the shortened intervention duration may not have been sufficiently long to show benefit.

    “The overall implications for the trial were that recruitment was likely slowed by the highly publicized safety concerns and the shortened intervention duration may not have been sufficiently long to show benefit.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A 2-group multisite trial was conducted in rural Niger to assess the effect of a low-cost, heat-stable rotavirus vaccine compared with placebo to prevent laboratory-confirmed severe rotavirus gastroenteritis.

    “A 2-group multisite trial was conducted in rural Niger to assess the effect of a low-cost, heat-stable rotavirus vaccine compared with placebo to prevent laboratory-confirmed severe rotavirus gastroenteritis.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [22] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Prior to beginning recruitment in 2004, rofecoxib was withdrawn from the market by the manufacturer for safety concerns about cardiovascular toxicity, and regulatory agencies stopped all trials involving cyclooxygenase 2 inhibitors.

    “Prior to beginning recruitment in 2004, rofecoxib was withdrawn from the market by the manufacturer for safety concerns about cardiovascular toxicity, and regulatory agencies stopped all trials involving cyclooxygenase 2 inhibitors.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    These are important modifications because they affected the study's ethical acceptability and feasibility.

    “These are important modifications because they affected the study's ethical acceptability and feasibility.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    The authors determined that a sufficient number of clusters had completed implementation of the planned intervention to allow analysis of the primary outcome but were unable to use the final 3 months of the stepped-wedge design (after the policy change) for the planned analysis.

    “The authors determined that a sufficient number of clusters had completed implementation of the planned intervention to allow analysis of the primary outcome but were unable to use the final 3 months of the stepped-wedge design (after the policy change) for the planned analysis.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A planned comparison was celecoxib plus hormone therapy vs hormone therapy alone.

    “A planned comparison was celecoxib plus hormone therapy vs hormone therapy alone.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The STAMPEDE investigators could not recruit to the celecoxib group and had to reassess the risk-benefit balance of the intervention.

    “The STAMPEDE investigators could not recruit to the celecoxib group and had to reassess the risk-benefit balance of the intervention.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The trialists identified this policy change as an extenuating circumstance leading to a premature and unanticipated modification to the implementation schedule at 9 months, before the planned completion at 12 months.

    “The trialists identified this policy change as an extenuating circumstance leading to a premature and unanticipated modification to the implementation schedule at 9 months, before the planned completion at 12 months.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    This could represent an important modification to trials conducted in critical care settings regardless of whether such a change triggered an amendment to the study protocol.

    “This could represent an important modification to trials conducted in critical care settings regardless of whether such a change triggered an amendment to the study protocol.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    These are important modifications that had implications for study feasibility and analytical methods in this trial.

    “These are important modifications that had implications for study feasibility and analytical methods in this trial.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisenone given

    CONSERVE is not a mechanism to redress poor trial design, and it does not encourage unwarranted trial modifications, especially post hoc changes to favor positive results based on accumulating trial data.

    “CONSERVE is not a mechanism to redress poor trial design, and it does not encourage unwarranted trial modifications, especially post hoc changes to favor positive results based on accumulating trial data.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    This introduced ethical challenges as study staff and participants worked to continue study operations despite the security threat.

    “This introduced ethical challenges as study staff and participants worked to continue study operations despite the security threat.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [22] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    There is a gap in existing trial reporting guidance that predates the COVID-19 pandemic and will persist beyond the pandemic.

    “This could help address a gap in existing trial reporting guidance that predates the COVID-19 pandemic and will persist beyond the pandemic.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The investigators' mitigating strategies included omission of the final study period from the randomized clinical trial analysis, an extended observational data collection period for 3 months beyond the anticipated stop date, and a revised design and analysis plan to include 3 conditions: usual care, planned intervention, and an uncontrolled modified intervention condition.

    “The investigators' mitigating strategies included omission of the final study period from the randomized clinical trial analysis, an extended observational data collection period for 3 months beyond the anticipated stop date, and a revised design and analysis plan to include 3 conditions: usual care, planned intervention, and an uncontrolled modified intervention condition.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    The prevalence of other underlying conditions leading to critical care unit admissions also changed in unanticipated ways.

    “The prevalence of other underlying conditions leading to critical care unit admissions also changed in unanticipated ways.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [21] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    By promoting complete and transparent reporting of trial modifications, CONSERVE allows the research community to learn from how extenuating circumstances have been managed, examine the overall impact of those circumstances, and take modifications into account when interpreting trial results.

    “By promoting complete and transparent reporting of trial modifications, CONSERVE also allows the research community to learn from how extenuating circumstances have been managed, examine the overall impact of those circumstances, and take modifications into account when interpreting trial results.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The STAMPEDE trial was a multicenter, multigroup, multistage platform trial evaluating the efficacy and safety of multiple novel systemic therapies compared with standard care for hormone-sensitive prostate cancer.

    “The STAMPEDE trial was a multicenter, multigroup, multistage platform trial evaluating the efficacy and safety of multiple novel systemic therapies compared with standard care for hormone-sensitive prostate cancer.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The intervention duration was also reduced, and cardiovascular risks were added to the consent materials.

    “The intervention duration was also reduced, and cardiovascular risks were added to the consent materials.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Investigators evaluated the effect of small-volume blood collection tubes vs standard tubes to reduce red blood cell transfusion in critical care patients in a pragmatic multicenter, stepped-wedge cluster trial at 25 sites in Canada.

    “Investigators evaluated the effect of small-volume blood collection tubes vs standard tubes to reduce red blood cell transfusion in critical care patients in a pragmatic multicenter, stepped-wedge cluster trial at 25 sites in Canada.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [21] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    They modified the eligibility criteria to exclude any potential participants who had substantial cardiovascular disease, and the start of recruitment to the celecoxib group was delayed by 1 year.

    “They modified the eligibility criteria to exclude any potential participants who had substantial cardiovascular disease, and the start of recruitment to the celecoxib group was delayed by 1 year.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    These are important modifications because they had meaningful effects for the study's ethical acceptability, analytical methods, and statistical power.

    “These are important modifications because they had meaningful effects for the study's ethical acceptability, analytical methods, and statistical power.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The authors interpreted this extenuating circumstance as a threat to the study's ethical foundations and analysis plan.

    “The authors interpreted this extenuating circumstance as a threat to the study's ethical foundations and analysis plan.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [22] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Examining interim outcome data can bias trial results and interpretation and introduce analytical and ethical challenges when interim analyses are not prespecified or lead to early study termination.

    “Examining interim outcome data can bias trial results and interpretation and introduce analytical and ethical challenges when interim analyses are not prespecified or lead to early study termination.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [27] source

      Not checked in the free run.

    • cites [28] source

      Not checked in the free run.

    • cites [29] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The investigators modified their analysis plan to mitigate the effect of these changes.

    “The investigators modified their analysis plan to mitigate the effect of these changes (Table).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [21] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationnone given

    Using data concerning recruitment rate or adherence would not generally introduce bias, whereas using outcome data by study group would have a greater potential to bias the choice of mitigating strategies used to respond to extenuating circumstances.

    “For example, using data concerning recruitment rate or adherence would not generally introduce bias, whereas using outcome data by study group would have a greater potential to bias the choice of mitigating strategies used to respond to extenuating circumstances.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    When trials are affected by extenuating circumstances, it may be reasonable in some instances to use outcome data to plan and implement mitigating strategies.

    “When trials are affected by extenuating circumstances, however, it may be reasonable in some instances to use outcome data to plan and implement mitigating strategies.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Trialists can reduce the chance of introducing bias by creating a plan for interim analyses a priori and detailing how the findings will inform further decisions.

    “Rather than conducting ad hoc interim analyses in a fully ad hoc manner, trialists can reduce the chance of introducing bias by creating a plan for these interim analyses a priori and detailing how the findings will inform further decisions.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The authors interpreted these as extenuating circumstances and implemented mitigating strategies including changes to the statistical analysis plan to mitigate the effects of these changes in the patient population.

    “The authors interpreted these as extenuating circumstances and implemented mitigating strategies including changes to the statistical analysis plan to mitigate the effects of these changes in the patient population.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [21] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    The types of patients admitted to the critical care units (and their corresponding prognoses) may have changed substantially after the start of the COVID-19 pandemic, with variable proportions of COVID-19 and elective surgery patients across sites.

    “The types of patients admitted to the critical care units (and their corresponding prognoses) may have changed substantially after the start of the COVID-19 pandemic, with variable proportions of COVID-19 and elective surgery patients across sites.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [21] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Terrorism in the region inhibited access to some areas, affecting outcome assessments and access to the laboratory.

    “Terrorism in the region inhibited access to some areas, affecting outcome assessments and access to the laboratory.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [22] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    These are important modifications because the change in standards of care could have effects on the study's ability to address its objectives, analytical methods, and statistical power.

    “These are important modifications because the change in standards of care could have effects on the study's ability to address its objectives, analytical methods, and statistical power.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Previously unanticipated analyses can be conducted in a planned manner by documenting the intended analysis in the protocol and determining a priori how those analyses will inform modifications.

    “These previously unanticipated analyses can be conducted in a planned manner by documenting the intended analysis in the protocol and determining how those analyses will inform modifications a priori.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The COVID-19 pandemic delayed implementation of the intervention at some sites due to clinical workload, pandemic preparedness activities, and infection control precautions, but the trial was ultimately completed.

    “The COVID-19 pandemic delayed implementation of the intervention at some sites due to clinical workload, pandemic preparedness activities, and infection control precautions, but the trial was ultimately completed.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [21] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In a multicenter stepped-wedge cluster randomized pragmatic trial, regional government enacted a policy change partway through the rollout that mandated widespread use of a modified version of the experimental intervention as the new standard of care.

    “In a multicenter stepped-wedge cluster randomized pragmatic trial, regional government enacted a policy change partway through the rollout that mandated widespread use of a modified version of the experimental intervention as the new standard of care.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductnone given

    The CONSERVE development process adapted the conventional Delphi process and incorporated several steps to solicit detailed feedback and achieve consensus with a large group of trial professionals and public representatives who refined the process, substituting virtual meetings for in-person discussions to ensure that dissenting views could be addressed.

    “Unlike prior reporting guidelines, this process adapted the conventional Delphi process and incorporated several steps to solicit detailed feedback and achieve consensus with a large group of trial professionals and public representatives who refined the process, but substituted in-person discussions with virtual meetings to ensure that dissenting views could be addressed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    By supporting transparency, CONSERVE may also promote public trust in science when studies encounter unanticipated circumstances.

    “By supporting transparency, CONSERVE may also promote public trust in science when studies encounter unanticipated circumstances.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [38] source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductown data

    The global survey sought to capture a large, international body of interdisciplinary persons working on and with trials, and those respondents provided examples and feedback about how CONSERVE could be used.

    “Third, the global survey sought to capture a large, international body of interdisciplinary persons working on and with trials, and those respondents provided examples and feedback about how CONSERVE could be used.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Consistent reporting of trials that encounter extenuating circumstances could prompt trialists to develop plans for a wider range of potential disruptions in trial protocols.

    “Consistent reporting of trials that encounter extenuating circumstances could also prompt trialists to develop plans for a wider range of potential disruptions in trial protocols.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The EMA guidance outlined the importance of describing specific dates and durations of issues external to the trial and discussed when data review may be warranted to inform study decisions.

    “The EMA guidance outlined the importance of describing specific dates and durations of issues external to the trial (eg, lockdowns and travel restrictions) and discussed when data review may be warranted to inform study decisions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [8] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Clinical and research specialty societies have provided guidance on conducting trials during the pandemic, including in oncology, cardiovascular disease and heart failure, and hepatology.

    “Clinical and research specialty societies have also provided guidance on conducting trials during the pandemic, including in oncology, cardiovascular disease and heart failure, and hepatology.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [46]

      Not checked in the free run.

    • cites [47]

      Not checked in the free run.

    • cites [48]

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Other reports have provided analyses on the management of missing data in trials due to COVID-19, the ethical dimensions of conducting trials during public health emergencies, and the challenges of trial sponsorship during a pandemic.

    “Other reports have provided analyses on the management of missing data in trials due to COVID-19, 41 ethical dimensions of conducting trials during public health emergencies, 33,42,43 and the challenges of trial sponsorship during a pandemic.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [41] source

      Not checked in the free run.

    • cites [33] source

      Not checked in the free run.

    • cites [44]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Despite its international representation, including respondents from low- and middle-income countries, CONSERVE may not have captured all relevant perspectives.

    “Despite its international representation, including respondents from low-and middle-income countries, CONSERVE may not have captured all relevant perspectives.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    CONSERVE complements regulatory guidance on modifying trials in the context of the COVID-19 pandemic.

    “CONSERVE complements regulatory guidance on modifying trials in the context of the COVID-19 pandemic.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Drs Orkin and Gill had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

    “Author Contributions: Drs Orkin and Gill had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Guidance from the FDA also addressed statistical methodology as it relates to meeting trial objectives during the pandemic.

    “Guidance from the FDA also addressed statistical methodology as it relates to meeting trial objectives during the pandemic.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [40] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The UK Medicines and Healthcare Products Regulatory Agency set guidance for trial investigators to assess the risks and benefits of ongoing trials during COVID-19 and to consider options including halting recruitment, adapting delivery processes, stopping or suspending the trial, or mitigating risks as the trial proceeds.

    “For example, the UK Medicines and Healthcare Products Regulatory Agency set guidance for trial investigators to assess the risks and benefits of ongoing trials during COVID-19 and to consider options including halting recruitment, adapting delivery processes, stopping or suspending the trial, or mitigating risks as the trial proceeds.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [39] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Editorials have called on trial authors to describe pandemic-related issues in the methods sections of articles, including changes in study protocol, trial delays or interruptions, issues with missing data, and effects on statistical power.

    “Editorials have called on trial authors to describe pandemic-related issues in the methods sections of articles, including changes in study protocol, trial delays or interruptions, issues with missing data, and effects on statistical power.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [51]

      Not checked in the free run.

    • cites [52] source

      Not checked in the free run.

    • cites [53]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The Norwegian Medicines Agency and the South African Health Products Regulatory Authority made similar recommendations, while the European Medicines Agency provided guidance on the methodological aspects of ongoing clinical trials.

    “Similar recommendations were made by the Norwegian Medicines Agency and the South African Health Products Regulatory Authority, while the European Medicines Agency (EMA) provided guidance on the methodological aspects of ongoing clinical trials.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [6] source

      Not checked in the free run.

    • cites [7] source

      Not checked in the free run.

    • cites [8] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    CONSERVE was developed rapidly using a modified process to engage rapidly with a global community of trial investigators, methodologists, ethicists, funders, regulators, journal editors, and patient representatives.

    “First, CONSERVE was developed rapidly using a modified process to engage rapidly with a global community of trial investigators, methodologists, ethicists, funders, regulators, journal editors, and patient representatives.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    These existing resources provide methodological guidance, while CONSERVE delivers a framework for reporting what decisions were made, why they were made, and the corresponding impact.

    “These resources provide methodological guidance, while CONSERVE delivers a framework for reporting what decisions were made, why they were made, and the corresponding impact.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Guidance from the FDA on trials during the COVID-19 pandemic recommended that trialists describe the contingency measures implemented, list how and which participants were affected including how participation was altered, and provide analyses and discussions that address the effect on safety and efficacy.

    “Guidance from the FDA on trials during the COVID-19 pandemic recommended that trialists describe the contingency measures implemented, list how and which participants were affected including how participation was altered, and provide analyses and discussions that address the effect on safety and efficacy.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [5] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The supporting organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or decision to submit the manuscript for publication.

    “Role of the Funder/Sponsor: The supporting organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or decision to submit the manuscript for publication.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    Because many ongoing trials affected by the pandemic have not yet been published, only a few reports have described how investigators have responded to the extenuating circumstances, limiting the examples available about COVID-19.

    “Second, given that many ongoing trials affected by the pandemic have not yet been published, only a few reports have described how investigators have responded to the extenuating circumstances, limiting the examples available about COVID-19.”
    Quote in the paperSubstantial claim
87 of 87
  • The paper relies on this without support.

    Reporting guidelines can improve the completeness and transparency of research reports by defining a minimum set of items to address.

    “Reporting guidelines can improve the completeness and transparency of research reports by defining a minimum set of items to address.”
  • The paper relies on this without support.

    Numerous trials that were underway prior to the COVID-19 pandemic faced unavoidable modifications in response to the pandemic.

    “Numerous trials that were underway prior to the COVID-19 pandemic faced unavoidable modifications in response to the pandemic, such as changes to methods of recruitment, intervention delivery, outcome assessment (eg, substituting virtual visits for in-person ones), statistical analysis, and sometimes study design.”
  • The paper relies on this without support.

    Forethought and diligence in trial design, statistical approaches, implementation, and analysis are necessary to minimize trial modifications after participant enrollment, which can introduce methodological, ethical, feasibility, and analytical challenges.

    “Forethought and diligence in trial design, statistical approaches, implementation, and analysis are necessary to minimize trial modifications after participant enrollment, which can introduce methodological, ethical, feasibility, and analytical challenges.”
  • The paper relies on this without support.

    Circumstances that are extenuating for one trial may not be extenuating for another.

    “Circumstances that are extenuating for one trial may not be extenuating for another.”
  • The paper relies on this without support.

    Many trials undergo amendments for a range of pragmatic and administrative reasons that do not necessarily constitute important modifications.

    “Many trials undergo amendments for a range of pragmatic and administrative reasons that do not necessarily constitute important modifications, for example, adding a recruitment site to an existing multicenter trial without modifying the study in any other way.”
  • The paper relies on this without support.

    Extenuating circumstances can potentially lead to modifications in any aspect of a trial.

    “Because extenuating circumstances can potentially lead to modifications in any aspect of a trial, the CONSERVE checklists incorporate a list of all items from the SPIRIT and CONSORT statements.”
6 of 6

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Stated development period ends before a review search update

    Minor

    The abstract places the guideline-development process, including the rapid review, between June 2020 and February 2021. The methods say its gray literature searches were updated on March 10, 2021.

1 of 1

The citation lists haven’t been fetched yet

References 48 · Cited by 299

Research works printed but not linked: 1

  1. Rusen, 2020, Challenges in tuberculosis clinical trials in the face of the COVID-19 pandemic., Trop Med Infect Dis, 5

Authors
Orkin, A. M., Gill, P. J., Ghersi, D., Campbell, L., Sugarman, J., Emsley, R., Steg, P. G., Weijer, C., Simes, J., Rombey, T., Williams, H. C., Wittes, J., Moher, D., Richards, D. P., Kasamon, Y., Getz, K., Hopewell, S., Dickersin, K., Wu, T., Ayala, A. P., Schulz, K. F., Calleja, S., Boutron, I., Ross, J. S., Golub, R. M., Khan, K. M., Mulrow, C., Siegfried, N., Heber, J., Lee, N., Kearney, P. R., Wanyenze, R. K., Hróbjartsson, A., Williams, R., Bhandari, N., Jüni, P., Chan, A.-W., CONSERVE Group, Orkin, A. M., Gill, P. J., Ghersi, D., Campbell, L., Sugarman, J., Emsley, R., Steg, P. G., Weijer, C., Simes, J., Rombey, T., Williams, H. C., Wittes, J., Moher, D., Richards, D. P., Kasamon, Y., Getz, K., Hopewell, S., Dickersin, K., Wu, T., Ayala, A. P., Schulz, K. F., Calleja, S., Boutron, I., Ross, J. S., Golub, R. M., Khan, K. M., Mulrow, C., Siegfried, N., Heber, J., Lee, N., Kearney, P. R., Wanyenze, R. K., Hróbjartsson, A., Williams, R., Bhandari, N., Jüni, P., Chan, A.-W., Kiermer, V., Corrigan-Curay, J., & Concato, J.
Affiliations
for the CONSERVE Group
Venue
JAMA
Published
2021-07-20
Volume
326
Issue
3
Pages
257
ISSN
  • 0002-9955 (ISSN-L)
  • 0098-7484
OpenAlex
W3173223243
Cited by
299
References
48
Citations by year
2026: 24 · 2025: 46 · 2024: 61 · 2023: 79 · 2022: 76 · 2021: 13
FWCI
33.23
Type
journal article
Language
en
Open access
Licence
cc-by-nc-nd
Locations
  • JAMA (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
  • HAL (submittedVersion)
  • Repository@Nottingham (University of Nottingham) (submittedVersion)
  • Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
  • University of Southern Denmark Research Portal (University of Southern Denmark) (submittedVersion)
  • The Sydney eScholarship Repository (The University of Sydney) (submittedVersion)
  • UNC Libraries
Funders
  • Amgen
  • Bristol-Myers Squibb
  • Eli Lilly and Company
  • Pfizer
  • AstraZeneca
  • Sanofi
  • Biogen
  • RTI International
  • Laura and John Arnold Foundation
  • Regeneron Pharmaceuticals
  • Merck KGaA
  • Amarin Corporation
  • Medicines Company
  • MyoKardia
  • National Institute for Health and Care Research (NIHR300051)
  • Department of Health and Social Care
  • Cancer Australia
  • South African Medical Research Council
  • University of Toronto
  • Novo Nordisk
  • Syddansk Universitet
  • Biosensors International Group
  • Servier
  • Idorsia Pharmaceuticals
  • National Institutes of Health (COVID-19)
  • Agency for Healthcare Research and Quality
  • Canadian Institutes of Health Research (COVID-19)
  • Medical Research Council (COVID-19)
  • National Health and Medical Research Council
  • Department of Medicine, University of Toronto
  • National Heart, Lung, and Blood Institute
  • U.S. National Library of Medicine
  • Institute of Musculoskeletal Health and Arthritis
  • Lawrence Berkeley National Laboratory
  • NIHR Academy
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
Keywords
mitigating circumstances, COVID-19 pandemic, reporting guidelines, conserves, CONSORT, alcoholic beverages, randomized controlled trials, clinical trial transparency, trial feasibility, stakeholder survey, checklist development, Delphi consensus, trial suspension
MeSH terms
COVID-19, Clinical Protocols, Delphi Technique, Humans, Publishing, Surveys and Questionnaires, Randomized Controlled Trials as Topic, Guidelines as Topic, Research Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review