CoChat

Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies

Open access

The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.

Abstract

Objectives: Designing studies with an internal pilot phase may optimise the use of pilot work to inform more efficient randomised controlled trials (RCTs). Careful selection of preagreed decision or ‘progression’ criteria at the juncture between the internal pilot and main trial phases provides a valuable opportunity to evaluate the likely success of the main trial and optimise its design or, if necessary, to make the decision not to proceed with the main trial. Guidance on the appropriate selection and application of progression criteria is, however, lacking. This paper outlines the key issues to consider in the optimal development and review of operational progression criteria for RCTs with an internal pilot phase. Design: A structured literature review and exploration of stakeholders' opinions at a Medical Research Council (MRC) Hubs for Trials Methodology Research workshop. Key stakeholders included triallists, methodologists, statisticians and funders. Results: There is considerable variation in the use of progression criteria for RCTs with an internal pilot phase, although 3 common issues predominate: trial recruitment, protocol adherence and outcome data. Detailed and systematic reporting around the decision-making process for stopping, amending or proceeding to a main trial is uncommon, which may hamper understanding in the research community about the appropriate and optimal use of RCTs with an internal pilot phase. 10 top tips for the development, use and reporting of progression criteria for internal pilot studies are presented. Conclusions: Systematic and transparent reporting of the design, results and evaluation of internal pilot trials in the literature should be encouraged in order to facilitate understanding in the research community and to inform future trials.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2016-013537

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 48 references

Cited by

See all 577

Metadata

Authors
Avery, K. N. L., Williamson, P. R., Gamble, C., O'Connell Francischetto, E., Metcalfe, C., Davidson, P., Williams, H., & Blazeby, J. M.
Affiliations
  • University of Bristol (GB)
  • University of Liverpool (GB)
  • Medical Research Council ConDuCT-II Hub for Trials Methodology Research, School of Social and Community Medicine, University of Bristol, Bristol, UK
  • National Institute for Health and Care Research (GB)
  • Nottingham University Hospitals NHS Trust (GB)
  • University Hospitals Bristol NHS Foundation Trust (GB)
Corresponding author
Avery, Kerry N L
Venue
BMJ Open
Publisher
BMJ
Published
2017-02
Volume
7
Issue
2
Pages
e013537
ISSN
2044-6055 (ISSN-L)
OpenAlex
W2588182016
Cited by
575
References
48
Citations by year
2026: 83 · 2025: 100 · 2024: 90 · 2023: 83 · 2022: 69 · 2021: 67 · 2020: 49 · 2019: 20 · 2018: 13 · 2017: 1
FWCI
15.85
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • BMJ Open (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Research Portal (Queen's University Belfast) (publishedVersion, cc-by)
  • White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
  • ResearchOnline (Glasgow Caledonian University) (acceptedVersion, other-oa)
  • Keele Research Repository (Keele University) (submittedVersion, cc-by)
  • Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
  • Stirling Online Research Repository (University of Stirling) (submittedVersion, cc-by)
  • UCL Discovery (University College London) (submittedVersion)
  • HighWire Press Open Archive (submittedVersion)
  • Ulster University Research Portal (Ulster University) (submittedVersion, other-oa)
  • University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
  • Queen Mary Research Online (Queen Mary University of London) (submittedVersion, other-oa)
  • Explore Bristol Research (submittedVersion, cc-by)
Funders
  • National Institute for Health and Care Research (DRF-2011-04-016, NF-SI-0611-10020, DRF-2012-05-182)
  • Medical Research Council (MR/K025635/1, MR/L004933/1, MR/K025643/1, MR/L004933/2)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords
internal pilot study, progression criteria, randomized controlled trials, trial design, trial recruitment, protocol adherence, outcome data, trial reporting, stakeholder perspectives, trial efficiency
MeSH terms
Attitude, Clinical Protocols, Decision Making, Humans, Pilot Projects, Research Design, Research Personnel, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Patient Selection, Guideline Adherence, Clinical Trials Data Monitoring Committees, Research Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies. https://app.cochat.ai/papers/10.1136/bmjopen-2016-013537
The paper
Avery, K. N. L., Williamson, P. R., Gamble, C., O'Connell Francischetto, E., Metcalfe, C., Davidson, P., Williams, H., & Blazeby, J. M. (2017). Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies. BMJ Open. https://doi.org/10.1136/bmjopen-2016-013537

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.