Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 145Statistical Methods in Clinical TrialsMeta-analysis and systematic reviewsHealth Policy Implementation Science

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index; 10 of the 14 sources its claims cite were checked for support.

Recommendations for progression criteria during external randomised pilot trial design, conduct, analysis and reporting

Open access

Abstract

Background: External randomised pilot trials aim to assess whether a future definitive Randomised Controlled Trial (RCT) is feasible. Prespecified progression criteria help guide the interpretation of pilot trial findings to decide whether, and how, a definitive RCT should be conducted. This commentary presents a set of proposed recommendations for progression criteria to guide researchers when (i) designing, (ii) conducting, (iii) analysing and (iv) reporting external randomised pilot trials. Methods: Recommendations were developed following a mixed methods approach. This involved (i) a methodological review of pilot trial publications, (ii) a cross-sectional study of pilot trial research funding applications, (iii) qualitative interviews with pilot trial researchers and (iv) a survey of corresponding authors of identified pilot trial publications. Initial recommendations were refined following two consultation stakeholder workshops held in July 2022. Recommendations for progression criteria for external randomised pilot trials: i. Design : consider progression criteria from the earliest opportunity; map progression criteria to feasibility objectives; consider quantitative and qualitative interpretations of feasibility; provide justification; develop guidelines rather than rules; seek input from relevant stakeholders. ii. Conduct : regularly monitor pilot trial data against progression criteria. iii. Analysis : avoid considering each progression criterion in isolation; engage in discussion with relevant stakeholders; consider context and other factors external to the pilot trial; consider feasibility (can we?) and progression (will we?). iv. Reporting : we propose a reporting checklist in relation to progression criteria and recommend reporting in a table format for clarity. Conclusion: These recommendations provide a helpful resource for researchers to consider progression criteria at different stages of external randomised pilot trials. We have produced a simple infographic tool to summarise these recommendations for researchers to refer to. Further research is needed to evaluate whether these proposed recommendations should inform future development, or update, of established guidelines for the design, conduct, analysis and reporting of external randomised pilot trials.

Overview

CoChat Summary

TL;DR

This commentary proposes recommendations for progression criteria across the design, conduct, analysis, and reporting of external randomised pilot trials, developed from four mixed-methods studies and stakeholder consultation. It offers practical guidance and a reporting checklist/table format, while calling for further evaluation before updating established guidelines.

Key findings

  • Recommendations span four stages: design (consider early, map to feasibility objectives, use quantitative and qualitative interpretations, justify criteria, treat as guidelines rather than rules, seek stakeholder input); conduct (regularly monitor data against criteria); analysis (avoid considering criteria in isolation, engage stakeholders, consider context, distinguish feasibility from progression); and reporting (use a proposed checklist and table format).
  • Development drew on four studies over three years (2019–2022): a methodological review of pilot trial publications, a cross-sectional study of NIHR Research for Patient Benefit funding applications, qualitative interviews, and a survey of corresponding authors.
  • Initial recommendations were refined after two external stakeholder workshops in July 2022; stakeholders included three trial investigators, four trial statisticians, six trial methodologists/health services researchers, one research funder manager, and one professor of primary care pharmacy.
  • The paper proposes a reporting checklist (Table 1) and recommends reporting progression criteria in a table format for clarity; an infographic tool was also produced.

Methods

  • Mixed methods approach with four distinct studies: (i) methodological review of external randomised pilot trial protocol and result publications (January 2018–December 2019); (ii) cross-sectional study of progression criteria in NIHR RfPB funding applications (funding decision July 2017–July 2019); (iii) qualitative interviews with pilot trial researchers/stakeholders (December 2020–July 2021); and (iv) survey of corresponding authors from study one (January–February 2022).
  • Findings were iteratively triangulated; the lead author drafted initial recommendations, which were refined by the wider study team and following feedback from two external stakeholder workshops in July 2022.
  • Stakeholder consultation included three trial investigators, four trial statisticians, six trial methodologists/health services researchers, one research funder manager, and one professor of primary care pharmacy.

Limitations

  • Stated: Further research is needed to evaluate whether the proposed recommendations should inform future development or update of established guidelines for the design, conduct, analysis, and reporting of external randomised pilot trials.
  • Stated: The recommendations were developed with external randomised pilot trials in mind, though they might also apply to non-randomised or single-arm pilot or feasibility studies.
  • Evident: The recommendations are proposed from triangulation of four studies and stakeholder workshops rather than a formal consensus or empirical evaluation of their implementation; no data are reported on whether adopting them improves feasibility assessment or reduces research waste.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s40814-023-01291-5

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Infographic to summarise recommendations for progression criteria
Fig. 1 Infographic to summarise recommendations for progression criteriaCC BY · PubMed Central
Fig. 2 Example progression criteria including both quantitative and qualitative data. Reproduced from Hynes et al (2022) Pilot Feasibility Stud 8:1–16, published CC-BY 4.0
Fig. 2 Example progression criteria including both quantitative and qualitative data. Reproduced from Hynes et al (2022) Pilot Feasibility Stud 8:1–16, published CC-BY 4.0CC BY · PubMed Central
Fig. 3 Example table to report progression criteria findings and implications for definitive RCT. Reproduced from Wiangkham et al (2019) PLoS One 14:e0215803, published CC-BY 4.0
Fig. 3 Example table to report progression criteria findings and implications for definitive RCT. Reproduced from Wiangkham et al (2019) PLoS One 14:e0215803, published CC-BY 4.0CC BY · PubMed Central

Verification

Claims the paper makes

7 Valid · 0 Not valid · 3 Not checked · 5 Own results and interpretations

1 reference still to check

A free account verifies the references that are still open.

Verify 1 reference — free account
  • Probably not a substantial claim. 11
  • The quote only partly states this claim. 2
  • It may state two separate claims as one. 1

Create a free account to see these claims.

Citations

Cites

Show all 37 references

Cited by

See all 145

Metadata

Authors
Mellor, K., Albury, C., Dutton, S. J., Eldridge, S., & Hopewell, S.
Affiliations
  • University of Oxford (GB)
  • University of London (GB)
Corresponding author
Mellor, Katie
Venue
Pilot and Feasibility Studies
Published
2023-04-15
Volume
9
Issue
1
Pages
59-59
ISSN
2055-5784 (ISSN-L)
OpenAlex
W4365814045
Cited by
145
References
37
Citations by year
2026: 70 · 2025: 54 · 2024: 16 · 2023: 5
FWCI
29.42
Type
journal article
Language
en
Open access
Licence
Locations
  • Pilot and Feasibility Studies (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Medical Research Foundation (MR/N013468/1)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Keywords
progression criteria, feasibility assessment, trial design, trial conduct, trial analysis, trial reporting, reporting checklist, stakeholder engagement, grant applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Recommendations for progression criteria during external randomised pilot trial design, conduct, analysis and reporting. https://app.cochat.ai/papers/10.1186/s40814-023-01291-5
The paper
Mellor, K., Albury, C., Dutton, S. J., Eldridge, S., & Hopewell, S. (2023). Recommendations for progression criteria during external randomised pilot trial design, conduct, analysis and reporting. Pilot and Feasibility Studies. https://doi.org/10.1186/s40814-023-01291-5

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.