Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Objectives: Designing studies with an internal pilot phase may optimise the use of pilot work to inform more efficient randomised controlled trials (RCTs). Careful selection of preagreed decision or ‘progression’ criteria at the juncture between the internal pilot and main trial phases provides a valuable opportunity to evaluate the likely success of the main trial and optimise its design or, if necessary, to make the decision not to proceed with the main trial. Guidance on the appropriate selection and application of progression criteria is, however, lacking. This paper outlines the key issues to consider in the optimal development and review of operational progression criteria for RCTs with an internal pilot phase. Design: A structured literature review and exploration of stakeholders' opinions at a Medical Research Council (MRC) Hubs for Trials Methodology Research workshop. Key stakeholders included triallists, methodologists, statisticians and funders. Results: There is considerable variation in the use of progression criteria for RCTs with an internal pilot phase, although 3 common issues predominate: trial recruitment, protocol adherence and outcome data. Detailed and systematic reporting around the decision-making process for stopping, amending or proceeding to a main trial is uncommon, which may hamper understanding in the research community about the appropriate and optimal use of RCTs with an internal pilot phase. 10 top tips for the development, use and reporting of progression criteria for internal pilot studies are presented. Conclusions: Systematic and transparent reporting of the design, results and evaluation of internal pilot trials in the literature should be encouraged in order to facilitate understanding in the research community and to inform future trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In effectiveness trials, power calculations and sample size decisions are primarily based on the detection of a clinically meaningful difference in measures of the effects of the intervention on the patient or public health outcomes such as behaviour, disease, symptomatology or functional outcomes [24].”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Feasibility and acceptability were operationalized a priori according to the following progression criteria thresholds: stop (benchmark: < 70%), adapt (> 70%- < 90%), and go (> 90%).”
From Yoga-Based Group Intervention for Inpatients with Schizophrenia Spectrum Disorders—Feasibility, Acceptability, and Preliminary Outcomes of a Rater-Blinded Randomized Controlled Trial. (2026) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These results give solid ground for the likely success of a following fully powered RCT investigating the intervention’s efficacy32 and align with previous findings on MBIs for SSD.22”
From Yoga-Based Group Intervention for Inpatients with Schizophrenia Spectrum Disorders—Feasibility, Acceptability, and Preliminary Outcomes of a Rater-Blinded Randomized Controlled Trial. (2026) · cites this paper as [32]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Thus, it aligns with the main aims and objectives of pilot and feasibility studies and with the progression stop-amend-go recommendations of Eldridge et al. [2] and Avery et al. [18].”
From Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“Avery et al. [18] published recommendations for internal pilots emphasising a traffic light (stop-amend-go/red-amber-green) approach to progression with focus on process assessment (recruitment, protocol adherence, follow-up) and transparent reporting around the choice of trial design and the decision-making processes for stopping, amending or proceeding to a main trial.”
From Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021) · cites this paper as [18]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
A tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Clinical Trials: A Practical Approach.
Hill, I. D., & Pocock, S. J. (1984) · Biometrics · doi:10.2307/2531186 · Cited by 2,930
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Design and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572 · cited 1×
“In addition, the assumption that pilot studies are less rigorous than main studies and are not designed to test the main trial hypothesis means that their findings are underdisseminated, thereby preventing triallists from accessing information that may be valuable to the success of future main trials.(3) 10 The system…”
BackgroundSelf-citationFundamentals of Clinical Trials
Friedman, L. M., Furberg, C. D., DeMets, D. L., Reboussin, D. M., & Granger, C. B. (2015) · doi:10.1007/978-3-319-18539-2 · Cited by 2,237
No surgical innovation without evaluation: the IDEAL recommendations
McCulloch, P., Altman, D. G., Campbell, W. B., Flum, D. R., Glasziou, P., Marshall, J. C., & Nicholl, J. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61116-8 · Cited by 1,820
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.010 · Cited by 1,658
Eldridge, S. M., Lancaster, G. A., Campbell, M. J., Thabane, L., Hopewell, S., Coleman, C. L., & Bond, C. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150205 · Cited by 1,581
Cited by
Items 201–300 of 577
Hahne, I., Zierhut, M., Bergmann, N., Hahn, E., Ta, T. M. T., Calvano, C., Bajbouj, M., & Böge, K. (2026) · Schizophrenia Bulletin · doi:10.1093/schbul/sbae198 · Cited by 4
Morris, R., Gallacher, K., Hann, M., Rolfe, C., Small, N., Giles, S. J., Sanders, C., & Campbell, S. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-039752 · Cited by 4
Forde, C. P., Costa, M. L., Cook, J. A., Tutton, E., Appelbe, D. E., Franssen, M., Barker, R., & Keene, D. J. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01349-4 · Cited by 4
“A traffic light system [17] for each outcome will inform decision-making about the feasibility of a full-scale RCT.”
MethodRandomized controlled trials in resuscitation
Drennan, I. R., McLeod, S. L., & Cheskes, S. (2024) · Resuscitation Plus · doi:10.1016/j.resplu.2024.100582 · Cited by 4
das Nair, R., Mhizha-Murira, J. R., Topcu, G., Tindall, T., Bale, C., Moghaddam, N. G., Scheffler, G., Drummond, A. E., Fitzsimmons, D. F., & Evangelou, N. (2024) · Clinical Rehabilitation · doi:10.1177/02692155241284781 · Cited by 6
“The Trial Management Group categorised the fi ndings based on guidance for progression criteria das Nair et al. to de fi nitive trials, 19 to arrive at Red-Amber-Green ratings for each key feasibility outcome.”
MethodBöge, K., Bergmann, N., Hahne, I., Emde, L., Cartner, S., Bell, I., Pillny, M., & Thomas, N. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100804 · Cited by 5
Halbeisen, G., Timmesfeld, N., & Paslakis, G. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-097886 · Cited by 4
McWilliams, D. J., Gustafson, O. D., Wyer, N., Couper, K., Kimani, P., Kandiyali, R., Barghouthy, D., Haylett, R., Richardson, H., Negus-Fancey, M., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-100803 · Cited by 5
“32 Verbatim anonymised transcripts of semistructured interviews will be thematically analysed.”
Wood, T. J., Parpia, S., Tate, I., Khalik, H. A., Muñoz-Mahamud, E., Tänzer, M., Hart, A., Albers, A., Hou, Q., Bhandari, M., et al. (2025) · JBJS Open Access · doi:10.2106/jbjs.oa.25.00150 · Cited by 5
“The primary outcomes of feasibility were determined by assessing participant enrollment, administration of the treatments, data collection methods, and protocol compliance using a well-reported traf fi c light approach 43 (Appendix A Table A3).”
Hewson, D. W., Nightingale, J., Ogollah, R. O., Brooks, A. J., Blackburn, L., Ollivere, B. J., Costa, M. L., Egan, T., Bates, P., Tyrrell-Marsh, I., et al. (2025) · BJA Open · doi:10.1016/j.bjao.2025.100498 · Cited by 4
Hitchman, L. H., Lathan, R., Ravindhran, B., Sidapra, M., Long, J. W., Cowling, A., Keding, A., Watson, J. M., Iglesias, C., Smith, G., et al. (2025) · International Wound Journal · doi:10.1111/iwj.70740 · Cited by 6
“The stop/go criteria used to judge deliverability were [24]: – Green: > 60% of eligible patients recruited, adherence to treatment arm and attendance to follow-up – Amber: 30%–60% of eligible patients recruited, adherence to treatment arm and attendance to follow-up – Red: 30% of eligible…”
McWilliams, D. J., Gustafson, O. D., Wyer, N., Couper, K., Kimani, P., Kandiyali, R., El-Banna, A., Barghouthy, D., Haylett, R., King, E., et al. (2026) · EClinicalMedicine · doi:10.1016/j.eclinm.2026.104000 · Cited by 4
“A traffic light ‘stop-amend-go’ system 26 was established a priori to guide decision-making for a definitive trial (See Supplementary Table S2).”
Keene, D. J., Srikesavan, C. S., Achten, J., Tutton, E., Dutton, S., Marian, I. R., Grant, R., Gould, J., Herbert, K., Athwal, A. K., et al. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01011-5 · Cited by 4
“Progression criteria to assess feasibility of a future definitive trial will be assessed using a traffic light system [10].”
MethodFraenkel, L., Pack, Q. R., Drager, L. R., Patel, J., Pontier, P., & Lindenauer, P. K. (2023) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2023.101147 · Cited by 5
Wade-Mcbane, K., King, A., Urch, C., Johansson, L., & Wells, M. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-072367 · Cited by 5
The Hand and Wrist: AntImicrobials and Infection (HAWAII) trial
Wormald, J. C. R., Rodrigues, J. N., Bheekharry, R., Riley, N. D., Tucker, S. C., Furniss, D., Dunlop, R. L. E., Jones, R. L., Applebe, D., Herbert, K., et al. (2023) · British journal of surgery · doi:10.1093/bjs/znad298 · Cited by 4
“In terms of progression to a full definitive trial, parameters for screening, recruitment and retention were set in the protocol stage 22,23 .”
Santos, G. C., Liljeroos, M., Tschann, K., Denhaerynck, K., Wicht, J., Jurgens, C. Y., Hullin, R., & Schäfer‐Keller, P. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01390-3 · Cited by 5
“Our results could be used to help define progression criteria thresholds with a traffic light approach guiding the decision to stop, amend, or proceed to the future effectiveness study [73].”
BackgroundFronza, G. P., Mitchell, L. K., Pachana, N. A., Byrne, G. J., Liddle, J., Yang, J., Brooks, D., Au, T. R., Pourzinal, D., Worthy, P., et al. (2024) · Clinical Gerontologist · doi:10.1080/07317115.2024.2336187 · Cited by 5
“Feasibility was assessed using a traffic light system, indicating (1) progression from feasibility into further evaluations, (2) adaptations required prior to further evaluations, or (3) termination if no adaptations are possible (Avery et al., 2017; Skivington et al., 2021).”
Gallagher, D., Spyreli, E., Anderson, A. S., Bridges, S., Cardwell, C. R., Coulman, E., Dombrowski, S. U., Free, C., Heaney, S., Hoddinott, P., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-084075 · Cited by 6
Taylor, C. D. J., Helliwell, B. J., Coleman, R., Sutton, C., Hutton, P., Sylvestre, Y., Bird, L., Shields, G., KELLY, J. A., Brandwood-Spencer, T., et al. (2025) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaf060 · Cited by 4
James, J., Selfe, J., & Goodwin, P. C. (2021) · Physiotherapy Practice and Research · doi:10.3233/ppr-210529 · Cited by 9
“…retention, a future study could also use an adapted RCT design whereby an internal pilot with clear progression rules are used to assess if the study should continue onto a main trial, thereby ensuring the research is robust and resources are not wasted [41].”
Nicolson, P. J. A., Holden, M. A., Marian, I. R., Williamson, E. M., Dutton, S., Garrett, A., Hopewell, S., & Lamb, S. E. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01275-5 · Cited by 4
“Progression criteria Progression criteria to assess feasibility of a future definitive trial will be assessed using a traffic light system for quantitative feasibility outcomes [47] (Table 3).”
MethodLiu, L., Brokenshire, B., Davies, D., & Harrison, J. (2024) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-024-01740-y · Cited by 5
“The criteria were developed based on research by Rankin et al. and Avery et al. [24, 25].”
Zlámal, J., Gjevjon, E. R., Fossum, M., Steindal, S. A., & Nes, A. A. G. (2021) · JMIR Research Protocols · doi:10.2196/31646 · Cited by 5
McDonough, S., Howes, S. C., Dillon, M., McAuley, J., Brady, J., Clarke, M., Clarke, M. J., Lait, E., McArdle, D., O’Neill, F. A., et al. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00938-5 · Cited by 4
“The traffic light system [46] will be used to guide progression to a main trial, as recommended in recent best practice, and will use the worst performing of the four elements in Table 1 to select which of the following actions to take:”
MethodAndersen, R. M., Skou, S. T., Clausen, M. B., Jäger, M., Zangger, G., Grøntved, A., Brønd, J. C., Soja, A. M. B., & Tang, L. H. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060157 · Cited by 4
Mellor, K., Dutton, S., & Hopewell, S. (2023) · Trials · doi:10.1186/s13063-022-06981-8 · Cited by 4
“This distinguishes them from internal pilot trials that are instead embedded within a definitive RCT often forming the first phase, where outcome data collected does contribute to the RCT analysis [2].”
BackgroundCarolino, N., Cunha, M., Pinto-Gouveia, J., Gameiro, S., & Galhardo, A. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-087447 · Cited by 3
Carney, R., Law, H., El-Metaal, H., Hann, M., Shields, G., Savage, S., Small, I., Jones, R., Shiers, D., Macafee, G., et al. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1457864 · Cited by 3
Gouveia, K., Sprague, S., Gallant, J. L., MacRae, S., Fabbro, G. D., Bzovsky, S., McKay, P., Johal, H. S., Busse, J. W., on behalf of the COPE Investigators, et al. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-024-01592-3 · Cited by 3
Wilkinson, J., Taylor, P. J., & Dunlop, B. J. (2025) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70117 · Cited by 4
de Luca, K. E., Yanz, M., Downie, A., Kendall, J. C., Skou, S. T., Hartvigsen, J., French, S. D., Ferreira, M. L., & Bierma‐Zeinstra, S. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01097-x · Cited by 3
Mellor, K., Harwood, J., Hejdenberg, J., Morgan, B. B., Dutton, S., & Hopewell, S. (2022) · Trials · doi:10.1186/s13063-022-06868-8 · Cited by 5
“The stop-amend-go format, which is recommended for progression criteria in RCTs with internal pilot phases [7], was less often used.”
BackgroundMethodNielsen, D., d’Apice, K., Cheung, R. W., Bryant, M., Heald, R., Storr, C., Tracey, L., Rashid, R., Dickerson, J., & Bowyer‐Crane, C. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01333-y · Cited by 3
Midgley, A. W., Levy, A. R., Rogers, S. N., Brooker, R. C., Bryant, V., Cherry, M. G., Lane, S., Nugent, M., Price, R., Schache, A. G., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0289911 · Cited by 5
“[71] for identifying the appropriateness of progression to an RCT:”
BackgroundSekome, K., Gómez-Olivé, F. X., Sherar, L. B., Esliger, D., & Myezwa, H. (2024) · Pilot and Feasibility Studies · doi:10.1186/s40814-024-01456-w · Cited by 4
Timms, L., RODD, H. D., Deery, C., Brocklehurst, P. R., & Marshman, Z. (2024) · Pilot and Feasibility Studies · doi:10.1186/s40814-024-01519-y · Cited by 5
“The sample size of the feasibility study must also allow estimations of other important parameters of uncertainty [24].”
BackgroundGeorg, A. K., Holl, J., Taubner, S., & Volkert, J. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-078548 · Cited by 3
Hynes, S. M., Dwyer, C. P., Alvarez‐Iglesias, A., Rogers, F., Joyce, R. A., Oglesby, M. H., Moses, A., Bane, E., Counihan, T. J., Charamba, B., et al. (2024) · Neurological Sciences · doi:10.1007/s10072-024-07757-5 · Cited by 5
“A traffic light system—green (go), amber (amend) and red (stop)—which allowed for modification was used [39], in consultation with the Trial Steering Committee (TSC).”
Coffey, T., Young, N., & Gillies, K. (2025) · Trials · doi:10.1186/s13063-025-08808-8 · Cited by 3
Prest, K., Harden, A., Barnicot, K., & Heys, M. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01619-3 · Cited by 6
“Table 3 summarises the outcome measures and data collection timing.”
Giuliani-Dewig, H. K., Gerstner, G. R., Register‐Mihalik, J. K., Blackburn, J. T., Padua, D. A., Staley, J. A., & Ryan, E. D. (2023) · Applied Ergonomics · doi:10.1016/j.apergo.2023.104212 · Cited by 3
Brighton, L. J., Evans, C., Farquhar, M. C., Bristowe, K., Kata, A., Higman, J., Ogden, M., Nolan, C. M., Yi, D., Gao, W., et al. (2024) · ERJ Open Research · doi:10.1183/23120541.00774-2023 · Cited by 4
“Decision to progress to a full trial was determined based on feasibility trial results meeting pre-defined criteria, assessed by the trial team alongside context provided by the qualitative data [35].”
Gopalakrishnan, L., Patil, S. R., Das, D., Paul, A., Sharma, P., Kachhwaha, A., Choudhary, U., & Diamond‐Smith, N. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01720-7 · Cited by 4
Li, G., Wu, D., Chen, X., Zeng, J., Li, Z., & Thabane, L. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00602-4 · Cited by 3
Examining the Usability of Workload Monitoring in Firefighter Recruits
Giuliani-Dewig, H. K., Gerstner, G. R., Mota, J. A., & Ryan, E. D. (2022) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000002592 · Cited by 3
“Thus, before examining the effectiveness of workloadmonitoring tomitigateMSK injuries in large prospective cohort studies, futurework is needed to determine if workload monitoring is a feasible strategy to monitor injury risk and health in tactical populations.(21,22) Therefore, the purpose of this study was to determ…”
BackgroundMichalopoulou, M., Jebb, S. A., Mackillop, L. H., Dyson, P. A., Hirst, J. E., Wire, A., & Astbury, N. M. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-060951 · Cited by 4
Lukachan, G. A., Chung, F. F., Yadollahi, A., Auckley, D. H., Eissa, M., Rahman, N., McCluskey, S., & Singh, M. (2022) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-022-02362-6 · Cited by 3
“We followed the progression criteria for reporting feasibility outcomes(27,28) using the traffic light approach.(29) The criteria included recruitment (accrual rate) and protocol adherence (i.”
MethodAinsworth, H. R., Marshman, Z., Whiteside, K., Sykes, D., Fairhurst, C. M., Turner, E., Chestnutt, I. G., Day, P. F., Dey, D., Elliott, L., et al. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01243-z · Cited by 3
Chiwanga, F. S., Woodford, J., Masika, G. M., Richards, D. A., Savi, V., & von Essén, L. (2023) · JMIR Research Protocols · doi:10.2196/48799 · Cited by 3
Langdon, P. E., Apanasionok, M. M., Scripps, E., Bunning, K., Filipczuk, M., Gillespie, D., Hastings, R. P., Jahoda, A. J., McNamara, R. L., Rai, D., et al. (2024) · Health Technology Assessment · doi:10.3310/mwtq5721 · Cited by 3
Lim, W. S., Meakin, G., Brittain, C., Bewick, T. A., & Duley, L. (2017) · Trials · doi:10.1186/s13063-017-2290-z · Cited by 3
“Increasingly, internal pilot studies form an integral part of large multicentre trials [6].”
BackgroundGallyer, V., Smith, T. O., Fordham, B., Dutton, S., Chester‐Jones, M., Lamb, S. E., & Winter, S. C. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-045741 · Cited by 4
Small numbers, big decisions: guidance for sample size in pilot trials
Lewis, M., Bromley, K., & Joseph, R. (2025) · BMJ · doi:10.1136/bmj.r1885 · Cited by 3
Tang, Y., Gierc, M., La, H., Liu, S., Lam, R. W., Puterman, E., & Faulkner, G. (2025) · PLOS One · doi:10.1371/journal.pone.0321958 · Cited by 2
Ryan, Á., Smith, S. M., Cummins, V., Murphy, C., & Galvin, R. (2022) · Journal of Multimorbidity and Comorbidity · doi:10.1177/26335565221142350 · Cited by 3
“We adapted criteria for progression as reported by Avery et al. 2017.32 Our criteria were based on the primary feasibility objectives and were divided into three categories: trial recruitment, protocol non-adherence and outcome data (See Table 3).32 Sample size and data analysis The main purpose of…”
MethodInfluentialKroese, B. S., Unwin, G., Hastings, R. P., Jahoda, A. J., McNamara, R. L., Gillespie, D., Segrott, J., Ingarfield, K., Gianatsi, M., Randell, E., et al. (2024) · Public Health Research · doi:10.3310/jtjy8001 · Cited by 3
Jones, J., Alexander, L., Hancock, E., & Cooper, K. (2025) · Journal of Parkinson s Disease · doi:10.1177/1877718x251324415 · Cited by 3
“Checklist were developed and mapped to these session plans allowing the researchers to assess intervention fi delity.”
Smith, T. O., Khoury, R., Welsh, A., Crowther, C., Hanson, S., Grant, K., Clark, A., Ashford, P., Hammond, M., Pond, M., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-095069 · Cited by 2
“18 A ‘traffic light’ system was used as a guide for progression to a definitive trial, 24 centred around recruitment, retention, intervention fidelity, contamination and data collection.”
Skog, R., Olsson, E. M. G., Gorman, J. R., Bober, S. L., Lampic, C., & Wettergren, L. (2025) · PLoS ONE · doi:10.1371/journal.pone.0322368 · Cited by 3
Rhodin, R., Eklund, R., Hagström, A. S., Dyregrov, A., & Sveen, J. (2025) · Death Studies · doi:10.1080/07481187.2025.2513980 · Cited by 4
“These incorporate a pilot phase into the first part of a randomized controlled trial (RCT) to assess the feasibility of progressing to the main trial (Avery et al., 2017; Bond et al., 2023).”
Ablewhite, J., Thomas, S., das Nair, R., Jones, F., Sprigg, N., Wharrad, H. J., & Drummond, A. E. (2025) · Clinical Rehabilitation · doi:10.1177/02692155251350084 · Cited by 2
“We used a feasibility traf fi c light system 28 : Red (stop) where A is not met; Amber (modify) where A is met AND either B OR C OR D reach at least 70%: and Green (proceed) where all criteria are met.”
Patterson, J. M., Cherry, M. G., Levy, A. R., Rogers, S. N., Brooker, R. C., Bryant, V. M., Lane, S., Nugent, M., Price, R., Schache, A. G., et al. (2025) · Frontiers in Oncology · doi:10.3389/fonc.2025.1525512 · Cited by 3
O’Donnell, R., Howell, R. M., Henderson, T., Sinclair, L., Mather, K., McMeekin, N., & Semple, S. E. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-107161 · Cited by 3
“40 We are using the red/amber/green traffic light system 41 to guide the decision on whether to progress to a definitive future trial using the criteria presented in table 1.”
Wells, H., Malik, K., Brasher, P. M. A., Bovill, E. S., Laeken, N. V., Warburton, R., Prabhakar, C., Li, X., & Isaac, K. V. (2025) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-025-03030-1 · Cited by 2
Nicolson, P. J. A., Holden, M. A., Marian, I. R., Saeedi, E., Williamson, E. M., Moylan, D., Stone, M., Hopewell, S., & Lamb, S. E. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-104813 · Cited by 2
“38 39 The EQ-5D health status scale is mapped onto the EQ- 5D-3L valuation set using the Crosswalk Index Value Calculator.”
McKay, S., Ng, C., Nicholas, J., Browne, V., Chinnery, G. L., Choi, I., Nation-Ingle, B., Allison, K., Perlow, E., Lamblin, M., et al. (2025) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2025.101578 · Cited by 2
“An internal pilot phase assessing feasibility will be conducted during the first three months of recruitment, using a Red-Amber-Green (RAG) rating system to evaluate key trial feasibility outcomes: recruitment, retention, and engagement [59].”
Massara, P., Spiegel-Feld, C., Hamilton, J. K., Maguire, J. L., Birken, C. S., Bandsma, R., & Comelli, E. M. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-057989 · Cited by 3
Wright, H., Walker-Clarke, A., Drummond, A. E., Kidd, L., Yeates, G., Williams, D., McWilliams, D. J., Clyne, W., Clark, C. C. T., Kimani, P., et al. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01421-z · Cited by 4
Green, Z., Mayberry, E., Ashton, J. J., Beattie, R. M., Evans, A., Wahid, A., & Edwards, M. O. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-078675 · Cited by 3
Broderick, M., Burridge, J. H., Demain, S. H., Johnson, L., Brereton, J., O’Shea, R., & Bentley, P. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-077121 · Cited by 2
Kohn, C., Turner, L., Yang, Z., Absoud, M., Casbard, A. C., Gomes, M., Grant, G., Hassiotis, A., Kennedy, E., Levitt, S., et al. (2024) · JMIR Research Protocols · doi:10.2196/54619 · Cited by 2
Towriss, C., Dafydd, C., & Edwards, M. O. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-087672 · Cited by 2
Mutedzi, B., Nkhoma, K. B., Langhaug, L. F., Hunt, J. L., & Harding, R. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01313-2 · Cited by 3
“Taken from our protocol, there is a paucity of guidance on setting progression criteria for feasibility and pilot trials [46].”
BackgroundGussmann, E., Lindner, C., Lucae, S., Falkai, P., Padberg, F., Egli, S., & Kopf‐Beck, J. (2023) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-023-01690-y · Cited by 3
“Following guidelines on evaluating pilot studies [46, 62], feasibility and acceptability criteria were benchmarked a priori with a traffic light system on recruitment, retention and attendance rate as well as patients’ overall treatment satisfaction: red (not feasible 60%), yellow (modify…”
BackgroundMethodEmotion Focused and Schema Therapy for Anorexia Nervosa: The SPEAKS Approach
Oldershaw, A., & Startup, H. M. (2024) · Springer eBooks · doi:10.1007/978-3-030-97416-9_105-1 · Cited by 2
Hamborg, T. G., Andersen, R. M., Skou, S. T., Clausen, M. B., Jäger, M., Zangger, G., Simonÿ, C., Grøntved, A., Brønd, J. C., Soja, A. M. B., et al. (2024) · Digital Health · doi:10.1177/20552076241239243 · Cited by 3
“…criteria in order to evaluate the feasibility of the study design, the intervention and its readiness to be tested in a subsequent RCT design were set using a GREEN (proceed to RCT), AMBER (amend when proceeding to RCT), or RED (issue must be solved before proceeding to RCT) system 48 (Table 1).”
MethodFivian, E., Parida, M., Fry, H. A. H., Mohanty, S., Padhan, S., Pradhan, R., Das, P., Odhiambo, G., Prost, A., Roopnaraine, T., et al. (2024) · PLOS Global Public Health · doi:10.1371/journal.pgph.0003206 · Cited by 2
van der Mei, I. A. F., Thomas, S., Shapland, S., Laslett, L. L., Taylor, B. V., Huglo, A., & Honan, C. A. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-079644 · Cited by 3
Alqurashi, N., Bell, S., Carley, S. D., Lecky, F. E., & Body, R. M. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-077191 · Cited by 3
Dennett, R., Thompson, T., Clyne, W., Straukiene, A., Davies-Cox, H., Hosking, J., Bones, K., & Elston, J. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-087020 · Cited by 2
Three-outcome designs for external pilot trials with progression criteria
Wilson, D. T., Hudson, E. M., & Brown, S. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02351-x · Cited by 2
Khatib, R., Glowacki, N., Guzman, I. A., Shields, M., Chase, J., & Gordon, M. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-024-01588-z · Cited by 3
Harris, S., Jordan, J., Wilkinson, A., & Seaton, P. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01649-x · Cited by 3
“The success of the feasibility study will be measured against the Red-Amber-Green (RAG) criteria [22] and aligned with feasibility outcomes.”
Narendorf, S. C., Munson, M. R., Khan, U., Brown, M., Gomez, G., Maria, D. S., Gilmer, T., Gattis, M. N., Hayward, P., & Herman, D. B. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01677-7 · Cited by 3
“These are presented in Table4 below in line with prior recommendations [77] to clearly delineate the key considerations that would indicate that the trial is not successful and procedures need to be reconsidered (STOP), criteria that would suggest the need to amend current procedures but proceed…”
Topcu, G., Smith, L., Mhizha-Murira, J. R., Goulden, N., Hoare, Z., Drummond, A. E., Fitzsimmons, D. F., Evangelou, N., Schmierer, K., Tallantyre, E. C., et al. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01073-5 · Cited by 5
“We will focus on the traffic light stop/review/go criteria [45, 46] to progress to the definitive trial, particularly on recruitment (go, average 12/month; review, average 6–11/month; stop, average ≤ 5/month) and retention (go, ≥ 80%; review, 50–79%; stop, ≤ 49%).”
BackgroundDennett, R., Thompson, T., Clyne, W., Straukiene, A., Davies-Cox, H., Hosking, J., Bones, K., Weight, O., & Elston, J. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059966 · Cited by 3
McWilliams, D. J., King, E., Nydahl, P., Darbyshire, J. L., Gallie, L., Barghouthy, D., Bassford, C. R., & Gustafson, O. D. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-066143 · Cited by 2
Schmidt, A., Bloch‐Nielsen, J. R., Kristensen, H. N., Hannibal, L., Jensen, S. H. J., Tang, L. H., & Rolving, N. (2024) · Health Science Reports · doi:10.1002/hsr2.1961 · Cited by 2
“25 Accordingly, green indicates proceeding as planned, amber suggests proceeding with amendments, and red signifies that issues must be addressed before moving forward or halting the process altogether (Table 2).”
BackgroundHall, A., Richmond, H., Bursey, K., Hansen, Z., Williamson, E. M., Copsey, B. J., Albury, C., Asghari, S., Curran, V. R., Pike, A. E., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-040834 · Cited by 5
Murthy, S. K., Marderfeld, L., Fergusson, D. A., Ramsay, T., Bernstein, C. N., Nguyen, G. C., Jairath, V., & Riddell, R. H. (2024) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01434-8 · Cited by 1
“If successful according to the proposed progression criteria for internal pilot studies [71], we will complete the full trial, from which the findings will inform clinical practice and will be used to update practice guidelines in this area.”
MethodGray, K. M., Apanasionok, M. M., Scripps, E., Bunning, K., Burke, C., Filipczuk, M., Hastings, R. P., Liew, A., McNamara, R. L., Nisar, A., et al. (2024) · Health Technology Assessment · doi:10.3310/lrwd7852 · Cited by 1
Yong, S. L., Ting, J. C. S., Wong, X.-S., WONG, G. H., & Kang, M. (2024) · Minerva Obstetrics and Gynecology · doi:10.23736/s2724-606x.24.05470-8 · Cited by 1
Reguenga, M. J. D. A., Lampridou, S., Pattison, N. A., Brett, S. J., & Soni, S. (2025) · PLoS ONE · doi:10.1371/journal.pone.0320935 · Cited by 1
“Upon the DaCSi-ICU study completion, the study team will meet and reach a consensus on whether the study is: a) ready to proceed to an RCT; b) ready pending some actions/improvements; and c) not ready to proceed to an RCT [31].”
InfluentialAbbo, N., Mitchell, T., Tonekaboni, S. H., Anagnostou, E. A., Andrade, B. F., Thorpe, K. E., & Beal, D. S. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01650-4 · Cited by 2
Vlachodimitropoulou, E., Malinowski, A. K., Kaplovitch, E., Carrier, M., & Shehata, N. (2025) · Blood Vessels Thrombosis & Hemostasis · doi:10.1016/j.bvth.2025.100106 · Cited by 1
“21,22 Adherence to study medication was assessed via participant self-reporting during scheduled follow-up telephone sessions at 3 and 6 weeks postpartum.”
InfluentialMoore, S. A., Calder, J., & Potthoff, S. (2025) · Clinical Rehabilitation · doi:10.1177/02692155251382502 · Cited by 1
“To establish if the tailored implementation process and PARAS intervention were feasible, we applied the traf fi c light system described by Avery et al. 19 If only minor amendments to the implementation process (e.g., small amount extra time for delivery) and intervention (e.g., minor changes to enable intervention ta…”
Richardson, C., Chan, C., Macgregor, E., Hare, C., Hannon, B. L., Black, S., Schneider, E., Buchman, D. Z., Wang, S., Rac, V. E., et al. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01706-5 · Cited by 1
Rossen, C. B., Schmidt, A., Hansen, M. S., Wivelsted, A.-L. D., Vedsted, P., & Gregersen, M. (2025) · Aging Clinical and Experimental Research · doi:10.1007/s40520-025-03214-1 · Cited by 2
“Prehabilitation is a resource-intensive yet promising strategy for supporting frail surgical patients and requires organizational readiness and adaptations to local context [50].”
Adey‐Wakeling, Z., Block, H., Hutchins, S., Greene, L., van den Berg, M., Stewart, G., Liu, E., Shulver, W., Crotty, M., & Hillier, S. (2026) · Archives of Rehabilitation Research and Clinical Translation · doi:10.1016/j.arrct.2026.100587 · Cited by 1
Metadata
- Authors
- Avery, K. N. L., Williamson, P. R., Gamble, C., O'Connell Francischetto, E., Metcalfe, C., Davidson, P., Williams, H., & Blazeby, J. M.
- Affiliations
- University of Bristol (GB)
- University of Liverpool (GB)
- Medical Research Council ConDuCT-II Hub for Trials Methodology Research, School of Social and Community Medicine, University of Bristol, Bristol, UK
- National Institute for Health and Care Research (GB)
- Nottingham University Hospitals NHS Trust (GB)
- University Hospitals Bristol NHS Foundation Trust (GB)
- Corresponding author
- Avery, Kerry N L
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-02
- Volume
- 7
- Issue
- 2
- Pages
- e013537
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5318608
- OpenAlex
- W2588182016
- Semantic Scholar
- c03117980919b954181d0ea10371c6c6561bde41
- Cited by
- 575
- References
- 48
- Citations by year
- 2026: 83 · 2025: 100 · 2024: 90 · 2023: 83 · 2022: 69 · 2021: 67 · 2020: 49 · 2019: 20 · 2018: 13 · 2017: 1
- FWCI
- 15.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMJ Open (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Portal (Queen's University Belfast) (publishedVersion, cc-by)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- ResearchOnline (Glasgow Caledonian University) (acceptedVersion, other-oa)
- Keele Research Repository (Keele University) (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Stirling Online Research Repository (University of Stirling) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- Ulster University Research Portal (Ulster University) (submittedVersion, other-oa)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, other-oa)
- Explore Bristol Research (submittedVersion, cc-by)
- Funders
- National Institute for Health and Care Research (DRF-2011-04-016, NF-SI-0611-10020, DRF-2012-05-182)
- Medical Research Council (MR/K025635/1, MR/L004933/1, MR/K025643/1, MR/L004933/2)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- internal pilot study, progression criteria, randomized controlled trials, trial design, trial recruitment, protocol adherence, outcome data, trial reporting, stakeholder perspectives, trial efficiency
- MeSH terms
- Attitude, Clinical Protocols, Decision Making, Humans, Pilot Projects, Research Design, Research Personnel, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Patient Selection, Guideline Adherence, Clinical Trials Data Monitoring Committees, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.