Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Objectives: Designing studies with an internal pilot phase may optimise the use of pilot work to inform more efficient randomised controlled trials (RCTs). Careful selection of preagreed decision or ‘progression’ criteria at the juncture between the internal pilot and main trial phases provides a valuable opportunity to evaluate the likely success of the main trial and optimise its design or, if necessary, to make the decision not to proceed with the main trial. Guidance on the appropriate selection and application of progression criteria is, however, lacking. This paper outlines the key issues to consider in the optimal development and review of operational progression criteria for RCTs with an internal pilot phase. Design: A structured literature review and exploration of stakeholders' opinions at a Medical Research Council (MRC) Hubs for Trials Methodology Research workshop. Key stakeholders included triallists, methodologists, statisticians and funders. Results: There is considerable variation in the use of progression criteria for RCTs with an internal pilot phase, although 3 common issues predominate: trial recruitment, protocol adherence and outcome data. Detailed and systematic reporting around the decision-making process for stopping, amending or proceeding to a main trial is uncommon, which may hamper understanding in the research community about the appropriate and optimal use of RCTs with an internal pilot phase. 10 top tips for the development, use and reporting of progression criteria for internal pilot studies are presented. Conclusions: Systematic and transparent reporting of the design, results and evaluation of internal pilot trials in the literature should be encouraged in order to facilitate understanding in the research community and to inform future trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In effectiveness trials, power calculations and sample size decisions are primarily based on the detection of a clinically meaningful difference in measures of the effects of the intervention on the patient or public health outcomes such as behaviour, disease, symptomatology or functional outcomes [24].”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Feasibility and acceptability were operationalized a priori according to the following progression criteria thresholds: stop (benchmark: < 70%), adapt (> 70%- < 90%), and go (> 90%).”
From Yoga-Based Group Intervention for Inpatients with Schizophrenia Spectrum Disorders—Feasibility, Acceptability, and Preliminary Outcomes of a Rater-Blinded Randomized Controlled Trial. (2026) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These results give solid ground for the likely success of a following fully powered RCT investigating the intervention’s efficacy32 and align with previous findings on MBIs for SSD.22”
From Yoga-Based Group Intervention for Inpatients with Schizophrenia Spectrum Disorders—Feasibility, Acceptability, and Preliminary Outcomes of a Rater-Blinded Randomized Controlled Trial. (2026) · cites this paper as [32]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Thus, it aligns with the main aims and objectives of pilot and feasibility studies and with the progression stop-amend-go recommendations of Eldridge et al. [2] and Avery et al. [18].”
From Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“Avery et al. [18] published recommendations for internal pilots emphasising a traffic light (stop-amend-go/red-amber-green) approach to progression with focus on process assessment (recruitment, protocol adherence, follow-up) and transparent reporting around the choice of trial design and the decision-making processes for stopping, amending or proceeding to a main trial.”
From Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021) · cites this paper as [18]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
A tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Clinical Trials: A Practical Approach.
Hill, I. D., & Pocock, S. J. (1984) · Biometrics · doi:10.2307/2531186 · Cited by 2,930
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Design and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572 · cited 1×
“In addition, the assumption that pilot studies are less rigorous than main studies and are not designed to test the main trial hypothesis means that their findings are underdisseminated, thereby preventing triallists from accessing information that may be valuable to the success of future main trials.(3) 10 The system…”
BackgroundSelf-citationFundamentals of Clinical Trials
Friedman, L. M., Furberg, C. D., DeMets, D. L., Reboussin, D. M., & Granger, C. B. (2015) · doi:10.1007/978-3-319-18539-2 · Cited by 2,237
No surgical innovation without evaluation: the IDEAL recommendations
McCulloch, P., Altman, D. G., Campbell, W. B., Flum, D. R., Glasziou, P., Marshall, J. C., & Nicholl, J. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61116-8 · Cited by 1,820
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.010 · Cited by 1,658
Eldridge, S. M., Lancaster, G. A., Campbell, M. J., Thabane, L., Hopewell, S., Coleman, C. L., & Bond, C. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150205 · Cited by 1,581
Cited by
Global Vascular Guidelines on the management of chronic limb-threatening ischemia.
Conte, M. S., Bradbury, A. W., Kolh, P., White, J. V., Dick, F., Fitridge, R., Mills, J. L., Ricco, J.-B., Suresh, K. R., Murad, M. H., et al. (2019) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2019.02.016 · Cited by 2,015
Global vascular guidelines on the management of chronic limb-threatening ischemia
Conte, M. S., Bradbury, A. W., Kolh, P., White, J. V., Dick, F., Fitridge, R., Mills, J. L., Ricco, J.-B., Suresh, K. R., Murad, M. H., et al. (2019) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/j.ejvs.2019.05.006 · Cited by 1,582
Guidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00634-w · Cited by 475
Moore, G. F., Evans, R. E., Hawkins, J., Littlecott, H., Melendez-Torres, G. J., Bonell, C., & Murphy, S. (2019) · Evaluation · doi:10.1177/1356389018803219 · Cited by 471
“Movement toward pre-specifying objective progression criteria (Avery et al., 2017) perhaps reinforces this.”
BackgroundHaywood, K., Whitehead, L., Nadkarni, V. M., Achana, F., Beesems, S., Böttiger, B. W., Brooks, A., Castrén, M., Ong, M. E., Hazinski, M. F., et al. (2018) · Circulation · doi:10.1161/cir.0000000000000562 · Cited by 362
Lewis, M., Bromley, K., Sutton, C. J., McCray, G., Myers, H. L., & Lancaster, G. A. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00770-x · Cited by 330
Bell, M. L., Whitehead, A. L., & Julious, S. A. (2018) · Clinical Epidemiology · doi:10.2147/clep.s146397 · Cited by 280
“11,14 Target effect size and potential efficacy Hislop et al 15 undertook a systematic review to identify seven approaches for determining the target effect size for an RCT and classified them as clinically important and/or realistic.”
Haywood, K., Whitehead, L., Nadkarni, V. M., Achana, F., Beesems, S., Böttiger, B. W., Brooks, A., Castrén, M., Ong, M. E. H., Hazinski, M. F., et al. (2018) · Resuscitation · doi:10.1016/j.resuscitation.2018.03.022 · Cited by 227
Dimairo, M., Pallmann, P., Wason, J., Todd, S., Jaki, T., Julious, S. A., Mander, A. P., Weir, C. J., Koenig, F., Walton, M. K., et al. (2020) · BMJ · doi:10.1136/bmj.m115 · Cited by 149
Totton, N., Lin, J., Julious, S. A., Chowdhury, M., & Brand, A. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01416-w · Cited by 168
Mellor, K., Albury, C., Dutton, S. J., Eldridge, S., & Hopewell, S. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01291-5 · Cited by 145
“a ‘rescue plan’ that outlines any problems encountered and how they were addressed [26].”
BackgroundMethodInfluentialKohrt, B. A., Jordans, M. J. D., Turner, E. L., Sikkema, K. J., Luitel, N. P., Rai, S., Singla, D. R., Lamichhane, J., Lund, C., & Patel, V. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0234-3 · Cited by 141
“If significant modifications are needed, we will consider the need for an internal pilot in the context of the full trial [97].”
BackgroundMethodIncorporating feasibility protocols in intervention research
Gadke, D. L., Kratochwill, T. R., & Gettinger, M. (2021) · Journal of School Psychology · doi:10.1016/j.jsp.2020.11.004 · Cited by 132
Pilot and feasibility studies: extending the conceptual framework
Bond, C. M., Lancaster, G., Campbell, M., Chan, C. L., Eddy, S., Hopewell, S., Mellor, K., Thabane, L., & Eldridge, S. M. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01233-1 · Cited by 149
Cheskes, S., Dorian, P., Feldman, M., McLeod, S. L., Scales, D. C., Pinto, R. L., Turner, L., Morrison, L. J., Drennan, I. R., & Verbeek, P. R. (2020) · Resuscitation · doi:10.1016/j.resuscitation.2020.02.010 · Cited by 94
Herbert, E., Julious, S. A., & Goodacre, S. (2019) · Trials · doi:10.1186/s13063-019-3578-y · Cited by 81
Martin-McGill, K., Marson, A., Smith, C. T., Young, B., Mills, S., Cherry, M., & Jenkinson, M. (2020) · Journal of Neuro-Oncology · doi:10.1007/s11060-020-03417-8 · Cited by 64
Sample size justification in feasibility studies: moving beyond published guidance
Montgomery, R. N. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01675-9 · Cited by 88
Cooper, C. L., Whitehead, A., Pottrill, E., Julious, S. A., & Walters, S. J. (2018) · Clinical Trials · doi:10.1177/1740774517752113 · Cited by 59
“Avery suggests that rather than employing dichotomous stop/go criteria, investigators should consider a traffic light red/ amber/green system which identifies the level of risk to proceeding.(21) In addition, data from the internal pilot are used in the main analysis which is not the case for external pilots and is th…”
BackgroundDimairo, M., Pallmann, P., Wason, J., Todd, S., Jaki, T., Julious, S. A., Mander, A. P., Weir, C. J., Koenig, F., Walton, M. K., et al. (2020) · Trials · doi:10.1186/s13063-020-04334-x · Cited by 58
Mbuagbaw, L., Kosa, S. D., Lawson, D. O., Stalteri, R., Olaiya, O. R., Alotaibi, A., & Thabane, L. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0500-z · Cited by 57
Determining sample size for pilot trials: a tutorial
Ying, X., Freedland, K. E., Powell, L. H., Stuart, E. A., Ehrhardt, S., & Mayo‐Wilson, E. (2025) · BMJ · doi:10.1136/bmj-2024-083405 · Cited by 76
Mellor, K., Eddy, S., Peckham, N., Bond, C. M., Campbell, M. J., Lancaster, G., Thabane, L., Eldridge, S. M., Dutton, S., & Hopewell, S. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-048178 · Cited by 53
Young, H. M. L., Goodliffe, S., Madhani, M., Phelps, K., Regen, E., Locke, A., Burton, J. O., Singh, S., Smith, A., & Conroy, S. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16193756 · Cited by 59
“A systematic process for the application of these progression criteria following the completion of a feasibility study has been outlined [1], but a recent review by Hallingberg et al [7] highlighted a lack of guidance on how to devise specific a priori progression criteria [7,9].”
BackgroundMethodInfluentialBöge, K., Hahne, I., Bergmann, N., Wingenfeld, K., Zierhut, M., Thomas, N., Ta, T. M. T., Bajbouj, M., & Hahn, E. (2021) · Schizophrenia Research · doi:10.1016/j.schres.2020.12.008 · Cited by 44
PETERS, E. R., Hardy, A., Dudley, R. E. J., Varese, F., Greenwood, K., Steel, C., Emsley, R., Keen, N., Bowe, S. E., Swan, S., et al. (2022) · Trials · doi:10.1186/s13063-022-06215-x · Cited by 57
A systematic survey of randomised trials that stopped early for reasons of futility
Walter, S. D., Han, H., Guyatt, G. H., Bassler, D., Bhatnagar, N., Gloy, V., Schandelmaier, S., & Briel, M. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-0899-1 · Cited by 42
Edbrooke-Childs, J., Edridge, C., Averill, P., Delane, L., Hollis, C., Craven, M. P., Martin, K., Feltham, A., Jeremy, G., Deighton, J., et al. (2019) · JMIR mHealth and uHealth · doi:10.2196/11677 · Cited by 39
“In line with guidelines on conducting feasibility trials [36], the Trial Steering Committee developed Go and No Go criteria to determine whether or not the findings from this study indicated that it would be feasible to examine the effectiveness of Power Up in a full trial.”
MethodLin, C., Evans, C., Koffman, J., Chen, P., Hou, M., & Harding, R. (2020) · Palliative Medicine · doi:10.1177/0269216320902666 · Cited by 40
Evaluation of randomized controlled trials: a primer and tutorial for mental health researchers
Harrer, M., Cuijpers, P. J., Schuurmans, L., Kaiser, T., Buntrock, C., van Straten, A., & Ebert, D. D. (2023) · Trials · doi:10.1186/s13063-023-07596-3 · Cited by 48
“These feasibility objectives can also serve as progression criteria to determine if a confirmatory trial can safely be rolled out [92].”
BackgroundCarswell, C., Reid, J., Walsh, I., McAneney, H., & Noble, H. R. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0389-y · Cited by 40
A Review of Clinical Trials With an Adaptive Design and Health Economic Analysis
Flight, L., Arshad, F., Barnsley, R., Patel, K., Julious, S. A., Brennan, A., & Todd, S. (2019) · Value in Health · doi:10.1016/j.jval.2018.11.008 · Cited by 38
“There could also be an opportunity to re-estimate the sample size.(16)”
BackgroundYoung, H. M. L., March, D. S., HIGHTON, P. J., Graham-Brown, M. P. M., Churchward, D. R., Grantham, C. E., Goodliffe, S., Jones, W., Cheung, M.-M., Greenwood, S. A., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-041227 · Cited by 35
Nixon, A. C., Bampouras, T. M., Gooch, H. J., Young, H. M. L., Finlayson, K. W., Pendleton, N., Mitra, S., Brady, M. E., & Dhaygude, A. P. (2021) · PLoS ONE · doi:10.1371/journal.pone.0251652 · Cited by 38
“Progression criteria are recommended for pilot trials to assess whether there should be progression to a definitive RCT [28].”
BackgroundLiaghat, B., Skou, S. T., Jørgensen, U., Søndergaard, J., Søgaard, K., & Juul‐Kristensen, B. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00632-y · Cited by 35
“Reporting was conducted according to the CONSORT statement extension to randomised pilot and feasibility trials [23] (Additional file 1), with research progression criteria based on a traffic light system of green (continue without changes), amber (apply changes to improve study design) and red (no RCT unless major ch…”
BackgroundMethodVarese, F., Sellwood, W., Pulford, D., Awenat, Y. F., Bird, L., Bhutani, G., Carter, L., Davies, L. M., Aseem, S., Davis, C., et al. (2023) · Psychological Medicine · doi:10.1017/s0033291723002532 · Cited by 42
“These were operationalized a priori using a three-level ‘ traffic light ’ approach (Avery et al., 2017) with thresholds to indicate, for each outcome, whether a future larger-scale trial would be feasible using the current design ( ‘ green ’ ), whether the trial would be feasible if modifications…”
Bendig, E., Bauereiss, N., Schmitt, A., Albus, P., & Baumeister, H. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-049238 · Cited by 31
Potter, K.-J., Golijana-Moghaddam, N., Evangelou, N., Mhizha-Murira, J. R., & das Nair, R. (2021) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-020-09711-x · Cited by 30
Shah, A., Chester‐Jones, M., Dutton, S., Marian, I. R., Barber, V. S., Griffith, D. M., Singleton, J., Wray, K., James, T. J., Drakesmith, H., et al. (2021) · British Journal of Anaesthesia · doi:10.1016/j.bja.2021.11.010 · Cited by 31
Value of surgical pilot and feasibility study protocols
Fairhurst, K., Blazeby, J. M., Potter, S., Gamble, C. L., Rowlands, C., & AVERY, K. N. L. (2019) · British journal of surgery · doi:10.1002/bjs.11167 · Cited by 33
Self-citationPatterson, B., Barton, C. J., Culvenor, A. G., Cooper, R., & Crossley, K. M. (2021) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-020-03919-6 · Cited by 35
Abbott, A. D., Schröder, K., Enthoven, P., Nilsén, P., & Öberg, B. E. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019906 · Cited by 30
“32 33 One objective for an internal pilot is to confirm the HCP acceptability of the intervention and trial within the first cluster.”
BackgroundInfluentialFoged, F., Rasmussen, I. E., Budde, J. B., Rasmussen, R. S., Rasmussen, V., Lyngbæk, M. P. P., Jønck, S., Krogh‐Madsen, R., Lindegaard, B., Ried‐Larsen, M., et al. (2021) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2021-001156 · Cited by 30
“A 12-lead ECG was obtained after each HIIT session to assess whether there was evidence of arrhythmia or myocardial ischaemia.”
Longhini, J., Canzan, F., Zambiasi, P., Toccoli, S., Gios, L., Greco, M. D., Sforzin, S., Moz, M., Fracchetti, M., Saiani, L., et al. (2023) · Patient Preference and Adherence · doi:10.2147/ppa.s431865 · Cited by 25
Sangraula, M., van’t Hof, E., Luitel, N. P., Turner, E. L., Marahatta, K., Nakao, J. H., van Ommeren, M., Jordans, M. J. D., & Kohrt, B. A. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0315-3 · Cited by 25
“modifications are needed, we will consider the need for an internal pilot in the context of the full trial [42].”
BackgroundMoore, S. A., Avery, L., Price, C., & Flynn, D. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00603-3 · Cited by 27
Quinn, L., Playle, R., Drew, C. J. G., Taiyari, K., Williams‐Thomas, R., Muratori, L. M., Hamana, K., Griffin, B. A., Kelson, M. J., Schubert, R., et al. (2022) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2022.06.013 · Cited by 25
“Progression criteria [49] to proceed to further intervention evaluation were based on the following: over 60% drop-out from the RCT at 12 months (no progression), between 40 and 60% drop-out (changes to the intervention and/or follow-up procedures required) and less than 30% drop-out at 12 months…”
Master, H., Coronado, R. A., Whitaker, S., Block, S., Vanston, S. W., Pennings, J. S., Gupta, R., Robinette, P. E., Stephens, B. F., Abtahi, A. M., et al. (2023) · Physical Therapy · doi:10.1093/ptj/pzad096 · Cited by 28
Carswell, C., Reid, J., Walsh, I., Johnston, W. C., McAneney, H., Mullan, R. N., Lee, J. B., Nelson, H., Matthews, M., Weatherup, E., et al. (2020) · BMC Nephrology · doi:10.1186/s12882-020-02162-4 · Cited by 25
Joshi, V. L., Tang, L. H., Kim, Y. J., Wagner, M. K., Nielsen, J. F., Tjørnlund, M., & Zwisler, A. (2022) · Resuscitation · doi:10.1016/j.resuscitation.2022.02.002 · Cited by 26
Post stroke intervention trial in fatigue (POSITIF): Randomised multicentre feasibility trial
Mead, G. E., Gillespie, D. C., Barber, M., House, A. O., Lewis, S. C., Ensor, H., Wu, S., & Chalder, T. (2022) · Clinical Rehabilitation · doi:10.1177/02692155221113908 · Cited by 24
“Although we fell just short of our pre-specified progression criteria, randomised controlled trials often proceed to a main phase despite just missing one criterion.(26) We might have achieved 90% follow-up rates had the team been able to access the trials unit during Covid-19 lockdown.”
MethodO’Riordan, D. L., Rathfon, M. A., Joseph, D. M., Hawgood, J., Rabow, M. W., Dracup, K., Marco, T. D., & Pantilat, S. Z. (2019) · Journal of Palliative Medicine · doi:10.1089/jpm.2018.0633 · Cited by 24
Bind, R. H., Sawyer, K. M., Hazelgrove, K. M., Rebecchini, L., Miller, C., Ahmed, S., Dazzan, P., Sevdalis, N., Bakolis, I., Davis, R. E., et al. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01360-9 · Cited by 23
“This is consistent with findings in the initial in-person three-arm RCT of M4M, which found EPDS decreases by week 6 of intervention [24].”
BackgroundResultInfluentialZierhut, M. M., Bergmann, N., Hahne, I., Wohlthan, J., Kraft, J., Braun, A., Ta, T. M. T., Hellmann‐Regen, J., Ripke, S., Bajbouj, M., et al. (2024) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2024.01.014 · Cited by 24
Patton, D., Francis, J., Clark, E. V., Smith, F. J., Cadogan, C. A., Ryan, C. A., & Hughes, C. M. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0506-6 · Cited by 20
Brazil, K., Scott, D. A., Wallace, E., Clarke, M. J., Fahey, T. P., Gillespie, P. H., O’Halloran, P. D., Cardwell, C. R., Carter, G., McGlade, K. J., et al. (2020) · Trials · doi:10.1186/s13063-020-4100-2 · Cited by 24
Murphy, J., McSharry, J., Hynes, L., & Molloy, G. (2021) · JMIR Formative Research · doi:10.2196/28784 · Cited by 21
“Following guidance on conducting feasibility studies [39], the research team established Go/No Go progression criteria to determine if the findings of this study indicated that it would be feasible to examine the efficacy and effectiveness of AsthmaMD in a future randomized controlled trial.”
MethodJønsson, L. R., Foss, N. B., Orbæk, J., Lauritsen, M. L., Sejrsen, H. N., & Kristensen, M. T. (2023) · Canadian Journal of Surgery · doi:10.1503/cjs.008722 · Cited by 26
Group antenatal care: findings from a pilot randomised controlled trial of REACH Pregnancy Circles
Sawtell, M., Wiggins, M., Wiseman, O., Mehay, A., McCourt, C., Sweeney, L., Hatherall, B., Ahmed, T., Greenberg, L., Hunter, R. M., et al. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01238-w · Cited by 19
“Feasibility measures To address the primary objectives of this pilot trial, data were collected on a range of pre-specified feasibility measures to inform decisions about progression to a full trial [18] and future trial processes (see Table 2).”
MethodCassidy, S., Okwose, N. C., Scragg, J. H., Houghton, D., Ashley, K., Trenell, M. I., Jakovljević, D. G., Hallsworth, K., & Avery, L. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0519-1 · Cited by 24
“A decision to proceed to a larger scale evaluation will be based on recruitment, retention, outcome data generated (amount of data obtained and the outcome of the data obtained), intervention acceptability and feasibility, and fidelity of delivery [25].”
BackgroundDaley, A., Griffin, R. A., Sanders, J. P., Gokal, K., Ives, N. J., Skrybant, M., Parretti, H. M., Edwardson, C. L., Biddle, S., Jolly, K. B., et al. (2025) · International Journal of Behavioral Medicine · doi:10.1007/s12529-025-10352-3 · Cited by 22
“…context of a traffic light system to indicate if the trial should proceed to an effectiveness trial; stop/red; intractable issues that cannot be remedied; amend/amber: remediable issues, proceeding with caution; and continue/green: no concerning issues that threaten the success of the trial [37].”
Skou, S. T., Brødsgaard, R. H., Nyberg, M., Dideriksen, M., Bødtger, U. C. S., Bricca, A., & Jäger, M. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01242-0 · Cited by 21
“Feasibility outcomes The predefined progression criteria of the feasibility study followed a red/amber/green traffic light system, which is preferred instead of a simple stop/go basis [40].”
MethodYoung, H. M. L., Castle, E. M., Briggs, J., Walklin, C., Billany, R. E., Asgari, E., Bhandari, S., BISHOP, N. C., Bramham, K., Burton, J. O., et al. (2024) · Scientific Reports · doi:10.1038/s41598-023-50507-4 · Cited by 21
“Results falling between these thresholds indicated that adaptations may render the definitive trial viable 38 .”
BackgroundMethodRowland, M. J., Veenith, T., Scomparin, C., Wilson, M., Hutchinson, P. J., Kolias, A. G., Lall, R., Regan, S. E., Mason, J. M., Andrews, P., et al. (2020) · Journal of the Intensive Care Society · doi:10.1177/1751143720901690 · Cited by 18
Huang, Y., Dong, S., Zhang, Y., Zhang, Y., Guo, Y., Shi, J., Li, X., Liu, S., Chen, Y., & Yu, J. (2025) · International Immunopharmacology · doi:10.1016/j.intimp.2024.113941 · Cited by 19
On behalf of the PolyPrime team, Rankin, A., Cadogan, C. A., Barry, H. E., Gardner, E., Agus, A. M., Molloy, G. J., Gorman, A., Ryan, C. A., Leathem, C. S., et al. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00822-2 · Cited by 17
Thiblin, E., Woodford, J., Reuther, C., Lundgren, J., Lutvica, N., & von Essén, L. (2022) · Cancer Medicine · doi:10.1002/cam4.5377 · Cited by 18
“64 A 6-month follow-up time-point was selected to examine the feasibility of longer-term data collection.”
BackgroundHusbands, S., Caskey, F. J., Winton, H. L., Gibson, A., Donovan, J., & Rooshenas, L. (2019) · Trials · doi:10.1186/s13063-019-3281-z · Cited by 18
Patton, D., Pearce, C. J., Cartwright, M., Smith, F. J., Cadogan, C. A., Ryan, C. A., Clark, E. V., Francis, J., & Hughes, C. M. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00762-3 · Cited by 17
Rowbottom, B., Galhardo, A., Donovan, E., & Gameiro, S. (2022) · Human Reproduction · doi:10.1093/humrep/deac168 · Cited by 16
“The hypotheses for this study were operationalized using traffic-light progression criteria for each feasibility outcome (Avery et al. , 2017), presented in Supplementary Table SII.”
Coulman, E., Gore, N. J., Moody, G., Wright, M., Segrott, J., Gillespie, D., Petrou, S., Lugg-Widger, F. V., Kim, S. W., Bradshaw, J., et al. (2022) · Public Health Research · doi:10.3310/heyy3556 · Cited by 17
Rapolthy‐Beck, A., Fleming, J., Turpin, M. J., Sosnowski, K., Dullaway, S., & White, H. T. (2023) · American Journal of Occupational Therapy · doi:10.5014/ajot.2023.050230 · Cited by 19
Tan, B. Y., Ding, B. T. K., Pereira, M. J., Skou, S. T., Thumboo, J., & Car, J. (2020) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-020-03611-9 · Cited by 17
McCue, P., Din, S. D., Hunter, H., Lord, S., Price, C., Shaw, L. C., Rodgers, H., Rochester, L., & Moore, S. A. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00605-1 · Cited by 15
Nicolson, G., Hayes, C. B., & Darker, C. D. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18179292 · Cited by 16
“[67] advocate that assessment of rates of completeness of outcome data is useful and important.”
BackgroundSeah, B., Espnes, G. A., Hong, W. T., & Wang, W. (2022) · BMC Geriatrics · doi:10.1186/s12877-022-03605-3 · Cited by 18
“Outcomes for feasibility criteria To establish trial viability and determine if changes in operation of main trial would be required, progression criteria on recruitment, intervention adherence and outcome data was set [47].”
BackgroundEdlmann, E., Thelin, E. P., Caldwell, K., Turner, C. L., Whitfield, P. C., Bulters, D. O., Holton, P., Suttner, N. J., Agyemang, K., Al-Tamimi, Y., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-42087-z · Cited by 16
Nixon, A. C., Bampouras, T. M., Gooch, H. J., Young, H. M. L., Finlayson, K. W., Pendleton, N., Mitra, S., Brady, M. E., & Dhaygude, A. P. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035344 · Cited by 18
Drennan, I. R., Dorian, P., McLeod, S. L., Pinto, R. L., Scales, D. C., Turner, L., Feldman, M., Verbeek, P. R., Morrison, L. J., & Cheskes, S. (2020) · Trials · doi:10.1186/s13063-020-04904-z · Cited by 15
(2022) · doi:10.1186/s40814-022-01018-y · Cited by 15
“’s Top Ten Tips for guiding the decision to progress from a pilot to a definitive trial, focusing on key acceptability and feasibility variables [37].”
Lawson, D. O., Mellor, K., Eddy, S., Lee, C., Kim, K. H., Kim, K., Mbuagbaw, L. C. E., & Thabane, L. (2022) · PubMed · doi:10.1097/phm.0000000000001797 · Cited by 8
“Readers are referred to a review by Avery et al.(27) for additional considerations for internal pilot trials.”
MethodAmanvermez, Y., Karyotaki, E., Cuijpers, P. J., Čihařová, M., Donker, M. H., Hurks, P. P. M., Salemink, E., Spinhoven, P., Struijs, S. Y., & de Wit, L. M. (2023) · JMIR Formative Research · doi:10.2196/45725 · Cited by 16
“Some studies rely on progression criteria that have been set based on metrics of recruitment, adherence, and outcome data [72].”
Hansen, A. L., Højen, A. A., Lindegaard, S. F., Grove, E. L., Jakobsen, C., & Rolving, N. (2024) · Thrombosis Research · doi:10.1016/j.thromres.2024.109133 · Cited by 14
Dodgson, G., Aynsworth, C., Mitrenga, K. J., Gibbs, C., Patton, V., Fernyhough, C., Dudley, R. E. J., Ewels, C., Leach, L., Alderson‐Day, B., et al. (2020) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12323 · Cited by 17
Bryant, M., Collinson, M., Burton, W., Stamp, E., Schofield, H., Copsey, B. J., Hartley, S., Webb, E., & Farrin, A. J. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00798-z · Cited by 14
Murphy, M. E., McSharry, J., Byrne, M., Boland, F., Corrigan, D., Gillespie, P., Fahey, T. P., & Smith, S. M. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-032594 · Cited by 15
Dudley, R. E. J., Dodgson, G., Common, S., O’Grady, L., Watson, F., Gibbs, C., Arnott, B., Fernyhough, C., Alderson‐Day, B., Ogundimu, E. O., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061827 · Cited by 13
Fairclough, S. J., Clifford, L., Foweather, L., Knowles, Z. R., Boddy, L. M., Ashworth, E., & Tyler, R. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303033 · Cited by 13
Brighton, L. J., Evans, C., Farquhar, M. C., Bristowe, K., Kata, A., Higman, J., Ogden, M., Nolan, C. M., Yi, D., Gao, W., et al. (2021) · ERJ Open Research · doi:10.1183/23120541.00717-2020 · Cited by 15
“Progression to the full trial will be determined based on feasibility trial results meeting pre-defined criteria (Table 3) within the context of qualitative data (26); in particular, where the qualitative data provides additional understanding and potential remedies for data falling in the amber/red zones.”
BackgroundPellet, J., Weiss, M., Zúñiga, F., & Mabire, C. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00812-4 · Cited by 14
Sorsdahl, K. R., van der Westhuizen, C., Neuman, M., Weiss, H. A., & MYERS, B. J. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00803-5 · Cited by 19
“Should we find that significant modifications are required, we will consider the need for an internal pilot in the context of the full trial [66].”
BackgroundHarvey, M.-P., Martel, M., Houde, F., Daguet, I., Riesco, É., & Léonard, G. (2022) · Frontiers in Pain Research · doi:10.3389/fpain.2022.817984 · Cited by 14
“It is important to reiterate that the present study includes and builds on data coming from a previous pilot study (35); the first part of the trial and the outcome data generated hence contribute to the final analyses (71).”
ResultAbboah‐Offei, M., Bristowe, K., Vanderpuye, N. A., Ansa, G. A., Oppong-Agyei, Y. D., Abas, M., Higginson, I. J., & Harding, R. (2020) · AIDS Care · doi:10.1080/09540121.2020.1739217 · Cited by 13
Nielsen, S. S., Skou, S. T., Larsen, A. E., Polianskis, R., Pawlak, W. Z., Vægter, H. B., Søndergaard, J., & Christensen, J. R. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-060920 · Cited by 12
Rondung, E., Humphries, S., Olsson, E. M. G., Sundelin, R., Norlund, F., Held, C., Spaak, J., Tornvall, P., & Lyngå, P. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100562 · Cited by 13
“…extension to randomized pilot and feasibility trials (Eldridge et al., 2016), we developed a traffic light model of predetermined progression criteria to guide the decision of whether to proceed, to proceed with amendments, or not to proceed to a full-scale randomized trial (Avery et al., 2017).”
Conneely, M., Leahy, A. M., O’Connor, M., Barry, L. A., Corey, G., Griffin, A., O’Shaughnessy, Í., O’Carroll, I., Leahy, S., Trépel, D., et al. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00954-5 · Cited by 14
Radisic, G., Duncanson, E., Leu, R. K. L., Collins, K., Burke, A. L. J., Turner, J. K., Chur‐Hansen, A., Donnelly, F., Hill, K. E., McDonald, S. P., et al. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-00989-2 · Cited by 14
“Progression criteria Decision-making about progression to a larger scale evaluation will be based on a process evaluation of recruitment, retention, intervention acceptability and feasibility [37].”
MethodBryant, M., Burton, W., Collinson, M., Hartley, S., Tubeuf, S., Roberts, K., Sondaal, A. E. C., & Farrin, A. J. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0309-1 · Cited by 13
McWilliams, D. J., King, E. B., Nydahl, P., Darbyshire, J. L., Gallie, L., Barghouthy, D., Bassford, C. R., & Gustafson, O. D. (2023) · EClinicalMedicine · doi:10.1016/j.eclinm.2023.102101 · Cited by 12
McFadden, A., Fitzpatrick, B., Shinwell, S., Tosh, K., Donnan, P. T., WALLACE, L. M., Johnson, E. A., MacGillivray, S. A., Gavine, A. J., Farré, A., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25740 · Cited by 13
Metadata
- Authors
- Avery, K. N. L., Williamson, P. R., Gamble, C., O'Connell Francischetto, E., Metcalfe, C., Davidson, P., Williams, H., & Blazeby, J. M.
- Affiliations
- University of Bristol (GB)
- University of Liverpool (GB)
- Medical Research Council ConDuCT-II Hub for Trials Methodology Research, School of Social and Community Medicine, University of Bristol, Bristol, UK
- National Institute for Health and Care Research (GB)
- Nottingham University Hospitals NHS Trust (GB)
- University Hospitals Bristol NHS Foundation Trust (GB)
- Corresponding author
- Avery, Kerry N L
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-02
- Volume
- 7
- Issue
- 2
- Pages
- e013537
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5318608
- OpenAlex
- W2588182016
- Semantic Scholar
- c03117980919b954181d0ea10371c6c6561bde41
- Cited by
- 575
- References
- 48
- Citations by year
- 2026: 83 · 2025: 100 · 2024: 90 · 2023: 83 · 2022: 69 · 2021: 67 · 2020: 49 · 2019: 20 · 2018: 13 · 2017: 1
- FWCI
- 15.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMJ Open (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Portal (Queen's University Belfast) (publishedVersion, cc-by)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- ResearchOnline (Glasgow Caledonian University) (acceptedVersion, other-oa)
- Keele Research Repository (Keele University) (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Stirling Online Research Repository (University of Stirling) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- Ulster University Research Portal (Ulster University) (submittedVersion, other-oa)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, other-oa)
- Explore Bristol Research (submittedVersion, cc-by)
- Funders
- National Institute for Health and Care Research (DRF-2011-04-016, NF-SI-0611-10020, DRF-2012-05-182)
- Medical Research Council (MR/K025635/1, MR/L004933/1, MR/K025643/1, MR/L004933/2)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- internal pilot study, progression criteria, randomized controlled trials, trial design, trial recruitment, protocol adherence, outcome data, trial reporting, stakeholder perspectives, trial efficiency
- MeSH terms
- Attitude, Clinical Protocols, Decision Making, Humans, Pilot Projects, Research Design, Research Personnel, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Patient Selection, Guideline Adherence, Clinical Trials Data Monitoring Committees, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.