The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index; none of the 45 sources its claims cite is checked for support yet.
Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes
Open accessAbstract
BACKGROUND: A pilot study can be an important step in the assessment of an intervention by providing information to design the future definitive trial. Pilot studies can be used to estimate the recruitment and retention rates and population variance and to provide preliminary evidence of efficacy potential. However, estimation is poor because pilot studies are small, so sensitivity analyses for the main trial's sample size calculations should be undertaken. METHODS: We demonstrate how to carry out easy-to-perform sensitivity analysis for designing trials based on pilot data using an example. Furthermore, we introduce rules of thumb for the size of the pilot study so that the overall sample size, for both pilot and main trials, is minimized. RESULTS: The example illustrates how sample size estimates for the main trial can alter dramatically by plausibly varying assumptions. Required sample size for 90% power varied from 392 to 692 depending on assumptions. Some scenarios were not feasible based on the pilot study recruitment and retention rates. CONCLUSION: Pilot studies can be used to help design the main trial, but caution should be exercised. We recommend the use of sensitivity analyses to assess the robustness of the design assumptions for a main trial.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
Pilot studies can inform the design of definitive trials with continuous outcomes by estimating recruitment/retention, population variance, and preliminary efficacy potential, but their small size makes estimates imprecise. The paper recommends sensitivity analyses and stepped rules of thumb for pilot sample size, illustrated by an example where required main-trial sample size for 90% power ranged from 392 to 692 depending on assumptions.
Key findings
- In the worked example, main-trial sample size for 90% power varied from 392 to 692 depending on assumptions about the SD and dropout rate; for 80% power, sample sizes ranged from 296 to 518.
- The pilot example had a recruitment rate of 50% of eligible patients, at 25 recruitments per month, and 80% retention (40 of 50 participants completed all three assessments).
- Based on a target standardized effect size of 4/14 = 0.29 for a 90% powered main trial, the stepped rules of thumb indicated 25 patients per arm for the pilot.
- Feasibility assessment showed that recruiting over 1.5 years at 25 participants per month would enroll 450 participants, falling below several sample size estimates in the sensitivity analysis.
Methods
- Methodological guidance paper with a worked example using a continuous outcome; it focuses on external pilot studies whose results are not combined with the main trial.
- The example is a hypothetical two-arm RCT comparing a new supportive care regimen for cancer patients to usual care, with quality of life at 3 months measured by FACT-G; the pilot had 50 participants, with 100 potential participants, 70 referred, 60 eligible, and 50 agreeing to participate.
- Main analysis demonstrates sample size sensitivity analyses varying the SD (pilot SD, upper 80% CI limit, literature estimate) and dropout rates (observed 20%, >5%, <5%), plus stepped rules of thumb for pilot sample size based on target effect size and future trial size.
Limitations
- Stated: pilot studies are small, so effect size and SD estimates are imprecise; using a pilot study’s SD to design a future sample size has been shown to often result in an underpowered study, and preliminary efficacy evidence from a pilot should not be overstated.
- Stated: sensitivity analyses are needed because sample size estimates can alter dramatically by plausibly varying assumptions, and some scenarios may not be feasible based on pilot recruitment and retention rates.
- Evident from the text: the worked example is explicitly hypothetical (“Suppose…”), so its numerical results are illustrative rather than empirical findings from an actual pilot study.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 45 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Required sample size for 90% power varied from 392 to 692 depending on assumptions.”
- Also stated in: § Sample size calculations and sensitivity analyses · plain
“For 90% power, sample size ranges from 392 to 692.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Abstract > Results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Sample size calculations and sensitivity analyses · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The example illustrates how sample size estimates for the main trial can alter dramatically by plausibly varying assumptions.”
- Also stated in: § Conclusion · boosted
“The example demonstrated how main trial sample size estimates can vary dramatically by plausibly altering assumptions.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Abstract > Results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Conclusion · boosted
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Some scenarios were not feasible based on the pilot study recruitment and retention rates.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Abstract > Results
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For 80% power, sample sizes range from 296 to 518.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Sample size calculations and sensitivity analyses
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Using an MID estimate of four points, and an SD of 14, the standardized effect size is 4/14=0.29.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study sample size
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Figure 1 shows several CIs demonstrating that the intervention is promising, as each CI contains the MID of 4.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study results
Load-bearingStrength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“The target effect size must also be realistic, and the estimated effect size and confidence interval (CI) from the pilot can give some evidence here, ie, whether there is any indication that the intervention is effective and important differences might be obtained in the main trial.5”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Target effect size and potential efficacy
What the sources say
- Not checked yetcites [5] Cocks K Torgerson DJ Sample size calculations for pilot randomized trials: a confidence interval approach J Clin Epidemiol 2013 66 2 197 201 23195919
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“However, estimation is poor because pilot studies are small, so sensitivity analyses for the main trial’s sample size calculations should be undertaken.”
- Also stated in: § Target effect size and potential efficacy · plain
“The small sample size of a pilot makes estimation uncertain, so caution must be exercised.19,20”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Abstract > Background
What the sources say
- Not checked yetcites [19] Kraemer HC Mintz J Noda A Tinklenberg J Yesavage JA Caution regarding the use of pilot studies to guide power calculations for study proposals Arch Gen Psychiatry 2006 63 5 484 489 16651505
- Not checked yetcites [20] Loscalzo J Pilot trials in clinical research: of what value are they? Circulation 2009 119 13 1694 1696 19349331
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Target effect size and potential efficacy · plain
None of the sources cited for this claim have been checked yet.
In the paper
“The small sample size of a pilot makes estimation uncertain, so caution must be exercised.19,20”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Target effect size and potential efficacy
What the sources say
- Not checked yetcites [19] Kraemer HC Mintz J Noda A Tinklenberg J Yesavage JA Caution regarding the use of pilot studies to guide power calculations for study proposals Arch Gen Psychiatry 2006 63 5 484 489 16651505
- Not checked yetcites [20] Loscalzo J Pilot trials in clinical research: of what value are they? Circulation 2009 119 13 1694 1696 19349331
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“pilot studies can also give estimates of retention rates and adherence rates.11”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Feasibility
What the sources say
- Not checked yetcites [11] Avery KNL Williamson PR Gamble C Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies BMJ Open 2017 7 2 e013537 PMC5318608 28213598
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- Probably not a substantial claim. 23
- It may state two separate claims as one. 15
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“If the pilot recruitment rate of 25 participants per month is a good estimate, then the study will be able to recruit and enroll 450 participants.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Feasibility of the main trial
Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of the 50 participants, 40 participants completed all three assessments; retention is 80%.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study results
Strength:plain· not yet calibratedn = 50Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This indicates a recruitment rate of 50% of eligible patients, at 25 recruitments per month.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study results
Strength:hedged· not yet calibratedn = 50Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The difference in the quality of life between the arms at 3 months is estimated at 3.1 points, with 95% CI −1.8 to 8.0, and SD =11.2.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This falls below several of the estimates in Table 2.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Feasibility of the main trial
Strength:plain· not yet calibratedn = 450Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Hislop et al15 undertook a systematic review to identify seven approaches for determining the target effect size for an RCT and classified them as clinically important and/or realistic.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Target effect size and potential efficacy
What the sources say
- Not checked yetcites [15] Hislop J Adewuyi TE Vale LD Methods for specifying the target difference in a randomised controlled trial: the Difference ELicitation in TriAls (DELTA) systematic review PLoS Med 2014 11 5 e1001645 24824338 PMC4019477
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“While some authors argue against carrying out hypothesis tests and assessing efficacy from pilots, even potential efficacy, most pilot studies do undertake hypothesis tests.6”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Target effect size and potential efficacy
What the sources say
- Not checked yetcites [6] Shanyinde M Pickering RM Weatherall M Questions asked and answered in pilot and feasibility randomized controlled trials BMC Med Res Methodol 2011 11 1 117 21846349 PMC3170294
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Pilot studies can be used to estimate the recruitment and retention rates and population variance and to provide preliminary evidence of efficacy potential.”
- Also stated in: § Introduction · plain
“To address this aim, there are a number of objectives for a pilot study including assessing recruitment and retention rates, obtaining estimates of parameters required for sample size calculation, and providing preliminary evidence of efficacy potential.3–6”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Abstract > Background
What the sources say
- Not checked yetcites [3] Craig P Dieppe P Macintyre S Developing and evaluating complex interventions: the new Medical Research Council guidance BMJ 2008 337 a1655 18824488 PMC2769032
- Not checked yetcites [4] Lancaster G Campbell M Eldridge S Trials in primary care: statistical issues in the design, conduct and evaluation of complex interventions Stat Methods Med Res 2010 19 4 349 377 20442193
- Not checked yetcites [5] Cocks K Torgerson DJ Sample size calculations for pilot randomized trials: a confidence interval approach J Clin Epidemiol 2013 66 2 197 201 23195919
- Not checked yetcites [6] Shanyinde M Pickering RM Weatherall M Questions asked and answered in pilot and feasibility randomized controlled trials BMC Med Res Methodol 2011 11 1 117 21846349 PMC3170294
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § Introduction · plain
In the paper
“A figure showing these CIs, the MID, and the null value can be a helpful way of displaying pilot results, by facilitating an assessment of both statistical significance and the potential for clinical significance.31”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Target effect size and potential efficacy
What the sources say
- Not checked yetcites [31] Bell ML Fiero MH Dhillon HM Bray VJ Vardy JL Statistical controversies in cancer research: using standardized effect size graphs to enhance interpretability of cancer-related clinical trials with patient-reported outcomes Ann Oncol 2017 28 8 1730 1733 28327975 PMC5834129
Strength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Pilot trial results can inform each of these elements.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The population SD is another key element of sample size estimation for continuous outcomes, and its estimation is one of the objectives for conducting a pilot study.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Estimating the standard deviation (SD)
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“In the absence of a known MID for continuous outcomes, particularly patient-reported outcomes, a standardized effect size15 between 0.3 and 0.5 has been recommended.17,18”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Target effect size and potential efficacy
What the sources say
- Not checked yetcites [15] Hislop J Adewuyi TE Vale LD Methods for specifying the target difference in a randomised controlled trial: the Difference ELicitation in TriAls (DELTA) systematic review PLoS Med 2014 11 5 e1001645 24824338 PMC4019477
- Not checked yetcites [17] King M A point of minimal important difference (MID): a critique of terminology and methods Expert Rev Pharmacoecon Outcomes Res 2011 11 2 171 184 21476819
- Not checked yetcites [18] Norman GR Sloan JA Wyrwich KW The truly remarkable universality of half a standard deviation: confirmation through another look Expert Rev Pharmacoecon Outcomes Res 2004 4 5 581 585 19807551
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“Factors such as type I error and power are set independent of the pilot and are discussed in detail elsewhere.7”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design
What the sources say
- Not checked yetcites [7] Julious SA Sample sizes for clinical trials with normal data Stat Med 2004 23 12 1921 1986 15195324
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Many trials struggle to reach their sample size goal, which can result in trial extensions or failure to recruit to their prespecified sample size.10”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Feasibility
What the sources say
- Not checked yetcites [10] Sully B Julious SA Nicholl J A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies Trials 2013 14 166 23758961 PMC3691846
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Pilot trials are often small versions of the main trial, undertaken to test trial methods and procedures.1,2”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Introduction
What the sources say
- Not checked yetcites [1] Thabane L Ma J Chu R A tutorial on pilot studies: the what, why and how BMC Med Res Methodol 2010 10 1 20053272 PMC2824145
- Not checked yetcites [2] Arain M Campbell MJ Cooper CL Lancaster GA What is a pilot or feasibility study? A review of current practice and editorial policy BMC Med Res Methodol 2010 10 67 20637084 PMC2912920
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“To address this aim, there are a number of objectives for a pilot study including assessing recruitment and retention rates, obtaining estimates of parameters required for sample size calculation, and providing preliminary evidence of efficacy potential.3–6”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Introduction
What the sources say
- Not checked yetcites [3] Craig P Dieppe P Macintyre S Developing and evaluating complex interventions: the new Medical Research Council guidance BMJ 2008 337 a1655 18824488 PMC2769032
- Not checked yetcites [4] Lancaster G Campbell M Eldridge S Trials in primary care: statistical issues in the design, conduct and evaluation of complex interventions Stat Methods Med Res 2010 19 4 349 377 20442193
- Not checked yetcites [5] Cocks K Torgerson DJ Sample size calculations for pilot randomized trials: a confidence interval approach J Clin Epidemiol 2013 66 2 197 201 23195919
- Not checked yetcites [6] Shanyinde M Pickering RM Weatherall M Questions asked and answered in pilot and feasibility randomized controlled trials BMC Med Res Methodol 2011 11 1 117 21846349 PMC3170294
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
In the paper
“Although some researchers use the pilot effect size to power the definitive trial, this is a practice that should be avoided in general, as estimation is poor due to the small sample size, and is likely to mislead.19”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Target effect size and potential efficacy
What the sources say
- Not checked yetcites [19] Kraemer HC Mintz J Noda A Tinklenberg J Yesavage JA Caution regarding the use of pilot studies to guide power calculations for study proposals Arch Gen Psychiatry 2006 63 5 484 489 16651505
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“One approach for handling this uncertainty is to use significance levels other than the “traditional” 5% to provide preliminary evidence for efficacy, with corresponding CIs such as 85 and 75% in addition to 95% CIs.21”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Target effect size and potential efficacy
What the sources say
- Not checked yetcites [21] Lee EC Whitehead AL Jacques RM Julious SA The statistical interpretation of pilot trials: should significance thresholds be reconsidered? BMC Med Res Methodol 2014 14 1 41 24650044 PMC3994566
Strength:plain· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“From this work, they proposed stepped rules of thumb for pilot studies based on the target effect size and the size of the future trial.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Pilot study sample size
What the sources say
- Not checked yetcites [27] Whitehead A Julious S Cooper C Campbell MJ Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable Stat Methods Med Res 2016 25 3 1057 1073 26092476 PMC4876429
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“The decision to progress from a pilot trial to a main trial is generally made using feasibility estimates, as well as issues such as protocol nonadherence.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Conclusion
What the sources say
- Not checked yetcites [11] Avery KNL Williamson PR Gamble C Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies BMJ Open 2017 7 2 e013537 PMC5318608 28213598
- Not checked yetcites [14] Hampson LV Williamson PR Wilby MJ Jaki T A framework for prospectively defining progression rules for internal pilot studies monitoring recruitment Stat Methods Med Res Epub 2017 1 01 28589752
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“While there are several rules of thumb for the size of a pilot study, ranging from 12 to 35 individuals per arm,5,27 none of these guidelines account for the likely size of the future trial.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Pilot study sample size
What the sources say
- Not checked yetcites [5] Cocks K Torgerson DJ Sample size calculations for pilot randomized trials: a confidence interval approach J Clin Epidemiol 2013 66 2 197 201 23195919
- Not checked yetcites [27] Whitehead A Julious S Cooper C Campbell MJ Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable Stat Methods Med Res 2016 25 3 1057 1073 26092476 PMC4876429
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although traditional power calculations are inappropriate for pilot studies (since the primary aim of a pilot study is not to test superiority of one treatment over the other), a sample size justification is important.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Pilot study sample size
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We have illustrated how pilot studies can aid in the design of future trials with continuous outcomes by providing estimates of population SD, evidence of potential for intervention effectiveness, and quantification of feasibility in the form of recruitment and retention rates.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Conclusion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These rates will aid in estimating the main trial duration.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“They find that the estimated FACT-G MID is between three and six points29 and an SD estimate from the literature30 is 14 in similar populations.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study sample size
What the sources say
- Not checked yetcites [29] Webster K Cella D Yost K The functional assessment of chronic illness therapy (FACIT) measurement system: properties, applications, and interpretation Health Qual Life Outcomes 2003 1 79 14678568 PMC317391
- Not checked yetcites [30] Bell ML McKenzie JE Designing psycho-oncology randomised trials and cluster randomised trials: variance components and intra-cluster correlation of commonly used psychosocial measures Psychooncology 2013 22 8 1738 1747 23080401
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Sensitivity analyses should also be performed in the design stage26 and can take the form of accounting for the uncertainty in estimation by calculating sample sizes based on a range of plausible SDs and retention/dropout rates.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Sensitivity analysis for sample size
What the sources say
- Not checked yetcites [26] Lewis JA Statistical principles for clinical trials (ICH E9): an introductory note on an international guideline Stat Med 1999 18 15 1903 1942 10440877
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“Sensitivity analyses are important to assess the robustness of study results to the assumptions made in the primary analysis.25”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Sensitivity analysis for sample size
What the sources say
- Not checked yetcites [25] Thabane L Mbuagbaw L Zhang S A tutorial on sensitivity analyses in clinical trials: the what, why, when and how BMC Med Res Methodol 2013 13 1 92 23855337 PMC3720188
Strength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, the objective of the pilot study to provide preliminary evidence of efficacy has been met.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study results
Strength:plain· not yet calibratedn = 50Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“For example, if the future trial will be designed around a small effect, then the number of patients per arm for the pilot study should be 25 for 90% power.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Pilot study sample size
What the sources say
- Not checked yetcites [27] Whitehead A Julious S Cooper C Campbell MJ Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable Stat Methods Med Res 2016 25 3 1057 1073 26092476 PMC4876429
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A CONSORT extension for reporting results of pilot and feasibility studies gives detailed guidelines.9”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Conclusion
What the sources say
- Not checked yetcites [9] Eldridge SM Chan CL Campbell MJ CONSORT 2010 statement: extension to randomised pilot and feasibility trials BMJ 2016 355 i5239 27777223 PMC5076380
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For a 90% powered main trial, they should use a sample size of 25 per arm for the pilot (Table 1).”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Example > Pilot study sample size
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Browne23 suggested using the pilot study’s upper limit of the 80% CI for the SD to calculate sample size in the subsequent trial.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Considerations for trial design > Sensitivity analysis for sample size
What the sources say
- Not checked yetcites [23] Browne RH On the use of a pilot sample for sample size determination Stat Med 1995 14 17 1933 1940 8532986
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Cocks and Torgerson5 also recommend basing the pilot study size on the future trial’s size, if the SD is known.”
§ Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes > Pilot study sample size
What the sources say
- Not checked yetcites [5] Cocks K Torgerson DJ Sample size calculations for pilot randomized trials: a confidence interval approach J Clin Epidemiol 2013 66 2 197 201 23195919
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In order to stablish the sample size required for this trial, we follow recommendations by Bell et al. (2018) which proposed that a sample size of 60 participants would be adequate considering an effect size of 0.3 and 80% of power.”
From Unified Protocol for the transdiagnostic treatment of emotional disorders in people with post COVID-19 condition: study protocol for a multiple baseline n-of-1 trial (2023) · cites this paper as Bell et al., 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“CIs and minimal clinically important differences (MCIDs) are presented to suggest plausible evidence of effect for respective study arms.34 35”
The cited source says what the claim attributes to it.
In the citing paper
“Lee et al35 and Bell et al34 suggest using CIs and the MCID to interpret feasibility trials.”
The cited source says what the claim attributes to it.
In the citing paper
“The method of setting the pilot trial sample size was applied [49,50], and the following parameters were chosen to establish the sample size:”
From HAPPY MAMA Project (Part 2)—Maternal Distress and Self-Efficacy: A Pilot Randomized Controlled Field Trial (2022) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Recruitment rate uses potential rather than eligible participants
MinorThe text says 60 participants met eligibility criteria and 50 agreed to participate. That is 83.3% of eligible participants, not the reported 50%; 50% is the proportion of the 100 potential participants.
Reported 50 · recomputed 83.333333
“Of the 100 potential participants, 70 participants were referred by their oncologist, 60 participants met eligibility criteria, and 50 participants agreed to participate. This indicates a recruitment rate of 50% of eligible patients”
Citations
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
The functional assessment of cancer therapy scale: development and validation of the general measure
Cella, D. F., Tulsky, D. S., Gray, G., Sarafian, B., Linn, E., Bonomi, A., Silberman, M., Yellen, S. B., Winicour, P., & Brannon, J. (1993) · Journal of Clinical Oncology · doi:10.1200/jco.1993.11.3.570 · Cited by 6,020
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
A tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Design and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572 · cited 1×
“We strongly stress that preliminary efficacy evidence from a pilot study should not be overstated, and researchers should avoid temptation to forgo the main trial.(20,22)”
Whitehead, A. L., Julious, S. A., Cooper, C. L., & Campbell, M. J. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280215588241 · Cited by 1,936 · cited 2×
“Whitehead et al 27 showed how, if you know the main trial’s target effect size, you can estimate the pilot study’s optimum sample size, minimizing the number of patients recruited across the two studies.”
Self-citation(2003) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-1-79 · Cited by 1,506
What is a pilot or feasibility study? A review of current practice and editorial policy
Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-67 · Cited by 1,483
On the use of a pilot sample for sample size determination
Browne, R. H. (1995) · Statistics in Medicine · doi:10.1002/sim.4780141709 · Cited by 1,007
Flagged first, then by citations
Cited by
Sorted by citations
Items 201–279 of 279
Lassell, R., Cross, J. E., Schmid, A. A., Davalos, D. B., & Wood, W. H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4197650
Mardan-Dezfouli, S., Reid, O. G., Fliss, M. D., Stevenson, J., Harris, D., Lyon, M. R., Koehle, M. S., & Mitchell, C. J. (2022) · Aesthetic Surgery Journal · doi:10.1093/asj/sjac220
Ng, M. S. P., Jabir, A. I., Ng, T. D. R., Ang, Y.-I., Chia, J. L., Tan, D. N. H., Lee, J. S., Mahendran, D. C. J., Car, L. T., & Chia, C. L. K. (2022) · medRxiv · doi:10.1101/2022.09.25.22280305
Provencher, V., D’Amours, M., Carbonneau, H., Levasseur, M., Poulin, V., Filiatrault, J., Obradović, N., Drouin, L., & Giroux, D. (2023) · Loisir et Société / Society and Leisure · doi:10.1080/07053436.2023.2184096
“Since our sample complies with the recommendations for pilot studies (12 to 35 per group; Bell et al., 2018; Johanson & Brooks, 2010), the lack of difference in the accomplishment of targeted MLA and well-being is surprising.”
MethodResultReynolds, P. S. (2023) · Wiley eBooks · doi:10.1002/9781119800002.ch4 · Cited by 2
A pragmatic approach to mobile attention bias modification in a clinical setting
Zhang, M. W. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/170488
Mason, J. B., Johnson, C., Ogbuefi, N., Wang, S., Armstrong, A. W., Barbieri, J. S., Cohen, J. B., Craig, E. T., Fitzsimmons, R. C., Garshick, M. S., et al. (2024) · Journal of Psoriasis and Psoriatic Arthritis · doi:10.1177/24755303241257906
The quantified method for blood clot detection in the extraction socket
Tanya, S., Patcharanuchat, P., & Sattayut, S. (2025) · F1000Research · doi:10.12688/f1000research.155330.2
A Remote Physical Activity Intervention Tailored to Rural Men: A Proof-of-Concept Study
Gallagher, J. B., Bayman, E. O., Cadmus‐Bertram, L., Jenkins, N. D. M., Pearlman, A. M., Whitaker, K. M., & Carr, L. J. (2025) · Translational Journal of the American College of Sports Medicine · doi:10.1249/tjx.0000000000000288
“This is consistent with other suggestions for adequate sample size to gather preliminary data (including qualitative feedback) for future studies (57 – 59), and larger than most Phase IIa studies.”
Karanasiou, M., Coates, R., & Kingston, J. L. (2025) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2025.2488475
“Table 4 indicates varying sample sizes based on the different effect sizes at 90% and 80% power, as advised by Bell et al. (2018).”
Roponen, J., Ruusunen, A. A., Nuutinen, O., Partonen, T., & Absetz, P. (2025) · British Journal Of Nutrition · doi:10.1017/s0007114525103565
“The sample size was compliant with the standard practices for similar studies (38) .”
Meidinger, P., Hong, Q. N., Tittley, J., Campeau‐Lecours, A., & Roy, J. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01646-0
“In the absence of a minimum important difference (MID) for Quick DASH within the target population, we choose a standardized effect size of 0.4 (range 0.3 and 0.5) to be used in the main trial, as suggested by Bell et al [37, 38].”
InfluentialSeenan, C., Abaraogu, U. O., Dall, P., Gilmour, L., Tew, G. A., Stuart, W. P., Elders, A., & Brittenden, J. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-105563
“During analysis, they acted as additional researchers, checking and providing comments on the analysis of the participant interviews.”
McArthur, C., Alizadehsaravi, N., Affoo, R. H., Cooke, K., Douglas, N., Earl, M., Farlie, M. K., Flynn, T., Ghanouni, P., Hunter, S. W., et al. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01685-7
“Our sample size calculation is driven by our feasibility outcomes of recruitment, retention and adherence which we will estimate within a 95% confidence interval (CI) as calculated by a Wilson score interval [53].”
Ladekarl, M., Specht, I. O., Adegboye, A. R. A., Brødsgaard, A., Nohr, E. A., Olsen, N. J., & Heitmann, B. L. (2025) · PLOS mental health. · doi:10.1371/journal.pmen.0000294
“However, we aimed to recruit 120 participants, even though this is a relatively large number for a feasibility study [26].”
Ademoyegun, A. B., Awogboro, O. I., Ojo, E. T., Ibitoye, A. G., Odetunde, M. O., & Awotidebe, T. O. (2025) · Bulletin of Faculty of Physical Therapy · doi:10.1186/s43161-025-00324-9
“Since this study is considered a pilot study, using the steeped rules of thumb, a small standardised difference of d < 0.3, with an expected 80% power for the main trial, 20 samples were required in each arm [29].”
InfluentialMcGrady, M. E., Ketterl, T. G., Tillery, R., Burns, M. M. K., Bills, S. E., Burke, M., Szulczewski, L., Brock, M. Y., Schwartz, L. E., Herriott, J. K., et al. (2025) · Pediatric Blood & Cancer · doi:10.1002/pbc.32127
Orchard, D., Bolt, D., Pinna, T., & Antoni-Pineda, G. (2025) · International journal of osteopathic medicine · doi:10.1016/j.ijosm.2025.100795
Brunet, J., Price, J., Gillison, F., Standage, M., Taljaard, M., Beauchamp, M. R., Reed, J. L., & Srikanthan, A. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01701-w
“Rather, the enrollment target was 30 – 40 young adults, which follows sample size recommendations for pilot studies using continuous outcome variables, as well as “rules of thumb” for pilot studies basing target sample size on anticipated effect size for a future full-scale trial [65].”
von Ash, T., O’Hagan, B., Gupta-Louis, S. K., DUNSIGER, S. I., Toure, F., Bohlen, L. C., Benitez, T. J., Murphy, C. M., Pindus, D. M., Brown, C. S., et al. (2025) · AJPM Focus · doi:10.1016/j.focus.2025.100465
“These thresholds were informed by existing literature on pilot intervention research, 40,41 the intervention ’ s expected effect size in a fully powered RCT given the team ’ s prior work PA promotion among women, 42 − 44 and contextual factors speci fi c to the study population and setting (e.g.,…”
Harnessing Project-Based and Experiential Learning for Competency-Driven Education
Ramaila, S. M. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3566-7.ch004
Mosher, C. E., Shinn, E. H., Addington, E. L., Wu, W., Bricker, J. B., Helft, P. R., Turk, A. A., Vater, L. B., Masood, A., Jalal, S. I., et al. (2025) · Contemporary Clinical Trials · doi:10.1016/j.cct.2025.108168
“Estimates of treatment effects from pilots are imprecise [69,70]; thus, we examined results across relevant ACT trials and recommendations regarding MCIDs [71,72] to inform our power calculation.”
Schwartz, L., Sijbrandij, M., van der Ven, E., Alözkan, C., & Lane, H. (2025) · International Journal of Mental Health · doi:10.1080/00207411.2025.2595363
“Pilot studies aiming to estimate parameters for a main trial can justify sample sizes between 25 and 35 participants per arm when anticipating a small effect size, aligning with the design of this study (Bell et al. 2018).”
Ferreira, M., Gadelha, M. J. N., Galdino, M. K. C., Ortíz, A. I. V., Nunes, S. A. N., & do Nascimento, E. B. (2025) · Applied Neuropsychology Child · doi:10.1080/21622965.2025.2594552
Firdaus, M. G., Rahmi, U., & Salasa, S. (2025) · Bravo’s Jurnal Program Studi Pendidikan Jasmani dan Kesehatan · doi:10.32682/bravos.v13i4/209
“…menggunakan rumus Federer dengan formula: (t-1)(n-1) ≥15 dengan hasil sampel setiap kelompok berjumlah 16 orang, lalu untuk mengantisipasi kemungkinan dropout maka jumlah sampel ditingkatkan menjadi 20 orang perkelompok berdasarkan estimasi tingkat dropout sekitar 20% (Bell & Julious, 2018).”
Additional file 2 of Guidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Figshare · doi:10.6084/m9.figshare.13173941
Surendran, A., McSharry, J., Meredith, D., McNamara, J., Bligh, F., Meade, O., & O’Hora, D. P. (2023) · Figshare · doi:10.6084/m9.figshare.23625459
Lambert, S. D., Duncan, L. R., Ellis, J., Robinson, J. W., Sears, C. S., Culos-Reed, N. S., Matthew, A., de Raad, M., Schaffler, J. L., Mina, D. S., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14253504
Aschbrenner, K. A., Kruse, G. R., Gallo, J. J., & Clark, V. P. (2022) · Figshare · doi:10.6084/m9.figshare.21211348
Surendran, A., McSharry, J., Meredith, D., McNamara, J. G., Bligh, F., Meade, O., & O’Hora, D. P. (2023) · Figshare · doi:10.6084/m9.figshare.23625456
Lambert, S. D., Duncan, L. R., Ellis, J., Robinson, J. W., Sears, C. S., Culos-Reed, N. S., Matthew, A., de Raad, M., Schaffler, J. L., Mina, D. S., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14253510
Surendran, A., McSharry, J., Meredith, D., McNamara, J. G., Bligh, F., Meade, O., & O’Hora, D. (2023) · Figshare · doi:10.6084/m9.figshare.23625465
Surendran, A., McSharry, J., Meredith, D., McNamara, J. G., Bligh, F., Meade, O., & O’Hora, D. P. (2023) · Figshare · doi:10.6084/m9.figshare.23625444
Patterson, B., Barton, C. J., Culvenor, A. G., Cooper, R., & Crossley, K. M. (2021) · Figshare · doi:10.6084/m9.figshare.13558794
Surendran, A., McSharry, J., Meredith, D., McNamara, J. G., Bligh, F., Meade, O., & O’Hora, D. P. (2023) · Figshare · doi:10.6084/m9.figshare.23625453
Patterson, B., Barton, C. J., Culvenor, A. G., Cooper, R., & Crossley, K. M. (2021) · Figshare · doi:10.6084/m9.figshare.13558806
Additional file 1 of Guidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Figshare · doi:10.6084/m9.figshare.13173938
Surendran, A., McSharry, J., Meredith, D., McNamara, J. G., Bligh, F., Meade, O., & O’Hora, D. P. (2023) · Figshare · doi:10.6084/m9.figshare.23625468
Surendran, A., McSharry, J., Meredith, D., McNamara, J. G., Bligh, F., Meade, O., & O’Hora, D. P. (2023) · Figshare · doi:10.6084/m9.figshare.23625462
Patterson, B., Barton, C. J., Culvenor, A. G., Cooper, R., & Crossley, K. M. (2021) · Figshare · doi:10.6084/m9.figshare.13558800
Surendran, A., McSharry, J., Meredith, D., McNamara, J. G., Bligh, F., Meade, O., & O’Hora, D. P. (2023) · Figshare · doi:10.6084/m9.figshare.23625450
Lambert, S. D., Duncan, L. R., Ellis, J., Robinson, J. W., Sears, C. S., Culos-Reed, N. S., Matthew, A., de Raad, M., Schaffler, J. L., Mina, D. S., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14253507
Patterson, B., Barton, C. J., Culvenor, A. G., Cooper, R., & Crossley, K. M. (2021) · Figshare · doi:10.6084/m9.figshare.13558809
Barabasch, A., Riemann-Lorenz, K., Kofahl, C., Scheiderbauer, J., Eklund, D., Kleiter, I., Kasper, J., Köpke, S., Lezius, S., Zapf, A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13544605
Patterson, B., Barton, C. J., Culvenor, A. G., Cooper, R., & Crossley, K. M. (2021) · Figshare · doi:10.6084/m9.figshare.13558803
Feasibility of glycated haemoglobin target-setting in adults with diabetes: A mixed-methods study
Westall, S., Watmough, S., Narayanan, R. P., Irving, G. J., & Hardy, K. J. (2026) · PLoS ONE · doi:10.1371/journal.pone.0317162
“We however recognise that the outcome measures presented here can give indications of the potential effectiveness of the intervention [45,46], though caution should be taken in interpreting these results.”
Hartung, V., Tallner, A., Limbach, M., Schultz, K., & Pfeifer, K. (2026) · Die Rehabilitation · doi:10.1055/a-2705-1784
Harich, J., & Rosas, M. K. (2026) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2026.102469 · Cited by 1
Bongaerts, V. A. M. C., Vos, R. C., Hageman, S. H. J., Redekop, K., Dorresteijn, J. A. N., Numans, M. E., & van Os, H. J. A. (2026) · BMJ Open · doi:10.64898/2026.02.13.26345729
A Personalised Well-Being App for Staff Working in Healthcare Settings: A Pilot Feasibility Study
Dandil, Y., McGillivray, H., & Kingston, J. L. (2026) · Journal of Technology in Human Services · doi:10.1080/15228835.2026.2629258
“Following the retention and recruitment guidelines for pilot studies (Bell et al., 2018), this study identified a weekly recruitment rate of three participants per week; on average, one participant completed a follow-up outcome measure.”
Habla, A. F., Soleim, S. B., Due, A. S., Tinglef, T. H., Eskelund, K., Díaz-i-Calvete, J., Larsen, K. M., Kristensen, T. D., Ebdrup, B. H., Nordentoft, M., et al. (2026) · PLoS ONE · doi:10.1371/journal.pone.0333716
“A sample size of 30 participants is commonly recommended in pilot research as it balances the need to gather sufficient data for feasibility assessment and prelimi-nary efficacy signals while minimizing resource expenditure [52,53].”
Levy, R., Phillips, R. L., O’Sullivan, G. M., Capra, S., Penm, J. H.-D., Lee, A., Sagnella, S., Segura, J. M., Forrey, R. A., Patanwala, A. E., et al. (2026) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2026.103063
Hormenu, T., Antiri, E. O., Ocansey, S., Awlime-Ableh, E., Paku, J. E., & Ansah, E. W. (2026) · Global Epidemiology · doi:10.1016/j.gloepi.2026.100255
“Given an estimated dropout rate of 20% for a pilot RCT in similar settings [22,23], a minimum of 20 participants was determined based on feasibility considerations in this setting, and was considered sufficient to evaluate retention [24,25].”
Fricke, C., Deibert, P., Maier, P., Kern, W. V., Krumnau, O., & Barsch, F. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-113095
Li, W., Huang, Z., Li, X., Wang, N., & Wang, R. (2026) · Healthcare and Rehabilitation · doi:10.1016/j.hcr.2026.100067
Thompson, L., Nielsen, E. E., Quilter, E. E. V., Slay, A., Wac, M., Wragg, M., Downes, S., Tittensor, P., Junges, L., Stuart, L., et al. (2026) · JMIR Research Protocols · doi:10.2196/85993
“The feasibility phase is a critical component, used to test trial methods on a small scale to assess whether a future, fully powered clinical trial can be undertaken [24].”
Antiri, E. O., Hormenu, T., Ocansey, S., Arthur, R. A., Awlime-Ableh, E., Salifu, I., Nyane, B., Gabla, A. M.-H., Paku, J. E., & Ansah, E. W. (2026) · Pilot and Feasibility Studies · doi:10.1186/s40814-026-01805-x
“A minimum of 20 participants is considered sufficient to assess retention with an 18.0% margin of error at the 95% confidence interval [70, 71] based on an expected dropout rate of 20.0% [72, 73].”
InfluentialIke, T. J., Jidong, D. E., Ayobi, E. E., Ike, M. L., Ike, P. R., Doghor, R. F., & Francis, C. (2026) · Dynamics of Asymmetric Conflict · doi:10.1080/17467586.2026.2652270
“This number has been reported in the literature as appropriate for conducting pilot or feasibility trials (Bell et al., 2018).”
Eisenman, S. R., Vanegas, J., Cicchetti, C., Compton, S. N., Gilliam, W., Iruka, I. U., Lyon, A. R., Wakschlag, L. S., SMITH, J. B., Spencer, A. E., et al. (2026) · Implementation Science Communications · doi:10.1186/s43058-026-00938-7
“Because of the emerging consensus that estimates of population effect sizes based on small samples are often positively biased (i.e., too large), formal power considerations for pilot trials are typically deemed unnecessary [68, 69].”
Osma, J., Sánchez-Albentosa, M., Prieto‐Rollan, I., Fadrique‐Jiménez, A., Haro, M. V. N., & Péris-Baquero, Ó. (2026) · BMC Family Practice · doi:10.1186/s12875-026-03347-w · Cited by 1
“This sample size coincides with that established by the design guidelines for this type of study [55], and with other studies carried out with a similar objective [56, 57].”
Savage, M. E., Mentiplay, B. F., Bruder, A. M., Slater, H., Serighelli, F., Couch, J. L., Bullock, L., & Culvenor, A. G. (2026) · Journal of Sport Rehabilitation · doi:10.1123/jsr.2025-0430
Vaid, N. (2026) · International Journal of Developmental Disabilities · doi:10.1080/20473869.2026.2679073
Kimani, J. G., Mburu, J. I., Nzuma, J. M., Groote, H. D., Gitonga, Z. M., & Mulungu, K. (2026) · Discover Agriculture · doi:10.1007/s44279-026-00667-4
“The use of 30 respondents is supported by the methodological literature, which suggests that a pilot sample of 20-30 respondents is generally adequate for identifying ambiguities, testing questionnaire flow, and assessing instrument reliability [105, 106].”
Edward, H., Macedo, L., Wojkowski, S., Mukherjee, S. D., & Smith‐Turchyn, J. (2026) · PLoS ONE · doi:10.1371/journal.pone.0351761
“The primary outcome of this study is feasibility as measured by adherence rate [37,44,45].”
Schmill, P., Hudson, J. L., Greenwood, S. A., & Chilcot, J. (2026) · medRxiv · doi:10.64898/2026.06.29.26356845
Arora, T., Alfalasi, S., & Omar, O. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00686-4
Rosenberg, S., Boyce, T. W., Walters, S. T., Barriga, L., Torres, J., Pankratz, V. S., Tawfik, B., Prabhakaran, S., Fine, S., Buro, A. W., et al. (2026) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph23081003
“These goals were based on our power analysis and common target of 80% in feasibility studies [26].”
Kleckner, A. S., Clingan, C. L., James, S., Addison, O. R., Hussain, A., Kleckner, I. R., Mohile, S. G., Ryan, A. S., Schotz, K. M., Terrin, M. L., et al. (2026) · Journal of Geriatric Oncology · doi:10.1016/j.jgo.2026.103077
Hoey, R. F., Binko, A., Bourbeau, D. J., Fass, R., Gunzler, D. D., Korty, L., Kshirsagar, A., Moore, M., Moynahan, M., Nechols, M. H., et al. (2026) · Frontiers in Neurology · doi:10.3389/fneur.2026.1922192
“Therefore, traditional sample size calculations to power efficacy are inappropriate (27, 28).”
Espie, C. A., Tse, K. Y. K., & Malaffo, M. (2026) · Behavioral Sleep Medicine · doi:10.1080/15402002.2026.2724278
Qasba, N. T., Lundsberg, L. S., Stanwood, N. L., & Gariepy, A. M. (2026) · Perspectives on Sexual and Reproductive Health · doi:10.1111/psrh.70086
Ghai, S., Cavallo, S., Gervais, M.-J., & Zidarov, D. (2026) · JMIR Formative Research · doi:10.2196/98632
“Feasibility objectives were a minimum recruitment rate of 30%, retention rate of 80%, and intervention adherence rate of 80%, consistent with established methodological recommendations for pilot studies [45].”
Chen, J., & Fiester, A. M. (2026) · Journal of Patient Experience · doi:10.1177/23743735261501452
Frowen, J. J., Rischin, D., Porceddu, S. V., Alexander, M., Dyer, M., Ahmad, H. A. E., Fua, T. F., Iulio, J. D., Pizzolla, A., & Gough, K. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-125077
Ávila-García, A. T., Villagrana-Rodríguez, A. L., Ledezma-Miramontes, E. J., Mercado-Nuñez, E., García-Casillas, M. A., Ontiveros-Castellanos, E. J., Chacón-Morales, K., Miller-Serrano, D., Araiza-Quintana, D. H., Herrera-Fuentes, L. F., et al. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15218209
Metadata
- Authors
- Bell, M. L., Whitehead, A. L., & Julious, S. A.
- Affiliations
- University of Arizona (US)
- University of Sheffield (GB)
- Corresponding author
- Bell, Melanie L
- Venue
- Clinical Epidemiology
- Publisher
- Informa UK Limited
- Published
- 2018-01
- Volume
- Volume 10
- Pages
- 153-157
- ISSN
- 1179-1349 (ISSN-L)
- PMC
- PMC5779280
- OpenAlex
- W2783709266
- Semantic Scholar
- cfec5aaa40794375792112254874a4c92fb0bf5e
- Cited by
- 280
- References
- 32
- Citations by year
- 2026: 37 · 2025: 52 · 2024: 22 · 2023: 48 · 2022: 43 · 2021: 37 · 2020: 26 · 2019: 12 · 2018: 3
- FWCI
- 16.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Clinical Epidemiology (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- UA Campus Repository (The University of Arizona) (acceptedVersion, cc-by-nc)
- Dove Medical Press (Taylor and Francis Group) (submittedVersion, cc-by-nc)
- Funders
- University of Southampton
- National Cancer Institute (P30CA023074)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- pilot study, trial design, sample size determination, sensitivity analysis, continuous outcomes, population variance estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
