The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
An audit of sample sizes for pilot and feasibility trials being undertaken in the United Kingdom registered in the United Kingdom Clinical Research Network database
Open accessAbstract
Background: There is little published guidance as to the sample size required for a pilot or feasibility trial despite the fact that a sample size justification is a key element in the design of a trial. A sample size justification should give the minimum number of participants needed in order to meet the objectives of the trial. This paper seeks to describe the target sample sizes set for pilot and feasibility randomised controlled trials, currently running within the United Kingdom. Methods: Data were gathered from the United Kingdom Clinical Research Network (UKCRN) database using the search terms ‘pilot’ and ‘feasibility’. From this search 513 studies were assessed for eligibility of which 79 met the inclusion criteria. Where the data summary on the UKCRN Database was incomplete, data were also gathered from: the International Standardised Randomised Controlled Trial Number (ISRCTN) register; the clinicaltrials.gov website and the website of the funders. For 62 of the trials, it was necessary to contact members of the research team by email to ensure completeness. Results: Of the 79 trials analysed, 50 (63.3%) were labelled as pilot trials, 25 (31.6%) feasibility and 14 were described as both pilot and feasibility trials. The majority had two arms (n = 68, 86.1%) and the two most common endpoints were continuous (n = 45, 57.0%) and dichotomous (n = 31, 39.2%). Pilot trials were found to have a smaller sample size per arm (median = 30, range = 8 to 114 participants) than feasibility trials (median = 36, range = 10 to 300 participants). By type of endpoint, across feasibility and pilot trials, the median sample size per arm was 36 (range = 10 to 300 participants) for trials with a dichotomous endpoint and 30 (range = 8 to 114 participants) for trials with a continuous endpoint. Publicly funded pilot trials appear to be larger than industry funded pilot trials: median sample sizes of 33 (range = 15 to 114 participants) and 25 (range = 8 to 100 participants) respectively. Conclusion: All studies should have a sample size justification. Not all studies however need to have a sample size calculation. For pilot and feasibility trials, while a sample size justification is important, a formal sample size calculation may not be appropriate. The results in this paper describe the observed sample sizes in feasibility and pilot randomised controlled trials on the UKCRN Database.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“More recently, research has begun to explore the differences between internal and external pilot studies and their contribution to main trials, and the appropriateness of pilot and feasibility studies for estimating the sample size.”
From Role of feasibility and pilot studies in randomised controlled trials: a cross-sectional study (2018) · cites this paper as [12]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current recommendations for sample sizes of pilot/feasibility studies vary, have a single rather than a multi-criterion basis, and do not necessarily link directly to formal progression criteria.”
From Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When looking at hybrid human delivered pilot studies, a sample size of 40 is on par with comparable research [105, 106].”
From Personalized machine learning guided intervention for optimizing lifestyle behaviors in depression: a pilot study (2026) · cites this paper as [106]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Feasibility studies are not designed to evaluate effects, and there is no definitive approach to estimating their correct sample size [49].”
From Changes in pain, daily occupations, lifestyle, and health following an occupational therapy lifestyle intervention: a secondary analysis from a feasibility study in patients with chronic high-impact pain (2024) · cites this paper as [49]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“There is no consensus but recommendations vary from 10 to 12 per group through to 60–75 per group depending on the main objective of the study.”
From Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021) · cites this paper as [16]
Experimental — accuracy not yet measured
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Sample size of 12 per group rule of thumb for a pilot study
Julious, S. A. (2005) · Pharmaceutical Statistics · doi:10.1002/pst.185 · Cited by 3,068 · cited 6×
“Julious [9] recommends a minimum sample size of 12 per group as a rule of thumb and justifies this based on rationale about feasibility and precision about the mean and variance;”
BackgroundInfluentialSelf-citationDesign and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572 · cited 3×
“There is the additional issue that setting the sample size too high may lead to a preventable failure to reach the recruitment target [12].”
BackgroundResultConsiderations in determining sample size for pilot studies
Hertzog, M. A. (2008) · Research in Nursing & Health · doi:10.1002/nur.20247 · Cited by 2,337 · cited 2×
“Hertzog [6] recommends the Julious and Patterson [7] method of using confidence intervals for a given precision constructed around the anticipated value to set the sample size;”
BackgroundMethodWhat is a pilot or feasibility study? A review of current practice and editorial policy
Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-67 · Cited by 1,483 · cited 9×
“[2] concluded that pilot trials are poorly reported and that the authors are often not explicit as to the purpose of their pilot trial.”
BackgroundResultInfluentialSim, J., & Lewis, M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.07.011 · Cited by 1,036 · cited 6×
“Continuous 6 43 (15, 60) [10, 60] However, Arain et al.”
BackgroundInfluentialOn the use of a pilot sample for sample size determination
Browne, R. H. (1995) · Statistics in Medicine · doi:10.1002/sim.4780141709 · Cited by 1,007 · cited 2×
“Trial description Pilot 50 30 (20, 45) [8, 114]”
BackgroundRecommendations for Planning Pilot Studies in Clinical and Translational Research
Moore, C. G., Carter, R. E., Nietert, P. J., & Stewart, P. W. (2011) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2011.00347.x · Cited by 661 · cited 2×
“[16] highlighted that it is not unusual for study proposal reviewers to come across a statement such as “No sample size justification is needed because of the pilot nature of the proposed study”, but they state that pilot trials are not exempt from needing a clear rationale for the number of patients to be included.”
BackgroundStatistics and ethics in medical research: III How large a sample?
Altman, D. G. (1980) · BMJ · doi:10.1136/bmj.281.6251.1336 · Cited by 580 · cited 1×
“If a study is too large it may be judged to be unethical as participants may be unnecessarily exposed to risks and burdens [11].”
BackgroundCampbell, M. J., Julious, S. A., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.311.7013.1145 · Cited by 476
Self-citation
Research works printed but not linked: 1
- SPSS Inc: Released 2009. PASW statistics for windows, version 18.0. 2009, Chicago: SPSS Inc
Cited by
Guidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00634-w · Cited by 475
Can digital technology enhance social connectedness among older adults? A feasibility study
Barbosa Neves, B., Franz, R., Judges, R., Beermann, C., & Baecker, R. (2019) · Journal of Applied Gerontology · doi:10.1177/0733464817741369 · Cited by 384
Lewis, M., Bromley, K., Sutton, C. J., McCray, G., Myers, H. L., & Lancaster, G. A. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00770-x · Cited by 330
Rhee, C. M., Ahmadi, S., Kovesdy, C. P., & Kalantar‐Zadeh, K. (2018) · Journal of Cachexia, Sarcopenia and Muscle · doi:10.1002/jcsm.12264 · Cited by 234
Role of feasibility and pilot studies in randomised controlled trials: a cross-sectional study
Blatch-Jones, A. J., Pek, W., Kirkpatrick, E., & Ashton-Key, M. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-022233 · Cited by 139
Metadata
- Authors
- Billingham, S. A., Whitehead, A. L., & Julious, S. A.
- Affiliations
- University of Sheffield (GB)
- Corresponding author
- Julious, Steven A
- Venue
- BMC Medical Research Methodology
- Published
- 2013-08-20
- Volume
- 13
- Issue
- 1
- Pages
- 104-104
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC3765378
- OpenAlex
- W2027748528
- Semantic Scholar
- 725b8e2a2b7f8a509bf11fd9dc8782de9cb9966f
- Cited by
- 962
- References
- 14
- Citations by year
- 2026: 117 · 2025: 124 · 2024: 132 · 2023: 102 · 2022: 148 · 2021: 98 · 2020: 86 · 2019: 46 · 2018: 44 · 2017: 21 · 2016: 22 · 2015: 14 · 2014: 8
- FWCI
- 11.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- pilot trial, feasibility trial, sample size justification, sample size determination, randomized controlled trials, trial design, funding sources, ClinicalTrials.gov
- MeSH terms
- Feasibility Studies, United Kingdom, Humans, Pilot Projects, Randomized Controlled Trials as Topic, Databases, Factual, Sample Size, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An audit of sample sizes for pilot and feasibility trials being undertaken in the United Kingdom registered in the United Kingdom Clinical Research Network database. https://app.cochat.ai/papers/10.1186/1471-2288-13-104
- The paper
- Billingham, S. A., Whitehead, A. L., & Julious, S. A. (2013). An audit of sample sizes for pilot and feasibility trials being undertaken in the United Kingdom registered in the United Kingdom Clinical Research Network database. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-13-104
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
