How big should the pilot study for my cluster randomised trial be?
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
There is currently a lot of interest in pilot studies conducted in preparation for randomised controlled trials. This paper focuses on sample size requirements for external pilot studies for cluster randomised trials. We consider how large an external pilot study needs to be to assess key parameters for input to the main trial sample size calculation when the primary outcome is continuous, and to estimate rates, for example recruitment rates, with reasonable precision. We used simulation to provide the distribution of the expected number of clusters for the main trial under different assumptions about the natural cluster size, intra-cluster correlation, eventual cluster size in the main trial, and various decisions made at the piloting stage. We chose intra-cluster correlation values and pilot study size to reflect those commonly reported in the literature. Our results show that estimates of sample size required for the main trial are likely to be biased downwards and very imprecise unless the pilot study includes large numbers of clusters and individual participants. We conclude that pilot studies will usually be too small to estimate parameters required for estimating a sample size for a main cluster randomised trial (e.g. the intra-cluster correlation coefficient) with sufficient precision and too small to provide reliable estimates of rates for process measures such as recruitment or follow-up rates.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“investigators should also be aware that estimates of rates in pilot trials may be subject to considerable uncertainty”
From CONSORT 2010 statement: extension to randomised pilot and feasibility trials. (2016) · cites this paper as [41]
In the citing paper
“Furthermore, several sources emphasised the importance of testing implementation in a range of contexts [15, 29, 39, 41]—especially in less socioeconomically advantaged groups, to examine the risk of widening health inequalities [29, 39].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [41]
In the citing paper
“Some condemned statistically testing for effectiveness [7, 20, 29, 32, 41], as such studies are often underpowered, hence leading to imprecise and potentially misleading estimates of effect sizes [7, 20].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [41]
In the citing paper
“Others made the case for identifying evidence of potential effectiveness, including use of interim or surrogate endpoints [7, 41]”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [41]
In the citing paper
“Cluster RCTs, which are common in public health interventions, were specifically earmarked as unsuitable for estimating parameters for sample size calculations (e.g. intra-cluster correlation coefficients) as well as recruitment and follow-up rates without additional information from other resources, because a large number of clusters and individual participants would be required [41].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [41]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Sufficient Sample Sizes for Multilevel Modeling
Maas, C. J. M., & Hox, J. J. (2005) · Methodology · doi:10.1027/1614-2241.1.3.86 · Cited by 3,582 · cited 1×
“Furthermore, an additional complication arises because estimates of these variances depend on the number of clusters as well as the number of individual participants, and the rather small number of clusters typically involved in a pilot study can potentially cause downward bias in estimates of between-cluster variatio…”
MethodA tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Design and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572 · cited 2×
“Objectives related to these five aspects are usually less well articulated in trial reports than an overarching feasibility objective, even though the importance of stating specific objectives has been stressed in several papers focusing on the methodology of pilot studies.(9,10) In addition, many studies labelled as…”
BackgroundResultSelf-citationSim, J., & Lewis, M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.07.011 · Cited by 1,036 · cited 1×
“Previous research in relation to individually randomised trials has suggested inflating sample sizes estimated from pilot studies using upper confidence interval limits to counteract imprecision in these estimates.(29) However, a more recent study concludes that if individually randomised trials are designed using par…”
Gulliford, M. C., Ukoumunne, O. C., & Chinn, S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009904 · Cited by 852
Teare, M. D., Dimairo, M., Shephard, N., Hayman, A., Whitehead, A., & Walters, S. J. (2014) · Trials · doi:10.1186/1745-6215-15-264 · Cited by 773 · cited 2×
“This has included investigations to assess how large such studies should be.(4) However, none of these investigations have focussed on cluster randomised trials.”
BackgroundResultA Practical Guide to Cluster Randomised Trials in Health Services Research
Eldridge, S., & Kerry, S. (2012) · Wiley eBooks · doi:10.1002/9781119966241 · Cited by 351 · cited 5×
“Patterns in ICCs have been explored by a number of authors and these are summarised in the book by Eldridge and Kerry, where the issue of how to combine estimates from different sources is also discussed.(3) Briefly, it has been shown that ICCs for outcomes that measure the process of care are generally higher than IC…”
BackgroundMethodResultInfluentialSelf-citationEldridge, S. M., Ashby, D., Feder, G. S., Rudnicka, A. R., & Ukoumunne, O. C. (2004) · Clinical Trials · doi:10.1191/1740774504cn006rr · Cited by 288 · cited 1×
“The interventions they evaluate can be complex, trial logistics complicated, and execution difficult.(1,2) Potentially, some of the reported problems in such trials could have been avoided if procedures and activities had been tested beforehand.”
BackgroundSelf-citationQuestions asked and answered in pilot and feasibility randomized controlled trials
Shanyinde, M., Pickering, R. M., & Weatherall, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-117 · Cited by 229 · cited 1×
“In addition, many studies labelled as pilot or feasibility randomised controlled trials continue to focus on assessing efficacy or effectiveness, rather than feasibility objectives.(11) In fact, objectives related to the different aspects of feasibility lead to different methods of determining how large such a study s…”
BackgroundBayesian methods of analysis for cluster randomized trials with binary outcome data
Turner, R. M., Omar, R. Z., & Thompson, S. G. (2001) · Statistics in Medicine · doi:10.1002/1097-0258(20010215)20:3<453::aid-sim803>3.0.co;2-l · Cited by 126
Self-citation
Research works printed but not linked: 2
- Mass CJM, 2005, Methodology, 1, 7
- Porteous T, 2013, Clin Exp Allergy, 43, 1444
Cited by
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
“[51] In addition to the possibility of making changes to the trial protocol, investigators should also be aware that estimates of rates in pilot trials may be subject to considerable uncertainty so that it is best to be cautious about setting definitive thresholds that could be missed simply due to chance variation.[4…”
Self-citationCONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Self-citationGuidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00634-w · Cited by 475
How to design efficient cluster randomised trials
Hemming, K., Eldridge, S., Forbes, G., Weijer, C., & Taljaard, M. (2017) · BMJ · doi:10.1136/bmj.j3064 · Cited by 270
Self-citationHallingberg, B., Turley, R., Segrott, J., Wight, D., Craig, P., Moore, L., Murphy, S., Robling, M., Simpson, S. A., & Moore, G. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0290-8 · Cited by 248
“Some explicitly stated progression criteria should not be judged as strict thresholds but as guidelines using, for example, a traffic lights system with varying levels of acceptability [7, 41].”
BackgroundInfluential
Metadata
- Authors
- Eldridge, S. M., Costelloe, C. E., Kahan, B. C., Lancaster, G. A., & Kerry, S. M.
- Affiliations
- University of London (GB)
- Centre for Primary Care and Public Health, Queen Mary University of London, London, UK
- Lancaster University (GB)
- Corresponding author
- Eldridge, Sandra M
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2015-06-12
- Volume
- 25
- Issue
- 3
- Pages
- 1039-1056
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W1927287710
- Cited by
- 135
- References
- 29
- Citations by year
- 2026: 14 · 2025: 22 · 2024: 11 · 2023: 13 · 2022: 8 · 2021: 16 · 2020: 22 · 2019: 10 · 2018: 5 · 2017: 10 · 2016: 4
- FWCI
- 5.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Statistical Methods in Medical Research (publishedVersion)
- PubMed (publishedVersion)
- Lancaster EPrints (Lancaster University) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- Funders
- National Institute for Health and Care Research (CDF-2016-09-015)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- pilot study, sample size determination, intra-cluster correlation, recruitment rate, follow-up rates, process indicators, sample size bias
- MeSH terms
- Humans, Pilot Projects, Cluster Analysis, Randomized Controlled Trials as Topic, Sample Size, Patient Selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How big should the pilot study for my cluster randomised trial be? https://app.cochat.ai/papers/10.1177/0962280215588242
- The paper
- Eldridge, S. M., Costelloe, C. E., Kahan, B. C., Lancaster, G. A., & Kerry, S. M. (2016). How big should the pilot study for my cluster randomised trial be? Statistical Methods in Medical Research. https://doi.org/10.1177/0962280215588242
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.