The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
What is a pilot or feasibility study? A review of current practice and editorial policy
Open accessAbstract
Background: In 2004, a review of pilot studies published in seven major medical journals during 2000-01 recommended that the statistical analysis of such studies should be either mainly descriptive or focus on sample size estimation, while results from hypothesis testing must be interpreted with caution. We revisited these journals to see whether the subsequent recommendations have changed the practice of reporting pilot studies. We also conducted a survey to identify the methodological components in registered research studies which are described as 'pilot' or 'feasibility' studies. We extended this survey to grant-awarding bodies and editors of medical journals to discover their policies regarding the function and reporting of pilot studies. Methods: Papers from 2007-08 in seven medical journals were screened to retrieve published pilot studies. Reports of registered and completed studies on the UK Clinical Research Network (UKCRN) Portfolio database were retrieved and scrutinized. Guidance on the conduct and reporting of pilot studies was retrieved from the websites of three grant giving bodies and seven journal editors were canvassed. Results: 54 pilot or feasibility studies published in 2007-8 were found, of which 26 (48%) were pilot studies of interventions and the remainder feasibility studies. The majority incorporated hypothesis-testing (81%), a control arm (69%) and a randomization procedure (62%). Most (81%) pointed towards the need for further research. Only 8 out of 90 pilot studies identified by the earlier review led to subsequent main studies. Twelve studies which were interventional pilot/feasibility studies and which included testing of some component of the research process were identified through the UKCRN Portfolio database. There was no clear distinction in use of the terms 'pilot' and 'feasibility'. Five journal editors replied to our entreaty. In general they were loathe to publish studies described as 'pilot'. Conclusion: Pilot studies are still poorly reported, with inappropriate emphasis on hypothesis-testing. Authors should be aware of the different requirements of pilot studies, feasibility studies and main studies and report them appropriately. Authors should be explicit as to the purpose of a pilot study. The definitions of feasibility and pilot studies vary and we make proposals here to clarify terminology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Indeed, so important is evidence of acceptability and feasibility that it is often prioritized in pilot trials of new interventions, even before robust evidence of efficacy is sought (Arain et al., 2010;Shanyinde et al., 2011).”
From Acceptability and Feasibility of an Intervention to Enhance Social Group Belonging: Evidence From Three Trials of Groups 4 Health (2022) · cites this paper as Arain et al., 2010
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing frameworks differ in the language and terminology used, and there is a lack of clarity over the specific purpose and scope of each proposed stage of work to be conducted before the full-scale RCT [14].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“They reviewed 54 pilot and feasibility studies published in 2007–2008, of which 81% incorporated hypothesis testing of clinical outcomes.”
From Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021) · cites this paper as [19]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This number enables the calculation of the key factors relevant to determine feasibility (eg, attrition rates) and provides a reasonable indication of the preliminary efficacy and likely sample size required for a larger controlled trial.39”
From Blended intervention based on acceptance and commitment therapy for informal caregivers of people with dementia (ACT-IC): Protocol of a mixed-methods feasibility study (2023) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“No formal power calculations are undertaken in feasibility studies; rather sufficient participants are recruited to determine factors such as attrition and recruitment rates in relation to feasibility outcomes.27”
From Computerised cognitive behaviour therapy for depression in adolescents: Study protocol for a feasibility randomised controlled trial (2014) · cites this paper as [27]
Experimental — accuracy not yet measured
16 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“There is an increasing awareness that publishing only 'significant' results can lead to considerably error [7].”
BackgroundA tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Design and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572 · cited 9×
“We searched citations to see whether the pilot studies identified by Lancaster et al [3] eventually led to main trials.”
BackgroundMethodResultInfluentialSelf-citationDeveloping and Evaluating Complex Interventions: New Guidance
Craig, P., Dieppe, P. A., MacIntyre, S., Michie, S., Nazareth, I., & Petticrew, M. P. (2006) · UCL Discovery (University College London) · Cited by 1,974
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702 · cited 1×
“However since pilot studies tend to be small, the results should be interpreted with caution [5].”
BackgroundStatistical Methods in Medical Research
Chan, W. (2013) · Model Assisted Statistics and Applications · doi:10.3233/mas-130255 · Cited by 634
Descriptive studies: what they can and cannot do
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07373-7 · Cited by 586 · cited 1×
“Some authors suggest that analysis of pilot studies should mainly be descriptive,[3,6] as hypothesis testing requires a powered sample size which is usually not available in pilot studies.”
BackgroundThe Continuing Unethical Conduct of Underpowered Clinical Trials
Halpern, S. D. (2002) · JAMA · doi:10.1001/jama.288.3.358 · Cited by 547 · cited 1×
“It is generally accepted that small, underpowered clinical trials are unethical [4].”
Background
Cited by
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
“Page 4 of 44 The development of this extension was motivated by the growing number of studies described as feasibility or pilot studies,[12] and by research that has identified weaknesses in the reporting and conduct of these studies.[12-15] We expect that improved reporting quality will lead to more highquality examp…”
Self-citationCONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Self-citationWhitehead, A. L., Julious, S. A., Cooper, C. L., & Campbell, M. J. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280215588241 · Cited by 1,936
Self-citationEldridge, S. M., Lancaster, G. A., Campbell, M. J., Thabane, L., Hopewell, S., Coleman, C. L., & Bond, C. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150205 · Cited by 1,581
“There are several previous reviews of empirical pilot and feasibility studies [1, 4, 7].”
BackgroundMethodInfluentialSelf-citationBillingham, S. A., Whitehead, A. L., & Julious, S. A. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-104 · Cited by 962
“[2] concluded that pilot trials are poorly reported and that the authors are often not explicit as to the purpose of their pilot trial.”
BackgroundResultInfluential
Metadata
- Authors
- Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A.
- Affiliations
- University of Sheffield (GB)
- Lancaster University (GB)
- Corresponding author
- Campbell, Michael J
- Venue
- BMC Medical Research Methodology
- Published
- 2010-07-16
- Volume
- 10
- Issue
- 1
- Pages
- 67-67
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC2912920
- OpenAlex
- W2023008186
- Cited by
- 1,483
- References
- 13
- Citations by year
- 2026: 63 · 2025: 93 · 2024: 135 · 2023: 114 · 2022: 139 · 2021: 140 · 2020: 133 · 2019: 117 · 2018: 106 · 2017: 112 · 2016: 100 · 2015: 82 · 2014: 76 · 2013: 35 · 2012: 28
- FWCI
- 24.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Lancaster EPrints (Lancaster University) (acceptedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Keele Research Repository (Keele University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Keywords
- pilot study, feasibility study, research reporting, editorial policy, hypothesis testing, sample size determination, terminology, medical journals
- MeSH terms
- Data Interpretation, Statistical, Feasibility Studies, Humans, Methods, Pilot Projects, Editorial Policies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What is a pilot or feasibility study? A review of current practice and editorial policy. https://app.cochat.ai/papers/10.1186/1471-2288-10-67
- The paper
- Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A. (2010). What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-10-67
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.