Questions asked and answered in pilot and feasibility randomized controlled trials
Open accessThe DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Background: In the last decade several authors have reviewed the features of pilot and feasibility studies and advised on the issues that should be addressed within them. We extend this literature by examining published pilot/feasibility trials that incorporate random allocation, examining their stated objectives, results presented and conclusions drawn, and comparing drug and non-drug trials. Methods: A search of EMBASE and MEDLINE databases for 2000 to 2009 revealed 3652 papers that met our search criteria. A random sample of 50 was selected for detailed review. Results: Most of the papers focused on efficacy: those reporting drug trials additionally addressed safety/toxicity; while those reporting non-drug trials additionally addressed methodological issues. In only 56% (95% confidence intervals 41% to 70%) were methodological issues discussed in substantial depth, 18% (95% confidence interval 9% to 30%) discussed future trials and only 12% (95% confidence interval 5% to 24%) of authors were actually conducting one. Conclusions: Despite recent advice on topics that can appropriately be described as pilot or feasibility studies the large majority of recently published papers where authors have described their trial as a pilot or addressing feasibility do not primarily address methodological issues preparatory to planning a subsequent study, and this is particularly so for papers reporting drug trials. Many journals remain willing to accept the pilot/feasibility designation for a trial, possibly as an indication of inconclusive results or lack of adequate sample size.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Indeed, so important is evidence of acceptability and feasibility that it is often prioritized in pilot trials of new interventions, even before robust evidence of efficacy is sought (Arain et al., 2010;Shanyinde et al., 2011).”
From Acceptability and Feasibility of an Intervention to Enhance Social Group Belonging: Evidence From Three Trials of Groups 4 Health (2022) · cites this paper as Shanyinde et al., 2011
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Within the research literature, there is considerable divergence over what exploratory studies should be called, what they should achieve, what they should entail, whether and how they should determine progression to future studies and how they should be reported [7, 8, 19–21].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Sources considering this issue suggested that if ‘extensive changes’ or ‘major modifications’ are made to either (note they did not specify what qualified as such), researchers should return to the exploratory [21, 30] or intervention development phases [15].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In some guidance, it was not mentioned whether changes should be made during the course of an exploratory study or afterwards, in order to get the best possible design for the future evaluation [6, 7, 21].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The development of the extension was motivated by the growing number of studies described as feasibility or pilot studies and by research that has identified weaknesses in their reporting and conduct.”
From CONSORT 2010 statement: extension to randomised pilot and feasibility trials. (2016) · cites this paper as [12]
Experimental — accuracy not yet measured
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 3×
“In other papers it was impossible to be sure what a priori objectives were from the published paper alone, but since methodological issues were discussed to greater depth in the non-drug trials, they are more likely to fall into Loscalzo’s class of a priori pilot trials.”
MethodResultCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474 · cited 1×
“The MRC guidelines for the evaluation of complex interventions published in 2000 [8] and revised in 2009 [9] emphasize the importance of testing procedures before planning an evaluation, and also the circular nature of development, feasibility and piloting, evaluation, implementation, and further development.”
MethodA tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Design and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572 · cited 5×
“Lancaster et al [2] could find no guidance on how to search MEDLINE for pilot/feasibility trials, and restricted their search to papers in six top ranking medical journals with the words ‘pilot’ or ‘feasibility’ in the title, abstract or keywords: of the 115 hits retrieved 25 (22%) were not suitable for a variety of r…”
BackgroundResultInfluentialCONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72352 · Cited by 2,165
The importance of pilot studies
Teijlingen, E. V., & Hundley, V. (2002) · Nursing Standard · doi:10.7748/ns.16.40.33.s1 · Cited by 1,648
What is a pilot or feasibility study? A review of current practice and editorial policy
Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-67 · Cited by 1,483 · cited 8×
“Arain et al [4] repeated Lancaster et al’s search procedure seven years later with a rate of unsuitable papers (30%) similar to ours of 33%.”
BackgroundResultInfluential
Research works printed but not linked: 1
- Cytel Software Corporation: StatXact: Version 8. 2007, Cambridge, MA 02139
Cited by
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
“Page 4 of 44 The development of this extension was motivated by the growing number of studies described as feasibility or pilot studies,[12] and by research that has identified weaknesses in the reporting and conduct of these studies.”
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Eldridge, S. M., Lancaster, G. A., Campbell, M. J., Thabane, L., Hopewell, S., Coleman, C. L., & Bond, C. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150205 · Cited by 1,581
“There are several previous reviews of empirical pilot and feasibility studies [1, 4, 7].”
BackgroundMethodThe Distinctive Features of a Feasibility Study: Objectives and Guiding Questions
Orsmond, G. I., & Cohn, E. S. (2015) · OTJR: Occupational Therapy Journal of Research · doi:10.1177/1539449215578649 · Cited by 561
Guidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00634-w · Cited by 475
Metadata
- Authors
- Shanyinde, M., Pickering, R. M., & Weatherall, M.
- Affiliations
- Southampton General Hospital (GB)
- University of Otago (NZ)
- Corresponding author
- Pickering, Ruth M
- Venue
- BMC Medical Research Methodology
- Published
- 2011-08-16
- Volume
- 11
- Issue
- 1
- Pages
- 117-117
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC3170294
- OpenAlex
- W2150063271
- Cited by
- 229
- References
- 71
- Citations by year
- 2026: 9 · 2025: 13 · 2024: 29 · 2023: 17 · 2022: 20 · 2021: 19 · 2020: 25 · 2019: 20 · 2018: 20 · 2017: 15 · 2016: 11 · 2015: 13 · 2014: 8 · 2013: 6 · 2012: 4
- FWCI
- 5.04
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Keywords
- pilot study, feasibility study, randomized controlled trials, trial design, methodological issues, drug trials, trial reporting quality, publication practices
- MeSH terms
- Drug Evaluation, Feasibility Studies, Humans, Pilot Projects, Randomized Controlled Trials as Topic, Drug-Related Side Effects and Adverse Reactions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Questions asked and answered in pilot and feasibility randomized controlled trials. https://app.cochat.ai/papers/10.1186/1471-2288-11-117
- The paper
- Shanyinde, M., Pickering, R. M., & Weatherall, M. (2011). Questions asked and answered in pilot and feasibility randomized controlled trials. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-11-117
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.