The DOI matches its Crossref record; 73 of the 76 references it cites were found in a registry or an index; 44 of the 57 sources its claims cite were checked for support.
Guidance for conducting feasibility and pilot studies for implementation trials
Open accessAbstract
Background: Implementation trials aim to test the effects of implementation strategies on the adoption, integration or uptake of an evidence-based intervention within organisations or settings. Feasibility and pilot studies can assist with building and testing effective implementation strategies by helping to address uncertainties around design and methods, assessing potential implementation strategy effects and identifying potential causal mechanisms. This paper aims to provide broad guidance for the conduct of feasibility and pilot studies for implementation trials. Methods: We convened a group with a mutual interest in the use of feasibility and pilot trials in implementation science including implementation and behavioural science experts and public health researchers. We conducted a literature review to identify existing recommendations for feasibility and pilot studies, as well as publications describing formative processes for implementation trials. In the absence of previous explicit guidance for the conduct of feasibility or pilot implementation trials specifically, we used the effectiveness-implementation hybrid trial design typology proposed by Curran and colleagues as a framework for conceptualising the application of feasibility and pilot testing of implementation interventions. We discuss and offer guidance regarding the aims, methods, design, measures, progression criteria and reporting for implementation feasibility and pilot studies. Conclusions: This paper provides a resource for those undertaking preliminary work to enrich and inform larger scale implementation trials.
Overview
CoChat Summary
TL;DR
This paper offers broad guidance for conducting feasibility and pilot studies of implementation trials, using the Curran effectiveness–implementation hybrid typology as a framework. It synthesizes existing recommendations and expert discussion to advise on aims, design, measures, sample size and power, progression criteria, and reporting.
Key findings
- The guidance distinguishes three possible purposes for implementation feasibility/pilot studies: informing implementation strategy development, assessing potential implementation strategy effects, and assessing the feasibility of study methods.
- Hybrid Type 1 and Type 2 designs are considered relevant; Hybrid Type 3 is not discussed because its implementation aim is a definitively powered trial.
- Recommended measures include implementation strategy effects such as adoption, reach, fidelity, and sustainability, and determinants such as context, acceptability, adaptability, feasibility, compatibility, cost, culture, dose, complexity, and self-efficacy.
- Progression criteria should generally be set a priori and specific to the feasibility measures, components, or outcomes assessed; the paper cites a traffic-light approach (stop/red, continue with modifications/yellow, continue with close monitoring, continue/green) and notes that stakeholder input is often required.
Methods
- Three facilitated group discussions were held with a group of 6 members from Canada, the U.S., and Australia, including implementation and behavioural science experts, public health researchers, and trial methodologists.
- A literature review in electronic bibliographic databases and Google identified 30 existing guidelines and recommendations for feasibility and pilot studies; seminal methods and implementation science texts were also examined.
- The authors used Eldridge and colleagues’ definitions of feasibility and pilot studies and Curran and colleagues’ effectiveness–implementation hybrid trial typology as the conceptual framework; the manuscript was developed iteratively over 9 months with consensus resolution of differences.
Limitations
- The paper does not include a dedicated limitations section. It states that explicit guidance for implementation feasibility or pilot trials was previously absent, that “little guidance is available” for progression criteria, and that formal reporting guidelines do not exist for hybrid trial designs.
- It acknowledges that randomised designs can be particularly challenging in implementation science, where research is often conducted in real-world contexts with pragmatic constraints, and that users of non-randomised pilot designs must interpret the guidance in that context.
- Evident from the text: the guidance is based on expert group discussion, literature synthesis, and commentary rather than a systematic review or empirical validation, and it is presented as a first step toward standardised guidelines rather than definitive standards.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
33 Valid · 2 Not valid · 7 Not checked · 4 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Feasibility and pilot studies play an important role in improving the conduct and quality of a definitive randomised controlled trial (RCT) for both intervention and implementation trials [10].”
§ Guidance for conducting feasibility and pilot studies for implementation trials > Background
What the sources say
- Partly supportedcites [10] Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, et al. Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework. PLoS One. 2016;11(3):e0150205. sourceExperimental — accuracy not yet measured
The Introduction describes feasibility and pilot studies as preparation for a definitive RCT assessing the effect of an intervention, and the Results explain that pilot studies test whether elements of that trial can be carried out. This supports their role in improving the design and conduct of intervention trials. The paper does not establish the same claim for implementation trials; it explicitly limits its focus to RCTs assessing intervention effects. Page numbers were not provided in our copy. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Non-hybrid pilot implementation studies are undertaken in the absence of a broader effectiveness trial. Such studies typically occur when the effectiveness of a clinical or public health intervention is well established, but robust strategies to promote its broader uptake and integration into clinical or public health services remain untested [15].”
§ Guidance for conducting feasibility and pilot studies for implementation trials > Guidance > Purpose (aims)
What the sources say
- Partly supportedcites [15] Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7. sourceExperimental — accuracy not yet measured
The “Will It Work?” section (page unavailable) says that, ideally, an intervention has shown efficacy and effectiveness before broad implementation, when feasibility questions about dissemination and integration arise. The “Appropriate Areas of Focus” section (page unavailable) also identifies implementation and integration as subjects of feasibility research. The paper does not establish that non-hybrid pilot implementation studies typically occur at this stage or that robust uptake strategies remain untested. (LLM, conf=0.82)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Specifically, unlike traditional feasibility and pilot studies that may include the preliminary testing of interventions on individual clinical or public health outcomes, implementation feasibility and pilot studies that explore strategies to improve intervention implementation often require assessing changes across multiple levels including individuals (e.g. service providers or clinicians) and”
§ Guidance for conducting feasibility and pilot studies for implementation trials > Background
What the sources say
- Partly supportedcites [21] Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38(1):4–23. sourceExperimental — accuracy not yet measured
The Introduction and Active Implementation Phase describe implementation as involving individuals, organizations, and wider service systems. The Discussion and Conclusions also calls for measures of implementation progress. The paper does not specifically discuss feasibility or pilot studies or say that those studies often require assessing changes at multiple levels. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, given the differences between implementation trials and conventional clinical or public health efficacy trials, the field of implementation science has identified the need for nuanced guidance [14–16, 19, 20].”
§ Guidance for conducting feasibility and pilot studies for implementation trials > Background
What the sources say
- Partly supportedcites [14] Levati S, Campbell P, Frost R, Dougall N, Wells M, Donaldson C, et al. Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used. Pilot Feasibility Stud. 2016;2:17. sourceExperimental — accuracy not yet measured
The Background (page unavailable) identifies limited guidance on choosing methods to optimise complex health interventions before a full-scale RCT. It does not identify a need for guidance arising from differences between implementation trials and conventional clinical or public health efficacy trials; that trial comparison is unsupported. (LLM, conf=0.82)
- Partly supportedcites [15] Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7. sourceExperimental — accuracy not yet measured
The Introduction says guidance and standards for feasibility studies are needed, and “Relating to the Real World” contrasts highly controlled efficacy trials with research suited to practice settings. The paper does not specifically identify a need for guidance on implementation trials as distinct from conventional efficacy trials. Page numbers are unavailable in our copy. (LLM, conf=0.85)
- Could not verifycites [16] Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58(2):107–12. sourceExperimental — accuracy not yet measured
Two searches of Eccles et al. (2005), “Changing the behavior of healthcare professionals,” returned no paper-scoped snippets, so the cited paper could not be checked against this specific claim. An unscoped search found closely related wording about pragmatic implementation trials and the need for guidance in “Guidance for conducting feasibility and pilot studies for implementation trials” (score 0.599). That match is below the rubric’s threshold for misattribution, and it does not establish that Eccles et al. did not also support the multi-citation sentence. (LLM, conf=0.64)
- Supportedcites [19] Proctor EK, Powell BJ, Baumann AA, Hamilton AM, Santens RL. Writing implementation research grant proposals: ten key ingredients. Implement Sci. 2012;7:96. sourceExperimental — accuracy not yet measured
Proctor et al. (2012), “Writing implementation research grant proposals: ten key ingredients,” explicitly recommends differentiating implementation research from efficacy and effectiveness research and describes methodological challenges that call for tailored guidance. A paper-scoped snippet also says that, unlike efficacy and effectiveness studies, implementation research often requires adapting an intervention to local context. The prior weak-match verdict overlooked these relevant passages; the cited paper does not make a contrary argument. (LLM, conf=0.87)
- Supportedcites [20] Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21(Suppl 2):S1–8. source
The 'Need for FE in Implementation/QI Research' section says traditional study designs alone are often inadequate for evaluating complex implementation efforts and that randomized trials can leave questions about wider uptake unanswered. The 'Challenges of Conducting FE' section contrasts fixed interventions in well-controlled trials with the adaptation sometimes needed in implementation research. Together, these passages support the stated need for more nuanced guidance; page numbers were not available in our copy. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“We focus on randomised trials as such designs are the most common trial design in implementation research, and randomised designs may provide the most robust estimates of the potential effect of implementation strategies [46].”
§ Guidance for conducting feasibility and pilot studies for implementation trials > Method
What the sources say
- Could not verifycites [46] McKay H, Naylor PJ, Lau E, Gray SM, Wolfenden L, Milat A, et al. Implementation and scale-up of physical activity and behavioural nutrition interventions: an evaluation roadmap. Int J Behav Nutr Phys Act. 2019;16(1):102. sourceExperimental — accuracy not yet measured
The Methods (Research design; page unavailable) describe a modified Delphi study, while the Results (Implementation determinants and outcomes; page unavailable) concern indicators for evaluating implementation and scale-up. Searches for randomised or randomized designs and robust estimates found no passage comparing trial designs or saying that randomisation provides the most robust estimates of implementation-strategy effects. (LLM, conf=0.76)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
19 more claims · 16 with their cited sources checked
Create a free account to see all 46 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 11
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“we identified 30 such guidelines and recommendations relevant to our aim [2, 10, 14, 15, 17, 18, 23–45].”
§ Guidance for conducting feasibility and pilot studies for implementation trials > Method
Reported 30 · recomputed 29
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Guidance for conducting feasibility and pilot studies for implementation trials > Guidance > Measures
“These outcomes are described in Table 2, including definitions and examples of how they may be applied to the implementation component of innovation being piloted.”
§ Guidance for conducting feasibility and pilot studies for implementation trials > Guidance > Measures
“Table: Table 3 Illustrations of implementation strategy measures for use in feasibility and pilot implementation studiesa [15, 17, 44, 46, 60, 62, 65, 68, 70–72]”
Citations
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963
Research works printed but not linked: 3
- Peters DH, Nhan TT, Adam T. Implementation research: a practical guide; 2013.
- Medical Research Council. A framework for development and evaluation of RCTs for complex interventions to improve health. London: Medical Research Council; 2000.
- Department of Veterans Health Affairs. Implementation Guide. Health Services Research & Development, Quality Enhancement Research Initiative. 2013.
Cited by
Reflections on 10 years of effectiveness-implementation hybrid studies
Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1053496 · Cited by 299
“At the same time, many in the field currently recommend exploring “implementability” of interventions very early in their development (24, 25) (or adaptation), and there are numerous published hybrid type 1 “pilot” studies (8, 26, 27) indicating a recognition of the value of considering implementation factors very ear…”
BackgroundApplying mixed methods to pilot feasibility studies to inform intervention trials
Aschbrenner, K. A., Kruse, G., Gallo, J. J., & Plano Clark, V. L. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01178-x · Cited by 175
“to examine with mixed methods In the context of intervention development research, several domains of feasibility are often of interest [46, 49].”
MethodChomutare, T., Tejedor, M., Svenning, T. O., Marco-Ruiz, L., Tayefi, M., Lind, K., Godtliebsen, F., Moen, A., Ismail, L., Makhlysheva, A., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192316359 · Cited by 183
Beets, M. W., von Klinggraeff, L., Weaver, R. G., Armstrong, B., & Burkart, S. A. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00909-w · Cited by 123
“It eliminates the ability to evaluate the impact of deviations from intervention delivery protocol (i.e., fidelity) which can prove invaluable during the early design stage when attempting to determine if changes to one or more intervention components is required [10].”
Dietary Management of Heart Failure: DASH Diet and Precision Nutrition Perspectives
Wickman, B. E., Enkhmaa, B., Ridberg, R. A., Romero, E., Cadeiras, M., Meyers, F., & Steinberg, F. M. (2021) · Nutrients · doi:10.3390/nu13124424 · Cited by 135
Metadata
- Authors
- Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L.
- Affiliations
- Hunter New England Local Health District (AU)
- University of Victoria (CA)
- University of British Columbia (CA)
- Corresponding author
- Pearson, Nicole
- Venue
- Pilot and Feasibility Studies
- Published
- 2020-10-31
- Volume
- 6
- Issue
- 1
- Pages
- 167-167
- ISSN
- 2055-5784 (ISSN-L)
- PMC
- PMC7603668
- OpenAlex
- W3096392826
- Cited by
- 475
- References
- 76
- Citations by year
- 2026: 92 · 2025: 110 · 2024: 124 · 2023: 77 · 2022: 50 · 2021: 19
- FWCI
- 38.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- Pilot and Feasibility Studies (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- cIRcle (University of British Columbia) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- NOVA (University of Newcastle Australia) (submittedVersion, cc-by)
- Funders
- National Health and Medical Research Council (APP1128348)
- National Heart Foundation of Australia (101175)
- Canada Research Chairs
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- feasibility study, pilot study, implementation trial, implementation science, implementation strategies, formative research, intervention uptake, reporting guidelines, causal mechanisms
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Guidance for conducting feasibility and pilot studies for implementation trials. https://app.cochat.ai/papers/10.1186/s40814-020-00634-w
- The paper
- Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020). Guidance for conducting feasibility and pilot studies for implementation trials. Pilot and Feasibility Studies. https://doi.org/10.1186/s40814-020-00634-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

