The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
The design and interpretation of pilot trials in clinical research in critical care
Abstract
BACKGROUND: Pilot trials are important to ensure that large randomized trials are rigorous, feasible, and economically justifiable. The objective of this review is to highlight the importance of randomized pilot trials and to describe key features of their design and interpretation using examples from critical care. METHODS: We searched MEDLINE (1997-2007) and contacted experts to identify pilot randomized trials to exemplify and summarize their key methodologic features including objectives, sample size determination, outcomes, analysis, and reporting. RESULTS: Pilot trials can have distinct and broad objectives. Investigators can predefine explicit criteria for determining their success. Surrogate outcome analyses are common in pilot trials, yet are usually underpowered to detect meaningful differences in clinically important end points and thus, should be cautiously interpreted. Pilot trials can facilitate successful conduct of large clinical trials by informing study design and streamlining protocol implementation. RECOMMENDATIONS: We recommend that investigators define suitable objectives, determine sample size estimates, and select outcomes that will address their specific pilot trial objectives. Clinical effects documented in pilot trials should be reported with caution to avoid undue enthusiasm or pessimism about unstable estimates. Further methodologic work is required to identify optimal pilot trial design, indexing, and reporting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2000) · New England Journal of Medicine · doi:10.1056/nejm200005043421801 · Cited by 12,941
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
Design and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702 · cited 7×
“Data from a pilot trial can provide important insight into the challenges and determinants of protocol adherence for subsequent large RCTs.”
BackgroundInfluentialBrower, R. G., Shanholtz, C. B., Fessler, H. E., Shade, D. M., White, P., Wiener, C. M., Teeter, J. G., Dodd-o, J. M., Almog, Y., & Piantadosi, S. (1999) · Critical Care Medicine · doi:10.1097/00003246-199908000-00015 · Cited by 575
Cited by
A tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
What is a pilot or feasibility study? A review of current practice and editorial policy
Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-67 · Cited by 1,483
Teare, M. D., Dimairo, M., Shephard, N., Hayman, A., Whitehead, A., & Walters, S. J. (2014) · Trials · doi:10.1186/1745-6215-15-264 · Cited by 773
Recommendations for Planning Pilot Studies in Clinical and Translational Research
Moore, C. G., Carter, R. E., Nietert, P. J., & Stewart, P. W. (2011) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2011.00347.x · Cited by 661
In, J. (2017) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2017.70.6.601 · Cited by 497
Pai, M., Lloyd, N. S., Cheng, J., Thabane, L., Spencer, F. A., Cook, D. J., Haynes, R. B., Schünemann, H. J., & Douketis, J. D. (2013) · Implementation Science · doi:10.1186/1748-5908-8-1 · Cited by 376
Self-citationPilot and feasibility studies come of age!
Lancaster, G. A. (2015) · Pilot and Feasibility Studies · doi:10.1186/2055-5784-1-1 · Cited by 260
Questions asked and answered in pilot and feasibility randomized controlled trials
Shanyinde, M., Pickering, R. M., & Weatherall, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-117 · Cited by 229
“Thromboembolism in Critical Care Trial (PROTECT) [62], also reviewed by Arnold et al [3].”
BackgroundInfluentialThabane, L., Hopewell, S., Lancaster, G. A., Bond, C. M., Coleman, C. L., Campbell, M. J., & Eldridge, S. M. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0065-z · Cited by 216
Should treatment effects be estimated in pilot and feasibility studies?
Sim, J. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0493-7 · Cited by 123
“[24], would be satisfied if the MID lies within (rather than necessarily below) the CI, suggesting that the MID is among the plausible values of the effect”
BackgroundAcceptance checklist for clinical effectiveness pilot trials: a systematic approach
Charlesworth, G., Burnell, K., Hoe, J., Orrell, M., & Russell, I. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-78 · Cited by 87
Connolly, B., Thompson, A., Douiri, A., Moxham, J., & Hart, N. (2015) · Journal of Critical Care · doi:10.1016/j.jcrc.2015.02.002 · Cited by 81
A brief summary of pilot and feasibility studies: Exploring terminology, aims, and methods
Donald, G. (2018) · European Journal of Integrative Medicine · doi:10.1016/j.eujim.2018.10.017 · Cited by 53
Bench, S., Day, T., Heelas, K., Hopkins, P., White, C., & Griffiths, P. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-006852 · Cited by 49
Cognitive Analytic Therapy for Bipolar Disorder: A Pilot Randomized Controlled Trial
Evans, M., Kellett, S., Heyland, S., Hall, J., & Majid, S. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2065 · Cited by 48
Delaney, C., Barrere, C., & Helming, M. (2011) · Journal of Holistic Nursing · doi:10.1177/0898010110378356 · Cited by 45
LeBlanc, A., Légaré, F., Labrecque, M., Godin, G., Thivierge, R., Laurier, C., Côté, L., O'Connor, A. M., & Rousseau, M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-5 · Cited by 37
Rahmadiana, M., Karyotaki, E., Passchier, J., Cuijpers, P., van Ballegooijen, W., Wimbarti, S., & Riper, H. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.11.002 · Cited by 25
Purcell, A., Buckley, T., King, J., Moyle, W., & Marshall, A. P. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0312-6 · Cited by 6
“Therefore, in line with current recommendations, we conducted a pragmatic, external pilot, parallel group, randomised controlled trial (RCT) to evaluate the protocol implementation which would inform a larger trial [9].”
Method
Metadata
- Authors
- Arnold, D. M., Burns, K. E. A., Adhikari, N. K. J., Kho, M. E., Meade, M. O., & Cook, D. J.
- Venue
- Critical Care Medicine
- Published
- 2009-01
- Volume
- 37
- Issue
- Supplement
- Pages
- S69-S74
- ISSN
- 0090-3493 (ISSN-L)
- OpenAlex
- W2138013284
- Cited by
- 214
- References
- 5
- FWCI
- 4.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.