On the use of a pilot sample for sample size determination
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
To compute the sample size needed to achieve the planned power for a t ‐test, one needs an estimate of the population standard deviation δ. If one uses the sample standard deviation from a small pilot study as an estimate of δ, it is quite likely that the actual power for the planned study will be less than the planned power. Monte Carlo simulations indicate that using a 100(1 − γ) per cent upper one‐sided confidence limit on δ will provide a sample size sufficient to achieve the planned power in at least 100(1 − γ) per cent of such trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Consistent with recommended pilot sample sizes derived from commonly-used approaches for pilot and feasibility trials [28–30], the target sample size was N=60 (30 per group).”
In the citing paper
“Most methodological papers that focus on recommendations about sample size requirements for pilot trials assume that the main aim of such a trial is to estimate a quantitative measure such as the variance (or standard deviation) of an effect size to inform the sample size calculation for a future definitive RCT.”
From CONSORT 2010 statement: extension to randomised pilot and feasibility trials. (2016) · cites this paper as [57]
In the citing paper
“There is no consensus but recommendations vary from 10 to 12 per group through to 60–75 per group depending on the main objective of the study.”
From Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! (2021) · cites this paper as [8]
In the citing paper
“a minimum of 30 participants was considered enough to reach the aims of feasibility and to provide useful data to optimize a future RCT design.”
From Feasibility, acceptability, and preliminary efficacy of a blended transdiagnostic group CBT for the treatment of emotional disorders (2025) · cites this paper as Browne, 1995
In the citing paper
“there is growing evidence for the effectiveness of mindfulness courses for people with long-term medical conditions.”
From Distant delivery of a mindfulness-based intervention for people with Parkinson's disease: The study protocol of a randomised pilot trial (2017) · cites this paper as [23]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557
Statistical Principles in Experimental Design.
Geisser, S., & Winer, B. J. (1963) · Journal of the American Statistical Association · doi:10.2307/2283359 · Cited by 1,890
Statistical Power Analysis for the Behavioral Sciences
Wassertheil, S., & Cohen, J. (1970) · Biometrics · doi:10.2307/2529115 · Cited by 1,383
Statistical Methods in Epidemiology
(2012) · SpringerReference · doi:10.1007/springerreference_205629 · Cited by 1,124
STATISTICAL METHODS IN EPIDEMIOLOGY
Yu, S., & Wang, X. (2017) · Handbook of Medical Statistics · doi:10.1142/9789813148963_0018 · Cited by 224
A Correction for Biasing Effects of Pilot Sample Size on Sample Size Determination
Shiffler, R. E., & Adams, A. J. (1987) · Journal of Marketing Research · doi:10.1177/002224378702400309 · Cited by 8
An Empirical Assessment of Realized A-Risk when Testing Hypotheses'
Shiffler, R. E., & Harwood, G. B. (1985) · Educational and Psychological Measurement · doi:10.1177/0013164485454012 · Cited by 3
A Correction for Biasing Effects of Pilot Sample Size on Sample Size Determination
Shiffler, R. E., & Adams, A. J. (1987) · Journal of Marketing Research · doi:10.2307/3151643 · Cited by 2
Research works printed but not linked: 1
- Cochran W. G., 1977, Sampling Techniques
Cited by
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
“There are a number of relevant papers.[54-56] Amongst these, a recent paper by Whitehead et al suggests that size of a pilot trial should be related to the size of the future definitive trial.”
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Design and analysis of pilot studies: recommendations for good practice
Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j..2002.384.doc.x · Cited by 2,572
“A general rule of thumb is to take 30 patients or greater to estimate a parameter (Browne 1995).”
BackgroundMethodConsiderations in determining sample size for pilot studies
Hertzog, M. A. (2008) · Research in Nursing & Health · doi:10.1002/nur.20247 · Cited by 2,337
“This is consistent with findings in a simulation study by Browne (1995) that using the sample variance from a pilot study results in less than a 50% chance of having the planned power in the full study.”
ResultWhitehead, A. L., Julious, S. A., Cooper, C. L., & Campbell, M. J. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280215588241 · Cited by 1,936
Sim, J., & Lewis, M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.07.011 · Cited by 1,036
“We have, therefore, also provided the IFs corresponding to a range of confidence levels, including 80% confidenceda figure recommended by Browne [11] as a minimum for this purpose.”
BackgroundMethodBillingham, S. A., Whitehead, A. L., & Julious, S. A. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-104 · Cited by 962
“Trial description Pilot 50 30 (20, 45) [8, 114]”
BackgroundTeare, M. D., Dimairo, M., Shephard, N., Hayman, A., Whitehead, A., & Walters, S. J. (2014) · Trials · doi:10.1186/1745-6215-15-264 · Cited by 773
“A frequently reported problem with publicly funded RCTs is that the recruitment of participants is often slower or more difficult than expected, with many trials failing to reach their planned sample size within the originally envisaged trial timescale and trial-funding envelope.”
BackgroundMethodInfluentialGuidelines for designing and evaluating feasibility pilot studies
Teresi, J. A., Yu, X., Stewart, A. L., & Hays, R. D. (2022) · Medical Care · doi:10.1097/mlr.0000000000001664 · Cited by 734
Recommendations for Planning Pilot Studies in Clinical and Translational Research
Moore, C. G., Carter, R. E., Nietert, P. J., & Stewart, P. W. (2011) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2011.00347.x · Cited by 661
A simple formula for the calculation of sample size in pilot studies
Viechtbauer, W., Smits, L., Kotz, D., Budé, L., Spigt, M., Serroyen, J., & Crutzen, R. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.04.014 · Cited by 612
“However, because pilot studies are by definition conducted with small sample sizes, they usually do not provide accurate information about such parameters and therefore may lead to erroneous decisions when such estimates are used without further qualification [2,10].”
BackgroundIn, J. (2017) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2017.70.6.601 · Cited by 497
“Some studies recommend over 30 samples per group [20] while some suggest 12 per group [21].”
BackgroundSample size calculations for pilot randomized trials: a confidence interval approach
Cocks, K., & Torgerson, D. J. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.09.002 · Cited by 431
“Consequently, how would one undertake a meaningful sample size calculation? Nevertheless, some authors have made some suggestions of sample sizes for pilot trials with figures of 12 [5], 10 [6], and 15 [7] per group, 32 in total [8] for a two-arm trial or 50% of the total main trial’s sample size [9] (Table 1 for full…”
BackgroundLewis, M., Bromley, K., Sutton, C. J., McCray, G., Myers, H. L., & Lancaster, G. A. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00770-x · Cited by 330
Bell, M. L., Whitehead, A. L., & Julious, S. A. (2018) · Clinical Epidemiology · doi:10.2147/clep.s146397 · Cited by 280
“Using a pilot study’s SD to design a future sample size has been shown to often result in an underpowered study.(23,24) Thus, sensitivity analyses should be undertaken.”
Wang, X., Pacho, F., Liu, J., & Kajungiro, R. (2019) · Sustainability · doi:10.3390/su11010209 · Cited by 279
“A general rule of thumb recommended by Browne [73] is to take 30 respondents or more to estimate a parameter.”
BackgroundA brief overview of pilot studies and their sample size justification
Kunselman, A. R. (2024) · Fertility and Sterility · doi:10.1016/j.fertnstert.2024.01.040 · Cited by 263
Etanercept in Alzheimer disease: A randomized, placebo-controlled, double-blind, phase 2 trial
Butchart, J., Brook, L., Hopkins, V., Teeling, J., Püntener, U., Culliford, D., Sharples, R., Sharif, S., McFarlane, B., Raybould, R., et al. (2015) · Neurology · doi:10.1212/wnl.0000000000001617 · Cited by 248
Sample Sizes for Clinical Trials
Julious, S. A. (2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781584887409 · Cited by 225
Freeman, D., Waite, F., Startup, H., Myers, E., Lister, R., McInerney, J., Harvey, A. G., Geddes, J., Zaiwalla, Z., Luengo-Fernandez, R., et al. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00314-4 · Cited by 219
Liaw, S. Y., Tan, J. Z., Lim, S., Zhou, W., Yap, J., Ratan, R., Ooi, S. L., Wong, S. J., Seah, B., & Chua, W. L. (2023) · Nurse Education Today · doi:10.1016/j.nedt.2023.105718 · Cited by 223
Vinther, M., Risum, N., Svendsen, J. H., Møgelvang, R., & Philbert, B. T. (2021) · JACC: Clinical Electrophysiology · doi:10.1016/j.jacep.2021.04.003 · Cited by 211
Kieser, M., & Wassmer, G. (1996) · Biometrical Journal · doi:10.1002/bimj.4710380806 · Cited by 213
Moss-Morris, R., McCrone, P., Yardley, L., van Kessel, K., Wills, G., & Dennison, L. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.03.001 · Cited by 209
Sample Size Recalculation in Internal Pilot Study Designs: A Review
Friede, T., & Kieser, M. (2006) · Biometrical Journal · doi:10.1002/bimj.200510238 · Cited by 204
Mathiassen, S. E., Möller, T., & Forsman, M. (2003) · Ergonomics · doi:10.1080/0014013031000090125 · Cited by 196
“…priori estimates of study size (table 4, ns3) are, however, still subject to considerable uncertainty, since the ‘true’ variances are, in fact, stochastic variables by themselves as illustrated by their confidence intervals (table 3, rows 14 and 15; references: Browne 1995, Mathiassen et al. 2002).”
BackgroundCook, J., Hislop, J., Adewuyi, T., Harrild, K., Altman, D., Ramsay, C., Fraser, C., Buckley, B., Fayers, P., Harvey, I., et al. (2014) · Health Technology Assessment · doi:10.3310/hta18280 · Cited by 194
Vail, M. M. L. (1976) · PubMed · Cited by 152
Distress improves after mindfulness training for progressive MS: a pilot randomised trial
Bogosian, A., Chadwick, P., Windgassen, S., Norton, S., McCrone, P., Mosweu, I., Silber, E., & Moss-Morris, R. (2015) · Multiple Sclerosis Journal · doi:10.1177/1352458515576261 · Cited by 135
Re-calculating the sample size in internal pilot study designs with control of the type I error rate
Kieser, M., & Friede, T. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000415)19:7<901::aid-sim405>3.0.co;2-l · Cited by 132
Chan, A. W. K., Yu, D. S. F., & Choi, K. C. (2017) · Clinical Interventions in Aging · doi:10.2147/cia.s124604 · Cited by 135
ABC of Questionnaire Development and Validation for Survey Research
Yusoff, M. S. B., Arifin, W. N., & Hadie, S. N. H. (2021) · Education in Medicine Journal · doi:10.21315/eimj2021.13.1.10 · Cited by 195
Dhabhar, F. S., Saul, A. N., Holmes, T. H., Daugherty, C., Neri, E., Tillie, J. M., Kusewitt, D. F., & Oberyszyn, T. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033069 · Cited by 131
“the ‘‘medium’’ to ‘‘large’’ range [126], even after adjustment for the tendency of small samples to overestimate effect size [127,128].”
Spiering, W., Williams, B., der Heyden, J. V., van Kleef, M. E. A. M., Lo, R. H., Versmissen, J., Moelker, A. D., Kroon, A. A., Reuter, H., Ansel, G. M., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32337-1 · Cited by 126
Vranceanu, A.-M., Bannon, S., Mace, R., Lester, E., Meyers, E., Gates, M., Popok, P., Lin, A., Salgueiro, D., Tehan, T., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.20807 · Cited by 114
Mathiassen, S. E., Alex Burdorf, A., & van der Beek, A. J. (2002) · Journal of Electromyography and Kinesiology · doi:10.1016/s1050-6411(01)00028-1 · Cited by 113
Karlsson, E., Farahnak, P., Franzén, E., Nygren‐Bonnier, M., Dronkers, J., van Meeteren, N. L. U., & Rydwik, E. (2019) · PLoS ONE · doi:10.1371/journal.pone.0219158 · Cited by 117
What influences consumers to purchase organic food in developing countries?
Pacho, F. T. (2020) · British Food Journal · doi:10.1108/bfj-01-2020-0075 · Cited by 141
Mahfoud, F., Renkin, J. P., Sievert, H., Bertog, S. C., Ewen, S., Böhm, M., Lengelé, J., Wojakowski, W., Schmieder, R. E., van der Giet, M., et al. (2020) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2019.10.048 · Cited by 108
“Forty-five patients was considered an appropriate sample size for this feasibility trial and in accordance with available recommendations (15).”
MethodSheaves, B., Freeman, D., Isham, L., McInerney, J., Nickless, A., Yu, L.-M., Rek, S., Bradley, J., Reeve, S., Attard, C., et al. (2018) · Psychological Medicine · doi:10.1017/s0033291717003191 · Cited by 104
“A sample size of 30 has been recommended for use in pilot studies where the treatment effect is expected to be large (Browne, 1995).”
Underpowering in randomized trials reporting a sample size calculation
Vickers, A. J. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00141-0 · Cited by 102
“This is because the square of SD is proportional to a χ distribution, which can be noticeably skewed for small samples [14].”
BackgroundLee, Y.-K. (2021) · Sustainability · doi:10.3390/su13095077 · Cited by 164
“A pilot test was conducted in July 2020 for 30 Chinese undergraduate students at D university in Korea that did not form part of the sampling frame of the main study, so as to assert the reliability of the scales used the questionnaire [61,62].”
MethodDaCosta, R. S., Kulbatski, I., Lindvere‐Teene, L., Starr, D., Blackmore, K. M., Silver, J. I., Opoku, J., Wu, Y. C., Medeiros, P. J., Xu, W., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0116623 · Cited by 105
“Hence, the sample size of 28 patients was not based on a priori considerations of statistical power, but does meet the minimum number of subjects suggested by Browne to estimate parameters of interest in a pilot study (inclusion/exclusion criteria, recruitment, randomization, treatment, compliance, follow-up and selec…”
A comparison of methods for adaptive sample size adjustment
Friede, T., & Kieser, M. (2001) · Statistics in Medicine · doi:10.1002/sim.972 · Cited by 99
“the case of sample size calculation using the variance from an external pilot study [29; 30].”
Simpson, R., Mair, F. S., & Mercer, S. W. (2017) · BMC Neurology · doi:10.1186/s12883-017-0880-8 · Cited by 95
“Browne [37] has demonstrated that an ‘n’ of 30 is sufficient to allow estimates of sample size for an efficacy trial.”
BackgroundBeing Creative Makes You Happier: The Positive Effect of Creativity on Subjective Well-Being
Tan, C. Y., Chuah, C.-Q., Lee, S.-T., & Tan, C. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147244 · Cited by 145
“A minimum of 30 participants is required for conducting a pilot study [72].”
BackgroundMind–body therapy via videoconferencing in patients with neurofibromatosis: An RCT
Vranceanu, A.-M., Riklin, E., Merker, V. L., Macklin, E. A., Park, E. R., & Plotkin, S. R. (2016) · Neurology · doi:10.1212/wnl.0000000000003005 · Cited by 85
Sample size re‐estimation in cluster randomization trials
Lake, S. L., Kammann, E., Klar, N. S., & Betensky, R. A. (2002) · Statistics in Medicine · doi:10.1002/sim.1121 · Cited by 92
A threshold causal model for clinical trials with departures from intended treatment
Albert, J. M. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990715)18:13<1587::aid-sim141>3.0.co;2-z · Cited by 2
O’Callaghan, P., Branham, L., Shannon, C., Betancourt, T. S., Dempster, M., & McMullen, J. D. (2014) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2014.02.004 · Cited by 92
Effect of Rosuvastatin on Amnesia and Disorientation after Traumatic Brain Injury (NCT00329758)
Tapia-Pérez, J. H., Sánchez-Aguilar, M., Torres-Corzo, J. G., Gordillo‐Moscoso, A., Martínez-Pérez, P., Madeville, P., Mendoza, E. D. L. C., & Chalita-Williams, J. C. (2008) · Journal of Neurotrauma · doi:10.1089/neu.2008.0554 · Cited by 95
Chan, A. W. K., Yu, D. S. F., Choi, K. C., Lee, D., Sit, J. W. H., & Chan, H. Y. L. (2016) · Clinical Interventions in Aging · doi:10.2147/cia.s111927 · Cited by 94
Morrison, A. P., Law, H., Carter, L., Sellers, R., Emsley, R., Pyle, M., French, P., Shiers, D., Yung, A. R., Murphy, E., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30096-8 · Cited by 94
Moghavvemi, S., Lee, S. T., & Lee, S. P. (2018) · International Journal of Bank Marketing · doi:10.1108/ijbm-06-2017-0114 · Cited by 81
Lombardo, M., Giannini, D., Lombardo, G., & Serrao, S. (2017) · Ophthalmology · doi:10.1016/j.ophtha.2017.01.040 · Cited by 80
PCSK9 Inhibition During the Inflammatory Stage of SARS-CoV-2 Infection
Navarese, E. P., Podhajski, P., Gurbel, P. A., Grzelakowska, K., Ruscio, E., Tantry, U. S., Magielski, P., Kubica, A., Niezgoda, P., Adamski, P., et al. (2023) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2022.10.030 · Cited by 81
“Duration of hospital stay, d 16 (13-23) 22 (15-27) Intubation duration, d 10 (3-24) 19 (10-25) Time with noninvasive mechanical ventilation or high-flow nasal cannula, d 0 (0-1) 0 (0-1)”
BackgroundPoulin, P. A., Nelli, J., Tremblay, S., Small, R., Caluyong, M. B., Freeman, J., Romanow, H., Stokes, Y., Carpino, T., Carson, A., et al. (2016) · Pain Research and Management · doi:10.1155/2016/3092391 · Cited by 78
“In particular, Browne [32] suggested that using the upper limit of the 95% confidence interval of the population variance in the formula for sample size calculation would guarantee the planned power with a probability of at least 0.95.”
MethodInfluentialCapobianco, L., Reeves, D., Morrison, A. P., & Adrian Wells, A. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.11.045 · Cited by 79
Morrison, A. P., Pyle, M., Maughan, D., Johns, L., Freeman, D., Broome, M. R., Husain, N., Fowler, D., Hudson, J., MacLennan, G., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30248-0 · Cited by 74
Bogosian, A., Hughes, A., Norton, S., Silber, E., & Moss‐Morris, R. (2016) · British Journal of Health Psychology · doi:10.1111/bjhp.12201 · Cited by 75
Banerjee, S., Manley, K., Shaw, B., Lewis, L. S., Cucato, G. G., Mills, R., Rochester, M. A., Clark, A., & Saxton, J. (2017) · Supportive Care in Cancer · doi:10.1007/s00520-017-3991-2 · Cited by 91
“As the main purpose was to assess the feasibility of the exercise program, there was no formal sample size calculation but we aimed to recruit 60 patients [30 in each group) in accordance with published recommendations [22, 23].”
MethodMorrison, A. P., Burke, E., Murphy, E., Pyle, M., Bowe, S., Varese, F., Dunn, G., Chapman, N., Hutton, P., Welford, M., et al. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.04.024 · Cited by 72
“The proposed sample size is adequate to obtain reliable sample size estimates (Browne 1995), and facilitate the main aims of a pilot trial, including feasibility of trial procedures and a production of a realistic power calculation for a future definitive study.”
MethodCase, L. D., & Ambrosius, W. T. (2007) · Methods in molecular biology · doi:10.1007/978-1-59745-530-5_19 · Cited by 73
Interim Analysis and Sample Size Reassessment
Posch, M., & Bauer, P. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.01170.x · Cited by 72
“We did not investigate the case where upper confidence limits for the variance are used for sample size reassessment (Browne, 1995; Kieser and Wassmer, 1996) or estimates of ∆/σ (Proschan and Hunsberger, 1995).”
BackgroundStrawbridge, R., Tsapekos, D., Hodsoll, J. P., Mantingh, T., Yalın, N., McCrone, P., Boadu, J., Macritchie, K., Cella, M., Reeder, C., et al. (2019) · Bipolar Disorders · doi:10.1111/bdi.12968 · Cited by 79
Supino, P. G., BORER, J. S., Franciosa, J. A., Preibisz, J., Hochreiter, C. A., Isom, O. W., Krieger, K. H., Girardi, L. N., Bouraad, D., & Forur, L. (2008) · Journal of Cardiac Failure · doi:10.1016/j.cardfail.2008.10.003 · Cited by 80
El‐Jawahri, A., Jacobs, J. M., Nelson, A. M., Traeger, L., Greer, J. A., Nicholson, S., Waldman, L. P., Fenech, A. L., Jagielo, A. D., D’Alotto, J., et al. (2020) · Cancer · doi:10.1002/cncr.32680 · Cited by 67
Fança‐Berthon, P., Tenon, M., Bouter, S. L., Manfré, A., Maudet, C., Dion, A., Chevallier, H., Laval, J., & van Breemen, R. B. (2021) · Journal of Nutrition · doi:10.1093/jn/nxab087 · Cited by 83
Arora, A., Gupta, S., Devi, C., & Walia, N. (2023) · Benchmarking An International Journal · doi:10.1108/bij-10-2021-0621 · Cited by 95
Sample size justification in feasibility studies: moving beyond published guidance
Montgomery, R. N. (2025) · Pilot and Feasibility Studies · doi:10.1186/s40814-025-01675-9 · Cited by 88
Christiansen, M. B., Thoma, L. M., Master, H., Voinier, D., Schmitt, L., Ziegler, M. L., LaValley, M. P., & White, D. K. (2019) · Arthritis Care & Research · doi:10.1002/acr.23882 · Cited by 69
“The sample size for this study was based on the general notion for pilot studies to recruit at least 30 participants for each parameter and expect 20% to drop out (27,28).”
MethodSikkema, K. J., Mulawa, M. I., Robertson, C., Watt, M. H., Ciya, N., Stein, D. J., Cherenack, E. M., Choi, K. W., Kombora, M., & Joska, J. A. (2017) · AIDS and Behavior · doi:10.1007/s10461-017-2013-1 · Cited by 69
“A target sample size of 60 was chosen as adequate to examine the feasibility and acceptability of a pilot RCT with two conditions [43].”
MethodMeeting the information needs of women with breast cancer: Piloting a nurse-led intervention
Beaver, K., Twomey, M. S., Witham, G., Foy, S., & Luker, K. A. (2006) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2006.02.004 · Cited by 66
Ultra minimally invasive sonographically guided carpal tunnel release: An external pilot study
Capa‐Grasa, A., Rojo-Manaute, J. M., Rodríguez, F. C., & Martín, J. V. (2014) · Orthopaedics & Traumatology Surgery & Research · doi:10.1016/j.otsr.2013.11.015 · Cited by 62
“…size for our pilot study ( n = 40), several authors [24,27,28] have discussed that a sample size calculation is not necessary for pilot studies, suggesting that sample size should depend on the parameter(s) to be estimated and that a general rule of thumb is to take 30 patients or greater [24,38 .”
BackgroundQi, L.-Y., Yang, J., Yan, S., Tu, J., She, Y.-F., Li, Y., Chi, L.-L., Wu, B., & Liu, C. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.48817 · Cited by 75
The role of fMRI in drug development
Carmichael, O. T., Schwarz, A. J., Chatham, C. H., Scott, D., Turner, J. A., Upadhyay, J., Coimbra, A., Goodman, J. A., Baumgartner, R., English, B. A., et al. (2017) · Drug Discovery Today · doi:10.1016/j.drudis.2017.11.012 · Cited by 63
“If acquisition must occur at multiple field strengths to facilitate recruitment, analytic endpoints emphasizing within-subject designs are most amenable, although ways to account for variance across magnets exist [75,76].”
BackgroundMethodSaif, M. A. M., Hussin, N., Husin, M. M., Alwadain, A. S., & Chakraborty, A. (2022) · Sustainability · doi:10.3390/su141711043 · Cited by 102
Feasibility Study of Transcutaneous Electrical Nerve Stimulation (TENS) for Cancer Bone Pain
Bennett, M., Johnson, M. I., Brown, S., Radford, H. E., Brown, J. M., & Searle, R. D. (2009) · Journal of Pain · doi:10.1016/j.jpain.2009.08.002 · Cited by 71
Tarrant, M., Carter, M., Dean, S. G., Taylor, R. S., Warren, F. C., Spencer, A. E., Adamson, J., Landa, P., Code, C., & Calitri, R. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-025167 · Cited by 62
Greenberg, J., Popok, P., Lin, A. C., Kulich, R. J., James, P., Macklin, E. A., Millstein, R. A., Edwards, R. R., & Vranceanu, A. (2020) · JMIR Formative Research · doi:10.2196/18703 · Cited by 62
“However, across all approaches, randomized controlled trials (RCTs) have tended to report mostly short-term improvements with relatively small effect sizes [9,11-16].”
Behavioural intention to purchase organic food: Bangladeshi consumers' perspective
Kabir, M. R., & Islam, S. (2021) · British Food Journal · doi:10.1108/bfj-05-2021-0472 · Cited by 77
Maspero, C. M. N., Abate, A., Bellincioni, F., Cavagnetto, D., Lanteri, V., Costa, A., & Farronato, M. (2019) · Progress in Orthodontics · doi:10.1186/s40510-019-0293-x · Cited by 58
“Some studies suggested for the pilot study over 30 samples per group [30], while some recommend 12 per group [31].”
BackgroundBogosian, A., Hurt, C. S., Hindle, J. V., McCracken, L. M., Vasconcelos e Sa, D. A., Axell, S., Tapper, K., Stevens, J., Hirani, P. S., Salhab, M., et al. (2022) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/0891988720988901 · Cited by 55
“A trial of at least 30 participants is adequate for an efficacy trial.(26) Enrolment of 60 participants was planned, anticipating a 10% dropout rate by 3 months.”
BackgroundVitolins, M. Z., Griffin, L. P., Tomlinson, W. V., Vuky, J., Adams, P. T., Moose, D., Frizzell, B. A., Lesser, G. J., Naughton, M., Radford, J. E., et al. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2012.48.1432 · Cited by 58
Jebeile, H., Gow, M. L., Lister, N. B., Haghighi, M. M., Ayer, J. G., Cowell, C. T. C. T., Baur, L. A., & Garnett, S. P. (2019) · Journal of Nutrition · doi:10.1093/jn/nxz049 · Cited by 62
“A target sample size of 30 adolescents was thought to be sufficient to inform the practicalities of delivering an IER dietary pattern (14).”
BackgroundA brief summary of pilot and feasibility studies: Exploring terminology, aims, and methods
Donald, G. (2018) · European Journal of Integrative Medicine · doi:10.1016/j.eujim.2018.10.017 · Cited by 53
“Some suggest that n=30 can be sufficient for a power calculation (Browne 1995, Lancaster et al 2004) The inappropriate focus on reporting outcome measures and hypothesis testing in studies calling themselves pilots or feasibility studies has been widespread.”
BackgroundGonzález‐González, A. I., Schmucker, C. M., Nothacker, J., Nury, E., Dinh, T. S., Brueckle, M.-S., Blom, J. W., van den Akker, M., Röttger, K., Wegwarth, O., et al. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm10010091 · Cited by 59
“Before screening, a stepwise calibration exercise was performed on a sample of 30 studies [15], with the aim of achieving at least 80% agreement between reviewers.”
MethodAre Sample Sizes Clear and Justified in RCTs Published in Dental Journals?
Koletsi, D., Fleming, P. S., Seehra, J., Bagos, P. G., & Pandis, N. (2014) · PLoS ONE · doi:10.1371/journal.pone.0085949 · Cited by 53
“The main reasons for inadequate assumptions of variances are that the assumptions are based on initial piloting, with the researchers following exactly the same variances for a much larger RCT, disregarding the fact that variance is not fixed [11].”
BackgroundMethodCullington, H. E., Kitterick, P. T., Weal, M. J., & Gromada, M. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019640 · Cited by 61
Brown, J. S. L., Blackshaw, E., Stahl, D., Fennelly, L., McKeague, L., Sclare, I., & Michelson, D. (2019) · Journal of Adolescence · doi:10.1016/j.adolescence.2018.11.009 · Cited by 52
Johnson, M. J., Booth, S., Currow, D. C., Lam, L. T.-M., & Phillips, J. L. (2016) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2015.11.026 · Cited by 57
Foster, N. E., Bishop, A., Bartlam, B., Ogollah, R. O., Barlas, P., Holden, M. A., ISMAIL, K. M. K., Jowett, S. M., Kettle, C., Kigozi, J., et al. (2016) · Health Technology Assessment · doi:10.3310/hta20330 · Cited by 55
“recruitment rates, variation in key patient-reported outcome measures, treatment fidelity), using the rule of thumb of 30 patients or greater per group.(78)”
Hind, D., Parkin, J., Whitworth, V., Rex, S., Young, T. A., Hampson, L. V., Sheehan, J., Maguire, C., Cantrill, H., Scott, E., et al. (2017) · Health Technology Assessment · doi:10.3310/hta21270 · Cited by 65
“Sample size The sample size was based on a recommended minimum of 30 participants (15 per group) for feasibility objectives involving parameter estimation.(151) Assuming a dropout rate at 6 months of 20%, we set a target of randomising at least 40 participants (20 per group).”
MethodKaur, N., Figueiredo, S. M., Bouchard, V., Moriello, C., & Mayo, N. E. (2017) · Clinical Rehabilitation · doi:10.1177/0269215517692129 · Cited by 57
Lombardo, M., Serrao, S., Lombardo, G., & Schiano‐Lomoriello, D. (2019) · Journal of Cataract & Refractive Surgery · doi:10.1016/j.jcrs.2019.01.026 · Cited by 54
Validation of the RUDAS in Patients With a Middle-Level Education in Lima, Peru
Custodio, N., Montesinos, R., Lira, D., Herrera‐Pérez, E., Chavez, K., Hernández-Córdova, G., Cuenca, J., Gamboa, C., & Metcalf, T. (2019) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/1533317519869709 · Cited by 50
Zhang, H., Zhang, A., Liu, C., Xiao, J., & Wang, K. (2021) · Mindfulness · doi:10.1007/s12671-021-01618-4 · Cited by 50
“Although our final sample of participants completing the intervention (n = 51) is low, based on power analysis, we consider the sample size acceptable given that this study is a pilot feasibility trial (Browne, 1995).”
MethodHadlandsmyth, K., Dindo, L. N., Wajid, R., Sugg, S. L., Zimmerman, M. B., & Rakel, B. A. (2019) · Psycho-Oncology · doi:10.1002/pon.5209 · Cited by 48
Acupuncture for Irritable Bowel Syndrome – An Exploratory Randomised Controlled Trial
Reynolds, J. A., Bland, M., & MacPherson, H. (2008) · Acupuncture in Medicine · doi:10.1136/aim.26.1.8 · Cited by 53
Kang, H., Han, S. Y., Cho, J. H., Kim, E. J., Kim, D. U., Yang, J. K., Jeon, S., Park, G., & Lee, T. H. (2021) · Journal of Hepato-Biliary-Pancreatic Sciences · doi:10.1002/jhbp.1082 · Cited by 48
Metadata
- Authors
- Browne, R. H.
- Affiliations
- Texas Scottish Rite Hospital for Children (US)
- Corresponding author
- Browne, Richard H.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 1995-09-15
- Volume
- 14
- Issue
- 17
- Pages
- 1933-1940
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2130607817
- Cited by
- 1,007
- References
- 8
- Citations by year
- 2026: 66 · 2025: 115 · 2024: 129 · 2023: 103 · 2022: 98 · 2021: 119 · 2020: 76 · 2019: 48 · 2018: 30 · 2017: 48 · 2016: 46 · 2015: 22 · 2014: 19 · 2013: 20 · 2012: 12
- FWCI
- 1.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistics in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- sample size determination, pilot study, t-test, statistical power, sample standard deviation, Monte Carlo simulation
- MeSH terms
- Clinical Trials as Topic, Humans, Monte Carlo Method, Pilot Projects, Reproducibility of Results, Confidence Intervals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.