The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Initial Scale Development: Sample Size for Pilot Studies
Abstract
Pilot studies are often recommended by scholars and consultants to address a variety of issues, including preliminary scale or instrument development. Specific concerns such as item difficulty, item discrimination, internal consistency, response rates, and parameter estimation in general are all relevant. Unfortunately, there is little discussion in the extant literature of how to determine appropriate sample sizes for these types of pilot studies. This article investigates the choice of sample size for pilot studies from a perspective particularly related to instrument development. Specific recommendations are made for researchers regarding how many participants they should use in a pilot study for initial scale development.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Johanson & Brooks (2010) did recommend a sample size of 12 participants per arm for pilot trials.”
From A Feasibility and Pilot Randomised Dismantling Trial of the Efficacy of Self-As-Context During Acceptance and Commitment Therapy. (2021) · cites this paper as Johanson & Brooks (2010)
In the citing paper
“As the current study was below the average (Billingham etal., 2013) and below the recommended (Johanson & Brooks, 2010) sample size”
From A Feasibility and Pilot Randomised Dismantling Trial of the Efficacy of Self-As-Context During Acceptance and Commitment Therapy. (2021) · cites this paper as Johanson & Brooks, 2010
Citations
Cites
Sample size of 12 per group rule of thumb for a pilot study
Julious, S. A. (2005) · Pharmaceutical Statistics · doi:10.1002/pst.185 · Cited by 3,068
Considerations in determining sample size for pilot studies
Hertzog, M. A. (2008) · Research in Nursing & Health · doi:10.1002/nur.20247 · Cited by 2,337
Handbook in research and evaluation
(1971) · Behavior Therapy · doi:10.1016/s0005-7894(71)80129-6 · Cited by 1,488
Bootstrapping: A Nonparametric Approach to Statistical Inference.
Aa, Mooney, C. Z., & Duval, R. D. (1994) · Journal of the American Statistical Association · doi:10.2307/2290969 · Cited by 1,365
Mooney, C., & Duval, R. (1993) · doi:10.4135/9781412983532 · Cited by 893
Statistical Inference for Coefficient Alpha
Feldt, L. S., Woodruff, D. J., & Salih, F. A. (1987) · Applied Psychological Measurement · doi:10.1177/014662168701100107 · Cited by 526
van Belle, G. (2002) · Wiley-Interscience eBooks · Cited by 461
Nelson, L. S. (2003) · Journal of Quality Technology · doi:10.1080/00224065.2003.11980200 · Cited by 422
WHAT SAMPLE SIZE is "ENOUGH" in INTERNET SURVEY RESEARCH?
Hill, R. L., & Hamilton, W. P. (1998) · Cited by 359
By Design: Planning Research on Higher Education.
Centra, J. A., Light, R. L., Singer, J. D., & Willett, J. B. (1991) · The Journal of Higher Education · doi:10.2307/1982292 · Cited by 266
Research works printed but not linked: 3
- Crocker, L., 1986, Classical and modern test theory
- Hill, R., 1998, Interpersonal Computing and Technology: An Electronic Journal for the 21st Century, 6
- Lowry, R., 2008, VassarStats: Website for statistical calculation
Cited by
Sorted by citations
Items 701–800 of 998
Jack, L. (2014) · Faculty of Health; Institute of Health and Biomedical Innovation; School of Nursing
Altowaijri, A. M. (2014) · ORCA Online Research @Cardiff (Cardiff University)
Azarian, M. S., Yunus, Y. A., & Dahlan, A. R. A. (2013)
Burley, T. (2014) · Libraries and Cultural Resources (University of Calgary) · doi:10.11575/prism/28627
An active approach to diabetes self-management
Breland, J. Y. (2013) · doi:10.7282/t3p55khp
Vertel, N. (2013) · cIRcle (University of British Columbia) · doi:10.14288/1.0074150
Sustainability of CSR Projects: A Strategic Approach
Fie, D. Y. G., & Medis, A. (2016) · Journals & Books Hosting (International Knowledge Sharing Platform)
Strategic Focus of CSR towards Sustainability: A Sri Lankan Perspective
Medis, A., Fie, D. Y. G., Khatibi, A., & Azam, S. M. F. (2016) · Journals & Books Hosting (International Knowledge Sharing Platform)
Escuela Universitaria de enfermería
Tejedo, I. S. (2012)
Al-Azzam, M. (2017) · Liverpool John Moores University · doi:10.24377/ljmu.t.00005164
Carter, W. R. (2015) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc804843
Haeger, D. L. (2014) · OhioLink ETD Center (Ohio Library and Information Network)
Solheim, J. (2017) · University Library - University of Saskatchewan (University of Saskatchewan)
Dressing and Securement of Peripheral Arterial Catheters: A Pilot Randomised Controlled Trial
Reynolds, H. (2014) · Griffith Research Online · doi:10.25904/1912/286
Climate change denial: the effects of ideological polarisation and threat
Clarke, E. J. R. (2017) · Figshare
Balubaid, S., Zin, R. M., & Mydin, S. H. (2018) · International Journal on Advanced Science Engineering and Information Technology · doi:10.18517/ijaseit.8.3.4191
“A sample size of 25 respondents was considered to conduct a pilot study as recommended by [29] for developing a quantitative instrument.”
MethodLin, T.-J., & Chien-Hsiung, C. (2018) · doi:10.11247/jsd.1.2_2_1
Managing Data-Driven Change: A Model of Unintended Deviation
Cho, S.-M. R. (2018) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/14279593
Ling, C. K., Effendi, R. A. A. R. A., Dolah, M. S., Ramli, S. H., & Bolong, J. (2018) · International Journal of Engineering & Technology · doi:10.14419/ijet.v7i4.15.23002
Antecedents of Customer Perceived Brand Innovativeness inOnline Brand Communities
Abdelhameed, K. A. M. (2018)
Al-Hakeem, A. A., Hassan, A., Meri, A., Dauwed, M., Jarrar, M., Shyaa, M. A., Ibrahim, H. M., & Al‐Bsheish, M. (2019) · Journal of Advanced Research in Dynamical and Control Systems
Liu, Y., Tan, T. X., Li, D., & Xu, Y. (2019) · International Journal for the Advancement of Counselling · doi:10.1007/s10447-019-09389-3
The Design and Evaluation of an Innovative Head Mounted Display Counselling Tool for Warfarin
Prenzler, S. (2019) · Griffith Research Online · doi:10.25904/1912/3466
van Laar, E. (2019) · doi:10.3990/1.9789036548670 · Cited by 1
Yusoff, H. M., Hamzah, M. I., & Surat, S. (2019) · Jurnal Pendidikan Malaysia · doi:10.17576/jpen-2019-44.02-07
Driving in the wrong lane : towards a change in paradigm for optimal passenger car lifespans
Rodrigues, A. (2018) · Nottingham Trent University's Institutional Repository (Nottingham Trent Repository)
DEVELOPMENT, VALIDITY AND RELIABILITY OF FIRE AND RESCUE OFFICER TRAUMATIC EVENT CHECKLIST
Salleh, M. N. M., Ismail, H., & Yusoff, H. M. (2020) · International Journal of Public Health and Clinical Sciences
Faridah, T. R., & Yuserrie, Z. (2017) · UMP Institutional Repository (Universiti Malaysia Pahang)
Dispositional, Place Perceptions, and Imagination: The Interactive Network of Authenticity
Chao, Y. (2020) · Journal of International Crisis and Risk Communication Research
Association of blood uric acid with the duration of diabetes in type 2 diabetics: A pilot study
Pinjar, M. J., Chandini, K., & Manogna, G. (2021) · Indian Journal of Clinical Anatomy and Physiology · doi:10.18231/j.ijcap.2020.070
Lee, B. (2020) · Digital Commons-TMC (Texas Medical Center)
Author, U. (2019) · Lincoln Repository (University of Lincoln) · doi:10.24385/lincoln.24326263
Joe‐Ikechebelu, N. N., Um, U., Azuike, E. C., Okechukwu, C. E., Akanwa, A. O., Ngene, W. O., & Be, N. (2021) · International Journal Of Medical Science And Clinical Invention · doi:10.18535/ijmsci/v8i05.04
“Ilorin west, Nigeria: Nathadex publishers; 2004 [25] Johanson GA, Brooks GP.”
Hlungwani, T. (2021) · Unisa Institutional Repository (University of South Africa)
A STUDY ON DEVELOPING A SELF-EFFICACY SCALE: SAMPLE OF KYRGYZ PROSPECTIVE TEACHERS
Özen, Y. (2021) · The Journal of International Educational Sciences · doi:10.29228/inesjournal.50635
Circular Economy: Exploratory Study of Steel Industry in Thailand
Piyathanavong, V., Garza‐Reyes, J. A., Huynh, V., Olapiriyakul, S., & Karnjana, J. (2021) · International Conference on Industrial Engineering and Operations Management (IEOM) · doi:10.46254/an11.20210001
“Lieder and Rashid (2016) and Zhang et al. (2019) highlight some barriers or missing initiatives to support CE implementation in the manufacturing sector. They include the lack of support from the government, lack of environmental regulations and laws, lack of resources, and lack of environmental awareness. Furthermore…”
BackgroundIsa, Z. M. (2021) · Medicine & health · doi:10.17576/mh.2021.1601.02
“In the aforementioned study, increasing the sample size impacted the Pearson correlations, length of the confidence interval, and Cronbach’s α coefficient beginning from when the sample size was 30, no matter what number of the items (Johanson & Brooks 2010).”
Effects of acupuncture at acupoints along lung meridian on cervical spondylosis of cervical type
Fan, L., Lu, G., Yuan, H., Wang, X., & Qiao, H. (2021) · Medicine Case Reports and Study Protocols · doi:10.1097/md9.0000000000000125
Analisis Statistik Kesahan dan Kebolehpercayaan Ujian Pencapaian Reka Bentuk Elektrik
Isa, Z. C., & Azid, N. (2021) · Malaysian Journal of Social Sciences and Humanities (MJSSH) · doi:10.47405/mjssh.v6i8.904
Creating competitive advantage through combined assurance in South African organisations
Madondo, L. N. (2021) · Unisa Institutional Repository (University of South Africa)
Ramia, I., Powell, A., Stratton, K., Stokes, C., Meltzer, A., & Muir, K. (2021)
Assessment of relationship between management policies and transfer of skills
Mburu, F. W., Kamau, A. W., & Macharia, S. M. (2021) · International Journal of Research in Business and Social Science (2147-4478) · doi:10.20525/ijrbs.v10i6.1324
Initial validation of the global assessment of severity of illness
Tompke, B. K., Chaurasia, A. K., Perlman, C. M., Speechley, K. N., & Ferro, M. A. (2021) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-021-00260-w · Cited by 1
“…scale validation, the study sample size was considered appropriate based on the size recommended for initial validation in pilot studies (n ≥ 24) (Johanson and Brooks 2010) and based on a minimum of 10–20 participants per scale item as recommended often in the literature (Anthoine et al.”
BackgroundMethodModel Pengaruh Knowledge Management terhadap Kinerja Logistics Service Provider
Pramadi, M. I., Ardi, R., & Zulkarnain, Z. (2021) · Jurnal Optimasi Teknik Industri (JOTI) · doi:10.30998/joti.v3i1.7733
Preparedness and Attributes of COVID-19 among Malaysian Public during the Movement Control Order
Mohamad, S. N. S., Mohamad, S. F. S., Ismail, S., Mohideen, F. B. S., Rosli, F. A., & Rahman, N. F. A. (2021) · Malaysian Journal of Science Health & Technology · doi:10.33102/mjosht.v7i2.170
“Subsequently, it was piloted among 30 respondents, which were deemed sufficient for its validity [6].”
BackgroundPadilla-Medina, D. M., Gilbar, O., & Williams, J. R. (2021) · Journal of Family Violence · doi:10.1007/s10896-021-00341-x · Cited by 1
STUDI AWAL ADAPTASI ALAT UKUR LEISURE SATISFACTION DI INDONESIA
Siregar, M. E. L., & Grasiaswaty, N. (2021) · Personifikasi Jurnal Ilmu Psikologi · doi:10.21107/personifikasi.v12i2.11690
Ali, F. H., & Bandi, S. (2021) · Journal of Information System and Technology Management · doi:10.35631/jistm.624012
“The number of pilot sample was finalized based on scholars’ view where they mentioned the need to obtain at least 30 respondents (Johanson & Brooks, 2010; Whitehead, Julious, Cooper, & Campbell, 2016).”
BackgroundQuestionário "Mosaico de Opiniões Sobre o Aborto Induzido"
Cacique, D. B. (2017) · doi:10.47749/t/unicamp.2017.990200
Validation of Newly Developed Questionnaire Islamic Work Ethics Questionnaire – A pilot study
Khan, F. M., Rafiq, A., Mirza, H. H., Mehdi, S. Z., & Saeed, S. (2021) · Pakistan Journal of Medical and Health Sciences · doi:10.53350/pjmhs2115123759
Feasibility of using moral injury screening instruments in VA chaplaincy spiritual assessments
Kopacz, M. S., Bishop, T. M., Ayre, A., Boska, R. L., Goldstrom, D., Tomberlin, D., Baxter, S., Dunlap, S. W., & Harris, J. I. (2022) · Journal of Health Care Chaplaincy · doi:10.1080/08854726.2022.2032980 · Cited by 1
Nelson, J. W., Felgen, J. A., & Hozak, M. A. (2021) · doi:10.1002/9781119747826.refs
Reply to Damberg and Pellas (2022) on the FAB-Swe
Ilardi, C. R. (2022) · Applied Neuropsychology Adult · doi:10.1080/23279095.2022.2051173
Classroom Attendance Scale Development and Validation Study
Akkuş, A. (2022) · European Journal of Science and Technology · doi:10.31590/ejosat.1063599
A imaginabilidade visual de itens nas perguntas de pesquisas de opinião em comunicação política
Henkel, K., & de Almeida, J. (2022) · Comunicação & Sociedade · doi:10.15603/2175-7755/cs.v43n3p111-135
Designing Questionnaires and Other Data Collection Instruments
Glewwe, P. W., & Todd, P. (2022) · World Bank, Washington, DC eBooks · doi:10.1596/978-1-4648-1497-6_ch18
Home monitoring of kidney function in cancer patients: assessing acceptability and clinical benefit
Ogden, L. (2019) · http://isrctn.com/ · doi:10.1186/isrctn11076307
(2020) · PeerJ · doi:10.7287/peerj.9210v0.2/reviews/3
“Such a pilot study could be useful in troubleshooting any potential 470 unforeseen issues prior to large-scale questionnaire administration (Johanson & Brooks, 2010).”
Appalasamy, J. R., Ramaiah, S. S., Joseph, J. P., Quek, K. F., Zain, A. Z. M., & Tha, K. K. (2019) · doi:10.2196/preprints.15950
Developing a Survey Instrument to Study Asset Misappropriation in the Malaysian Public Sector
Dani, R. M., Mansor, N., & Noor, N. R. A. M. (2022) · International Journal of Academic Research in Accounting Finance and Management Sciences · doi:10.6007/ijarafms/v12-i2/13230
“Additionally, Johanson and Brooks (2010) recommend a minimum of 30 representative participants for a pilot study involving the administration of a preliminary survey or the development of a new scale.”
BackgroundIsmail, R. I., Awang, J., & Ismail, I. (2022) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v12-i6/13916
“As Johanson and Brooks (2010) suggested a minimum number of 30 people for a pilot study is enough for validity and reliability for an initial study, Mohd Yusri (2017) recommends that 30 to 50 respondents are suitable and ideal for the pilot study.”
BackgroundKim, S.-Y., Cho, W. S., & Kim, B.-G. (2022) · The Journal of Korean Physical Therapy · doi:10.18857/jkpt.2022.34.3.104
Kadi, A. J., Kamal, E. M., Yusof, N., & Sakka, R. A. (2022) · Springer eBooks · doi:10.1007/978-981-16-2210-6_30
The technostress questionnaire: a pilot study
Finstad, G. L., & Giorgi, G. (2021) · Journal of Advanced Health Care · doi:10.36017/jahc2111-001 · Cited by 9
Food Waste and Household Logistics: A Critical Analysis between Malaysia and Bangladesh
Hossain, S. M. A., & Haque, M. (2022) · Asian Journal of Research in Business and Management · doi:10.55057/ajrbm.2022.4.2.12
Implementation of 5S Practice in University Electrical and Electronic Laboratories
Idris, U. P. S., Tang, J. R., Vengidason, S., Idris, U. P. S., Hanapi, Z., Idris, U. P. S., Kamal, M. F. M., Idris, U. P. S., & Mei, J. H. (2022) · Perspectives of science and education · doi:10.32744/pse.2022.1.11
PEMBANGUNAN MINDA REMAJA PERSPEKTIF ‘ULWAN: TINJAUAN TERHADAP AMALAN KELUARGA DI PUTRAJAYA
Raffar, I. N. A. Z., Ibhrim, Z., & HAMID, M. F. A. (2022) · MANU Jurnal Pusat Penataran Ilmu dan Bahasa (PPIB) · doi:10.51200/manu.v33i1.2404
Song, K. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.235039
Ridzuan, A. A.-M., Kamri, N. ʿ., & Yusoff, Z. M. (2022) · UMRAN - International Journal of Islamic and Civilizational Studies · doi:10.11113/umran2022.9n3.583
Rahim, F. A., Maat, S. M., & Surat, S. (2022) · Malaysian Journal of Social Sciences and Humanities (MJSSH) · doi:10.47405/mjssh.v7i11.1891
Thirty Years of Consanguineous Marriages in Pakistan
Bashir, S., & Nazir, S. (2023) · NUST Journal of Social Sciences and Humannities · doi:10.51732/njssh.v1i01.146
Rani, M. I. A., Zolkaflil, S., & Nazri, S. N. F. S. M. (2023) · International Journal of Asian Social Science · doi:10.55493/5007.v13i3.4737
Key challenges for rural destinations to meet the expectations of Generation Z travellers
Mondok, A., & Zámbó, Z. (2022) · Acta Carolus Robertus · doi:10.33032/acr.3419
Provencher, V., D’Amours, M., Carbonneau, H., Levasseur, M., Poulin, V., Filiatrault, J., Obradović, N., Drouin, L., & Giroux, D. (2023) · Loisir et Société / Society and Leisure · doi:10.1080/07053436.2023.2184096
Logistics and supply chain for mice cities
Sriraksa, C. (2020) · doi:10.58837/chula.the.2020.293
Deguchi, N., Tanaka, R., Hirakawa, Y., & Sasai, H. (2023) · Musculoskeletal Care · doi:10.1002/msc.1768
Mohamud, M. Z., & Jusoh, M. S. (2023) · AIP conference proceedings · doi:10.1063/5.0132797
Spiritual Assessment Scale Psychometric Testing
Yusof, F. B., Kadir, N. B. A., Zakaria, S. M., & Malik, N. A. (2023) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v13-i6/17589
Kumari, S., Ahmad, I., Sharma, A., & Rizvi, M. R. (2023) · Turkish Journal Of Neurology · doi:10.4274/tnd.2023.05769
Bakar, S. N. A., Mahmood, N., Ismail, A., Hashim, A. M., Hamsan, N. Y., Hamid, N. I. N., & Yakzam, R. C. (2023) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v13-i6/17543
“According to Johanson & Brooks (2010), 30 is the minimum and sufficient number of respondents for analysing validity and reliability of a pilot study.”
BackgroundHandjaja, F. S., Rasmin, M., Prasenohadi, P., & Akmal, E. (2023) · Jurnal Respirologi Indonesia · doi:10.36497/jri.v43i3.456
“studied 1202 subjects and found that the difference in median APACHE II scores in patients living (14 [821]) and dying (19 [12-24]) during an ICU stay was significant, with a score difference of ±5.”
BackgroundRamli, M. A., & Aziz, N. (2023) · Accounting and Finance Research · doi:10.5430/afr.v12n3p57
Metadata
- Authors
- Johanson, G. A., & Brooks, G. P.
- Affiliations
- Ohio University (US)
- Corresponding author
- Johanson, George A.
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 2009-12-18
- Volume
- 70
- Issue
- 3
- Pages
- 394-400
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- OpenAlex
- W1984294110
- Cited by
- 1,012
- References
- 19
- Citations by year
- 2026: 134 · 2025: 115 · 2024: 110 · 2023: 99 · 2022: 89 · 2021: 104 · 2020: 83 · 2019: 67 · 2018: 49 · 2017: 34 · 2016: 33 · 2015: 29 · 2014: 25 · 2013: 19 · 2012: 13
- FWCI
- 9.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational and Psychological Measurement (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- pilot study, sample size determination, scale development, instrument development, item difficulty, item discrimination, internal consistency, response rate, parameter estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review