The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
Sample size requirements for the internal validation of psychiatric scales
Open accessAbstract
The ratio of subjects to variables (N/p), as a rule to calculate the sample size required in internal validity studies on measurement scales, has been recommended without any strict theoretical or empirical basis being provided. The purpose of the present study was to develop a tool to determine sample size for these studies in the field of psychiatry. First, a literature review was carried out to identify the distinctive features of psychiatric scales. Then, two simulation methods were developed to generate data according to: (1) the model for factor structure derived from the literature review and (2) a real dataset. This enabled the study of the quality of solutions obtained from principal component analysis or Exploratory Factor Analysis (EFA) on various sample sizes. Lastly, the influence of sample size on the precision of Cronbach's alpha coefficient was examined. The N/p ratio rule is not upheld by this study: short scales do not allow smaller sample size. As a rule of thumb, if one's aim is to reveal the factor structure, a minimum of 300 subjects is generally acceptable but should be increased when the number of factors within the scale is large, when EFA is used and when the number of items is small.Copyright © 2011 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Confirmatory factor analysis for applied research
(2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,614
Costello, A. B., & Osborne, J. (2005) · University of Massachusetts Amherst · doi:10.7275/jyj1-4868 · Cited by 10,297
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587
Sample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497
A First Course in Factor Analysis
Comrey, A. L., & Lee, H. B. (2013) · doi:10.4324/9781315827506 · Cited by 4,546
Factor analysis in the development and refinement of clinical assessment instruments.
Floyd, F. J., & Widaman, K. F. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.286 · Cited by 3,970
A First Course in Factor Analysis
Price, B. (1993) · Technometrics · doi:10.1080/00401706.1993.10485363 · Cited by 3,512
A User's Guide to Principal Components
Leigh, S., & Jackson, J. E. (1993) · Technometrics · doi:10.2307/1269292 · Cited by 3,332
A Meta-Analysis of Cronbach's Coefficient Alpha
Peterson, R. A. (1994) · Journal of Consumer Research · doi:10.1086/209405 · Cited by 3,028
psych: Procedures for Psychological, Psychometric, and Personality Research
Revelle, W. (2007) · CRAN: Contributed Packages · doi:10.32614/cran.package.psych · Cited by 2,965
Relation of sample size to the stability of component patterns.
Guadagnoli, E., & Velicer, W. F. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.2.265 · Cited by 2,880
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
A Use's Guide to Principal Components
Jackson, J. E. (1991) · Wiley Series in Probability and Statistics · doi:10.1002/0471725331 · Cited by 2,516
The Scientific Use of Factor Analysis in Behavioral and Life Sciences
Cattell, R. B. (1978) · doi:10.1007/978-1-4684-2262-7 · Cited by 2,165
THE APPLICATION OF EXPLORATORY FACTOR ANALYSIS IN APPLIED PSYCHOLOGY: A CRITICAL REVIEW AND ANALYSIS
FORD, J. K., MacCALLUM, R. C., & TAIT, M. (1986) · Personnel Psychology · doi:10.1111/j.1744-6570.1986.tb00583.x · Cited by 1,732
Minimum Sample Size Recommendations for Conducting Factor Analyses
Mundfrom, D. J., Shaw, D. G., & Ke, T. L. (2005) · International Journal of Testing · doi:10.1207/s15327574ijt0502_4 · Cited by 1,704
Affects of variable and subject sampling on factor pattern recovery.
Velicer, W. F., & Fava, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.2.231 · Cited by 998
Multivariate Analysis: The Need for Data, and other Problems
Everitt, B. S. (1975) · British Journal of Psychiatry · doi:10.1192/bjp.126.3.237 · Cited by 772
Hogarty, K. Y., Hines, C. V., Kromrey, J. D., Ferron, J. M., & Mumford, K. R. (2005) · Educational and Psychological Measurement · doi:10.1177/0013164404267287 · Cited by 559
Widaman, K. F. (1993) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2803_1 · Cited by 513
Sánchez–López, M. D. P., & Dresch, V. (2008) · PubMed · Cited by 511
Kabacoff, R. I., Segal, D. L., Hersen, M., & Van Hasselt, V. B. (1997) · Journal of Anxiety Disorders · doi:10.1016/s0887-6185(96)00033-3 · Cited by 500
Common methodological problems in factor analytic studies.
Comrey, A. L. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.46.4.648 · Cited by 478
Pyramidical Model of Schizophrenia
Kay, S. R., & Sevy, S. (1990) · Schizophrenia Bulletin · doi:10.1093/schbul/16.3.537 · Cited by 444
Green, S. B., & Yang, Y. (2009) · Psychometrika · doi:10.1007/s11336-008-9099-3 · Cited by 428
Bell, M. D., Lysaker, P. H., Beam-Goulet, J. L., Milstein, R. M., & Lindenmayer, J.-P. (1994) · Psychiatry Research · doi:10.1016/0165-1781(94)90075-2 · Cited by 422
The stability of the factor structure of the General Health Questionnaire
WERNEKE, U., GOLDBERG, D. P., YALCIN, I., & ÜSTÜN, B. T. (2000) · Psychological Medicine · doi:10.1017/s0033291799002287 · Cited by 387
Ventura, J., Nuechterlein, K. H., Subotnik, K. L., Gutkind, D., & Gilbert, E. A. (2000) · Psychiatry Research · doi:10.1016/s0165-1781(00)00228-6 · Cited by 355
Treatment-Resistant Schizophrenia
Elkis, H. (2007) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2007.04.001 · Cited by 338
Beck, A. T., & Steer, R. A. (1991) · Journal of Anxiety Disorders · doi:10.1016/0887-6185(91)90002-b · Cited by 331
The Approximate Sampling Distribution of Kuder-Richardson Reliability Coefficient Twenty
Feldt, L. S. (1965) · Psychometrika · doi:10.1007/bf02289499 · Cited by 288
(2008) · Encyclopedia of Counseling · doi:10.4135/9781412963978.n256 · Cited by 271
Fan, X., & Thompson, B. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401614001 · Cited by 218
Can the 12-item General Health Questionnaire be used to measure positive mental health?
HU, Y., STEWART-BROWN, S., TWIGG, L., & WEICH, S. (2007) · Psychological Medicine · doi:10.1017/s0033291707009993 · Cited by 200
Confidence Intervals About Score Reliability Coefficients, Please: An EPM Guidelines Editorial
Fan, X., & Thompson, B. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971365 · Cited by 191
Friedman, S., Samuelian, J.-C., Lancrenon, S., Even, C., & Chiarelli, P. (2001) · Psychiatry Research · doi:10.1016/s0165-1781(01)00309-2 · Cited by 175
A Comparison Of Component And Factor Patterns: A Monte Carlo Approach
Velicer, W. F., Peacock, A. C., & Jackson, D. N. (1982) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1703_5 · Cited by 169
Woolrich, R. A., Kennedy, P., & Tasiemski, T. (2006) · Psychology, Health & Medicine · doi:10.1080/13548500500294211 · Cited by 168
Assessment of the structure of the Hospital Anxiety and Depression Scale in musculoskeletal patients
Pallant, J. F., & Bailey, C. M. (2005) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-3-82 · Cited by 166
Reliability Beyond Theory and Into Practice
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9103-y · Cited by 164
Kih�, C., Rezaki, M., Rezaki, B., Kaplan, I., �zgen, G., Sagduyu, A., & �zturk, M. O. (1997) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/bf00805437 · Cited by 163
Factor analysis of the Hospital Anxiety and Depression Scale from a large cancer population
Smith, A. B., Selby, P. J., Velikova, G., Stark, D., Wright, E. P., Gould, A., & Cull, A. (2002) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1348/147608302169625 · Cited by 162
Hankins, M. (2008) · Clinical Practice and Epidemiology in Mental Health · doi:10.1186/1745-0179-4-10 · Cited by 158
Usefulness of Beck Depression Inventory (BDI) in the Korean elderly population
Jo, S. A., Park, M. H., Jo, I., Ryu, S., & Han, C. (2006) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1664 · Cited by 158
Gabryelewicz, T., Styczyńska, M., Pfeffer, A. Z., Wasiak, B., Barczak, A. K., Łuczywek, E., Androsiuk, W., & Barcikowska, M. (2004) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1235 · Cited by 138
Gorenstein, C., Andrade, L. H., Filho, A. H. G. V., Tung, T. C., & Artes, R. (1999) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(199905)55:5<553::aid-jclp3>3.3.co;2-4 · Cited by 137
Five-factor model of schizophrenic psychopathology: how valid is it?
Lykouras, L., Oulis, P., Psarros, K., Daskalopoulou, E. G., Botsis, A., Christodoulou, G. N., & Stefanis, C. (2000) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s004060070041 · Cited by 118
Basker, M. M., Moses, P. D., Russell, S., & Russell, P. S. S. (2007) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/1753-2000-1-8 · Cited by 114
Structure of the Computer-Assisted Beck Anxiety Inventory With Psychiatric Inpatients
Steer, R. A., Rissmiller, D. J., Ranieri, W. F., & Beck, A. T. (1993) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6003_10 · Cited by 114
Bonicatto, S., Dew, A. M., & Soria, J. J. (1998) · Psychiatry Research · doi:10.1016/s0165-1781(98)00047-x · Cited by 106
Bonilla, J., Bernal, G., Santos, A., & dos Santos, D. M. A. D. A. P. (2003) · Journal of Clinical Psychology · doi:10.1002/jclp.10195 · Cited by 104
Fresán, A., de la Fuente‐Sandoval, C., Lóyzaga, C., García‐Anaya, M., Meyenberg, N., Nicolini, H., & Apiquián, R. (2004) · Schizophrenia Research · doi:10.1016/j.schres.2004.03.021 · Cited by 92
Use of the Beck Anxiety Inventory with Adolescent Psychiatric Outpatients
Steer, R. A., Kumar, G., Ranieri, W. F., & Beck, A. T. (1995) · Psychological Reports · doi:10.2466/pr0.1995.76.2.459 · Cited by 86
Measuring Depression at the End of Life: Is the Hamilton Depression Rating Scale a Valid Instrument?
Olden, M., Rosenfeld, B. D., Pessin, H., & BREITBART, W. S. (2008) · Assessment · doi:10.1177/1073191108320415 · Cited by 81
Adachi, N., Onuma, T., Nishiwaki, S., Murauchi, S., Akanuma, N., Ishida, S., & Takei, N. (2000) · Seizure · doi:10.1053/seiz.2000.0413 · Cited by 80
Chapman, L. K., Williams, S. R., Mast, B. T., & Woodruff‐Borden, J. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2008.12.003 · Cited by 79
Effects of Atypical Antipsychotics on the Syndromal Profile in Treatment-Resistant Schizophrenia
Lindenmayer, J., Czobor, P., Volavka, J., et al. (2004) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v65n0416 · Cited by 73
Lançon, C., Reine, G., Llorca, P., & Auquier, P. (1999) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1999.tb10851.x · Cited by 72
A three‐factor analytic model of the MADRS in geriatric depression
Parker, R., Flint, E. P., Bosworth, H. B., Pieper, C. F., & Steffens, D. C. (2002) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.776 · Cited by 71
Symptom components of standard depression scales and past suicidal behavior
Grunebaum, M. F., Keilp, J. G., Li, S., Ellis, S. P., Burke, A. K., Oquendo, M. A., & Mann, J. J. (2005) · Journal of Affective Disorders · doi:10.1016/j.jad.2005.03.002 · Cited by 68
The functional neuroanatomy of schizophrenic subsyndromes
Honey, G. D., Sharma, T., John Suckling, A., Giampietro, V., Soni, W., Williams, S., & Bullmore, E. T. (2003) · Psychological Medicine · doi:10.1017/s0033291703007864 · Cited by 68
Structural validity of MADRS during antidepressant treatment
Galinowski, A., & Lehert, P. (1995) · International Clinical Psychopharmacology · doi:10.1097/00004850-199510030-00004 · Cited by 65
Sex Differences on the Revised Beck Depression Inventory for Outpatients With Affective Disorders
Steer, R. A., Beck, A. T., & Brown, G. P. (1989) · Journal of Personality Assessment · doi:10.1207/s15327752jpa5304_6 · Cited by 63
The factor structure of the Hospital Anxiety and Depression Scale in acquired brain injury
Dawkins, N., Cloherty, M. E., Gracey, F., & Evans, J. J. (2006) · Brain Injury · doi:10.1080/02699050601076414 · Cited by 62
Iwata, N., Mishima, N., Shimizu, T., Mizoue, T., Fukuhara, M., Hidano, T., & Spielberger, C. D. (1998) · Psychological Reports · doi:10.2466/pr0.1998.82.2.651 · Cited by 62
Serretti, A., Jori, M. C., Casadei, G., Ravizza, L., Smeraldi, E., & Akiskal, H. S. (1999) · Journal of Affective Disorders · doi:10.1016/s0165-0327(99)00056-7 · Cited by 61
Validation of the Beck Depression Inventory for a Portuguese-speaking Chinese community in Brazil
Wang, Y., Andrade, L. H., & Gorenstein, C. (2005) · Brazilian Journal of Medical and Biological Research · doi:10.1590/s0100-879x2005000300011 · Cited by 58
Uslu, R., Kapçi, E., Öncü, B., Uğurlu, M., & Turkcapar, H. (2008) · Journal of clinical psychology in medical settings · doi:10.1007/s10880-008-9122-y · Cited by 55
Fedorowicz, V. J., Falissard, B., Foulon, C., Dardennes, R. M., Divac, S. M., Guelfi, J. D., & Rouillon, F. (2007) · International Journal of Eating Disorders · doi:10.1002/eat.20415 · Cited by 52
Self-citationPowell, R. (2003) · Mental Retardation · doi:10.1352/0047-6765(2003)041<0088:ppotbd>2.0.co;2 · Cited by 49
Munoz, D. J., Chen, E. Y., Fischer, S. F., Roehrig, M., Sanchez-Johnson, L., Alverdy, J. C., Dymek-Valentine, M., & Grange, D. L. (2007) · Obesity Surgery · doi:10.1007/s11695-007-9185-0 · Cited by 47
Factorial study of the BDI in pregnant women
Salamero, M., Marcos, T., Gutiérrez, F., & Rebull, E. (1994) · Psychological Medicine · doi:10.1017/s0033291700029111 · Cited by 46
López-Castedo, A., & Fernandez, L. (2005) · Perceptual and Motor Skills · doi:10.2466/pms.100.3.676-680 · Cited by 45
The Five Symptom Dimensions and Depression in Schizophrenia
Lee, K.-H., Harris, A. W. F., Loughland, C. M., & Williams, L. M. (2003) · Psychopathology · doi:10.1159/000073447 · Cited by 42
Dagnan, D., Jahoda, A. J., McDowell, K., Masson, J., Banks, P., & Hare, D. J. (2008) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2008.01053.x · Cited by 36
Psychometric properties of the State–Trait Anxiety Inventory among Japanese clinical outpatients
Iwata, N., Mishima, N., Okabe, K., Kobayashi, N., Hashiguchi, E., & Egashira, K. (2000) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(200006)56:6<793::aid-jclp8>3.0.co;2-4 · Cited by 35
Harvey, P. D., Davidson, M., WHITE, L. E., Keefe, R. S. E., Hirschowitz, J., Mohs, R. C., & Davis, K. L. (1996) · Biological Psychiatry · doi:10.1016/0006-3223(95)00486-6 · Cited by 35
Salokangas, R. K. R., Honkonen, T., Stengård, E., & Koivisto, A.-M. (2002) · Nordic Journal of Psychiatry · doi:10.1080/080394802760322079 · Cited by 33
Effects of size of sample on eigenvalues, observed communalities, and factor loadings.
Aleamoni, L. M. (1973) · Journal of Applied Psychology · doi:10.1037/h0035429 · Cited by 23
Caveat on Sample Sizes in Factor Analysis
Loo, R. (1983) · Perceptual and Motor Skills · doi:10.2466/pms.1983.56.2.371 · Cited by 21
Empirically Derived Factor Indices for the Beck Depression Inventory
Killgore, W. D. S. (1999) · Psychological Reports · doi:10.2466/pr0.1999.84.3.1005 · Cited by 19
Four symptom dimensions in outpatients with schizophrenia
Villalta‐Gil, V., Vilaplana, M., Ochoa, S., Dolz, M., Usall, J., Haro, J. M., Almenara, J., González-Caballero, J. L., & Lagares, C. (2006) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2006.01.005 · Cited by 17
FACTOR STRUCTURE OF THE BECK DEPRESSION INVENTORY IN A UNIVERSITY SAMPLE
Helm, H. W., & Boward, M. D. (2003) · Psychological Reports · doi:10.2466/pr0.2003.92.1.53 · Cited by 16
Costa, E., Uchôa, E., Firmo, J. O. A., Lima‐Costa, M. F., & Prince, M. J. (2008) · Aging Clinical and Experimental Research · doi:10.1007/bf03324885 · Cited by 8
Factor Structure of Paranoid Schizophrenia: A Prospective Study
Łoza, B., Kucharska‐Pietura, K., Kopacz, G., & Dębowska, G. (2003) · Psychopathology · doi:10.1159/000071258 · Cited by 6
Metzger (1990) · doi:10.1002/1097-4679(199001)46:1
Cited by
Goretzko, D., Pham, T. T. H., & Bühner, M. (2021) · Current Psychology · doi:10.1007/s12144-019-00300-2 · Cited by 621
Development and initial evaluation of the Brief Addiction Monitor (BAM)
Cacciola, J. S., Alterman, A. I., DePhilippis, D., Drapkin, M. L., Valadez, C., Fala, N. C., Oslin, D., & McKay, J. R. (2013) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2012.07.013 · Cited by 203
Howard, M. C., & Henderson, J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113328 · Cited by 134
On the Measurement of Climate Change Anxiety: French Validation of the Climate Anxiety Scale
Mouguiama-Daouda, C., Blanchard, M. A., Coussement, C., & Heeren, A. (2022) · Psychologica Belgica · doi:10.5334/pb.1137 · Cited by 125
Knollmann, M., Reissner, V., & Hebebrand, J. (2019) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-018-1204-2 · Cited by 66
Metadata
- Authors
- Rouquette, A., & Falissard, B.
- Venue
- International Journal of Methods in Psychiatric Research
- Publisher
- Wiley
- Published
- 2011-10-24
- Volume
- 20
- Issue
- 4
- Pages
- 235-249
- ISSN
- 1049-8931 (ISSN-L)
- 1557-0657
- OpenAlex
- W2124808906
- Cited by
- 296
- References
- 89
- FWCI
- 7.80
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.