The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Why Ordinal Variables Can (Almost) Always Be Treated as Continuous Variables: Clarifying Assumptions of Robust Continuous and Ordinal Factor Analysis Estimation Methods
Open accessAbstract
The analysis of factor structures is one of the most critical psychometric applications. Frequently, variables (i.e., items or indicators) resulting from questionnaires using ordinal items with 2 to 7 categories are used. There are plenty of articles that recommend treating ordinal variables in a factor analysis by default as ordinal and not as continuous imposing a multivariate normal distribution assumption. In this article, we critically reflect that the reasoning behind such suggestions is flawed. In our view, findings from simulation studies cannot tell about the right modeling strategy of ordinal variables in factor analysis. Moreover, it is argued that ordinal factor models impose a normality assumption for underlying continuous variables, which might also often be false in empirical applications. However, researchers seldom opt for these much-needed, more flexible modeling strategies if the ordinal nature variables would seriously be modeled in factor analysis. Finally, the consequences of modeling choices for validity, reliability, measurement invariance, and the assessment of global model fit are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Maximum Likelihood Estimation of Misspecified Models
White, H. (1982) · Econometrica · doi:10.2307/1912526 · Cited by 4,098
Maximum Likelihood Estimation of Misspecified Models
White, H. (1983) · Econometrica · doi:10.2307/1912004 · Cited by 3,674
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012) · Psychological Methods · doi:10.1037/a0029315 · Cited by 2,816
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
mirt: A Multidimensional Item Response Theory Package for the R Environment
Chalmers, R. P. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i06 · Cited by 2,643
Thanks coefficient alpha, we’ll take it from here.
McNeish, D. (2018) · Psychological Methods · doi:10.1037/met0000144 · Cited by 2,533
Statistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
Muthén, B. (1984) · Psychometrika · doi:10.1007/bf02294210 · Cited by 1,544
Missing Data: Five Practical Guidelines
Newman, D. A. (2014) · Organizational Research Methods · doi:10.1177/1094428114548590 · Cited by 1,411
Increasing Transparency Through a Multiverse Analysis
Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616658637 · Cited by 1,372
On the Relationship between iTem Response Theory and Factor Analysis of Discretized Variables
Takane, Y., & de Leeuw, J. (1987) · Psychometrika · doi:10.1007/bf02294363 · Cited by 691
Factor Analysis with Ordinal Indicators: A Monte Carlo Study Comparing DWLS and ULS Estimation
Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903203573 · Cited by 685
Li, C.-H. (2016) · Psychological Methods · doi:10.1037/met0000093 · Cited by 681
Olsson, U. H., Foss, T., Troye, S. V., & Howell, R. D. (2000) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0704_3 · Cited by 648
Coefficient Alpha: A Reliability Coefficient for the 21st Century?
Yang, Y., & Green, S. B. (2011) · Journal of Psychoeducational Assessment · doi:10.1177/0734282911406668 · Cited by 479
Green, S. B., & Yang, Y. (2009) · Psychometrika · doi:10.1007/s11336-008-9099-3 · Cited by 428
Svetina, D., Rutkowski, L., & Rutkowski, D. (2020) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2019.1602776 · Cited by 425
Sass, D. A., Schmitt, T. A., & Marsh, H. W. (2014) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2014.882658 · Cited by 421
(2005) · Psychology Press eBooks · doi:10.4324/9781410612977 · Cited by 312
Confirmatory Factor Analysis of Ordinal Variables With Misspecified Models
Yang-Wallentin, F., Joreskog, K., & Luo, H. (2010) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2010.489003 · Cited by 307
Extending the rank likelihood for semiparametric copula estimation
D. Hoff, P. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas107 · Cited by 297
Dolan, C. V. (1994) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1994.tb01039.x · Cited by 278
The Impact of Categorization With Confirmatory Factor Analysis
DiStefano, C. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0903_2 · Cited by 276
Goodness-of-Fit Assessment of Item Response Theory Models
Maydeu-Olivares, A. (2013) · Measurement: Interdisciplinary Research & Perspective · doi:10.1080/15366367.2013.831680 · Cited by 262
Flora, D. B., LaBrish, C., & Chalmers, R. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00055 · Cited by 237
A Note on the Relation Between Factor Analytic and Item Response Theory Models
Kamata, A., & Bauer, D. J. (2008) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701758406 · Cited by 235
A comparison of item-level and scale-level multiple imputation for questionnaire batteries
Gottschall, A. C., West, S. G., & Enders, C. K. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.640589 · Cited by 225
On The Robustness Of Factor Analysis Against Crude Classification Of The Observations
Olsson, U. (1979) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1404_7 · Cited by 207
Improving Fit Indices in Structural Equation Modeling with Categorical Data
Savalei, V. (2020) · Multivariate Behavioral Research · doi:10.1080/00273171.2020.1717922 · Cited by 190
On the Sampling Theory Roundations of Item Response Theory Models
Holland, P. W. (1990) · Psychometrika · doi:10.1007/bf02294609 · Cited by 181
Developing Multidimensional Likert Scales Using Item Factor Analysis: The Case of Four-point Items
Asún, R. A., Rdz-Navarro, K., & Alvarado, J. M. (2016) · Sociological Methods & Research · doi:10.1177/0049124114566716 · Cited by 179
(2007) · Routledge eBooks · doi:10.4324/9780203936764 · Cited by 177
Evaluating estimation methods for ordinal data in structural equation modeling
Lei, P.-W. (2009) · Quality and Quantity · doi:10.1007/s11135-007-9133-z · Cited by 174
Using Exploratory Factor Analysis to Determine the Dimensionality of Discrete Responses
Barendse, M. T., Oort, F. J., & Timmerman, M. E. (2015) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2014.934850 · Cited by 170
Understanding Robust Corrections in Structural Equation Modeling
Savalei, V. (2014) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2013.824793 · Cited by 167
Handbook of Latent Variable and Related Models
Lee, S. (2007) · Elsevier eBooks · doi:10.1016/b978-0-444-52044-9.x5000-9 · Cited by 157
Asymptotic Robust Inferences in the Analysis of Mean and Covariance Structures
Satorra, A. (1992) · Sociological Methodology · doi:10.2307/270998 · Cited by 153
Glöckner-Rist, A., & Hoijtink, H. (2003) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1004_4 · Cited by 147
Structural Equation Models and Mixture Models With Continuous Nonnormal Skewed Distributions
Asparouhov, T., & Muthén, B. (2015) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2014.947375 · Cited by 135
9. Multiple Imputation of Incomplete Categorical Data Using Latent Class Analysis
Vermunt, J. K., van Ginkel, J. R., van der Ark, L. A., & Sijtsma, K. (2008) · Sociological Methodology · doi:10.1111/j.1467-9531.2008.00202.x · Cited by 128
Si, Y., & Reiter, J. P. (2013) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998613480394 · Cited by 121
ML Versus MI for Missing Data With Violation of Distribution Conditions
Yuan, K., Yang‐Wallentin, F., & Bentler, P. M. (2012) · Sociological Methods & Research · doi:10.1177/0049124112460373 · Cited by 119
Lucke, J. F. (2004) · Applied Psychological Measurement · doi:10.1177/0146621604270882 · Cited by 115
Bayesian Gaussian Copula Factor Models for Mixed Data
Murray, J. S., Dunson, D. B., Carin, L., & Lucas, J. E. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.762328 · Cited by 105
Bayesian Gaussian Copula Factor Models for Mixed Data.
Murray, J. S., Dunson, D. B., Carin, L., & Lu, J. E. (2013) · DukeSpace (Duke University) · Cited by 90
On Misconceptions and the Limited Usefulness of Ordinal Alpha
Chalmers, R. P. (2017) · Educational and Psychological Measurement · doi:10.1177/0013164417727036 · Cited by 87
Arminger, G., & Schoenberg, R. J. (1989) · Psychometrika · doi:10.1007/bf02294626 · Cited by 85
17 Robust Procedures in Structural Equation Modeling
Yuan, K., & Bentler, P. M. (2007) · Handbook of computing and statistics with applications · doi:10.1016/b978-044452044-9/50020-3 · Cited by 78
Extending mixtures of factor models using the restricted multivariate skew-normal distribution
Lin, T., McLachlan, G. J., & Lee, S. (2015) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2015.09.025 · Cited by 78
Murray, J. S., & Reiter, J. P. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1174132 · Cited by 74
Partial and latent ignorability in missing-data problems
Harel, O., & Schafer, J. L. (2009) · Biometrika · doi:10.1093/biomet/asn069 · Cited by 67
Factor Copula Models for Item Response Data
Nikoloulopoulos, A. K., & Joe, H. (2013) · Psychometrika · doi:10.1007/s11336-013-9387-4 · Cited by 60
Evaluating methods for handling missing ordinal data in structural equation modeling
Jia, F., & Wu, W. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1187-4 · Cited by 58
Multiple Imputation Using Gaussian Copulas
Hollenbach, F. M., Bojinov, I., Minhas, S., Metternich, N. W., Ward, M. D., & Volfovsky, A. (2018) · Sociological Methods & Research · doi:10.1177/0049124118799381 · Cited by 57
Evaluation of Six Effect Size Measures of Measurement Non-Invariance for Continuous Outcomes
Gunn, H., Grimm, K. J., & Edwards, M. C. (2019) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2019.1689507 · Cited by 56
Yuan, K. (2009) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2009.05.001 · Cited by 49
Chen, P., Wu, W., Garnier‐Villarreal, M., Kite, B. A., & Jia, F. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2019.1608799 · Cited by 49
Pernicious Polychorics: The Impact and Detection of Underlying Non-normality
Foldnes, N., & Grønneberg, S. (2019) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2019.1673168 · Cited by 39
A general non-linear multilevel structural equation mixture model
Kelava, A., & Brandt, H. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00748 · Cited by 34
Ferrando, P. J. (1999) · Applied Psychological Measurement · doi:10.1177/01466219922031284 · Cited by 28
Asymptotic Robustness Study of the Polychoric Correlation Estimation
Jin, S., & Yang‐Wallentin, F. (2016) · Psychometrika · doi:10.1007/s11336-016-9512-2 · Cited by 27
Testing Categorized Bivariate Normality With Two-Stage Polychoric Correlation Estimates
Maydeu‐Olivares, A., Forero, C. G., Gallardo‐Pujol, D., & Renom, J. (2009) · Methodology · doi:10.1027/1614-2241.5.4.131 · Cited by 26
Lai, K. (2018) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2018.1505522 · Cited by 26
Kuha, J., Katsikatsou, M., & Moustaki, I. (2018) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/rssa.12350 · Cited by 25
On Identification and Non-normal Simulation in Ordinal Covariance and Item Response Models
Foldnes, N., & Grønneberg, S. (2019) · Psychometrika · doi:10.1007/s11336-019-09688-z · Cited by 25
Yuan, K., & Bentler, P. M. (2010) · The American Statistician · doi:10.1198/tast.2010.09203 · Cited by 22
Gruhl, J., Erosheva, E. A., & Crane, P. K. (2012) · Cited by 22
A semiparametric Bayesian approach for structural equation models
Song, X., Pan, J., Kwok, T. C. Y., Vandenput, L., Ohlsson, C., & Leung, P. (2010) · Biometrical Journal · doi:10.1002/bimj.200900135 · Cited by 19
A latent class selection model for nonignorably missing data
Jung, H., Schafer, J. L., & Seo, B. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.07.002 · Cited by 17
Gruhl, J., Erosheva, E. A., & Crane, P. K. (2013) · The Annals of Applied Statistics · doi:10.1214/13-aoas675 · Cited by 17
Metric Transformations and the Filtered Monotonic Polynomial Item Response Model
Feuerstahler, L. M. (2018) · Psychometrika · doi:10.1007/s11336-018-9642-9 · Cited by 15
Raykov, T., & Marcoulides, G. A. (2015) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2014.937846 · Cited by 10
Bayesian Estimation and Testing of a Beta Factor Model for Bounded Continuous Variables
Revuelta, J., Hidalgo, B., & Alcázar‐Córcoles, M. Á. (2020) · Multivariate Behavioral Research · doi:10.1080/00273171.2020.1805582 · Cited by 10
Latent Ignorability and Item Selection for Nursing Home Case-Mix Evaluation
Bartolucci, F., Montanari, G. E., & Pandolfi, S. (2017) · Journal of Classification · doi:10.1007/s00357-017-9227-9 · Cited by 9
Kano, Y., & Takai, K. (2011) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2011.04.007 · Cited by 8
Hoffmann, S., Schönbrodt, F. D., Elsas, R., Wilson, R., Strasser, U., & Boulesteix, A. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/afb9p · Cited by 8
Linear factor copula models and their properties
Krupskii, P., & Genton, M. G. (2018) · Scandinavian Journal of Statistics · doi:10.1111/sjos.12325 · Cited by 5
IRT Modelling of Dichotomous Items with Linear Factor AnalysisPreprint
Tran, U. S., & Formann, A. K. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2408956 · Cited by 1
Cited by
Development and Validation of a Basic Psychological Needs Scale for Technology Use
Moradbakhti, L., Leichtmann, B., & Mara, M. (2024) · Psychological Test Adaptation and Development · doi:10.1027/2698-1866/a000062 · Cited by 41
Kuo, T.-S., Chen, Q. Z., Zhang, A. X., Hsieh, J., Zhu, H., & Holstein, K. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713865 · Cited by 12
Mathematical proof of the Fisher-Escolà Q statistical distribution in quantum consciousness modeling
Escolà-Gascón, Á., & Benito-León, J. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.04.025 · Cited by 4
Metadata
- Authors
- Robitzsch, A.
- Venue
- Frontiers in Education
- Publisher
- Frontiers Media SA
- Published
- 2020-10-08
- Volume
- 5
- ISSN
- 2504-284X (ISSN-L)
- OpenAlex
- W3092459516
- Cited by
- 379
- References
- 79
- FWCI
- 21.99
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.