The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Influence of Imputation and EM Methods on Factor Analysis when Item Nonresponse in Questionnaire Data is Nonignorable
Abstract
This study deals with the influence of each of twelve imputation methods and two methods using the EM algorithm on the results of maximum likelihood factor analysis as compared with results obtained from the complete data factor analysis (no missing scores). Complete questionnaire rating scale data were simulated and, next, missing item scores were created under both ignorable and nonignorable nonresponse mechanisms. Next, imputation methods were used to fill the gaps and factor analysis was applied to both the original complete data and to the data sets including imputed scores. Each imputation method was implemented once with residual error and once without residual error. Also, one EM method estimated the factor loadings directly and the other estimated the complete data covariance matrix, which subsequently was factor analyzed. A design was analyzed with design factors Latent Trait Structure (technically called Mixing Configuration), Correlation Between Latent Traits, Nonresponse Mechanism, Percentage of Missingness, Sample Size, and Imputation Method. We found that, in general, methods that impute a score based on a respondent's mean score obtained from his/her observed item scores best recovered the factor loadings structure from the complete data. Moreover, for unidimensional data person mean methods with a residual error gave better results than the other imputation methods, either with or without a residual error component. For the EM methods a smaller design was analyzed. The conclusion was that both EM methods better recovered the complete data factor loadings than the imputation methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The only missing item score for the remaining six patients was imputed using two-way imputation (56, 57).”
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
Applied Multivariate Statistics for the Social Sciences
Stevens, J. P. (2012) · Routledge eBooks · doi:10.4324/9780203843130 · Cited by 10,652
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
An Introduction to Multivariate Statistical Analysis
Muirhead, R. J., & Anderson, T. W. (1986) · Journal of Business and Economic Statistics · doi:10.2307/1391399 · Cited by 9,179
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072
Multiple Imputation After 18+ Years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.2307/2291635 · Cited by 2,686
The Scientific Use of Factor Analysis in Behavioral and Life Sciences
Cattell, R. B. (1978) · doi:10.1007/978-1-4684-2262-7 · Cited by 2,165
A comparison of some methodologies for the factor analysis of non‐normal Likert variables
Muthén, B., & Kaplan, D. (1985) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1985.tb00832.x · Cited by 1,778 · cited 2×
“Dolan (1994) used 200, 300, and 400 simulated respondents; Muthén and Kaplan (1985) were interested in large sample properties and used a sample size of 1000.”
BackgroundMethodApplied Multivariate Statistics for the Social Sciences
Schumm, W. R., & Stevens, J. P. (1993) · The American Statistician · doi:10.2307/2685203 · Cited by 1,533
Statistical theories of mental test scores
Lord, F. M., Novick, M. R., & Birnbaum, A. (1974) · Cited by 1,158
The Analysis of Social Science Data with Missing Values
LITTLE, R. J. A., & RUBIN, D. B. (1989) · Sociological Methods & Research · doi:10.1177/0049124189018002004 · Cited by 1,016
On structural equation modeling with data that are not missing completely at random
Muthén, B., Kaplan, D., & Hollis, M. (1987) · Psychometrika · doi:10.1007/bf02294365 · Cited by 883
An introduction to multivariate statistical analysis
Anderson, T. W. 1.-2. (1958) · Cited by 880
On the Relationship between iTem Response Theory and Factor Analysis of Discretized Variables
Takane, Y., & de Leeuw, J. (1987) · Psychometrika · doi:10.1007/bf02294363 · Cited by 699
Muthén, B., & Kaplan, D. (1992) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1992.tb00975.x · Cited by 690
Tools for Statistical Inference
Tanner, M. A. (1996) · Springer series in statistics · doi:10.1007/978-1-4612-4024-2 · Cited by 637
MTW, & Tanner, M. A. (1997) · Journal of the American Statistical Association · doi:10.2307/2965746 · Cited by 611
EM Algorithms for ML Factor Analysis
Rubin, D. B., & Thayer, D. T. (1982) · Psychometrika · doi:10.1007/bf02293851 · Cited by 602
Becker, R. A., Chambers, J. M., & Wilks, A. R. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781351074988 · Cited by 574
The New S Language, A Programming Environment for Data Analysis and Graphics.
Austin, G., Becker, R. A., Chambers, J. M., & Wilks, A. R. (1990) · The Economic Journal · doi:10.2307/2234167 · Cited by 523
Dolan, C. V. (1994) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1994.tb01039.x · Cited by 281
Tanner, M. A. (1998) · Biometrics · doi:10.2307/3109795 · Cited by 200
Full-Information Factor Analysis for Polytomous Item Responses
Muraki, E., & Carlson, J. E. (1995) · Applied Psychological Measurement · doi:10.1177/014662169501900109 · Cited by 185
Little, R. J. A., & Nathaniel Schenker, A. (1995) · Springer eBooks · doi:10.1007/978-1-4899-1292-3_2 · Cited by 158
Estimation for the Multiple Factor Model when Data are Missing
Finkbeiner, C. T. (1979) · Psychometrika · doi:10.1007/bf02296204 · Cited by 153
Normal-Ogive Multidimensional Model
McDonald, R. P. (1997) · Springer eBooks · doi:10.1007/978-1-4757-2691-6_15 · Cited by 134
Loglinear Multidimensional IRT Models for Polytomously Scored Items
Kelderman, H., & Rijkes, C. P. M. (1994) · Psychometrika · doi:10.1007/bf02295181 · Cited by 125
Rubin, D. B. (1991) · Psychometrika · doi:10.1007/bf02294461 · Cited by 92
Asymptotic Comparison of Missing Data Procedures for Estimating Factor Loadings
Brown, C. H. (1983) · Psychometrika · doi:10.1007/bf02294022 · Cited by 70
Bernaards, C. A., & Sijtsma, K. (1999) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3403_1 · Cited by 65
Optimizing factorial invariance
Berge, J. M. (1977) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 64
Estimation for Structural Equation Models with Missing Data
Lee, S. (1986) · Psychometrika · doi:10.1007/bf02294002 · Cited by 59
Item Nonresponse: Occurence, Causes, and Imputation of Missing Answers to Test Items
Huisman, M. (1999) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 47
Simultaneous componenet and factor analysis methods for two or more groups: a comparative study.
Niesing, J. (1997) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 15
Research works printed but not linked: 3
- Acock A. C., 1997, Family Science Review, 10, 76
- Likert R. A., 1932, Archives of Psychology, 140, 149
- Liu C., 1998, Statistica Sinica, 8, 729
Cited by
Sorted by citations
Missing Data: Five Practical Guidelines
Newman, D. A. (2014) · Organizational Research Methods · doi:10.1177/1094428114548590 · Cited by 1,411
Murovec, N., & Prodan, I. (2009) · Technovation · doi:10.1016/j.technovation.2009.05.010 · Cited by 474
van der Ark, L. A. (2007) · Journal of Statistical Software · doi:10.18637/jss.v020.i11 · Cited by 469
INTERPERSONAL AGGRESSION IN WORK GROUPS: SOCIAL INFLUENCE, RECIPROCAL, AND INDIVIDUAL EFFECTS.
Glomb, T. M., & Liao, H. (2003) · Academy of Management Journal · doi:10.2307/30040640 · Cited by 432
Organizational commitment, turnover intentions and the influence of cultural values
Wasti, S. A. (2003) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317903769647193 · Cited by 346
Metadata
- Authors
- Bernaards, C. A., & Sijtsma, K.
- ORCID
- Sijtsma, Klaas
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2000-07
- Volume
- 35
- Issue
- 3
- Pages
- 321-364
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- OpenAlex
- W2111095327
- Cited by
- 177
- References
- 39
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 5 · 2023: 12 · 2022: 13 · 2021: 14 · 2020: 4 · 2019: 7 · 2018: 8 · 2017: 4 · 2016: 9 · 2015: 6 · 2014: 6 · 2013: 5 · 2012: 6
- FWCI
- 6.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Multivariate Behavioral Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- missing data imputation, nonignorable nonresponse, maximum likelihood factor analysis, expectation-maximization algorithm, questionnaire data, item nonresponse, factor loadings, residual error, simulation study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review