The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Influence of Imputation and EM Methods on Factor Analysis when Item Nonresponse in Questionnaire Data is Nonignorable
Abstract
This study deals with the influence of each of twelve imputation methods and two methods using the EM algorithm on the results of maximum likelihood factor analysis as compared with results obtained from the complete data factor analysis (no missing scores). Complete questionnaire rating scale data were simulated and, next, missing item scores were created under both ignorable and nonignorable nonresponse mechanisms. Next, imputation methods were used to fill the gaps and factor analysis was applied to both the original complete data and to the data sets including imputed scores. Each imputation method was implemented once with residual error and once without residual error. Also, one EM method estimated the factor loadings directly and the other estimated the complete data covariance matrix, which subsequently was factor analyzed. A design was analyzed with design factors Latent Trait Structure (technically called Mixing Configuration), Correlation Between Latent Traits, Nonresponse Mechanism, Percentage of Missingness, Sample Size, and Imputation Method. We found that, in general, methods that impute a score based on a respondent's mean score obtained from his/her observed item scores best recovered the factor loadings structure from the complete data. Moreover, for unidimensional data person mean methods with a residual error gave better results than the other imputation methods, either with or without a residual error component. For the EM methods a smaller design was analyzed. The conclusion was that both EM methods better recovered the complete data factor loadings than the imputation methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The only missing item score for the remaining six patients was imputed using two-way imputation (56, 57).”
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
Applied Multivariate Statistics for the Social Sciences
Stevens, J. P. (2012) · Routledge eBooks · doi:10.4324/9780203843130 · Cited by 10,652
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
An Introduction to Multivariate Statistical Analysis
Muirhead, R. J., & Anderson, T. W. (1986) · Journal of Business and Economic Statistics · doi:10.2307/1391399 · Cited by 9,179
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072
Multiple Imputation After 18+ Years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.2307/2291635 · Cited by 2,686
Research works printed but not linked: 3
- Acock A. C., 1997, Family Science Review, 10, 76
- Likert R. A., 1932, Archives of Psychology, 140, 149
- Liu C., 1998, Statistica Sinica, 8, 729
Cited by
Sorted by citations
Items 101–175 of 175
Yang, F., & Liu, Y. (2025) · Tourism Management · doi:10.1016/j.tourman.2025.105141 · Cited by 11
Ramirez-Luzuriaga, M. J., Hoddinott, J. F., Martorell, R., Patel, S. A., Ramírez‐Zea, M., Waford, R., & Stein, A. D. (2020) · Journal of Nutrition · doi:10.1093/jn/nxaa337 · Cited by 14
Assessing alternative imputation strategies for infrequently missing items on multi-item scales
Rezvan, P. H., Comulada, W. S., Fernandez, M. I., & Belin, T. R. (2022) · Communications in Statistics Case Studies Data Analysis and Applications · doi:10.1080/23737484.2022.2115430 · Cited by 10
Paap, M. C. S., Lenferink, L. I. M., Herzog, N., Kroeze, K. A., & van der Palen, J. A. M. (2016) · Health and Quality of Life Outcomes · doi:10.1186/s12955-016-0500-0 · Cited by 10
The Role of Autonomy Support and Job Crafting in Interest Incongruence: A Mediated Moderation Model
Li, J., Flores, L. Y., Yang, H., Weng, Q. D., & Zhu, L. (2021) · Journal of Career Development · doi:10.1177/08948453211033903 · Cited by 10
Examining Associations of Sexual Attraction and Attitudes on Women's Disordered Eating Behavior
Bankoff, S. M., Marks, A. K., Swenson, L. P., & Pantalone, D. W. (2015) · Journal of Clinical Psychology · doi:10.1002/jclp.22244 · Cited by 10
Edwards, J. M., & Finch, W. H. (2018) · Psicologica · doi:10.2478/psicolj-2018-0005 · Cited by 10
Grove, A. B., Kurtz, E. D., Wallace, R. E., Sheerin, C. M., & Scott, S. M. (2021) · Military Psychology · doi:10.1080/08995605.2021.1897496 · Cited by 10
Conijn, J. M., Emons, W. H. M., van Assen, M. A. L. M., Pedersen, S. S., & Sijtsma, K. (2013) · Multivariate Behavioral Research · doi:10.1080/00273171.2013.815580 · Cited by 10
Using scalability coefficients and conditional association to assess monotone homogeneity
Straat, J. H. (2012) · Data Archiving and Networked Services (DANS) · Cited by 10
Job characteristics as drivers of occupational commitment: the mediating mechanisms
Jiang, Y., Wang, Q., & Weng, Q. D. (2020) · Current Psychology · doi:10.1007/s12144-020-00755-8 · Cited by 11
Chiang, Y., Li, X., Lee, C., Wu, C.-C., Chang, H., & Zhang, S. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.818894 · Cited by 9
Is It Wrong? Handling Missing Responses in IRT
Culbertson, M. J. (2011) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 9
Hamel, J. F., Sebille, V., Néel, T. L., Kubis, G., Boyer, F. C., & Hardouin, J.-B. (2015) · Statistical Methods in Medical Research · doi:10.1177/0962280215615158 · Cited by 9
Sakai, K., Nakamura, K., Satomi, G., Kondo, M., & Hirosawa, K. (1983) · PubMed · Cited by 9
Mellenbergh, G. J. (2019) · Springer eBooks · doi:10.1007/978-3-030-12272-0_16 · Cited by 8
Reporting Proficiency Levels for Examinees With Incomplete Data
Sinharay, S. (2021) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986211051379 · Cited by 8
Item response theory modeling with nonignorable missing data
Pimentel, J. L. (2005) · University of Twente Research Information · Cited by 9
Varela, M. F., Vera, M. R., Departamento Mediaciones y Subjetividades, U. D. P. A., & Universidad de Playa Ancha, V. (2023) · Revista Latinoamericana de Psicología · doi:10.14349/rlp.2023.v55.2 · Cited by 7
Bayesian estimation of the multidimensional graded response model with nonignorable missing data
Fu, Z., Tao, J., & Shi, N. (2009) · Journal of Statistical Computation and Simulation · doi:10.1080/00949650903029276 · Cited by 7
Comparison of methods for dealing with missing values in the EPV-R
Paniagua, D., Amor, P. J., Echeburúa, E., & Abad, F. J. (2017) · Psicothema · doi:10.7334/psicothema2016.75 · Cited by 7
Bulut, O., Xiao, J., Rodriguez, M. C., & Gorgun, G. (2020) · Journal of School Violence · doi:10.1080/15388220.2020.1770603 · Cited by 7
A Noise-Aware Multiple Imputation Algorithm for Missing Data
Li, F., Sun, H., Gu, Y., & Yu, G. (2022) · Mathematics · doi:10.3390/math11010073 · Cited by 6
Grove, A. B., Sheerin, C. M., Wallace, R. E., Green, B. A., Minnich, A. H., & Kurtz, E. D. (2023) · Military Psychology · doi:10.1080/08995605.2023.2236924 · Cited by 10
From Zero to Hero? An Exploratory Study of the Predictors of Success in the Dutch Idols Competition
Zwaan, K., & ter Bogt, T. (2010) · Popular Music & Society · doi:10.1080/03007760903392708 · Cited by 6
A Comparison of Missing-Data Imputation Techniques in Exploratory Factor Analysis
Xiao, C., Bruner, D. W., Dai, T., Guo, Y., & Hanlon, A. L. (2019) · Journal of Nursing Measurement · doi:10.1891/1061-3749.27.2.313 · Cited by 6
Ramirez-Luzuriaga, M. J., Ochaeta, L., Ramírez‐Zea, M., DiGirolamo, A. M., Waford, R., Wray, C., Martorell, R., & Stein, A. D. (2021) · BMC Psychology · doi:10.1186/s40359-021-00654-y · Cited by 6
Dealing with Missing Responses in Cognitive Diagnostic Modeling
Dai, S., & Svetina, D. (2022) · Psych · doi:10.3390/psych4020028 · Cited by 8
The impact of missing data rates and imputation methods on the assumption of unidimensionality
Baniamer, A. O. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321344 · Cited by 5
Cummings, C. (2016) · PSU McNair Scholars Online Journal · doi:10.15760/mcnair.2016.3 · Cited by 5
Bias of factor loadings from questionnaire data with imputed scores
Bernaards, C. A., & Sijtsma, K. (2005) · Journal of Statistical Computation and Simulation · doi:10.1080/00949650410001649318 · Cited by 5
On the lacking visibility of management research from non-Western countries
Bajwa, N. U. H., & König, C. J. (2017) · Management Research Review · doi:10.1108/mrr-02-2016-0036 · Cited by 4
Kayıp Veri ile Baş Etme Yöntemlerinin Madde Parametrelerine Etkisinin İncelenmesi
SAYIN, A., & Yandi, A. (2017) · Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi · doi:10.21031/epod.355506 · Cited by 4
Liu, C., & Kolen, M. J. (2018) · Journal of Educational Measurement · doi:10.1111/jedm.12192 · Cited by 4
Hughes, A. (2011) · Staffordshire Online Repository (Staffordshire University) · Cited by 4
Mota, J., Martins, J., & Onofre, M. (2022) · Research Square · doi:10.21203/rs.3.rs-1458709/v3 · Cited by 4
On the meaning of customer satisfaction : A study in the context of retail banking
Terpstra, M. (2008) · Data Archiving and Networked Services (DANS) · Cited by 4
Modified Item-Fit Indices for Dichotomous IRT Models with Missing Data
Zhang, X., & Wang, C. (2022) · Applied Psychological Measurement · doi:10.1177/01466216221125176 · Cited by 3
van Nes, K. A., van der Ark, L. A., van Loveren, C., & Aartman, I. H. A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0289337 · Cited by 3
Fox, J., Pimentel, J. L., & Glas, C. A. W. (2006) · Behaviormetrika · doi:10.2333/bhmk.33.27 · Cited by 3
Sexual Harassment Litigation: a Road to Re-victimization or Recovery?
Lawson, A. K., & Fitzgerald, L. F. (2016) · Psychological Injury and Law · doi:10.1007/s12207-016-9269-z · Cited by 3
Shen, Y., Wang, S., & Xiao, H. (2024) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12340 · Cited by 2
You, X., Yang, J., & Xu, X. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1487111 · Cited by 2
Chang, Y., & Yang, C.-X. (2023) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2023.2289056 · Cited by 2
Examining the restrictiveness of the PRP-QUANT Template
Lakens, D. (2024) · Peer Community In Registered Reports · doi:10.24072/pci.rr.100480 · Cited by 2
Evaluating the Effects of Missing Data Handling Methods on Scale Linking Accuracy
Wu, T., Kim, S. Y., & Westine, C. D. (2022) · Educational and Psychological Measurement · doi:10.1177/00131644221140941 · Cited by 2
Job Satisfaction and Burnout among Forensic Interviewers
Chiarelli-Helminiak, C. M. (2014) · OpenCommons at University of Connecticut (University of Connecticut) · Cited by 2
Antecedents and consequences of cost system design choices
Schoute, M. (2009) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) · Cited by 2
Charonitis, M., Requier, F., Guillemin, C., Reyt, M., Folville, A., Geurten, M., Bastin, C., Willems, S. J., Muto, V., Schmidt, C., et al. (2024) · Psychologica Belgica · doi:10.5334/pb.1259 · Cited by 1
Johnson, Z. D. (2025) · Communication Education · doi:10.1080/03634523.2025.2557307 · Cited by 1
Wang, J., Rapatz, G., Lowy, A., Olson, S., & Kuebler, J. (2008) · Pharmaceutical Statistics · doi:10.1002/pst.333 · Cited by 1
Modeling nonignorable missing data processes in item calibration
Glas, C. A. W., & Pimentel, J. L. (2006) · University of Twente Research Information · Cited by 1
Spatio-Temporal View GAIN for Data Imputation and Dynamic Soft Sensor
Ren, J., Chen, X., & Zhao, C. (2022) · IEEE Data Driven Control and Learning Systems Conference (DDCLS) · doi:10.1109/ddcls55054.2022.9858447 · Cited by 1
Jung, J., & Lee, W. (2025) · Educational and Psychological Measurement · doi:10.1177/00131644251329524 · Cited by 1
Smits, N., Vorst, H. C. M., & Mellenbergh, G. J. (2002) · UvA-DARE (University of Amsterdam) · Cited by 1
Item response theory in clinical outcome measurement
Holman, R. (2005) · Data Archiving and Networked Services (DANS) · Cited by 1
Investigating the effects of missing data treatments on item response theory vertical scaling
Shin, A.-Y., Lee, W., Brennan, R. L., Kolen, M. J., Welch, C. J., & Tan, A. (2016) · doi:10.17077/etd.g0o7zsk9 · Cited by 1
mokken: Conducts Mokken Scale Analysis
van der Ark, L. A., & Koopman, L. (2007) · doi:10.32614/cran.package.mokken · Cited by 1
Bernaards, C. A. (2000) · COMPSTAT · doi:10.1007/978-3-642-57678-2_23
Kinder mit Behinderungen und deren Familien: Evaluation des Stepping Stones Triple P Elterntrainings
Theobald, M., Aschersleben, G., Karbach, J., Hasmann, R., Karpinski, N. K., & Petermann, F. (2015) · Zeitschrift für Psychiatrie Psychologie und Psychotherapie · doi:10.1024/1661-4747/a000247
Wasti, S. N., & 東京大学大学院経済学研究科附属日本経済国際共同研究センター (2001) · RePEc: Research Papers in Economics
Mota, J., Martins, J., & Onofre, M. (2022) · Research Square · doi:10.21203/rs.3.rs-1458709/v1
Mota, J., Martins, J., & Onofre, M. (2022) · Research Square · doi:10.21203/rs.3.rs-1458709/v2
(2016) · PSU McNair Scholars Online Journal · doi:10.15760/mcnair.2016.01
Beyond Lockdown Fatigue: Prolonged Influence of the COVID-19 Pandemic on LifestylePreprint
Charonitis, M., Requier, F., Guillemin, C., Reyt, M., Folville, A., Geurten, M., Bastin, C., Willems, S. J., Muto, V., Schmidt, C., et al. (2023) · doi:10.31234/osf.io/5wchd
Investigation of Missing Data Methods in Polytomous Multidimensional Item Response Theory
Işıkoğlu, M. A., & Atar, B. (2023) · DergiPark (Istanbul University) · doi:10.17152/gefad.1319907
van Nes, K. A., van Loveren, C., & Aartman, I. H. A. (2024) · PLoS ONE · doi:10.1371/journal.pone.0300432 · Cited by 1
Ramírez-Luzuriaga, M. J., Ochaeta, L., Ramírez-Zea, M., DiGirolamo, A. M., Waford, R., Wray, C., Martorell, R., & Stein, A. D. (2021) · Figshare · doi:10.6084/m9.figshare.16674971
Li, X., Zhou, Y., Liang, J., & Wang, Y. (2025) · International Journal of Science Education · doi:10.1080/09500693.2025.2604794
Estimators of the AIC and BIC in multiply imputed data
van Ginkel, J. V., & Molenaar, D. (2026) · Behaviormetrika · doi:10.1007/s41237-025-00281-6
Dyball, D. M., Schofield, S. J., Burdett, H. J., LeFeuvre, P., Bennett, A. N., Cullinan, P., Boos, C. J., Bull, A. M. J., & Fear, N. T. (2026) · Quality of Life Research · doi:10.1007/s11136-025-04158-9
Spitzer, L., Kroeger, A., & Mueller, S. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261432216
Are extensive simulation studies always necessary? A critical overview
van Ginkel, J. R., & Rippe, R. C. A. (2026) · Statistical Methods & Applications · doi:10.1007/s10260-026-00877-6
Metadata
- Authors
- Bernaards, C. A., & Sijtsma, K.
- ORCID
- Sijtsma, Klaas
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2000-07
- Volume
- 35
- Issue
- 3
- Pages
- 321-364
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- OpenAlex
- W2111095327
- Cited by
- 177
- References
- 39
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 5 · 2023: 12 · 2022: 13 · 2021: 14 · 2020: 4 · 2019: 7 · 2018: 8 · 2017: 4 · 2016: 9 · 2015: 6 · 2014: 6 · 2013: 5 · 2012: 6
- FWCI
- 6.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Multivariate Behavioral Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- missing data imputation, nonignorable nonresponse, maximum likelihood factor analysis, expectation-maximization algorithm, questionnaire data, item nonresponse, factor loadings, residual error, simulation study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review