The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Missing Data in Multiple Item Scales: A Monte Carlo Analysis of Missing Data Techniques
Abstract
Researchers in many fields use multiple item scales to measure important variables such as attitudes and personality traits, but find that some respondents failed to complete certain items. Past missing data research focuses on missing entire instruments, and is of limited help because there are few variables to help impute missing scores and the variables are often not highly related to each other. Multiple item scales offer the unique opportunity to impute missing values from other correlated items designed to measure the same construct. A Monte Carlo analysis was conducted to compare several missing data techniques. The techniques included listwise deletion, regression imputation, hot-deck imputation, and two forms of mean substitution. Results suggest that regression imputation and substituting the mean response of a person to other items on a scale are very promising approaches. Furthermore, the imputation techniques often outperformed listwise deletion.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the PSWQ, IES-R and DASS-21, individual mean substitution was used up to a maximum of 30% of missing items (Roth et al., 1999). Less than 1% of data was replaced using this approach.”
From Parental Anxiety and Posttraumatic Stress Symptoms in Pediatric Food Allergy. (2021) · cites this paper as Roth et al., 1999
Citations
Cites
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 79,882
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META‐ANALYSIS
BARRICK, M. R., & MOUNT, M. K. (1991) · Personnel Psychology · doi:10.1111/j.1744-6570.1991.tb00688.x · Cited by 8,689
Williams, L. J., & Anderson, S. E. (1991) · Journal of Management · doi:10.1177/014920639101700305 · Cited by 6,380
Journal of The American Statistical Association
Fienberg, S. E. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,289
Statistical Analysis With Missing Data
Ghosh, S., Little, R. J. A., & Rubin, D. B. (1988) · Technometrics · doi:10.2307/1269814 · Cited by 4,730
Maximum likelihood estimation from incomplete data via the EM algorithm
Dempster, A. P. (1977) · Journal of the Royal Statistical Society Series A (Statistics in Society) · Cited by 4,543
Role Conflict and Ambiguity in Complex Organizations
Rizzo, J. R., House, R. J., & Lirtzman, S. I. (1970) · Administrative Science Quarterly · doi:10.2307/2391486 · Cited by 3,700
A Review of Scale Development Practices in the Study of Organizations
Hinkin, T. R. (1995) · Journal of Management · doi:10.1177/014920639502100509 · Cited by 3,193
Research works printed but not linked: 12
- Bailar, B. A., 1982, Incomplete data in sample surveys: Proceedings of the symposium, 299
- Baker, K., 1989, Journal of Market Research Society, 31, 153
- Dawes, R. M., 1983, Judgment under uncertainty: Heuristics & biases
- Ford, B. L., 1983, Incomplete data in sample surveys. Volume II: Theory and bibliographies, 185
- Goodman, J. S., 1996, Journal of Management-Research Methods & Analysis, 22, 627
- Hackman, J. R., 1980, Work redesign
- Hunter, J. E., Ninth Annual Conference for Industrial and Organizational Psychology
- Madow, W. G., 1983, Incomplete data in sample surveys. Volume I: Report and case studies
- Madow, W. G., 1983, Incomplete data in sample surveys. Volume I: Report and case studies, 3
- McDonald, R. A., Southern Academy of Management meetings
- Rizvi, M. H., 1983, Incomplete data in sample surveys. Volume III: Proceedings of the symposium, 351
- Roth, P. L., Journal of Business & Psychology
Cited by
Sorted by citations
Items 301–343 of 343
Meikle, S. M. (2011) · Research Commons (University of Waikato) · Cited by 1
On everyday stress and coping strategies among elementary school children
Sotardi, V. A. (2013) · UA Campus Repository (The University of Arizona) · doi:10.26021/9771 · Cited by 1
Parent-Adolescent Relationships, Sexuality-Related Communication and Sexual Identity Development
Pericak, S. A. (2012) · The Atrium (University of Guelph) · Cited by 1
Watanabe, L. K. (2019) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2019-13760 · Cited by 1
Bosma, B., & van Witteloostuijn, A. C. (2021) · doi:10.31124/advance.13570598.v2 · Cited by 1
McDonnell, J. (2021) · UWA Profiles and Research Repository (UWA) · doi:10.26182/2a2q-k211 · Cited by 1
The primary prevention of violence in secondary school pupils in the West of Scotland
Gavine, A. J. (2014) · St Andrews Research Repository (St Andrews Research Repository) · Cited by 1
Glaser, D. N. (2003) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1001_9
Chan, J. Y. (2012) · Research Commons (University of Waikato)
The Statistical Developments and Applications Reference List
Furr, R. M., Sass, D. A., Streiner, D. L., & Meijer, R. R. (2014) · Journal of Personality Assessment · doi:10.1080/00223891.2014.976791
Wagner, R. A., Llp, F., David-Evans, M., Flynn, R. J., Helliwell, J. R., & Herbert, S. (2014)
Improving the measurement of patient safety : development of a new patient safety climate survey
Wentzell, N. (2008) · Saint Mary's University Institutional Repository (Saint Mary's University)
Communication and Sexual Identity Development
Pericak, S. A. (2012)
An intergenerational perspective on routine role succession in organizations
Franz, G. (2014) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Kiyang, L.-N. (2012) · Corpus Université Laval (Université Laval)
Neurological Models of Dyslexia
Dailey, N. S. (2016) · UA Campus Repository (The University of Arizona) · doi:10.13140/rg.2.2.32741.09442
Cole, H. A. (2018) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2018.040
Optimizing Community and Hospital Services Using the Cancer Support Source Program
Ross, E. J., Wiener, C. H., Robinson, D. C., & Cassisi, J. E. (2018) · Journal of Patient Experience · doi:10.1177/2374373518808309
“Following Roth et al (27) and Tabachnick and Fidell (28) recommendations, mean substitution is a strategy that is especially applicable to selfreport measures in which all items that are indicators of a specific concept or construct are assumed to be closely and positively correlated.”
BackgroundWheeler, B. K. (2018) · Libraries and Cultural Resources (University of Calgary) · doi:10.11575/prism/33117
Linking ethical leadership and employee performance in the Australian banking industry
Kia, N. (2020) · RMIT Research Repository (RMIT University Library) · doi:10.25439/rmt.27596409
Präg, P. (2018) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/y9sv7
Magnesium Intake and Human Health
Wolf, F. I., & Trapani, V. (2018) · MDPI eBooks · doi:10.3390/books978-3-03897-335-5
Weelden, V., & Christine, J. (2019) · Digital Commons-DePaul (DePaul University)
Validation of the Empathy Index in a Brazilian SamplePreprint
Shiramizu, V. K. M., & Yamamoto, M. E. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zwu26 · Cited by 1
Bosma, B., & van Witteloostuijn, A. C. (2021) · doi:10.31124/advance.13570598
Bidirectional dynamics of mood, reward, effort and exploration in naturalistic task environmentsPreprint
Suzuki, S., Ryan, J., Cheong, Y. F., Kragel, P. A., & Treadway, M. T. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4q3um
AYDAR, G., & Şumuer, E. (2023) · Kocaeli Üniversitesi Eğitim Dergisi · doi:10.33400/kuje.1316555
Investigation of Missing Data Methods in Polytomous Multidimensional Item Response Theory
Işıkoğlu, M. A., & Atar, B. (2023) · DergiPark (Istanbul University) · doi:10.17152/gefad.1319907
Risky sexual behavior in Veterans seeking substance use and mental health treatment
Tu, J. W., Shaw, R. J., Florimbio, A. R., McCarthy, K., Bonar, E. E., Chermack, S. T., Winters, J. J., Walton, M. A., & Sexton, M. B. (2024) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2024.100572
“Item 17 (exaggerated startle) was accidentally omitted from the materials; data were imputed using mean PCL-C scores in because it produces less biased estimates compared to other approaches (e.g., item mean sub-stitution, regression imputation; Roth et al., 1999).”
Hulteen, R. M., Meester, A. D., Barcelona, J., Barnett, L. M., Centeio, E. E., & Stodden, D. F. (2025) · Journal of Motor Learning and Development · doi:10.1123/jmld.2024-0031
Diagnostic control systems and boundary systems: Pathway or barrier to SMEs’ entrepreneurial success
Bakkali, C., Maurice, J., & Covin, J. G. (2026) · Journal of Small Business Management · doi:10.1080/00472778.2026.2616377
“When no more than one or two items were missing within a given construct, missing values were replaced using the respondent’s mean score on the remaining items for that construct (Downey & King, 1998; Roth et al., 1999).”
Zadeh, S. O. M. (2024) · theses.fr (ABES) · doi:10.70675/d866982azaf08z4499z8a48z9c8da202c81f
The Development and Validation of a Questionnaire to Assess Agility in Software Engineering (QASE)
Tchikanmou, V. A., & Scheel, T. (2026) · Journal of Software Engineering Research and Development · doi:10.5753/jserd.2026.6280
“Furthermore, it has been shown to produce approximately unbiased parameter estimates while maintaining the underlying factor structure and exerting only a minimal impact on overall validity (Huis-man, 2000; Peyre et al., 2011; Roth et al., 1999; Schafer & Graham, 2002).”
The Relationship Between Maternal Personality Functioning and Caregiving Quality
Zell, C. S., Cervantes, B. R., Cano, K., Hasanov, A., Babcock, J. C., & Sharp, C. (2026) · Journal of Personality Disorders · doi:10.1521/pedi.2026.40.5.391
The Influence of Poverty Simulations on Dental Students' Empathy
Young, L. B., McQuistan, M. R., & Pendleton, C. (2026) · European Journal Of Dental Education · doi:10.1111/eje.70326
The influence of masculinity ideology on high-risk sexual behavior among men who have sex with men
Wheldon, C. W. (2007) · Digital Commons - University of South Florida (University of South Florida)
Metadata
- Authors
- Roth, P. L., Switzer, F. S., & Switzer, D. M.
- Affiliations
- Clemson University (US)
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 1999-07
- Volume
- 2
- Issue
- 3
- Pages
- 211-232
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2122169890
- Cited by
- 344
- References
- 39
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 11 · 2023: 8 · 2022: 17 · 2021: 14 · 2020: 16 · 2019: 20 · 2018: 28 · 2017: 17 · 2016: 15 · 2015: 19 · 2014: 19 · 2013: 21 · 2012: 26
- FWCI
- 2.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Organizational Research Methods (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- missing data, regression imputation, hot deck imputation, mean substitution, listwise deletion, imputation accuracy, attitudes, personality traits
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
