Cited by 344Statistical Methods and Bayesian InferencePsychometric Methodologies and TestingSurvey Methodology and Nonresponse

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.

Missing Data in Multiple Item Scales: A Monte Carlo Analysis of Missing Data Techniques

Roth, Philip L., Switzer, Fred S., Switzer, Deborah M.·1999·Organizational Research Methods

DOI 10.1177/109442819923001

Open this paper in CoChat — free account

Abstract

Researchers in many fields use multiple item scales to measure important variables such as attitudes and personality traits, but find that some respondents failed to complete certain items. Past missing data research focuses on missing entire instruments, and is of limited help because there are few variables to help impute missing scores and the variables are often not highly related to each other. Multiple item scales offer the unique opportunity to impute missing values from other correlated items designed to measure the same construct. A Monte Carlo analysis was conducted to compare several missing data techniques. The techniques included listwise deletion, regression imputation, hot-deck imputation, and two forms of mean substitution. Results suggest that regression imputation and substituting the mean response of a person to other items on a scale are very promising approaches. Furthermore, the imputation techniques often outperformed listwise deletion.

Integrity signals

Registry

Crossref · 10.1177/109442819923001

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Using multivariate statistics
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 79,882
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META‐ANALYSIS
BARRICK, M. R., & MOUNT, M. K. (1991) · Personnel Psychology · doi:10.1111/j.1744-6570.1991.tb00688.x · Cited by 8,689
Job Satisfaction and Organizational Commitment as Predictors of Organizational Citizenship and In-Role Behaviors
Williams, L. J., & Anderson, S. E. (1991) · Journal of Management · doi:10.1177/014920639101700305 · Cited by 6,380
Journal of The American Statistical Association
Fienberg, S. E. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,289
Statistical Analysis With Missing Data
Ghosh, S., Little, R. J. A., & Rubin, D. B. (1988) · Technometrics · doi:10.2307/1269814 · Cited by 4,730
Maximum likelihood estimation from incomplete data via the EM algorithm
Dempster, A. P. (1977) · Journal of the Royal Statistical Society Series A (Statistics in Society) · Cited by 4,543
Role Conflict and Ambiguity in Complex Organizations
Rizzo, J. R., House, R. J., & Lirtzman, S. I. (1970) · Administrative Science Quarterly · doi:10.2307/2391486 · Cited by 3,700
A Review of Scale Development Practices in the Study of Organizations
Hinkin, T. R. (1995) · Journal of Management · doi:10.1177/014920639502100509 · Cited by 3,193

Show all 39 references

Research works printed but not linked: 12

Bailar, B. A., 1982, Incomplete data in sample surveys: Proceedings of the symposium, 299
Baker, K., 1989, Journal of Market Research Society, 31, 153
Dawes, R. M., 1983, Judgment under uncertainty: Heuristics & biases
Ford, B. L., 1983, Incomplete data in sample surveys. Volume II: Theory and bibliographies, 185
Goodman, J. S., 1996, Journal of Management-Research Methods & Analysis, 22, 627
Hackman, J. R., 1980, Work redesign
Hunter, J. E., Ninth Annual Conference for Industrial and Organizational Psychology
Madow, W. G., 1983, Incomplete data in sample surveys. Volume I: Report and case studies
Madow, W. G., 1983, Incomplete data in sample surveys. Volume I: Report and case studies, 3
McDonald, R. A., Southern Academy of Management meetings
Rizvi, M. H., 1983, Incomplete data in sample surveys. Volume III: Proceedings of the symposium, 351
Roth, P. L., Journal of Business & Psychology

Sorted by citations

Items 201–300 of 343

The effect of discrimination and stress on sexual and behavioral health among sexual minority servicemen
Delgado, A. J., Gordon, D. M., & Schnarrs, P. W. (2016) · Journal of Gay & Lesbian Mental Health · doi:10.1080/19359705.2016.1141344 · Cited by 11
Simplifying Common Method Variance Mitigation: The Role of Additional Variables
Sturman, M. C., Richardson, H. A., Simmering, M. J., & Ukhov, A. D. (2025) · Journal of Business and Psychology · doi:10.1007/s10869-025-10074-z · Cited by 17
Assessing alternative imputation strategies for infrequently missing items on multi-item scales
Rezvan, P. H., Comulada, W. S., Fernandez, M. I., & Belin, T. R. (2022) · Communications in Statistics Case Studies Data Analysis and Applications · doi:10.1080/23737484.2022.2115430 · Cited by 10
Criminal defendants' satisfaction with lawyers: perceptions of procedural fairness and effort of the lawyer
Raaijmakers, E. A. C., Keijser, J. W. D., Nieuwbeerta, P., & Dirkzwager, A. (2014) · Psychology Crime and Law · doi:10.1080/1068316x.2014.951646 · Cited by 10
Development and validation of a scale assessing achievement goals in driving
Mascret, N., Nicolleau, M., & Ragot-Court, I. (2020) · PLoS ONE · doi:10.1371/journal.pone.0230349 · Cited by 10
“01% of the data were missing, so they were replaced by the mean of the participant’s subscale [50].”
Background
Integrated Moral Conviction Theory of Student Cheating: An Empirical Test
Roberts, F., Thomas, C. H., Novičević, M. M., Ammeter, A. P., Garner, B. L., Johnson, P., & Popoola, I. T. (2017) · Organizational Behavior Teaching Review · doi:10.1177/1052562917710686 · Cited by 11
Drivers of student satisfaction and student loyalty in an Australian university setting
Brown, R. M. (2006) · UWA Profiles and Research Repository (University of Western Australia) · Cited by 10
Development of the Personal and Professional Self-Care Scale
Dorociak, K. E. (2015) · Loyola eCommons (Loyola University of Chicago) · Cited by 10
An educational strategy to enhance pharmacy students' attitudes toward addressing health literacy of patients
Wilcoxen, K., & King, S. R. (2013) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2012.11.001 · Cited by 9
The effects of injunctive and descriptive tipping norms on tipping behavior and motives
Lynn, M. (2021) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2021.101786 · Cited by 9
Corporate Brand Experience as a New Construct and Its Effects on Employees’ Corporate Brand Pride and Brand-Supporting Behaviours
Egeler, P., Abed, F., & Büttgen, M. (2022) · International Journal of Business and Management · doi:10.5539/ijbm.v17n3p39 · Cited by 9
“Next missing values were checked and as Roth et al. (1999) suggest, those sets in which more than 30% of the data were missing were deleted; this resulted in a usable sample of 282 observations.”
Background
Elucidating the relationships between shame, anger, and self-destructive behaviors: The role of aversive responses to emotions
Cassiello-Robbins, C. F., Wilner, J. G., Peters, J. R., Bentley, K. H., & Sauer-Zavala, S. E. (2018) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2018.12.004 · Cited by 11
[Hepatic vein blood flow pattern measured by Doppler echocardiography as an evaluation of tricuspid valve insufficiency].
Sakai, K., Nakamura, K., Satomi, G., Kondo, M., & Hirosawa, K. (1983) · PubMed · Cited by 9
Psychological predictors of health anxiety and pain in ambulatory presentations in a hospital emergency department
Parker, H., Carlton, E. W., Harris, S., & Daniels, J. (2022) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465822000352 · Cited by 11
“If 20% or fewer items were missing from questionnaires then the case mean substitution method was planned (Roth et al., 1999).”
Method
Assessing the efficacy and safety of STOP (successful treatment for paranoia)—an app-based cognitive bias modification therapy for paranoia: a randomised clinical trial protocol
Yiend, J., Taher, R., Fialho, C., Hampshire, C., Hsu, C.-W., Kabir, T., Keppens, J., McGuire, P. K., Mouchlianitis, E. D., PETERS, E. R., et al. (2024) · Trials · doi:10.1186/s13063-024-08570-3 · Cited by 7
Are Business Students Prepared for the World of Business? Self‐interest, Conformity and Conflict Styles
Petersen, B. K., & Ford, D. P. (2018) · Canadian Journal of Administrative Sciences / Revue Canadienne des Sciences de l Administration · doi:10.1002/cjas.1523 · Cited by 8
Untangling the role of interactions in police satisfaction: Examining direct and indirect contacts with the police
Merenda, F., Trent, J., & Rinke, C. R. (2020) · The Police Journal Theory Practice and Principles · doi:10.1177/0032258x20960790 · Cited by 8
“The MI technique has been shown to create less biased estimates compared to various other methods, such as mean value replacement (Allison, 2001; Roth et al., 1999).”
Method
Battle of the Appraisals: Pain-Related Injustice Versus Catastrophizing as Mediators in the Relationship Between Pain Intensity and 3-Month Outcomes in Adolescents with Chronic Pain
Miller, M. M., Williams, A. E., Scott, E. L., Trost, Z., & Hirsh, A. T. (2021) · Journal of Pain · doi:10.1016/j.jpain.2021.07.006 · Cited by 8
Analysis of customer satisfaction survey data
Rotella, P., & Chulani, S. (2012) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2012.6224304 · Cited by 8
“• mean substitution [1], [2], [3] • listwise deletion [4], [5], [6]”
Background
A cross-sectional study of patterns of renewed stress among parents of children with autism
Fiske, K. (2009) · Rutgers University Community Repository (Rutgers University) · doi:10.7282/t3cr5tkj · Cited by 8
“Seltzer et al. (2001) report, among parents in their 50s, 57% of parents of children with developmental disabilities still lived with their affected child, compared to 41% of parents of children with other severe mental health disorders and only 16% of parents with typical children.”
Background
Outcomes of People of Color in an Efficacy Trial of Cognitive-Behavioral Treatments for Anxiety, Depression, and Related Disorders
Cardona, N. D., Ametaj, A., Cassiello-Robbins, C. F., Wilner, J. G., Olesnycky, O. S., Sauer-Zavala, S. E., Farchione, T. J., & Barlow, D. H. (2023) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000001692 · Cited by 6
A Preliminary Examination of the Effects of Transdiagnostic Versus Single Diagnosis Protocols on Anger During the Treatment of Anxiety Disorders
Cassiello-Robbins, C. F., Sauer-Zavala, S. E., Wilner, J. G., Bentley, K. H., Conklin, L. R., Farchione, T. J., & Barlow, D. H. (2018) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000834 · Cited by 7
“It all needs to be a full jigsaw, not just bits”: exploration of healthcare professionals’ beliefs towards supported self-management for long-term conditions
Anderson, N., & Özakinci, G. (2019) · BMC Psychology · doi:10.1186/s40359-019-0319-7 · Cited by 8
The predictive role of achievement goals adoption on sensation-seeking and risk taking in driving
Mascret, N., Nicolleau, M., Martha, C., Naude, C., Serre, T., & Ragot-Court, I. (2021) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2021.03.006 · Cited by 7
Evaluating the Feasibility and Reliability of Remotely Delivering and Scoring the North Star Ambulatory Assessment in Ambulant Patients with Duchenne Muscular Dystrophy
Emery, N. C., Strachan, K., Kulshrestha, R., Kuiper, J. H., & Willis, T. A. (2022) · Children · doi:10.3390/children9050728 · Cited by 7
“This method effectively implemented the commonly recommended ‘person mean’ imputation method [14,15].”
Method
The Moderating Effect of Reciprocity Beliefs on Work Outcomes
Hastings, S. E. (2011) · Scholarship@Western (Western University) · Cited by 7
An Empirical Investigation of Factors Contributing to Item Nonresponse in Self-Reported Bullying Instruments
Bulut, O., Xiao, J., Rodriguez, M. C., & Gorgun, G. (2020) · Journal of School Violence · doi:10.1080/15388220.2020.1770603 · Cited by 7
“Handling item nonresponse in survey data is highly important because: (1) item nonresponse can have a negative impact on both the psychometric quality of the instrument and the validity of results (Roth et al., 1999); (2) the presence of systematic item nonresponse may yield a dataset that is no longer representative…”
Background
Social work education and the recognition of rights in the digital tech age: implications for professional identity
Ricciardelli, L. A., McGarity, S. V., & Nackerud, L. G. (2020) · Social Work Education · doi:10.1080/02615479.2020.1805427 · Cited by 7
Cognitive Aspects of Generalised Anxiety Disorder in Adolescents: Exploring Intolerance of Uncertainty, Cognitive Avoidance, and Positive Beliefs About Worry
Shipp, L., Leigh, E., Laverton, A., Percy, R., & Waite, P. (2025) · Child Psychiatry & Human Development · doi:10.1007/s10578-025-01809-3 · Cited by 10
Impact of multiple commitments on the performance of open innovation projects: the mediating role of trusted and vigilant knowledge interaction
Qin, Y., & Wang, J. (2022) · Journal of Knowledge Management · doi:10.1108/jkm-06-2022-0454 · Cited by 6
Bird Feeders Increase Connection to Nature in Parents But Not in Their Children
Hammond, R. L. (2020) · Ecopsychology · doi:10.1089/eco.2019.0036 · Cited by 8
“…especially for parents, I excluded participants from analyses of CTN when they exceeded a tolerance threshold for missing and/or double-marked data of 30% of scale items in order to reduce the loss of power that would occur when using a listwise deletion method (Roth, Switzer, & Switzer, 1999).”
Anger as a Mechanism of Injustice Appraisals in Pediatric Chronic Pain
Miller, M. M., Williams, A. E., Scott, E. L., Trost, Z., & Hirsh, A. T. (2021) · Journal of Pain · doi:10.1016/j.jpain.2021.07.005 · Cited by 6
Implicit theories in driving: Scale development, validation, and predictive role on violations and driving self-efficacy
Nicolleau, M., Mascret, N., Martha, C., Naude, C., Serre, T., & Ragot-Court, I. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2022.03.003 · Cited by 8
Measuring Depression in Young Adults: Preliminary Development of an English Version of the Teate Depression Inventory
Ruan‐Iu, L., Pendergast, L. L., Liao, P.-C., Jones, P., von der Embse, N. P., Innamorati, M., & Balsamo, M. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20156470 · Cited by 6
“Missing data were minimal (<3%), and listwise deletion was used [53,54].”
Method
Beliefs about Alcohol and the College Experience, Locus of Self, and College Undergraduates’ Drinking Patterns*
Crawford, L. A., & Novak, K. B. (2011) · Sociological Inquiry · doi:10.1111/j.1475-682x.2011.00387.x · Cited by 6
The Influences of Stress and Social Support on Adherence to Health Promotion Strategies by People Living with HIV/AIDS in Dar es Salaam, Tanzania
Kaijage, T. J., & Wexler, S. (2010) · Journal of HIV/AIDS & Social Services · doi:10.1080/15381501.2010.502807 · Cited by 7
“This method of scoring, in effect, applies the technique of individual mean substitution for missing values; missing item scores for each participant are replaced by the mean of the participant's valid item scores (eg, person mean substitution), an approach that Bono, Ried, Kimberlin, and Vogel ( 2007 ), Roth, Switzer…”
Method
Psychometric properties of the Dimensions of Stressful Events Rating Scale.
Spilsbury, J. C., Fletcher, K. E., Creeden, R., & Friedman, S. (2008) · Traumatology An International Journal · doi:10.1177/1534765608321072 · Cited by 6
Évaluation de l’efficacité des méthodes de traitement des valeurs manquantes dans le contexte d’échelles de mesure de type Likert
Rousseau, M., & Bertrand, R. (2005) · Mesure et évaluation en éducation · doi:10.7202/1087029ar · Cited by 6
Do research and education matter to business school rankings?
Drnevich, P. L., Armstrong, C. E., Crook, T. A., & Crook, T. R. (2011) · International Journal of Management in Education · doi:10.1504/ijmie.2011.039483 · Cited by 6
Case management for frail older people. Effects on healthcare utilisation, cost in relation to utility, and experiences of the intervention
Sandberg, M. (2013) · Lund University Publications (Lund University) · Cited by 6
Organisational Justice, Individual Differences and Counterproductive Work Behaviour: A Longitudinal Study in New Zealand and Thailand
Jarunratanakul, P. (2013) · Research Commons (University of Waikato) · Cited by 5
State Differences in Tipping Attitudes and Behavior: Attributable to State Differences in Tipping Motivations?
Lynn, M. (2022) · Review of Regional Studies · doi:10.52324/001c.66200 · Cited by 5
Revising the Self-Harm Antipathy Scale: validation among staff in psychiatric healthcare in Sweden
Lantto, R., Jungert, T., Nilsson, M., Probert-Lindström, S., & Westling, S. (2020) · Nordic Journal of Psychiatry · doi:10.1080/08039488.2020.1733657 · Cited by 6
Dimensionality of the Pay Satisfaction Questionnaire: A Validation Study in Belgium
Gieter, S. D., Cooman, R. D., Pepermans, R., Caers, R., Bois, C. D., & Jegers, M. (2006) · Psychological Reports · doi:10.2466/pr0.98.3.640-650 · Cited by 5
Donor limited hot deck imputation: effects on parameter estimation
Joenssen, D. W., & Bankhofer, U. (2012) · Applied Computer Science · Cited by 5
The effects of ‘does not apply’ on measurement of temperament with the Infant Behavior Questionnaire—Revised: A cautionary tale for very young infants
Giesbrecht, G. F., & Dewey, D. (2014) · Early Human Development · doi:10.1016/j.earlhumdev.2014.08.003 · Cited by 5
“Although this procedure is known to attenuate variance and may produce inconsistent bias to parameter estimates (sometimes leading to Type 1 and other times leading to Type 2 errors) [9], it appears to produce reasonably unbiased parameter estimates when the overall rates of missing items are below 20% [10,11].”
Background
Serial indirect effects of psychosocial causal beliefs and stigma on help-seeking preferences for depression
Tsai, I.-C., Kao, Y., & Lien, Y. (2022) · Current Psychology · doi:10.1007/s12144-021-02683-7 · Cited by 5
“First, we imputed missing scale values using the participants’ mean if 25% or less of the item responses were missing (Roth, Switzer, and Switzer 1999).”
Method
Maternal distress during pregnancy and language development in preschool age: A population-based cohort study
Ribeiro, L. A., Zachrisson, H. D., Gustavson, K., & Schjølberg, S. (2015) · European Journal of Developmental Psychology · doi:10.1080/17405629.2015.1050373 · Cited by 5
Addressing End-User Privacy Concerns
Earp, J. B., & Antón, A. I. (2004) · Journal of the Association for Information Systems · Cited by 5
The Effects of Physical Work Environment Satisfaction and Shared Workspace Characteristics on Employee Behaviors Toward Their Organization: Using Environmental Control as a Mediator.
MacMillan, C. (2012) · Research Commons (University of Waikato) · Cited by 5
Vitamin B6 status and chronic chemotherapy-induced peripheral neuropathy: a prospective cohort study among patients with non-metastatic colorectal cancer receiving oxaliplatin-based chemotherapy
Renting, L., Zwart, N. R. K., Ueland, P. M., McCann, A., Ulvik, A., van Halteren, H. K., Lubberman, F. J. E., Winkels, R. M., Kampman, E., & Kok, D. E. G. (2024) · BMJ Oncology · doi:10.1136/bmjonc-2024-000462 · Cited by 4
Emotions Experienced by Students Taking Online and Classroom Quizzes
Stowell, J. R., Allan, W. D., & Teoro, S. M. (2012) · Journal of Educational Computing Research · doi:10.2190/ec.47.1.e · Cited by 4
Understanding Patients’ Reactions to Services: The Role of Personal Service Values in Heart Patient Satisfaction and Wellness
Sinclair, R. R., Fleming, W. D., Radwinsky, R., Clupper, D. R., & Clupper, J. H. (2002) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2002.tb00223.x · Cited by 4
Lack of Effects of the Presence of a Dog on Pain Perception in Healthy Participants—A Randomized Controlled Trial
Wagner, C., Gaab, J., Locher, C., & Hediger, K. (2021) · Frontiers in Pain Research · doi:10.3389/fpain.2021.714469 · Cited by 4
Utilization and Impact of Career Services Among Collegiate Athletes
Davis, E., Brgoch, S. M., Lower‐Hoppe, L. M., Lynch, M. R., Johnston, D., Wray, D., McCray, K., & Parietti, M. L. (2022) · Journal of Athlete Development and Experience · doi:10.25035/jade.04.03.03 · Cited by 4
“Additionally, composite scores for utilization and familiarity of career services were computed based on the average utilization and familiarity scores reported (Roth et al., 1999).”
Method
“Human behavior and the social media environment”: group differences in social media attitudes and knowledge among U.S. social work students
Ricciardelli, L. A., Quinn, A. E., & Nackerud, L. G. (2020) · Social Work Education · doi:10.1080/02615479.2019.1710125 · Cited by 4
College Alcohol-Control Policies and Students' Alcohol Consumption: A Matter of Exposure?
Demers, A., Beauregard, N., & Gliksman, L. (2013) · Contemporary Drug Problems · doi:10.1177/009145091304000203 · Cited by 4
Expanding understanding of mental health recovery: effects of stigma and working alliance on the quality of life of persons with severe mental disabilities receiving community-based case management services
Kondrat, D. C. (2009) · PsycEXTRA Dataset · doi:10.1037/e500392011-016 · Cited by 4
“Using the hypothesized relationships between items in each of the scales, the researcher used completed items in the scales to predict missing items in the scales (Roth et al. 1999).”
Method
Partial least squares structural equation modelling with incomplete data : an investigation of the impact of imputation methods
Jamil, M. F. A. (2012) · Bradford Scholars (University of Bradford) · Cited by 4
HydroTGNN: Filling missing streamflow data with graph neural network
Sui, T., Wang, C., Zhuang, Y., Yang, S., Fang, J., & Huang, Q. (2026) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2026.106937 · Cited by 3
QCA & CQCA: Quad Countries Algorithm and Chaotic Quad Countries Algorithm
Soltani-Sarvestani, M. A., & Lotfi, S. (2012) · Applied Computer Science · Cited by 3
Validation of Polish version of Gastrointestinal Dysfunction Scale for Parkinson’s Disease
Nowak, J. M., Antoniak, A., Kopczyński, M. H., Zając, W., Sadowski, K. A., Milanowski, Ł., Koziorowski, D., & Figura, M. (2024) · Neurologia i Neurochirurgia Polska · doi:10.5603/pjnns.98275 · Cited by 6
“Nevertheless, a missingness rate of below 20% is acceptable for psychometric scales [21, 22].”
Background
Remorse, psychopathology, psychopathic characteristics, and recidivism among adolescent offenders
Spice, A. (2013) · Summit (Simon Fraser University) · Cited by 3
Impact of teacher training on academic self-concept and educational outcomes
Lobos, K., Bustos, C., & Díaz, A. (2019) · Electronic Journal of Research in Educational Psychology · doi:10.25115/ejrep.v17i49.2219 · Cited by 3
Examining the Validity of a Model of Integrated Health Care Knowledge
Black, D. R., & Nugent, W. R. (2018) · Journal of the Society for Social Work and Research · doi:10.1086/699167 · Cited by 3
“We applied this method for missing values based on research (Roth et al., 1999) showing that missing items that are part of a subdomain are moderately to highly correlated.”
Method
The nature of the student-institution relationship and behavioral indicators of personal and social responsibility: an exploration of the association between relational quality outcomes, alcohol use, and academic honesty
Boyd, K. D. (2010) · Cited by 3
Effects of Sexual Abuse and Cultural Coping on African American Parent-Child Relationships: Implications for Intervention
Miller, A. K. (2010) · Digital Archive @ GSU · doi:10.57709/1396778 · Cited by 3
Team Dynamics and Learning Behavior in Hospitals: A Study of Error Reporting by Nurses
Munn, L. T. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/tab9-xg64 · Cited by 3
Stressors, Strains and Social Support: Occupational Experiences of University Professors
Moeller, C. (2009) · Cited by 3
The Relationships among Organizational Service Orientation, Customer Service Training, and Employee Engagement
Johnson, K. R. (2011) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 3
Factors Affecting Students' Career Choice in New Zealand
Pang, N. G. M. H. (2014) · Research Commons (University of Waikato) · Cited by 3
A Legal and Empirical Study of 3D Printing Online Platforms and an Analysis of User BehaviourPreprint
Submitter, I. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.4095841 · Cited by 3
A psychological contract perspective of supervisors’ satisfaction with employees
Darden, T. R., Brekashvili, P., Lambert, L. S., Currie, R., & Hardt, G. (2025) · Journal of Management & Organization · doi:10.1017/jmo.2024.50 · Cited by 2
“This procedure affected 0.1% of the data in the sample (Roth, Switzer, & Switzer, 1999), affecting 108 values.”
Influential
Innovative knowledge-based system for streamflow hindcasting: A comparative assessment of Gaussian Process-Integrated Neural Network with LSTM and GRU models
R, A. N. G., & Adarsh, S. (2025) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2025.106433 · Cited by 2
Measuring Family Engagement in Psychiatric Service: An Evaluation of the Family/Visitor Survey
Kondrat, D. C., Early, T. J., & Warren, K. L. (2011) · Social Work in Mental Health · doi:10.1080/15332985.2010.545334 · Cited by 2
“Using a simulation study to determine the best ways to estimate missing values, Roth, Switzer, and Switzer (1999) argue that a single random imputation is a good approach for simulating data when items in a scale are missing.”
Method
The Role of Androgens in Life History Theories of Attachment
Sankar, J. (2015) · Scholarship@Western (Western University) · Cited by 2
Job Insecurity, Organizational Citizenship Behaviors, and Job Search Activities: How Work Locus of Control and Control-Oriented Coping Moderate These Relationships
McInroe, J. A. (2013) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 2
Determining the relationships between resilience, spirituality, life events, disruptions, demographic characteristics, personal history, and mental health symptoms in active duty soldiers with a recent deployment history
Simmons, A. (2012) · Texas ScholarWorks (Texas Digital Library) · Cited by 2
Identity, cohesion, and enmeshment across cultures
Gomez, S. B. (2014) · Cited by 2
The Influence of Team Cohesion and Contextual Performance on Project Team Performance Over Time
Vazquez, M. (2019) · Digital Commons-DePaul (DePaul University) · Cited by 2
This just in : analysis of factors influencing online newspaper reading behaviour
Schoneville, S. (2007) · Cited by 2
Data Analytic Methods
Landis, R. S. (2013) · Oxford University Press eBooks · doi:10.1093/obo/9780199846740-0065 · Cited by 2
Loneliness and mental health in a randomised controlled trial of a peer-provided self-management intervention for people leaving crisis resolution teams
Wang, J. (2018) · UCL Discovery (University College London) · doi:10.13140/rg.2.2.22466.61126 · Cited by 2
Fostering Work Engagement through State and Trait Trust: Evidence from Irish University Research Centres
Chughtai, A. A. (2010) · Dublin City University Open Access Institutional Repository (Dublin City University) · Cited by 2
Missing Data: A Gentle Introduction by Patrick E. McKnight, Katherine M. McKnight, Souraya Sidani, and Aurelio Jose Figueredo
(2008) · Personnel Psychology · doi:10.1111/j.1744-6570.2008.00111_8.x · Cited by 2
The change of working alliance and the association to treatment outcome in an internet-based therapy after pregnancy loss
Kramuschke, M., Reinhardt, J., Dölemeyer, R., Kaiser, J., & Kersting, A. (2024) · BMC Psychology · doi:10.1186/s40359-024-01751-4 · Cited by 2
“Nevertheless, the WAI-S is a reliable measure of the therapeutic alliance [61].”
BackgroundMethodInfluential
The Effects of Missing Data Handling Methods on Reliability Coefficients: A Monte Carlo Simulation Study
Kaçak, T., & Kılıç, A. F. (2024) · Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi · doi:10.21031/epod.1485482 · Cited by 1
A Social Cognitive Approach to Improving Stress and Anxiety Management Among Student Pharmacists
King, S. R., Hallam, J. S., & Schwindt, V. E. (2025) · American Journal of Pharmaceutical Education · doi:10.1016/j.ajpe.2025.101486 · Cited by 1
Poverty Simulations: Are the Learning Outcomes Consistently and Uniformly Positive?
McQuistan, M. R., Young, L. B., & Pendleton, C. (2025) · Journal of Dental Education · doi:10.1002/jdd.70090 · Cited by 1
“Otherwise, case mean substitution was used to replace missing values [35, 36].”
How 'Job Creators' Think
Brigham, K. H., Mitchell, R. K., & Stambaugh, J. (2014) · doi:10.17919/x9vc7p
Optimality and Robustness of Vector Autoregression Forecasting Under Missing Values
Kharin, Y. S. (2013) · Springer eBooks · doi:10.1007/978-3-319-00840-0_8 · Cited by 1
Title: Brief Implicit Association Tests of Stigmatizing Attitudes, Awareness of Mental Distress and Label-Avoidance: A Study in People with Depressive Symptoms
Freitag, S., Stolzenburg, S., Schomerus, G., & Schmidt, S. (2019) · Community Mental Health Journal · doi:10.1007/s10597-019-00372-1 · Cited by 1
The relationship between anxiety, coping, and disordered-eating attitudes in adolescent military-dependents at high-risk for excess weight gain
Solomon, S., Shank, L. M., Lavender, J. M., Neyland, M. K. H., Gallagher-Teske, J. H., Markos, B., Haynes, H. E., Repke, H. E., Rice, A. J., Sbrocco, T., et al. (2022) · Military Psychology · doi:10.1080/08995605.2022.2083448 · Cited by 1
“Following previous studies, the global score was computed if each subscale had less than or equal to 20% missing data (Graham, 2009; Newman, 2014; Roth et al., 1999).”
Method
Cyclic clustering approach to impute missing values for cyclostationary hydrological time series
Mahmoudi, M. R. (2022) · Quality & Quantity · doi:10.1007/s11135-022-01484-9 · Cited by 1
Multiple Imputation with Factor Scores: A Practical Approach for Handling Simultaneous Missingness Across Items in Longitudinal Designs
Li, Y., Oravecz, Z., Ji, L., & Chow, S. (2024) · Multivariate Behavioral Research · doi:10.1080/00273171.2024.2371816 · Cited by 1
“…are more challenging to handle compared with missingness in specific, scattered items because in the latter, many existing techniques can still be used to yield reasonable imputed scores for the missing values based on other observed items measuring the same latent construct (Roth et al., 1999).”
Nurses' Intention to Support Informed Decision-Making about Breast Cancer Screening with Mammography: A Survey
Kiyang, L.-N., Labrecque, M., Doualla‐Bell, F., Turcotte, S., Roch, G., Farley, C., Bas, M. C., & Légaré, F. (2013) · Canadian Journal of Nursing Research · doi:10.1177/084456211304500309 · Cited by 1
Simulation and Virtual Experimentation: Grounding with Empirical Data
Kennedy, D., & McComb, S. (2017) · Computational social sciences · doi:10.1007/978-3-319-48941-4_8 · Cited by 1
Employee Needs and Job-Related Opportunities: From The Person-Environment Fit Framework
Goo, W. (2022) · Digital Archive @ GSU · doi:10.57709/6558738 · Cited by 1
The relationship between attachment styles and employee creativity: evidence from the engineering industry.
Kidney, R. (2013) · Dublin City University Open Access Institutional Repository (Dublin City University) · Cited by 1
The link between social representations of HIV/AIDS and sexual behaviour amongst young people in Ghana and the U.K.
Baah‐Odoom, D. (2010) · UPT. Syiah Kuala University Library (Syiah Kuala University) · Cited by 1

Authors: Roth, P. L., Switzer, F. S., & Switzer, D. M.
Affiliations: Clemson University (US)
ORCID: Roth, Philip L.
Switzer, Fred S.
Venue: Organizational Research Methods
Publisher: SAGE Publications
Published: 1999-07
Volume: 2
Issue: 3
Pages: 211-232
ISSN: 1094-4281 (ISSN-L)
1552-7425
DOI: 10.1177/109442819923001
OpenAlex: W2122169890
Cited by: 344
References: 39
Citations by year: 2026: 5 · 2025: 7 · 2024: 11 · 2023: 8 · 2022: 17 · 2021: 14 · 2020: 16 · 2019: 20 · 2018: 28 · 2017: 17 · 2016: 15 · 2015: 19 · 2014: 19 · 2013: 21 · 2012: 26
FWCI: 2.99
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Organizational Research Methods (publishedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
Keywords: missing data, regression imputation, hot deck imputation, mean substitution, listwise deletion, imputation accuracy, attitudes, personality traits

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Missing Data in Multiple Item Scales: A Monte Carlo Analysis of Missing Data Techniques

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks