MISSING DATA: A CONCEPTUAL REVIEW FOR APPLIED PSYCHOLOGISTS
Abstract
There has been conspicuously little research concerning missing data problems in the applied psychology literature. Fortunately, other fields have begun to investigate this issue. These include survey research, marketing, statistics, economics, and biometrics. A review of this literature suggests several trends for applied psychologists. For example, listwise deletion of data is often the least accurate technique to deal with missing data. Other methods for estimating missing data scores may be more accurate and preserve more data for investigators to analyze. Further, the literature reveals that the amount of missing data and the reasons for deletion of data impact how investigators should handle the problem. Finally, there is a great need for more investigation of strategies for dealing with missing data, especially when data are missing in nonrandom or systematic patterns.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
If no reliability estimate could be located, a mean substitution was conducted within the ability or personality category.
“If no reliability estimate could be located than a mean substitution was conducted within the ability or personality category (Roth, 1994).”
From Extraversion and intelligence: A meta-analytic investigation (2005) · cites this paper as Roth, 1994
Cites
Maximum Likelihood from Incomplete Data Via the <i>EM</i> Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444 · see citing works
On structural equation modeling with data that are not missing completely at random
Muthén, B., Kaplan, D., & Hollis, M. (1987) · Psychometrika · doi:10.1007/bf02294365 · Cited by 883 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978 · see citing works
Best practices for missing data management in counseling psychology
Schlomer, G. L., Bauman, S., & Card, N. A. (2010) · Journal of Counseling Psychology · doi:10.1037/a0018082 · Cited by 1,835 · see citing works
A Primer on Maximum Likelihood Algorithms Available for Use With Missing Data
Enders, C. K. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0801_7 · Cited by 1,027 · see citing works
Improving PLS-SEM Use for Business Marketing Research
Guenther, P., Guenther, M., Ringle, C. M., Zaefarian, G., & Cartwright, S. (2023) · Industrial Marketing Management · doi:10.1016/j.indmarman.2023.03.010 · Cited by 800 · see citing works
Drnevich, P. L., & Kriauciunas, A. P. (2011) · Strategic Management Journal · doi:10.1002/smj.882 · Cited by 681 · see citing works
Missing Data in Multiple Item Scales: A Monte Carlo Analysis of Missing Data Techniques
Roth, P. L., Switzer, F. S., & Switzer, D. M. (1999) · Organizational Research Methods · doi:10.1177/109442819923001 · Cited by 344 · see citing works
Nurses' Work Schedule Characteristics, Nurse Staffing, and Patient Mortality
Trinkoff, A. M., Johantgen, M., Storr, C. L., Gurses, A. P., Liang, Y., & Han, K. (2011) · Nursing Research · doi:10.1097/nnr.0b013e3181fff15d · Cited by 208 · see citing works
Johnson, M. O., Chesney, M. A., Goldstein, R. B., Remien, R. H., Catz, S., Gore-Felton, C., Charlebois, E., Morin, S. F., & NIMH Healthy Living Project Team (2006) · AIDS Patient Care and STDs · doi:10.1089/apc.2006.20.258 · Cited by 170 · see citing works
Extraversion and intelligence: A meta-analytic investigation
Wolf, M. B., & Ackerman, P. L. (2005) · Personality and Individual Differences · doi:10.1016/j.paid.2005.02.020 · Cited by 101 · see citing works
Correcting the Effect Size of d for Range Restriction and Unreliability
Bobko, P., Roth, P. L., & Bobko, C. (2001) · Organizational Research Methods · doi:10.1177/109442810141003 · Cited by 84 · see citing works
Self-citationMultiple imputation of multiple multi-item scales when a full imputation model is infeasible
Plumpton, C. O., Morris, T., Hughes, D. A., & White, I. R. (2016) · BMC Research Notes · doi:10.1186/s13104-016-1853-5 · Cited by 76 · see citing works
Sachan, S., Almaghrabi, F., Yang, J.-B., & Xu, D.-L. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115597 · Cited by 66 · see citing works
Is emotion regulation associated with cancer-related psychological symptoms?
Guimond, A.-J., Ivers, H., & Savard, J. (2019) · Psychology & Health · doi:10.1080/08870446.2018.1514462 · Cited by 51 · see citing works
Attitudes toward women, rape myths, and rape perceptions among male police officers in South Korea
Lee, J., Lee, C., & Lee, W. (2012) · Psychology of Women Quarterly · doi:10.1177/0361684311427538 · Cited by 49 · see citing works
Clusters of Psychological Symptoms in Breast Cancer
Guimond, A.-J., Ivers, H., & Savard, J. (2020) · Cancer Nursing · doi:10.1097/ncc.0000000000000705 · Cited by 38 · see citing works
Haines, C., Loades, M., & Davis, C. (2019) · Clinical Child Psychology and Psychiatry · doi:10.1177/1359104519829796 · Cited by 39 · see citing works
Effects of group and individual-based step goals on children's physical activity levels in school
Kang, M., & Brinthaupt, T. M. (2009) · Pediatric Exercise Science · doi:10.1123/pes.21.2.148 · Cited by 25 · see citing works
Chong, Y. Y., Mak, Y. W., & Loke, A. Y. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.110208 · Cited by 12 · see citing works
- Authors
- ROTH, P. L.
- Affiliations
- Clemson University (US)
- Corresponding author
- ROTH, PHILIP L.
- ORCID
- ROTH, PHILIP L.
- Venue
- Personnel Psychology
- Publisher
- Wiley
- Published
- 1994-09
- Volume
- 47
- Issue
- 3
- Pages
- 537-560
- ISSN
- 0031-5826 (ISSN-L)
- 1744-6570
- OpenAlex
- W2032578483
- Cited by
- 901
- References
- 2
- Citations by year
- 2026: 16 · 2025: 17 · 2024: 19 · 2023: 32 · 2022: 27 · 2021: 37 · 2020: 39 · 2019: 49 · 2018: 42 · 2017: 36 · 2016: 43 · 2015: 54 · 2014: 53 · 2013: 59 · 2012: 31
- FWCI
- 3.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Personnel Psychology (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- missing data, listwise deletion, multiple imputation, missing data estimation, survey data analysis, applied psychology research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
