Best practices for missing data management in counseling psychology
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
This article urges counseling psychology researchers to recognize and report how missing data are handled, because consumers of research cannot accurately interpret findings without knowing the amount and pattern of missing data or the strategies that were used to handle those data. Patterns of missing data are reviewed, and some of the common strategies for dealing with them are described. The authors provide an illustration in which data were simulated and evaluate 3 methods of handling missing data: mean substitution, multiple imputation, and full information maximum likelihood. Results suggest that mean substitution is a poor method for handling missing data, whereas both multiple imputation and full information maximum likelihood are recommended alternatives to this approach. The authors suggest that researchers fully consider and report the amount and pattern of missing data and the strategy for handling those data in counseling psychology research and that editors advise researchers of this expectation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Missing data were imputed using a Markov Chain Monte Carlo multivariate imputation algorithm with ten estimations per missing value (Schlomer et al., 2010).”
From Smartphone-Based Emotion Recognition Skills Training for Alexithymia—A Randomized Controlled Pilot Study (2019) · cites this paper as Schlomer et al., 2010
Citations
Cites
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Applied Multivariate Statistics for the Social Sciences
Stevens, J. P. (2012) · Routledge eBooks · doi:10.4324/9780203843130 · Cited by 10,648
A test of missing completely at random for multivariate data with missing values
Little, R. J. A. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478722 · Cited by 8,963
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163 · cited 1×
“We invite readers to refer to other existing literature that specifically deal with categorical missing data (e.g., Allison, 2001; Chen & Astebro, 2003; Graham, 2009).”
MethodAnalysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
SPSS Survival Manual: A Step by Step Guide to Data Analysis using IBM SPSS
Pallant, J. (2020) · Routledge eBooks · doi:10.4324/9781003117407 · Cited by 5,201
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978
Schafer, J. L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800102 · Cited by 3,949
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Cited by
Principled missing data methods for researchers
Dong, Y., & Peng, C.-Y. J. (2013) · SpringerPlus · doi:10.1186/2193-1801-2-222 · Cited by 2,208
“Another advantage of MI over ML-based methods is its computational simplicity (Sinharay et al. 2001).”
BackgroundTaylor, G., Jungert, T., Mageau, G. A., Schattke, K., Dedic, H., Rosenfield, S., & Koestner, R. (2014) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.08.002 · Cited by 816
“This technique has also been shown to outperform older ad-hoc procedures such as listwise deletion or mean substitution (Schlomer et al., 2010), and several studies have indicated that it yields the least biased and most efficient parameter estimates (Peugh & Enders, 2004).”
MethodHandling Item-Level Missing Data: Simpler Is Just as Good
Parent, M. C. (2013) · The Counseling Psychologist · doi:10.1177/0011000012445176 · Cited by 685
“The same blurring is present within the paper by Schlomer et al. (2010), who discuss both item- and scale-level missingness but do not make distinctions between them; indeed, results of their analysis, which focuses on very high levels of scale-level missingness in a three-variable model, are…”
BackgroundResultInfluentialAssociations among bullying, cyberbullying, and suicide in high school students
Bauman, S., Toomey, R. B., & Walker, J. L. (2013) · Journal of Adolescence · doi:10.1016/j.adolescence.2012.12.001 · Cited by 665
Self-citationBelsky, J., Schlomer, G. L., & Ellis, B. J. (2012) · Developmental Psychology · doi:10.1037/a0024454 · Cited by 612
Self-citation
Metadata
- Authors
- Schlomer, G. L., Bauman, S., & Card, N. A.
- Affiliations
- University of Arizona (US)
- Venue
- Journal of Counseling Psychology
- Published
- 2010
- Volume
- 57
- Issue
- 1
- Pages
- 1-10
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W2097814478
- Cited by
- 1,835
- References
- 30
- Citations by year
- 2026: 66 · 2025: 98 · 2024: 90 · 2023: 124 · 2022: 143 · 2021: 148 · 2020: 155 · 2019: 165 · 2018: 118 · 2017: 125 · 2016: 126 · 2015: 147 · 2014: 133 · 2013: 91 · 2012: 58
- FWCI
- 54.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Counseling Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- missing data, missing data patterns, missing data handling, mean substitution, multiple imputation, full information maximum likelihood, reporting practices, simulation study, counseling psychology research
- MeSH terms
- Counseling, Data Collection, Data Interpretation, Statistical, Humans, Psychology, Research Design, Bias, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.