Best practices for missing data management in counseling psychology
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
This article urges counseling psychology researchers to recognize and report how missing data are handled, because consumers of research cannot accurately interpret findings without knowing the amount and pattern of missing data or the strategies that were used to handle those data. Patterns of missing data are reviewed, and some of the common strategies for dealing with them are described. The authors provide an illustration in which data were simulated and evaluate 3 methods of handling missing data: mean substitution, multiple imputation, and full information maximum likelihood. Results suggest that mean substitution is a poor method for handling missing data, whereas both multiple imputation and full information maximum likelihood are recommended alternatives to this approach. The authors suggest that researchers fully consider and report the amount and pattern of missing data and the strategy for handling those data in counseling psychology research and that editors advise researchers of this expectation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Missing data were imputed using a Markov Chain Monte Carlo multivariate imputation algorithm with ten estimations per missing value (Schlomer et al., 2010).”
From Smartphone-Based Emotion Recognition Skills Training for Alexithymia—A Randomized Controlled Pilot Study (2019) · cites this paper as Schlomer et al., 2010
Citations
Cites
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Applied Multivariate Statistics for the Social Sciences
Stevens, J. P. (2012) · Routledge eBooks · doi:10.4324/9780203843130 · Cited by 10,648
A test of missing completely at random for multivariate data with missing values
Little, R. J. A. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478722 · Cited by 8,963
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163 · cited 1×
“We invite readers to refer to other existing literature that specifically deal with categorical missing data (e.g., Allison, 2001; Chen & Astebro, 2003; Graham, 2009).”
MethodAnalysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
SPSS Survival Manual: A Step by Step Guide to Data Analysis using IBM SPSS
Pallant, J. (2020) · Routledge eBooks · doi:10.4324/9781003117407 · Cited by 5,201
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978
Schafer, J. L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800102 · Cited by 3,949
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Cited by
Principled missing data methods for researchers
Dong, Y., & Peng, C.-Y. J. (2013) · SpringerPlus · doi:10.1186/2193-1801-2-222 · Cited by 2,208
“Another advantage of MI over ML-based methods is its computational simplicity (Sinharay et al. 2001).”
BackgroundTaylor, G., Jungert, T., Mageau, G. A., Schattke, K., Dedic, H., Rosenfield, S., & Koestner, R. (2014) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.08.002 · Cited by 816
“This technique has also been shown to outperform older ad-hoc procedures such as listwise deletion or mean substitution (Schlomer et al., 2010), and several studies have indicated that it yields the least biased and most efficient parameter estimates (Peugh & Enders, 2004).”
MethodHandling Item-Level Missing Data: Simpler Is Just as Good
Parent, M. C. (2013) · The Counseling Psychologist · doi:10.1177/0011000012445176 · Cited by 685
“The same blurring is present within the paper by Schlomer et al. (2010), who discuss both item- and scale-level missingness but do not make distinctions between them; indeed, results of their analysis, which focuses on very high levels of scale-level missingness in a three-variable model, are…”
BackgroundResultInfluentialAssociations among bullying, cyberbullying, and suicide in high school students
Bauman, S., Toomey, R. B., & Walker, J. L. (2013) · Journal of Adolescence · doi:10.1016/j.adolescence.2012.12.001 · Cited by 665
Self-citationBelsky, J., Schlomer, G. L., & Ellis, B. J. (2012) · Developmental Psychology · doi:10.1037/a0024454 · Cited by 612
Self-citationCORD-19: The COVID-19 Open Research Dataset
Wang, L. L., Lo, K., Chandrasekhar, Y., Reas, R., Yang, J., Burdick, D., Eide, D., Funk, K., Katsis, Y., Kinney, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.10706
Effects of School-Wide Positive Behavioral Interventions and Supports on Child Behavior Problems
Bradshaw, C. P., Waasdorp, T. E., & Leaf, P. J. (2012) · Pediatrics · doi:10.1542/peds.2012-0243 · Cited by 472
Wang, Y. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106373 · Cited by 424
Eaton, A. A., Saunders, J. F., Jacobson, R. K., & West, K. (2020) · Sex Roles · doi:10.1007/s11199-019-01052-w · Cited by 391
Park, T., Reilly-Spong, M., & Gross, C. R. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0395-8 · Cited by 370
“Nevertheless, inadequate reporting and handling of missing data are problematic [79], and developers should be strongly encouraged to report rates of missing data and use robust methods for imputation.”
BackgroundDaily multidimensional racial discrimination among Black U.S. American adolescents
English, D., Lambert, S. F., Tynes, B. M., Bowleg, L., Zea, M. C., & Howard, L. C. (2020) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2019.101068 · Cited by 370
Main, A., Zhou, Q., Ma, Y., Luecken, L. J., & Liu, X. (2011) · Journal of Counseling Psychology · doi:10.1037/a0023632 · Cited by 361
“Listwise deletion was used to handle missing data in regression analyses because this approach provides unbiased parameter estimates under MCAR (Graham, 2009; Schlomer et al., 2010).”
MethodBrough, P., Timms, C., O'Driscoll, M. P., Kalliath, T., Siu, O.-L., Sit, C., & Lo, D. (2014) · The International Journal of Human Resource Management · doi:10.1080/09585192.2014.899262 · Cited by 351
The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)
Phan, M. H., Keebler, J. R., & Chaparro, B. S. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816669646 · Cited by 342
“The EM method is considered to be most appropriate for non-hypothesis-testing analyses, such as EFA and internal consistency calculations (Enders, 2003; Schlomer, Bauman, & Card, 2010).”
MethodMereish, E. H., & Poteat, V. P. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000088 · Cited by 335
Lam, S.-F., Jimerson, S., Kikas, E., Cefai, C., Veiga, F. H., Nelson, B., Hatzichristou, C., Polychroni, F., Basnett, J., Duck, R., et al. (2012) · Journal of School Psychology · doi:10.1016/j.jsp.2011.07.004 · Cited by 322
Schleider, J., & Weisz, J. (2018) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12811 · Cited by 320
Wang, Y., Cao, Y., Gong, S., Wang, Z., Li, N., & Ai, L. (2022) · Learning and Individual Differences · doi:10.1016/j.lindif.2022.102128 · Cited by 308
Burić, I., & Moè, A. (2020) · Teaching and Teacher Education · doi:10.1016/j.tate.2019.103008 · Cited by 299
When Does Time Matter? Maternal Employment, Children’s Time With Parents, and Child Development
Hsin, A., & Felfe, C. (2014) · Demography · doi:10.1007/s13524-014-0334-5 · Cited by 302
“In order to preserve our sample size, we follow Schlomer et al. (2010) and impute missing values on all covariates, including the 1997 test scores,4 using multiple imputations by chained equations.5 In our analysis of children’s time with fathers, we restrict our sample to only children who reside…”
Dzhambov, A., Hartig, T., Markevych, I., Tilov, B., & Dimitrova, D. (2018) · Environmental Research · doi:10.1016/j.envres.2017.09.015 · Cited by 303
Long-term effects of child abuse and neglect on emotion processing in adulthood
Young, J. C., & Widom, C. S. (2014) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2014.03.008 · Cited by 287
Practical and statistical issues in missing data for longitudinal patient-reported outcomes
Bell, M. L., & Fairclough, D. L. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280213476378 · Cited by 285
Wei, M., Su, J. C., Carrera, S., Lin, S.-P., & Yi, F. (2013) · Journal of Counseling Psychology · doi:10.1037/a0033413 · Cited by 282
Positive parenting predicts the development of adolescent brain structure: a longitudinal study
Whittle, S., Simmons, J. G., Dennison, M., Vijayakumar, N., Schwartz, O., Yap, M. B. H., Sheeber, L., & Allen, N. B. (2014) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2013.10.006 · Cited by 279
“For the PSI, up to five issues for discussion were selected that both the mother and adolescent endorsed as occurring the most frequently and generating the highest intensity of anger on the Issues Checklist (Prinz et al., 1979).”
Randall, A. K., Leon, G., Basili, E., Martos, T., Boiger, M., Baldi, M., Hocker, L., Kline, K., Masturzi, A., Aryeetey, R., et al. (2022) · Journal of Social and Personal Relationships · doi:10.1177/02654075211034236 · Cited by 273
“Finally, cases with missing responses above 25% were also considered as ineligible for inclusion in the final dataset and the subsequent data imputation procedure (Schlomer et al., 2010).”
BackgroundWaasdorp, T. E. (2012) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2011.755 · Cited by 263
“Although the participation rate was consistently high, we examined the patterns of missing data but did not find evidence that the level of missingness was problematic.(36,37) For example, baseline scores on concentration problems were unrelated to subsequent missingness on this measure (adjusted odds ratio=1.”
BackgroundCheng, H.-L., Kwan, K.-L. K., & Sevig, T. (2013) · Journal of Counseling Psychology · doi:10.1037/a0031169 · Cited by 258
Sudore, R. L., Boscardin, J., Feuz, M. A., McMahan, R. D., Katen, M. T., & Barnes, D. E. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2017.1607 · Cited by 235
“Documented discussions about ACP 61 (29) 63 (31)”
BackgroundRenshaw, T. L., Long, A. C. J., & Cook, C. R. (2015) · School Psychology Quarterly · doi:10.1037/spq0000112 · Cited by 225
Levant, R. F., Hall, R. J., & Rankin, T. J. (2013) · Journal of Counseling Psychology · doi:10.1037/a0031545 · Cited by 222
Aguinis, H., Ramani, R. S., & Alabduljader, N. (2023) · Organizational Research Methods · doi:10.1177/1094428120943281 · Cited by 222
Renshaw, T. L., Long, A. C. J., & Cook, C. R. (2015) · School Psychology Quarterly · doi:10.1037/spq0000088 · Cited by 207
Schwartz, S. J., Weisskirch, R. S., Zamboanga, B. L., Castillo, L. G., Ham, L. S., Huynh, Q.-L., Park, I. J. K., Donovan, R., Kim, S. Y., Vernon, M., et al. (2011) · Journal of Counseling Psychology · doi:10.1037/a0021356 · Cited by 202
A multifactor Lesbian, Gay, and Bisexual Positive Identity Measure (LGB-PIM).
Riggle, E. D. B., Mohr, J. J., Rostosky, S. S., Fingerhut, A. W., & Balsam, K. F. (2014) · Psychology of Sexual Orientation and Gender Diversity · doi:10.1037/sgd0000057 · Cited by 193
Perfectionism, procrastination, and psychological distress.
Rice, K. G., Richardson, C. M. E., & Clark, D. (2012) · Journal of Counseling Psychology · doi:10.1037/a0026643 · Cited by 183
“We followed procedures described by Enders (2010) and Schlomer, Bauman, and Card (2010) to describe and explore missing data.”
MethodProfiles of acculturative adjustment patterns among Chinese international students.
Wang, K. T., Heppner, P. P., Fu, C.-C., Zhao, R., Li, F., & Chuang, C.-C. (2012) · Journal of Counseling Psychology · doi:10.1037/a0028532 · Cited by 181
Massive LMS log data analysis for the early prediction of course-agnostic student performance
Riestra-González, M., Paule-Ruíz, M. D. P., & Ortin, F. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104108 · Cited by 178
“…the mean substitution method, based on replacing null values with Table 7: Independent variables with the greatest Gini importance to classify at-risk, fail/pass and excellent students (respective mark thresholds 2.5, 5.0 and 8.5). the average value for that feature in the whole dataset [45, 46].”
MethodInfluentialGraphical Models for Processing Missing Data
Mohan, K., & Pearl, J. (2021) · Journal of the American Statistical Association · doi:10.1080/01621459.2021.1874961 · Cited by 158
“in wastage of data. Pairwise deletion (or available case analysis) is a deletion method that drastically reduces data loss by operating on all samples in which the variables of interest are observed (Schlomer et al., 2010). For example, to compute the covariance of variables X and Y, all those cases or observations in…”
MethodUmaña-Taylor, A. J., Tynes, B. M., Toomey, R. B., Williams, D. R., & Mitchell, K. J. (2015) · Developmental Psychology · doi:10.1037/a0038432 · Cited by 170
Parent, M. C., & Moradi, B. (2011) · Journal of Counseling Psychology · doi:10.1037/a0021398 · Cited by 166
Trajectories of Social Engagement and Limitations in Late Life
Thomas, P. A. (2011) · Journal of Health and Social Behavior · doi:10.1177/0022146511411922 · Cited by 164
Gana, K., Bailly, N., Saada, Y., Joulain, M., Trouillet, R., Hervé, C., & Alaphilippe, D. (2013) · Health Psychology · doi:10.1037/a0031656 · Cited by 163
Bidell, M. P. (2017) · Journal of Homosexuality · doi:10.1080/00918369.2017.1321389 · Cited by 205
Atkins, M. R., Johnson, D. M., Force, E. C., & Petrie, T. A. (2015) · Psychology of Sport and Exercise · doi:10.1016/j.psychsport.2014.10.008 · Cited by 159
Storch, E. A., Sulkowski, M. L., Nadeau, J., Lewin, A. B., Arnold, E. B., Mutch, P. J., Jones, A. M., & Murphy, T. K. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-013-1795-x · Cited by 157
“0 to replace missing values with a set of plausible values that account for variability across imputations (Schlomer et al. 2010).”
BackgroundBernier, A., Beauchamp, M. H., Carlson, S. M., & Lalonde, G. (2015) · Developmental Psychology · doi:10.1037/dev0000032 · Cited by 199
A generalized item response tree model for psychological assessments
Jeon, M., & de Boeck, P. A. L. (2015) · Behavior Research Methods · doi:10.3758/s13428-015-0631-y · Cited by 160
“However, adequate reporting and handling of missing data is often ignored in practice (Peng et al., 2006; Saunders et al., 2006; Schlomer et al., 2010).”
BackgroundHughes, J. N., & Cao, Q. (2017) · Journal of School Psychology · doi:10.1016/j.jsp.2017.10.003 · Cited by 193
Marques‐Quinteiro, P., Vargas, R., Eifler, N., & Curral, L. A. (2018) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2018.1551882 · Cited by 214
“stochastic regression or expectation maximization (Schlomer et al., 2010).”
BackgroundMethodInfluentialLiao, K. Y., Wei, M., & Yin, M. (2019) · Psychology of Women Quarterly · doi:10.1177/0361684319883198 · Cited by 220
“The results suggest the appropriateness of using model-based methods of missing data estimation, namely the full information maximum likelihood (FIML) estimation (Schlomer et al., 2010).”
MethodCheng, H., & Mallinckrodt, B. S. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000052 · Cited by 184
Exploratory Factor Analysis With Small Samples and Missing Data
McNeish, D. (2016) · Journal of Personality Assessment · doi:10.1080/00223891.2016.1252382 · Cited by 187
“…used in the first stage is often stated to be unbiased so long as the missing values are missing at random (MAR), this property is more accurately expressed by estimates being asymptotically unbiased when data are MAR, meaning that small samples might be problematic (Schlomer et al., 2010).”
BackgroundZygmont, C. S., & Smith, M. R. (2014) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.10.1.p040 · Cited by 192
Love me Tinder: Body image and psychosocial functioning among men and women
Strübel, J., & Petrie, T. A. (2017) · Body Image · doi:10.1016/j.bodyim.2017.02.006 · Cited by 204
Parent, M. C., & Moradi, B. (2011) · Psychology of Men & Masculinity · doi:10.1037/a0021904 · Cited by 190
Using Group-Based Trajectory and Growth Mixture Modeling to Identify Classes of Change Trajectories
Frankfurt, S. B., Frazier, P. A., Syed, M., & Jung, K. R. (2016) · The Counseling Psychologist · doi:10.1177/0011000016658097 · Cited by 170
Bishop-Fitzpatrick, L., Hong, J., Smith, L. E., Makuch, R. A., Greenberg, J. S., & Mailick, M. R. (2016) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-016-2816-3 · Cited by 142
“1% of data on maternal warmth and maternal criticism) were imputed using the expectationmaximization algorithm, which results in less biased parameter estimates than mean or regression imputation (Dempster et al. 1977; Honaker et al. 2011; Schafer and Graham 2002; Schlomer et al. 2010).”
MethodKeith, J. M., Bennetto, L., & Rogge, R. D. (2015) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2015.07.032 · Cited by 176
Bradshaw, C. P., Waasdorp, T. E., & Leaf, P. J. (2014) · Journal of Educational Psychology · doi:10.1037/a0037630 · Cited by 188
Liu, X., Zhao, Y., Li, J., Dai, J., Wang, X., & Wang, S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00537 · Cited by 163
Does Life Satisfaction Change in Old Age: Results From an 8-Year Longitudinal Study
Gana, K., Bailly, N., Saada, Y., Joulain, M., & Alaphilippe, D. (2012) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbs093 · Cited by 191
Who Adopts Queer and Pansexual Sexual Identities?
Morandini, J. S., Blaszczynski, A. P., & Dar‐Nimrod, I. (2016) · The Journal of Sex Research · doi:10.1080/00224499.2016.1249332 · Cited by 159
“To estimate missing data we employed estimation maximization (EM) in SPSS, Version 21, as recommended by Schlomer, Bauman, and Card (2010).”
MethodStefana, A., Damiani, S., Granziol, U., Provenzani, U., Solmi, M., Youngstrom, E. A., & Fusar‐Poli, P. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1494261 · Cited by 254
“Arbitrary cutoffs should be avoided to prevent biased results (Schlomer et al., 2010).”
Phang, C. K., Mukhtar, F., Ibrahim, N., Keng, S., & Sidik, S. M. (2015) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9591-3 · Cited by 166
“Missing values were found in 3 (4 %) participants and replaced with ‘full information maximum likelihood (FIML)’ method, as recommended for missing data management (Schlomer et al. 2010).”
MethodMeter, D. J., & Bauman, S. A. (2016) · The Journal of Early Adolescence · doi:10.1177/0272431616670752 · Cited by 157
Self-citationPrice, M., Legrand, A. C., Brier, Z. M. F., van Stolk-Cooke, K., Peck, K., Dodds, P. S., Danforth, C. M., & Adams, Z. W. (2022) · Psychological Trauma: Theory, Research, Practice, and Policy · doi:10.1037/tra0001202 · Cited by 141
Asian American college students' suicide ideation: A mixed-methods study.
Wong, Y. J., Koo, K. H., Tran, K. K., Chiu, Y.-C., & Mok, Y. (2011) · Journal of Counseling Psychology · doi:10.1037/a0023040 · Cited by 146
A data imputation method for multivariate time series based on generative adversarial network
Guo, Z., Wan, Y., & Ye, H. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.007 · Cited by 140
Wong, Y. J., Owen, J., Gabana, N. T., Brown, J. W., McInnis, S., Toth, P., & Gilman, L. (2018) · Psychotherapy Research · doi:10.1080/10503307.2016.1169332 · Cited by 127
“The FIML method is superior to conducting a listwise deletion and is one of the best methods for handling missing data because it has been shown to provide unbiased parameter estimates and standard errors (Schlomer et al., 2010).”
MethodWinters-Stone, K. M., Dobek, J. C., Bennett, J. A., Dieckmann, N. F., Maddalozzo, G. F., Ryan, C. W., & Beer, T. M. (2015) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2014.08.010 · Cited by 126
“Using maximum likelihood estimation in this way has been shown to perform on par with multiple imputation for generating unbiased parameter estimateswhendata is missing at random.(45) We also performed a sensitivity analysis using a 2 (group) 3 (time)mixed design analysis of covariance excluding participants who did n…”
MethodGaudreau, P., Miranda, D., & Gareau, A. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.08.019 · Cited by 126
Assessing Quality in Toddler Classrooms Using the CLASS-Toddler and the ITERS-R
Paro, K. M. L., Williamson, A., & Hatfield, B. E. (2014) · Early Education and Development · doi:10.1080/10409289.2014.883586 · Cited by 146
Atitsogbe, K. A., Mama, N. P., Sovet, L., Pari, P., & Rossier, J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00180 · Cited by 173
Gender, social engagement, and limitations in late life
Thomas, P. A. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.07.035 · Cited by 123
A Pilot Study: Vital Methodological Issues
Hazzi, O. A., & Maldaon, I. (2015) · Verslas teorija ir praktika · doi:10.3846/btp.2015.437 · Cited by 186
Herrero, J., Rodríguez‐Díaz, F. J., & Torres, A. (2016) · Violence Against Women · doi:10.1177/1077801216642870 · Cited by 138
Dzhambov, A. M., Tilov, B. G., Markevych, I., & Dimitrova, D. (2017) · Environment International · doi:10.1016/j.envint.2017.09.009 · Cited by 141
Gendered Racial Microaggressions Scale for Asian American Women: Development and initial validation.
Keum, B. T., Brady, J. L., Sharma, R., Lu, Y., Kim, Y. H., & Thai, C. J. (2018) · Journal of Counseling Psychology · doi:10.1037/cou0000305 · Cited by 147
Student Motivation and Learning in Mathematics and Science: A Cluster Analysis
Ng, B., Liu, W. C., & Wang, J. (2015) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-015-9654-1 · Cited by 143
Miller, M. J., Yang, M., Hui, K., Choi, N., & Lim, R. H. (2011) · Journal of Counseling Psychology · doi:10.1037/a0023636 · Cited by 148
Wink, M. N., LaRusso, M. D., & Smith, R. L. (2021) · Psychology in the Schools · doi:10.1002/pits.22516 · Cited by 194
Schleider, J. L., Burnette, J. L., Widman, L. M., Hoyt, C. L., & Prinstein, M. J. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2019.1622123 · Cited by 127
Stevens, A., & Stetson, P. D. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104550 · Cited by 147
Childhood emotional abuse and attachment processes in the dyadic adjustment of dating couples.
Riggs, S. A., Cusimano, A. M., & Benson, K. M. (2011) · Journal of Counseling Psychology · doi:10.1037/a0021319 · Cited by 111
Parental Autonomy Support in Two Cultures: The Moderating Effects of Adolescents’ Self-Construals
Marbell-Pierre, K. N., Grolnick, W. S., Stewart, A. L., & Raftery-Helmer, J. N. (2019) · Child Development · doi:10.1111/cdev.12947 · Cited by 110
for the European Low Grade Glioma Network, Beez, T., Boge, K., Wager, M., Whittle, I. R., Fontaine, D., Spena, G., Braun, S. B., Szelényi, A., Bello, L., et al. (2013) · Acta Neurochirurgica · doi:10.1007/s00701-013-1759-0 · Cited by 122
“When more than 20 % of data is missing in survey research, statistical analyses are likely to be biased [17].”
BackgroundMultilevel modeling: Overview and applications to research in counseling psychology.
Kahn, J. H. (2011) · Journal of Counseling Psychology · doi:10.1037/a0022680 · Cited by 124
Relationships between trauma symptoms and race-based traumatic stress.
Carter, R. T., Kirkinis, K., & Johnson, V. E. (2019) · Traumatology An International Journal · doi:10.1037/trm0000217 · Cited by 136
Woulfe, J. M., & Goodman, L. A. (2018) · Journal of Interpersonal Violence · doi:10.1177/0886260518760018 · Cited by 123
Brewster, M. E., Velez, B. L., DeBlaere, C., & Moradi, B. (2011) · Journal of Counseling Psychology · doi:10.1037/a0025206 · Cited by 127
Krispenz, A., Gort, C., Schültke, L., & Dickhäuser, O. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01917 · Cited by 116
The Men’s Project: A sexual assault prevention program targeting college men.
Stewart, A. L. (2013) · Psychology of Men & Masculinity · doi:10.1037/a0033947 · Cited by 123
McConachie, D. A. J., McKenzie, K., Morris, P. G., & Walley, R. M. (2014) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2014.03.005 · Cited by 103
Garriott, P. O., & Nisle, S. (2018) · Journal of Diversity in Higher Education · doi:10.1037/dhe0000068 · Cited by 103
Poteat, V. P., Scheer, J. R., & Chong, E. S. K. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000058 · Cited by 116
Lachman, J. M., Cluver, L. D., Boyes, M. E., Kuo, C., & Casale, M. (2013) · AIDS Care · doi:10.1080/09540121.2013.825368 · Cited by 125
Larson, L. R., Cooper, C. B., Stedman, R. C., Decker, D. J., & Gagnon, R. J. (2018) · Society & Natural Resources · doi:10.1080/08941920.2018.1447714 · Cited by 120
Vaskinn, A., Sundet, K. S., Simonsen, C., Hellvin, T., Melle, I. S., & Andreassen, O. A. (2011) · Neuropsychology · doi:10.1037/a0022677 · Cited by 118
Hatchel, T. J., Ingram, K. M., Mintz, S., Hartley, C. M., Valido, A., Espelage, D. L., & Wyman, P. A. (2019) · Journal of Child and Family Studies · doi:10.1007/s10826-019-01339-2 · Cited by 146
“The maximization estimation method was implemented to impute the missing data as it is believed to be superior to methods like list-wise deletion or mean substitution (Schlomer et al. 2010).”
Method
Metadata
- Authors
- Schlomer, G. L., Bauman, S., & Card, N. A.
- Affiliations
- University of Arizona (US)
- Venue
- Journal of Counseling Psychology
- Published
- 2010
- Volume
- 57
- Issue
- 1
- Pages
- 1-10
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W2097814478
- Cited by
- 1,835
- References
- 30
- Citations by year
- 2026: 66 · 2025: 98 · 2024: 90 · 2023: 124 · 2022: 143 · 2021: 148 · 2020: 155 · 2019: 165 · 2018: 118 · 2017: 125 · 2016: 126 · 2015: 147 · 2014: 133 · 2013: 91 · 2012: 58
- FWCI
- 54.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Counseling Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- missing data, missing data patterns, missing data handling, mean substitution, multiple imputation, full information maximum likelihood, reporting practices, simulation study, counseling psychology research
- MeSH terms
- Counseling, Data Collection, Data Interpretation, Statistical, Humans, Psychology, Research Design, Bias, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.