Best practices for missing data management in counseling psychology
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
This article urges counseling psychology researchers to recognize and report how missing data are handled, because consumers of research cannot accurately interpret findings without knowing the amount and pattern of missing data or the strategies that were used to handle those data. Patterns of missing data are reviewed, and some of the common strategies for dealing with them are described. The authors provide an illustration in which data were simulated and evaluate 3 methods of handling missing data: mean substitution, multiple imputation, and full information maximum likelihood. Results suggest that mean substitution is a poor method for handling missing data, whereas both multiple imputation and full information maximum likelihood are recommended alternatives to this approach. The authors suggest that researchers fully consider and report the amount and pattern of missing data and the strategy for handling those data in counseling psychology research and that editors advise researchers of this expectation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Missing data were imputed using a Markov Chain Monte Carlo multivariate imputation algorithm with ten estimations per missing value (Schlomer et al., 2010).”
From Smartphone-Based Emotion Recognition Skills Training for Alexithymia—A Randomized Controlled Pilot Study (2019) · cites this paper as Schlomer et al., 2010
Citations
Cites
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Applied Multivariate Statistics for the Social Sciences
Stevens, J. P. (2012) · Routledge eBooks · doi:10.4324/9780203843130 · Cited by 10,648
A test of missing completely at random for multivariate data with missing values
Little, R. J. A. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478722 · Cited by 8,963
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163 · cited 1×
“We invite readers to refer to other existing literature that specifically deal with categorical missing data (e.g., Allison, 2001; Chen & Astebro, 2003; Graham, 2009).”
MethodAnalysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
SPSS Survival Manual: A Step by Step Guide to Data Analysis using IBM SPSS
Pallant, J. (2020) · Routledge eBooks · doi:10.4324/9781003117407 · Cited by 5,201
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978
Schafer, J. L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800102 · Cited by 3,949
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Cited by
Items 401–500 of 1,002
Primé, D. R., Bernstein, B. L., Wilkins‐Yel, K. G., & Bekki, J. (2014) · Journal of Career Assessment · doi:10.1177/1069072714523086 · Cited by 54
“For the purposes of this study, we followed the recommendations of Schlomer, Bauman, and Card (2010) and defined incompleteness as having missing data equal to or above 20% of the advisor items.”
MethodDavis, J. M., Manley, A. R., Goldberg, S. B., Stankevitz, K. A., & Smith, S. S. (2015) · BMC Complementary and Alternative Medicine · doi:10.1186/s12906-015-0618-3 · Cited by 33
“Determination of abstinence outcomes adhered to the intent-to-treat principle, such that failure to attend the 4- or 24-week assessment visits resulted in coding the participant as relapsed at that visit [60].”
MethodSocial Cognitive Predictors of Mexican American High School Students’ Math/Science Career Goals
Garriott, P. O., Raque‐Bogdan, T. L., Zoma, L., Mackie-Hernandez, D., & Lavin, K. (2016) · Journal of Career Development · doi:10.1177/0894845316633860 · Cited by 39
Social Support Questionnaire for Children: Development and Initial Validation
Gordon-Hollingsworth, A. T., Thompson, J. E., Geary, M. A., Schexnaildre, M. A., Lai, B. S., & Kelley, M. L. (2015) · Measurement and Evaluation in Counseling and Development · doi:10.1177/0748175615596780 · Cited by 52
Gashu, Z., Jerene, D., Ensermu, M., Habte, D., Melese, M., Hiruy, N., Shibeshi, E., Hamusse, S. D., Nigussie, G., Girma, B., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0160514 · Cited by 33
“Average imputation method for age, common-point imputation for period when index cases registered for anti-TB and modal imputation for type of contacts and sex was applied to fill in the missed values [24].”
MethodRenshaw, T. L., & Bolognino, S. J. (2016) · Assessment for Effective Intervention · doi:10.1177/1534508416678970 · Cited by 37
“%) and, using analyses outlined by Schlomer, Bauman, and Card (2010), were characterized by patterns suggesting that data were missing completely at random.”
MethodPerceived discrimination among Muslims and its correlates. A comparative analysis
Lindemann, A., & Stolz, J. (2020) · Ethnic and Racial Studies · doi:10.1080/01419870.2020.1729389 · Cited by 38
“We used multiple imputation (MI) (Schlomer, Bauman, and Card 2010), and imputed between 0% and 1.5% of missing data for different independent variables.”
MethodInfluentialExploring Polarization in US Food Policy Opinions
Biedny, C., Malone, T., & Lusk, J. L. (2020) · Applied Economic Perspectives and Policy · doi:10.1002/aepp.13053 · Cited by 40
Schmidt, C. J., Stoddard, S. A., Heinze, J. E., Caldwell, C. H., & Zimmerman, M. A. (2020) · Journal of Community Psychology · doi:10.1002/jcop.22401 · Cited by 41
Jones, M. K., Hill‐Jarrett, T. G., Latimer, K., Reynolds, A. A., Garrett, N., Harris, I., Joseph, S. S., & Jones, A. L. (2021) · Journal of Black Psychology · doi:10.1177/00957984211021229 · Cited by 33
“Missing data were handled using expectation maximization (Schlomer et al., 2010).”
MethodVitak, J. (2014) · Societies · doi:10.3390/soc4040561 · Cited by 41
“Missing data accounted for no more than 1.5% for any one item, and the average number of missing cases across these items was 1.88 (0.44%); values were imputed using the Expectation-Maximization (EM) algorithm in SPSS’ Missing Values Analysis [64].”
MethodInfluentialAre you in the mood? Therapist affect and psychotherapy process.
Chui, H. T., Hill, C. E., Kline, K. V., Kuo, P. B., & Mohr, J. J. (2016) · Journal of Counseling Psychology · doi:10.1037/cou0000155 · Cited by 39
“Specifically, FIML retains the power and sample size for accurate standard error and confidence interval estimations without the need to first creating files of imputed data (Schlomer et al., 2010).”
BackgroundPathways to healthy aging – Exploring the determinants of self-rated health in older adults
Zadworna, M. (2022) · Acta Psychologica · doi:10.1016/j.actpsy.2022.103651 · Cited by 44
Li, X., Zhang, X., & Lyu, H. (2022) · Personality and Individual Differences · doi:10.1016/j.paid.2022.111998 · Cited by 41
Daoud, A. O., Tsehayae, A. A., & Fayek, A. R. (2017) · Canadian Journal of Civil Engineering · doi:10.1139/cjce-2016-0381 · Cited by 34
Anyiwo, N., Ward, L. M., Fletcher, K. D., & Rowley, S. J. (2018) · Journal of Black Psychology · doi:10.1177/0095798418771818 · Cited by 41
Self‐Compassion, Trait Resilience, and Trauma Exposure in Undergraduate Students
Shebuski, K., Bowie, J., & Ashby, J. S. (2020) · Journal of College Counseling · doi:10.1002/jocc.12145 · Cited by 36
Krys, S., Otte, K., & Knipfer, K. (2020) · Anxiety Stress & Coping · doi:10.1080/10615806.2020.1763141 · Cited by 37
Tan, K. K. H., Treharne, G. J., Ellis, S. J., Schmidt, J. M., & Veale, J. F. (2020) · International Journal of Transgender Health · doi:10.1080/15532739.2020.1819504 · Cited by 39
“outcomes that could not be evaluated (Schlomer et al., 2010).”
BackgroundMethodInfluentialYu, S., Guo, N., Zheng, C., Song, Y., & Hao, J. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147500 · Cited by 34
Herrera, C. J., Owens, G. P., & Mallinckrodt, B. S. (2013) · Journal of Multicultural Counseling and Development · doi:10.1002/j.2161-1912.2013.00024.x · Cited by 43
“Simulation analyses suggest that multiple imputation performs significantly better than mean substitution or pairwise deletion (Schlomer et al., 2010).”
BackgroundNargiso, J. E., Friend, K. B., & Florin, P. R. (2013) · The Journal of Early Adolescence · doi:10.1177/0272431613477238 · Cited by 44
Nguyen‐Feng, V. N., Frazier, P. A., Greer, C. S., Howard, K. G., Paulsen, J. A., Meredith, L. N., & Kim, S. (2015) · Psychology of Violence · doi:10.1037/a0039596 · Cited by 39
Ma, C. M. S., & Shek, D. T. L. (2017) · Research on Social Work Practice · doi:10.1177/1049731517711246 · Cited by 35
Li, P., Zhou, N., Zhang, Y., Xiong, Q., Nie, R., & Fang, X. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01703 · Cited by 45
“50% on grade) were addressed using full information maximum likelihood estimation methods, a preferred technique for producing parameter estimates with minimal bias (Schlomer et al., 2010).”
MethodInfluentialWong, T. K. Y., Colasante, T., & Malti, T. (2023) · Journal of School Psychology · doi:10.1016/j.jsp.2023.101253 · Cited by 31
Yang, Q., Xie, R., Li, J., Zhang, R., Ding, W., & Li, W. (2023) · Mindfulness · doi:10.1007/s12671-023-02169-6 · Cited by 40
Wilson, H. W., Samuelson, S. L., Staudenmeyer, A. H., & Widom, C. S. (2015) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.02.009 · Cited by 40
Coulombe, S., Radziszewski, S., Meunier, S., Provencher, H. L., Hudon, C., Roberge, P., Provencher, M. D., & Houle, J. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00584 · Cited by 38
“This estimation method does not require deletion of cases with missing data but instead uses the information available from all the participants (Schlomer et al., 2010).”
MethodHo, R., Lai, A. H. Y., Lo, P. H. Y., Nan, J. K.-M., & Pon, A. K. L. (2016) · The Journal of Early Adolescence · doi:10.1177/0272431615624563 · Cited by 32
“FIML estimation was preferred over the traditional imputation method because it produces accurate standard errors by maintaining the sample size (Schlomer et al., 2010).”
MethodRothenberg, W. A., Hussong, A. M., & Chassin, L. (2017) · Developmental Psychology · doi:10.1037/dev0000419 · Cited by 40
Zhou, N., Ma, S., Li, X., Zhang, J., Liang, Y., Yu, C., Geng, X., Meng, J., Yuan, X., Cao, H., et al. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.09.016 · Cited by 39
Scheer, J. R., & Antebi‐Gruszka, N. (2019) · Journal of Trauma & Dissociation · doi:10.1080/15299732.2019.1597815 · Cited by 34
Cyber-aggression towards women: Measurement and psychological predictors in gaming communities
Jagayat, A., & Choma, B. L. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106753 · Cited by 49
“15% of the values were missing and replaced using multiple imputation (Schlomer et al., 2010).”
MethodUnderstanding the role of technology in reducing corruption: a transaction cost approach
Prasad, A., & Shivarajan, S. (2015) · Journal of Public Affairs · doi:10.1002/pa.1484 · Cited by 34
Coe, J. L., Davies, P. T., Hentges, R. F., & Sturge‐Apple, M. L. (2019) · Development and Psychopathology · doi:10.1017/s0954579418001736 · Cited by 43
Kim, J., Christy, A. G., Schlegel, R. J., Donnellan, M. B., & Hicks, J. A. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617727587 · Cited by 37
Li, R., Yao, M., Chen, Y., & Liu, H. (2019) · The Journal of Early Adolescence · doi:10.1177/0272431619880335 · Cited by 35
Mind‐wandering in children with and without ADHD
Frick, M. A., Asherson, P., & Brocki, K. C. (2020) · British Journal of Clinical Psychology · doi:10.1111/bjc.12241 · Cited by 31
Luther, L., Suor, J. H., Rosen, C., Jobe, T. H., Faull, R. N., & Harrow, M. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2020.03.012 · Cited by 33
González, C., Morawska, A., & Haslam, D. M. (2020) · Behavior Therapy · doi:10.1016/j.beth.2020.09.006 · Cited by 36
Strodl, E. S., Markey, C. N., Aimé, A., Rodgers, R. F., Dion, J., Coco, G. L., Gullo, S., McCabe, M. P., Mellor, D. J., Granero‐Gallegos, A., et al. (2020) · Body Image · doi:10.1016/j.bodyim.2020.09.013 · Cited by 35
Machine Learning Based Approaches for Imputation in Time Series Data and their Impact on Forecasting
Saad, M., Chaudhary, M., Karray, F., & Gaudet, V. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9283191 · Cited by 38
Mejeh, M., & Held, T. (2022) · Vocations and Learning · doi:10.1007/s12186-022-09298-4 · Cited by 69
“Although modern techniques such as multiple-imputation and maximum likelihood estimations are appropriate to handle missing data (Buhi et al., 2008; Schlomer et al., 2010), the possibility of bias cannot be excluded.”
MethodCzachowski, S., Seed, P., Schofield, P., & Ashworth, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027378 · Cited by 30
“We explored the five different ways of calculating change on the effect size [11,12].”
BackgroundMethodK-NN Classifier Performs Better Than K-Means Clustering in Missing Value Imputation
Malarvizhi, M. R. (2012) · IOSR Journal of Computer Engineering · doi:10.9790/0661-0651215 · Cited by 31
Characterizing Spouse/Partner Depression and Alcohol Problems Over the Course of Military Deployment
Erbes, C. R., Kramer, M., Arbisi, P. A., DeGarmo, D. S., & Polusny, M. A. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000190 · Cited by 26
Born this way: Sexual orientation beliefs and their correlates in lesbian and bisexual women.
Morandini, J. S., Blaszczynski, A. P., Costa, D. S. J., Godwin, A., & Dar‐Nimrod, I. (2017) · Journal of Counseling Psychology · doi:10.1037/cou0000209 · Cited by 41
“All missing data was imputed using estimation maximization in SPSS Version 21 (see Schlomer, Bauman, and Card (2010)).”
MethodHeads, A. M. B., Glover, A. M., Castillo, L. G., Blozis, S. A., & Kim, S. Y. (2017) · Journal of American College Health · doi:10.1080/07448481.2017.1400975 · Cited by 35
“We used multiple imputation to maximize the inclusion of all participants in the data analysis.(43) Missing data were assumed to be missing at random.”
MethodAnxiety sensitivity as a predictor of panic disorder symptoms: a prospective 3-year study
Jurin, T., & Biglbauer, S. (2018) · Anxiety Stress & Coping · doi:10.1080/10615806.2018.1453745 · Cited by 40
Held, T., & Mejeh, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e29526 · Cited by 80
“While maximum likelihood estimations are suitable for addressing missing data [116], the possibility of bias cannot be completely excluded.”
Ávila, M., Brandão, T., Teixeira, J., Coimbra, J. L., & Matos, P. M. (2015) · Psycho-Oncology · doi:10.1002/pon.3817 · Cited by 40
“Expectation maximization was preferred for using all available data to estimate a distribution of possible values for each missing data point, because this method is found to perform well and to be more accurate comparing with more conventional techniques [35].”
MethodAdolescents’ responses to marital conflict: The role of cooperative marital conflict.
Zhou, N., & Buehler, C. A. (2017) · Journal of Family Psychology · doi:10.1037/fam0000341 · Cited by 38
Strategies for handling missing data in longitudinal studies with questionnaires
Nooraee, N., Molenberghs, G., Ormel, J., & van den Heuvel, E. R. (2018) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2018.1520854 · Cited by 33
Robitschek, C., Yang, A., Villalba, R., & Shigemoto, Y. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.12.121 · Cited by 34
Storlie, C. A., & Toomey, R. B. (2019) · Journal of Career Development · doi:10.1177/0894845319828541 · Cited by 31
Maternal Interleukin-6 Is Associated With Macaque Offspring Amygdala Development and Behavior
Ramirez, J. S. B., Graham, A. M., Thompson, J. R., Zhu, J. Y., Sturgeon, D., Bagley, J. L., Thomas, E., Papadakis, S., Bah, M., Perrone, A. J., et al. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz188 · Cited by 30
“However, missing data is a common occurrence in longitudinal studies, and has been extensively addressed using the full information maximum likelihood estimator used in this study (Collins et al. 2001; Enders 2001; Graham 2003; Raykov 2005; Buhi 2008; Jeličić et al. 2009; Schlomer et al. 2010; Larsen 2011; Peyre et al…”
MethodKramers, S., Turgeon, S., Bean, C. N., Sabourin, C., & Camiré, M. (2020) · International Journal of Sports Science & Coaching · doi:10.1177/1747954120922367 · Cited by 36
“Missing data were treated using multiple imputations.(28) Following this, all scales were screened for normality using George and Mallery’s(29) guidelines (i.”
MethodRasdi, R. M., & Ahrari, S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237838 · Cited by 26
The Association Between Implicit Racial Bias and Mindfulness in Mental Health Practitioners
Ivers, N. N., Johnson, D. A., & Rogers, J. L. (2020) · Journal of Counseling & Development · doi:10.1002/jcad.12350 · Cited by 36
Decomposition of perceived usefulness: A theoretical perspective and empirical test
Ambalov, I. A. (2021) · Technology in Society · doi:10.1016/j.techsoc.2020.101520 · Cited by 50
Hoang, V. L., Green, T., & Bonner, A. (2021) · Journal of Renal Care · doi:10.1111/jorc.12380 · Cited by 40
Wang, H., King, R. B., & McInerney, D. M. (2021) · Research Papers in Education · doi:10.1080/02671522.2021.1961293 · Cited by 41
“…likelihood (FIML) testing was conducted in M plu s. FIML has been found by psychometricians to be superior to other alternative approaches (e.g., listwise deletion, pairwise deletion, and mean imputation) in dealing with missing data (Enders and Bandalos 2001; Schlomer, Bauman, and Card 2010).”
Eisman, A. B., Stoddard, S. A., Bauermeister, J. A., Caldwell, C. H., & Zimmerman, M. A. (2015) · Journal of Youth and Adolescence · doi:10.1007/s10964-015-0267-3 · Cited by 36
“FIML does not impute values into new datasets, but rather estimates parameters based on available complete data and implied values for missing data conditioned on observed data (Schlomer, Bauman, & Card, 2010).”
Srikanth, S., Petrie, T. A., Greenleaf, C. A., & Martin, S. B. (2014) · The Journal of Early Adolescence · doi:10.1177/0272431614530807 · Cited by 43
Xu, H., & Tracey, T. J. G. (2016) · Journal of Career Assessment · doi:10.1177/1069072716665874 · Cited by 33
Griva, K., Lam, K. F. Y., Mooppil, N., Ng, J.-A. H., McBain, H. B., & Newman, S. P. (2018) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2018.07.012 · Cited by 37
Skowronski, M., Busching, R., & Krahé, B. (2021) · Sex Roles · doi:10.1007/s11199-020-01187-1 · Cited by 27
Wei, M., Tsai, P.-C., Lannin, D. G., Du, Y., & Tucker, J. R. (2014) · The Counseling Psychologist · doi:10.1177/0011000014560173 · Cited by 45
Hunter, C. D., Case, A. D., Joseph, N. P., Mekawi, Y., & Bokhari, E. (2016) · Journal of Black Psychology · doi:10.1177/0095798415627114 · Cited by 41
“…in a Pearson correlation with our demographic variables and outcome variables.1 Based on the pattern of associations between data missingness and our outcome variables of interest and following recommendations of Schlomer et al. (2010), we concluded that our data were missing completely at random.”
BackgroundInfluentialWendsche, J., Hacker, W., Wegge, J., & Rudolf, M. (2016) · Research in Nursing & Health · doi:10.1002/nur.21729 · Cited by 28
Ehrenreich, J. T., Dimeff, L. A., Woodcock, E. A., Queen, A. H., Kelly, T. B., Contreras, I., Rash, B., Kelley-Brimer, A., Hauschildt, J., Danner, S., et al. (2016) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2016.1245116 · Cited by 29
Kalibatseva, Z., Leong, F. T. L., Ham, E. H., Lannert, B. K., & Chen, Y. (2017) · Asian American Journal of Psychology · doi:10.1037/aap0000067 · Cited by 30
Wiebe, E., Rachmatullah, A., Akram, B., Boulden, D. C., Mott, B., Boyer, K. E., & Lester, J. C. (2020) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/116600 · Cited by 37
Hassed, C. S., Flighty, A. J., Chambers, R., HOSEMANS, D. J. F., Bailey, N. W., Connaughton, S., Lee, S. J., & Kazantzis, N. (2020) · Cognitive Therapy and Research · doi:10.1007/s10608-020-10150-z · Cited by 35
Buenconsejo, J. U., & Datu, J. A. D. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2020.105470 · Cited by 39
Hildebrand, A., Behrendt, S., & Hoyer, J. (2014) · Psychotherapy Research · doi:10.1080/10503307.2014.923125 · Cited by 37
McDermott, R. C., Schwartz, J. P., Lindley, L. D., & Proietti, J. S. (2013) · Psychology of Men & Masculinity · doi:10.1037/a0032788 · Cited by 35
Lee, J. O., Kosterman, R., Jones, T. M., Herrenkohl, T. I., Rhew, I. C., Catalano, R. F., & Hawkins, J. D. (2016) · Public Health · doi:10.1016/j.puhe.2016.06.010 · Cited by 34
Mindfulness and Emotional Distress: the Mediating Role of Psychological well-Being
Baroni, D., Nerini, A., Matera, C., & Stefanile, C. (2016) · Current Psychology · doi:10.1007/s12144-016-9524-1 · Cited by 34
Lukas, C. A., Trevisi Fuentes, H., & Berking, M. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100250 · Cited by 27
“Missing data were imputed using a Markov Chain Monte Carlo multivariate imputation algorithm with ten estimations per missing value (Schlomer et al., 2010).”
MethodDing, X., Zhang, W., Ooi, L. L., Coplan, R. J., Zhu, X., & Sang, B. (2023) · Journal of Research on Adolescence · doi:10.1111/jora.12837 · Cited by 33
Eisenhower, A., Blacher, J., & Baker, B. L. (2013) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2012.12.002 · Cited by 35
Predictors of Growth in the Aftermath of Traumatic Events: The Role of Personal Growth Initiative
Shigemoto, Y., Ashton, M. W., & Robitschek, C. (2015) · Journal of Loss and Trauma · doi:10.1080/15325024.2015.1110446 · Cited by 28
Turgeon, S., Lanovaz, M. J., & Dufour, M. (2020) · Behavior Modification · doi:10.1177/0145445520915671 · Cited by 43
“Because the attrition rate was high (> 5%) and that 20 participants did not complete any post-test measures, we could not use imputation techniques (Schlomer et al., 2010).”
BackgroundPassion and grit in the pursuit of long-term personal goals in college students
Verner‐Filion, J., Schellenberg, B. J. I., Holding, A. C., & Koestner, R. (2020) · Learning and Individual Differences · doi:10.1016/j.lindif.2020.101939 · Cited by 44
Flores, L. Y., Navarro, R. L., Lee, B. H., Hu, X., Diaz, D., & Martinez, L. D. (2021) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2021.103580 · Cited by 29
McNaughtan, J. L., Eicke, D., Thacker, R., & Freeman, S. (2021) · The Journal of Higher Education · doi:10.1080/00221546.2021.1935601 · Cited by 41
Mir, A. A., Kearfott, K. J., Çelebi, F. V., & Rafique, M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262131 · Cited by 32
Why So Many Arrows? Introduction to Structural Equation Modeling for the Novitiate User
Berkout, O. V., Gross, A. M., & Young, J. N. (2014) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-014-0165-3 · Cited by 32
“ML is sometimes called full information maximum likelihood, because it uses all of the information in the dataset to estimate parameters (Enders 2001; Schlomer et al. 2010).”
BackgroundLin, M.-W., & Yu, C. (2014) · Journal of Comparative Policy Analysis Research and Practice · doi:10.1080/13876988.2013.870115 · Cited by 27
“Although there is no consensus in the literature regarding at what point the amount of missing information becomes problematic for inference and estimation, researchers have suggested that a cutoff point between 5 and 20 per cent is acceptable (see Schlomer et al. 2010).”
BackgroundMacy, J. T., Chassin, L., Presson, C. C., & Yeung, E. (2015) · Psychology and Health · doi:10.1080/08870446.2015.1104309 · Cited by 29
Prescription Stimulant Misuse and ADHD Symptomatology Among College Students in Iceland
Guðmundsdóttir, B. G., Weyandt, L. L., & Ernudottir, G. B. (2016) · Journal of Attention Disorders · doi:10.1177/1087054716684379 · Cited by 40
Kwon, K., Kim, E. Y., & Sheridan, S. M. (2012) · School Psychology Review · doi:10.1080/02796015.2012.12087516 · Cited by 35
“…we used the multiple imputation (MI) procedure (Allison, 2009) to handle missing data (for a discussion of the advantages of MI over other conventional approaches such as listwise deletion or mean substitution as well as a description of the procedure, see Allison, 2009; Schlomer et al., 2010).”
MethodPhysical fitness as a moderator of neuroticism and depression in adolescent boys and girls
Yeatts, P. E., Martin, S. B., & Petrie, T. A. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.03.040 · Cited by 35
Mandel, T., Dunkley, D. M., & Starrs, C. J. (2018) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-018-9673-7 · Cited by 31
“Missing data for the interpersonal sensitivity variables were dealt with using a maximum likelihood method in SAS Version 9.2 (see Schlomer et al. 2010).”
MethodInfluentialA Time-Lagged Examination of the Greenhaus and Allen Work-Family Balance Model
Landolfi, A., Barattucci, M., & Presti, A. L. (2020) · Behavioral Sciences · doi:10.3390/bs10090140 · Cited by 46
“003% for the Time 2 ones) were replaced through the Expectation–Maximization method (SPSS 21) [73].”
MethodZajicek-Farber, M. L., Mayer, L. M., Daughtery, L. G., & Rodkey, E. (2014) · Journal of Social Service Research · doi:10.1080/01488376.2014.930946 · Cited by 26
Davies, P. T., Thompson, M. J., Coe, J. L., Sturge‐Apple, M. L., & Martin, M. J. (2019) · Developmental Psychology · doi:10.1037/dev0000717 · Cited by 29
Davies, P. T., Thompson, M. J., Li, Z., & Sturge‐Apple, M. L. (2022) · Developmental Psychology · doi:10.1037/dev0001381 · Cited by 30
Metadata
- Authors
- Schlomer, G. L., Bauman, S., & Card, N. A.
- Affiliations
- University of Arizona (US)
- Venue
- Journal of Counseling Psychology
- Published
- 2010
- Volume
- 57
- Issue
- 1
- Pages
- 1-10
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W2097814478
- Cited by
- 1,835
- References
- 30
- Citations by year
- 2026: 66 · 2025: 98 · 2024: 90 · 2023: 124 · 2022: 143 · 2021: 148 · 2020: 155 · 2019: 165 · 2018: 118 · 2017: 125 · 2016: 126 · 2015: 147 · 2014: 133 · 2013: 91 · 2012: 58
- FWCI
- 54.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Counseling Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- missing data, missing data patterns, missing data handling, mean substitution, multiple imputation, full information maximum likelihood, reporting practices, simulation study, counseling psychology research
- MeSH terms
- Counseling, Data Collection, Data Interpretation, Statistical, Humans, Psychology, Research Design, Bias, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.