Best practices for missing data management in counseling psychology
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
This article urges counseling psychology researchers to recognize and report how missing data are handled, because consumers of research cannot accurately interpret findings without knowing the amount and pattern of missing data or the strategies that were used to handle those data. Patterns of missing data are reviewed, and some of the common strategies for dealing with them are described. The authors provide an illustration in which data were simulated and evaluate 3 methods of handling missing data: mean substitution, multiple imputation, and full information maximum likelihood. Results suggest that mean substitution is a poor method for handling missing data, whereas both multiple imputation and full information maximum likelihood are recommended alternatives to this approach. The authors suggest that researchers fully consider and report the amount and pattern of missing data and the strategy for handling those data in counseling psychology research and that editors advise researchers of this expectation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Missing data were imputed using a Markov Chain Monte Carlo multivariate imputation algorithm with ten estimations per missing value (Schlomer et al., 2010).”
From Smartphone-Based Emotion Recognition Skills Training for Alexithymia—A Randomized Controlled Pilot Study (2019) · cites this paper as Schlomer et al., 2010
Citations
Cites
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Applied Multivariate Statistics for the Social Sciences
Stevens, J. P. (2012) · Routledge eBooks · doi:10.4324/9780203843130 · Cited by 10,648
A test of missing completely at random for multivariate data with missing values
Little, R. J. A. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478722 · Cited by 8,963
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163 · cited 1×
“We invite readers to refer to other existing literature that specifically deal with categorical missing data (e.g., Allison, 2001; Chen & Astebro, 2003; Graham, 2009).”
MethodAnalysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
SPSS Survival Manual: A Step by Step Guide to Data Analysis using IBM SPSS
Pallant, J. (2020) · Routledge eBooks · doi:10.4324/9781003117407 · Cited by 5,201
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978
Schafer, J. L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800102 · Cited by 3,949
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Cited by
Items 501–600 of 1,002
Carney, J. V., Liu, Y., & Hazler, R. J. (2018) · Children and Youth Services Review · doi:10.1016/j.childyouth.2018.07.029 · Cited by 32
Discrimination from family and substance use for multiracial individuals
Franco, M. G., & Carter, S. E. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2019.01.008 · Cited by 26
Mortensen, J. A., & Barnett, M. A. (2019) · Infant Behavior and Development · doi:10.1016/j.infbeh.2019.01.004 · Cited by 39
de Baca, T. C., Prather, A. A., Lin, J., Sternfeld, B., Adler, N. E., Epel, E. S., & Puterman, E. M. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0482-5 · Cited by 26
“To handle the missing cases, we utilized multiple imputation and created 25 new datasets with Proc MI; results from the imputed datasets were then pooled with Proc MIanalyze [56, 57].”
MethodZucker, A., chang, Y.-K., Maharaj, R., Wang, W., Fiani, T., McHugh, S., Feinup, D. M., & Jones, E. A. (2021) · Autism · doi:10.1177/13623613211042135 · Cited by 26
Mindless Suffering: the Relationship Between Mindfulness and Non-Suicidal Self-Injury
Caltabiano, G., & Martin, G. (2016) · Mindfulness · doi:10.1007/s12671-016-0657-y · Cited by 35
Evidence of a continuum in foundational expressive communication skills
Greenwood, C. R., Walker, D., Buzhardt, J. F., Howard, W., McCune, L. A., & Anderson, R. A. (2013) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2013.02.006 · Cited by 30
Hanley, S. M., & McLaren, S. (2014) · Psychology of Women Quarterly · doi:10.1177/0361684314522420 · Cited by 31
Bailly, N., Gana, K., Hervé, C., Joulain, M., & Alaphilippe, D. (2014) · Aging & Mental Health · doi:10.1080/13607863.2013.875121 · Cited by 34
Toomey, R. B., & Russell, S. T. (2012) · Journal of Research on Adolescence · doi:10.1111/j.1532-7795.2012.00830.x · Cited by 31
Neurocognitive Correlates of Young Drivers' Performance in a Driving Simulator
Guinosso, S. A., Johnson, S. B., Schultheis, M. T., Graefe, A. C., & Bishai, D. M. (2016) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2015.12.018 · Cited by 33
Examining Adolescent Suicidal Behaviors in Relation to Gun Carrying and Bullying
Romero, A. J., Bauman, S. A., Ritter, M. K., & Anand, P. (2016) · Journal of School Violence · doi:10.1080/15388220.2016.1190933 · Cited by 30
Self-citationBall, C. L., Smetana, J. G., Sturge‐Apple, M. L., Suor, J. H., & Skibo, M. A. (2017) · Developmental Psychology · doi:10.1037/dev0000378 · Cited by 35
A 7-year longitudinal study of sexual minority young men’s parental relationships and mental health.
Pachankis, J. E., Sullivan, T. J., & Moore, N. F. (2018) · Journal of Family Psychology · doi:10.1037/fam0000427 · Cited by 32
Dealing with missing data by EM in single-case studies
Chen, L., Feng, Y., Wu, P.-J., & Peng, C. J. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01210-8 · Cited by 31
Motivational enhancement career intervention for youth with disabilities
Sheftel, A., Lindstrom, L., & McWhirter, B. T. (2014) · Advances in School Mental Health Promotion · doi:10.1080/1754730x.2014.949061 · Cited by 38
Mendelson, T., Clary, L. K., Sibinga, E., Tandon, D., Musci, R., Mmari, K., Salkever, D., Stuart, E. A., & Ialongo, N. (2020) · Contemporary Clinical Trials · doi:10.1016/j.cct.2019.105895 · Cited by 25
Zamudio, G., Wang, C. D., & Jin, L. (2020) · The Counseling Psychologist · doi:10.1177/0011000020930637 · Cited by 26
“Missing data was analyzed by Little’s χ2 which suggested that the missing data was not related to systematic factors (missing completely at random); therefore, the Expectation-Maximization algorithm was used to supplement missing data (Schlomer et al., 2010).”
MethodMartin, M. J., Davies, P. T., & Cummings, E. M. (2017) · Journal of Research on Adolescence · doi:10.1111/jora.12305 · Cited by 29
Supervisor Cultural Humility and Supervisee Nondisclosure: The Supervisory Working Alliance Matters
Ertl, M. M., Ellis, M. V., & Peterson, L. P. (2023) · The Counseling Psychologist · doi:10.1177/00110000231159316 · Cited by 33
“Because parameters derived fromMCAR data under list-wise deletion have been found to be equivalent to those derived from complete data (Schlomer et al., 2010), this study proceeded with complete case analysis by excluding participants with more than 5% missing data (n = 64).”
MethodGu, H., Yao, Y., He, F., & Cheng, Y. (2023) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2023.106188 · Cited by 28
Menie, M. A. W. O., Figueredo, A. J., de Baca, T. C., Fernandes, H. B. F., Madison, G., Wolf, P. S. A., & Black, C. J. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00422 · Cited by 23
“If large amounts of missingness are present in a dataset, this might bias parameter estimates and p-values, increasing type 1 or type 2 error (Schlomer et al., 2010).”
BackgroundWeymouth, B. B., & Buehler, C. A. (2018) · Journal of Family Psychology · doi:10.1037/fam0000396 · Cited by 39
Presseau, C., Luu, L. P., Inman, A. G., & DeBlaere, C. (2018) · Counselling Psychology Quarterly · doi:10.1080/09515070.2018.1476837 · Cited by 32
Levinson, S., Neuspiel, J. M., Eisenhower, A., & Blacher, J. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-020-04675-1 · Cited by 35
“Maximum likelihood estimation techniques have performed better than multiple imputation, listwise deletion, or pairwise deletion and produce unbiased parameter estimates (Enders and Bandalos 2001; Schlomer et al. 2010).”
MethodThe predictive role of perfectionism on heavy work investment: A two-waves cross-lagged panel study
Spagnoli, P., Kovalchuk, L. S., Aiello, M., & Rice, K. G. (2021) · Personality and Individual Differences · doi:10.1016/j.paid.2021.110632 · Cited by 26
The route to employability: a longitudinal study on a sample of Italian job seekers
Presti, A. L., Rosa, A. D., & Zaharie, M. A. (2021) · International Journal for Educational and Vocational Guidance · doi:10.1007/s10775-021-09482-3 · Cited by 33
Children’s dove temperament as a differential susceptibility factor in child rearing contexts.
Davies, P. T., Hentges, R. F., Coe, J. L., Parry, L. Q., & Sturge‐Apple, M. L. (2021) · Developmental Psychology · doi:10.1037/dev0001215 · Cited by 30
Davies, P. T., Thompson, M. J., Hentges, R. F., Parry, L. Q., & Sturge‐Apple, M. L. (2021) · Child Development · doi:10.1111/cdev.13720 · Cited by 31
Social cognitive mechanisms in healthcare worker resilience across time during the pandemic
Smith, A. J., Shoji, K., Griffin, B. J., Sippel, L. M., Dworkin, E. R., Wright, H., Morrow, E. H., Locke, A., Love, T., Harris, J. I., et al. (2022) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-022-02247-5 · Cited by 31
“Simulation studies on missing data imputation methods showed that FIML is more suitable to manage data with as much as 25% of missing data compared to other missing data management methods such as listwise and pairwise deletion [11, 68] and produces tolerable bias in results with up to 50% missingness in some cases ev…”
MethodWang, F., Liu, Y., & Leung, S. O. (2022) · School Effectiveness and School Improvement · doi:10.1080/09243453.2022.2043393 · Cited by 33
Kim, Y. H., O’Brien, K. M., & Kim, H. (2015) · Journal of Career Assessment · doi:10.1177/1069072715599538 · Cited by 48
“Consistent with recommendations from Schlomer, Bauman, and Card (2010), 6 participants with more than 10% missing data were not retained, leaving 377 surveys in the statistical analyses.”
MethodLee, J. O., Herrenkohl, T. I., Jung, H., Skinner, M. L., & Klika, J. B. (2015) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.07.012 · Cited by 38
Smith, D. C., Davis, J. P., Ureche, D. J., & Dumas, T. M. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2015.09.002 · Cited by 27
“These nonstochastic imputationmethods for handlingmissing data produce very biased regression coefficients and standard errors compared to more nuanced stochastic techniques (Johnson & Young, 2011; Schlomer et al., 2010).”
Carraro, N., & Gaudreau, P. (2015) · Personality and Social Psychology Bulletin · doi:10.1177/0146167215594121 · Cited by 30
Supportive care needs in patients with cardiovascular disorders
Kohlmann, S., Kilbert, M. S., Ziegler, K., & Schulz, K. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.01.002 · Cited by 28
“Single missing values were estimated and completed using multiple-imputation analysis according to recommendations [27].”
MethodChriston, L., Arnold, C. C., & Myers, B. J. (2014) · Behavior Therapy · doi:10.1016/j.beth.2014.02.002 · Cited by 29
“, missing values are dependent upon another series of measured variables), “missingness” dummy codes were created for all providing/ recommending variables (1 = missing and 0 = not missing) and for unfamiliarity (1 =unfamiliar and 0 = familiar; Schlomer et al., 2010).”
BackgroundMethodInfluentialAdult Attachment Dimensions and College Student Distress: The Mediating Role of Hope
McDermott, R. C., Cheng, H., Wright, C. N., Browning, B. R., Upton, A. W., & Sevig, T. D. (2015) · The Counseling Psychologist · doi:10.1177/0011000015575394 · Cited by 43
“Following the recommendations of Schlomer, Bauman, and Card (2010), comparisons between participants with missing data and participants with complete values indicated that these two groups did not differ significantly on any of the research variables.”
MethodEmotion dysregulation moderates the link between perfectionism and dysmorphic appearance concern.
Cunningham, M. L., Griffiths, S., Baillie, A., & Murray, S. B. (2016) · Psychology of Men & Masculinity · doi:10.1037/men0000082 · Cited by 32
Aliyas, Z. (2019) · Journal of Transport & Health · doi:10.1016/j.jth.2019.100578 · Cited by 30
Context of maternal intrusiveness during infancy and associations with preschool executive function
Broomell, A. P. R., Smith, C. L., Calkins, S. D., & Bell, M. A. (2019) · Infant and Child Development · doi:10.1002/icd.2162 · Cited by 36
Asian American Acculturation and Enculturation
Zhang, S., & Moradi, B. (2012) · The Counseling Psychologist · doi:10.1177/0011000012456882 · Cited by 37
A Swedish cross-cultural adaptation and validation of the Tinnitus Functional Index
Hoff, M., & Kähäri, K. R. (2016) · International Journal of Audiology · doi:10.1080/14992027.2016.1265154 · Cited by 29
“We did not compensate for missing data by means substitution method but rather computed the scores based on valid responses only (Schlomer et al, 2010).”
MethodAnyiwo, N., Anderson, R. E., Marchand, A. D., Diemer, M. A., & Garrett, J. M. (2022) · Journal of Community & Applied Social Psychology · doi:10.1002/casp.2652 · Cited by 26
Manembu, P. D. K., Kewo, A., & Welang, B. (2015) · doi:10.1109/iceei.2015.7352554 · Cited by 24
“Based on the results, mean substitutions method perform poor in handling missing data, where both multiple imputation and full information maximum likelihood are the recommended methods to this kind of approach [9].”
MethodDavies, P. T., Thompson, M. J., Martin, M. J., & Cummings, E. M. (2020) · Child Development · doi:10.1111/cdev.13451 · Cited by 27
Hurst, P., Ring, C., & Kavussanu, M. (2022) · Journal of Sports Sciences · doi:10.1080/02640414.2022.2053387 · Cited by 35
“Given that missing data can reduce the accuracy of the analyses and compromise inferences (Schlomer et al., 2010), missing data were replaced using a multiple imputation, which is acceptable to use when less than 5% of data is missing (Cheema, 2014).”
MethodLosh, A., Eisenhower, A., & Blacher, J. (2022) · Research in Autism · doi:10.1016/j.rasd.2022.102027 · Cited by 37
Yang, P., Schlomer, G. L., & Lippold, M. A. (2022) · Developmental Psychology · doi:10.1037/dev0001442 · Cited by 36
Self-citationGreenwood, C. R., Buzhardt, J. F., Walker, D., McCune, L. A., & Howard, W. (2013) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2013.07.002 · Cited by 29
Disengaged or Bookworm: Academics, Mental Health, and Success for Sexual Minority Youth
Watson, R. J., & Russell, S. T. (2014) · Journal of Research on Adolescence · doi:10.1111/jora.12178 · Cited by 28
Kvande, M. N., Klöckner, C. A., Moksnes, U. K., & Espnes, G. A. (2014) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2014.892350 · Cited by 28
“Prior to determining the procedure for handling missing responses, the guidelines for best practice in reporting and evaluating missing values were followed (Schlomer et al., 2010).”
MethodToomey, R. B., Anhalt, K., & Shramko, M. (2016) · Self and Identity · doi:10.1080/15298868.2016.1157516 · Cited by 30
‘Friends and grades’: Peer preference and attachment predict academic success among Naskapi youth
Burack, J. A., D’Arrisso, A., Ponizovsky, V., Troop‐Gordon, W., Mandour, T., Tootoosis, C., Robinson, S., Iarocci, G., & Fryberg, S. A. (2013) · School Psychology International · doi:10.1177/0143034312446888 · Cited by 38
“Like” me: Shopping, self-display, body image, and social networking sites.
Strubel, J., Petrie, T. A., & Pookulangara, S. (2018) · Psychology of Popular Media Culture · doi:10.1037/ppm0000133 · Cited by 24
Long, A. C. J., Renshaw, T. L., & Camarota, D. (2018) · Contemporary School Psychology · doi:10.1007/s40688-018-0177-y · Cited by 29
“To optimize the data and maximize the statistical power of the planned analyses, missing data were ultimately handled using a maximum likelihood data imputation method, which estimates plausible responses for missing values based on observed response values (see Schlomer et al. 2010).”
MethodEvaluating Performance of Missing Data Imputation Methods in IRT Analyses
Kalkan, Ö. K., Kara, Y., & Kelecioğlu, H. (2018) · International Journal of Assessment Tools in Education · doi:10.21449/ijate.430720 · Cited by 23
“For example, Schlomer, Bauman, and Card (2010), and Schafer and Graham (2002) reported that the accuracy of the parameter and standard error estimates makes MI the best choice for handling missing data.”
BackgroundMethodInfluentialEffects of Acculturation and Access on Recreation Participation Among Latinos
Fernandez, M., Shinew, K. J., & Stodolska, M. (2015) · Leisure Sciences · doi:10.1080/01490400.2014.991436 · Cited by 24
Institutional Predictors of Volunteer Retention: The Case of AmeriCorps National Service
McBride, A. M., & Lee, Y. (2011) · Administration & Society · doi:10.1177/0095399711413729 · Cited by 27
Patient-Reported Outcomes in Male and Female Collegiate Soccer Players During an Athletic Season
Hoch, J. M., Druvenga, B., Ferguson, B. A., Houston, M. N., & Hoch, M. C. (2015) · Journal of Athletic Training · doi:10.4085/1062-6050-50.5.03 · Cited by 24
Rahnfeld, M., Wendsche, J., & Wegge, J. (2023) · BMC Geriatrics · doi:10.1186/s12877-023-03829-x · Cited by 39
“Therefore, we used the expectation maximisation algorithm in SPSS 26 for data imputation [57].”
MethodChen, M., & Mok, I. A. C. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1248602 · Cited by 47
“The full information maximum likelihood method was used to handle missing values (Schlomer et al., 2010).”
MethodGuardia, A. C. L., Cramer, R. J., Brubaker, M. D., & Long, M. M. (2018) · Community Mental Health Journal · doi:10.1007/s10597-018-0314-0 · Cited by 26
The Relationships Among Self-Compassion, Stigma, and Attitudes Toward Counseling in Student-Athletes
Hilliard, R. C., Redmond, L. A., & Watson, J. C. (2018) · Journal of Clinical Sport Psychology · doi:10.1123/jcsp.2018-0027 · Cited by 31
“Given that there was so little missing data, expectation maximization was used to impute the missing values (Schlomer, Bauman, & Card, 2010).”
Male and female mental health differences in built environment undergraduates
Scott‐Young, C. M., Turner, M., & Holdsworth, S. (2020) · Construction Management and Economics · doi:10.1080/01446193.2020.1748213 · Cited by 34
“For the remainder, missing values were replaced using multiple imputation as recommended by Schlomer et al. (2010).”
MethodMorgan, J. E., Lee, S. S., Mahrer, N. E., Guardino, C. M., Davis, E. P., Shalowitz, M. U., Ramey, S. L., & Schetter, C. D. (2020) · Developmental Psychobiology · doi:10.1002/dev.21982 · Cited by 24
Marie, L., Poindexter, E. K., Fadoir, N. A., & Smith, P. N. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.037 · Cited by 27
Consumer Comprehension of the Nutrition Facts Label: A Comparison of the Original and Updated Labels
Kim, E. J., Ellison, B., Prescott, M. P., & Nayga, R. M. (2020) · American Journal of Health Promotion · doi:10.1177/0890117120983128 · Cited by 24
“” When the pattern of missing values is not at random, the data are considered as nonignorable nonresponses and they must be included in the analysis to avoid bias.(23) Thus, we counted missing values as incorrect rather than dropping them.”
MethodPan, M., Zhang, S., Qiu, S., Liu, L., Li, H., Zhao, M., Dong, M., Si, F., Wang, Y., & Qian, Q. (2021) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-021-01236-0 · Cited by 38
Jin, L., Yang, E., & Zamudio, G. (2021) · Counselling Psychology Quarterly · doi:10.1080/09515070.2021.1887084 · Cited by 34
Cheng, H. (2022) · Counselling Psychology Quarterly · doi:10.1080/09515070.2022.2065664 · Cited by 27
“Multiple imputation procedures were conducted with the SPSS software before computing the subscale and scale scores (Schlomer et al., 2010) for the primary analyses.”
MethodEstrella, E., & Frazier, P. A. (2023) · Disability and Rehabilitation · doi:10.1080/09638288.2023.2176554 · Cited by 28
“As there was only a small amount of missing data (0–4% across variables) and the sample size with missing data had adequate power [32], multiple imputation was not performed.”
BackgroundRen, Y., Barnhart, W. R., Cui, T., Song, J., Tang, C., Cui, S., & He, J. (2023) · Body Image · doi:10.1016/j.bodyim.2023.04.011 · Cited by 29
DTIN: Dual Transformer-based Imputation Nets for multivariate time series emitter missing data
Sun, Z., Li, Y., Wang, W., Liu, J., & Liu, X. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111270 · Cited by 25
Christon, L., & Myers, B. J. (2015) · Research in Autism · doi:10.1016/j.rasd.2015.08.004 · Cited by 28
Optimum estimation of missing values in randomized complete block design by genetic algorithm
Azadeh, A., Asadzadeh, S. M., Jafari-Marandi, R., Nazari-Shirkouhi, S., Baharian, G., Talebi, S., & Naghavi, A. (2012) · Knowledge-Based Systems · doi:10.1016/j.knosys.2012.06.014 · Cited by 23
Shaffer, K. S., & Friedlander, M. L. (2015) · Psychotherapy Research · doi:10.1080/10503307.2015.1080877 · Cited by 30
Racism and Sociopolitical Engagement Among Lesbian, Gay, and Bisexual Racial/Ethnic Minority Adults
VanDaalen, R. A., & Santos, C. E. (2017) · The Counseling Psychologist · doi:10.1177/0011000017699529 · Cited by 23
“According to Schlomer et al. (2010), given the nonsignificant result of these tests, it is plausible that the data are missing completely at random.”
MethodResultYoon, S., Barnhart, S., & Cage, J. L. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.04.015 · Cited by 24
An, S., Jung, H., & Lee, S. C. L. (2018) · Clinical Gerontologist · doi:10.1080/07317115.2018.1516263 · Cited by 24
Oros, S. M., Christon, L., Barth, K. S., Berini, C., Padgett, B. L., & Díaz, V. A. (2020) · The International Journal of Psychiatry in Medicine · doi:10.1177/0091217420946240 · Cited by 26
Lavergne, K. J., & Pelletier, L. G. (2016) · Motivation and Emotion · doi:10.1007/s11031-016-9577-3 · Cited by 28
“We used the Full Information Maximum Likelihood Robust method in Mplus (Muthén and Muthén 2012) to estimate model parameters from all available data (Schlomer et al. 2010) in the covariance matrix (see Appendix A in Supplementary materials).”
Assessing the Relationship Between Physical Health and Inmate Misconduct
Grosholz, J. M., & Semenza, D. C. (2018) · Criminal Justice and Behavior · doi:10.1177/0093854818775467 · Cited by 28
Career Decision Self‐Efficacy of Asian American Students: The Role of Curiosity and Ethnic Identity
Kim, Y. H., & Choi, N. (2019) · The Career Development Quarterly · doi:10.1002/cdq.12161 · Cited by 35
Guzmán‐González, M., Contreras, P., & Casu, G. (2020) · Journal of Social and Personal Relationships · doi:10.1177/0265407520940399 · Cited by 29
“05, thus expectation maximization was used to replace the missing data at the individual item level (Schlomer et al., 2010).”
MethodInfluentialFamily influence on undergraduates’ career choice implementation
Vautero, J., Silva, A. D., & Taveira, M. D. C. (2021) · International Journal for Educational and Vocational Guidance · doi:10.1007/s10775-020-09453-0 · Cited by 46
Datu, J. A. D., & Fincham, F. D. (2021) · Journal of Social and Personal Relationships · doi:10.1177/02654075211029380 · Cited by 31
“Prior research (Schlomer et al., 2010) has recommended the use of an expectation-maximization imputation strategy in this case.”
MethodThe dual pandemic: COVID-19, systemic racism, and college student-athletic mental health
Newman, T. J., Turgeon, S., Moore, M. A., Bean, C. N., Lee, L., Knuettel, M., & Rahill, C. O. (2022) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2022.2026997 · Cited by 31
“Hence, missing data were imputed using multiple imputations (Schlomer et al., 2010).”
MethodPresti, A. L., HEIJDEN, B. I. J. M. V. D., Briscoe, J. P., & Rosa, A. D. (2023) · Career Development International · doi:10.1108/cdi-08-2022-0220 · Cited by 33
Harris, A. H. S., Reeder, R. N., & Hyun, J. K. (2011) · The Journal of Psychology · doi:10.1080/00223980.2011.555431 · Cited by 28
Perceptions and Attitudes About Genetic Counseling Among Residents of a Midwestern Rural Area
Riesgraf, R. J., Veach, P. M., MacFarlane, I. M., & LeRoy, B. S. (2014) · Journal of Genetic Counseling · doi:10.1007/s10897-014-9777-5 · Cited by 28
“Multiple Imputation of Missing Data Missing data for participants included in the analyses were estimated using multiple imputation, as supported by Schlomer et al. (2010).”
MethodPeterson, N. A., Farmer, A. Y. R., Donnelly, L., & Forenza, B. (2014) · Journal of Teaching in Social Work · doi:10.1080/08841233.2014.955943 · Cited by 23
Parent Support Matters for the Educational Success of Sexual Minorities
Watson, R. J., Barnett, M. A., & Russell, S. T. (2015) · Journal of GLBT Family Studies · doi:10.1080/1550428x.2015.1028694 · Cited by 28
Minority Stress and Depressive Symptoms: Familism, Ethnic Identity, and Gender as Moderators
Cheng, H., Hitter, T. L., Adams, E. M., & Williams, C. (2016) · The Counseling Psychologist · doi:10.1177/0011000016660377 · Cited by 30
Beliefs About the Direct Comparison of E-Cigarettes and Cigarettes
Hershberger, A. R., Karyadi, K. A., VanderVeen, J. D., & Cyders, M. A. (2017) · Substance Use & Misuse · doi:10.1080/10826084.2016.1268628 · Cited by 25
Carlson, R. G., Wheeler, N. J., & Adams, J. J. (2018) · Journal of Counseling & Development · doi:10.1002/jcad.12188 · Cited by 24
Choi, E., Ospina, J. H., Steger, M. F., & Orsi, R. (2018) · Journal of Gerontological Social Work · doi:10.1080/01634372.2018.1515140 · Cited by 30
Xu, H. (2019) · Journal of Career Assessment · doi:10.1177/1069072719831975 · Cited by 31
Feinstein, B. A., McConnell, E. A., Dyar, C., Mustanski, B. S., & Newcomb, M. E. (2019) · Clinical Psychological Science · doi:10.1177/2167702619842561 · Cited by 29
Davies, A., Burnette, C. B., & Mazzeo, S. E. (2020) · Sex Roles · doi:10.1007/s11199-020-01151-z · Cited by 31
Metadata
- Authors
- Schlomer, G. L., Bauman, S., & Card, N. A.
- Affiliations
- University of Arizona (US)
- Venue
- Journal of Counseling Psychology
- Published
- 2010
- Volume
- 57
- Issue
- 1
- Pages
- 1-10
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W2097814478
- Cited by
- 1,835
- References
- 30
- Citations by year
- 2026: 66 · 2025: 98 · 2024: 90 · 2023: 124 · 2022: 143 · 2021: 148 · 2020: 155 · 2019: 165 · 2018: 118 · 2017: 125 · 2016: 126 · 2015: 147 · 2014: 133 · 2013: 91 · 2012: 58
- FWCI
- 54.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Counseling Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- missing data, missing data patterns, missing data handling, mean substitution, multiple imputation, full information maximum likelihood, reporting practices, simulation study, counseling psychology research
- MeSH terms
- Counseling, Data Collection, Data Interpretation, Statistical, Humans, Psychology, Research Design, Bias, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.