The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Methods for Handling Missing Data
Abstract
This chapter describes a general approach to handling missing data in psychological research. It provides a theoretical background in readable, nontechnical fashion. Our overall goal was to give practical, usable advice, rather than to give a detailed statistical treatment of issues surrounding analysis of incomplete data. We give an overview of the older, unacceptable methods for handling incomplete data, so that readers will know what approaches to avoid; although analysis of complete cases is sometimes an acceptable solution, we argue that pairwise deletion and mean substitution should be avoided. With respect to newer, acceptable methods, we give a general overview, including a brief discussion of the full information maximum likelihood structural equation modeling procedures (such as Amos, Mx, LISREL 8.5, and Mplus), but focus primarily on multiple imputation as a general solution. We give specific guidelines for making use of state‐of‐the‐art multiple imputation software and step‐by‐step instructions for using multiple imputation with Schafer's (1997) NORM program. Empirical examples of exploratory and data quality analyses and a substantive illustration involving multiple linear regression demonstrate the use of multiple imputation in practice. The chapter concludes with a discussion of some practical issues that often arise in connection with the analysis of incomplete data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Self-citationThe Jackknife, the Bootstrap and Other Resampling Plans
Efron, B. (1982) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970319 · Cited by 8,120
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Statistical Analysis With Missing Data
Ghosh, S. (1988) · Technometrics · doi:10.1080/00401706.1988.10488446 · Cited by 4,576
The Calculation of Posterior Distributions by Data Augmentation
Tanner, M. A., & Wong, W. H. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478458 · Cited by 3,928
Species Richness of Parasite Assemblages: Evolution and Patterns
Poulin, R. (1997) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.28.1.341 · Cited by 3,499
Linear Mixed Models for Longitudinal Data
Molenberghs, G., & Verbeke, G. (2000) · Springer Series in Statistics · doi:10.1007/978-1-4419-0300-6 · Cited by 2,646
Cited by
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Self-citationMissing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
Self-citationHow Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory
Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007) · Prevention Science · doi:10.1007/s11121-007-0070-9 · Cited by 2,795
Self-citation(2009) · Cited by 2,013
Best practices for missing data management in counseling psychology
Schlomer, G. L., Bauman, S., & Card, N. A. (2010) · Journal of Counseling Psychology · doi:10.1037/a0018082 · Cited by 1,835
Early gender differences in self-regulation and academic achievement.
Matthews, J. S., Ponitz, C. C., & Morrison, F. J. (2009) · Journal of Educational Psychology · doi:10.1037/a0014240 · Cited by 687
Executive function and theory of mind: Stability and prediction from ages 2 to 3.
Carlson, S. M., Mandell, D. J., & Williams, L. (2004) · Developmental Psychology · doi:10.1037/0012-1649.40.6.1105 · Cited by 684
Santiago, C. D., Wadsworth, M. E., & Stump, J. (2011) · Journal of Economic Psychology · doi:10.1016/j.joep.2009.10.008 · Cited by 600
Planned missing data designs in psychological research.
Graham, J. W., Taylor, B. J., Olchowski, A. E., & Cumsille, P. E. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.4.323 · Cited by 573
Self-citationRussell, S. T., Ryan, C., Toomey, R. B., Diaz, R. M., & Sanchez, J. (2011) · Journal of School Health · doi:10.1111/j.1746-1561.2011.00583.x · Cited by 526
Toomey, R. B., Ryan, C., Diaz, R. M., Card, N. A., & Russell, S. T. (2010) · Developmental Psychology · doi:10.1037/a0020705 · Cited by 526
Latent Motivational Change in an Academic Setting: A 3-Year Longitudinal Study.
Otis, N., Grouzet, F. M. E., & Pelletier, L. G. (2005) · Journal of Educational Psychology · doi:10.1037/0022-0663.97.2.170 · Cited by 430
Tsai, Y.-M., Kunter, M., Lüdtke, O., Trautwein, U., & Ryan, R. M. (2008) · Journal of Educational Psychology · doi:10.1037/0022-0663.100.2.460 · Cited by 412
Prochaska, J. O., Velicer, W. F., Redding, C., Rossi, J. S., Goldstein, M., DePue, J., Greene, G. W., Rossi, S. R., Sun, X., Fava, J. L., et al. (2005) · Preventive Medicine · doi:10.1016/j.ypmed.2004.09.050 · Cited by 382
Trautwein, U. (2007) · Learning and Instruction · doi:10.1016/j.learninstruc.2007.02.009 · Cited by 375
Umgang mit fehlenden Werten in der psychologischen Forschung
Lüdtke, O., Robitzsch, A., Trautwein, U., & Köller, O. (2007) · Psychologische Rundschau · doi:10.1026/0033-3042.58.2.103 · Cited by 369
Tanner-Smith, E. E., Wilson, S. J., & Lipsey, M. W. (2013) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2012.05.006 · Cited by 331
Violent Media Content and Aggressiveness in Adolescents: A Downward Spiral Model
Slater, M. D., Henry, K. L., Swaim, R. C., & Anderson, L. L. (2003) · Communication Research · doi:10.1177/0093650203258281 · Cited by 318
Guo, J., Parker, P. D., Marsh, H. W., & Morin, A. J. S. (2015) · Developmental Psychology · doi:10.1037/a0039440 · Cited by 312
Citizenship and Counterproductive Behavior: Clarifying Relations Between the Two Domains
Sackett, P. R., Berry, C. M., Wiemann, S. A., & Laczo, R. M. (2006) · Human Performance · doi:10.1207/s15327043hup1904_7 · Cited by 301
Retelsdorf, J., Butler, R., Streblow, L., & Schiefele, U. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.01.001 · Cited by 300
Heteronormativity, school climates, and perceived safety for gender nonconforming peers
Toomey, R. B., McGuire, J. K., & Russell, S. T. (2012) · Journal of Adolescence · doi:10.1016/j.adolescence.2011.03.001 · Cited by 297
Proudfoot, J., Clarke, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., Harrison, V., Christensen, H., & Hadzi-Pavlovic, D. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-312 · Cited by 264
High performance work systems in emergent organizations: Implications for firm performance
Messersmith, J. G., & Guthrie, J. P. (2010) · Human Resource Management · doi:10.1002/hrm.20342 · Cited by 292
Bailey, J. A., Hill, K. G., Oesterle, S., & Hawkins, J. D. (2009) · Developmental Psychology · doi:10.1037/a0016129 · Cited by 284
Recurrence after operative management of intrahepatic cholangiocarcinoma
Hyder, O., Hatzaras, I., Sotiropoulos, G. C., Paul, A., Alexandrescu, S., Marques, H., Pulitano, C., Barroso, E., Clary, B. M., Aldrighetti, L., et al. (2013) · Surgery · doi:10.1016/j.surg.2012.12.005 · Cited by 281
Need-supporting gamification in education: An assessment of motivational effects over time
van Roy, R., & Zaman, B. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.08.018 · Cited by 273
Toomey, R. B., Ryan, C., Diaz, R. M., & Russell, S. T. (2011) · Applied Developmental Science · doi:10.1080/10888691.2011.607378 · Cited by 271
Neumann, M., Wirtz, M., Bollschweiler, E., Mercer, S. W., Warm, M., Wolf, J., & Pfaff, H. (2007) · Patient Education and Counseling · doi:10.1016/j.pec.2007.07.003 · Cited by 254
Burnout in nurses – the relationship between social capital in hospitals and emotional exhaustion
Kowalski, C., Ommen, O., Driller, E., Ernstmann, N., Wirtz, M. A., Köhler, T., & Pfaff, H. (2010) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2009.02989.x · Cited by 222
Ingoldsby, E. M., Shaw, D. S., Winslow, E., Schonberg, M., Gilliom, M., & Criss, M. M. (2006) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-006-9026-y · Cited by 214
Individual and group CBT and IPT for Puerto Rican adolescents with depressive symptoms.
Rosselló, J., Bernal, G., & Rivera-Medina, C. (2008) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/1099-9809.14.3.234 · Cited by 197
The structure of academic self-concepts revisited: The nested Marsh/Shavelson model.
Brunner, M., Keller, U., Dierendonck, C., Reichert, M., Ugen, S., Fischbach, A., & Martin, R. (2010) · Journal of Educational Psychology · doi:10.1037/a0019644 · Cited by 181
Wilson, S. J., Tanner-Smith, E. E., Lipsey, M. W., Steinka-Fry, K., & Morrison, J. (2011) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2011.8 · Cited by 173
Espelage, D. L., Low, S., Rao, M. A., Hong, J. S., & Little, T. D. (2014) · Journal of Research on Adolescence · doi:10.1111/jora.12060 · Cited by 155
Kleinke, K. (2017) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998616687084 · Cited by 148
Data Analysis in Social Psychology: Recent and Recurring Issues
Judd, C. M., & Kenny, D. A. (2010) · Handbook of Social Psychology · doi:10.1002/9780470561119.socpsy001004 · Cited by 151
Espelage, D. L., Basile, K. C., De La Rue, L., & Hamburger, M. E. (2015) · Journal of Interpersonal Violence · doi:10.1177/0886260514553113 · Cited by 134
Curran, T., Hill, A. P., & Niemiec, C. P. (2013) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.35.1.30 · Cited by 129
Narayan, A. J., Englund, M. M., & Egeland, B. (2013) · Development and Psychopathology · doi:10.1017/s095457941300031x · Cited by 83
Smith, E. A., Palen, L.-A., Caldwell, L. L., Flisher, A. J., Graham, J. W., Mathews, C., Wegner, L., & Vergnani, T. (2008) · Prevention Science · doi:10.1007/s11121-008-0103-z · Cited by 77
Self-citationThe Psychometric Properties of the Kentucky Inventory of Mindfulness Skills in Clinical Populations
Baum, C., Kuyken, W., Bohus, M., Heidenreich, T., Michalak, J., & Steil, R. (2010) · Assessment · doi:10.1177/1073191109356525 · Cited by 76
Dissociation predicts later attention problems in sexually abused children
Kaplow, J. B., Hall, E., Koenen, K. C., Dodge, K. A., & Amaya-Jackson, L. (2008) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2007.07.005 · Cited by 73
Peer relations in the anxiety–depression link: test of a mediation model
Biggs, B. K., Nelson, J. M., & Sampilo, M. L. (2010) · Anxiety, Stress & Coping · doi:10.1080/10615800903406543 · Cited by 68
Wilson, S. J., & Tanner-Smith, E. E. (2013) · Journal of the Society for Social Work and Research · doi:10.5243/jsswr.2013.22 · Cited by 66
Green, M. J., Espie, C. A., Hunt, K., & Benzeval, M. (2012) · SLEEP · doi:10.5665/sleep.1882 · Cited by 59
Roles of general versus second language (L2) knowledge in L2 reading comprehension
Guo, Y., & Roehrig, A. D. (2011) · Reading in a Foreign Language · doi:10.64152/10125/66659 · Cited by 52
Does recreational computer use affect high school achievement?
Bowers, A. J., & Berland, M. (2013) · Educational Technology Research and Development · doi:10.1007/s11423-012-9274-1 · Cited by 40
Cassidy, A. R. (2016) · Child Neuropsychology · doi:10.1080/09297049.2014.994484 · Cited by 37
Gilbey, D., Mahfouda, S., Ohan, J., Lin, A., & Perry, Y. (2020) · Adolescent Research Review · doi:10.1007/s40894-019-00128-8 · Cited by 28
Burraston, B. O., & Eddy, J. M. (2017) · Smith College Studies in Social Work · doi:10.1080/00377317.2017.1248634 · Cited by 15
Metadata
- Authors
- Graham, J. W., Cumsille, P. E., & Elek‐Fisk, E.
- Venue
- Handbook of Psychology
- Publisher
- Wiley
- Published
- 2003-04-15
- Pages
- 87-114
- OpenAlex
- W2157808941
- Cited by
- 611
- References
- 34
- Type
- other
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.