The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Methods for Handling Missing Data
Abstract
This chapter describes a general approach to handling missing data in psychological research. It provides a theoretical background in readable, nontechnical fashion. Our overall goal was to give practical, usable advice, rather than to give a detailed statistical treatment of issues surrounding analysis of incomplete data. We give an overview of the older, unacceptable methods for handling incomplete data, so that readers will know what approaches to avoid; although analysis of complete cases is sometimes an acceptable solution, we argue that pairwise deletion and mean substitution should be avoided. With respect to newer, acceptable methods, we give a general overview, including a brief discussion of the full information maximum likelihood structural equation modeling procedures (such as Amos, Mx, LISREL 8.5, and Mplus), but focus primarily on multiple imputation as a general solution. We give specific guidelines for making use of state‐of‐the‐art multiple imputation software and step‐by‐step instructions for using multiple imputation with Schafer's (1997) NORM program. Empirical examples of exploratory and data quality analyses and a substantive illustration involving multiple linear regression demonstrate the use of multiple imputation in practice. The chapter concludes with a discussion of some practical issues that often arise in connection with the analysis of incomplete data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Self-citationThe Jackknife, the Bootstrap and Other Resampling Plans
Efron, B. (1982) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970319 · Cited by 8,120
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Statistical Analysis With Missing Data
Ghosh, S. (1988) · Technometrics · doi:10.1080/00401706.1988.10488446 · Cited by 4,576
The Calculation of Posterior Distributions by Data Augmentation
Tanner, M. A., & Wong, W. H. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478458 · Cited by 3,928
Species Richness of Parasite Assemblages: Evolution and Patterns
Poulin, R. (1997) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.28.1.341 · Cited by 3,499
Linear Mixed Models for Longitudinal Data
Molenberghs, G., & Verbeke, G. (2000) · Springer Series in Statistics · doi:10.1007/978-1-4419-0300-6 · Cited by 2,646
A comparison of inclusive and restrictive strategies in modern missing data procedures.
Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.330 · Cited by 2,389
Statistical Strategies for Small Sample Research
Hoyle, R. H. (1999) · Cited by 2,109
Mini-Markers: A Brief Version of Goldberg's Unipolar Big-Five Markers
Saucier, G. (1994) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6303_8 · Cited by 1,703
Modeling the Drop-Out Mechanism in Repeated-Measures Studies
Little, R. J. A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476615 · Cited by 1,522
Multiple Imputation for Multivariate Missing-Data Problems: A Data Analyst's Perspective
Schafer, J. L., & Olsen, M. K. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3304_5 · Cited by 1,518
Latent Variables Analysis: Applications for Developmental Research.
AA, Eye, A. V., & Clogg, C. C. (1995) · Journal of the American Statistical Association · doi:10.2307/2291370 · Cited by 1,376
New methods for the analysis of change.
(2001) · American Psychological Association eBooks · doi:10.1037/10409-000 · Cited by 898
On structural equation modeling with data that are not missing completely at random
Muthén, B., Kaplan, D., & Hollis, M. (1987) · Psychometrika · doi:10.1007/bf02294365 · Cited by 883
Adding Missing-Data-Relevant Variables to FIML-Based Structural Equation Models
Graham, J. W. (2003) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1001_4 · Cited by 619
Self-citationMuthén, B. (2001) · New methods for the analysis of change. · doi:10.1037/10409-010 · Cited by 441
A class of pattern-mixture models for normal incomplete data
LITTLE, R. J. A. (1994) · Biometrika · doi:10.1093/biomet/81.3.471 · Cited by 405
Graham, J. W., Hofer, S. M., & MacKinnon, D. P. (1996) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3102_3 · Cited by 366
Self-citationMultivariate Applications in Substance Use Research: New Methods for New Questions
(2000) · Psychology Press eBooks · doi:10.4324/9781410604217 · Cited by 314
Cytokine regulation of apoptosis in fetal substantia nigra cultures
Jarskog, L. F., & Gilmore, J. H. (1996) · Biological Psychiatry · doi:10.1016/0006-3223(96)84228-4 · Cited by 273
Estimation of Linear Models with Incomplete Data
Allison, P. D. (1987) · Sociological Methodology · doi:10.2307/271029 · Cited by 268
Analysis with missing data in prevention research.
Graham, J. W., Hofer, S. M., Donaldson, S. I., MacKinnon, D. P., & Schafer, J. L. (1997) · The science of prevention: Methodological advances from alcohol and substance abuse research. · doi:10.1037/10222-010 · Cited by 264
Self-citationGraham, J. W., & Donaldson, S. I. (1993) · Journal of Applied Psychology · doi:10.1037//0021-9010.78.1.119 · Cited by 202
Self-citationStructural Factor Analysis Experiments with Incomplete Data
McArdle, J. J. (1994) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2904_5 · Cited by 198
Little, R. J. A., & Schenker, N. (1995) · Handbook of Statistical Modeling for the Social and Behavioral Sciences · doi:10.1007/978-1-4899-1292-3_2 · Cited by 160
Modeling Incomplete Longitudinal Substance Use Data Using Latent Variable Growth Curve Methodology
Duncan, S. C., & Duncan, T. E. (1994) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2904_1 · Cited by 124
Planned missing-data designs in analysis of change.
Graham, J. A., Taylor, B. J., & Cumsille, P. E. (2001) · American Psychological Association eBooks · doi:10.1037/10409-011 · Cited by 118
Self-citationSchafer, J. L. (2001) · American Psychological Association eBooks · doi:10.1037/10409-012 · Cited by 112
Duncan, T. E., Duncan, S. C., & Li, F. (1998) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519809540086 · Cited by 88
Data Quality in Evaluation of an Alcohol-Related Harm Prevention Program
Graham, J. A., Roberts, M. M., Tatterson, J. W., & Johnston, S. E. (2002) · Evaluation Review · doi:10.1177/0193841x02026002002 · Cited by 16
Self-citation
Cited by
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Self-citationMissing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
Self-citationHow Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory
Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007) · Prevention Science · doi:10.1007/s11121-007-0070-9 · Cited by 2,795
Self-citation(2009) · Cited by 2,013
Best practices for missing data management in counseling psychology
Schlomer, G. L., Bauman, S., & Card, N. A. (2010) · Journal of Counseling Psychology · doi:10.1037/a0018082 · Cited by 1,835
Metadata
- Authors
- Graham, J. W., Cumsille, P. E., & Elek‐Fisk, E.
- Venue
- Handbook of Psychology
- Publisher
- Wiley
- Published
- 2003-04-15
- Pages
- 87-114
- OpenAlex
- W2157808941
- Cited by
- 611
- References
- 34
- Type
- other
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.