The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Missing Data in Educational Research: A Review of Reporting Practices and Suggestions for Improvement
Abstract
Missing data analyses have received considerable recent attention in the methodological literature, and two “modern” methods, multiple imputation and maximum likelihood estimation, are recommended. The goals of this article are to (a) provide an overview of missing-data theory, maximum likelihood estimation, and multiple imputation; (b) conduct a methodological review of missing-data reporting practices in 23 applied research journals; and (c) provide a demonstration of multiple imputation and maximum likelihood estimation using the Longitudinal Study of American Youth data. The results indicated that explicit discussions of missing data increased substantially between 1999 and 2003, but the use of maximum likelihood estimation or multiple imputation was rare; the studies relied almost exclusively on listwise and pairwise deletion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
A test of missing completely at random for multivariate data with missing values
Little, R. J. A. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478722 · Cited by 8,963
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Journal of The American Statistical Association
Fienberg, S. E. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,125
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978
Self-citationStatistical Analysis With Missing Data
Ghosh, S. (1988) · Technometrics · doi:10.1080/00401706.1988.10488446 · Cited by 4,576
(1982) · Cited by 3,737
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
A comparison of inclusive and restrictive strategies in modern missing data procedures.
Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.330 · Cited by 2,389
Statistical Strategies for Small Sample Research
Hoyle, R. H. (1999) · Cited by 2,109
Allison, P. (2002) · doi:10.4135/9781412985079 · Cited by 2,050
Yuan, K.-H., & Bentler, P. M. (2000) · Sociological Methodology · doi:10.1111/0081-1750.00078 · Cited by 1,748
(1996) · Dialnet (Universidad de la Rioja) · Cited by 1,733
Multiple Imputation for Multivariate Missing-Data Problems: A Data Analyst's Perspective
Schafer, J. L., & Olsen, M. K. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3304_5 · Cited by 1,518
Enders, C. K. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.352 · Cited by 932
Self-citationMISSING DATA: A CONCEPTUAL REVIEW FOR APPLIED PSYCHOLOGISTS
ROTH, P. L. (1994) · Personnel Psychology · doi:10.1111/j.1744-6570.1994.tb01736.x · Cited by 901
On structural equation modeling with data that are not missing completely at random
Muthén, B., Kaplan, D., & Hollis, M. (1987) · Psychometrika · doi:10.1007/bf02294365 · Cited by 883
Multiple Imputation for Missing Data: A Cautionary Tale
ALLISON, P. D. (2000) · Sociological Methods & Research · doi:10.1177/0049124100028003003 · Cited by 795
Enders, C. K. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971482 · Cited by 787
Self-citationMardia, K. V. (1974) · Cited by 786
Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S., Cribbie, R. A., Donahue, B., Kowalchuk, R. K., Lowman, L. L., Petoskey, M. D., Keselman, J. C., et al. (1998) · Review of Educational Research · doi:10.2307/1170601 · Cited by 627
Adding Missing-Data-Relevant Variables to FIML-Based Structural Equation Models
Graham, J. W. (2003) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1001_4 · Cited by 619
Horton, N. J., & Lipsitz, S. R. (2001) · The American Statistician · doi:10.1198/000313001317098266 · Cited by 600
The use of multiple imputation for the analysis of missing data.
Sinharay, S., Stern, H. S., & Russell, D. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.317 · Cited by 560
(2000) · Psychology Press eBooks · doi:10.4324/9781410601940 · Cited by 479
Advances in Social Science Methodology
Thompson, B. (1994) · Cited by 423
Graham, J. W., Hofer, S. M., & MacKinnon, D. P. (1996) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3102_3 · Cited by 366
Gold, M. S., & Bentler, P. M. (2000) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0703_1 · Cited by 332
Enders, C. K. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.3.322 · Cited by 313
Self-citationThe developmental ecology of urban males' youth violence.
Tolan, P. H., Gorman-Smith, D., & Henry, D. B. (2003) · Developmental Psychology · doi:10.1037//0012-1649.39.2.274 · Cited by 301
Li, K. H., Raghunathan, T. E., & Rubin, D. B. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475152 · Cited by 245
On the performance of multiple imputation for multivariate data with small sample size
Graham, J. A., Schafer, J. L., & Hoyle, R. H. (1999) · Cited by 232
Multiple Imputation in Multivariate Research
(2000) · Modeling Longitudinal and Multilevel Data · doi:10.4324/9781410601940-15 · Cited by 205
Sadler, P., & Woody, E. (2003) · Journal of Personality & Social Psychology · doi:10.1037//0022-3514.84.1.80 · Cited by 203
Hill, J. L., Brooks-Gunn, J., & Waldfogel, J. (2003) · Developmental Psychology · doi:10.1037/0012-1649.39.4.730 · Cited by 202
Likelihood based frequentist inference when data are missing at random
Kenward, M. G., & Molenberghs, G. (1998) · Statistical Science · doi:10.1214/ss/1028905886 · Cited by 192
Snyder, J., Brooker, M., Patrick, M. R., Snyder, A., Schrepferman, L., & Stoolmiller, M. (2003) · Child Development · doi:10.1046/j.1467-8624.2003.00644.x · Cited by 168
Planned missing-data designs in analysis of change.
Graham, J. A., Taylor, B. J., & Cumsille, P. E. (2001) · American Psychological Association eBooks · doi:10.1037/10409-011 · Cited by 140
McQueen, A., Getz, J. G., & Bray, J. H. (2003) · Child Development · doi:10.1046/j.1467-8624.2003.00635.x · Cited by 127
New approaches to missing data in psychological research: Introduction to the special section.
West, S. G. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.315 · Cited by 36
Kaplan, D. (1995) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986020001069 · Cited by 25
Cited by
Multiple imputation of discrete and continuous data by fully conditional specification
van Buuren, S. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280206074463 · Cited by 2,827
Principled missing data methods for researchers
Dong, Y., & Peng, C.-Y. J. (2013) · SpringerPlus · doi:10.1186/2193-1801-2-222 · Cited by 2,208
“These findings are consistent with those reported in the literature and thus confirm the recommendations of the three principled methods (Allison 2003; Horton and Lipsitz 2001; Kenward and Carpenter 2007; Peng et al. 2006; Peugh and Enders 2004; Schafer and Graham 2002).”
BackgroundResultTeachers’ Mathematical Knowledge, Cognitive Activation in the Classroom, and Student Progress
Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., Klusmann, U., Krauss, S., Neubrand, M., & Tsai, Y.-M. (2010) · American Educational Research Journal · doi:10.3102/0002831209345157 · Cited by 2,100
An introduction to modern missing data analyses
Baraldi, A. N., & Enders, C. K. (2010) · Journal of School Psychology · doi:10.1016/j.jsp.2009.10.001 · Cited by 1,452
Self-citationMissing Data: Five Practical Guidelines
Newman, D. A. (2014) · Organizational Research Methods · doi:10.1177/1094428114548590 · Cited by 1,411
“As sensible as this principle may sound, it is still routinely ignored by researchers in management and psychology who regularly opt for listwise deletion (cf. Peugh & Enders, 2004).”
Background
Metadata
- Authors
- Peugh, J. L., & Enders, C. K.
- Venue
- Review of Educational Research
- Published
- 2004-12
- Volume
- 74
- Issue
- 4
- Pages
- 525-556
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2130836428
- Cited by
- 1,112
- References
- 49
- FWCI
- 7.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.