Principled missing data methods for researchers
Open accessThe DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.
Abstract
The impact of missing data on quantitative research can be serious, leading to biased estimates of parameters, loss of information, decreased statistical power, increased standard errors, and weakened generalizability of findings. In this paper, we discussed and demonstrated three principled missing data methods: multiple imputation, full information maximum likelihood, and expectation-maximization algorithm, applied to a real-world data set. Results were contrasted with those obtained from the complete data set and from the listwise deletion method. The relative merits of each method are noted, along with common features they share. The paper concludes with an emphasis on the importance of statistical assumptions, and recommendations for researchers. Quality of research will be enhanced if (a) researchers explicitly acknowledge missing data problems and the conditions under which they occurred, (b) principled methods are employed to handle missing data, and (c) the appropriate treatment of missing data is incorporated into review standards of manuscripts submitted for publication.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“A full information maximum-likelihood method was used to deal with missing data [45].”
From Online Mindfulness-Based Cognitive Behavioral Therapy Intervention for Youth With Major Depressive Disorders: Randomized Controlled Trial. (2021) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,031
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Society and the Adolescent Self-Image
Rosenberg, M. (1965) · doi:10.1515/9781400876136 · Cited by 30,126
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · cited 3×
“…one can use the Markov Chain Monte Carlo (MCMC) method (Schafer 1997), or the fully conditional specification (also referred to as chained equations) if the missing variable is categorical or non-normal (Raghunathan et al. 2001; van Buuren 2007; van Buuren et al. 1999; van Buuren et al. 2006).”
BackgroundMethodMissing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792 · cited 8×
“One has to turn to numerical simulation methods, such as MCMC (Schafer 1997) in this case.”
BackgroundMethodInfluentialStatistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473 · cited 4×
“MI was proposed to impute missing data while acknowledging the uncertainty associated with the imputed values (Little and Rubin 2002).”
BackgroundMethodInfluential(2010) · Cited by 7,034
(2001) · Statistics for Psychologists · doi:10.4324/9781410605542-11 · Cited by 6,877
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163 · cited 1×
“In the case of a random slope and random intercepts model, one needs to perform multiple imputation separately within each cluster (Graham 2009).”
MethodAnalysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012 · cited 38×
“…following: l θ Y Þ ¼ l θ YobsÞ þ logP Ymis Y obs; θÞ þ logc;jðjðjð ð15Þ where l(θ|Y) = log P(Y|θ) is the complete-data log likelihood, l(θ|Yobs) is the observed-data log likelihood, log c is a constant, and P(Ymis|Yobs, θ) is the predictive distribution of the missing data, given θ (Schafer 1997).”
BackgroundMethodResultInfluentialAnalysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978 · cited 1×
“When the two assumptions are met, FIML is demonstrated to produce unbiased estimates (Enders and Bandalos 2001) and valid model fit information (Enders 2001).”
BackgroundMultiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072
Schafer, J. L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800102 · Cited by 3,949
The Calculation of Posterior Distributions by Data Augmentation
Tanner, M. A., & Wong, W. H. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478458 · Cited by 3,928
The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses
Wilks, S. S. (1938) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177732360 · Cited by 3,493 · cited 2×
“log likelihoods follows a chi-square distribution under suitable regularity conditions (Schafer and Graham 2002; Wilks 1938).”
BackgroundMethodMultiple imputation of discrete and continuous data by fully conditional specification
van Buuren, S. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280206074463 · Cited by 2,827
How Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory
Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007) · Prevention Science · doi:10.1007/s11121-007-0070-9 · Cited by 2,795
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Multiple Imputation After 18+ Years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.2307/2291635 · Cited by 2,686
A multivariate technique for multiply imputing missing values using a sequence of regression models
Raghunathan, T. E., Lepkowski, J. M., Hoewyk, J. V., & Solenberger, P. W. (2001) · Survey methodology · Cited by 2,436
A comparison of inclusive and restrictive strategies in modern missing data procedures.
Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.330 · Cited by 2,389 · cited 8×
“And the literature consistently documented the superior power of EM, compared to MI (Collins et al. 2001; Graham et al. 2007; Schafer and Graham 2002).”
BackgroundMethodResultInfluentialMultiple Imputation of Missing Values
Royston, P. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400301 · Cited by 2,340
Best practices for missing data management in counseling psychology
Schlomer, G. L., Bauman, S., & Card, N. A. (2010) · Journal of Counseling Psychology · doi:10.1037/a0018082 · Cited by 1,835 · cited 2×
“Another advantage of MI over ML-based methods is its computational simplicity (Sinharay et al. 2001).”
BackgroundHow can I deal with missing data in my study?
Bennett, D. A. (2001) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1467-842x.2001.tb00294.x · Cited by 1,656 · cited 3×
“Bennett (2001) maintained that statistical analysis is likely to be biased when more than 10% of data are mis sing.”
BackgroundInfluentialMultiple Imputation for Multivariate Missing-Data Problems: A Data Analyst's Perspective
Schafer, J. L., & Olsen, M. K. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3304_5 · Cited by 1,518
Missing Data Techniques for Structural Equation Modeling.
Allison, P. D. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.545 · Cited by 1,333 · cited 1×
“These findings are consistent with those reported in the literature and thus confirm the recommendations of the three principled methods (Allison 2003; Horton and Lipsitz 2001; Kenward and Carpenter 2007; Peng et al. 2006; Peugh and Enders 2004; Schafer and Graham 2002).”
ResultMultiple Imputation by Chained Equations (MICE): Implementation in Stata
Royston, P., & White, I. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i04 · Cited by 1,248
Fully conditional specification in multivariate imputation
Van Buuren, S., Brand, J. P. L., Groothuis-Oudshoorn, C. G. M., & Rubin, D. B. (2006) · Journal of Statistical Computation and Simulation · doi:10.1080/10629360600810434 · Cited by 1,217
Analysis of Longitudinal Data.
Have, T. R. T., Diggle, P. J., Liang, K.-Y., & Zeger, S. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291352 · Cited by 1,171
Peugh, J. L., & Enders, C. K. (2004) · Review of Educational Research · doi:10.3102/00346543074004525 · Cited by 1,112 · cited 2×
“These findings are consistent with those reported in the literature and thus confirm the recommendations of the three principled methods (Allison 2003; Horton and Lipsitz 2001; Kenward and Carpenter 2007; Peng et al. 2006; Peugh and Enders 2004; Schafer and Graham 2002).”
BackgroundResultMultiple Imputation of Missing Values: Update of Ice
Royston, P. (2005) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0500500404 · Cited by 1,041
A Primer on Maximum Likelihood Algorithms Available for Use With Missing Data
Enders, C. K. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0801_7 · Cited by 1,027 · cited 5×
“When the two assumptions are met, FIML is demonstrated to produce unbiased estimates (Enders and Bandalos 2001) and valid model fit information (Enders 2001).”
BackgroundMethodInfluentialNew methods for the analysis of change.
(2001) · American Psychological Association eBooks · doi:10.1037/10409-000 · Cited by 898
Miscellanea. Small-sample degrees of freedom with multiple imputation
Barnard, J. (1999) · Biometrika · doi:10.1093/biomet/86.4.948 · Cited by 829 · cited 2×
“The degrees of freedom (νm or ν m ) for this t distribution are calculated by Equations 8–10 (Barnard and Rubin 1999): r ¼ 1 þ 1 m B U : ð8Þ νm ¼ m−1ð Þ 1 þ 1r 2 ð9Þ ν m ¼ 1 νm þ 1 1−gammað Þν0 ν0þ1ð Þ ν0þ3 " #−1 ð10Þ In Equation 8, r is the relative increase in variance due to missing data.”
MethodHorton, N. J., & Kleinman, K. P. (2007) · The American Statistician · doi:10.1198/000313007x172556 · Cited by 786
Adding Missing-Data-Relevant Variables to FIML-Based Structural Equation Models
Graham, J. W. (2003) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1001_4 · Cited by 619 · cited 15×
“Graham (2003) has shown that by constructing the saturated correlates model this way, one can include an auxiliary variable in the SEM model without affecting parameter estimate(s), or the model fit index for the model of substantive interest, which is Equation 18 in the current study.”
BackgroundMethodInfluentialHorton, N. J., & Lipsitz, S. R. (2001) · The American Statistician · doi:10.1198/000313001317098266 · Cited by 600 · cited 1×
“These findings are consistent with those reported in the literature and thus confirm the recommendations of the three principled methods (Allison 2003; Horton and Lipsitz 2001; Kenward and Carpenter 2007; Peng et al. 2006; Peugh and Enders 2004; Schafer and Graham 2002).”
ResultThe impact of caring and connectedness on adolescent health and well‐being
RESNICK, M. D., HARRIS, L. J., & BLUM, R. W. (1993) · Journal of Paediatrics and Child Health · doi:10.1111/j.1440-1754.1993.tb02257.x · Cited by 581 · cited 4×
“The HBQ asked adolescents to indicate whether they engaged in specific risky health behaviors (Behavioral Risk Scale) or had experienced selected emotions (Emotional Risk Scale).”
MethodInfluentialThe use of multiple imputation for the analysis of missing data.
Sinharay, S., Stern, H. S., & Russell, D. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.317 · Cited by 560
Multiple imputation: current perspectives
Kenward, M. G., & Carpenter, J. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280206075304 · Cited by 456 · cited 1×
“These findings are consistent with those reported in the literature and thus confirm the recommendations of the three principled methods (Allison 2003; Horton and Lipsitz 2001; Kenward and Carpenter 2007; Peng et al. 2006; Peugh and Enders 2004; Schafer and Graham 2002).”
ResultREALCOM-IMPUTE Software for Multilevel Multiple Imputation with Mixed Response Types
Carpenter, J. R., Goldstein, H., & Kenward, M. G. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i05 · Cited by 395 · cited 1×
“In this instance, one may turn to specialized MI programs, such as, the PAN library in the S-Plus program (Schafer 2001), the REALCON-IMPUTE software (Carpenter et al. 2011), and the R package mlmmm (Yucel 2007).”
MethodSelf-efficacy and performance in mathematics: Reciprocal determinism in 33 nations.
Williams, T., & Williams, K. (2010) · Journal of Educational Psychology · doi:10.1037/a0017271 · Cited by 338 · cited 1×
“Another was suspected to have used either LD or an imputation method to deal with attrition in a PISA data set (OECD 2009; Williams and Williams 2010).”
MethodPartially parametric techniques for multiple imputation
Schenker, N., & Taylor, J. M. G. (1996) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(95)00057-7 · Cited by 334 · cited 1×
“Unfortunately, the importance of assessing the convergence was rarely mentioned in articles that reviewed the theory and application of MCMC (Schafer 1999; Schafer and Graham 2002; Schlomer et al. 2010; Sinharay et al. 2001).”
BackgroundEnders, C. K. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.3.322 · Cited by 313 · cited 1×
“Enders (2003) stated that a missing rate of 15% to 20% was common in educational and psychological studies.”
BackgroundThe Analysis of Incomplete Data
Hartley, H. O., & Hocking, R. R. (1971) · Biometrics · doi:10.2307/2528820 · Cited by 295
PISA Data Analysis Manual: SPSS, Second Edition
OECD (2009) · PISA · doi:10.1787/9789264056275-en · Cited by 265 · cited 1×
“Cronbach’s alpha reliability (Nunnally 1978) was .84 for the Behavioral Risk Scale and .81 for the Emotional Risk Scale (Peng and Nichols 2003).”
MethodMultiple Imputation of Missing Values: Further Update of Ice, with an Emphasis on Interval Censoring
Royston, P. (2007) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800700401 · Cited by 259 · cited 2×
“Other software packages are also available for imputing missing values in categorical variables, such as the ICE module in Stata (Royston 2004, 2005, 2007; Royston and White 2011), the mice package in R and S-Plus (van Buuren and GroothuisOudshoorn 2011), and the IVEware (Raghunathan et al. 2001).”
MethodMultiple Imputation for the Fatal Accident Reporting System
Heitjan, D. F., & Little, R. J. A. (1991) · Applied Statistics · doi:10.2307/2347902 · Cited by 227
A Potential for Bias When Rounding in Multiple Imputation
Horton, N. J., Lipsitz, S. R., & Parzen, M. (2003) · The American Statistician · doi:10.1198/0003130032314 · Cited by 224 · cited 2×
“For example, Horton et al. (2003) showed analytically that rounding the imputed values led to biased estimates, whereas imputed values without rounding led to unbiased results.”
BackgroundResultAdvances in Missing Data Methods and Implications for Educational Research
Peng, C. J., Harwell, M. R., Liou, S.-M., & Ehman, L. H. (2006) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-578-320251005 · Cited by 216
Self-citationRobustness of a multivariate normal approximation for imputation of incomplete binary data
Bernaards, C. A., Belin, T. R., & Schafer, J. L. (2007) · Statistics in Medicine · doi:10.1002/sim.2619 · Cited by 192 · cited 1×
“Bernaards et al. (2007) compared three approaches to rounding in binary missing values: (1) rounding the imputed value to the nearest plausible value, (2) randomly drawing from a Bernoulli trial using the imputed value, between 0 and 1, as the probability in the Bernoulli trial, and (3) using an…”
MethodState of the Multiple Imputation Software
Yucel, R. M. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i01 · Cited by 179 · cited 1×
“Interested readers are referred to a special volume of the Journal of Statistical Software (Yucel 2011) for recent developments in MI software.”
BackgroundLittle, R. J. A., & Schenker, N. (1995) · Handbook of Statistical Modeling for the Social and Behavioral Sciences · doi:10.1007/978-1-4899-1292-3_2 · Cited by 160
Demirtas, H., Freels, S. A., & Yucel, R. M. (2008) · Journal of Statistical Computation and Simulation · doi:10.1080/10629360600903866 · Cited by 153
Schafer, J. L. (2001) · American Psychological Association eBooks · doi:10.1037/10409-012 · Cited by 127
MULTILEVEL MODELLING NEWSLETTER
Lapidot, T. (2004) · Cited by 86
Using Multinomial Logistic Models To Predict Adolescent Behavioral Risk
Peng, C. J., & Nichols, R. N. (2003) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1051748160 · Cited by 71
Self-citationThe EM Algorithm: A Guided Tour
Couvreur, C. (1997) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4612-1996-5_12 · Cited by 52 · cited 2×
“Second, the EM algorithm is simple, easy to implement (Dempster et al. 1977) and stable (Couvreur 1996).”
BackgroundMethodBehavioral and Emotional Risk in Early Adolescents
Ingersoll, G. M., & Orr, D. P. (1989) · The Journal of Early Adolescence · doi:10.1177/0272431689094002 · Cited by 46 · cited 4×
“The HBQ asked adolescents to indicate whether they engaged in specific risky health behaviors (Behavioral Risk Scale) or had experienced selected emotions (Emotional Risk Scale).”
MethodInfluentialComparison of Two Approaches for Handling Missing Covariates in Logistic Regression
Peng, C. J., & Zhu, J. (2007) · Educational and Psychological Measurement · doi:10.1177/0013164407305582 · Cited by 44
Self-citationFrequent Somatic Complaints and Psychosocial Risk in Adolescents
Ingersoll, G. M., Grizzle, K. L., Beiter, M., & Orr, D. P. (1993) · The Journal of Early Adolescence · doi:10.1177/0272431693013001004 · Cited by 17 · cited 1×
“Written parental consent was waived with the approval of the school administration and the university Institutional Review Board (Ingersoll et al. 1993).”
MethodR mlmmm Package: Fitting Multivariate Linear Mixed Effects Models with Missing Values
Yucel, R. M. (2015) · Turkiye Klinikleri Journal of Biostatistics · doi:10.5336/biostatic.2014-42149 · Cited by 8
Multiple imputation of missing blood pressure covariates in survival analysis
van Buuren, S., Boshuizen, H. C., & Knook, D. L. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990330)18:6<681::aid-sim71>3.0.co;2-r
Research works printed but not linked: 7
- Ake CF: Rounding after multiple imputation with non-binary categorical covariates. In Proceedings of the Thirtieth Annual SAS® Users Group International Conference. Cary, NC: SAS Institute Inc; 2005:1-11.
- Allison PD: Missing data. Thousand Oaks, CA: Sage Publications, Inc.; 2001.
- Allison PD: Imputation of categorical variables with PROC MI. In Proceedings of the Thirtieth Annual SAS® Users Group International Conference. Cary, NC: SAS Institute Inc; 2005:1-14.
- Nunnally J: Psychometric theory. 2nd edition. New York: McGraw-Hill; 1978.
- SAS Institute Inc: SAS/STAT 9.3 User's Guide. Cary, NC: SAS Institute Inc; 2011.
- Truxillo C: Maximum Likelihood Parameter Estimation with Incomplete Data. In Proceedings of the Thirtieth Annual SAS® Users Group International Conference. Cary, NC: SAS Institute Inc; 2005:1-19.
- Yung Y, Zhang W: Making use of incomplete observations in the analysis of structural equation models: The CALIS procedure's full information maximum likelihood method in SAS/STAT® 9.3. In Proceedings of the SAS® Global Forum 2011 Conference. Cary, NC: SAS Institute Inc; 2011.
Cited by
Santini, Z. I., Jose, P. E., York Cornwell, E., Koyanagi, A., Nielsen, L., Hinrichsen, C., Meilstrup, C., Madsen, K. R., & Koushede, V. (2020) · The Lancet Public Health · doi:10.1016/s2468-2667(19)30230-0 · Cited by 1,755
The proportion of missing data should not be used to guide decisions on multiple imputation
Madley-Dowd, P., Hughes, R., Tilling, K., & Heron, J. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.016 · Cited by 1,053
“Statistical guidance articles have stated that bias is likely in analyses with more than 10% missingness and that if more than 40% data are missing in important variables then results should only be considered as hypothesis generating [18,19].”
BackgroundA survey on missing data in machine learning
Emmanuel, T., Maupong, T., Mpoeleng, D., Semong, T., Mphago, B., & Tabona, O. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00516-9 · Cited by 1,067
“The monotone data pattern is easier to deal with since patterns among the missing values are easily observable [24].”
BackgroundGroarke, J. M., Berry, E., Graham-Wisener, L., McKenna-Plumley, P. E., McGlinchey, E., & Armour, C. (2020) · PLOS ONE · doi:10.1371/journal.pone.0239698 · Cited by 727
“As less than 5% of the data were missing pairwise and listwise deletion were implemented [69,70].”
Issues and recommendations for exploratory factor analysis and principal component analysis
Schreiber, J. B. (2021) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2020.07.027 · Cited by 565
Metadata
- Authors
- Dong, Y., & Peng, C.-Y. J.
- Affiliations
- Indiana University Bloomington (US)
- Corresponding author
- Peng, Chao-Ying Joanne
- Venue
- SpringerPlus
- Published
- 2013-05-14
- Volume
- 2
- Issue
- 1
- Pages
- 222-222
- ISSN
- 2193-1801 (ISSN-L)
- PMC
- PMC3701793
- OpenAlex
- W2139075905
- Semantic Scholar
- 9ac8ef178c71a93570ee44af6542983fd74ecb08
- Cited by
- 2,208
- References
- 69
- Citations by year
- 2026: 197 · 2025: 269 · 2024: 238 · 2023: 240 · 2022: 252 · 2021: 266 · 2020: 197 · 2019: 181 · 2018: 162 · 2017: 88 · 2016: 74 · 2015: 33 · 2014: 8
- FWCI
- 33.41
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- SpringerPlus (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- missing data, multiple imputation, full information maximum likelihood, expectation-maximization algorithm, listwise deletion, estimation bias, statistical power, reporting guidelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.