The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Analysis of Variance of Multiply Imputed Data
Open accessAbstract
As a procedure for handling missing data, Multiple imputation consists of estimating the missing data multiple times to create several complete versions of an incomplete data set. All these data sets are analyzed by the same statistical procedure, and the results are pooled for interpretation. So far, no explicit rules for pooling F tests of (repeated-measures) analysis of variance have been defined. In this article we outline the appropriate procedure for the results of analysis of variance (ANOVA) for multiply imputed data sets. It involves both reformulation of the ANOVA model as a regression model using effect coding of the predictors and applying already existing combination rules for regression models. The proposed procedure is illustrated using 3 example data sets. The pooled results of these 3 examples provide plausible F and p values.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Missing values were handled by multivariate multiple imputation using Rubin’s method.26”
From Aerobic, resistance, or combined exercise training and cardiovascular risk profile in overweight or obese adults: the CardioRACE trial (2024) · cites this paper as [26]
In the citing paper
“as no consensus on how to best pool F statistics was available [34].”
From An Internet-Based Cognitive Behavioral Therapy Program Adapted to Patients With Cardiovascular Disease and Depression: Randomized Controlled Trial (2019) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Multilevel analysis techniques and applications
Hox, J. J., Moerbeek, M., & van de Schoot, R. (2002) · Cited by 6,006
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
Journal of Statistical Software
de Leeuw, J. (2009) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.10 · Cited by 3,651
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Flexible Imputation of Missing Data
van Buuren, S. (2012) · doi:10.1201/b11826 · Cited by 2,022 · cited 3×
“For the results of Multiple imputation, λ̄, the average proportion of variation in Q attributable to missing data is shown as well (Van Buuren, 2012, p. 41).”
MethodThat BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,694
Missing-Data Adjustments in Large Surveys
Little, R. J. A. (1988) · Journal of Business and Economic Statistics · doi:10.1080/07350015.1988.10509663 · Cited by 1,109
Rubin, D. B. (1976) · Biometrika · doi:10.2307/2335739 · Cited by 946
Miscellanea. Small-sample degrees of freedom with multiple imputation
Barnard, J. (1999) · Biometrika · doi:10.1093/biomet/86.4.948 · Cited by 841
What Improves with Increased Missing Data Imputations?
Bodner, T. E. (2008) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510802339072 · Cited by 695
Multiple Imputation with Diagnostics (mi) inR: Opening Windows into the Black Box
Su, Y., Gelman, A., Hill, J., & Yajima, M. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i02 · Cited by 645
Adding Missing-Data-Relevant Variables to FIML-Based Structural Equation Models
Graham, J. A. (2003) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1001_4 · Cited by 621
Statistical Matching Using File Concatenation With Adjusted Weights and Multiple Imputations
Rubin, D. B. (1986) · Journal of Business and Economic Statistics · doi:10.1080/07350015.1986.10509497 · Cited by 564
Characteristics of infant child care: Factors contributing to positive caregiving
Vandell, D. L. (1996) · Early Childhood Research Quarterly · doi:10.1016/s0885-2006(96)90009-5 · Cited by 553
Multiple Imputation for Missing Data: Concepts and New Development
Yuan, Y. (2000) · Cited by 470
Hand, D. J., Daly, F., McConway, K., Lunn, D., & Ostrowski, E. (1994) · Springer eBooks · doi:10.1007/978-1-4899-7266-8 · Cited by 373
Designing Experiments and Analysing Data.
Morrey, G. H., Maxwell, S. E., & Delaney, H. D. (1991) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347533 · Cited by 370
Missing-Data Adjustments in Large Surveys
Little, R. J. A. (1988) · Journal of Business and Economic Statistics · doi:10.2307/1391878 · Cited by 286
Li, K. H., Raghunathan, T. E., & Rubin, D. B. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475152 · Cited by 246
Multiple Regression and the Analysis of Variance and Covariance
Lindley, D. V., & Edwards, A. L. (1986) · The Mathematical Gazette · doi:10.2307/3615797 · Cited by 219
Using Multivariate Data to Structure Developmental Change
McArdle, J. J., & Nesselroade, J. R. (2019) · Psychology Press eBooks · doi:10.4324/9781315792712-10 · Cited by 216
Giesbrecht, F. G., & Burns, J. C. (1985) · Biometrics · doi:10.2307/2530872 · Cited by 207
Li, K. H., Raghunathan, T. E., & Rubin, D. B. (1991) · Journal of the American Statistical Association · doi:10.2307/2290525 · Cited by 186
Bakermans‐Kranenburg, M. J., van IJzendoorn, M. H., & Kroonenberg, P. M. (2004) · Infant Behavior and Development · doi:10.1016/j.infbeh.2004.02.002 · Cited by 181
Self-citationGlucroft, B. I. (2001) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/106480460100900407 · Cited by 178
Statistical Matching Using File Concatenation with Adjusted Weights and Multiple Imputations
Rubin, D. B. (1986) · Journal of Business and Economic Statistics · doi:10.2307/1391390 · Cited by 121
Reiter, J. P. (2007) · Biometrika · doi:10.1093/biomet/asm028 · Cited by 79
Designing Experiments and Analyzing Data
(2004) · Technometrics · doi:10.1198/tech.2004.s810 · Cited by 56
[That BLUP is a Good Thing: The Estimation of Random Effects]: Rejoinder
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011933 · Cited by 45
Research works printed but not linked: 4
- Dunn , L. M. and Dunn , L. M. 1981 . Peabody Picture Test – Revised manual for Forms L and M , Circle Pines, MN : American Guidance Service .
- Snijders , T. and Bosker , R. 1999 . Multilevel analysis , London , UK : Sage .
- Winer , B. J. 1971 . Statistical principles in experimental designs, 2nd ed. , New York, NY : McGraw-Hill .
- Van Ginkel , J. R. and Kroonenberg , P. M. 2011, July . Multiple imputation and (repeated-measures) analysis of variance , Hong Kong : Presentation given at the 17th international meeting of the Psychometric Society .
Cited by
Sorted by citations
Rebutting Existing Misconceptions About Multiple Imputation as a Method for Handling Missing Data
van Ginkel, J. R., Linting, M., Rippe, R. C. A., & van der Voort, A. (2019) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1530680 · Cited by 553
“…are less user-friendly than the automatic pooling by SPSS. Additionally, the paper promoting the SPSS macro for pooling the results of ANOVA (Van Ginkel & Kroonenberg, 2014a) has been misquoted by many authors, suggesting that combination rules for ANOVA are either not available or too…”
MethodInfluentialIt's time: A meta-analysis on the self-control-deviance link
Vazsonyi, A. T., Mikuška, J., & Kelley, E. L. (2017) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2016.10.001 · Cited by 504
Solomon, R., Egeren, L. A. V., Mahoney, G. J., Huber, M. S. Q., & Zimmerman, P. (2014) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/dbp.0000000000000096 · Cited by 208
Electrical fingerprint of the amygdala guides neurofeedback training for stress resilience
Keynan, J. N., Cohen, A., Jackont, G., Green, N., Goldway, N., Davidov, A., Meir-Hasson, Y., Raz, G., Intrator, N., Fruchter, E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0484-3 · Cited by 158
Victor, S. E., Muehlenkamp, J. J., Hayes, N. A., Lengel, G. J., Styer, D. M., & Washburn, J. J. (2018) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2018.01.009 · Cited by 146
“48. van Ginkel JR, Kroonenberg PM.”
MethodInfluential
Metadata
- Authors
- van Ginkel, J. R., & Kroonenberg, P. M.
- Affiliations
- Leiden University
- Leiden University (NL)
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2014-01
- Volume
- 49
- Issue
- 1
- Pages
- 78-91
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- PMC
- PMC4029775
- OpenAlex
- W2155931297
- Cited by
- 152
- References
- 33
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 11 · 2023: 12 · 2022: 12 · 2021: 13 · 2020: 13 · 2019: 17 · 2018: 16 · 2017: 20 · 2016: 12 · 2015: 5 · 2014: 5
- FWCI
- 14.80
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Multivariate Behavioral Research (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Aging (R01AG008235)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- multiple imputation, analysis of variance, missing data, repeated measures ANOVA
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review