Analysis of Variance of Multiply Imputed Data

van Ginkel, Joost R.; Kroonenberg, Pieter M.

doi:10.1080/00273171.2013.855890

Cited by 152Statistical Methods and Bayesian InferenceStatistical Methods and ApplicationsMeta-analysis and systematic reviews

Analysis of Variance of Multiply Imputed Data

Open access

van Ginkel, Joost R., Kroonenberg, Pieter M.·2014·Multivariate Behavioral Research

DOI 10.1080/00273171.2013.855890PMC PMC4029775

Open this paper in CoChat — free account

Abstract

As a procedure for handling missing data, Multiple imputation consists of estimating the missing data multiple times to create several complete versions of an incomplete data set. All these data sets are analyzed by the same statistical procedure, and the results are pooled for interpretation. So far, no explicit rules for pooling F tests of (repeated-measures) analysis of variance have been defined. In this article we outline the appropriate procedure for the results of analysis of variance (ANOVA) for multiply imputed data sets. It involves both reformulation of the ANOVA model as a regression model using effect coding of the predictors and applying already existing combination rules for regression models. The proposed procedure is illustrated using 3 example data sets. The pooled results of these 3 examples provide plausible F and p values.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1080/00273171.2013.855890

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Missing values were handled by multivariate multiple imputation using Rubin's method.
“Missing values were handled by multivariate multiple imputation using Rubin’s method.26”
From Aerobic, resistance, or combined exercise training and cardiovascular risk profile in overweight or obese adults: the CardioRACE trial (2024) · cites this paper as [26]
No consensus was available on how to best pool F statistics.
“as no consensus on how to best pool F statistics was available [34].”
From An Internet-Based Cognitive Behavioral Therapy Program Adapted to Patients With Cardiovascular Disease and Depression: Randomized Controlled Trial (2019) · cites this paper as [34]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701 · see citing works
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,384 · see citing works
<b>mice</b>: Multivariate Imputation by Chained Equations in<i>R</i>
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · see citing works
Inference and missing data
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925 · see citing works
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473 · see citing works
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012 · see citing works
Multilevel analysis techniques and applications
Hox, J. J., Moerbeek, M., & van de Schoot, R. (2002) · Cited by 6,005 · see citing works
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627 · see citing works
Journal of Statistical Software
de Leeuw, J. (2009) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.10 · Cited by 3,608 · see citing works
Multilevel Analysis
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419 · see citing works
Flexible Imputation of Missing Data
van Buuren, S. (2012) · doi:10.1201/b11826 · Cited by 2,022 · cited 3× · see citing works
“For the results of Multiple imputation, λ̄, the average proportion of variation in Q attributable to missing data is shown as well (Van Buuren, 2012, p. 41).”
Method
That BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,694 · see citing works
Missing-Data Adjustments in Large Surveys
Little, R. J. A. (1988) · Journal of Business and Economic Statistics · doi:10.1080/07350015.1988.10509663 · Cited by 1,109 · see citing works
Inference and Missing Data
Rubin, D. B. (1976) · Biometrika · doi:10.2307/2335739 · Cited by 946 · see citing works
Miscellanea. Small-sample degrees of freedom with multiple imputation
Barnard, J. (1999) · Biometrika · doi:10.1093/biomet/86.4.948 · Cited by 841 · see citing works
What Improves with Increased Missing Data Imputations?
Bodner, T. E. (2008) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510802339072 · Cited by 695 · see citing works
Multiple Imputation with Diagnostics (mi) inR: Opening Windows into the Black Box
Su, Y., Gelman, A., Hill, J., & Yajima, M. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i02 · Cited by 645 · see citing works
Adding Missing-Data-Relevant Variables to FIML-Based Structural Equation Models
Graham, J. A. (2003) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1001_4 · Cited by 621 · see citing works
Statistical Matching Using File Concatenation With Adjusted Weights and Multiple Imputations
Rubin, D. B. (1986) · Journal of Business and Economic Statistics · doi:10.1080/07350015.1986.10509497 · Cited by 554 · see citing works
Characteristics of infant child care: Factors contributing to positive caregiving
Vandell, D. L. (1996) · Early Childhood Research Quarterly · doi:10.1016/s0885-2006(96)90009-5 · Cited by 553 · see citing works
Multiple Imputation for Missing Data: Concepts and New Development
Yuan, Y. (2000) · Cited by 470 · see citing works
A Handbook of Small Data Sets
Hand, D. J., Daly, F., McConway, K., Lunn, D., & Ostrowski, E. (1994) · Springer eBooks · doi:10.1007/978-1-4899-7266-8 · Cited by 373 · see citing works
Designing Experiments and Analysing Data.
Morrey, G. H., Maxwell, S. E., & Delaney, H. D. (1991) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347533 · Cited by 370 · see citing works
Missing-Data Adjustments in Large Surveys
Little, R. J. A. (1988) · Journal of Business and Economic Statistics · doi:10.2307/1391878 · Cited by 286 · see citing works
Large-Sample Significance Levels from Multiply Imputed Data Using Moment-Based Statistics and anFReference Distribution
Li, K. H., Raghunathan, T. E., & Rubin, D. B. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475152 · Cited by 246 · see citing works
Multiple Regression and the Analysis of Variance and Covariance
Lindley, D. V., & Edwards, A. L. (1986) · The Mathematical Gazette · doi:10.2307/3615797 · Cited by 219 · see citing works
Using Multivariate Data to Structure Developmental Change
McArdle, J. J., & Nesselroade, J. R. (2019) · Psychology Press eBooks · doi:10.4324/9781315792712-10 · Cited by 216 · see citing works
Two-Stage Analysis Based on a Mixed Model: Large-Sample Asymptotic Theory and Small-Sample Simulation Results
Giesbrecht, F. G., & Burns, J. C. (1985) · Biometrics · doi:10.2307/2530872 · Cited by 207 · see citing works
Large-Sample Significance Levels from Multiply Imputed Data Using Moment-Based Statistics and an F Reference Distribution
Li, K. H., Raghunathan, T. E., & Rubin, D. B. (1991) · Journal of the American Statistical Association · doi:10.2307/2290525 · Cited by 186 · see citing works
Software: SPSS for Windows SPSS Inc. 233 S. Wacker Dr., 11th Floor Chicago, IL 60606 (312) 651-3000 www.spss.com
Glucroft, B. I. (2001) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/106480460100900407 · Cited by 178 · see citing works
Differences in attachment security between African-American and white children: ethnicity or socio-economic status?
Bakermans‐Kranenburg, M. J., van IJzendoorn, M. H., & Kroonenberg, P. M. (2004) · Infant Behavior and Development · doi:10.1016/j.infbeh.2004.02.002 · Cited by 163 · see citing works
Self-citation
Statistical Matching Using File Concatenation with Adjusted Weights and Multiple Imputations
Rubin, D. B. (1986) · Journal of Business and Economic Statistics · doi:10.2307/1391390 · Cited by 121 · see citing works
Small-sample degrees of freedom for multi-component significance tests with multiple imputation for missing data
Reiter, J. P. (2007) · Biometrika · doi:10.1093/biomet/asm028 · Cited by 79 · see citing works
Designing Experiments and Analyzing Data
(2004) · Technometrics · doi:10.1198/tech.2004.s810 · Cited by 56 · see citing works
[That BLUP is a Good Thing: The Estimation of Random Effects]: Rejoinder
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011933 · Cited by 45 · see citing works

Flagged first, then by citations

Research works printed but not linked: 1

Winer BJ Statistical principles in experimental designs 1971 2nd ed New York McGraw-Hill

Sorted by citations

Rebutting Existing Misconceptions About Multiple Imputation as a Method for Handling Missing Data
van Ginkel, J. R., Linting, M., Rippe, R. C. A., & van der Voort, A. (2019) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1530680 · Cited by 553 · see citing works
It's time: A meta-analysis on the self-control-deviance link
Vazsonyi, A. T., Mikuška, J., & Kelley, E. L. (2017) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2016.10.001 · Cited by 504 · see citing works
PLAY Project Home Consultation Intervention Program for Young Children With Autism Spectrum Disorders
Solomon, R., Egeren, L. A. V., Mahoney, G. J., Huber, M. S. Q., & Zimmerman, P. (2014) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/dbp.0000000000000096 · Cited by 206 · see citing works
Electrical fingerprint of the amygdala guides neurofeedback training for stress resilience
Keynan, J. N., Cohen, A., Jackont, G., Green, N., Goldway, N., Davidov, A., Meir-Hasson, Y., Raz, G., Intrator, N., Fruchter, E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0484-3 · Cited by 148 · see citing works
Characterizing gender differences in nonsuicidal self-injury: Evidence from a large clinical sample of adolescents and adults
Victor, S. E., Muehlenkamp, J. J., Hayes, N. A., Lengel, G. J., Styer, D. M., & Washburn, J. J. (2018) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2018.01.009 · Cited by 146 · see citing works
The contemporary face of gender differences and similarities in depression throughout adolescence: Development and chronicity
Salk, R. H., Petersen, J. L., Abramson, L. Y., & Hyde, J. S. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.03.071 · Cited by 134 · see citing works
“…we should first test the between-subjects effect of gender in a repeated measures MANOVA; however, formulas for pooling F-tests of analysis of variance for multiply imputed data sets (which would be necessary with our longitudinal data) are still in development (van Ginkel & Kroonenberg, 2014).”
Method
Rethinking interhemispheric imbalance as a target for stroke neurorehabilitation
Xu, J., Branscheidt, M., Schambra, H. M., Steiner, L., Widmer, M., Diedrichsen, J., Goldsmith, J., Lindquist, M. A., Kitago, T., Luft, A. R., et al. (2019) · Annals of Neurology · doi:10.1002/ana.25452 · Cited by 131 · see citing works
Music Therapy Enhances Executive Functions and Prefrontal Structural Neuroplasticity after Traumatic Brain Injury: Evidence from a Randomized Controlled Trial
Siponkoski, S., Martínez‐Molina, N., Kuusela, L., Laitinen, S., Holma, M., Ahlfors, M., Jordan-Kilkki, P., Ala-Kauhaluoma, K., Melkas, S., Pekkola, J., et al. (2019) · Journal of Neurotrauma · doi:10.1089/neu.2019.6413 · Cited by 125 · see citing works
A randomized controlled trial comparing two cognitive-behavioral programs for adolescent girls with subclinical depression: A school-based program (Op Volle Kracht) and a computerized program (SPARX)
Poppelaars, M., Tak, Y. R., Lichtwarck‐Aschoff, A., Engels, R. C. M. E., Lobel, A., Merry, S., Lucassen, M. F. G., & Granic, I. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.03.005 · Cited by 114 · see citing works
An Internet-Based Intervention for Chronic Pain
Lin, J., Paganini, S., Sander, L., Lüking, M., Ebert, D. D., Buhrman, M., Andersson, G., & Baumeister, H. (2017) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2017.0681 · Cited by 110 · see citing works
Effects of Meditation versus Music Listening on Perceived Stress, Mood, Sleep, and Quality of Life in Adults with Early Memory Loss: A Pilot Randomized Controlled Trial
Innes, K. E., Selfe, T. K., Khalsa, D. S., & Kandati, S. (2016) · Journal of Alzheimer s Disease · doi:10.3233/jad-151106 · Cited by 108 · see citing works
Analysing data from the psycholinguistic visual-world paradigm: Comparison of different analysis methods
Ito, A., & Knoeferle, P. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01969-3 · Cited by 106 · see citing works
Methods for significance testing of categorical covariates in logistic regression models after multiple imputation: power and applicability analysis
Eekhout, I. E., van de Wiel, M. A., & Heymans, M. W. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0404-7 · Cited by 106 · see citing works
Overcoming Disembodiment: The Effect of Movement Therapy on Negative Symptoms in Schizophrenia—A Multicenter Randomized Controlled Trial
Martin, L. A. L., Koch, S. C., Hirjak, D., & Fuchs, T. A. E. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00483 · Cited by 104 · see citing works
A Pilot RCT of Psychodynamic Group Art Therapy for Patients in Acute Psychotic Episodes: Feasibility, Impact on Symptoms and Mentalising Capacity
Montag, C., Haase, L., Seidel, D., Bayerl, M., Gallinat, J., Herrmann, U., & Dannecker, K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0112348 · Cited by 97 · see citing works
Major depressive disorder with melancholia displays robust alterations in resting state heart rate and its variability: implications for future morbidity and mortality
Kemp, A. H., Quintana, D. S., Quinn, C. R., Hopkinson, P., & Harris, A. W. F. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01387 · Cited by 94 · see citing works
Meditation and Music Improve Memory and Cognitive Function in Adults with Subjective Cognitive Decline: A Pilot Randomized Controlled Trial
Innes, K. E., Selfe, T. K., Khalsa, D. S., & Kandati, S. (2017) · Journal of Alzheimer s Disease · doi:10.3233/jad-160867 · Cited by 91 · see citing works
Aerobic, resistance, or combined exercise training and cardiovascular risk profile in overweight or obese adults: the CardioRACE trial
Lee, D.-C., Brellenthin, A. G., Lanningham-Foster, L. M., Kohut, M. L., & Li, Y. (2024) · European Heart Journal · doi:10.1093/eurheartj/ehad827 · Cited by 89 · see citing works
“26 We used linear mixed effects models with repeated measures including both baseline and follow-up data.”
Method
An Internet-Based Cognitive Behavioral Therapy Program Adapted to Patients With Cardiovascular Disease and Depression: Randomized Controlled Trial
Johansson, P., Westas, M., Andersson, G., Alehagen, U., Broström, A., Jaarsma, T., Mourad, G., & Lundgren, J. (2019) · JMIR Mental Health · doi:10.2196/14648 · Cited by 77 · see citing works
Significance Tests and Estimates for R2 for Multiple Regression in Multiply Imputed Datasets: A Cautionary Note on Earlier Findings, and Alternative Solutions
van Ginkel, J. R. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1540967 · Cited by 73 · see citing works
A Randomized-Controlled Trial of the Triple P-Positive Parenting Program Seminar Series with Indonesian Parents
Sumargi, A. M., Sofronoff, K., & Morawska, A. (2014) · Child Psychiatry & Human Development · doi:10.1007/s10578-014-0517-8 · Cited by 69 · see citing works
Comorbidity of Arithmetic and Reading Disorder
Raddatz, J., Kuhn, J., Holling, H., Moll, K., & Dobel, C. (2016) · Journal of Learning Disabilities · doi:10.1177/0022219415620899 · Cited by 70 · see citing works
Cognitive bias modification and CBT as early interventions for adolescent social and test anxiety: two-year follow-up of a randomized controlled trial
de Hullu, E., Sportel, B. E., Nauta, M. H., & de Jong, P. J. (2017) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2016.11.011 · Cited by 63 · see citing works
Teaching College in the Time of COVID-19: Gender and Race Differences in Faculty Emotional Labor
Berheide, C. W., Carpenter, M. A., & Cotter, D. A. (2022) · Sex Roles · doi:10.1007/s11199-021-01271-0 · Cited by 65 · see citing works
Exposure to polychlorinated biphenyls and organochlorine pesticides and risk of dementia, Alzheimer’s disease and cognitive decline in an older population: a prospective analysis from the Canadian Study of Health and Aging
Medehouenou, T. C. M., Ayotte, P., Carmichael, P., Kröger, E., Verreault, R., Lindsay, J., Dewailly, É., Tyas, S. L., Bureau, A., & Laurin, D. (2019) · Environmental Health · doi:10.1186/s12940-019-0494-2 · Cited by 63 · see citing works
Effects of a Brief Mindfulness Curriculum on Self-reported Executive Functioning and Emotion Regulation in Hong Kong Adolescents
Lam, K. N., & Seiden, D. Y. (2019) · Mindfulness · doi:10.1007/s12671-019-01257-w · Cited by 63 · see citing works
A Randomized Controlled Trial in Routine Clinical Practice Comparing Acceptance and Commitment Therapy with Cognitive Behavioral Therapy for the Treatment of Major Depressive Disorder
A-Tjak, J. G. L., Morina, N., Topper, M., & Emmelkamp, P. M. G. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000486807 · Cited by 61 · see citing works
Children with Sexual Behavior Problems: Clinical Characteristics and Relationship to Child Maltreatment
Allen, B. (2016) · Child Psychiatry & Human Development · doi:10.1007/s10578-016-0633-8 · Cited by 60 · see citing works
Cognitive effects of music and dance training in children.
LaPlume, A. A., & Wiseheart, M. (2018) · Archives of Scientific Psychology · doi:10.1037/arc0000048 · Cited by 57 · see citing works
Dialectical behavior therapy self‐help for binge‐eating disorder: A randomized controlled study
Carter, J. C., Kenny, T. E., Singleton, C., Wijk, M. V., & Heath, O. J. (2019) · International Journal of Eating Disorders · doi:10.1002/eat.23208 · Cited by 55 · see citing works
Discrimination Matters: Relations of Perceived Discrimination to Student Mental Health
Weeks, M. R., & Sullivan, A. L. (2019) · School Mental Health · doi:10.1007/s12310-019-09309-1 · Cited by 53 · see citing works
Effects of Dance Movement Therapy on Adult Patients with Autism Spectrum Disorder: A Randomized Controlled Trial
Mastrominico, A., Fuchs, T. A. E., Manders, E. J., Steffinger, L., Hirjak, D., Sieber, M., Thomas, E., Holzinger, A., Konrad, A., Bopp, N., et al. (2018) · Behavioral Sciences · doi:10.3390/bs8070061 · Cited by 52 · see citing works
Differences in university students’ motivation between a required and an elective physical activity education policy
Kim, M. S., & Cardinal, B. J. (2018) · Journal of American College Health · doi:10.1080/07448481.2018.1469501 · Cited by 47 · see citing works
Are risk factors for preterm and early-term live singleton birth the same? A population-based study in France
Delnord, M., Blondel, B., Prunet, C., & Zeitlin, J. A. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018745 · Cited by 44 · see citing works
Key Aspects of Prognostic Model Development and Interpretation From a Clinical Perspective
Hoesseini, A., van Leeuwen, N., Sewnaik, A., Steyerberg, E. W., de Jong, R. J. B., Lingsma, H. F., & Offerman, M. P. J. (2021) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2021.3505 · Cited by 42 · see citing works
Adaptive meta-learning extreme learning machine with golden eagle optimization and logistic map for forecasting the incomplete data of solar irradiance
Boriratrit, S., Fuangfoo, P., Srithapon, C., & Chatthaworn, R. (2023) · Energy and AI · doi:10.1016/j.egyai.2023.100243 · Cited by 41 · see citing works
Effects of Mantra Meditation versus Music Listening on Knee Pain, Function, and Related Outcomes in Older Adults with Knee Osteoarthritis: An Exploratory Randomized Clinical Trial (RCT)
Innes, K. E., Selfe, T. K., Kandati, S., Wen, S., & Huysmans, Z. (2018) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2018/7683897 · Cited by 41 · see citing works
A Randomized Controlled Trial of Group Triple P With Chinese Parents in Mainland China
Guo, M., Morawska, A., & Sanders, M. R. (2016) · Behavior Modification · doi:10.1177/0145445516644221 · Cited by 38 · see citing works
A randomized clinical trial of motivational enhancement therapy for alcohol problems in partner violent men
Murphy, C. M., Ting, L. A., Jordan, L. C., Musser, P. H., Winters, J. J., Poole, G. M., & Pitts, S. C. (2018) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2018.03.004 · Cited by 37 · see citing works
Lay-worker Delivered Home Visiting Promotes Early Childhood Development and Reduces Violence in Rwanda: A Randomized Pilot
Barnhart, D. A., Farrar, J., Murray, S. M., Brennan, R. T., Antonaccio, C. M., Sezibera, V., Ingabire, C., Godfroid, K., Bazubagira, S. M., Uwimana, O., et al. (2020) · Journal of Child and Family Studies · doi:10.1007/s10826-020-01709-1 · Cited by 34 · see citing works
Effects of a 12-week yoga versus a 12-week educational film intervention on symptoms of restless legs syndrome and related outcomes: an exploratory randomized controlled trial
Innes, K. E., Selfe, T. K., Montgomery, C., Hollingshead, N. A., Huysmans, Z., Srinivasan, R., Wen, S., Hausmann, M. J., Sherman, K. J., & Klatt, M. D. (2020) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.8134 · Cited by 32 · see citing works
Dentoskeletal comparison of miniscrew-anchored maxillary protraction with hybrid and conventional hyrax expanders: A randomized clinical trial
Miranda, F., Bastos, J. C. D. C., dos Santos, A. M., Janson, G., Lauris, J. R. P., & Garib, D. G. (2021) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2021.02.017 · Cited by 32 · see citing works
A clinical effectiveness trial comparing ACT and CBT for inpatients with depressive and mixed mental disorders
Samaan, M., Diefenbacher, A., Schade, C., Dambacher, C., Pontow, I.-M., Pakenham, K., & Fydrich, T. (2021) · Psychotherapy Research · doi:10.1080/10503307.2020.1802080 · Cited by 29 · see citing works
“This enables use of the multiple imputation technique for missing data estimation with the ITT sample (van Ginkel & Kroonenberg, 2014).”
Method
Revisiting the immigrant paradox: Suicidal ideations and suicide attempts among immigrant and non‐immigrant adolescents
Vazsonyi, A. T., Mikuška, J., & Gaššová, Z. (2017) · Journal of Adolescence · doi:10.1016/j.adolescence.2017.05.008 · Cited by 29 · see citing works
Impairments in cognitive empathy and alexithymia occur independently of executive functioning in college students with autism
Ziermans, T., de Bruijn, Y., Dijkhuis, R., Staal, W., & Swaab, H. (2019) · Autism · doi:10.1177/1362361318817716 · Cited by 28 · see citing works
Dissecting the Genetic Architecture of Shoot Growth in Carrot ( Daucus carota L.) Using a Diallel Mating Design
Turner, S., Maurizio, P. L., Valdar, W. S. J., Yandell, B. S., & Simon, P. W. (2017) · G3 Genes Genomes Genetics · doi:10.1534/g3.117.300235 · Cited by 25 · see citing works
The psychological effects of physical exercise: A controlled study of the placebo effect
Arbinaga, F., Ozcorta, E. J. F., Buñuel, P. S.-L., & Carmona, J. (2018) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12482 · Cited by 24 · see citing works
Thought-shape fusion in young healthy females appears after vivid imagination of thin ideals.
Wyssen, A., Coelho, J. S., Wilhelm, P., Zimmermann, G., & Munsch, S. (2016) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2016.03.010 · Cited by 25 · see citing works
What If I Appear Boring, Anxious, or Unattractive? Validation and Treatment Sensitivity of the Negative Self Portrayal Scale in Clinical Samples
Moscovitch, D. A., Rowa, K., Paulitzki, J. R., Antony, M. M., & McCabe, R. E. (2015) · Cognitive Therapy and Research · doi:10.1007/s10608-014-9645-5 · Cited by 22 · see citing works
A psycho‐oncological online intervention supporting partners of patients with cancer (PartnerCARE): Results from a randomized controlled feasibility trial
Bodschwinna, D., Lorenz, I., Bauereiß, N., Gündel, H., Baumeister, H., & Hönig, K. (2022) · Psycho-Oncology · doi:10.1002/pon.5917 · Cited by 20 · see citing works
Implications of a “Null” Randomized Controlled Trial of Mindfulness and Compassion Interventions in Healthy Adults
Kaplan, D. M., Mehl, M. R., Pace, T. W. W., Negi, L. T., Silva, B. O.-D., Dodson‐Lavelle, B., Sivilli, T., Williams, A., Comstock, T., Price, B. E., et al. (2022) · Mindfulness · doi:10.1007/s12671-022-01861-3 · Cited by 18 · see citing works
Segregation paradox? School racial/ethnic and socioeconomic composition and racial/ethnic differences in engagement
Ackert, E. (2017) · Social Science Research · doi:10.1016/j.ssresearch.2017.10.010 · Cited by 19 · see citing works
The professional student program for educational resilience: Enhancing momentary engagement in classwork
Torsney, B. M., & Symonds, J. E. (2019) · The Journal of Educational Research · doi:10.1080/00220671.2019.1687414 · Cited by 20 · see citing works
Selective vs Routine Cholangiography Across a Health Care Enterprise
Gross, A. R., Said, S. A., Wehrle, C. J., Hong, H., Quick, J. D., Larson, S. L., Hossain, M. S., Naffouje, S. A., Walsh, R. M., & Augustin, T. (2024) · JAMA Surgery · doi:10.1001/jamasurg.2024.5216 · Cited by 18 · see citing works
Retracted
Priorities for Mediterranean marine turtle conservation and management in the face of climate change
Mazaris, A. D., Dimitriadis, C., Papazekou, M., Schofield, G., Doxa, A., Chatzimentor, A., Türkozan, O., Katsanevakis, S., Lioliou, A., Abalo‐Morla, S., et al. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.117805 · Cited by 18 · see citing works
A cohort study comparing the effects of medical cannabis for anxiety patients with and without comorbid sleep disturbance
Murphy, M., Erridge, S., Holvey, C., Coomber, R., Rucker, J., & Sodergren, M. H. (2023) · Neuropsychopharmacology Reports · doi:10.1002/npr2.12407 · Cited by 17 · see citing works
Delivering Mindfulness-Based Interventions for Insomnia, Pain, and Dysfunctional Eating Through a Text Messaging App: Three Randomized Controlled Trials Investigating the Effectiveness and Mediating Mechanisms.
Li, A. C., Wong, K. K., Chio, F. H., Mak, W. W., & Poon, L. W. (2022) · Journal of Medical Internet Research · doi:10.2196/30073 · Cited by 17 · see citing works
Incorporating a Usual Care Comparator into a Study of Meditation and Music Listening for Older Adults with Subjective Cognitive Decline: A Randomized Feasibility Trial
Innes, K. E., Montgomery, C., Selfe, T. K., Wen, S., Khalsa, D. S., & Flick, M. (2021) · Journal of Alzheimer s Disease Reports · doi:10.3233/adr-200249 · Cited by 17 · see citing works
A Longitudinal Investigation of the Ethnic and National Identities of Children With Migration Background in Germany
Froehlich, L., Martiny, S. E., & Deaux, K. (2019) · Social Psychology · doi:10.1027/1864-9335/a000403 · Cited by 19 · see citing works
Psoriasis Characteristics for the Early Detection of Psoriatic Arthritis
Belman, S., Walsh, J. A., Carroll, C., Milliken, M., Haaland, B. A., Duffin, K. C., Krueger, G. G., & Feng, B. (2021) · The Journal of Rheumatology · doi:10.3899/jrheum.201123 · Cited by 17 · see citing works
Missing Data and Multiple Imputation in the Context of Multivariate Analysis of Variance
Finch, W. H. (2015) · The Journal of Experimental Education · doi:10.1080/00220973.2015.1011594 · Cited by 17 · see citing works
Next generation crosscutting themes: Factors that contribute to students' understandings of size and scale
Chesnutt, K. M., Jones, M. G., Hite, R. L., Cayton, E. M., Ennes, M. E., Corin, E. N., & Childers, G. M. (2018) · Journal of Research in Science Teaching · doi:10.1002/tea.21443 · Cited by 18 · see citing works
Recall of Affective Responses to Exercise: Examining the Influence of Intensity and Time
Sławińska, M., & Davis, P. A. (2020) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2020.573525 · Cited by 17 · see citing works
A Latent Class Analysis of Gambling Activity Patterns in a Canadian University Sample of Emerging Adults: Socio-demographic, Motivational, and Mental Health Correlates
Sanscartier, M. D., Edgerton, J. D., & Roberts, L. W. (2017) · Journal of Gambling Studies · doi:10.1007/s10899-017-9734-y · Cited by 18 · see citing works
Cost‐effectiveness of three internet‐based interventions for eating disorders: A randomized controlled trial
Rohrbach, P. J., Dingemans, A. E., van Furth, E. F., Spinhoven, P., van Ginkel, J. R., Bauer, S., & Marle, M. E. V. D. A. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23763 · Cited by 15 · see citing works
Convergence of Parent Report and Child Behavior using the Dyadic Parent-Child Interaction Coding System (DPICS)
Cotter, A., & Brestan‐Knight, E. (2020) · Journal of Child and Family Studies · doi:10.1007/s10826-020-01813-2 · Cited by 14 · see citing works
A longitudinal examination of the relations between motivation, math achievement, and STEM career aspirations among Black students
Adler, R. M., Rittle‐Johnson, B., Hickendorff, M., & Durkin, K. L. (2023) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2023.102240 · Cited by 15 · see citing works
Boys have not caught up, family influences still continue: Influences on executive functioning and behavioral self‐regulation in elementary students in Germany
Gunzenhauser, C., Saalbach, H., & von Suchodoletz, A. (2017) · PsyCh Journal · doi:10.1002/pchj.180 · Cited by 13 · see citing works
Effect of mindfulness-based intervention on endurance performance under pressure and performance-relevant mental attributes, an interdisciplinary perspective: Protocol for a Mindfulness-Based Peak Performance (MBPP) trial
Chang, Y., Gill, D. L., Creswell, J. D., Chen, D.-T., Lin, C., Chu, C., & Nien, J. (2023) · Contemporary Clinical Trials · doi:10.1016/j.cct.2023.107175 · Cited by 12 · see citing works
Web-Based Intervention Effects on Mild Cognitive Impairment Based on Apolipoprotein E Genotype: Quasi-Experimental Study
Tsolaki, A., Tsolaki, M., Pandria, N., Lazarou, E., Gkatzima, O., Zilidou, V. I., Karagianni, M. A., Iakovidou‐Kritsi, Z., Kimiskidis, V. Κ., & Bamidis, P. D. (2019) · Journal of Medical Internet Research · doi:10.2196/14617 · Cited by 12 · see citing works
The relationship between social norms and sexual risk-reduction intentions and behavior among men who have sex with men: Findings from an eHealth intervention.
Basaran, A. M. B., Christensen, J. L., Miller, L. C., Appleby, P. R., & Read, S. J. (2019) · Psychology of Addictive Behaviors · doi:10.1037/adb0000467 · Cited by 12 · see citing works
Determinants of Non-paid Task Division in Gay-, Lesbian-, and Heterosexual-Parent Families With Infants Conceived Using Artificial Reproductive Techniques
Gelderen, L. V. R., Ellis‐Davies, K., Huijzer-Engbrenghof, M., Jorgensen, T. D., Gross, M., Winstanley, A., Rubio, B., Vecho, O., Lamb, M. E., & Bos, H. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00914 · Cited by 12 · see citing works
A Nonparametric, Multiple Imputation-Based Method for the Retrospective Integration of Data Sets
Carrig, M. M., Manrique‐Vallier, D., Ranby, K. W., Reiter, J. P., & Hoyle, R. H. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2015.1022641 · Cited by 12 · see citing works
The christian religious education teachers’ attitudes toward the five-stage lesson plan framework in Kenya: A gender-based analysis
Saoke, V. O., Musafiri, C. M., Ndwiga, Z. N., & Githaiga, P. W. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e19104 · Cited by 10 · see citing works
Maternal exposure to legacy PFAS compounds PFOA and PFOS is associated with disrupted cytokine homeostasis in neonates: The Upstate KIDS study (2008–2010)
Jones, L., Ghassabian, A., Yeung, E. H., Mendola, P., Kannan, K., & Bell, E. M. (2025) · Environment International · doi:10.1016/j.envint.2025.109288 · Cited by 10 · see citing works
Mental Health, Behavior Change Skills, and Eating Behaviors in Postpartum Women
Yu, Y. H., Ma, Q., Fernandez, I. D., & Groth, S. W. (2021) · Western Journal of Nursing Research · doi:10.1177/01939459211021625 · Cited by 10 · see citing works
Language acquisition of early sequentially bilingual children is moderated by short‐term memory for order in developmental language disorder: Findings from the HelSLI study
Lahti‐Nuuttila, P., Laasonen, M. R., Smolander, S., Kunnari, S., Arkkila, E. P., & Service, E. (2021) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12635 · Cited by 10 · see citing works
Accuracy of Metabolic Cost Predictive Equations During Military Load Carriage
Vine, C. A. J., Coakley, S. L., Blacker, S. D., Doherty, J., Hale, B. J., Walker, E. F., Rue, C. A., Lee, B. J., Flood, T. R., Knapik, J. J., et al. (2020) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000003644 · Cited by 10 · see citing works
Does curve pattern impact on the effects of physiotherapeutic scoliosis specific exercises on Cobb angles of participants with adolescent idiopathic scoliosis: A prospective clinical trial with two years follow-up
Fan, Y., To, M. K.-T., Yeung, E., Wu, J., He, R. X., Xu, Z., Zhang, R., Li, G., Cheung, K., & Cheung, J. P. Y. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245829 · Cited by 10 · see citing works
Exposure to perfluoroalkyl substances and neonatal immunoglobulin profiles in the upstate KIDS study (2008–2010)
Jones, L., Ghassabian, A., Lawrence, D. A., Sundaram, R., Yeung, E. H., Kannan, K., & Bell, E. M. (2022) · Environmental Pollution · doi:10.1016/j.envpol.2022.119656 · Cited by 10 · see citing works
Using an ideal observer analysis to investigate the visual perceptual efficiency of individuals with a history of non-suicidal self-injury when identifying emotional expressions
Ziebell, L., Collin, C. A., Rainville, S. J. M., Mazalu, M., & Weippert, M. V. (2020) · PLoS ONE · doi:10.1371/journal.pone.0227019 · Cited by 10 · see citing works
Can 3 mg·kg−1 of Caffeine Be Used as An Effective Nutritional Supplement to Enhance the Effects of Resistance Training in Rugby Union Players?
Tamilio, R. A., Clarke, N. D., Duncan, M. J., Morris, R. O., Grgić, J., & Tallis, J. A. (2021) · Nutrients · doi:10.3390/nu13103367 · Cited by 9 · see citing works
Extrapulmonary symptoms of patients with asthma treated in specialist pulmonary care
Salsman, M. L., Nordberg, H. O., Wïttchen, H., Klotsche, J., Mühlig, S., Riedel, O., & Ritz, T. (2021) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2021.110538 · Cited by 9 · see citing works
Handling missing data in longitudinal clinical trials: three examples from the pediatric psychology literature
Peugh, J., & Mara, C. A. (2024) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsae070 · Cited by 8 · see citing works
Psychological distress and symptom-related burnout in asthma during the COVID-19 pandemic
Salsman, M. L., Nordberg, H. O., Howell, J., Berthet-Miron, M. M., Rosenfield, D., & Ritz, T. (2023) · Journal of Behavioral Medicine · doi:10.1007/s10865-023-00412-y · Cited by 10 · see citing works
How Do You Like Your Forgiveness? Communication Style Preferences and Effects
Merolla, A. J., Zhang, S., McCullough, J. L., & Sun, S. (2017) · Communication Studies · doi:10.1080/10510974.2017.1377743 · Cited by 8 · see citing works
Short-Term Memory for Serial Order Moderates Aspects of Language Acquisition in Children With Developmental Language Disorder: Findings From the HelSLI Study
Lahti‐Nuuttila, P., Service, E., Smolander, S., Kunnari, S., Arkkila, E. P., & Laasonen, M. R. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.608069 · Cited by 8 · see citing works
Corresponding Changes in Sleep and Discrimination: A Three-year Longitudinal Study Among Ethnically/Racially Diverse Adolescents
Lorenzo, K., Xie, M., Cham, H., El‐Sheikh, M., & Yip, T. (2024) · Journal of Youth and Adolescence · doi:10.1007/s10964-024-02086-4 · Cited by 7 · see citing works
Boys have caught up, family influences still continue: Influences on executive functioning and behavioral self‐regulation in elementary students in Germany
Gunzenhauser, C., Saalbach, H., & von Suchodoletz, A. (2017) · PsyCh Journal · doi:10.1002/pchj.157 · Cited by 7 · see citing works
Retracted
Understanding the perceived business obstacles and determinants of credit adoption by textile firms: evidences from World Bank’s enterprises survey
Singh, S., Amini, M., Jamshed, M., Sharma, H. P., & Khan, W. (2023) · Research Journal of Textile and Apparel · doi:10.1108/rjta-12-2022-0155 · Cited by 7 · see citing works
From Serodiscordant to Magnetic: The Feasibility and Acceptability of a Pilot Psychoeducational Group Intervention Designed to Improve Relationship Quality
Eaton, A. D., Cattaneo, J., Watchorn, J. M., Bilbao-Joseph, C., Bowler, S., Hazelton, M., Myslik, J., Ross, A., & Chambers, L. A. (2017) · Social Work With Groups · doi:10.1080/01609513.2017.1369922 · Cited by 7 · see citing works
Effectiveness of a numeracy intelligent tutoring system in kindergarten: A conceptual replication
Grimes, K. R., Park, S., McClelland, A. M., Park, J., Lee, Y. R., Nozari, M., Umer, Z., Zaparolli, B., & Bryant, D. P. (2021) · Journal of Numerical Cognition · doi:10.5964/jnc.6931 · Cited by 9 · see citing works
The Efficacy of a Group Program Integrating Compassionate Mind Training with Cognitive Behavioral Therapy for College Students With Test Anxiety in Mainland China
Guo, M., Liu, A., Wang, X., & Liu, Y. (2024) · Mindfulness · doi:10.1007/s12671-024-02342-5 · Cited by 6 · see citing works
Evaluation of multiple-imputation procedures for three-mode component models
van Ginkel, J. R., & Kroonenberg, P. M. (2017) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2017.1355368 · Cited by 6 · see citing works
Self-citation
Outcomes of In Situ Training for Disclosure as a Standalone and a Booster to a Child Protective Behaviors Education Program
White, C., Shanley, D. C., Zimmer‐Gembeck, M. J., Walsh, K., Hawkins, R. M. F., & Lines, K. (2018) · Child Maltreatment · doi:10.1177/1077559518816877 · Cited by 6 · see citing works
COVID-stressed schools struggled to teach mathematics
Lange‐Küttner, C. (2024) · Acta Psychologica · doi:10.1016/j.actpsy.2024.104174 · Cited by 6 · see citing works
Imputation and Missing Data
Momeni, A., Pincus, M. R., & Libien, J. M. (2017) · Springer eBooks · doi:10.1007/978-3-319-60543-2_8 · Cited by 6 · see citing works
Healthy Start Home Visiting Program—School-Based Model: Cluster Randomized Controlled Trial
Leung, C., Tsang, S., Heung, K., & Tam, M. (2018) · Research on Social Work Practice · doi:10.1177/1049731518786578 · Cited by 6 · see citing works
The perceived adultism scale: Initial validation of an instrument measuring youth experiences of age-based oppression
Hall, S. F., & 4theRecord Research Team (2025) · Applied Developmental Science · doi:10.1080/10888691.2024.2435378 · Cited by 5 · see citing works
Imputação de dados na análise de variância em experimentos no Delineamento Inteiramente Casualizado
Stochero, E. L. M., Jacobi, L. F., & Lúcio, A. D. (2020) · Ciência e Natura · doi:10.5902/2179460x40447 · Cited by 5 · see citing works

Pooling ANOVA Results From Multiply Imputed Datasets
Grund, S., Lüdtke, O., & Robitzsch, A. (2016) · Methodology · doi:10.1027/1614-2241/a000111 · Cited by 58 · see citing works
Statistical Inference for Chi-square Statistics or F-Statistics Based on Multiple ImputationPreprint
Wang, B., Fang, Y., & Jin, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.10812
Mixed model variance adjustments when missing values are multiply imputed
Chakraborty, H. (2013) · Journal of Medical Statistics and Informatics · doi:10.7243/2053-7662-1-2
Significance Tests and Estimates for R2 for Multiple Regression in Multiply Imputed Datasets: A Cautionary Note on Earlier Findings, and Alternative Solutions
van Ginkel, J. R. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1540967 · Cited by 73 · see citing works
Pooling methods for likelihood ratio tests in multiply imputed data setsPreprint
Grund, S., Lüdtke, O., & Robitzsch, A. (2021) · doi:10.17605/osf.io/u9s4k · Cited by 1 · see citing works

Authors: van Ginkel, J. R., & Kroonenberg, P. M.
Affiliations: Leiden University
Leiden University (NL)
ORCID: Kroonenberg, Pieter M.
Venue: Multivariate Behavioral Research
Publisher: Informa UK Limited
Published: 2014-01
Volume: 49
Issue: 1
Pages: 78-91
ISSN: 0027-3171 (ISSN-L)
1532-7906
DOI: 10.1080/00273171.2013.855890
PMC: PMC4029775
OpenAlex: W2155931297
Cited by: 152
References: 33
Citations by year: 2026: 6 · 2025: 9 · 2024: 11 · 2023: 12 · 2022: 12 · 2021: 13 · 2020: 13 · 2019: 17 · 2018: 16 · 2017: 20 · 2016: 12 · 2015: 5 · 2014: 5
FWCI: 14.80
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Locations: Multivariate Behavioral Research (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute on Aging (R01AG008235)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords: multiple imputation, analysis of variance, missing data, repeated measures ANOVA

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Analysis of Variance of Multiply Imputed Data

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks