The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Multiple imputation of missing values was not necessary before performing a longitudinal mixed-model analysis
Abstract
Background and objectives As a result of the development of sophisticated techniques, such as multiple imputation, the interest in handling missing data in longitudinal studies has increased enormously in past years. Within the field of longitudinal data analysis, there is a current debate on whether it is necessary to use multiple imputations before performing a mixed-model analysis to analyze the longitudinal data. In the current study this necessity is evaluated.Study design and setting The results of mixed-model analyses with and without multiple imputation were compared with each other. Four data sets with missing values were created-one data set with missing completely at random, two data sets with missing at random, and one data set with missing not at random). In all data sets, the relationship between a continuous outcome variable and two different covariates were analyzed: a time-independent dichotomous covariate and a time-dependent continuous covariate.Results Although for all types of missing data, the results of the mixed-model analysis with or without multiple imputations were slightly different, they were not in favor of one of the two approaches. In addition, repeating the multiple imputations 100 times showed that the results of the mixed-model analysis with multiple imputation were quite unstable.Conclusion It is not necessary to handle missing data using multiple imputations before performing a mixed-model analysis on longitudinal data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multiple imputation when performing mixed models analyses can lead to unstable results [26]”
In the citing paper
“Linear mixed modelling has been demonstrated to control for missing data, and therefore, multiple imputation was not required (Peters et al., 2012;Twisk et al., 2013).”
From Exercise combined with Acceptance and Commitment Therapy for chronic pain: One-year follow-up from a randomized controlled trial (2024) · cites this paper as Twisk et al., 2013
In the citing paper
“Twisk et al 71 provided evidence that multiple imputation for missing data is not necessary before computing longitudinal mixed models.”
In the citing paper
“However, completely missing measurements will not be imputed as this is not necessary for multilevel analysis (63).”
From Timing of imagery rescripting during schema therapy for borderline personality disorder: the LUCY trial (2023) · cites this paper as [63]
In the citing paper
“Therefore, patterns of missingness were not found to be MNAR and the decision to continue the analysis with the available data was made [84,85].”
From Negative and positive affect regulation in a transdiagnostic internet-based protocol for emotional disorders: Randomized controlled trial (2021) · cites this paper as [84]
In the citing paper
“Mixed model analysis handles missing data; no imputation method was applied since there are reports that imputations before a mixed model analysis is not necessary and simulations indicated that imputations before mixed models could result in unstable results [30].”
From Is sleep disturbance in patients with chronic pain affected by physical exercise or ACT-based stress management? - A randomized controlled study (2018) · cites this paper as [30]
In the citing paper
“We also performed all analyses on the data for 100 imputations. Because there is a current debate whether it is necessary to perform multiple imputations in combination with mixed-model analyses in longitudinal studies [65], we also performed the LMM analyses without multiple imputations.”
From Long-Term Results of a Web-Based Guided Self-Help Intervention for Employees With Depressive Symptoms: Randomized Controlled Trial (2014) · cites this paper as [65]
In the citing paper
“Because of the current debate on the necessity of multiple imputations in combination with mixed-model analysis in longitudinal studies [65], we also performed mixed-model analysis without multiple imputations. The results were comparable, indicating that data were robust and multiple imputations may not have been needed.”
From Long-Term Results of a Web-Based Guided Self-Help Intervention for Employees With Depressive Symptoms: Randomized Controlled Trial (2014) · cites this paper as [65]
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
(2010) · Cited by 7,034
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
Schafer, J. L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800102 · Cited by 3,949
Statistical Analysis With Missing Data
Lazar, N. A. (2003) · Technometrics · doi:10.1198/tech.2003.s167 · Cited by 2,477
Multiple Imputation of Missing Values
Royston, P. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400301 · Cited by 2,340 · cited 1×
“[28,29] discuss the impact of the number of imputations on the precision of the estimates and suggest ways of determining the required number of imputations by evaluating the sampling error of the multiple-imputation estimates.”
BackgroundMultiple Imputation for Nonresponse in Surveys.
Lynn, P. J., & Rubin, D. B. (1988) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348774 · Cited by 2,330
Cited by
Sorted by citations
Items 101–200 of 568
Hornstra, R., der Oord, S. V., Staff, A. I., Hoekstra, P. J., Oosterlaan, J., van der Veen‐Mulders, L., Luman, M., & van den Hoofdakker, B. J. (2021) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2021.1955368 · Cited by 43
“To compare the three conditions on our primary and secondary outcomes, we conducted multilevel analysis (mixed modeling) using Stata, version 16 (StataCorp, 2019), which takes missing data into account (Twisk et al., 2013).”
MethodMandatory Nap Times and Group Napping Patterns in Child Care: An Observational Study
Staton, S., Smith, S. S., Hurst, C., Pattinson, C., & Thorpe, K. (2017) · Behavioural Sleep Medicine · doi:10.1080/15402002.2015.1120199 · Cited by 36
Mild Albuminuria Is a Risk Factor for Faster GFR Decline in the Nondiabetic Population
Melsom, T., Solbu, M. D., Schei, J., Stefansson, V. T. N., Norvik, J. V., Jenssen, T. G., Wilsgaard, T., & Eriksen, B. O. (2018) · Kidney International Reports · doi:10.1016/j.ekir.2018.01.015 · Cited by 34
“All 1567 participants with 1 to 3 GFR measurements were included in the analyses because linear mixed models allow for missing observations at $1 timepoints.(16,17) Although 3 measurements were only available for a random subsample (n 1⁄4 87) in RENIS-FU, this sufficed for estimating the 3 variance components in the u…”
MethodVergallo, A., Houot, M., Cavedo, E., Lemercier, P., Vanmechelen, E., De Vos, A., Habert, M., Potier, M., Dubois, B., Lista, S., et al. (2019) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2019.07.001 · Cited by 32
“Indeed, the strength of this model is to focus on subject trajectories taking into account for the correlation between timepoints, thus allowing intraindividual and interindividual comparisons [27,28].”
BackgroundNetten, A. P., Rieffe, C. J., Ketelaar, L., Soede, W., Gadow, K. D., & Frijns, J. H. M. (2017) · Ear and Hearing · doi:10.1097/aud.0000000000000500 · Cited by 32
Siemonsma, P. C., Blom, J. W., Hofstetter, H., van Hespen, A. T. H., Gussekloo, J., Drewes, Y. M., & van Meeteren, N. L. U. (2018) · BMC Geriatrics · doi:10.1186/s12877-018-0859-3 · Cited by 32
“We used Linear Mixed Model (LMM) analysis, correcting for age, sex, baseline scores and clustering by physiotherapist.”
MethodEffect of Arthroplasty vs Fusion for Patients With Cervical Radiculopathy
Johansen, T. O., Sundseth, J., Fredriksli, O. A., Andresen, H., Zwart, J., Kolstad, F., Pripp, A. H., Gulati, S., & Nygaard, O. P. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.19606 · Cited by 32
Bartel, K., Huang, C., Maddock, B., Williamson, P., & Gradisar, M. (2018) · Journal of Sleep Research · doi:10.1111/jsr.12668 · Cited by 36
Academic trajectories of very preterm born children at school age
Twilhaar, E. S., de Kieviet, J. F., van Elburg, R. M., & Oosterlaan, J. (2018) · Archives of Disease in Childhood Fetal & Neonatal · doi:10.1136/archdischild-2018-315028 · Cited by 31
Aarden, J. J., van der Schaaf, M., van der Esch, M., Reichardt, L. A., van Seben, R., Bosch, J. A., Twisk, J. W. R., Buurman, B. M., & Engelbert, R. (2019) · PLoS ONE · doi:10.1371/journal.pone.0219041 · Cited by 31
“A Linear Mixed Model (LMM) was performed to analyse the course of mobility and the association between the course of mobility and muscle strength.”
MethodSelf-citationPhysical activity and renal function in the Italian kidney transplant population
Masiero, L., Puoti, F., Bellis, L., Lombardini, L., Totti, V., Angelini, M. L., Spazzoli, A., Costa, A. N., Cardillo, M., Sella, G., et al. (2020) · Renal Failure · doi:10.1080/0886022x.2020.1847723 · Cited by 31
“nique applied (mixed regression analysis) [36].”
Larsen, K. T., Huang, T., Ried‐Larsen, M., Andersen, L. B., Heidemann, M., & Møller, N. C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0157182 · Cited by 32
“This method has shown to be preferable in longitudinal analyses and can be performed without any imputations of missing data [20].”
MethodInvestigating daily fatigue scores during two-week offshore day shifts
Riethmeister, V., Bültmann, U., Gordijn, M. C. M., Brouwer, S., & de Boer, M. R. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2018.04.008 · Cited by 31
“Under this assumption, linear mixed models provide valid estimates, without data imputation (Twisk et al., 2013).”
BackgroundAn industrial missing values processing method based on generating model
Wang, H., Yuan, Z., Chen, Y., Shen, B., & Wu, A. (2019) · Computer Networks · doi:10.1016/j.comnet.2019.02.007 · Cited by 30
Decreased Appetite is Associated with Sarcopenia-Related Outcomes in Acute Hospitalized Older Adults
van Dronkelaar, C., Tieland, M., Aarden, J. J., Reichardt, L. A., van Seben, R., van der Schaaf, M., van der Esch, M., Engelbert, R., Twisk, J. W. R., Bosch, J. A., et al. (2019) · Nutrients · doi:10.3390/nu11040932 · Cited by 31
“In addition, the analyses on the associations were performed with linear mixed models, which accounts for missing data [39].”
MethodSelf-citationAlemu, S. M., Herklots, T., Almansa, J., Mbarouk, S. S., Sulkers, E., Stekelenburg, J., de Zeeuw, J., Jacod, B. C., & Biesma, R. G. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17239034 · Cited by 30
“Missing values were assumed to be missing at random (MAR) [23].”
Lewis, J. S., Sim, J., & Barlas, P. (2017) · European Journal of Pain · doi:10.1002/ejp.1001 · Cited by 32
“Shoulder flexion, abduction, external rotation and internal rotation ranges of movement were measured as described by Valentine and Lewis (2006).”
MethodVisser, H. A. D., van Megen, H. J. G. M., van Oppen, P., Hoogendoorn, A. W., Glas, G. G., Neziroglu, F. A., & van Balkom, A. J. L. M. (2017) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2017.03.003 · Cited by 30
Kwok, J. Y. Y., Jiang, D., Yeung, D. Y.-L., Choi, N. G., Ho, R., Warner, L. M., & Chou, K. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.16767 · Cited by 32
The effects of questions during shared-reading: Do demand-level and placement really matter?
Lenhart, J., Lenhard, W., Vaahtoranta, E., & Suggate, S. (2019) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2018.10.006 · Cited by 27
Xu, Y., Bright, C. L., Barth, R. P., & Ahn, H. (2020) · Child Maltreatment · doi:10.1177/1077559520926568 · Cited by 30
“As methodological research indicates, MLE is a preferred way to address missing data to make valid estimations relative to multiple imputation (Rabe-Hesketh & Skrondal, 2012; Twisk et al., 2013).”
MethodRøsstad, T., Salvesen, Ø. O., Steinsbekk, A., Grimsmo, A., Sletvold, O., & Garåsen, H. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2206-3 · Cited by 29
“Multiple imputations were not done as this has been found to be unnecessary when performing mixed model analyses on longitudinal data [23].”
MethodThe dose-dependent effect of estrogen on bone mineral density in trans girls
Boogers, L. S., van der Loos, M. A. T. C., Wiepjes, C. M., van Trotsenburg, A. S. P., den Heijer, M., & Hannema, S. E. (2023) · European Journal of Endocrinology · doi:10.1093/ejendo/lvad116 · Cited by 28
Body Awareness as an Important Target in Multidisciplinary Chronic Pain Treatment
van der Maas, L. C. C., Köke, A. J. A., Bosscher, R. J., Twisk, J. W. R., Janssen, T. W. J., & Peters, M. L. (2015) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000000320 · Cited by 27
Self-citationLumbar Microdiscectomy in Obese Patients: A Multicenter Observational Study
Madsbu, M. A., Øie, L. R., Salvesen, Ø. O., Vangen-Lønne, V., Nygaard, O. P., Solberg, T. K., & Gulati, S. (2017) · World Neurosurgery · doi:10.1016/j.wneu.2017.11.156 · Cited by 28
Peng, Y.-L., Tain, Y., Lee, C., Yang, Y., Huang, Y., Wen, Y.-H., & Hsu, C. (2020) · Scientific Reports · doi:10.1038/s41598-020-67026-1 · Cited by 29
Boekhout, J. M., Berendsen, B., Peels, D. A., Bolman, C. A. W., & Lechner, L. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15020346 · Cited by 27
“By conducting multilevel analyses in this study, the most accurate way of handling missing data was applied [51].”
MethodBarends, H., Dessel, N. C.-V., van der Wouden, J. C., Twisk, J. W. R., Terluin, B., van der Horst, H. E., & Dekker, J. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.110131 · Cited by 27
Self-citationInhulsen, M. M. R., Busch, V., & van Stralen, M. M. (2022) · Journal of School Health · doi:10.1111/josh.13175 · Cited by 28
Meal-Specific Dietary Changes From Squires Quest! II: A Serious Video Game Intervention
Cullen, K. W., Liu, Y., & Thompson, D. I. (2016) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2016.02.004 · Cited by 26
Missing Data in the Field of Otorhinolaryngology and Head & Neck Surgery: Need for Improvement
Netten, A. P., Dekker, F. W., Rieffe, C. J., Soede, W., Briaire, J. J., & Frijns, J. H. M. (2016) · Ear and Hearing · doi:10.1097/aud.0000000000000346 · Cited by 26
“Statistical analyses were checked as to 137 whether the degrees of freedom were consistent, if imputations were mentioned or applied, 138 and if other likelihood-based methods were used that are able to handle missing data without 139 excluding incomplete cases, such as linear mixed models (Twisk et al. 2013).”
MethodA double-blind, placebo-controlled study of inositol in trichotillomania
Leppink, E. W., Redden, S., & Grant, J. (2017) · International Clinical Psychopharmacology · doi:10.1097/yic.0000000000000156 · Cited by 23
“…without imputation, although a more conservative approach may also provide more accurate and stable results than LME models using fixed and multiple imputation methods for handling missing data, and thus no imputation was performed for missing data (Chakraborty and Gu, 2009; Twisk et al., 2013).”
ResultMoljord, I. E. O., Lara‐Cabrera, M. L., Salvesen, Ø. O., Rise, M. B., Bjørgen, D., Antonsen, D. Ø., Olsø, T. M., Evensen, G. H., Gudde, C. B., Linaker, O. M., et al. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.01.008 · Cited by 28
Nikolopoulou, M., Byraki, A., Ahlberg, J., Heymans, M. W., Hamburger, H., de Lange, J., Lobbezoo, F., & Aarab, G. (2017) · Journal of Oral Rehabilitation · doi:10.1111/joor.12505 · Cited by 26
“The major strengths of mixed models are their ability to accommodate missing data points often encountered in longitudinal datasets and to generate valid study results (21).”
BackgroundSelf-citationKorshøj, M., Jørgensen, M. B., Lidegaard, M., Mortensen, O. S., Krustrup, P., Holtermann, A., & Søgaard, K. (2017) · Scandinavian Journal of Public Health · doi:10.1177/1403494817717833 · Cited by 26
“The mixed model analysis is a strength when evaluating repeated observations with observations missing at random, since the mixed model enables use of information from all observations without imputation [18,28].”
MethodThastum, M., Johnsen, D. B., Silverman, W. K., Jeppesen, P., Heyne, D. A., & Lomholt, J. J. (2019) · Trials · doi:10.1186/s13063-018-3124-3 · Cited by 26
Verjans-Janssen, S. R. B., Gerards, S. M. P. L., Kremers, S., Vos, S. B., Jansen, M. W. J., & van Kann, D. (2020) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-01012-8 · Cited by 28
Learning a Credal Classifier With Optimized and Adaptive Multiestimation for Missing Data Imputation
Zhang, Z., Tian, H., Yan, L.-Z., Arnaud Martin, B., & Zhou, K. (2021) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2021.3090210 · Cited by 28
“In the early Rubin’s method [1], [9], [14], the missing values are imputed M times to produce M complete datasets based”
BackgroundMethodBerends, E. T. M., Wiepjes, C. M., Nota, N. M., Schotman, H. H. M., Heijboer, A. C., & den Heijer, M. (2023) · European Journal of Endocrinology · doi:10.1093/ejendo/lvad052 · Cited by 25
The Prevalence and Characteristics of Emergency Medicine Patient Use of New Media
Post, L. A., Vaca, F. E., Biroscak, B. J., Dziura, J. D., Brandt, C., Bernstein, S. L., Taylor, R. A., Jagminas, L., & D’Onofrio, G. (2015) · JMIR mhealth and uhealth · doi:10.2196/mhealth.4438 · Cited by 25
“” Thus, participants who reported Latino/Hispanic as a racial category were corrected using hot deck imputation [87-98].”
Cesarean Delivery, Overweight throughout Childhood, and Blood Pressure in Adolescence
Pluymen, L. P. M., Smit, H. A., Wijga, A. H., Gehring, U., de Jongste, J. C., & van Rossem, L. (2016) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2016.08.059 · Cited by 25
de Waal, M. M., Dekker, J., Kikkert, M., Christ, C., Chmielewska, J., Staats, M., van den Brink, W., & Goudriaan, A. E. (2018) · Addiction · doi:10.1111/add.14500 · Cited by 24
“As we used mixed-model analyses for evaluating secondary outcome measures, no imputation of missing data was needed [42].”
MethodKokkeler, K. J. E., Marijnissen, R. M., Wardenaar, K. J., Rhebergen, D., van den Brink, R. H. S., van der Mast, R. C., & Voshaar, R. C. O. (2020) · Psychological Medicine · doi:10.1017/s0033291720002159 · Cited by 30
Aadland, E., Okely, A. D., & Nilsen, A. K. O. (2022) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-022-01286-0 · Cited by 24
Oluwagbemigun, K., Anesi, A., Ulaszewska, M., Clarke, G. A., Alexy, U., Schmid, M. C., Roden, M., Herder, C., Mattivi, F., & Nöthlings, U. (2020) · Scientific Reports · doi:10.1038/s41598-020-63313-z · Cited by 24
Domić, J., Pinckaers, P. J., Grootswagers, P., Siebelink, E., Gerdessen, J. C., van Loon, L. J. C., & de Groot, C. P. G. M. (2024) · Journal of Nutrition · doi:10.1016/j.tjnut.2024.12.019 · Cited by 26
Kleine‐Borgmann, J., Dietz, T.-N., Schmidt, K., & Bingel, U. (2022) · Pain · doi:10.1097/j.pain.0000000000002752 · Cited by 23
“42 Model estimates are reported as absolute beta values ( b ) with 95% confidence intervals.”
Korshøj, M., Clays, E., Lidegaard, M., Skotte, J. H., Holtermann, A., Krustrup, P., & Søgaard, K. (2015) · European Journal of Applied Physiology · doi:10.1007/s00421-015-3259-9 · Cited by 23
Ghielen, I., Koene, P., Twisk, J. W. R., Kwakkel, G., van den Heuvel, O. A., & van Wegen, E. E. H. (2020) · Neurodegenerative Disease Management · doi:10.2217/nmt-2019-0028 · Cited by 23
Self-citationBystad, E. W., Stefansson, V. T. N., Eriksen, B. O., & Melsom, T. (2023) · Kidney International Reports · doi:10.1016/j.ekir.2023.06.022 · Cited by 22
“All 1551 participants were included in the analysis regardless of the number of follow-up GFRs because the linear mixed regression accounts for missing values.(38) Effect modification of sex and hyperfiltration on the association between MetS and GFR decline rate was tested using a 3-way interaction term between MetS,…”
MethodSurgery for Herniated Lumbar Disc in Daily Tobacco Smokers: A Multicenter Observational Study
Madsbu, M. A., Salvesen, Ø. O., Werner, D. A. T., Franssen, E., Weber, C., Nygaard, O. P., Solberg, T. K., & Gulati, S. (2017) · World Neurosurgery · doi:10.1016/j.wneu.2017.10.024 · Cited by 24
“This strategy was in line with studies showing that it is not necessary to handle missing data using multiple imputations before performing a mixed model analyses on longitudinal d ata.[24, 25]”
ResultSurgery for Herniated Lumbar Disk in Individuals 65 Years of Age or Older
Madsbu, M. A., Solberg, T. K., Salvesen, Ø. O., Nygaard, O. P., & Gulati, S. (2017) · JAMA Surgery · doi:10.1001/jamasurg.2016.5557 · Cited by 24
Xu, Y., Wang, X., Ahn, H., & Harrington, D. (2018) · Children and Youth Services Review · doi:10.1016/j.childyouth.2018.04.012 · Cited by 22
Rasmussen, C. D. N., Hendriksen, P. R., Svendsen, M. J., Ekner, D., Hansen, K., Sørensen, O. H., Svendsen, S. W., van der Beek, A. J., & Holtermann, A. (2018) · Trials · doi:10.1186/s13063-018-2788-z · Cited by 24
Blom, E. E., Aadland, E., Skrove, G. K., Solbraa, A. K., & Oldervoll, L. M. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02554-x · Cited by 26
Vergallo, A., Lemercier, P., Cavedo, E., Lista, S., Vanmechelen, E., Vos, A. D., Zetterberg, H., Blennow, K., Habert, M., Potier, M., et al. (2021) · Alzheimer s & Dementia · doi:10.1002/alz.12228 · Cited by 21
Tsai, Y., Chuang, L.-L., Lee, Y., & Chiu, C. (2021) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2021.109114 · Cited by 21
Johansen, T. O., Vangen-Lønne, V., Holmberg, S. T., Salvesen, Ø. O., Solberg, T. K., Gulati, A. M., Nygaard, O. P., & Gulati, S. (2022) · Acta Neurochirurgica · doi:10.1007/s00701-022-05282-y · Cited by 21
“This strategy was in line with studies showing that imputations are not necessary before performing linear mixed model analysis of longitudinal data [23, 33].”
ResultComparing Bispectral Index Monitoring vs Clinical Assessment for Deep Sedation in the ICU
Huespe, I. A., Giunta, D. H., Acosta, K., Poletti, D. Á., Prado, E., Sanghavi, D. K., Bisso, I. C., Giannasi, S., & Carini, F. C. (2024) · CHEST Journal · doi:10.1016/j.chest.2024.05.031 · Cited by 24
A Procedure and Guidelines for Analyzing Groups of Software Engineering Replications
Santos, A., Vegas, S., Oivo, M., & Juristo, N. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2935720 · Cited by 23
“as data are missing at random [98]).”
Harrell, F. E. (2015) · Springer series in statistics · doi:10.1007/978-3-319-19425-7_3 · Cited by 21
Eklund, A., Axén, I., Kongsted, A., Lohela-Karlsson, M., Leboeuf‐Yde, C., & Jensen, I. B. (2014) · Trials · doi:10.1186/1745-6215-15-102 · Cited by 21
“Outcome measures will not be imputed for participants not responding to followup questions as previous research using the SMS-Track system has yielded high response rates [33,36,37] and research has indicated it unnecessary when performing analysis on longitudinal data [50].”
BackgroundClaassen-van Dessel, N., van der Wouden, J. C., Twisk, J. W. R., Dekker, J., & van der Horst, H. E. (2018) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2018.02.009 · Cited by 20
Self-citationToward feeling, understanding, and caring: The development of empathy in young autistic children
Li, B., Blijd-Hoogewys, E. M. A., Stockmann, L., Vergari, I., & Rieffe, C. J. (2022) · Autism · doi:10.1177/13623613221117955 · Cited by 27
“LMM can account for the dependency within the longitudinal data (Hox et al., 2010) and is robust in handing randomly missing data (Twisk et al., 2013).”
BackgroundIngebrigtsen, T., Aune, G., Karlsen, M. E., Gulati, S., Kolstad, F., Nygaard, O. P., Thyrhaug, A. M., & Solberg, T. K. (2022) · Acta Neurochirurgica · doi:10.1007/s00701-022-05453-x · Cited by 20
“Strategies to manage MNAR observations include multiple imputations and the use of mixed linear models [26].”
MethodKorshøj, M., Krause, N., Clays, E., Søgaard, K., Krustrup, P., & Holtermann, A. (2017) · American Journal of Hypertension · doi:10.1093/ajh/hpw197 · Cited by 20
“…of bias from self-reporting, and/or differential misclassification, (ii) the cluster-randomized controlled trial design, reducing contamination bias, (iii) the mixed-model analysis without imputation, 28 and (iv) the comprehensive assessment and control of potential confounders during follow-up.”
Methodvan Summeren, J., Holtman, G. A., Kollen, B. J., van Leeuwen, Y., van Ulsen-Rust, A. H. C., Tabbers, M. M., Dekker, J. H., & Berger, M. Y. (2019) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2019.09.048 · Cited by 23
Korshøj, M., Lidegaard, M., Krustrup, P., Jørgensen, M. B., Søgaard, K., & Holtermann, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0158547 · Cited by 20
“The mixed model analysis is a strength when evaluating repeated measurements observations with observations missing at random, since the mixed model enables use of information from all observations without imputing missing observations [48,71].”
MethodSproesser, G., Arens-Azevêdo, U., & Renner, B. (2023) · PLOS Sustainability and Transformation · doi:10.1371/journal.pstr.0000086 · Cited by 19
Effect of Electronic Health Record–Based Coaching on Weight Maintenance
Conroy, M. B., McTigue, K. M., Bryce, C. L., Tudorascu, D., Gibbs, B. B., Arnold, J., COMER, D. M., Hess, R., Huber, K., Simkin‐Silverman, L. R., et al. (2019) · Annals of Internal Medicine · doi:10.7326/m18-3337 · Cited by 19
Melsom, T., Norvik, J. V., Enoksen, I. T., Stefansson, V. T. N., Rismo, R., Jenssen, T. G., Solbu, M. D., & Eriksen, B. O. (2021) · Kidney International Reports · doi:10.1016/j.ekir.2021.05.007 · Cited by 19
“All 1627 participants with 1 to 3 GFR measurements were included in the analyses because linear mixed models allow for missing observations at 1 or more time points as long as the observations are missing at random.(36,37) Missing of the third GFR measurement for the majority of participants was part of the design of…”
MethodRösel, I., Serna-Higuita, L. M., Sayah, F. A., Buchholz, M., Buchholz, I., Kohlmann, T., Martus, P., & Feng, Y. (2021) · Quality of Life Research · doi:10.1007/s11136-021-03037-3 · Cited by 18
“For the MAR datasets, approach-1 provided the most inaccurate predictions yielding the largest MSE compared 1 3 to all other approaches with an increasing MSE across the increasing proportions of simulated missing data.”
BackgroundMethodResultInfluentialTebbens, M., Schutte, M. H., Troelstra, M., Bruinstroop, E., de Mutsert, R., Nederveen, A. J., den Heijer, M., & Bisschop, P. H. L. T. (2023) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgad409 · Cited by 20
Mental health across two years of the COVID-19 pandemic: a 5-wave longitudinal study in Germany
Weber, M., Burchert, S., Sijbrandij, M., Patanè, M., Pinucci, I., Renneberg, B., Knaevelsrud, C., & Schumacher, S. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1229700 · Cited by 25
“, repeated measures analyses of variance), mixed models provide less biased variance components in incomplete and unbalanced data using all available data (40, 41), and do not require multiple imputation of missing values (42).”
MethodIdentifying unusual performance in Australian and New Zealand intensive care units from 2000 to 2010
Solomon, P. J., Kasza, J., & Moran, J. L. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-53 · Cited by 19
“showed that MI applied to mixed models may be misleading, [34].”
MethodThe acute effects of short bouts of exercise on inhibitory control in adolescents
Gejl, A. K., Bugge, A., Ernst, M. T., Tarp, J., Hillman, C. H., Have, M., Froberg, K., & Andersen, L. B. (2018) · Mental health and physical activity · doi:10.1016/j.mhpa.2018.06.003 · Cited by 24
Powers, J. R., Dobson, A. J., Berry, H. L., Graves, A. M., Hanigan, I. C., & Loxton, D. (2015) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.12369 · Cited by 23
Thomsen, L. T., Schmidt‐Persson, J., Damsgaard, C. T., Krustrup, P., Grøntved, A., Krølner, R. F., Nielsen, G., Lundbye‐Jensen, J., Skovgaard, T., Mølgaard, C., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0308142 · Cited by 18
“Missing values will be handled via the mixed regression modelling approach to analyses [91, 92].”
Eichengreen, A., Broekhof, E., Tsou, Y.-T., & Rieffe, C. (2022) · European Child and Adolescent Psychiatry · doi:10.1007/s00787-021-01900-9 · Cited by 17
“points of a participant [67], missing values in independent variables at baseline could still result in bias [68].”
BackgroundWatson, L., Belcher, J., Nicholls, E. E., Chandratre, P., Bucknall, M., Hider, S., Lawton, S., Mallen, C. D., Müller, S., Rome, K., et al. (2022) · Rheumatology · doi:10.1093/rheumatology/keac706 · Cited by 20
“Longitudinal mixed model analysis operates under the assumption that missing data are missing at random [39, 40].”
MethodMoljord, I. E. O., Helland-Hansen, K. A., Salvesen, Ø. O., Olsø, T. M., Gudde, C. B., Rise, M. B., Steinsbekk, A., & Eriksen, L. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1712-z · Cited by 20
“The intention to treat analysis [37] was done using a linear mixed model which uses all available data in the presence of dropouts and there is no need for multiple imputations [38].”
MethodRezvani, F., Heider, D., Härter, M. C., König, H., Bienert, F., Brinkmann, J., Herbarth, L., Kramer, E., Steinisch, P., Freudenstein, F., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-032146 · Cited by 18
Korshøj, M., Ravn, M. H., Holtermann, A., Hansen, Å. M., & Krustrup, P. (2015) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-015-1067-5 · Cited by 18
“Missing values were not imputed either for outcome or for covariate variables (White et al. 2012; Twisk et al. 2013).”
BackgroundBarends, H., van der Wouden, J. C., Claassen - van Dessel, N., Twisk, J. W. R., van der Horst, H. E., & Dekker, J. (2022) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2022.110945 · Cited by 18
Self-citationEffects of Illness Management and Recovery: A Multicenter Randomized Controlled Trial
Roosenschoon, B.-J., van Weeghel, J., Deen, M. L., van Esveld, E. W., Kamperman, A. M., & Mulder, C. L. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.723435 · Cited by 17
“As LMMs use the full data set, this methodology retains people with missing values; thus, imputation is not necessarily beneficial in this context (61).”
MethodBelief Combination of Classifiers for Incomplete Data
Zhang, Z., Ye, S., Zhang, Y., Ding, W., & Wang, H. H. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105458 · Cited by 17
Alalawi, A., Devecchi, V., Gallina, A., Luque-Suárez, A., & Falla, D. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11072042 · Cited by 18
“Moreover, according to a previous study, multiple imputation is unnecessary for analysing longitudinal data as findings showed that multiple imputation was highly unstable when the multiple imputations were repeated 100 times [84].”
Hyland, K., Hammarberg, A., Hedman‐Lagerlöf, E., Johansson, M., Lindner, P., & Andréasson, S. (2023) · Addiction · doi:10.1111/add.16157 · Cited by 19
Riethmeister, V., Bültmann, U., De Boer, M. R., Gordijn, M., & Brouwer, S. (2018) · Chronobiology International · doi:10.1080/07420528.2018.1466794 · Cited by 19
“Under this assumption, mixed models provide valid estimates, without data imputation (Twisk et al. 2013).”
Methodthe MEMORA group, Dauphinot, V., Moutet, C., Rouch, I., Verdurand, M., Mouchoux, C., Delphin‐Combe, F., Gaujard, S., & Krolak‐Salmon, P. (2019) · BMC Geriatrics · doi:10.1186/s12877-019-1204-1 · Cited by 17
de Jong, M., Korrelboom, K., van der Meer, I., Deen, M. L., Hoek, H. W., & Spinhoven, P. (2016) · Trials · doi:10.1186/s13063-016-1716-3 · Cited by 18
Verswijveren, S. J. J. M., Wiebe, S. A., Rahman, A. A., Kuzik, N., & Carson, V. (2020) · Mental health and physical activity · doi:10.1016/j.mhpa.2020.100340 · Cited by 16
Wealth accumulation by hypogamy in own and parental education in China
Cheng, C., & Zhou, Y. (2021) · Journal of Marriage and the Family · doi:10.1111/jomf.12805 · Cited by 17
The effect of recreational cannabis legalization on rates of traffic injury in Canada
Walker, M., Saarela, O., Mann, R., Carpino, M., & Cusimano, M. D. (2023) · Addiction · doi:10.1111/add.16188 · Cited by 16
Long-Term Results After Surgery for Degenerative Cervical Myelopathy
Johansen, T. O., Holmberg, S. T., Danielsen, E., Rao, V., Salvesen, Ø. O., Andresen, H., Vleggeert-Lankamp, C. L. A., Solberg, T. K., Gulati, S., & Nygaard, O. P. (2023) · Neurosurgery · doi:10.1227/neu.0000000000002712 · Cited by 16
“21,22 In the mixed model, patients could still be included in the analysis if a variable was present at a minimum of one of the follow-up time points.”
BackgroundEnriched music-supported therapy for individuals with chronic stroke: a randomized controlled trial
Segura, E., Grau‐Sánchez, J., Porto, M. F., Puebla, M. D. L. C., Sánchez-Pinsach, D., Cerquides, J., Duarte, E., Palumbo, A., Turry, A., Raghavan, P., et al. (2024) · Journal of Neurology · doi:10.1007/s00415-024-12570-3 · Cited by 20
“The linear models were run with the PP dataset because it has been shown that regression models on imputed data can lead to unstable results [41].”
Campforts, B. C. M., Drukker, M., van Amelsvoort, T., & Bak, M. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-06317-7 · Cited by 18
Dannehl, K., Rief, W., & Euteneuer, F. (2019) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2350 · Cited by 16
Madsbu, M. A., Salvesen, Ø. O., Carlsen, S. M., Westin, S., Onarheim, K., Nygaard, O. P., Solberg, T. K., & Gulati, S. (2020) · Acta Neurochirurgica · doi:10.1007/s00701-019-04195-7 · Cited by 16
Dipnall, J. F., Rivara, F. P., Lyons, R. A., Ameratunga, S. N., BRUSSONI, M. J., Lecky, F. E., Bradley, C., Beck, B., Lyons, J., Schneeberg, A., et al. (2021) · Injury Prevention · doi:10.1136/injuryprev-2021-044309 · Cited by 16
Metadata
- Authors
- Twisk, J., de Boer, M., de Vente, W., & Heymans, M.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Twisk, Jos
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2013-09
- Volume
- 66
- Issue
- 9
- Pages
- 1022-1028
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W1974992958
- Cited by
- 568
- References
- 43
- Citations by year
- 2026: 58 · 2025: 68 · 2024: 74 · 2023: 57 · 2022: 61 · 2021: 52 · 2020: 46 · 2019: 45 · 2018: 27 · 2017: 26 · 2016: 21 · 2015: 19 · 2014: 10 · 2013: 4
- FWCI
- 15.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- VU Research Portal (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- multiple imputation, missing data, longitudinal analysis, mixed models, missing completely at random, missing at random, missing not at random, time-varying covariates
- MeSH terms
- Data Interpretation, Statistical, Humans, Longitudinal Studies, Patient Dropouts, Research Design, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
