The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Attrition in longitudinal studies
Abstract
The purpose of this paper was to illustrate the influence of missing data on the results of longitudinal statistical analyses [i.e., MANOVA for repeated measurements and Generalised Estimating Equations (GEE)] and to illustrate the influence of using different imputation methods to replace missing data. Besides a complete dataset, four incomplete datasets were considered: two datasets with 10% missing data and two datasets with 25% missing data. In both situations missingness was considered independent and dependent on observed data. Imputation methods were divided into cross-sectional methods (i.e., mean of series, hot deck, and cross-sectional regression) and longitudinal methods (i.e., last value carried forward, longitudinal interpolation, and longitudinal regression). Besides these, also the multiple imputation method was applied and discussed. The analyses were performed on a particular (observational) longitudinal dataset, with particular missing data patterns and imputation methods. The results of this illustration shows that when MANOVA for repeated measurements is used, imputation methods are highly recommendable (because MANOVA as implemented in the software used, uses listwise deletion of cases with a missing value). Applying GEE analysis, imputation methods were not necessary. When imputation methods were used, longitudinal imputation methods were often preferable above cross-sectional imputation methods, in a way that the point estimates and standard errors were closer to the estimates derived from the complete dataset. Furthermore, this study showed that the theoretically more valid multiple imputation method did not lead to different point estimates than the more simple (longitudinal) imputation methods. However, the estimated standard errors appeared to be theoretically more adequate, because they reflect the uncertainty in estimation caused by missing values.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“GEE allows for not using imputation methods for the missing data, because the participants with missing data are not excluded from the analysis [46].”
From Fibrates as drugs with senolytic and autophagic activity for osteoarthritis therapy (2019) · cites this paper as [46]
In the citing paper
“We chose GEE models because EMA data have a hierarchical structure; this type of model adjusts for dependency of repeated measures within one participant and can handle non-normally distributed data. GEE models are also suitable for dealing with missing data; it is not required to exclude participants with missing questionnaires, nor should missing questionnaires be imputed beforehand.”
From Experienced burden of and adherence to smartphone-based ecological momentary assessment in persons with affective disorders (2020) · cites this paper as [29]
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
Applied Regression Analysis and Other Multivariable Methods
Walker, E., Kleinbaum, D. G., Kupper, L. L., & Muller, K. E. (1989) · Technometrics · doi:10.2307/1270375 · Cited by 8,538
Longitudinal Data Analysis for Discrete and Continuous Outcomes
Zeger, S. L., & Liang, K. (1986) · Biometrics · doi:10.2307/2531248 · Cited by 7,781
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072
Multiple Imputation After 18+ Years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.2307/2291635 · Cited by 2,686
Multiple Imputation for Nonresponse in Surveys.
Lynn, P. J., & Rubin, D. B. (1988) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348774 · Cited by 2,330
Statistical Analysis with Missing Data.
Chatfield, C., Little, R. J. A., & Rubin, D. B. (1988) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2982783 · Cited by 2,203
Cited by
Sorted by citations
Items 101–200 of 526
van Stralen, M. M., de Vries, H., Bolman, C. A. W., Mudde, A. N., & Lechner, L. (2010) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9166-8 · Cited by 67
“By including covariates into the regression analyses and analyzing the total dataset, including the missing data using multilevel analyses, we accounted for selective dropout as much as possible [40].”
MethodLong-term Outcomes of Exercise
Korpelainen, R., Keinanen-Kiukaanniemi, S. M., Nieminen, P. A., Heikkinen, J. E., Väänänen, K., & Korpelainen, J. T. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.311 · Cited by 67
Kilkens, O. J. E., Dallmeijer, A. J., Nene, A. V., Post, M. W. M., & van der Woude, L. H. V. (2005) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2005.03.020 · Cited by 66
Alonso, Á., Seguí‐Gómez, M., de Irala, J., Sánchez‐Villegas, A., Beunza, J. J., & Martínez‐González, M. Á. (2006) · European Journal of Epidemiology · doi:10.1007/s10654-006-9008-y · Cited by 64
“Different methods to correct for selection bias due to differential retention have been proposed, mainly based on imputation methods for lost to follow-up individuals [24].”
MethodBehind the Numbers: Propensity Score Analysis—A Primer for the Diagnostic Radiologist
McDonald, R. J., McDonald, J. S., Kallmes, D. F., & Carter, R. E. (2013) · Radiology · doi:10.1148/radiol.13131465 · Cited by 64
Jiamjariyapon, T., Ingsathit, A., Pongpirul, K., Vipattawat, K., Kanchanakorn, S., Saetie, A., Kanistanon, D., Wongprompitak, P., Leesmidt, V., Watcharasaksilp, W., et al. (2017) · BMC Nephrology · doi:10.1186/s12882-016-0414-4 · Cited by 67
“We use generalized estimating equations (GEE), adjusted for age, gender, diabetes, and hypertension, to analyze continuous variables in both primary and secondary outcomes [20].”
Lukavská, K., Vacek, J., & Gabhelík, R. (2020) · Journal of Behavioral Addictions · doi:10.1556/2006.2020.00068 · Cited by 67
Continuity of health impairment and substance misuse among adult prisoners in Queensland, Australia
Kinner, S. A. (2006) · International Journal of Prisoner Health · doi:10.1080/17449200600935711 · Cited by 63
Tan, H., Wen, S. W., WALKER, M. C., & Demissie, K. (2004) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-4-21 · Cited by 62
“Previous studies on missing data [8-11] have focused on the impact of missing information on study results and the methods to treat the missing variables.”
MethodA prospective 12-month study of the effect of smoking cessation on periodontal clinical parameters
Rosa, E. F., Corraini, P., de Carvalho, V. F., Inoue, G., Gomes, E. F., Lotufo, J. P. B., Micheli, G. D., & Pannuti, C. M. (2011) · Journal Of Clinical Periodontology · doi:10.1111/j.1600-051x.2011.01723.x · Cited by 62
Pool, J. J. M., Ostelo, R., Knol, D. L., Vlaeyen, J. W. S., Bouter, L. M., & de Vet, H. C. W. (2010) · Spine · doi:10.1097/brs.0b013e3181c212ee · Cited by 61
“It has been demonstrated that multilevel analyses are very flexible in handling these missing questionnaires.(35) The analyses were performed in SPSS 12.”
BackgroundCoffeng, J. K., Boot, C. R. L., Duijts, S. F. A., Twisk, J. W. R., van Mechelen, W., & Hendriksen, I. J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114860 · Cited by 71
“It has been revealed that using multilevel analysis for an incomplete dataset is better than applying imputation methods [78, 79].”
MethodVesco, K. K., Leo, M. C., KARANJA, N. M., Gillman, M. W., McEvoy, C. T., King, J. C., Eckhardt, C. L., Smith, K., Perrin, N., & Stevens, V. J. (2016) · Obesity · doi:10.1002/oby.21597 · Cited by 61
“An advantage of GEE is that it allows us to include participants with missing data across time, as GEE uses all available data to estimate the working correlation matrix parameters (27-29).”
MethodGali, K., Winter, S. J., Ahuja, N. J., Frank, E., & Prochaska, J. J. (2021) · Substance Abuse Treatment, Prevention, and Policy · doi:10.1186/s13011-021-00352-3 · Cited by 59
“Rather than remove respondents who did not complete all the surveys and conduct a completecase analysis that could lead to less power and biased results, we used GEE analyses, which is useful in dealing with missing data and does not require imputation [34].”
Methodvan Hooff, M. L., Spruit, M., O’Dowd, J. K., van Lankveld, W., Fairbank, J. C. T., & van Limbeek, J. (2013) · European Spine Journal · doi:10.1007/s00586-013-2844-z · Cited by 61
“these imputed values reflect the uncertainty in estimation caused by the missing values [56].”
BackgroundÅsenlöf, P., Denison, E., & Lindberg, P. (2009) · European Journal of Pain · doi:10.1016/j.ejpain.2009.01.010 · Cited by 62
Early participant attrition from clinical trials: role of trial design and logistics
Siddiqi, A.-E.-A., Sikorskii, A. E., Given, C. W., & Given, B. A. (2008) · Clinical Trials · doi:10.1177/1740774508094406 · Cited by 59
“The recruitment of patients representative of the target population is necessary for generalization of the findings (external validity), whereas their retention, particularly after randomization, is perhaps more important as high attrition can reduce the trial’s statistical power and also pose serious threat to its in…”
Backgroundter Hoeve, N., Sunamura, M., Stam, H. J., Boersma, E. H., Geleijnse, M. L., van Domburg, R. T., & van den Berg-Emons, R. J. G. (2018) · International Journal of Cardiology · doi:10.1016/j.ijcard.2017.12.015 · Cited by 59
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660 · Cited by 59
Rueger, S. Y., Chen, P., Jenkins, L. N., & Choe, H. J. (2013) · Journal of Youth and Adolescence · doi:10.1007/s10964-013-0039-x · Cited by 58
Wesseling, J., Bierma‐Zeinstra, S., Kloppenburg, M., Meijer, R., & Bijlsma, J. W. J. (2013) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2013-203829 · Cited by 58
Cohort Profile: The Amsterdam Growth and Health Longitudinal Study
Wijnstok, N. J., Hoekstra, T., van Mechelen, W., Kemper, H. C. G., & Twisk, J. W. R. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys028 · Cited by 57
Blended learning in education: effects on knowledge and attitude
Ireland, J., Martindale, S., Johnson, N., Adams, D. B., & Eboh, W. O. (2009) · British Journal of Nursing · doi:10.12968/bjon.2009.18.2.37868 · Cited by 56
Graphical Models for Recovering Probabilistic and Causal Queries from Missing Data
Mohan, K., & Pearl, J. (2014) · doi:10.21236/ada614408 · Cited by 56
Schmidt, S., Francés, A., Lorente, J. A., Juanpere-Rodero, N., Lloreta, J., Bonfill, X., Martínez‐Zapata, M. J., Morales‐Suárez‐Varela, M., de la Cruz, J., Emparanza, J. I., et al. (2014) · Urologic Oncology Seminars and Original Investigations · doi:10.1016/j.urolonc.2014.09.012 · Cited by 55
“indicate the direction and magnitude of the difference when compared with the (even when the assumption of missing completely at random does not hold) [28].”
BackgroundFerro, M. A. (2013) · Annals of Epidemiology · doi:10.1016/j.annepidem.2013.10.007 · Cited by 55
“Other approaches such as last observation carried forward and single imputationwere excluded because application of suchmethods has recently been presented [6,7].”
Kresta, J. Y., Oliver, J. M., Jagim, A. R., Fluckey, J. D., Riechman, S. E., Kelly, K. A., Meininger, C. J., Mertens‐Talcott, S. U., Rasmussen, C. J., & Kreider, R. B. (2014) · Journal of the International Society of Sports Nutrition · doi:10.1186/s12970-014-0055-6 · Cited by 57
“Missing data, if any, were replaced using the last observed value or series mean [36].”
MethodGabrio, A., Mason, A. J., & Baio, G. (2017) · PharmacoEconomics - Open · doi:10.1007/s41669-017-0015-6 · Cited by 57
“category includes last value carried forward [26], linear extrapolation [27], mean and conditional imputation [28].”
BackgroundDisclosing biology teachers’ beliefs about biotechnology and biotechnology education
Fonseca, M. J., Costa, P., Lencastre, L., & Tavares, F. (2011) · Teaching and Teacher Education · doi:10.1016/j.tate.2011.11.007 · Cited by 59
In Vivo Longitudinal MRI and Behavioral Studies in Experimental Spinal Cord Injury
Sundberg, L. M., Herrera, J. J., & Narayana, P. A. (2010) · Journal of Neurotrauma · doi:10.1089/neu.2010.1369 · Cited by 54
“Generalized estimating equation (GEE) analysis (Twisk and de Vente, 2002) was used to evaluate the temporal correlations within each group (Cohen et al., 2009), and Pearson’s correlation analysis was used to evaluate links between end-point histology and MRI and behavior measures.”
Gustavsson, C., Denison, E., & von Koch, L. (2009) · European Journal of Pain · doi:10.1016/j.ejpain.2009.10.004 · Cited by 52
Sletvold, O., Helbostad, J. L., Thingstad, P., Taraldsen, K., Prestmo, A., Lamb, S. E., Aamodt, A., Johnsen, R., Magnussen, J., & Saltvedt, I. T. (2011) · BMC Geriatrics · doi:10.1186/1471-2318-11-18 · Cited by 53
“Patterns of missing data will be explored prior to analysis, and accounted for in the analysis by imputation methods [61].”
Methodvan Stralen, M. M., de Vries, H., Mudde, A. N., Bolman, C. A. W., & Lechner, L. (2009) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-6-83 · Cited by 53
Comparing human behavior models in repeated Stackelberg security games: An extended study
Kar, D., Fang, F., Fave, F. M. D., Sintov, N. D., Tambe, M., & Lyet, A. (2016) · Artificial Intelligence · doi:10.1016/j.artint.2016.08.002 · Cited by 53
Yang, P.-K., Hsu, C., Chen, M., Lai, M., Li, Z.-R. T., Chen, C., Chen, S., & Ho, H. (2018) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2017-01739 · Cited by 52
“The segmented regression analysis utilizing the GEE methodology evaluated all data in the longitudinal dataset and has been shown to be less susceptible to the effects of missing data (46).”
MethodReducing attrition in panel studies in developing countries
Hill, Z. E. (2004) · International Journal of Epidemiology · doi:10.1093/ije/dyh060 · Cited by 52
Evans, M. B., & Eys, M. (2014) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.12235 · Cited by 51
Coutinho, H. M., Leenstra, T., Acosta, L. P., SU, L., Jarilla, B. R., Jiz, M., LANGDON, G. C., Olveda, R. M., McGarvey, S. T., Kurtis, J. D., et al. (2006) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2006.75.720 · Cited by 51
“These results were considered to be false negative (falling below detection level); these egg counts were imputed using the “last value carried over” method.(16) Low, moderate, and high S.”
MethodChange of Price Premiums Trend for Organic Food Products: The Example of the Polish Egg Market
Pawlewicz, A. (2020) · Agriculture · doi:10.3390/agriculture10020035 · Cited by 53
van Groenou, M. B. V., Deeg, D., & Penninx, B. (2003) · Aging Clinical and Experimental Research · doi:10.1007/bf03324497 · Cited by 46
Vissers, L. E. T., Waller, M., van der Schouw, Y. T., Hébert, J. R., Shivappa, N., Schoenaker, D. A. J. M., & Mishra, G. D. (2017) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2017.03.005 · Cited by 51
“Given the limitations of this type of imputation for longitudinal data [24], imputed results are presented as sensitivity analyses.”
Attrition Bias Related to Missing Outcome Data
Lewin, A., Brondeel, R., Benmarhnia, T., Thomas, F., & Chaix, B. (2017) · Epidemiology · doi:10.1097/ede.0000000000000755 · Cited by 50
Lechat, T., & Torrès, O. (2016) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1746-979120160000012003 · Cited by 58
de Beus, E., Bots, M. L., van Zuilen, A. D., Wetzels, J. F. M., & Blankestijn, P. J. (2015) · Hypertension · doi:10.1161/hypertensionaha.115.05694 · Cited by 48
“No adjustment for multiple statistical testing was made.(15,16)”
MethodPatel, C. B., Cohen, D. M., Ahobila‐Vajjula, P., Sundberg, L. M., Chacko, T., & Narayana, P. A. (2009) · Journal of Neurotrauma · doi:10.1089/neu.2008.0860 · Cited by 51
“Using various imputation methods to run MANOVA and GEE on an incomplete longitudinal dataset, Twisk and de Vente (2002) concluded that not imputing missing data would result in superior GEE results, while imputing missing data would result in superior MANOVA results.”
Missing value imputation in longitudinal measures of alcohol consumption
Grittner, U., Gmel, G. E., Ripatti, S., Bloomfield, K., & Wicki, M. (2011) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.330 · Cited by 45
David, M., & Ware, R. S. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.001 · Cited by 48
van der Valk, R. J. P., Duijts, L., Kerkhof, M., Willemsen, S. P., Albert Hofman, D., Moll, H., Smit, H. A., Brunekreef, B., Postma, D. S., Jaddoe, V. W. V., et al. (2012) · Allergy · doi:10.1111/j.1398-9995.2012.02819.x · Cited by 47
“To handle missing values in binary repeated outcomes (18, 19) and covariates, but not for the determinants ‘fetal smoke exposure’ and ‘ETS exposure in infancy’, multiple imputations were used for all analyses.”
MethodKolt, G. S., Schofield, G., Kerse, N. M., Garrett, N., Schlüter, P. J., Ashton, T., & Patel, A. (2009) · BMC Public Health · doi:10.1186/1471-2458-9-404 · Cited by 46
Predicting missing biomarker data in a longitudinal study of Alzheimer disease
Lo, R. Y., Jagust, W. J., Aisen, P. S. S., Jack, C. R., Toga, A. W., Beckett, L. A., Gamst, A. C., Soares, H. D., Green, R. C., Montine, T., et al. (2012) · Neurology · doi:10.1212/wnl.0b013e318253d5b3 · Cited by 46
Friedman, A. N., Guirguis, J. K., Kapoor, R., Gupta, S., Leaf, D. E., Timsina, L., & for the STOP‐COVID Investigators (2021) · Obesity · doi:10.1002/oby.23245 · Cited by 45
“The GEE allowed us to The GEE allowed us to use intention-to-treat analyses for all the available cases for each biomarker thus minimizing loss of statistical power due to attrition over time.(28)”
MethodWorkplace Rehabilitation and Supportive Conditions at Work: A Prospective Study
Åhlström, L., Hagberg, M., & Dellve, L. (2012) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-012-9391-z · Cited by 45
“There could be an issue when interpreting data due to loss to follow-up, although method chosen when analyzing the data; linear mixed models for longitudinal analyses of the repeated measurements, is a sophisticated method and in those cases it is less urgent to estimate missing data [51], if subjects is missing the r…”
MethodCohn, A. M., Johnson, A. L., Hair, E. C., Rath, J. M., & Villanti, A. C. (2016) · Tobacco Induced Diseases · doi:10.1186/s12971-015-0066-3 · Cited by 45
“Financial situation was assessed at Waves 1, 3, 5, and 7; and was imputed using a carryforward approach from the previous wave for waves 2 and 4 and a carry-backward approach for wave 6 [61, 62].”
MethodSheehan, R. B., Herring, M. P., & Campbell, M. J. (2018) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2018.03.005 · Cited by 45
Linking public issues with private troubles: panel studies in developing countries
Trudy Harpham, C., HUTTLY, S. R. A., Wilson, I., & de Wet, T. (2003) · Journal of International Development · doi:10.1002/jid.988 · Cited by 45
de Jonge, P., Kempen, G. I. J. M., Sanderman, R., Ranchor, A. V., van Jaarsveld, C. H. M., van Sonderen, E., Scaf-Klomp, W., Weening, A., Slaets, J. P. J., & Ormel, J. (2005) · Psychosomatics · doi:10.1176/appi.psy.47.1.33 · Cited by 46
Rastad, C., Ulfberg, J., & Lindberg, P. (2011) · Depression Research and Treatment · doi:10.1155/2011/543906 · Cited by 42
“5%) in the SIGH-SAD/SR were imputed using the method of last value carried forward [29] or with zero if missing at baseline.”
MethodEffect of smoking cessation on non‐surgical periodontal therapy: results after 24 months
Rosa, E. F., Corraini, P., Inoue, G., Gomes, E. F., Guglielmetti, M. R., Sanda, S. R., Lotufo, J. P. B., Romito, G. A., & Pannuti, C. M. (2014) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.12313 · Cited by 44
Yang, P.-K., Chou, C.-H., Chang, C., Chen, S., Ho, H., & Chen, M. (2020) · Reproductive Biology and Endocrinology · doi:10.1186/s12958-020-00629-5 · Cited by 44
van Bussel, B. C. T., Henry, R. M. A., Schalkwijk, C., Dekker, J. M., Nijpels, G., Feskens, E. J. M., & Stehouwer, C. D. A. (2017) · European Journal of Nutrition · doi:10.1007/s00394-017-1420-4 · Cited by 43
“For these individuals, we imputed the missing post-cuff release diameter(s) with a longitudinal regression method [23].”
MethodJönsson, B., Baker, S. R., Lindberg, P., Oscarson, N., & Öhrn, K. (2012) · Journal Of Clinical Periodontology · doi:10.1111/j.1600-051x.2011.01822.x · Cited by 43
“Intentions to treat analyses (Twisk & de Wente 2002) were applied on complete data sets after missing data had been imputed through the last value carried forward method and for GI linear inter-polation imputation method (according to SPSS 15.0).”
MethodInfluentialSelf-Management of Persistent Neck Pain
Gustavsson, C., Denison, E., & von Koch, L. (2011) · Spine · doi:10.1097/brs.0b013e3182028b04 · Cited by 42
Lechat, T., & Torrès, O. (2016) · Revue internationale P M E Économie et gestion de la petite et moyenne entreprise · doi:10.7202/1038335ar · Cited by 53
Kuo, P., Wu, S., Chien, P., Rau, C., Chen, Y., Hsieh, H.-Y., & Hsieh, C. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018252 · Cited by 40
Lennon, O. C., & Blake, C. M. (2009) · BMC Neurology · doi:10.1186/1471-2377-9-9 · Cited by 40
“A last measurement carried forward method will be used to predict outcome where drop-outs occur [46].”
MethodDuncan, M. J., Vandelanotte, C., Rosenkranz, R. R., Caperchione, C. M., Ding, H., Ellison, M., George, E. S., Hooker, C., Karunanithi, M., Kolt, G. S., et al. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-656 · Cited by 42
“Linear mixed models and generalized estimating equations will be used to compare intervention groups across time points [50].”
MethodSingle-case experimental research designs.
Kazdin, A. E. (2015) · Methodological issues and strategies in clinical research (4th ed.). · doi:10.1037/14805-029 · Cited by 39
Pool, J., Ostelo, R., Köke, A., Bouter, L., & de Vet, H. D. (2006) · Manual Therapy · doi:10.1016/j.math.2005.07.006 · Cited by 47
Rastad, C., Ulfberg, J., & Lindberg, P. (2007) · Journal of Affective Disorders · doi:10.1016/j.jad.2007.10.009 · Cited by 38
Grégoire, S., Beaulieu, F., Lachance, L., Bouffard, T., Vezeau, C., & Perreault, M. (2024) · Journal of American College Health · doi:10.1080/07448481.2022.2099224 · Cited by 41
“MANCOVAs and ANCOVAs were first conducted according to the intention-to-treat (ITT) principles using the last-observation-carried-forward method 74 on the conservative assumption that students who did not complete T2 or T3 should not experience significant changes during the intervention.”
Modern Statistical Modeling Approaches for Analyzing Repeated-Measures Data
Hayat, M. J., & Hedlin, H. (2012) · Nursing Research · doi:10.1097/nnr.0b013e31824f5f58 · Cited by 39
de Koning, E. J., Timmermans, E. J., van Schoor, N. M., Stubbs, B., van den Kommer, T. N., Dennison, E. M., Limongi, F., Castell, M. V., Edwards, M. H., Queipó, R., et al. (2018) · Journal of Pain · doi:10.1016/j.jpain.2018.02.006 · Cited by 38
Manifest Conflict and Conflict Aftermath in Franchise Systems: A 10-Year Examination*
Winsor, R. D., Manolis, C., Kaufmann, P. J., & Kashyap, V. (2012) · Journal of Small Business Management · doi:10.1111/j.1540-627x.2012.00369.x · Cited by 42
Jönsson, B., Öhrn, K., Lindberg, P., & Oscarson, N. (2012) · Journal Of Clinical Periodontology · doi:10.1111/j.1600-051x.2012.01898.x · Cited by 37
Predictors for treatment outcomes after corneal crosslinking for keratoconus: a validation study
Godefrooij, D. A., Boom, K., Soeters, N., Imhof, S. M., & Wisse, R. P. L. (2016) · International Ophthalmology · doi:10.1007/s10792-016-0262-z · Cited by 37
“Five patients missed the 12-month follow-up visit, but they did attend the 6- and 18-month visits; for these patients, simple longitudinal imputation was used to estimate their CDVA andKmax values at 12 months [26].”
MethodAnholt, G. E., Kempe, P., de Haan, E., van Oppen, P., Cath, D. C., Smit, J. H., & van Balkom, A. J. L. M. (2007) · Psychotherapy and Psychosomatics · doi:10.1159/000110058 · Cited by 37
Jaafar, M. H., Mahadeva, S., Tan, K. M., Chin, A., Kamaruzzaman, S. B., Khor, H. M., Saedon, N. I., & Tan, M. P. (2018) · Nutrition in Clinical Practice · doi:10.1002/ncp.10195 · Cited by 36
Chirwa, E. D., Griffiths, P. L., Maleta, K. M., Norris, S. A., & Cameron, N. (2013) · Annals of Human Biology · doi:10.3109/03014460.2013.839742 · Cited by 36
“G oodn e ss - o f -f it s t a ti s ti c s f r o m f itti ng g r o w t h m od e l s t o h e i gh t m ea s u r e m e n t s ( i n ce n ti m e t r e s ) fr o m 3 m on t h s t o 10 y ea r s . number of data points per individual (Twisk & de Vente, 2002; Twisk, 2004).”
Tough, H., Brinkhof, M. W. G., Siegrist, J., & Fekete, C. (2018) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2018.04.009 · Cited by 38
The Fate of Patients Not Returning for Follow-up Five Years After Total Knee Arthroplasty
King, P. J., Malin, A. S., Scott, R. D., & Thornhill, T. S. (2004) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-200405000-00002 · Cited by 35
García, M., Fernández, E., Schiaffino, A., Borrell, C., Martí, M., & Borràs, J. M. (2004) · Annals of Epidemiology · doi:10.1016/j.annepidem.2004.06.002 · Cited by 35
Lung function in lambs with diaphragmatic hernia after reversible fetal tracheal occlusion
Bratu, I., Flageole, H., Laberge, J., Kovács, L., Faucher, D., & Piedbœuf, B. (2004) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2004.06.024 · Cited by 35
Developmental Changes in Cross‐Situational Word Learning: The Inverse Effect of Initial Accuracy
Fitneva, S. A., & Christiansen, M. H. (2015) · Cognitive Science · doi:10.1111/cogs.12322 · Cited by 35
Zafar, F., Jaquiss, R. D. B., Almond, C. S. D., Lorts, A., Chin, C. C., Rizwan, R., Bryant, R., Tweddell, J. S., & Morales, D. L. S. (2017) · The Journal of Heart and Lung Transplantation · doi:10.1016/j.healun.2017.03.002 · Cited by 34
“An interpolation technique was used for linear imputation of the LVEF variable.(13) Means and distribution of the LVEF variable were compared between the raw and post-imputation data and are presented in the accompanying material (see appendix in Figure S1 of Supplementary Material, available online at www.”
MethodXia, J., Pan, S., Zhu, M., Cai, G., Yan, M., Su, Q., Yan, J., & Ning, G. (2019) · Computational and Mathematical Methods in Medicine · doi:10.1155/2019/8152713 · Cited by 39
“Before the training procedure, data are preprocessed by imputation and normalization. missing values are filled by linear interpolation imputation method, assuming a linear development in time of the variable with missing data [48].”
MethodMcCarthy, K., Chersich, M., Vearey, J., Meyer‐Rath, G., Jaffer, A., Simpwalo, S., & Venter, F. (2009) · International Journal of STD & AIDS · doi:10.1258/ijsa.2009.009258 · Cited by 34
Comans, T. A., Brauer, S., & Haines, T. P. (2010) · The Journals of Gerontology Series A · doi:10.1093/gerona/glq054 · Cited by 32
“The GEE is a flexible way of analyzing this type of design and can be adapted for a range of data distributions for the dependent variable and produces relatively precise and unbiased estimates even in presence of missing data (missing at random, missing completely at random, or missing not at random) without need for…”
BackgroundSelf‐reported dry mouth among ageing people: a longitudinal, cross‐national study
Åstrøm, A., Lie, S., Ekback, G., Gülcan, F., & Ordell, S. (2018) · European Journal of Oral Sciences · doi:10.1111/eos.12601 · Cited by 31
Educational Attainment and Nonwage Labor Market Returns in the United States
Schudde, L. T., & Bernell, K. (2019) · AERA Open · doi:10.1177/2332858419874056 · Cited by 37
“Living in areas with few employers or with high unemployment may negatively affect the number of employment opportunities and the quality of the jobs available (Benmelech, Bergman, & Kim, 2018; Fields, 1975; Thiede, Lichter, & Slack, 2018).”
BackgroundCheng, A. A., Zamarro, G., & Orriens, B. (2016) · Sociological Methods & Research · doi:10.1177/0049124117747305 · Cited by 39
Chen, L.-H., Liang, J., Chen, M.-C., Wu, C., Cheng, H., Wang, H.-H., & Shyu, Y. L. (2017) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-017-1768-x · Cited by 33
“In longitudinal studies, GEE analysis is especially useful for data belonging to participants who die or are lost to follow up; analysis can be applied to attrition without using imputation [22].”
Fabre, V., Wu, H.-W., Pond‐Tor, S., Coutinho, H. M., Acosta, L. P., Jiz, M., Olveda, R. M., Cheng, L., White, E. S., Jarilla, B. R., et al. (2011) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiq099 · Cited by 32
“Intermittent missing stool samples were imputed using the same method [24].”
MethodFactors Related to Accelerometer-Derived Physical Activity in Pacific Children Aged 6 Years
Oliver, M., Schluter, P., Schofield, G., & Paterson, J. (2011) · Asia-Pacific journal of public health · doi:10.1177/1010539510370992 · Cited by 31
Goettsch, W., Yin, D., Alemao, E., Klungel, O. H., Stalenhoef, A. F. H., & Herings, R. M. C. (2004) · Current Medical Research and Opinion · doi:10.1185/030079904125004114 · Cited by 32
“It has been indicated that GEE with and without several methods of imputations of the missing values will deliver similar point estimates only with small differences in the estimated standard errors 31 .”
Axial Elongation Trajectories in Chinese Children and Adults With High Myopia
Zhang, S., Chen, Y., Li, Z., Wang, W., Xuan, M., Zhang, J., Hu, Y. C., Chen, Y., Ou, X., Yin, Q., et al. (2023) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2023.5835 · Cited by 31
Širovnik, J., Würbel, H., & Toscano, M. J. (2017) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2017.09.017 · Cited by 31
Long-term follow-up after cognitive behaviour therapy for chronic fatigue syndrome
Janse, A., Nikolaus, S., Wiborg, J. F., Heins, M., van der Meer, J. W. M., Bleijenberg, G., Tummers, M., Twisk, J., & Knoop, H. (2017) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2017.03.016 · Cited by 30
Schlüter, P. J., Lee, M., Hamilton, G., Coe, G., Messer‐Perkins, H., & Smith, B. (2014) · Journal of Public Health Dentistry · doi:10.1111/jphd.12079 · Cited by 29
Grönstedt, H. K., Hellström, K., Bergland, A., Helbostad, J. L., Puggaard, L., Andresen, M., Granbo, R., & Frändin, K. (2011) · Aging Clinical and Experimental Research · doi:10.1007/bf03337766 · Cited by 30
Paratz, J. D., Kenardy, J., Mitchell, G., Comans, T., Coyer, F., Thomas, P., Singh, S., Luparia, L., & Boots, R. J. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-004966 · Cited by 29
“The GEE is a flexible technique that takes into account the correlations among individuals in longitudinal study designs and can account for missing data without a need for imputation techniques.(46)”
Method
Metadata
- Authors
- Twisk, J., & de Vente, W.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Twisk, Jos
- ORCID
- Twisk, Jos
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2002-04
- Volume
- 55
- Issue
- 4
- Pages
- 329-337
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2032594557
- Cited by
- 527
- References
- 18
- Citations by year
- 2026: 18 · 2025: 15 · 2024: 9 · 2023: 20 · 2022: 24 · 2021: 43 · 2020: 18 · 2019: 36 · 2018: 28 · 2017: 27 · 2016: 26 · 2015: 23 · 2014: 29 · 2013: 28 · 2012: 27
- FWCI
- 14.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- attrition, missing data, longitudinal study, imputation methods, multiple imputation, generalized estimating equations, listwise deletion, hot deck imputation, cross-sectional regression, standard errors
- MeSH terms
- Analysis of Variance, Data Interpretation, Statistical, Epidemiologic Methods, Humans, Longitudinal Studies, Mathematical Computing, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review