The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Attrition in longitudinal studies
Abstract
The purpose of this paper was to illustrate the influence of missing data on the results of longitudinal statistical analyses [i.e., MANOVA for repeated measurements and Generalised Estimating Equations (GEE)] and to illustrate the influence of using different imputation methods to replace missing data. Besides a complete dataset, four incomplete datasets were considered: two datasets with 10% missing data and two datasets with 25% missing data. In both situations missingness was considered independent and dependent on observed data. Imputation methods were divided into cross-sectional methods (i.e., mean of series, hot deck, and cross-sectional regression) and longitudinal methods (i.e., last value carried forward, longitudinal interpolation, and longitudinal regression). Besides these, also the multiple imputation method was applied and discussed. The analyses were performed on a particular (observational) longitudinal dataset, with particular missing data patterns and imputation methods. The results of this illustration shows that when MANOVA for repeated measurements is used, imputation methods are highly recommendable (because MANOVA as implemented in the software used, uses listwise deletion of cases with a missing value). Applying GEE analysis, imputation methods were not necessary. When imputation methods were used, longitudinal imputation methods were often preferable above cross-sectional imputation methods, in a way that the point estimates and standard errors were closer to the estimates derived from the complete dataset. Furthermore, this study showed that the theoretically more valid multiple imputation method did not lead to different point estimates than the more simple (longitudinal) imputation methods. However, the estimated standard errors appeared to be theoretically more adequate, because they reflect the uncertainty in estimation caused by missing values.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“GEE allows for not using imputation methods for the missing data, because the participants with missing data are not excluded from the analysis [46].”
From Fibrates as drugs with senolytic and autophagic activity for osteoarthritis therapy (2019) · cites this paper as [46]
In the citing paper
“We chose GEE models because EMA data have a hierarchical structure; this type of model adjusts for dependency of repeated measures within one participant and can handle non-normally distributed data. GEE models are also suitable for dealing with missing data; it is not required to exclude participants with missing questionnaires, nor should missing questionnaires be imputed beforehand.”
From Experienced burden of and adherence to smartphone-based ecological momentary assessment in persons with affective disorders (2020) · cites this paper as [29]
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
Applied Regression Analysis and Other Multivariable Methods
Walker, E., Kleinbaum, D. G., Kupper, L. L., & Muller, K. E. (1989) · Technometrics · doi:10.2307/1270375 · Cited by 8,538
Longitudinal Data Analysis for Discrete and Continuous Outcomes
Zeger, S. L., & Liang, K. (1986) · Biometrics · doi:10.2307/2531248 · Cited by 7,781
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072
Multiple Imputation After 18+ Years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.2307/2291635 · Cited by 2,686
Multiple Imputation for Nonresponse in Surveys.
Lynn, P. J., & Rubin, D. B. (1988) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348774 · Cited by 2,330
Statistical Analysis with Missing Data.
Chatfield, C., Little, R. J. A., & Rubin, D. B. (1988) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2982783 · Cited by 2,203
Cited by
Sorted by citations
Items 401–500 of 526
Clinical Decision Support for Skin Tumor Treatment: A Case-Based Reasoning Approach
Kuhn, M., Warnecke, Y., Preciado-Marquez, D., Grüger, J., Bley, L. I., Storck, M., Weishaupt, C., Bergmann, R., & Braun, S. A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-96559-3_27 · Cited by 1
Spangler, H., Lynch, D. H., Xie, W., Daneshvar, N., Chen, H., Lin, F.-C., Vásquez, E., & Batsis, J. A. (2026) · Journal of Ageing and Longevity · doi:10.3390/jal6010006 · Cited by 1
“GEEs also accounted for participants who died or were no longer community-dwelling at any point in the study [24].”
Best Practices in Handling Missing Data in Psychological Research
Moreau, D. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261444273 · Cited by 1
Differentiating Intermittent Missingness from Dropout in Dynamic Structural Equation Models
McNeish, D. (2026) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2026.2677598 · Cited by 1
Statistical methods for missing data in complex sample surveys.
Little, R. J. A., & Andridge, R. (2011) · Cited by 1
Gender Neutral? An Empirical Test of Life-course Theor ies of Criminal Behaviour
Thompson, J. M. (2012) · Scholarship@Western (Western University) · Cited by 1
Coffman, B. A. (2014) · UNM’s Digital Repository (University of New Mexico) · Cited by 1
A MULTIPLE CLASSIFIER SYSTEM FOR PREDICTING WITH MISSING SENSOR VALUES
Rahman, A., Zhang, Q., & D’Este, C. (2014) · Advances in Adaptive Data Analysis · doi:10.1142/s1793536914500095 · Cited by 1
Skues, J. (2010) · Swinburne figshare (Swinburne University of Technology) · doi:10.25916/sut.26284078 · Cited by 1
An Introduction to Common Systematic Errors in Medical Research
Almasi‐Hashiani, A., Hassanzadeh, J., Eshrati, B., & Khedmati, E. (2012) · Zahedan Journal of Research in Medical Sciences · Cited by 1
Wallis, D. J. (2013) · Cited by 1
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.013 · Cited by 1
Registries in Spine Care: UK and Europe
Meyer, B., Shiban, E., & Krieg, S. M. (2018) · Springer eBooks · doi:10.1007/978-3-319-97990-8_7 · Cited by 1
Goda, J. S., Lewis, S. C., Laskar, S., Kannan, S., Khanna, N. R., Jain, H., Bagal, B. P., & Epari, S. (2019) · Cancer Reports · doi:10.1002/cnr2.1161 · Cited by 1
“Generalized estimating equations (GEE) modeling will also be used as a subsidiary analysis for reporting the longitudinal changes in QOL data.(19)”
MethodComparison of Two Frameworks for Analyzing Longitudinal Data
Zhou, J., Zhou, X., & Sun, L. (2021) · Statistical Science · doi:10.1214/20-sts813 · Cited by 1
Internal and External Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.003 · Cited by 1
Holleman, M. S., Huygens, S. A., Al, M., Kuppen, M. C. P., Westgeest, H. M., den Bergh, A. C. M. V., Bergman, A. M., van den Eertwegh, A. J. M., Hendriks, M. P., Lampe, M. I., et al. (2022) · Drugs - Real World Outcomes · doi:10.1007/s40801-022-00294-7 · Cited by 1
“Moreover, PSM is not feasible for the comparison of more than two treatment options [27, 28].”
BackgroundMeta-Analysis on Individual Participant Data
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.012 · Cited by 1
Bal, M. I., Hilberink, S. R., Roelofs, P. D. D. M., van der Slot, W. M. A., Bentvelsen, L., Miedema, H. S., & Roebroeck, M. E. (2023) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038128.2023.2228019 · Cited by 1
“A GEE-model was chosen because a) it corrects for dependency of observations within an individual and for missing values; and b) it is robust for relatively small sample sizes [45].”
BackgroundMethodPetousis, P., Wilson, J. M., Gelvezon, A. V., Alam, S., Jain, A., Prichard, L., Elashoff, D. A., Raja, N., & Bui, A. A. T. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooae015 · Cited by 2
Hidalgo-Rasmussen, C. A., Zurita-Aguilar, K. A., Torres-Chávez, L. J., Rosales-Damián, G., & Telles, F. S. (2024) · TEMPUS PSICOLÓGICO · doi:10.30554/tempuspsi.7.2.5145.2024
Making the cut: Investigating body image and well-being among female powerlifters
Tremonte, I. L., Mack, D. E., Wilson, P. M., & Sabiston, C. M. (2025) · Performance Enhancement & Health · doi:10.1016/j.peh.2025.100333 · Cited by 1
Recovering knot placements in Bayesian piecewise growth models with missing data
Heo, I., Jia, F., & Depaoli, S. A. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02716-0 · Cited by 1
“1 A path diagram for the population model in which the presence of missing values at a specific occasion ensured missing values in subsequent occasions (Nicholson et al., 2017; Twisk & de Vente, 2002; Winter & Depaoli, 2022).”
Mixed Model Analysis with Different Outcome Variables
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.006 · Cited by 1
Case-Control and Cohort Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.008 · Cited by 1
Null Hypothesis Significance Testing
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.014 · Cited by 1
Winter Fatigue and Winter Depression : Prevalence and Treatment with Bright Light
Rastad, C. (2009) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 1
Interrelations between process and outcome measures over the course of rheumatoid arthritis.
Welsing, P. M. J. (2005) · Radboud Repository (Radboud University) · Cited by 1
Letter by Patel Regarding Article, “A Primer in Longitudinal Data Analysis”
Patel, C. B. (2009) · Circulation · doi:10.1161/circulationaha.108.836767 · Cited by 1
Context Matters: Uncovering Factors Influencing Charges of Religious Workplace Discrimination
Ahmad, A. S. (2017) · Academy of Management Proceedings · doi:10.5465/ambpp.2017.17089abstract · Cited by 1
INTERDEPENDENCE AND INTERPERSONAL INFLUENCE AMONG INDIVIDUAL SPORT TEAMMATES
Evans, M. B. (2014)
Health and service use in old age: longitudinal population based studies in Taiwan
Chen, C. (2009) · Research Online (University of Wollongong)
Longitudinal, Model-Based Clustering with Missing Data
Franzén, J. (2008)
Costs and Outcomes in Hemodialysis and Hemodiafiltration
Mazairac, A. H. A. (2011) · Utrecht University Repository (Utrecht University)
Martínez, M. G. (2004) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
van Zuilen, A. D. (2011) · Utrecht University Repository (Utrecht University)
Pannuti, C. M. (2014) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.23.2014.tde-01122014-145231
Rosa, E. F. (2014) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.23.2014.tde-18092014-134132
Coutinho, H. M. (2006) · Utrecht University Repository (Utrecht University)
Innovative Modeling of Outcome in Cardiac Surgery
Mokhles, M. M. (2013) · RePub (Erasmus University Rotterdam)
Effects of telemonitoring in patients with heart failure
Boyne, J. J. (2013) · doi:10.26481/dis.20131213jb
Milking the sevelamer-calcium debate
Chertow, G. M., & Raggi, P. (2003) · Kidney International · doi:10.1046/j.1523-1755.2003.341_11.x
The performance of missing data treatments for longitudinal data with a time-varying covariate
Adachi, E. (2005) · Texas ScholarWorks (Texas Digital Library)
van den Kommer, T. N. (2011) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam)
Exhaled nitric oxide and asthma in childhood
van der Valk, R. J. P. (2013)
Conway, R. J. (2014) · Arrow@dit (Dublin Institute of Technology) · doi:10.13025/17694
Rosa, E. F. (2011) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.23.2011.tde-18062011-103619
Efeito de um programa antitabágico na perda dentária: estudo prospectivo intervencional de 24 meses
Gomes, E. F. (2013) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.23.2013.tde-02092013-164835
Niboro, R. D. (2015) · KU ScholarWorks (The University of Kansas)
Ser, G., & Bati, C. T. (2015) · Turkish Journal of Agriculture - Food Science and Technology · doi:10.24925/turjaf.v3i12.926-932.511
Elective orthopaedic surgery in patients with inflammatory arthropathies
Ringen, H. O. (2010) · NORA - Norwegian Open Research Archives
Longitudinal Effects of Cognitive Reserve and Vascular Risks in Aging and Dementia
Lo, Y. Y. (2012) · eScholarship (California Digital Library)
2531 Measuring the quality of personal care in prostate cancer radiotherapy
Foley, K., Groome, P. A., Feldman‐Stewart, D., Brundage, M., McArdle, S., & Mackillop, W. J. (2015) · European Journal of Cancer · doi:10.1016/s0959-8049(16)31350-8
Temel, G. Ö., Erdoğan, S., SELVİ, H., & Kaya, İ. E. (2016) · Educational Sciences Theory & Practice · doi:10.12738/estp.2016.4.0080
“In longitudinal studies where inter-rater reliability is investigated, there may be various error sources that are time based and exclusive of the investigated variable since longitudinal studies involve taking repeated measures in different time frames (Twisk & Vente, 2002).”
BackgroundThe harmonisation of stroke datasets: A case study of four UK datasets
Munyombwe, T. (2016) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Ireland, A. M. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/1pfa-v477
Lin, M.-Y. (2016) · Durham e-Theses (Durham University)
Milner, A. J. (2010) · Griffith Research Online · doi:10.25904/1912/3533
Sarasvita, R. (2010) · Adelaide Research & Scholarship (AR&S) (University of Adelaide)
Dealing with Attrition and Missing Data in Longitudinal Studies: A Critique
Mutua, M. N., Mogeni, S. H., & Kilonzi, J. M. (2018) · International Journal of Sciences: Basic and Applied Research
Classifying drug-induced epileptic seizures in zebrafish larvae
Níelsdóttir, L. (2015)
A longitudinal examination of the motivation and mental health of elite athletes
Sheehan, R. B. (2018) · University of Limerick Institutional Repository (University of Limerick) · doi:10.34961/5974
Creación de un índice de movilidad para rankings de hoteles
de Sandoval, J. L. X., Morales, A., & Plaza, A. J. G. (2019) · Revista de Métodos Cuantitativos para la Economía y la Empresa · doi:10.46661/revmetodoscuanteconempresa.3060 · Cited by 1
“No obstante, es importante identificar las causas de esta pérdida de información para realizar una adecuada interpretación de los resultados (Twisk & De Vente, 2002).”
BackgroundResponse to Dr. Watts letter on “The impact of computer use on myopia development in childhood”
Enthoven, C. A., & Klaver, C. C. W. (2020) · Preventive Medicine · doi:10.1016/j.ypmed.2020.106069
Basic Principles of Mixed Model Analysis
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.003
Similarity-Based Data-Fusion Schemes for Missing Data Imputation in Univariate Time Series Data
Nickolas, S., & Shobha, K. (2021) · Algorithms for intelligent systems · doi:10.1007/978-981-15-7533-4_12
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.014
Physical activity trajectories of hospitalized patients: a latent class analysis
Bakker, S. (2021) · Utrecht University Repository (Utrecht University)
Methodological issues to analyse real-world longitudinal occupational health data (Preprint)Preprint
Colin-Chevalier, R., Dutheil, F., Dewavrin, S., Cornet, T., Baker, J. S., & Pereira, B. (2021) · doi:10.2196/preprints.35068
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.001
Construct and Data-Evaluation Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.004
Single-Case Experimental Research Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.009
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.007
Cautions, Negative Effects, and Replication
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.016
Selecting Measures for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.011
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.021
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.013
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.022
Ideas that Begin the Research Process
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.005
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.020
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.025
Presenting and Analyzing the Data
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.015
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.024
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.018
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.002
Assessment: Types of Measures and Their Use
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.012
Experimental Research Using Group Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.006
Ethical Issues and Guidelines for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.017
Communication of Research Findings
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.019
de Jonge, E., & van der Loo, M. (2018) · Wiley eBooks · doi:10.1002/9781118897126.refs
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.005
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.016
What Is Gained by Using Mixed Model Analysis?
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.004
Twisk, J. W. R. (2019) · doi:10.1017/9781108635660.001
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.002
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.015
Predictions Based on Mixed Model Analysis
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660.009
Metadata
- Authors
- Twisk, J., & de Vente, W.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Twisk, Jos
- ORCID
- Twisk, Jos
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2002-04
- Volume
- 55
- Issue
- 4
- Pages
- 329-337
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2032594557
- Cited by
- 527
- References
- 18
- Citations by year
- 2026: 18 · 2025: 15 · 2024: 9 · 2023: 20 · 2022: 24 · 2021: 43 · 2020: 18 · 2019: 36 · 2018: 28 · 2017: 27 · 2016: 26 · 2015: 23 · 2014: 29 · 2013: 28 · 2012: 27
- FWCI
- 14.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- attrition, missing data, longitudinal study, imputation methods, multiple imputation, generalized estimating equations, listwise deletion, hot deck imputation, cross-sectional regression, standard errors
- MeSH terms
- Analysis of Variance, Data Interpretation, Statistical, Epidemiologic Methods, Humans, Longitudinal Studies, Mathematical Computing, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review