Assessing the non-random sampling effects of subject attrition in longitudinal research
Abstract
The potential effects of attrition in longitudinal research are addressed and a procedure for assessing its effects is recommended. We recommend that researchers assess the effects of subject attrition on their data by assessing: (1) the presence of non-random sampling using multiple logistic regression, (2) mean differences on the study’s variables between those who responded and did not respond to the subsequent data collection, (3) the restriction or enhancement of variances, and (4) changes in relationships among variables due to attrition. We demonstrate the procedure using data collected from a random sample of employed adults in the US regarding job satisfaction, job characteristics, demographics, and mood. In our data, subject attrition led to non-random sampling, affected the means and variances of some of the variables, but did not affect the relationships among the variables. The effects of subject attrition may be sample specific, but the procedure recommended for assessing its effects may be used in other data sets and substantive areas.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Attrition is especially common in addictions and longitudinal research.
“Attrition is especially common in addictions and longitudinal research (Goodman & Blum, 1996; Pulford et al., 2010; Stark, 1992)”
From Examining the Prospective Associations Between Mindfulness Facets and Substance Use in Emerging Adulthood. (2021) · cites this paper as Goodman & Blum, 1996
The data were missing at random.
“The attrition analysis based on the Goodman and Blum procedure (1996) suggested that our data was missing at random.”
From Reliability and validity of the Japanese version of the experiential avoidance in caregiving questionnaire (EACQ) (2023) · cites this paper as Goodman and Blum (1996)
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267 · see citing works
Job Demands, Job Decision Latitude, and Mental Strain: Implications for Job Redesign
Karasek, R. A. (1979) · Administrative Science Quarterly · doi:10.2307/2392498 · Cited by 12,597 · see citing works
Tests for comparing elements of a correlation matrix
Steiger, J. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.87.2.245 · Cited by 4,621 · see citing works
Pearson, K. (1903) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1903.0001 · Cited by 415 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Longitudinal Research: The Theory, Design, and Analysis of Change
Ployhart, R. E., & Vandenberg, R. J. (2010) · Journal of Management · doi:10.1177/0149206309352110 · Cited by 1,496 · see citing works
Gustavson, K., von Soest, T., Karevold, E., & Røysamb, E. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-918 · Cited by 679 · see citing works
Gámez-Guadix, M., Orue, I., Smith, P. K., & Calvete, E. (2013) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2013.03.030 · Cited by 532 · see citing works
Clinical trials: The challenge of recruitment and retention of participants
Gul, R. B., & Ali, P. A. (2010) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2009.03041.x · Cited by 449 · see citing works
Long-term Cognitive, Psychological, and Health Outcomes Associated With Child Abuse and Neglect
Strathearn, L., Giannotti, M., Mills, R., Kisely, S., Najman, J., & Abajobir, A. (2020) · Pediatrics · doi:10.1542/peds.2020-0438 · Cited by 401 · see citing works
Keith, M. G., Tay, L., & Harms, P. D. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01359 · Cited by 319 · see citing works
Child maltreatment and mental health problems in adulthood: birth cohort study
Kisely, S., Abajobir, A. A., Mills, R., Strathearn, L., Clavarino, A., & Najman, J. M. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.207 · Cited by 210 · see citing works
Feedback Specificity, Exploration, and Learning.
Goodman, J. S., Wood, R. E., & Hendrickx, M. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.2.248 · Cited by 201 · see citing works
Self-citationAfota, M., Provost Savard, Y., Léon, E., & Ollier‐Malaterre, A. (2024) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12494 · Cited by 40 · see citing works
Caudill, B. D., Luckey, B., Crosse, S. B., Blane, H. T., Ginexi, E. M., & Campbell, B. (2007) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2007.68.399 · Cited by 34 · see citing works
Single, A., & Keough, M. T. (2021) · Alcohol and Alcoholism · doi:10.1093/alcalc/agaa112 · Cited by 10 · see citing works
Morimoto, H., Kishita, N., Kondo, H., Tanaka, N., Abe, Y., & Muto, T. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.02.003 · Cited by 6 · see citing works
“An ICC value of 0.51 – 0.75 indicated moderate, 0.76 to 0.90 indicated good and 1 To assess the presence of non-random sampling, in accordance with Goodman and Blum (1996), the multiple logistic regression analysis was conducted to explore which participants would respond to both two surveys…”
MethodInfluentialFor whom and under what circumstances does email message batching work?
Wijngaards, I., Pronk, F. R., & Burger, M. J. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100494 · Cited by 6 · see citing works
Morimoto, H., Kishita, N., Kondo, H., & Muto, T. (2023) · Clinical Gerontologist · doi:10.1080/07317115.2022.2163951 · Cited by 4 · see citing works
- Authors
- Goodman, J. S., & Blum, T. C.
- Affiliations
- Purdue University West Lafayette (US)
- Georgia Institute of Technology (US)
- ORCID
- Blum, Terry C.
- Venue
- Journal of Management
- Publisher
- SAGE Publications
- Published
- 1996-08
- Volume
- 22
- Issue
- 4
- Pages
- 627-652
- ISSN
- 0149-2063 (ISSN-L)
- 1557-1211
- OpenAlex
- W2098396890
- Cited by
- 766
- References
- 4
- Citations by year
- 2026: 54 · 2025: 47 · 2024: 50 · 2023: 61 · 2022: 50 · 2021: 50 · 2020: 41 · 2019: 49 · 2018: 35 · 2017: 32 · 2016: 33 · 2015: 34 · 2014: 30 · 2013: 24 · 2012: 33
- FWCI
- 2.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Management (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Keywords
- non-probability sampling, longitudinal study, multivariate logistic regression, mean difference, job satisfaction, mood, working adults
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
