Handling Attrition in Longitudinal Studies: The Case for Refreshment Samples
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Panel studies typically suffer from attrition, which reduces sample size and can result in biased inferences. It is impossible to know whether or not the attrition causes bias from the observed panel data alone. Refreshment samples - new, randomly sampled respondents given the questionnaire at the same time as a subsequent wave of the panel - offer information that can be used to diagnose and adjust for bias due to attrition. We review and bolster the case for the use of refreshment samples in panel studies. We include examples of both a fully Bayesian approach for analyzing the concatenated panel and refreshment data, and a multiple imputation approach for analyzing only the original panel. For the latter, we document a positive bias in the usual multiple imputation variance estimator. We present models appropriate for three waves and two refreshment samples, including nonterminal attrition. We illustrate the three-wave analysis using the 2007-2008 Associated Press-Yahoo! News Election Poll.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012 · cited 2×
“As in other missing data contexts, model-based and multiple imputation approaches have differential advantages (Schafer (1997)).”
BackgroundMethodFitzmaurice, G. M., Laird, N. M., & Ware, J. H. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781119513469 · Cited by 4,639
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072
What to do about missing values in time series cross- section data
Honaker, J., & King, G. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2010.00447.x · Cited by 966 · cited 2×
“Given the well-known limitations of single imputation methods (Little and Rubin, 2002), multiple imputation (see Section 3) also has been used to handle missing data from attrition (e.g., Pasek et al., 2009; Honaker and King, 2010).”
MethodStruggles with Survey Weighting and Regression Modeling
Gelman, A. (2007) · Statistical Science · doi:10.1214/088342306000000691 · Cited by 604
Using Survey Participants to Estimate the Impact of Nonparticipation
Lin, I.-F., & Schaeffer, N. C. (1995) · Public Opinion Quarterly · doi:10.1086/269471 · Cited by 356
Applications of multiple imputation in medical studies: from AIDS to NHANES
Barnard, J., & Meng, X.-L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800103 · Cited by 340 · cited 1×
“See Rubin (1996), Barnard and Meng (1999) and Reiter and Raghunathan (2007) for reviews of multiple imputation.”
BackgroundExtent and Determinants of Panel Attrition in the European Community Household Panel
Behr, A., Bellgardt, E., & Rendtel, U. (2005) · European Sociological Review · doi:10.1093/esr/jci037 · Cited by 163
Cited by
O’Meara, K., Kuvaeva, A., Nyunt, G., Waugaman, C., & Jackson, R. (2017) · American Educational Research Journal · doi:10.3102/0002831217716767 · Cited by 292
The registration continuum in clinical science: A guide toward transparent practices
Benning, S. D., Bachrach, R. L., Smith, E. A., Freeman, A. J., & Wright, A. G. C. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000451 · Cited by 77
Assessing the Efficacy of an App-Based Method of Family Planning: The Dot Study Protocol
Simmons, R. G., Shattuck, D. C., & Jennings, V. H. (2017) · JMIR Research Protocols · doi:10.2196/resprot.6886 · Cited by 27
“Quarterly, the IRH study team will evaluate the discontinuation rate and determine whether new or additional recruitment efforts for the study will be deployed [22].”
Gadosey, C. K., Grunschel, C., Kegel, L. S., Schnettler, T., Turhan, D., Scheunemann, A., Bäulke, L., Thomas, L., Buhlmann, U., Dresel, M., et al. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.918367 · Cited by 17
Toniolo-Barrios, M., & ten Brummelhuis, L. L. (2023) · Personality and Individual Differences · doi:10.1016/j.paid.2023.112392 · Cited by 13
Metadata
- Authors
- Deng, Y., Hillygus, D. S., Reiter, J. P., Si, Y., & Zheng, S.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2013-05-01
- Volume
- 28
- Issue
- 2
- ISSN
- 2331-8422 (ISSN-L)
- 0883-4237
- OpenAlex
- W1981398148
- Cited by
- 115
- References
- 11
- Type
- posted content
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Handling Attrition in Longitudinal Studies: The Case for Refreshment Samples. https://app.cochat.ai/papers/10.1214/13-sts414
- The paper
- Deng, Y., Hillygus, D. S., Reiter, J. P., Si, Y., & Zheng, S. (2013). Handling Attrition in Longitudinal Studies: The Case for Refreshment Samples. Statistical Science. https://doi.org/10.1214/13-sts414
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.