Participation in Population Studies
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Many areas of epidemiologic practice are flourishing as population registries, and other large databases make it easier than ever to collect the information researchers seek on virtually all the individuals they have defined as eligible. Meanwhile, in studies that require participants to respond (by being interviewed or completing a questionnaire, or by providing biologic samples), epidemiologists face a real and growing threat from nonparticipation. We are not alone in our predicament, because survey researchers in general report that they must spend more effort to get even moderate response rates. It appears that the very high response rates of earlier decades are no longer within reach today. We must first understand the scope and nature of the problem, soberly evaluate our current practices, and then look for major changes that will take us forward. Are Response Rates Today Actually Poor? To assess the state of response rates, we rely on reporting in the journal articles. Analytic epidemiology studies published in 2003 in 10 high-impact journals in epidemiology (American Journal of Epidemiology; Annals of Epidemiology; Cancer Epidemiology, Biomarkers and Prevention; EPIDEMIOLOGY; International Journal of Epidemiology; and Journal of Clinical Epidemiology), public health (American Journal of Public Health), and medicine (Lancet, New England Journal of Medicine, and Journal of the American Medical Association) showed remarkable patterns both in the reporting of response rates and in the rates achieved.1 Authors provided some information on participation—either the “response rate” of participants divided by the total eligible or the “participation rate” of participants divided by the subtotal of eligible living persons approached for the study (or the numbers with which to calculate one or both rates)—for only 41% of cross-sectional, 56% of case–control, and 68% of cohort studies. Publications in 2003 included studies conducted over many years; average participation fell from 1970 to 2002 for all designs and most steeply for controls in population-based studies. In such control groups, participation rates of 70% and response rates of 50% are not uncommon today. During the past 3 decades, proportionally more studies have collected biologic specimens, but fewer than 3 in 10 reported participation for the specimen component. Is Poor Participation Introducing Substantial Bias in our Estimates? Epidemiologists measure the association between an exposure and health outcome by choosing the right effect parameter, estimating it, calculating the imprecision, and considering the possible direction and magnitude of the bias. For rate ratios, the “bias factor” (estimated rate ratio divided by the true rate ratio) is the parameter that captures direction and magnitude of bias.2 In the case–control setting, the willingness to participate (W) may or may not vary with a particular exposure. Expressed mathematically, the “bias ratio” (WE, for the exposed, divided by WU for the unexposed) may or may not be 1.0, and it may be different in cases (WEcase/WUcase) than in controls (WEcontrol/WUcontrol). The bias ratio thus becomes WEcase/WUcase/WEcontrol/WUcontrol. Several implications emerge immediately. A 70% response rate in cases and 60% in controls could create almost no bias for one exposure yet large bias for another exposure within the same study. Equal response rates in cases and controls offer no protection if the relevant correlates of nonparticipation are different in the sick and the healthy, as they so often are. On the other hand, rather poor response rates may be nothing to worry about if willingness is essentially unrelated to exposure. Even if willingness differs with exposure, bias still will not result unless this tendency is stronger (or weaker) in cases than in controls. This pattern is hard to gauge, but it is the real threat. How Sensible is Sensitivity Analysis? Careful investigation of the statistical structure of bias has uncovered subtle features and variations of this central paradigm and doubtless will yield more. We and our statistically sophisticated colleagues should pursue this area. Meanwhile, we all should exploit the simple insights uncovered by the bias ratio and use sensitivity analyses to explore the impact of plausible levels of differential response for a particular exposure in a particular study. Sometimes, the exposure in question (even just the simplest yes/no version of exposure) has been measured in another study with a high response rate. The established correlates of the exposure then can inform the model of the probable determinants of nonresponse. With such a model, a range of the likely risk ratios or other effect estimates can be constructed. Second, if the effect parameters in one study agree closely with those from studies with other designs, one can take some comfort. Another tack is to exploit contrasts within the study. One might look across related exposures within the s
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Response rates among control subjects in case-control studies☆
Slattery, M. L., Edwards, S. L., Caan, B. J., Kerber, R. A., & Potter, J. D. (1995) · Annals of Epidemiology · doi:10.1016/1047-2797(94)00113-8 · Cited by 167
Reported Participation in Case-Control Studies: Changes over Time
Olson, S. H. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.6.574 · Cited by 53
Cited by
Genome-wide association analysis identifies 13 new risk loci for schizophrenia
Multicenter Genetic Studies of Schizophrenia Consortium, Ripke, S., Psychosis Endophenotypes International Consortium, Wellcome Trust Case Control Consortium 2, O'Dushlaine, C., Chambert, K., Moran, J. L., Kähler, A. K., Akterin, S., Bergen, S. E., et al. (2013) · Nature Genetics · doi:10.1038/ng.2742 · Cited by 1,496
The INTERPHONE study: design, epidemiological methods, and description of the study population
Cardis, E., Richardson, L., Deltour, I., Armstrong, B., Feychting, M., Johansen, C., Kilkenny, M., McKinney, P., Modan, B., Sadetzki, S., et al. (2007) · European Journal of Epidemiology · doi:10.1007/s10654-007-9152-z · Cited by 270
Partner relationship satisfaction and maternal emotional distress in early pregnancy
Røsand, G.-M. B., Slinning, K., Eberhard-Gran, M., Røysamb, E., & Tambs, K. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-161 · Cited by 134
“Although this response rate is low, it is not uncommon in large epidemiologic studies and does not necessarily imply a biased sample [83].”
BackgroundPaternal Mental Health and Socioemotional and Behavioral Development in Their Children
Kvalevaag, A. L., Ramchandani, P. G., Hove, O., Assmus, J., Eberhard-Gran, M., & Biringer, E. (2013) · Pediatrics · doi:10.1542/peds.2012-0804 · Cited by 111
Røsand, G.-M. B., Slinning, K., Røysamb, E., & Tambs, K. (2014) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-013-0681-3 · Cited by 68
“However, this low response rate is not uncommon for large epidemiological studies and does not necessarily imply an unrepresentative sample [32].”
Background
Metadata
- Authors
- Hartge, P.
- Venue
- Epidemiology
- Published
- 2006-05
- Volume
- 17
- Issue
- 3
- Pages
- 252-254
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W2033889721
- Cited by
- 123
- References
- 2
- FWCI
- 44.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Participation in Population Studies. https://app.cochat.ai/papers/10.1097/01.ede.0000209441.24307.92
- The paper
- Hartge, P. (2006). Participation in Population Studies. Epidemiology. https://doi.org/10.1097/01.ede.0000209441.24307.92
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.