Reported Participation in Case-Control Studies: Changes over Time
Abstract
There is concern that participation in case-control studies has declined. To address this question, the author and colleagues reviewed data from 82 US and Canadian case-control studies published in epidemiologic journals during two periods: 1988-1990 and 1997-January 1999. The median year of data collection, which ranged from 1972 to 1996, was the primary independent variable. Reported response among both cases and controls remained constant over this time period. The regression coefficients (beta) were small: For each year, there was a change of 0.15 percentage points for cases (p = 0.56) and -0.16 percentage points for controls (p = 0.54). Possible confounders included the location where the study had been conducted and, for cases, the disease under study (cancer vs. others). After adjustment for these factors in case groups, there was still no association between year of data collection and response: For each year, there was a change of -0.20 percentage points (p = 0.43). After adjustment of results for study location among controls, there was a moderate decline over time: For each year, there was a change of -0.44 percentage points (p = 0.12). Overall, reported response in more recent studies was similar to that in earlier studies; for control groups, this may reflect changes in locations where the studies were conducted.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is evidence that participation in epidemiological studies may have declined in recent decades.
“Finally, there is evidence that participation in epidemiological studies may have declined in recent decades [ 137 , 138 ], which underscores the need for transparent reporting [ 139 ].”
From Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration (2007) · cites this paper as [138]
Cites
Response rates among control subjects in case-control studies☆
Slattery, M. L., Edwards, S. L., Caan, B. J., Kerber, R. A., & Potter, J. D. (1995) · Annals of Epidemiology · doi:10.1016/1047-2797(94)00113-8 · Cited by 167 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613 · see citing works
“[137,138], which underscores the need for transparent reporting [139].”
Vandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543 · see citing works
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2014) · International Journal of Surgery · doi:10.1016/j.ijsu.2014.07.014 · Cited by 2,969 · see citing works
“Finally, there is evidence that participation in epidemiological studies may have declined in recent decades [137,138], which underscores the need for transparent reporting [139].”
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181577511 · Cited by 2,779 · see citing works
Participation Rates in Epidemiologic Studies
Galea, S., & Tracy, M. (2007) · Annals of Epidemiology · doi:10.1016/j.annepidem.2007.03.013 · Cited by 1,877 · see citing works
Sources and transformations of chlorophenols in the natural environment.
Czaplicka, M. (2003) · Science of the Total Environment · doi:10.1016/j.scitotenv.2003.09.015 · Cited by 601
Vandenbroucke, J. P., von Elm, E. B., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S., Poole, C., Schlesselman, J. J., & Egger, M. (2009) · Gaceta Sanitaria · doi:10.1016/j.gaceta.2008.12.001 · Cited by 203 · see citing works
Reporting Participation in Epidemiologic Studies: A Survey of Practice
Morton, L. M., Cahill, J., & Hartge, P. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj036 · Cited by 461 · see citing works
“A previous analysis of participation in 82 case-control studies in the United States and Canada suggested a nonsignificant change in participation for controls of � 0.44 percent per year based on a median year of data collection during 1972–1996 ( 6 ), which is consistent with our results.”
BackgroundMethodResultInfluentialLanghammer, A., Krokstad, S., Romundstad, P., Heggland, J., & Holmen, J. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-143 · Cited by 388 · see citing works
“Low participation rates among persons under the age of 40 probably reflects less opportunity to spend time, limited short time benefit for a rather healthy age group [1,24] and less altruistic attitude in contributing to research [1].”
BackgroundRE: “REPORTING PARTICIPATION IN EPIDEMIOLOGIC STUDIES: A SURVEY OF PRACTICE”
Verda, N. L., & Teta, M. J. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj220 · Cited by 4 · see citing works
“Research into this topic conducted over many years suggests that there are many factors that affect participation, including the method of recruitment (4, 19); various family and medical history or exposure factors, especially those involved with the topic under study (18, 19) and including disease status (6, 17); que…”
BackgroundResultInfluentialParticipation in Population Studies
Hartge, P. A. (2006) · Epidemiology · doi:10.1097/01.ede.0000209441.24307.92 · Cited by 123 · see citing works
Vrijheid, M., Richardson, L., Armstrong, B. K., Auvinen, A. P., Berg, G., Carroll, M. T. C., Chetrit, A., Deltour, I., Feychting, M., Giles, G. G., et al. (2008) · Annals of Epidemiology · doi:10.1016/j.annepidem.2008.10.006 · Cited by 79 · see citing works
MacArthur, M., Sharp, L., Hold, G., Little, J., & El-Omar, E. (2004) · Cancer Epidemiology, Biomarkers and Prevention · doi:10.1158/1055-9965.epi-04-0878 · Cited by 84 · see citing works
“It has been noted that participation rates in research seem to be declining (28).”
BackgroundLittle, J. (2009) · British medical journal · doi:10.1136/bmj.b2546 · Cited by 82 · see citing works
Analysis of nonresponse bias in a population-based case-control study on lung cancer.
Richiardi, L., Boffetta, P., & Merletti, F. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00455-9 · Cited by 82 · see citing works
Reporting Participation in Case-Control Studies
Olson, S. H., Voigt, L. F., Begg, C. B., & Weiss, N. S. (2002) · Epidemiology · doi:10.1097/00001648-200203000-00004 · Cited by 65 · see citing works
Self-citationRogers, A., Murtaugh, M., Edwards, S., & Slattery, M. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh176 · Cited by 66 · see citing works
Poverty, Environment, and Health
O’Neill, M. S., McMichael, A. J., Schwartz, J. D., & Wartenberg, D. E. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181570ab9 · Cited by 49 · see citing works
Factors impacting questionnaire response in a Dutch retrospective cohort study.
Ronckers, C., Land, C., Hayes, R., Verduijn, P., & van Leeuwen, F. V. (2004) · Annals of Epidemiology · doi:10.1016/s1047-2797(03)00123-6 · Cited by 46 · see citing works
Vandenbroucke, J. P., von Elm, E. B., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S., Poole, C., Schlesselman, J. J., & Egger, M. (2024) · Ewha Medical Journal · doi:10.12771/emj.2024.e31 · Cited by 11 · see citing works
Bunin, G. R., Spector, L. G., Olshan, A. F., Robison, L. L., Roesler, M. A., Grufferman, S., Shu, X.-O., & Ross, J. A. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm050 · Cited by 38 · see citing works
Enclosing a pen with a postal questionnaire can significantly increase the response rate.
Sharp, L., Cochran, C., Cotton, S., Gray, N. M., & Gallagher, M. E. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.10.014 · Cited by 42 · see citing works
Dietary patterns and colorectal cancer in a Japanese population: The Fukuoka Colorectal Cancer Study
Kurotani, K., Budhathoki, S., Joshi, A., Yin, G., Toyomura, K., Kono, S., Mibu, R., Tanaka, M., Kakeji, Y., Maehara, Y., et al. (2010) · British Journal of Nutrition · doi:10.1017/s0007114510002606 · Cited by 37 · see citing works
“However, this rate was among the highest reported in recent case–control studies using community controls((39)).”
ResultPandeya, N., Williams, G., Green, A. C., Webb, P. M., & Whiteman, D. C. (2009) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2009.00401.x · Cited by 37 · see citing works
Wigertz, A., Lönn, S., Hall, P., & Feychting, M. (2010) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2008.085845 · Cited by 34 · see citing works
“A decline in participation in epidemiological studies has been noted in recent years.”
The Epidemiologic Approach to Pharmacogenomics
Little, J., Sharp, L., Khoury, M., Bradley, L., & Gwinn, M. (2005) · American Journal of Pharmacogenomics · doi:10.2165/00129785-200505010-00001 · Cited by 33 · see citing works
Association of Fluids From Beverages With Risk of Rectal Cancer
Murtaugh, M., Ma, K., Caan, B., & Slattery, M. (2004) · Nutrition and Cancer · doi:10.1207/s15327914nc4901_4 · Cited by 30 · see citing works
“We also found few differences in our cases and controls, and participation rates in our study are in line with the mean participation rates reported by Olson (42), but selection bias cannot be completely ruled out.”
ResultBeebe, T., Talley, N. J., Camilleri, M., Jenkins, S., Anderson, K., & Locke, G. (2007) · Medical Care · doi:10.1097/mlr.0b013e31805468b0 · Cited by 28 · see citing works
Mayne, D. J., Ressler, K., Smith, D., Hockey, G. R., Botham, S., & Ferson, M. (2011) · Interdisciplinary Perspectives on Infectious Diseases · doi:10.1155/2011/341065 · Cited by 27 · see citing works
“Our low response rate is consistent with reports of increasing difficulty in recruiting controls and decreasing participation rates in epidemiological studies [34, 35], especially those using population controls [36].”
ResultSharp, L., Cotton, S., Gray, N. M., Avis, M., Russell, I., Walker, L. G., Waugh, N., Whynes, D., Woolley, C., Thornton, A., et al. (2010) · British Journal of Cancer · doi:10.1038/sj.bjc.6606042 · Cited by 23 · see citing works
“In all, 52% of eligible women participated in TOMBOLA, which compares favourably with population-based epidemiological studies (Olson, 2001), especially in view of concerns about barriers to participation of women in trials (Sharp et al, 2006).”
ResultInvited commentary: Birth certificates--a best control scenario?
Ross, J., Spector, L., Olshan, A., & Bunin, G. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh137 · Cited by 21 · see citing works
“Although declining response rates with RDD were not confirmed in one recent report that evaluated rates in several published studies (13), it has been our experience”
BackgroundXu, M.-T., Richardson, L., Campbell, S., Pintos, J., & Siemiatycki, J. (2018) · Annals of Epidemiology · doi:10.1016/j.annepidem.2018.04.001 · Cited by 20 · see citing works
Wong, C. K., Horn-Ross, P. L., Gee, G. C., Shariff-Marco, S., Quach, T., Allen, L., Bautista, R., La Chica, P. Q., Tseng, W., Chang, P., et al. (2016) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2015-206905 · Cited by 17 · see citing works
Beebe, T., Jenkins, S., Anderson, K., & Davern, M. (2008) · Mayo Clinic proceedings · doi:10.1016/s0025-6196(11)60784-2 · Cited by 17
Conway, D., McMahon, A., Smith, K. M., Taylor, J. C., & Mckinney, P. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.12.012 · Cited by 17 · see citing works
Glaser, S., Clarke, C., Keegan, T., Gomez, S., Nugent, R. A., Topol, B., Stearns, C. B., & Stewart, S. L. (2004) · Cancer Causes and Control · doi:10.1023/b:caco.0000036191.79739.98 · Cited by 17 · see citing works
“were identified by random-digit dialing (RDD), the overall response rate was 65% when RDD outcome was incorporated; this rate, while comparable to those in similar studies [14-18], raises concern about the representativeness of the participants.”
ResultMillar, M. M., Kinney, A., Camp, N., Cannon-Albright, L., Hashibe, M., Penson, D., Kirchhoff, A. C., Neklason, D. W., Gilsenan, A., Dieck, G., et al. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz011 · Cited by 16 · see citing works
Yoshida, D., Kono, S., Moore, M., Toyomura, K., Nagano, J., Mizoue, T., Mibu, R., Tanaka, M., Kakeji, Y., Maehara, Y., et al. (2007) · Japanese Journal of Clinical Oncology · doi:10.1093/jjco/hym065 · Cited by 15
“Although a higher participation rate is of course desirable, the participation rate of 60% is considered to be acceptable (30).”
BackgroundBarriers in participant recruitment of diverse ethnicities in the state of Kuwait
Tariq, S., Goddard, C., & Elkum, N. B. (2013) · International Journal for Equity in Health · doi:10.1186/1475-9276-12-93 · Cited by 13 · see citing works
“Participation rates among cases in case–control studies are consistently higher than those among controls [17].”
ResultQuality Control and Good Epidemiological Practice
Rajaraman, P., & Samet, J. M. (2005) · Springer eBooks · doi:10.1007/978-3-540-26577-1_14 · Cited by 7 · see citing works
Non‐response Bias in a Surveillance Program for Asbestos‐related Lung Cancer
Knoll, L., Felten, M. K., Ackermann, D., & Kraus, T. (2010) · Journal of Occupational Health · doi:10.1539/joh.l10061 · Cited by 13 · see citing works
Evaluating the use of friend or family controls in epidemiologic case-control studies
Zhong, C., Cockburn, M., Cozen, W., Voutsinas, J. M., Lacey, J., Luo, J., Sullivan-Halley, J., Bernstein, L., & Wang, S. S. (2016) · Cancer Epidemiology · doi:10.1016/j.canep.2016.10.007 · Cited by 10 · see citing works
Chandran, U., Zirpoli, G., Ciupak, G., McCann, S., Gong, Z.-H., Pawlish, K., Lin, Y., Demissie, K., Ambrosone, C., & Bandera, E. (2013) · British Journal of Cancer · doi:10.1038/bjc.2013.513 · Cited by 9 · see citing works
“Response rates as low as 50% are not uncommon in population studies (Hartge, 2006), and case participation for studies of cancer have shown to be lower than for studies of other diseases (Olson, 2001).”
Design, methodological issues and participation in a multiple sclerosis case–control study
Williamson, D., Marrie, R., Ashley-Koch, A., Schiffer, R., Trottier, J., & Wagner, L. (2012) · Acta Neurologica Scandinavica · doi:10.1111/j.1600-0404.2011.01629.x · Cited by 9 · see citing works
“Although prior research suggested that participation rates in case–control studies range from 40% to 97% (29), we anticipated that the individuals with MS would be motivated to participate because of community concerns about MS.”
BackgroundBrinkman, S., Johnson, S. E., Lawrence, D., Codde, J. P., Hart, M. B., Straton, J., & Silburn, S. (2010) · Trials · doi:10.1186/1745-6215-11-100 · Cited by 9 · see citing works
“The higher participation rate in the case group is consistent with other population case-control studies [50] and specifically in adolescent pregnancy prevention studies.”
ResultTrends in participation rates in case–control studies of occupational risk factors 1991–2017
Sritharan, J., Luo, Y., & Harris, M. A. (2020) · Occupational and Environmental Medicine · doi:10.1136/oemed-2019-106200 · Cited by 10 · see citing works
Recruitment to research studies in maternity hospitals: an example from the Early Births Study.
Watson, L., Lumley, J., Rayner, J., & Potter, A. (2008) · Midwifery · doi:10.1016/j.midw.2007.07.004 · Cited by 7
“In two reviews of case-control studies (Stang et al., 1999; Olson, 2001), the studies were generally not relevant to the Early Births Study as they did not recruit in the perinatal period and community controls were recruited by random digit dialling.”
BackgroundDrug utilization in the Maastricht Study
Nielen, J., Driessen, J., Dagnelie, P., Boonen, A., van den Bemt, B. V. D., van Onzenoort, H. V., Neef, C., Henry, R., Burden, A., Sep, S., et al. (2020) · Medicine · doi:10.1097/md.0000000000018524 · Cited by 2
“Several factors that may be involved include the distance to research facility,([9]) medical history,([10,11]) age, sex,([12,14]) race,([9,13]) and education or income.”
BackgroundJan, P., Erik, V. E., Douglas, G., Peter, C. G., Cynthia, D., Stuart, J., Charles, P., James, J., & Matthias, E. (2021) · doi:10.17816/dd70821-58176 · Cited by 1
“Наконец, есть свидетельства того, что участие в эпидемиологических исследованиях могло снизиться в последние десятилетия [137, 138], что свидетельствует о необходимости прозрачной отчётности [139].”
- Authors
- Olson, S. H.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- Corresponding author
- Olson, S. H.
- ORCID
- Olson, S. H.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2001-09-15
- Volume
- 154
- Issue
- 6
- Pages
- 574-581
- ISSN
- 0002-9262 (ISSN-L)
- OpenAlex
- W2033503949
- Cited by
- 53
- References
- 0
- Citations by year
- 2024: 1 · 2022: 1 · 2021: 1 · 2020: 2 · 2019: 1 · 2018: 1 · 2017: 1 · 2016: 2 · 2014: 1 · 2013: 3 · 2012: 1
- FWCI
- 3.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r03ca052107-01, 5t32ca009529-25)
- National Cancer Institute (CA52107, CA 09529)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- case-control study, research participation, response rate, declining participation, temporal trends, case groups, control groups, research location, epidemiological investigation
- MeSH terms
- Data Collection, Health Surveys, Humans, Regression Analysis, Bias, Confounding Factors, Epidemiologic, Epidemiologic Studies, Case-Control Studies, Sample Size, Patient Selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
