What Do Case-Control Studies Estimate? Survey of Methods and Assumptions in Published Case-Control Research
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
To evaluate strategies used to select cases and controls and how reported odds ratios are interpreted, the authors examined 150 case-control studies published in leading general medicine, epidemiology, and clinical specialist journals from 2001 to 2007. Most of the studies (125/150; 83%) were based on incident cases; among these, the source population was mostly dynamic (102/125; 82%). A minority (23/125; 18%) sampled from a fixed cohort. Among studies with incident cases, 105 (84%) could interpret the odds ratio as a rate ratio. Fifty-seven (46% of 125) required the source population to be stable for such interpretation, while the remaining 48 (38% of 125) did not need any assumptions because of matching on time or concurrent sampling. Another 17 (14% of 125) studies with incident cases could interpret the odds ratio as a risk ratio, with 16 of them requiring the rare disease assumption for this interpretation. The rare disease assumption was discussed in 4 studies but was not relevant to any of them. No investigators mentioned the need for a stable population. The authors conclude that in current case-control research, a stable exposure distribution is much more frequently needed to interpret odds ratios than the rare disease assumption. At present, investigators conducting case-control studies rarely discuss what their odds ratios estimate.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In a case–control study with incidence density sampling, the OR can be interpreted as a rate ratio, circumventing this problem.14”
From Recommendations for presenting analyses of effect modification and interaction (2012) · cites this paper as [14]
In the citing paper
“When studies report different ratio metrics, for example, hazard ratios, risk ratios, or odds ratios, they may be combined ignoring the differences in metrics. This may be appropriate depending on which study designs were included (cohort studies or case-control studies) and how participants were sampled in case-control studies [84,85].”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [85]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796
Self-citationVandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613
Self-citationClinical Epidemiology: A Basic Science for Clinical Medicine.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_9 · Cited by 3,476
Epidemiologic Research: Principles and Quantitative Methods.
Mayer, L. S., Kleinbaum, D. G., Kupper, L. L., & Morgenstern, H. (1984) · Journal of the American Statistical Association · doi:10.2307/2288427 · Cited by 2,905
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181577511 · Cited by 2,779
Self-citationCase-Control Studies: Design, Conduct, Analysis.
Youkeles, L., & Schlesselman, J. J. (1983) · Journal of the American Statistical Association · doi:10.2307/2288156 · Cited by 2,346
Hennekens, C. H., Buring, J. E., & Mayrent, S. L. (1987) · Medical Entomology and Zoology · Cited by 2,319
Porta, M. (2026) · doi:10.1093/acref/9780197663639.001.0001 · Cited by 2,175
Clinical Epidemiology: The Essentials.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_10 · Cited by 1,835
RE: “ESTIMABILITY AND ESTIMATION IN CASE-REFERENT STUDIES”
Halperin, M. (1977) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112409 · Cited by 1,542
Epidemiology: Principles and Methods
MacMahon, B., & Pugh, T. F. (1970) · Cited by 1,472
Epidemiology: Beyond the Basics
Szklo, M., & Nieto, F. J. (1999) · Cited by 1,441
A case-cohort design for epidemiologic cohort studies and disease prevention trials
PRENTICE, R. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.1 · Cited by 1,439
- Statistical Models for Epidemiology
(2013) · Bayesian Methods in Epidemiology · doi:10.1201/b15382-9 · Cited by 1,346
ESTIMABILITY AND ESTIMATION IN CASE-REFERENT STUDIES
MIETTINEN, O. (1976) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112220 · Cited by 1,321
Methods in Observational Epidemiology
Kelsey, J. L. (1986) · Cited by 1,307
(1977) · Annals of Internal Medicine · doi:10.7326/0003-4819-86-6-835_3 · Cited by 1,155
Selection of Controls in Case-Control Studies
Wacholder, S., McLaughlin, J. K., Silverman, D. T., & Mandel, J. S. (1992) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116396 · Cited by 998
Clinical Epidemiology: The Architecture of Clinical Research.
(1985) · Annals of Internal Medicine · doi:10.7326/0003-4819-103-4-649_2 · Cited by 949
(1985) · Cited by 487
ON THE NEED FOR THE RARE DISEASE ASSUMPTION IN CASE-CONTROL STUDIES
GREENLAND, S., & THOMAS, D. C. (1982) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113439 · Cited by 442
Quality of reporting of observational longitudinal research.
Tooth, L. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi042 · Cited by 363
Issues in the reporting of epidemiological studies: a survey of recent practice.
Pocock, S. J., Collier, T. J., Dandreo, K. J., de Stavola, B. L., Goldman, M. B., Kalish, L. A., Kasten, L. E., & McCormack, V. A. (2004) · BMJ · doi:10.1136/bmj.38250.571088.55 · Cited by 313
What Does the Odds Ratio Estimate in a Case-Control Study?
PEARCE, N. (1993) · International Journal of Epidemiology · doi:10.1093/ije/22.6.1189 · Cited by 266
(1978) · Polydrug Abuse · doi:10.1016/b978-0-12-745250-0.50015-1 · Cited by 246
An introduction to epidemiologic methods
Kahn, H. A. (1983) · Medical Entomology and Zoology · Cited by 224
RODRIGUES, L., & KIRKWOOD, B. R. (1990) · International Journal of Epidemiology · doi:10.1093/ije/19.1.205 · Cited by 207
Introduction to modern epidemiology
Ahlbom, A., & Norell, S. E. (1984) · Medical Entomology and Zoology · Cited by 152
The scandal of poor epidemiological research: ***
Elm, E. V., & Egger, M. (2004) · BMJ · doi:10.1136/bmj.329.7471.868 · Cited by 134
Self-citationClinical Epidemiology: The Study of the Outcome of Illness.
(1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-106-3-490_1 · Cited by 127
Epidemiology in medical practice
Barker, D. J. P., & Rose, G. (1976) · Medical Entomology and Zoology · Cited by 113
Design options in epidemiologic research. An update.
Miettinen, O. S. (1982) · PubMed · Cited by 111
Bias in psychiatric case–control studies: Literature survey
Lee, W., Bindman, J., Ford, T., Glozier, N., Moran, P., Stewart, R., & Hotopf, M. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.027250 · Cited by 92
A Study Guide to Epidemiology and Biostatistics.
(1979) · Annals of Internal Medicine · doi:10.7326/0003-4819-90-5-868_6 · Cited by 75
THE RARE-DISEASE ASSUMPTION REVISITED
GREENLAND, S., THOMAS, D. C., & MORGENSTERN, H. (1986) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114476 · Cited by 66
ESTIMATORS OF RELATIVE RISK FOR CASE-CONTROL STUDIES
HOGUE, C. J. R., GAYLOR, D. W., & SCHULZ, K. F. (1983) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113646 · Cited by 62
STROBE: new standards for reporting observational epidemiology, a chance to improve
Ebrahim, S. B. J., & Clarke, M. J. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym185 · Cited by 57
Norell, S. E. (1995) · doi:10.1093/oso/9780195074901.001.0001 · Cited by 30
Epidemiology and health risk assessment
Gordis, L., & Libauer, C. H. (1988) · Oxford University Press eBooks · Cited by 26
Suggestions for STROBE Recommendations
Kuller, L. H., & Goldstein, B. D. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181571e16 · Cited by 20
Commentary: Strengthening the reporting of observational epidemiology the STROBE statement
Egger, M., Altman, D. G., Vandenbroucke, J. P., & of the STROBE group (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym199 · Cited by 20
Self-citationBridging case-control studies and randomized trials
Rosendaal, F. R. (2001) · Trials · doi:10.1186/cvm-2-3-109 · Cited by 16
Rothman, K. J., Huybrechts, K. F., & Murray, E. J. (2024) · doi:10.1093/oso/9780197751541.001.0001 · Cited by 12
An Introductory Study Guide to Public Health and Epidemiology
Unwin, N. C., Carr, S. M., Leeson, J., & Pless‐Mulloli, T. (1997) · Medical Entomology and Zoology · Cited by 12
Is There a Dark Phase of This STROBE?
MacMahon, B., & Weiss, N. S. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181570f6e · Cited by 11
Epidemiology for the Health Sciences: A Primer on Epidemiologic Concepts and Their Uses
Austin, D. F., & Werner, S. B. (1974) · Cited by 6
Teaching Epidemiology: What You Should Know and What You Could Do
Olsen, J., & Trichopoulos, D. (1992) · Medical Entomology and Zoology · Cited by 6
Research works printed but not linked: 2
- 2001, Medline Rows With NULL issns Will Point To This, 2, 109
- Marcucci, 1982, Medline Rows With NULL issns Will Point To This, 8, 7
Cited by
Bjornevik, K., Cortese, M., Healy, B. C., Kuhle, J., Mina, M. J., Leng, Y., Elledge, S. J., Niebuhr, D. W., Scher, A. I., Munger, K. L., et al. (2022) · Science · doi:10.1126/science.abj8222 · Cited by 2,049
Recommendations for presenting analyses of effect modification and interaction
Knol, M. J., & VanderWeele, T. J. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dyr218 · Cited by 1,494
Self-citationVanderWeele, T. J., & Knol, M. J. (2014) · Epidemiologic Methods · doi:10.1515/em-2013-0005 · Cited by 1,127
“Suppose that we only have estimates for odds ratios but that the outcome is rare (or that the controls are selected from the entirety of the underlying population rather than just from the non-cases cf. Knol et al., 2008) so that odds ratios approximate risk ratios.”
BackgroundSelf-citationOrellano, P., Reynoso, J., Quaranta, N., Bardach, A., & Ciapponi, A. (2020) · Environment International · doi:10.1016/j.envint.2020.105876 · Cited by 792
Dekkers, O. M., Vandenbroucke, J. P., Cevallos, M., Renehan, A. G., Altman, D. G., & Egger, M. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002742 · Cited by 525
Self-citation
Metadata
- Authors
- Knol, M. J., Vandenbroucke, J. P., Scott, P., & Egger, M.
- Affiliations
- University Medical Center Utrecht (NL)
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-09-18
- Volume
- 168
- Issue
- 9
- Pages
- 1073-1081
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2060908959
- Cited by
- 189
- References
- 48
- Citations by year
- 2026: 12 · 2025: 12 · 2024: 14 · 2023: 18 · 2022: 14 · 2021: 5 · 2020: 7 · 2019: 11 · 2018: 16 · 2017: 6 · 2016: 6 · 2015: 13 · 2014: 16 · 2013: 11 · 2012: 7
- FWCI
- 6.61
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, other-oa)
- Open Access CRIS of the University of Bern
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- case-control study, odds ratio interpretation, rate ratios, relative risk, incident cases, case selection, control selection, exposure distribution
- MeSH terms
- Data Collection, Decision Trees, Epidemiology, Medicine, Periodicals as Topic, Specialization, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.