Confounding in observational studies based on large health care databases: problems and potential solutions – a primer for the clinician
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Population-based health care databases are a valuable tool for observational studies as they reflect daily medical practice for large and representative populations. A constant challenge in observational designs is, however, to rule out confounding, and the value of these databases for a given study question accordingly depends on completeness and validity of the information on confounding factors. In this article, we describe the types of potential confounding factors typically lacking in large health care databases and suggest strategies for confounding control when data on important confounders are unavailable. Using Danish health care databases as examples, we present the use of proxy measures for important confounders and the use of external adjustment. We also briefly discuss the potential value of active comparators, high-dimensional propensity scores, self-controlled designs, pseudorandomization, and the use of positive or negative controls.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Case-Crossover Design: A Method for Studying Transient Effects on the Risk of Acute Events
Maclure, M. (1991) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115853 · Cited by 2,327 · cited 3×
“31,34 If exposure prevalence and potential confounding factors vary over time, this time variability has to be taken into account in the study design to avoid spurious associations.”
Negative Controls: A Tool for Detecting Confounding and Bias in Observational Studies
Lipsitch, M., Tchetgen Tchetgen, E., & Cohen, T. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181d61eeb · Cited by 1,583 · cited 2×
“49 Using negative exposure, or outcome controls, does not control confounding, but it is a way to at least address the potential magnitude of uncontrolled confounding.”
Mendelian randomization: prospects, potentials, and limitations
Smith, G. D. (2004) · International Journal of Epidemiology · doi:10.1093/ije/dyh132 · Cited by 1,222
An introduction to instrumental variables for epidemiologists
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.4.722 · Cited by 1,156
Triangulation in aetiological epidemiology
Lawlor, D. A., Tilling, K., & Davey Smith, G. (2017) · International Journal of Epidemiology · doi:10.1093/ije/dyw314 · Cited by 1,129 · cited 1×
“The use of “negative controls” is an example of the general idea of “triangulation” of research findings on which a recent review was written by Lawlor et al. 52”
Schneeweiss, S., Rassen, J. A., Glynn, R. J., Avorn, J., Mogun, H., & Brookhart, M. A. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181a663cc · Cited by 1,128
Genetically elevated C-reactive protein and ischemic vascular disease
Zacho, J., Tybjærg-Hansen, A., Jensen, J. S., Grande, P., Sillesen, H., & Nordestgaard, B. G. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0707402 · Cited by 839
A meta‐analysis of coffee drinking, cigarette smoking, and the risk of Parkinson's disease
Hernán, M. A., Takkouche, B., Caamaño‐Isorna, F., & Gestal‐Otero, J. J. (2002) · Annals of Neurology · doi:10.1002/ana.10277 · Cited by 818 · cited 1×
“…smoking is associated with an increased risk of peptic ulcer (the underlying indication for vagotomy) 17 and, at the same time, may protect against Parkinson’s disease, 18 lack of data on smoking was of concern, as smoking, rather than vagotomy, could be behind the observed protective association.”
Vagotomy and subsequent risk of Parkinson's disease
Svensson, E., Horváth‐Puhó, E., Thomsen, R. W., Djurhuus, J. C., Pedersen, L., Borghammer, P., & Sørensen, H. T. (2015) · Annals of Neurology · doi:10.1002/ana.24448 · Cited by 806 · cited 1×
“Svensson et al 16 used Danish registries to examine the association between vagotomy and subsequent risk of Parkinson’s disease.”
Tutorial in biostatistics: the self‐controlled case series method
Whitaker, H. J., Paddy Farrington, C., Spiessens, B., & Musonda, P. (2006) · Statistics in Medicine · doi:10.1002/sim.2302 · Cited by 719
Self controlled case series methods: an alternative to standard epidemiological study designs
Petersen, I., Douglas, I., & Whitaker, H. (2016) · BMJ · doi:10.1136/bmj.i4515 · Cited by 525 · cited 1×
“33 These designs, which are largely similar with subtle differences, include only cases of the outcome of interest and compare their exposure status in a relevant period for potentially causing the outcome with the exposure in a different period.”
Regression Discontinuity Designs in Epidemiology: Causal Inference Without Randomized Trials
Bor, J., Moscoe, E., Mutevedzi, P., Newell, M.-L., & Bärnighausen, T. (2014) · Epidemiology · doi:10.1097/ede.0000000000000138 · Cited by 291
Freemantle, N., Marston, L., Walters, K., Wood, J., Reynolds, M. R., & Petersen, I. (2013) · BMJ · doi:10.1136/bmj.f6409 · Cited by 211 · cited 1×
“25 This study demonstrated that the propensity score analyses were unable to capture the effect of severity of the underlying illness (confounding by indication), and thus, the propensity score analyses provided biased results.”
Thomsen, R. W., Pedersen, L., Møller, N., Kahlert, J., Beck-Nielsen, H., & Sørensen, H. T. (2015) · Diabetes Care · doi:10.2337/dc13-2983 · Cited by 89
Boef, A. G. C., le Cessie, S., Dekkers, O. M., Frey, P., Kearney, P. M., Kerse, N., Mallen, C. D., McCarthy, V. J. C., Mooijaart, S. P., Muth, C., et al. (2015) · Epidemiology · doi:10.1097/ede.0000000000000425 · Cited by 13
Cited by
Koutsokera, A., Varughese, R. A., Sykes, J., Orchanian-Cheff, A., Shah, P. S., Chaparro, C., Tullis, E., Singer, L. G., & Stephenson, A. L. (2019) · Journal of Cystic Fibrosis · doi:10.1016/j.jcf.2018.10.013 · Cited by 36
Metadata
- Authors
- Nørgaard, M., Ehrenstein, V., & Vandenbroucke, J. P.
- Venue
- Clinical Epidemiology
- Publisher
- Informa UK Limited
- Published
- 2017-03
- Volume
- Volume 9
- Pages
- 185-193
- ISSN
- 1179-1349 (ISSN-L)
- OpenAlex
- W2602904671
- Cited by
- 210
- References
- 15
- FWCI
- 7.54
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.