Should we adjust for a confounder if empirical and theoretical criteria yield contradictory results? A simulation study
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Confounders can be identified by one of two main strategies: empirical or theoretical. Although confounder identification strategies that combine empirical and theoretical strategies have been proposed, the need for adjustment remains unclear if the empirical and theoretical criteria yield contradictory results due to random error. We simulated several scenarios to mimic either the presence or the absence of a confounding effect and tested the accuracy of the exposure-outcome association estimates with and without adjustment. Various criteria (significance criterion, Change-in-estimate(CIE) criterion with a 10% cutoff and with a simulated cutoff) were imposed, and a range of sample sizes were trialed. In the presence of a true confounding effect, unbiased estimates were obtained only by using the CIE criterion with a simulated cutoff. In the absence of a confounding effect, all criteria performed well regardless of adjustment. When the confounding factor was affected by both exposure and outcome, all criteria yielded accurate estimates without adjustment, but the adjusted estimates were biased. To conclude, theoretical confounders should be adjusted for regardless of the empirical evidence found. The adjustment for factors that do not have a confounding effect minimally effects. Potential confounders affected by both exposure and outcome should not be adjusted for.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Simulation Study of Confounder-Selection Strategies
Maldonado, G., & Greenland, S. (1993) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116813 · Cited by 2,491
Hernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
The Impact of Residual and Unmeasured Confounding in Epidemiologic Studies: A Simulation Study
Fewell, Z., Davey Smith, G., & Sterne, J. A. C. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm165 · Cited by 734
Controlling for Continuous Confounders in Epidemiologic Research
Brenner, H., & Blettner, M. (1997) · Epidemiology · doi:10.1097/00001648-199707000-00014 · Cited by 151
Hernández, A. V., Eijkemans, M. J. C., & Steyerberg, E. W. (2006) · Annals of Epidemiology · doi:10.1016/j.annepidem.2005.09.007 · Cited by 65
Cited by
Addressing context dependence in ecology
Catford, J. A., Wilson, J. R. U., Pyšek, P., Hulme, P. E., & Duncan, R. P. (2022) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2021.09.007 · Cited by 344
Obstructive sleep apnea and longitudinal Alzheimer’s disease biomarker changes
Bubu, O. M., Pirraglia, E., Andrade, A. G., Sharma, R. A., Gimenez-Badia, S., Umasabor-Bubu, O. Q., Hogan, M. M., Shim, A. M., Mukhtar, F., Sharma, N., et al. (2019) · Sleep · doi:10.1093/sleep/zsz048 · Cited by 164
“As our study tried to answer an etiological question, we employed a broad selection of covariates based on published literature [18, 19].”
Baksh, R. A., Abrahams, S., Auyeung, B., & MacPherson, S. E. (2018) · PLOS ONE · doi:10.1371/journal.pone.0195818 · Cited by 114
Sauce, B., Liebherr, M., Judd, N., & Klingberg, T. (2022) · Scientific Reports · doi:10.1038/s41598-022-11341-2 · Cited by 74
Lee, S., Ock, M., Kim, H., & Kim, H. (2020) · Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy · doi:10.1002/phar.2450 · Cited by 13
“1.(31) Stratified analysis was used to identify the risk difference, dependent on gender, age, the Charlson comorbidity index (CCI), chronic disease affecting hypoglycemia, and hypoglycemic agent combinations that were used continuously for 120 days.”
Method
Metadata
- Authors
- Lee, P. H.
- Venue
- Scientific Reports
- Published
- 2014-08-15
- Volume
- 4
- Issue
- 1
- Pages
- 6085-6085
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2078651157
- Cited by
- 112
- References
- 6
- FWCI
- 8.59
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Should we adjust for a confounder if empirical and theoretical criteria yield contradictory results? A simulation study. https://app.cochat.ai/papers/10.1038/srep06085
- The paper
- Lee, P. H. (2014). Should we adjust for a confounder if empirical and theoretical criteria yield contradictory results? A simulation study. Scientific Reports. https://doi.org/10.1038/srep06085
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.