A Method for Detection of Residual Confounding in Time-series and Other Observational Studies
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
BACKGROUND: A difficult issue in observational studies is assessment of whether important confounders are omitted or misspecified. In this study, we present a method for assessing whether residual confounding is present. Our method depends on availability of an indicator with 2 key characteristics: first, it is conditionally independent (given measured exposures and covariates) of the outcome in the absence of confounding, misspecification, and measurement errors; second, it is associated with the exposure and, like the exposure, with any unmeasured confounders. METHODS: We demonstrate the method using a time-series study of the effects of ozone on emergency department visits for asthma in Atlanta. We argue that future air pollution may have the characteristics appropriate for an indicator, in part because future ozone cannot have caused yesterday's health events. Using directed acyclic graphs and specific causal relationships, we show that one can identify residual confounding using an indicator with the stated characteristics. We use simulations to assess the discriminatory ability of future ozone as an indicator of residual confounding in the association of ozone with asthma-related emergency department visits. Parameter choices are informed by observed data for ozone, meteorologic factors, and asthma. RESULTS: In simulations, we found that ozone concentrations 1 day after the emergency department visits had excellent discriminatory ability to detect residual confounding by some factors that were intentionally omitted from the model, but weaker ability for others. Although not the primary goal, the indicator can also signal other forms of modeling errors, including substantial measurement error, and does not distinguish between them. CONCLUSIONS: The simulations illustrate that the indicator based on future air pollution levels can have excellent discriminatory ability for residual confounding, although performance varied by situation. Application of the method should be evaluated by considering causal relationships for the intended application, and should be accompanied by other approaches, including evaluation of a priori knowledge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Robins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451 · cited 1×
“Robins pointed out that our proposed approach can be justified using results of the G-computation algorithm.(17) In particular, we can consider the Disease (Dt) as a treatment.”
MethodGranger, C. W. J. (1980) · Journal of Economic Dynamics and Control · doi:10.1016/0165-1889(80)90069-x · Cited by 1,746
Negative Controls: A Tool for Detecting Confounding and Bias in Observational Studies
Lipsitch, M., Tchetgen Tchetgen, E., & Cohen, T. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181d61eeb · Cited by 1,583
Hernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
Exposure measurement error in time-series studies of air pollution: concepts and consequences
Zeger, S. L., Thomas, D., Dominici, F., Samet, J. M., Schwartz, J., Dockery, D., & Cohen, A. (2000) · Environmental Health Perspectives · doi:10.1289/ehp.00108419 · Cited by 1,156 · cited 1×
“Thus, ambient levels can be conceptually valid exposures and appropriate objects of study.(14) Furthermore, if measurement error estimates are available, then correction for measurement error is possible,(15) although utility of the many applicable methods may be limited by the information available.”
BackgroundModel Choice in Time Series Studies of Air Pollution and Mortality
Peng, R. D., Dominici, F., & Louis, T. A. (2006) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2006.00410.x · Cited by 583
Data, Design, and Background Knowledge in Etiologic Inference
Robins, J. M. (2001) · Epidemiology · doi:10.1097/00001648-200105000-00011 · Cited by 358
Cited by
Raz, R., Roberts, A. L., Lyall, K., Hart, J. E., Just, A. C., Laden, F., & Weisskopf, M. G. (2015) · Environmental Health Perspectives · doi:10.1289/ehp.1408133 · Cited by 334
Temperature Variability and Mortality: A Multi-Country Study
Guo, Y., Gasparrini, A., Armstrong, B. G., Tawatsupa, B., Tobias, A., Lavigne, E., Coelho, M. D. S. Z. S., Pan, X., Kim, H., Hashizume, M., et al. (2016) · Environmental Health Perspectives · doi:10.1289/ehp149 · Cited by 332
Darrow, L. A., Klein, M., Flanders, W. D., Mulholland, J. A., Tolbert, P. E., & Strickland, M. J. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu234 · Cited by 292
Self-citationMaher, G. M., O’Keeffe, G. W., Kearney, P. M., Kenny, L. C., Dinan, T. G., Mattsson, M., & Khashan, A. S. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.0854 · Cited by 271
The Control Outcome Calibration Approach for Causal Inference With Unobserved Confounding
Tchetgen Tchetgen, E. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwt303 · Cited by 119
Metadata
- Authors
- Flanders, W. D., Klein, M., Darrow, L. A., Strickland, M. J., Sarnat, S. E., Sarnat, J. A., Waller, L. A., Winquist, A., & Tolbert, P. E.
- Venue
- Epidemiology
- Published
- 2011-01
- Volume
- 22
- Issue
- 1
- Pages
- 59-67
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W2094415180
- Cited by
- 91
- References
- 8
- FWCI
- 1.62
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.