The Impact of Residual and Unmeasured Confounding in Epidemiologic Studies: A Simulation Study
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Measurement error in explanatory variables and unmeasured confounders can cause considerable problems in epidemiologic studies. It is well recognized that under certain conditions, nondifferential measurement error in the exposure variable produces bias towards the null. Measurement error in confounders will lead to residual confounding, but this is not a straightforward issue, and it is not clear in which direction the bias will point. Unmeasured confounders further complicate matters. There has been discussion about the amount of bias in exposure effect estimates that can plausibly occur due to residual or unmeasured confounding. In this paper, the authors use simulation studies and logistic regression analyses to investigate the size of the apparent exposure-outcome association that can occur when in truth the exposure has no causal effect on the outcome. The authors consider two cases with a normally distributed exposure and either two or four normally distributed confounders. When the confounders are uncorrelated, bias in the exposure effect estimate increases as the amount of residual and unmeasured confounding increases. Patterns are more complex for correlated confounders. With plausible assumptions, effect sizes of the magnitude frequently reported in observational epidemiologic studies can be generated by residual and/or unmeasured confounding alone.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is the opposite of what is often seen where observational studies over-estimate effects found in large, well designed RCTs.”
From A systematic review and meta-analysis of effects of early life non-cognitive skills on academic, psychosocial, cognitive and health outcomes (2018) · cites this paper as [45]
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Analysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
Vitamin E Consumption and the Risk of Coronary Heart Disease in Men
Rimm, E. B., Stampfer, M. J., Ascherio, A., Giovannucci, E., Colditz, G. A., & Willett, W. C. (1993) · New England Journal of Medicine · doi:10.1056/nejm199305203282004 · Cited by 2,347
Vitamin E Consumption and the Risk of Coronary Disease in Women
Stampfer, M. J., Hennekens, C. H., Manson, J. E., Colditz, G. A., Rosner, B., & Willett, W. C. (1993) · New England Journal of Medicine · doi:10.1056/nejm199305203282003 · Cited by 2,103
Hernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
Roncaglioni, M. C. (2001) · The Lancet · doi:10.1016/s0140-6736(00)03539-x · Cited by 999
Identifiability, Exchangeability, and Epidemiological Confounding
GREENLAND, S., & ROBINS, J. M. (1986) · International Journal of Epidemiology · doi:10.1093/ije/15.3.413 · Cited by 686
Covariate measurement errors and parameter estimation in a failure time regression model
PRENTICE, R. L. (1982) · Biometrika · doi:10.1093/biomet/69.2.331 · Cited by 668
Basic Methods for Sensitivity Analysis of Biases
GREENLAND, S. (1996) · International Journal of Epidemiology · doi:10.1093/ije/25.6.1107 · Cited by 586
Khaw, K.-T., Bingham, S., Welch, A., Luben, R., Wareham, N., Oakes, S., & Day, N. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04128-3 · Cited by 573
THE EFFECT OF MISCLASSIFICATION IN THE PRESENCE OF COVARIATES
GREENLAND, S. (1980) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113025 · Cited by 494 · cited 1×
“For example, Greenland (15) and Brenner (16) have illustrated the effects of misclassification of dichotomous and polytomous confounders, respectively.”
BackgroundLawlor, D. A., Smith, G. D., Bruckdorfer, K. R., Kundu, D., & Ebrahim, S. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16260-0 · Cited by 438
Proper interpretation of non-differential misclassification effects: expectations vs observations
Jurek, A. M., Greenland, S., Maldonado, G., & Church, T. R. (2005) · International Journal of Epidemiology · doi:10.1093/ije/dyi060 · Cited by 410
Causation in epidemiology: Table 1
Parascandola, M., & Weed, D. L. (2001) · Journal of Epidemiology and Community Health · doi:10.1136/jech.55.12.905 · Cited by 276
Semi-Automated Sensitivity Analysis to Assess Systematic Errors in Observational Data
Lash, T. L., & Fink, A. K. (2003) · Epidemiology · doi:10.1097/01.ede.0000071419.41011.cf · Cited by 250
SCHRÖDER, H., COVAS, M. I., MARRUGAT, J., VILA, J., PENA, A., ALCÁNTARA, M., & MASIÁ, R. (2001) · Clinical Nutrition · doi:10.1054/clnu.2001.0460 · Cited by 232
Randomized Trials of Vitamin E in the Treatment and Prevention of Cardiovascular Disease
Eidelman, R. S., Hollar, D., Hebert, P. R., Lamas, G. A., & Hennekens, C. H. (2004) · Archives of Internal Medicine · doi:10.1001/archinte.164.14.1552 · Cited by 231
Satia-Abouta, J. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg039 · Cited by 146
Mismeasurement and the Resonance of Strong Confounders: Uncorrelated Errors
Marshall, J. R., & Hastrup, J. L. (1996) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a008671 · Cited by 133
ESTIMATING AND CORRECTING FOR CONFOUNDER MISCLASSIFICATION
SAVITZ, D. A., & BARÓN, A. E. (1989) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115210 · Cited by 125
Spiegelman, D. L., ROSNER, B. A., & Logan, R. W. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473898 · Cited by 114
Bias in relative odds estimation owing to imprecise measurement of correlated exposures
Phillips, A. N., & Smith, G. D. (1992) · Statistics in Medicine · doi:10.1002/sim.4780110712 · Cited by 108 · cited 1×
“Phillips and Davey Smith (18) considered measurement error in a continuous exposure and a confounding variable.”
BackgroundSelf-citationAnalysis of case‐control data with covariate measurement error: Application to diet and colon cancer
Armstrong, B. G., Whittemore, A. S., & Howe, G. R. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080916 · Cited by 106
Quantitative sensory testing cannot differentiate simulated sensory loss from sensory neuropathy
Freeman, R., Chase, K. P., & Risk, M. R. (2003) · Neurology · doi:10.1212/wnl.60.3.465 · Cited by 104
Reflections on the limitations to epidemiology
Smith, G. D. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00334-6 · Cited by 95
Measurement Error and Misclassification in Statistics and Epidemiology
Spiegelman, D. (2006) · Journal of the American Statistical Association · doi:10.1198/jasa.2006.s70 · Cited by 80
Effect of Measurement Error on Energy-Adjustment Models in Nutritional Epidemiology
Kipnis, V., Freedman, L. S., Brown, C. C., Hartman, A. M., Schatzkin, A., & Wacholder, S. (1997) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009202 · Cited by 78
Bias due to non-differential misclassification of polytomous confounders
Brenner, H. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90009-p · Cited by 54
Measurement of Lifetime Alcohol Intake: Utility of a Self-administered Questionnaire
Friesema, I. H. M. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh102 · Cited by 49
Test‐retest reliability of the Upper Extremity Questionnaire among keyboard operators*†
Salerno, D. F., Franzblau, A., Armstrong, T. J., Werner, R. A., & Becker, M. P. (2001) · American Journal of Industrial Medicine · doi:10.1002/ajim.10024 · Cited by 40
Sonis, J. H. (1998) · PubMed · Cited by 39
The importance of critically interpreting simulation studies.
Maldonado, G., & Greenland, S. (1997) · PubMed · Cited by 34
Correcting for measurement error in binary and continuous variables using replicates
White, I. R., Frost, C. D., & Tokunaga, S. (2001) · Statistics in Medicine · doi:10.1002/sim.908 · Cited by 30
Observational versus randomised trial evidence
Khaw, K., Day, N. E., Bingham, S. A., & Wareham, N. J. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16924-9 · Cited by 27
Development and Validation of a Calcium Intake Questionnaire for Postmenopausal Women in China
Xu, L., Porteous, J. E., Phillips, M. R., & Suping, Z. (2000) · Annals of Epidemiology · doi:10.1016/s1047-2797(99)00055-1 · Cited by 27
Yokoo, E. M., Valente, J. G., Sichieri, R., & Silva, E. C. (2001) · Environmental Research · doi:10.1006/enrs.2001.4241 · Cited by 22
Chinn, S., & Schouten, J. P. (2005) · Thorax · doi:10.1136/thx.2004.039230 · Cited by 20
Poppers, Kaposi′s-Sarcoma, and HIV-Infection: Empirical Example of a Strong Confounding Effect?
Morabia, A. (1995) · Preventive Medicine · doi:10.1006/pmed.1995.1014 · Cited by 15
The Reliability of Passively Collected AIDS Surveillance Data in Massachusetts
Gallagher, K., Jara, M., Demaria, A., Seage, G. R., & Heeren, T. (2003) · Annals of Epidemiology · doi:10.1016/s1047-2797(02)00265-x · Cited by 7
Cited by
Mendelian randomization: genetic anchors for causal inference in epidemiological studies
Davey Smith, G., & Hemani, G. (2014) · Human Molecular Genetics · doi:10.1093/hmg/ddu328 · Cited by 4,677
Exploring pathways linking greenspace to health: theoretical and methodological guidance
Markevych, I., Schoierer, J., Hartig, T., Chudnovsky, A., Hystad, P., Dzhambov, A. M., de Vries, S., Triguero-Mas, M., Brauer, M., Nieuwenhuijsen, M. J., et al. (2017) · Environmental Research · doi:10.1016/j.envres.2017.06.028 · Cited by 2,543
Interpretation of the evidence for the efficacy and safety of statin therapy
Collins, R., Reith, C., Emberson, J., Armitage, J., Baigent, C., Blackwell, L., Blumenthal, R., Danesh, J., Smith, G. D., DeMets, D., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31357-5 · Cited by 1,857
Boden, J. M., & Fergusson, D. M. (2011) · Addiction · doi:10.1111/j.1360-0443.2010.03351.x · Cited by 1,233
A Trial of Sugar-free or Sugar-Sweetened Beverages and Body Weight in Children
de Ruyter, J. C., Olthof, M. R., Seidell, J. C., & Katan, M. B. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1203034 · Cited by 814
Metadata
- Authors
- Fewell, Z., Davey Smith, G., & Sterne, J. A. C.
- Affiliations
- University of Bristol (GB)
- ORCID
- Sterne, J. A. C.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-06-24
- Volume
- 166
- Issue
- 6
- Pages
- 646-655
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2098314489
- Cited by
- 734
- References
- 40
- Citations by year
- 2026: 62 · 2025: 72 · 2024: 100 · 2023: 72 · 2022: 49 · 2021: 53 · 2020: 41 · 2019: 39 · 2018: 47 · 2017: 30 · 2016: 28 · 2015: 20 · 2014: 21 · 2013: 15 · 2012: 18
- FWCI
- 15.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Explore Bristol Research (submittedVersion)
- Funders
- Medical Research Council
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- residual confounding, unmeasured confounding, measurement error, exposure-outcome association, logistic regression, simulation study
- MeSH terms
- Data Interpretation, Statistical, Epidemiologic Methods, Humans, Research Design, Bias, Confounding Factors, Epidemiologic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.