The Impact of Residual and Unmeasured Confounding in Epidemiologic Studies: A Simulation Study
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Measurement error in explanatory variables and unmeasured confounders can cause considerable problems in epidemiologic studies. It is well recognized that under certain conditions, nondifferential measurement error in the exposure variable produces bias towards the null. Measurement error in confounders will lead to residual confounding, but this is not a straightforward issue, and it is not clear in which direction the bias will point. Unmeasured confounders further complicate matters. There has been discussion about the amount of bias in exposure effect estimates that can plausibly occur due to residual or unmeasured confounding. In this paper, the authors use simulation studies and logistic regression analyses to investigate the size of the apparent exposure-outcome association that can occur when in truth the exposure has no causal effect on the outcome. The authors consider two cases with a normally distributed exposure and either two or four normally distributed confounders. When the confounders are uncorrelated, bias in the exposure effect estimate increases as the amount of residual and unmeasured confounding increases. Patterns are more complex for correlated confounders. With plausible assumptions, effect sizes of the magnitude frequently reported in observational epidemiologic studies can be generated by residual and/or unmeasured confounding alone.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is the opposite of what is often seen where observational studies over-estimate effects found in large, well designed RCTs.”
From A systematic review and meta-analysis of effects of early life non-cognitive skills on academic, psychosocial, cognitive and health outcomes (2018) · cites this paper as [45]
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Analysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
Vitamin E Consumption and the Risk of Coronary Heart Disease in Men
Rimm, E. B., Stampfer, M. J., Ascherio, A., Giovannucci, E., Colditz, G. A., & Willett, W. C. (1993) · New England Journal of Medicine · doi:10.1056/nejm199305203282004 · Cited by 2,347
Vitamin E Consumption and the Risk of Coronary Disease in Women
Stampfer, M. J., Hennekens, C. H., Manson, J. E., Colditz, G. A., Rosner, B., & Willett, W. C. (1993) · New England Journal of Medicine · doi:10.1056/nejm199305203282003 · Cited by 2,103
Hernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
Roncaglioni, M. C. (2001) · The Lancet · doi:10.1016/s0140-6736(00)03539-x · Cited by 999
Identifiability, Exchangeability, and Epidemiological Confounding
GREENLAND, S., & ROBINS, J. M. (1986) · International Journal of Epidemiology · doi:10.1093/ije/15.3.413 · Cited by 686
Covariate measurement errors and parameter estimation in a failure time regression model
PRENTICE, R. L. (1982) · Biometrika · doi:10.1093/biomet/69.2.331 · Cited by 668
Basic Methods for Sensitivity Analysis of Biases
GREENLAND, S. (1996) · International Journal of Epidemiology · doi:10.1093/ije/25.6.1107 · Cited by 586
Cited by
Items 701–759 of 759
Bell, J. A., Carslake, D., Hughes, A., Tilling, K. M., Dodd, J. W., Doidge, J., Harrison, D. A., Rowan, K. M., & Smith, G. D. (2024) · Figshare · doi:10.6084/m9.figshare.27019377
Additional file 1 of MIND diet and the risk of dementia: a population-based study
de Crom, T. O. E., Mooldijk, S. S., Ikram, M. K., Ikram, M. A., & Voortman, T. (2022) · Figshare · doi:10.6084/m9.figshare.18318128
Bell, J. A., Carslake, D., Hughes, A., Tilling, K. M., Dodd, J. W., Doidge, J., Harrison, D. A., Rowan, K. M., & Smith, G. D. (2024) · Figshare · doi:10.6084/m9.figshare.27019392
Bell, J. A., Carslake, D., Hughes, A., Tilling, K. M., Dodd, J. W., Doidge, J., Harrison, D. A., Rowan, K. M., & Smith, G. D. (2024) · Figshare · doi:10.6084/m9.figshare.27019380
Kawabata, E., Tilling, K., Groenwold, R. H. H., & Hughes, R. A. (2023) · Figshare · doi:10.6084/m9.figshare.22767476
Bell, J. A., Carslake, D., Hughes, A., Tilling, K. M., Dodd, J. W., Doidge, J., Harrison, D. A., Rowan, K. M., & Smith, G. D. (2024) · Figshare · doi:10.6084/m9.figshare.27019437
Bell, J. A., Carslake, D., Hughes, A., Tilling, K. M., Dodd, J. W., Doidge, J., Harrison, D. A., Rowan, K. M., & Smith, G. D. (2024) · Figshare · doi:10.6084/m9.figshare.27019365
Bell, J. A., Carslake, D., Hughes, A., Tilling, K. M., Dodd, J. W., Doidge, J., Harrison, D. A., Rowan, K. M., & Smith, G. D. (2024) · Figshare · doi:10.6084/m9.figshare.27019401
Bell, J. A., Carslake, D., Hughes, A., Tilling, K. M., Dodd, J. W., Doidge, J., Harrison, D. A., Rowan, K. M., & Smith, G. D. (2024) · Figshare · doi:10.6084/m9.figshare.27019422
Mentis, A.-F. A., Dardiotis, E., Efthymiou, V., & Chrousos, G. P. (2021) · Figshare · doi:10.6084/m9.figshare.13565690
Characterising sedentary and screen-based behaviour in adults
Harvey, D. L. (2023) · UEA Digital Repository (University of East Anglia) · Cited by 1
Desai, R. (2025) · UCL Discovery (University College London)
Risk insights for clinical medication: a Mendelian randomization study of 23 drugs and lung cancer
Wang, H., Zhou, B., Ma, B., Zhang, T., & Kong, R. (2026) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-025-04967-2
Associations of bee sting injuries with environmental and social factors: an exploratory study
Kim, Y., & Min, K. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1742966
Zhang, G., Xia, J., Zhou, Y., Qian, J., Yin, D., & Lv, W. (2026) · Discover Oncology · doi:10.1007/s12672-026-04672-3
Introduction to genetics of skeletal and mineral metabolic diseases
Newey, P. J., Lovegrove, C. E., Howles, S., Whyte, M. P., & Thakker, R. V. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-13683-2.00015-3
Yoshiji, S. (2024) · eScholarship@McGill (McGill) · doi:10.82308/23011
Shen, Q.-M., Li, Z., Tan, Y., Gao, L.-F., Liu, D.-K., Li, H. L., Yang, W., & Xiang, Y.-B. (2026) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.4290
Goulian, A. J., Wilson, I., & Locke, A. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15103607
Rasengane, T. A., Ezinne, N. E., Ndep, A. O., Eseme, N. J., Richter, S. M., Agho, K., Ejidike, G. E., Kwarteng, M. A., Ahaiwe, K. E., Meribe, N. C., et al. (2026) · Health Science Reports · doi:10.1002/hsr2.72504
Zehra, A., Deng, Y., SWARNA, K. S., Herrin, J. S., Polley, E. C., Neumiller, J. J., Galindo, R. J., Umpierrez, G. E., Ross, J. S., Brito, J. P., et al. (2026) · Journal of the American Heart Association · doi:10.1161/jaha.125.046238 · Cited by 1
Alderson, E., Bowden, N., McLay, L., Beaglehole, B., & Schlüter, P. J. (2026) · JCPP Advances · doi:10.1002/jcv2.70133
Sim, H., Lee, W. K., Lange, C., & Lee, W. (2026) · Statistics in Medicine · doi:10.1002/sim.70630
Hennessy, C., Swartz, A. Z., Harrell, F. E., & Silver, H. J. (2026) · BMC Medical Research Methodology · doi:10.1186/s12874-026-02881-6
Ko, S., Leckie, G., Evans, C. R., Kim, R., & Subramanian, S. V. (2026) · International Journal of Epidemiology · doi:10.1093/ije/dyag073
Kadri, H. M. A., El‐Metwally, A., Farook, F. F., Othman, F. M., Al-Sehli, H., Sudairy, A. A. A., & Aldubikhi, A. I. S. (2026) · Frontiers in Global Women s Health · doi:10.3389/fgwh.2026.1816012
Park, S. J., Seok, H. H., Kim, S. H., Lee, S. Y., Kim, B. J., Park, T., Kim, E., & Kim, H. J. (2026) · Medicina · doi:10.3390/medicina62071212
Tatoli, R., Donghia, R., Casimo, G., Pesole, P. L., & Bonfiglio, C. (2026) · Antioxidants · doi:10.3390/antiox15070802
Zhu, G., Liu, J., Wang, S., & Wang, L. (2026) · Medicine · doi:10.1097/md.0000000000049348
Zhao, L., Mao, C., Xu, Y., Zhou, K., Liang, M., Han, Y., Zhang, J., Hong, Y., Hu, N., & Wu, F. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1883227
The spectrum of steatotic liver disease in the USA
Jaidka, K., Bhagat, N., De, A., & Duseja, A. K. (2026) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(26)00122-6
Using non-targeted HPV infections in studies with risk compensation
Étiévant, L. (2026) · The International Journal of Biostatistics · doi:10.1515/ijb-2025-0087
Mendelian randomization applied to cancer: What it has and has not achieved
Smith-Byrne, K., Breeur, M., Yarmolinsky, J. W., & Smith, G. D. (2026) · Cancer Epidemiology · doi:10.1016/j.canep.2026.103182
The Rebirth of Ecological StudyPreprint
Ma, H. (2026) · Qeios · doi:10.32388/fbo0c7
Zhang, X., Guo, J., Luo, F., Zheng, D., Zhang, Y., & Chen, T. (2026) · BMC Cardiovascular Disorders · doi:10.1186/s12872-026-06366-8
Schlüter, P. J., Verster, F., Bowden, N., Chepulis, L. M., Dai, Y., & Paul, R. G. (2026) · Scientific Reports · doi:10.1038/s41598-026-64322-0
The Rebirth of Ecological StudyPreprint
Ma, H. (2026) · Qeios · doi:10.32388/fbo0c7.2
Do quantitative bias analyses accurately characterize bias due to uncontrolled confounding?
Armidie, T. A., Collin, L. J., MacLehose, R. F., Ahern, T. P., & Lash, T. L. (2026) · Annals of Epidemiology · doi:10.1016/j.annepidem.2026.110270
Yarmolinsky, J. W., Cavallo, F. R., Koskeridis, F., Yu, X., Bouras, E., Richenberg, G., Costantini, I., Ray, D., Woolf, B. A. R., Karhunen, V., et al. (2026) · medRxiv · doi:10.64898/2026.08.30.26361622
Do Specific Diseases Matter? 7-Year Trajectories of Subjective Aging in Middle-Aged and Older Adults
Gehring, M., Wettstein, M., Reinhard, A.-K., & Wurm, S. (2026) · GeroPsych · doi:10.1024/1662-9647/a000374
Liu, Y., Zhang, M., & Liu, Y. (2026) · Frontiers in Nutrition · doi:10.3389/fnut.2026.1895132
İNCEBIYIK, M., & Düken, R. K. (2026) · The Atlantic Journal of Medical Science and Research · doi:10.5455/atjmed.2026.03.026
A flexible Monte Carlo quantitative bias analysis for unmeasured confounding
Kawabata, E., Shapland, C. Y., Palmer, T., Carslake, D., Tilling, K. M., & Hughes, R. (2026) · Statistical Methods in Medical Research · doi:10.1177/09622802261488056
Xuan, Z., Zhen, Y., Muheyati, D., Huang, D., Cui, L., Chen, Z., Dai, M., Jiang, Y., Ding, Y., Qian, Y., et al. (2026) · Clinical Cosmetic and Investigational Dermatology · doi:10.2147/ccid.s633054
Charro, R., Arshad, T., & Eman, N. U. (2026) · Revista Portuguesa de Cardiologia · doi:10.1016/j.repc.2026.08.006 · Cited by 1
Upadhyay, D., Acharya, B., Maharjan, K., Poudel, N., Neupane, B., & Dhakal, J. (2026) · Research Square · doi:10.21203/rs.3.rs-10722803/v1
Montilla, M., Bastidas, J. A. O., Fajardo, H. A. R., López, A. M. M., Tique, S., Cruz, D. P. R., Vega, E. C., Pavas-Escobar, N., Vargas, L. N. O., Farfán, J. P., et al. (2026) · PLOS Global Public Health · doi:10.1371/journal.pgph.0006492
Denova‐Gutiérrez, E., Tintle, N., Lai, H. T. M., Westra, J., Jong, E. D., Muñoz-Aguirre, P., Kuri-Morales, P. A., Alegre-Díaz, J., Tapia‐Conyer, R., Berumen-Campos, J., et al. (2026) · Clinical Nutrition ESPEN · doi:10.1016/j.clnesp.2026.105171
Diet Quality and Prognosis in Patients With Non-Muscle Invasive Bladder Cancer: The Be-Well Study
Ergas, I. J., Zimbalist, A., Haque, R., Lee, V. S., Roh, J. M., Cannavale, K. L., Wang, Z., Loo, R. K., Aaronson, D. S., Quesenberry, C. P., et al. (2026) · Urology · doi:10.1016/j.urology.2026.10.010
Nyström, T., Michelsen, J., Imberg, H., Hallström, S., Tasselius, V., Norhammar, A., Petzold, M., Mader, J. K., Choudhary, P., Elzalabany, M. K., et al. (2026) · Diabetes Obesity and Metabolism · doi:10.1111/dom.71429
Su, Y.-H., Wei, C., Lin, C.-C., Chen, M., Chen, M.-K., Hung, K., & Chen, P. (2026) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2026.144007
Association Between Frequency of Childhood Milk Intake and Adult Lung Function
Zhang, Y., Zhang, Y., Wang, X., Liu, C., Ye, L., Rao, T., Liu, J., Zhang, W., Li, Y., Wang, R., et al. (2026) · Food Science & Nutrition · doi:10.1002/fsn3.72524
Jaju, S., Chinnappan, N., Sakthivel, V., Nair, A., Kumar, M. V., Pandian, J., Sivagnanam, J., Jose, A., Morris, R. J., Ramasamy, K., et al. (2026) · Indian Journal of Ophthalmology · doi:10.4103/ijo.ijo_61_26
Ling-ling, W., (290115), Y. L., Rong, L., Qian, W., Chen, X., Cheng, Z.-R., Chen, S.-Y., Yang, Y., Chien, C.-W., & Tung, T. (2026) · Annals of Medicine · doi:10.1080/07853890.2026.2752675
Sakeah, J. K. (2026) · uO Research (University of Ottawa) · doi:10.20381/ruor-32363
The persistent multidomain health effects of the early-life exposome
Anguita‐Ruiz, A., Amine, I., Luo, C., Guillien, A., Arteaga, M., Setó-Llorens, A., Stratakis, N., Maître, L., Güil-Oumrait, N., Ruiz-Rivera, M., et al. (2026) · Science Advances · doi:10.1126/sciadv.aec2089
Shah, M. (2012) · Scholarship@Western (Western University)
Metadata
- Authors
- Fewell, Z., Davey Smith, G., & Sterne, J. A. C.
- Affiliations
- University of Bristol (GB)
- ORCID
- Sterne, J. A. C.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-06-24
- Volume
- 166
- Issue
- 6
- Pages
- 646-655
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2098314489
- Cited by
- 734
- References
- 40
- Citations by year
- 2026: 62 · 2025: 72 · 2024: 100 · 2023: 72 · 2022: 49 · 2021: 53 · 2020: 41 · 2019: 39 · 2018: 47 · 2017: 30 · 2016: 28 · 2015: 20 · 2014: 21 · 2013: 15 · 2012: 18
- FWCI
- 15.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Explore Bristol Research (submittedVersion)
- Funders
- Medical Research Council
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- residual confounding, unmeasured confounding, measurement error, exposure-outcome association, logistic regression, simulation study
- MeSH terms
- Data Interpretation, Statistical, Epidemiologic Methods, Humans, Research Design, Bias, Confounding Factors, Epidemiologic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.