The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Risk Factors, Confounding, and the Illusion of Statistical Control
Abstract
When experimental designs are premature, impractical, or impossible, researchers must rely on statistical methods to adjust for potentially confounding effects. Such procedures, however, are quite fallible. We examine several errors that often follow the use of statistical adjustment. The first is inferring a factor is causal because it predicts an outcome even after "statistical control" for other factors. This inference is fallacious when (as usual) such control involves removing the linear contribution of imperfectly measured variables, or when some confounders remain unmeasured. The converse fallacy is inferring a factor is not causally important because its association with the outcome is attenuated or eliminated by the inclusion of covariates in the adjustment process. This attenuation may only reflect that the covariates treated as confounders are actually mediators (intermediates) and critical to the causal chain from the study factor to the study outcome. Other problems arise due to mismeasurement of the study factor or outcome, or because these study variables are only proxies for underlying constructs. Statistical adjustment serves a useful function, but it cannot transform observational studies into natural experiments, and involves far more subjective judgment than many users realize.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, great care should be exercised when interpreting adjusted results, as the validity of results often depends crucially on complete knowledge of important confounders, their precise measurement, and appropriate specification in the statistical model (see also item 20) [ 157 , 158 ].”
From Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration (2007) · cites this paper as [157]
Citations
Cites
Efficient capital markets: A review of theory and empirical work
Fama, E. F. (1970) · The Journal of Finance · doi:10.2307/2325486 · Cited by 13,635
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Self-citationProcess Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Kraemer, H. C., Stice, E., Kazdin, A., Offord, D., & Kupfer, D. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.6.848 · Cited by 1,712
Hernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
THE EFFECT OF MISCLASSIFICATION IN THE PRESENCE OF COVARIATES
GREENLAND, S. (1980) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113025 · Cited by 494
Self-citationRandomization, Statistics, and Causal Inference
Greenland, S. (1990) · Epidemiology · doi:10.1097/00001648-199011000-00003 · Cited by 385
Self-citationData, Design, and Background Knowledge in Etiologic Inference
Robins, J. M. (2001) · Epidemiology · doi:10.1097/00001648-200105000-00011 · Cited by 358
Religion and mortality among the community-dwelling elderly.
Oman, D., & Reed, D. (1998) · American Journal of Public Health · doi:10.2105/ajph.88.10.1469 · Cited by 350
Research works printed but not linked: 34
- Talcott, 1998, Co-occurrent use of cigarettes, alcohol, and caffeine in a retired military population., Mil Med, 163, 133, 10.1093/milmed/163.3.133 · DOI
- Greenland, 2003, Quantifying biases in causal models: classical confounding vs. collider-stratification bias., Epidemiology, 14, 300, 10.1097/01.EDE.0000042804.12056.6C · DOI · Paper page
- Cole, 2002, Fallibility is estimating direct effects., Int J Epidemiol, 31, 163, 10.1093/ije/31.1.163 · DOI · Paper page
- Greenland, 2002, An overview of relations among causal modelling methods., Int J Epidemiol, 31, 1030, 10.1093/ije/31.5.1030 · DOI · Paper page
- Robins, 1992, Identifiability and exchangeability for direct and indirect effects., Epidemiology, 3, 143, 10.1097/00001648-199203000-00013 · DOI · Paper page
- Hopkins, 1981, A survey of 246 suggested coronary risk factors., Atherosclerosis, 40, 1, 10.1016/0021-9150(81)90122-2 · DOI
- Davey Smith, 1992, Smoking as ‘independent’ risk factor for suicide: illustration of an artifact from observational epidemiology., Lancet, 340, 709, 10.1016/0140-6736(92)92242-8 · DOI · Paper page
- Elliott, 1996, Diagonal earlobe creases and prognosis in patients with suspected coronary artery disease., Am J Med, 100, 205, 10.1016/S0002-9343(97)89460-0 · DOI
- Gump, 2000, Are vacations good for your health? The 9-year mortality experience after the multiple risk factor intervention trial., Psychosom Med, 62, 608, 10.1097/00006842-200009000-00003 · DOI
- Pickering, 1999, Cardiovascular pathways: socioeconomic status and stress effects on hypertension and cardiovascular function., Ann NY Acad Sci, 896, 262, 10.1111/j.1749-6632.1999.tb08121.x · DOI
- Tikkanen, 1998, Associations between skeletal muscle properties, physical fitness, physical activity and coronary heart disease risk factors in men., Atherosclerosis, 137, 377, 10.1016/S0021-9150(97)00276-1 · DOI
- Greenland, 1980, Control of confounding in the assessment of medical technology., Int J Epidemiol, 9, 361, 10.1093/ije/9.4.361 · DOI
- Royston, 2000, A useful monotonic non-linear model with applications in medicine and epidemiology., Stat Med, 19, 2053, 10.1002/1097-0258(20000815)19:15<2053::AID-SIM505>3.0.CO;2-6 · DOI
- Hummer, 1999, Religious involvement and U.S. adult mortality., Demography, 36, 273, 10.2307/2648114 · DOI · Paper page
- Koenig, 1999, Does religious attendance prolong survival? A six-year follow-up study of 3,968 older adults., J Gerontol A Biol Sci Med Sci, 54, M370, 10.1093/gerona/54.7.M370 · DOI · Paper page
- Presser, 1998, Data collection mode and social desirability bias in self-reported religious attendance., Am Sociol Rev, 63, 137, 10.2307/2657486 · DOI
- Phillips, 1991, Bias in relative adds estimation owing to imprecise measurement of correlated exposures., Stat Med, 11, 953, 10.1002/sim.4780110712 · DOI · Paper page
- Frasure-Smith, 1995, Depression and 18-month prognosis after myocardial infarction., Circulation, 91, 999, 10.1161/01.CIR.91.4.999 · DOI
- Carroll, 2002, Depression and mortality following myocardial infarction: the issue of disease severity., Epidemiol Psichiatr Soc, 11, 65, 10.1017/S1121189X00005510 · DOI
- Lane, 2001, Mortality and quality of life 12 months after myocardial infarction: effects of depression and anxiety., Psychosom Med, 63, 221, 10.1097/00006842-200103000-00005 · DOI
- Lane, 2002, In-hospital symptoms of depression do not predict mortality three-years after myocardial infarction., Int J Epidemiol, 31, 1179, 10.1093/ije/31.6.1179 · DOI
- Mayou, 2000, Depression and anxiety as predictors of outcome after myocardial infarction., Psychosom Med, 62, 212, 10.1097/00006842-200003000-00011 · DOI
- Berkman, 2003, effects of treating depression and low perceived social support on clinical events after myocardial infarction: the Enhancing Recovery in Coronary Heart Disease (ENRICHD) randomized trial., JAMA, 289, 3106, 10.1001/jama.289.23.3106 · DOI · Paper page
- Louis, 2002, Clinical trials update: The Heart Protection Study, IONA, CARISA, ENRICHD, ALIVE, MADIT II and REMATCH., Eur J Heart Fail, 4, 111, 10.1016/S1388-9842(01)00240-9 · DOI
- Macleod, 2001, Are the effects of psychosocial exposures attributable to confounding? Evidence from a prospective observational study on psychological stress and mortality., J Epidemiol Commun Health, 55, 878, 10.1136/jech.55.12.878 · DOI
- Macleod, 2002, Psychological stress and cardiovascular disease: empirical demonstration of bias in a prospective observational study of Scottish men., Br Med J, 324, 1247, 10.1136/bmj.324.7348.1247 · DOI
- Suls, 1989, Effects of sensory and procedural information on coping with stressful medical procedures and pain: A meta-analysis., J Consult Clin Psychol, 57, 372, 10.1037/0022-006X.57.3.372 · DOI
- Smith, 1992, Socioeconomic differences in mortality: evidence from Glasgow graveyards., Br Med J, 305, 1554, 10.1136/bmj.305.6868.1554 · DOI
- Glynn, 2001, When stress happens matters: effects of earthquakes on stress responsivity in pregnancy., Am J Obstet Gynecol, 184, 637, 10.1067/mob.2001.111066 · DOI · Paper page
- Christenfeld, 1999, New York City as a risk factor for heart attack mortality., Psychosom Med, 61, 740, 10.1097/00006842-199911000-00003 · DOI
- Kulik, 1996, Social comparison and affiliation under threat: Effects on recovery from major surgery., J Pers Soc Psychol, 71, 967, 10.1037/0022-3514.71.5.967 · DOI
- Robins, 1989, Control of confounding by intermediate variables., Stat Med, 8, 679, 10.1002/sim.4780080608 · DOI
- Smith, 2003, Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials., Br Med J, 327, 1459, 10.1136/bmj.327.7429.1459 · DOI
- Lane, 2004, Is depression following acute myocardial infarction an independent risk for mortality?, Am J Cardiol, 93, 1333, 10.1016/j.amjcard.2004.01.001 · DOI
Cited by
Sorted by citations
Items 201–229 of 229
Eliminating confounder-induced bias in the statistics of intervention
Loukas, O., & Chung, H. (2023) · doi:10.48550/arxiv.2312.00225 · Cited by 1
Jan, P., Erik, V. E., Douglas, G., Peter, C. G., Cynthia, D., Stuart, J., Charles, P., James, J., & Matthias, E. (2021) · doi:10.17816/dd70821-58176 · Cited by 1
Sorjonen, K., Nilsonne, G., Bo, M.-L., & Ingre, M. (2020) · BMC Research Notes · doi:10.1186/s13104-021-05545-4 · Cited by 1
Key Information for Cannabis and DUIC Policy
Ward, N., Otto, J., Finley, K., & Culture, S. (2019) · ROSA P · doi:10.21949/1518413 · Cited by 1
“Rather, it only means that the inherent risk from certain demographic variables is greater than the risk associated with cannabis use (Christenfeld et al. 2004; Kraemer et al. 2001).”
BackgroundVitaro, F. (2012) · Journal of Gambling Issues · doi:10.4309/jgi.2012.27.3 · Cited by 1
Personality and physical health.
Smith, T. W., Williams, P., & Segerstrom, S. C. (2014) · American Psychological Association eBooks · doi:10.1037/14343-029 · Cited by 16
Addiction science needs rehab.
Fallu, J.-S. (2026) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2026.2745008
Karamitros, G., Bouloukakis, G., Pontell, M. E., Galdyn, I. A., Shakoori, P., Redett, R. J., & Lamaris, G. A. (2026) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2026.09.048
Luan, X.-C., Li, X.-R., Li, X.-X., Wang, X.-Z., Zhang, X.-L., Zhao, B.-S., Xu, J., Z.-H. Y., Jing, G., & Liu, N. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1934652
Hossain, S. J. B., Rumi, M., & Ahmed, S. (2026) · Discover Public Health · doi:10.1186/s12982-026-01629-3
Dempsey, A., Howard, S., & Gallagher, S. (2026) · Religion Brain & Behavior · doi:10.1080/2153599x.2026.2617648 · Cited by 1
“Firstly, due to the cross-sectional nature, inferences about causality cannot be determined (Christenfeld et al., 2004).”
From 'What-is' to 'What-if' in Human-Factor Analysis: A Post-Occupancy Evaluation Case
Chen, X., Sun, R., Geyer, P., Borrmann, A., & Schiavon, S. (2025) · arXiv.org · doi:10.48550/arxiv.2512.02060
“Critical to this process is correctly identifying confounders and colliders – two fundamental variable types that can distort causal inference if not properly handled [44, 8].”
Ansah, E. O., Kyei, F., Opoku, C. F., Danquah, A., Fosu, K., Agyenim, E. B., & Agyirifo, D. (2024) · medRxiv · doi:10.1101/2024.09.23.24314169
“However, these findings can be influenced by confounders that can obscure the relationship between cholesterol and breast cancer [25, 26] .”
Health Psychology and Behavioral Medicine
Smith, T. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.027 · Cited by 20
Conditional Differential Expression for Biomarker Discovery In High-throughput Cancer Data
Wang, D. S. (2019) · uO Research (University of Ottawa) · doi:10.20381/ruor-23071 · Cited by 1
“When these covariates are not controlled in the study design, it is pertinent that statistical analyses account for these possibly confounding effects [13] [14].”
BackgroundConfound those Damned Confounders
Sleigh, J. W. (2012) · Anaesthesia and Intensive Care · doi:10.1177/0310057x1204000402
Safety of ibuprofen vs. paracetamol.
Peterson, G., & Naunton, M. (2011) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2010.03864.x
Symptoms of depression but not depressive disorder. Reply
Hoen, P., Whooley, M., & de Jonge, P. (2011) · doi:10.1016/j.jacc.2010.11.035
Regression Versus Causation, Revisited
Cox, L. A. (2010) · doi:10.1111/j.1539-6924.2010.01388.x
Goring, S. (2009) · Asian Test Symposium · doi:10.14288/1.0066519
“There are several limitations to this approach.(148,149) First, this method does not correct of imbalances in unmeasured or immeasurable confounders, as they are, by definition, not measured, and therefore can not be entered into the model.”
Carroll, D., Bennett, P., & Vedhara, K. (2007) · British Journal of Health Psychology · doi:10.1348/135910707x182268
Self-citationAssessing the impact of prescribed medicines on health outcomes
Lucke, J., & Hall, W. (2007) · Australia and New Zealand Health Policy · doi:10.1186/1743-8462-4-1 · Cited by 21
“tobacco and alcohol use, comorbid conditions, etc) are not measured then neither of these approaches can be used to control for confounding by indication [36,38].”
Evidencing Situational Interaction Without Situation-Level Exposure Data
Hardie, B. (2020) · SpringerBriefs in criminology · doi:10.1007/978-3-030-46194-2_3
Why Not Replace Quantitative Risk Assessment Models with Regression Models?
Cox, L. A. (2020) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-3-030-57358-4_7
How to Assess a Prognostic Study
Gupta, S., Kim, K. S., Belley-Côté, É., & Whitlock, R. (2019) · Evidence-Based Surgery · doi:10.1007/978-3-030-05120-4_21
“When experimental designs are premature, impractical, or impossible, researchers must rely on statistical methods to adjust for potentially confounding effects (4).”
Background
Metadata
- Authors
- Christenfeld, N. J. S., Sloan, R. P., Carroll, D., & Greenland, S.
- Affiliations
- University of California San Diego (US)
- University of California, Los Angeles (US)
- Corresponding author
- Christenfeld, Nicholas J. S.
- Venue
- Psychosomatic Medicine
- Published
- 2004-11
- Volume
- 66
- Issue
- 6
- Pages
- 868-875
- ISSN
- 0033-3174 (ISSN-L)
- OpenAlex
- W2065056866
- Cited by
- 260
- References
- 0
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 8 · 2023: 5 · 2022: 11 · 2021: 21 · 2020: 15 · 2019: 17 · 2018: 7 · 2017: 4 · 2016: 13 · 2015: 8 · 2014: 14 · 2013: 14 · 2012: 28
- FWCI
- 1.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychosomatic Medicine (publishedVersion)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- confounding, statistical adjustment, causal inference, risk factors, measurement error, mediators, covariate adjustment, observational studies, natural experiment
- MeSH terms
- Data Interpretation, Statistical, False Positive Reactions, Humans, Research Design, Risk Factors, Reproducibility of Results, Health Behavior, Bias, Confounding Factors, Epidemiologic, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Observation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review