The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Risk Factors, Confounding, and the Illusion of Statistical Control
Abstract
When experimental designs are premature, impractical, or impossible, researchers must rely on statistical methods to adjust for potentially confounding effects. Such procedures, however, are quite fallible. We examine several errors that often follow the use of statistical adjustment. The first is inferring a factor is causal because it predicts an outcome even after "statistical control" for other factors. This inference is fallacious when (as usual) such control involves removing the linear contribution of imperfectly measured variables, or when some confounders remain unmeasured. The converse fallacy is inferring a factor is not causally important because its association with the outcome is attenuated or eliminated by the inclusion of covariates in the adjustment process. This attenuation may only reflect that the covariates treated as confounders are actually mediators (intermediates) and critical to the causal chain from the study factor to the study outcome. Other problems arise due to mismeasurement of the study factor or outcome, or because these study variables are only proxies for underlying constructs. Statistical adjustment serves a useful function, but it cannot transform observational studies into natural experiments, and involves far more subjective judgment than many users realize.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, great care should be exercised when interpreting adjusted results, as the validity of results often depends crucially on complete knowledge of important confounders, their precise measurement, and appropriate specification in the statistical model (see also item 20) [ 157 , 158 ].”
From Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration (2007) · cites this paper as [157]
Citations
Cites
Efficient capital markets: A review of theory and empirical work
Fama, E. F. (1970) · The Journal of Finance · doi:10.2307/2325486 · Cited by 13,635
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Self-citationProcess Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Kraemer, H. C., Stice, E., Kazdin, A., Offord, D., & Kupfer, D. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.6.848 · Cited by 1,712
Hernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
THE EFFECT OF MISCLASSIFICATION IN THE PRESENCE OF COVARIATES
GREENLAND, S. (1980) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113025 · Cited by 494
Self-citationRandomization, Statistics, and Causal Inference
Greenland, S. (1990) · Epidemiology · doi:10.1097/00001648-199011000-00003 · Cited by 385
Self-citationData, Design, and Background Knowledge in Etiologic Inference
Robins, J. M. (2001) · Epidemiology · doi:10.1097/00001648-200105000-00011 · Cited by 358
Religion and mortality among the community-dwelling elderly.
Oman, D., & Reed, D. (1998) · American Journal of Public Health · doi:10.2105/ajph.88.10.1469 · Cited by 350
Research works printed but not linked: 34
- Talcott, 1998, Co-occurrent use of cigarettes, alcohol, and caffeine in a retired military population., Mil Med, 163, 133, 10.1093/milmed/163.3.133 · DOI
- Greenland, 2003, Quantifying biases in causal models: classical confounding vs. collider-stratification bias., Epidemiology, 14, 300, 10.1097/01.EDE.0000042804.12056.6C · DOI · Paper page
- Cole, 2002, Fallibility is estimating direct effects., Int J Epidemiol, 31, 163, 10.1093/ije/31.1.163 · DOI · Paper page
- Greenland, 2002, An overview of relations among causal modelling methods., Int J Epidemiol, 31, 1030, 10.1093/ije/31.5.1030 · DOI · Paper page
- Robins, 1992, Identifiability and exchangeability for direct and indirect effects., Epidemiology, 3, 143, 10.1097/00001648-199203000-00013 · DOI · Paper page
- Hopkins, 1981, A survey of 246 suggested coronary risk factors., Atherosclerosis, 40, 1, 10.1016/0021-9150(81)90122-2 · DOI
- Davey Smith, 1992, Smoking as ‘independent’ risk factor for suicide: illustration of an artifact from observational epidemiology., Lancet, 340, 709, 10.1016/0140-6736(92)92242-8 · DOI · Paper page
- Elliott, 1996, Diagonal earlobe creases and prognosis in patients with suspected coronary artery disease., Am J Med, 100, 205, 10.1016/S0002-9343(97)89460-0 · DOI
- Gump, 2000, Are vacations good for your health? The 9-year mortality experience after the multiple risk factor intervention trial., Psychosom Med, 62, 608, 10.1097/00006842-200009000-00003 · DOI
- Pickering, 1999, Cardiovascular pathways: socioeconomic status and stress effects on hypertension and cardiovascular function., Ann NY Acad Sci, 896, 262, 10.1111/j.1749-6632.1999.tb08121.x · DOI
- Tikkanen, 1998, Associations between skeletal muscle properties, physical fitness, physical activity and coronary heart disease risk factors in men., Atherosclerosis, 137, 377, 10.1016/S0021-9150(97)00276-1 · DOI
- Greenland, 1980, Control of confounding in the assessment of medical technology., Int J Epidemiol, 9, 361, 10.1093/ije/9.4.361 · DOI
- Royston, 2000, A useful monotonic non-linear model with applications in medicine and epidemiology., Stat Med, 19, 2053, 10.1002/1097-0258(20000815)19:15<2053::AID-SIM505>3.0.CO;2-6 · DOI
- Hummer, 1999, Religious involvement and U.S. adult mortality., Demography, 36, 273, 10.2307/2648114 · DOI · Paper page
- Koenig, 1999, Does religious attendance prolong survival? A six-year follow-up study of 3,968 older adults., J Gerontol A Biol Sci Med Sci, 54, M370, 10.1093/gerona/54.7.M370 · DOI · Paper page
- Presser, 1998, Data collection mode and social desirability bias in self-reported religious attendance., Am Sociol Rev, 63, 137, 10.2307/2657486 · DOI
- Phillips, 1991, Bias in relative adds estimation owing to imprecise measurement of correlated exposures., Stat Med, 11, 953, 10.1002/sim.4780110712 · DOI · Paper page
- Frasure-Smith, 1995, Depression and 18-month prognosis after myocardial infarction., Circulation, 91, 999, 10.1161/01.CIR.91.4.999 · DOI
- Carroll, 2002, Depression and mortality following myocardial infarction: the issue of disease severity., Epidemiol Psichiatr Soc, 11, 65, 10.1017/S1121189X00005510 · DOI
- Lane, 2001, Mortality and quality of life 12 months after myocardial infarction: effects of depression and anxiety., Psychosom Med, 63, 221, 10.1097/00006842-200103000-00005 · DOI
- Lane, 2002, In-hospital symptoms of depression do not predict mortality three-years after myocardial infarction., Int J Epidemiol, 31, 1179, 10.1093/ije/31.6.1179 · DOI
- Mayou, 2000, Depression and anxiety as predictors of outcome after myocardial infarction., Psychosom Med, 62, 212, 10.1097/00006842-200003000-00011 · DOI
- Berkman, 2003, effects of treating depression and low perceived social support on clinical events after myocardial infarction: the Enhancing Recovery in Coronary Heart Disease (ENRICHD) randomized trial., JAMA, 289, 3106, 10.1001/jama.289.23.3106 · DOI · Paper page
- Louis, 2002, Clinical trials update: The Heart Protection Study, IONA, CARISA, ENRICHD, ALIVE, MADIT II and REMATCH., Eur J Heart Fail, 4, 111, 10.1016/S1388-9842(01)00240-9 · DOI
- Macleod, 2001, Are the effects of psychosocial exposures attributable to confounding? Evidence from a prospective observational study on psychological stress and mortality., J Epidemiol Commun Health, 55, 878, 10.1136/jech.55.12.878 · DOI
- Macleod, 2002, Psychological stress and cardiovascular disease: empirical demonstration of bias in a prospective observational study of Scottish men., Br Med J, 324, 1247, 10.1136/bmj.324.7348.1247 · DOI
- Suls, 1989, Effects of sensory and procedural information on coping with stressful medical procedures and pain: A meta-analysis., J Consult Clin Psychol, 57, 372, 10.1037/0022-006X.57.3.372 · DOI
- Smith, 1992, Socioeconomic differences in mortality: evidence from Glasgow graveyards., Br Med J, 305, 1554, 10.1136/bmj.305.6868.1554 · DOI
- Glynn, 2001, When stress happens matters: effects of earthquakes on stress responsivity in pregnancy., Am J Obstet Gynecol, 184, 637, 10.1067/mob.2001.111066 · DOI · Paper page
- Christenfeld, 1999, New York City as a risk factor for heart attack mortality., Psychosom Med, 61, 740, 10.1097/00006842-199911000-00003 · DOI
- Kulik, 1996, Social comparison and affiliation under threat: Effects on recovery from major surgery., J Pers Soc Psychol, 71, 967, 10.1037/0022-3514.71.5.967 · DOI
- Robins, 1989, Control of confounding by intermediate variables., Stat Med, 8, 679, 10.1002/sim.4780080608 · DOI
- Smith, 2003, Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials., Br Med J, 327, 1459, 10.1136/bmj.327.7429.1459 · DOI
- Lane, 2004, Is depression following acute myocardial infarction an independent risk for mortality?, Am J Cardiol, 93, 1333, 10.1016/j.amjcard.2004.01.001 · DOI
Cited by
Sorted by citations
Items 101–200 of 229
Ring, C., France, C. R., al'Absi, M., Edwards, L., McIntyre, D., Carroll, D., & Martin, U. (2008) · Biological Psychology · doi:10.1016/j.biopsycho.2007.10.006 · Cited by 31
Self-citationTyra, A. T., Ginty, A. T., & John‐Henderson, N. A. (2021) · International Journal of Behavioral Medicine · doi:10.1007/s12529-021-09964-2 · Cited by 34
Hardie, B. (2019) · Deviant Behavior · doi:10.1080/01639625.2019.1673924 · Cited by 28
“…the inclusion of unnecessary controls can damage the predictive power of models, which further hampers attempts to demonstrate statistical interaction (Christenfeld et al. 2004; Hardie forthcoming,c; Hirtenlehner and Kunz 2015; McClelland and Judd 1993; Pauwels, Ponsaers, and Svensson 2009).”
BackgroundSmith, T. W., & Weihs, K. L. (2019) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000739 · Cited by 43
“and validity of the “partialled” versions of predictive variables (183,184).”
BackgroundPuig‐Pérez, S., Villada, C., Pulopulos, M. M., Hidalgo, V., & Salvador, A. (2016) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.01.015 · Cited by 27
Magura, S., McKean, J., Kosten, S., & Tonigan, J. S. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2012.09.011 · Cited by 28
“However, explicit “covariate control” for such factors, even when a study attempts to measure them, inevitably results in serious problems of interpretation (Christenfeld et al., 2004).”
BackgroundMulti-pollutant Modeling Through Examination of Susceptible Subpopulations Using Profile Regression
Coker, E., Liverani, S., Su, J. G., & Molitor, J. (2018) · Current Environmental Health Reports · doi:10.1007/s40572-018-0177-0 · Cited by 26
Beasley, M., Macfarlane, T. V., & Macfarlane, G. J. (2016) · Pain · doi:10.1097/j.pain.0000000000000675 · Cited by 26
“However, it is possible that some of these third variables may actually be mediators of the observed effect, in which case they should not have been used in adjustment and the observed relationship will have been underestimated.(2) Figure 2.”
BackgroundBias due to 2-stage residual-outcome regression analysis in genetic association studies
Demissie, S., & Cupples, L. (2011) · Genetic Epidemiology · doi:10.1002/gepi.20607 · Cited by 25
“Environmental or biological variables, such as dietary factors, smoking, age, and sex, are often used as covariates in MLR with the goal of reducing noise in the outcome variation and estimating the genotype effect more precisely [Christenfeld et al., 2004].”
MethodGinty, A. T., Hurley, P. E., & Young, D. A. (2020) · Biological Psychology · doi:10.1016/j.biopsycho.2020.107933 · Cited by 24
Xu, Y., Wang, I. Y., Chen, J., Sun, J., & Li, J. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102521 · Cited by 36
Markham, W., & Spencer, N. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262988 · Cited by 22
“In studies with SES as the exposure variable, adjusting in regression analysis for psychological, social or behaviour related variables which are potential mediators is likely to reduce the direct effect of SES on ADHD [16].”
MethodTyra, A. T., Soto, S. M., Young, D. A., & Ginty, A. T. (2020) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2020.08.006 · Cited by 27
Tyra, A. T., Brindle, R. C., Hughes, B. M., & Ginty, A. T. (2020) · Psychophysiology · doi:10.1111/psyp.13681 · Cited by 27
Tak, L. M., Bakker, S. J. L., Slaets, J. P. J., & Rosmalen, J. G. M. (2009) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2009.05.059 · Cited by 21
“The drawback of this strategy is inferring that hs-CRP is not causally important because its association with FSS is eliminated by the inclusion of covariates in the adjustment process, while it may only reflect that the covariates treated as confounders are actually critical to the causal chain (Christenfeld et al.,…”
BackgroundMethodCarroll, D., Batty, G., Mortensen, L., Deary, I., & Phillips, A. C. (2011) · Thorax · doi:10.1136/thoraxjnl-2011-200104 · Cited by 20
“Fourth, observational studies are prone to confounding by poorly measured or unmeasured variables.(40) However, we adjusted for a more complete set of potentially relevant confounders than previous studies.”
Self-citationUnikel, C., Holle, A. F. V., Bulik, C. M., & Ocampo-Ortega, R. (2011) · European Eating Disorders Review · doi:10.1002/erv.1070 · Cited by 19
Gratitude, social support and cardiovascular reactivity to acute psychological stress
Gallagher, S. M., Creaven, A., Howard, S., Ginty, A. T., & Phillips, A. C. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108090 · Cited by 19
Increased risk of ischaemic heart disease after kidney donation
Haugen, A. J., Hallan, S., Langberg, N., Dahle, D., Pihlstrøm, H., Birkeland, K., Reisæter, A., Midtvedt, K., Hartmann, A., Holdaas, H., et al. (2021) · Nephrology, Dialysis and Transplantation · doi:10.1093/ndt/gfab054 · Cited by 19
“We considered eGFR at follow-up as a possible downstream mediator [23] in the association of kidney donation and ischaemic heart disease.”
BackgroundMeurs, M., Zuidersma, M., Dickens, C., & de Jonge, P. (2013) · International Journal of Cardiology · doi:10.1016/j.ijcard.2012.06.042 · Cited by 19
“Incomplete adjustment for confounders or poorly measured confounding factors might lead to the incorrect inference that a variable predicts an outcome independent from these factors [6].”
BackgroundStewart, A., & Carter, J. (2009) · Environmental Geochemistry and Health · doi:10.1007/s10653-008-9210-9 · Cited by 19
“Controlling or adjusting for a factor in multivariate analyses ( Christenfeld et al. 2004 ) usually results in authors neglecting to address the role of that factor in the”
BackgroundUnraveling the mysteries of sleep-disordered breathing in children.
Lerman, J. (2006) · Anesthesiology · doi:10.1097/00000542-200610000-00004 · Cited by 19
Phillips, A. C., Der, G., Shipton, D., & Benzeval, M. (2011) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2011.08.002 · Cited by 16
“Second, determining causality is impossible from observational data, even with prospective data, it is difficult and confounding is always a potential problem (Christenfeld et al., 2004).”
Ginty, A. T., Oosterhoff, B. J., Young, D. A., & Williams, S. E. (2021) · British Journal of Psychology · doi:10.1111/bjop.12528 · Cited by 15
Jensen, A., Andersen, P. K., & Stensballe, L. G. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029794 · Cited by 23
Rughiniș, C., & Humă, B. (2015) · Journal of Aging Studies · doi:10.1016/j.jaging.2015.07.005 · Cited by 16
Ranøyen, I., Jozefiak, T., Wallander, J. L., Lydersen, S., & Indredavik, M. S. (2014) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-014-0888-y · Cited by 19
“Multi-adjusted analyses should be interpreted with some caution due to the difficulty of deciding whether variables are mediators, confounders, or colliders [36].”
BackgroundGray, R. (2013) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.12211 · Cited by 18
A Landmark Paper in HIV Research?
Hall, W., & Lucke, J. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020293 · Cited by 16
Ginty, A. T., Tyra, A. T., Young, D. A., John‐Henderson, N. A., Gallagher, S. M., & Tsang, J.-A. C. (2020) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2020.10.005 · Cited by 19
Smith, T. W. (2019) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000660 · Cited by 15
“, residual confounding resulting from imperfect measurement) have been thoroughly described (21).”
BackgroundPaternal Age and General Cognitive Ability—A Cross Sectional Study of Danish Male Conscripts
McGrath, J. J., Mortensen, P. B., Pedersen, C. B., Ehrenstein, V., & Petersen, L. V. (2013) · PLoS ONE · doi:10.1371/journal.pone.0077444 · Cited by 20
“overadjustment, spurious associations) [27-29].”
Carroll, D., Bibbey, A., Roseboom, T. J., Phillips, A. C., Ginty, A. T., & de Rooij, S. R. (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01361.x · Cited by 14
Self-citationConceptualization, Measurement, and Analysis of Negative Affective Risk Factors
Smith, T. W. (2010) · Springer eBooks · doi:10.1007/978-0-387-09488-5_12 · Cited by 16
Cardiovascular reactions to acute psychological stress and academic achievement
Ginty, A. T., Tyra, A. T., Young, D. A., Brindle, R. C., de Rooij, S. R., & Williams, S. E. (2022) · Psychophysiology · doi:10.1111/psyp.14064 · Cited by 18
Williams, S. E., Quinton, M. L., van Zanten, J. V., Davies, J., Möller, C. M., Trotman, G. P., & Ginty, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.568580 · Cited by 14
“Despite the rigorous approach employed, the crosssectional nature of the work prevents any conclusions of causal relationships existing between variables (Christenfeld et al., 2004).”
BackgroundLiving with observational data in biological anthropology
Smith, R. J. (2019) · American Journal of Physical Anthropology · doi:10.1002/ajpa.23862 · Cited by 16
Diminished cardiovascular stress reactivity is associated with lower levels of social participation
John‐Henderson, N. A., Counts, C. J., Sanders, C. S., & Ginty, A. T. (2019) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2019.01.005 · Cited by 14
“First, since the research is cross-sectional, causality cannot be inferred [43].”
BackgroundSorjonen, K., Falkstedt, D., Wallin, A. S., Bo, M.-L., & Nilsonne, G. (2021) · BMC Psychology · doi:10.1186/s40359-021-00653-z · Cited by 13
Knight, G. P., Safa, M. D., & White, R. M. B. (2018) · Development and Psychopathology · doi:10.1017/s095457941800113x · Cited by 21
Alshaikh, B., Salman, O., Soliman, N., Ells, A., & Yusuf, K. (2017) · BMJ Open Ophthalmology · doi:10.1136/bmjophth-2016-000049 · Cited by 13
“Any risk factors that demonstrated associations, whether statistically significant or judged to be clinically significant, with both pre-eclampsia and ROP but were not intermediate variables, were included in the modelling process as possible confounders.(11) The least significant variables were then removed until all…”
Epidemiological study design and the advancement of equine health
Fosgate, G. T., & Cohen, N. D. (2008) · Equine Veterinary Journal · doi:10.2746/042516408x363323 · Cited by 9
Uso de servicios de salud según posición socioeconómica en trabajadores de una universidad pública
Pavão, A. L. B., Coeli, C. M., Lopes, C. D. S., Faerstein, E., Werneck, G., & Chor, D. (2012) · Revista de Saúde Pública · doi:10.1590/s0034-89102012005000002 · Cited by 11
Keegan, C., Conroy, R., & Doyle, F. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.11.030 · Cited by 11
“els is likely to lead to erroneous conclusions (Christenfeld et al., 2004; Kraemer et al., 2001).”
BackgroundCarroll, D., Phillips, A. C., Der, G., Hunt, K., Bibbey, A., Benzeval, M., & Ginty, A. T. (2012) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2012.10.005 · Cited by 10
“First, it remains possible that our findings are a product of a confounding by a third variable (Christenfeld et al., 2004).”
Self-citationLao, X., Thomas, G., Jiang, C.-Q., Zhang, W.-S., Adab, P., Lam, T., & Cheng, K. (2010) · Respiratory Medicine · doi:10.1016/j.rmed.2010.06.003 · Cited by 11
“*p value for age-adjusted mean comparison among the 4 snoring freq for these effects.(36) A study showed that habitual snoring was an important predisposing factor in future hypertension even for non-obese adults (BMI <27.”
BackgroundO'Riordan, A., Young, D. A., & Ginty, A. (2023) · Biological Psychology · doi:10.1016/j.biopsycho.2023.108599 · Cited by 10
Ginty, A., Young, D. A., Tyra, A. T., Hurley, P. E., Brindle, R. C., & Williams, S. E. (2020) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000848 · Cited by 10
“Lastly, although the study is prospective, it is still correlational in nature and the results could be impacted by a third variable (74).”
BackgroundJohn‐Henderson, N. A., Gruman, H. E., Counts, C. J., & Ginty, A. T. (2020) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2020.104583 · Cited by 10
“Second, the study was cross-sectional, so causation cannot be inferred (Christenfeld, 2004).”
BackgroundRespiratory outcomes of late preterm infants of mothers with early and late onset preeclampsia
Soliman, Y. A., Alshaikh, B., Alawad, E., Akierman, A., Elsharkawy, A., & Yusuf, K. (2019) · Journal of Perinatology · doi:10.1038/s41372-019-0497-4 · Cited by 10
Hatami, R. (2019) · Water, Air and Soil Pollution · doi:10.1007/s11270-019-4150-9 · Cited by 10
Sorjonen, K., Nilsonne, G., Ingre, M., & Bo, M.-L. (2021) · BMC Pediatrics · doi:10.1186/s12887-022-03349-4 · Cited by 9
Gallagher, S., O'Súilleabháin, P. S., & Smith, M. A. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.03.004 · Cited by 9
Wright, A. G. C., & Hallquist, M. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.024
MCEE: a data preprocessing approach for metabolic confounding effect elimination
Li, Y., Li, M.-C., Jia, W., Ni, Y., & Chen, T.-L. (2018) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-018-0947-4 · Cited by 9
Aroused versus calm positive affects as predictors of lipids.
Shirom, A., Melamed, S., Berliner, S. A., & Shapira, I. (2009) · Health Psychology · doi:10.1037/a0015988 · Cited by 11
“A major problem with our adjusting for the control variables used in our OLS regressions is that either of them could be a step in the causal pathway leading from HPHA and HPLA to the T2 levels of the serum lipids under study (Breaugh, 2006; Christenfeld, Sloan, Carroll, & Greenland, 2004 ).”
MethodBourbeau, J., Sedeno, M., Li, P. Z., Troosters, T., Hamilton, A., De Sousa, D., Maltais, F., Erzen, D., & Lavoie, K. L. (2021) · ERJ Open Research · doi:10.1183/23120541.00533-2020 · Cited by 8
Haugan, T., Muggleton, S., & Myhr, A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0254033 · Cited by 9
McMahon, J., Gallagher, E. A., Walsh, E. H., & O’Connor, C. (2021) · Irish Educational Studies · doi:10.1080/03323315.2021.1932555 · Cited by 13
“Given the cross-sectional nature of the research, the authors cannot draw conclusions based on the causality of these relationships (Christenfeld et al. 2004).”
BackgroundStudy design synopsis: Bias can cast a dark shadow over studies
Fosgate, G. T. (2020) · Equine Veterinary Journal · doi:10.1111/evj.13358 · Cited by 10
Cox, L. A. (2009) · Risk Analysis · doi:10.1111/j.1539-6924.2009.01303.x · Cited by 8
“Omissions of some specific explanatory variables (such as Black and Poverty, which, as previously noted, is not redundant with Income) in the original analysis might have unpredictably affected the regression coefficients for the remaining variables.(12) As illustrated in our simple thought experiment, different selec…”
Striving for Excellence with Evidence-Based Dentistry
Gillette, J. (2009) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2009.06.008 · Cited by 8
Cynical hostility as a determinant of poor oral health status in an adult population
Suominen‐Taipale, A. L., Mettovaara, H., Uutela, A. K., Härkänen, T., Vehkalahti, M. M., & Knuuttila, M. L. E. (2009) · European Journal Of Oral Sciences · doi:10.1111/j.1600-0722.2009.00611.x · Cited by 6
“Statistical adjustment is useful, but it cannot be used to make observational studies comparable to natural experiments, as it involves far more subjective judgment than many users realize (38).”
BackgroundTyra, A. T., Garner, S.-B., & Ginty, A. T. (2024) · Biological Psychology · doi:10.1016/j.biopsycho.2024.108966 · Cited by 9
Spencer, N., Ludvigsson, J., You, Y.-Y., Francis, K., Awad, Y. A., Markham, W., Faresjö, T., Goldhaber-Fiebert, J., White, P. A., Raat, H., et al. (2022) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2022-219228 · Cited by 7
Ahmad, M., Tyra, A. T., Ginty, A. T., & Brindle, R. C. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.04.007 · Cited by 9
Kulkarni, H., Thangam, M., Liu, S. D., DeVries, J. T., Rothstein, E. S., Young, M. N., & Amin, A. P. (2020) · medRxiv · doi:10.1101/2020.08.18.20177063 · Cited by 7
“Whereas these observational studies have provided key insights into the econometrics of PCI, measured or unmeasured confounding can remain even if all the studies have rigorously adjusted for as many confounders as possible.(82,83) In the future, large-scale multicenter randomized studies evaluating the costs of vario…”
BackgroundFemale sex and stroke in atrial fibrillation: an intriguing relationship
Boriani, G., Colella, J., Imberti, J., Fantecchi, E., & Vitolo, M. (2019) · Internal and Emergency Medicine · doi:10.1007/s11739-019-02169-2 · Cited by 7
Veras, M. A. D. S. M., Pinheiro, T. F., Galan, L., Magno, L., Leal, A. F., Knauth, D., Motta-Castro, A. R. C., de Queiroz, R. S. B., Mayaud, P., McCartney, D. J., et al. (2024) · Revista Brasileira de Epidemiologia · doi:10.1590/1980-549720240002.supl.1.2 · Cited by 7
Williams, S. E., & Ginty, A. (2023) · Anxiety, Stress, & Coping · doi:10.1080/10615806.2023.2282092 · Cited by 6
“The results may have been influenced by other unmeasured outcomes that were not adjusted for in the models or by an unintended general response bias (Christenfeld et al., 2004).”
BackgroundGinty, A., Phillips, A. C., Der, G., Deary, I., & Carroll, D. (2011) · Psychophysiology · doi:10.1111/psyp.2011.48.issue-7 · Cited by 6
Self-citationStamenkovic, S., Solesse, A., Zanetti, L. C. D. S., Zagury, P., Vray, M., Auquier, P., Baumelou, E., BELS, F. D., Béné, M. C., Bernard, A., et al. (2012) · Therapies · doi:10.2515/therapie/2012065 · Cited by 13
Ansah, E. O., Kyei, F., Opoku, C. F., Danquah, A., Fosu, K., Agyenim, E. B., & Agyirifo, D. (2025) · Cancer Medicine · doi:10.1002/cam4.70928 · Cited by 5
“LDL, a major component of TC, has been shown to promote cancer cell proliferation and migration by influencing the tumor microenvironment and hormone signaling [17].”
Yao, Q., Chang, C.-F., Joshi, P., & McDonald, C. (2022) · Environment, Development and Sustainability · doi:10.1007/s10668-022-02735-3 · Cited by 5
“Second, statistical control cannot rule out all the confounding effects due to errors in statistical measures (particularly for latent constructs), modeling (Christenfeld et al., 2004), and some other challenges to confound controlling (Brookhart et al., 2010).”
Inferring Causal Relationships between Risk Factors and Outcomes Using Genetic Variation
Burgess, S., Foley, C. N., & Zuber, V. (2019) · Wiley eBooks · doi:10.1002/9781119487845.ch23 · Cited by 40
MCEE 2.0: more options and enhanced performance
Li, Y., Zheng, X., Liang, D., Zhao, A., Jia, W. P., & Chen, T. (2019) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-019-01874-3 · Cited by 5
Zoccali, C., & Mallamaci, F. (2016) · Nephrology, Dialysis and Transplantation · doi:10.1093/ndt/gfw277 · Cited by 5
Controlling for "confounders" in psychosocial pain research.
Sullivan, M. (2016) · Pain · doi:10.1097/j.pain.0000000000000493 · Cited by 5
“Controlling for confounders permits the researcher to explore alternate explanations of an observed relation between an exposure variable and an outcome.(1) For example, a researcher might be interested in examining the effects of occupational chemical exposure on the risk of developing lung cancer.”
BackgroundChaput, K. H., & Vinturache, A. (2015) · Anesthesia and Analgesia · doi:10.1213/ane.0000000000000878 · Cited by 5
Moran, J. L., & Solomon, P. J. (2007) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)01125-0 · Cited by 6
Carroll, D., Macleod, J., & Phillips, A. C. (2006) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2006.02.013 · Cited by 5
“Applying general arguments that are by now very well rehearsed [7,8], we suggested that considerations such as confounding by common antecedents of both VE and CHD and reverse causation could not be readily dismissed and resolution was likely only following experimental studies.”
BackgroundSelf-citationEnfoques modernos del sesgo y la causalidad en la investigación epidemiológica
Gallestey, J. B. (2012) · Revista Cubana de Salud Pública · doi:10.1590/s0864-34662012000500003 · Cited by 5
Tobacco smoking and depression: time to move on to a new research paradigm in medicine?
de Jonge, P., & Bos, E. H. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-138 · Cited by 4
“Suboptimal confounding control also takes place when not all potential confounders, or the wrong confounders, are entered into the multivariate prediction model [7,8].”
BackgroundLow coenzyme Q₁₀ levels and the outcome of statin treatment in heart failure.
Mortensen, S. A. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2010.10.051 · Cited by 4
Retrospective analysis: looking backward to point the way forward.
Ochroch, E., & Fleisher, L. A. (2006) · Anesthesiology · doi:10.1097/00000542-200610000-00003 · Cited by 4
The longitudinal role of sleep on self‐harm during adolescence: A birth cohort study
Pawley, M., Morales‐Muñoz, I., Bagshaw, A. P., & Tang, N. K. Y. (2025) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.70018 · Cited by 4
Sonier, R.-P., Guitard, D., Melanson, E., Jamieson, R. K., & Saint‐Aubin, J. (2025) · Memory & Cognition · doi:10.3758/s13421-024-01678-6 · Cited by 2
“However, despite its widespread popularity, the generalizability of results obtained through this method has long been disputed (see Becker, 2005; Breaugh, 2008; Carlson & Wu, 2011; Christenfeld et al., 2004; Meehl, 1971; Newcombe, 2003; Pedhazur, 1997; Spector & Brannick, 2011).”
Sorjonen, K., Nilsonne, G., Ingre, M., & Melin, B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0297216 · Cited by 3
Tyra, A. T., Ginty, A. T., Johnson, L. R., Lafromboise, M. E., Malatare, M., Salois, E. M., & John‐Henderson, N. A. (2022) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001140 · Cited by 4
“First, the analyses were correlational, and the results could have been impacted by a third variable (41).”
BackgroundJohn‐Henderson, N. A., Counts, C. J., & Ginty, A. T. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.565610 · Cited by 3
Scheier, L. (2019) · Journal of Neurotrauma · doi:10.1089/neu.2017.5465 · Cited by 3
Philopoulos, D. (2015) · Journal de gynecologie, obstetrique et biologie de la reproduction · doi:10.1016/j.jgyn.2014.07.003 · Cited by 3
Lane, D., & Carroll, D. (2007) · Springer eBooks · doi:10.1007/978-1-84628-502-8_32 · Cited by 3
Self-citationZhu, G., Tay, L. Q., & Zhang, M. (2026) · Behavior Research Methods · doi:10.3758/s13428-025-02841-w · Cited by 2
“This makes the FCI algorithm more applicable to psychology research, where it is often challenging to control for all potential confounders (Christenfeld et al., 2004; Rohrer, 2018; Park et al., 2024).”
Gallagher, S. M., Creaven, A., Hackett, R. A., O'Connor, D. B., & Howard, S. (2023) · Physiology & Behavior · doi:10.1016/j.physbeh.2023.114452 · Cited by 3
Why Science Succeeds, and Sometimes Doesn’t
Baron, J. A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108684354.004 · Cited by 3
On Differentiating Adaptation From Disposition Concepts
Lang, F., Gerstorf, D., Weiss, D. J., & Wagner, G. (2016) · doi:10.1027/1614-0001/a000205 · Cited by 2
Nonyane, B. A. S., & Foulkes, A. S. (2008) · BMC Genetics · doi:10.1186/1471-2156-9-71 · Cited by 2
“Several recent manuscripts describe, for the general regression setting, the potential error associated with treating covariates as confounders when in fact they are effect mediators [19-22].”
From ‘What-is’ to ‘What-if’ in human-factor analysis: A post-occupancy evaluation case
Chen, X., Sun, R., Geyer, P., Borrmann, A., & Schiavon, S. (2026) · Building and Environment · doi:10.1016/j.buildenv.2026.114285 · Cited by 1
Hildt, C., Tzivian, L., Ogurtsova, K., & Hoffmann, B. H. (2025) · Environmental Research · doi:10.1016/j.envres.2025.123589 · Cited by 2
Metadata
- Authors
- Christenfeld, N. J. S., Sloan, R. P., Carroll, D., & Greenland, S.
- Affiliations
- University of California San Diego (US)
- University of California, Los Angeles (US)
- Corresponding author
- Christenfeld, Nicholas J. S.
- Venue
- Psychosomatic Medicine
- Published
- 2004-11
- Volume
- 66
- Issue
- 6
- Pages
- 868-875
- ISSN
- 0033-3174 (ISSN-L)
- OpenAlex
- W2065056866
- Cited by
- 260
- References
- 0
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 8 · 2023: 5 · 2022: 11 · 2021: 21 · 2020: 15 · 2019: 17 · 2018: 7 · 2017: 4 · 2016: 13 · 2015: 8 · 2014: 14 · 2013: 14 · 2012: 28
- FWCI
- 1.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychosomatic Medicine (publishedVersion)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- confounding, statistical adjustment, causal inference, risk factors, measurement error, mediators, covariate adjustment, observational studies, natural experiment
- MeSH terms
- Data Interpretation, Statistical, False Positive Reactions, Humans, Research Design, Risk Factors, Reproducibility of Results, Health Behavior, Bias, Confounding Factors, Epidemiologic, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Observation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review