Performance of disease risk scores, propensity scores, and traditional multivariable outcome regression in the presence of multiple confounders
Abstract
Propensity scores are widely used in cohort studies to improve performance of regression models when considering large numbers of covariates. Another type of summary score, the disease risk score (DRS), which estimates disease probability conditional on nonexposure, has also been suggested. However, little is known about how it compares with propensity scores. Monte Carlo simulations were conducted comparing regression models using the DRS and the propensity score with models that directly adjust for all of the individual covariates. The DRS was calculated in 2 ways: from the unexposed population and from the full cohort. Compared with traditional multivariable outcome regression models, all 3 summary scores had comparable performance for moderate correlation between exposure and covariates and, for strong correlation, the full-cohort DRS and propensity score had comparable performance. When traditional methods had model misspecification, propensity scores and the full-cohort DRS had superior performance. All 4 models were affected by the number of events per covariate, with propensity scores and traditional multivariable outcome regression least affected. These data suggest that, for cohort studies for which covariates are not highly correlated with exposure, the DRS, particularly that calculated from the full cohort, is a useful tool.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Risk stratification can control observed confounders more efficiently than regression and may outperform propensity scores when covariates are weakly correlated with exposure.
“These methods constitute a broader strategy of risk stratification, allowing for more efficient control of observed confounders than regression-based approaches [31,32], and are a better alternative to propensity score estimation when covariates are not highly correlated with the exposure [33].”
From Social Media Use and Depressive Symptoms Among United States Adolescents (2021) · cites this paper as [33]
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241 · see citing works
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655 · see citing works
Variable Selection for Propensity Score Models
Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Stürmer, T. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj149 · Cited by 2,336 · see citing works
Schneeweiss, S., Rassen, J. A., Glynn, R. J., Avorn, J., Mogun, H., & Brookhart, M. A. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181a663cc · Cited by 1,128 · see citing works
Graham, D. J., Campen, D. H., Hui, R. L., Spence, M. M., Cheetham, C., Levy, G. D., Shoor, S., & Ray, W. A. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17864-7 · Cited by 913 · see citing works
Self-citationCepeda, M. S. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg115 · Cited by 859 · see citing works
Identifiability, Exchangeability, and Epidemiological Confounding
GREENLAND, S., & ROBINS, J. M. (1986) · International Journal of Epidemiology · doi:10.1093/ije/15.3.413 · Cited by 686 · see citing works
Gail, M. H., Wieand, S., & Piantadosi, S. (1984) · Biometrika · doi:10.1093/biomet/71.3.431 · Cited by 683 · see citing works
Regression models for prognostic prediction: advantages, problems, and suggested solutions.
Fe, H., Kl, L., Matchar, D. B., & Ta, R. (1985) · PubMed · Cited by 559 · see citing works
COX-2 selective non-steroidal anti-inflammatory drugs and risk of serious coronary heart disease
Ray, W. A., Stein, C., Daugherty, J. R., Hall, K., Arbogast, P. G., & Griffin, M. R. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11131-7 · Cited by 503 · see citing works
Self-citationOral Erythromycin and the Risk of Sudden Death from Cardiac Causes
Ray, W. A., Murray, K. T., Meredith, S., Narasimhulu, S. S., Hall, K., & Stein, C. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa040582 · Cited by 493 · see citing works
Self-citationAntipsychotics and the Risk of Sudden Cardiac Death
Ray, W. A., Meredith, S. K., Thapa, P. B., Meador, K. G., Hall, K., & Murray, K. T. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.12.1161 · Cited by 430 · see citing works
Self-citationThe prognostic analogue of the propensity score
Hansen, B. B. (2008) · Biometrika · doi:10.1093/biomet/asn004 · Cited by 379 · see citing works
STRATIFICATION BY A MULTIVARIATE CONFOUNDER SCORE
Miettinen, O. S. (1976) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112339 · Cited by 351 · see citing works
Ray, W. A., Stein, C., Hall, K., Daugherty, J. R., & Griffin, M. R. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07370-1 · Cited by 326 · see citing works
Self-citationBootstrap investigation of the stability of a cox regression model
Altman, D. G., & Andersen, P. K. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080702 · Cited by 311 · see citing works
Invited Commentary: Variable Selection versus Shrinkage in the Control of Multiple Confounders
Greenland, S. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm355 · Cited by 281 · see citing works
Cyclic antidepressants and the risk of sudden cardiac death
Ray, W. A., Meredith, S. K., Thapa, P. B., Hall, K., & Murray, K. T. (2004) · Clinical Pharmacology & Therapeutics · doi:10.1016/j.clpt.2003.09.019 · Cited by 275 · see citing works
Self-citationAustin, P. C., Grootendorst, P. V., Normand, S. T., & Anderson, G. M. (2006) · Statistics in Medicine · doi:10.1002/sim.2618 · Cited by 230 · see citing works
Stürmer, T., Schneeweiß, S., Brookhart, M. A., Rothman, K. J., Avorn, J., & Glynn, R. J. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi106 · Cited by 171 · see citing works
Use of disease risk scores in pharmacoepidemiologic studies
Arbogast, P. G., & Ray, W. A. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280208092347 · Cited by 135 · see citing works
Self-citationCook, E. F., & Goldman, L. (1989) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(89)90036-x · Cited by 110 · see citing works
Ray, W. A., Chung, C. P., Stein, C., et al. (2007) · Gastroenterology · doi:10.1053/j.gastro.2007.06.058 · Cited by 84 · see citing works
Self-citationAdjustment for Multiple Cardiovascular Risk Factors Using a Summary Risk Score
Arbogast, P. G., Kaltenbach, L. A., Ding, H., & Ray, W. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31815be000 · Cited by 58 · see citing works
Self-citationConfounder summary scores when comparing the effects of multiple drug exposures
Cadarette, S. M., Gagne, J. J., Solomon, D. H., Katz, J. N., & Stürmer, T. (2009) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1845 · Cited by 55 · see citing works
Non-steroidal antiinflammatory drugs and risk of serious coronary heart disease
Ray, W. A., Stein, C., & Griffin, M. R. (2002) · The Lancet · doi:10.1016/s0140-6736(02)09349-2 · Cited by 49 · see citing works
Self-citationPike, M. C., Anderson, J. A., & Day, N. (1979) · Journal of Epidemiology & Community Health · doi:10.1136/jech.33.1.104 · Cited by 42 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Prescription of long-acting opioids and mortality in patients with chronic noncancer pain
Ray, W. A., Chung, C. P., Murray, K. T., Hall, K., & Stein, C. M. (2016) · JAMA · doi:10.1001/jama.2016.7789 · Cited by 369 · see citing works
Effectiveness of Cognitive Tutor Algebra I at Scale
Pane, J. F., Griffin, B. A., McCaffrey, D. F., & Karam, R. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713507480 · Cited by 317 · see citing works
Ray, W. A., Chung, C. P., Murray, K. T., Smalley, W. E., Daugherty, J. R., Dupont, W. D., & Stein, C. M. (2018) · JAMA · doi:10.1001/jama.2018.17242 · Cited by 222 · see citing works
Self-citationFaillie, J.-L., Yu, O. H., Yin, H., Hillaire-Buys, D., Barkun, A., & Azoulay, L. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.1531 · Cited by 134 · see citing works
Social Media Use and Depressive Symptoms Among United States Adolescents
Kreski, N., Platt, J., Rutherford, C., Olfson, M., Odgers, C., Schulenberg, J., & Keyes, K. M. (2021) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2020.07.006 · Cited by 97 · see citing works
- Authors
- Arbogast, P. G., & Ray, W. A.
- Affiliations
- Vanderbilt University (US)
- ORCID
- Ray, W. A.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-07-12
- Volume
- 174
- Issue
- 5
- Pages
- 613-620
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2142541082
- Cited by
- 138
- References
- 27
- Citations by year
- 2026: 2 · 2025: 12 · 2024: 6 · 2023: 5 · 2022: 12 · 2021: 9 · 2020: 12 · 2019: 11 · 2018: 16 · 2017: 7 · 2016: 14 · 2015: 11 · 2014: 7 · 2013: 7 · 2012: 7
- FWCI
- 5.87
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- disease risk score, propensity score, model misspecification, summary scores, cohort studies
- MeSH terms
- Epidemiologic Methods, Humans, Probability, Prognosis, Cohort Studies, Bias, Confounding Factors, Epidemiologic, Multivariate Analysis, Logistic Models, Propensity Score
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review