The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Propensity scores: From naïve enthusiasm to intuitive understanding
Abstract
Estimation of the effect of a binary exposure on an outcome in the presence of confounding is often carried out via outcome regression modelling. An alternative approach is to use propensity score methodology. The propensity score is the conditional probability of receiving the exposure given the observed covariates and can be used, under the assumption of no unmeasured confounders, to estimate the causal effect of the exposure. In this article, we provide a non-technical and intuitive discussion of propensity score methodology, motivating the use of the propensity score approach by analogy with randomised studies, and describe the four main ways in which this methodology can be implemented. We carefully describe the population parameters being estimated — an issue that is frequently overlooked in the medical literature. We illustrate these four methods using data from a study investigating the association between maternal choice to provide breast milk and the infant's subsequent neurodevelopment. We outline useful extensions of propensity score methodology and discuss directions for future research. Propensity score methods remain controversial and there is no consensus as to when, if ever, they should be used in place of traditional outcome regression models. We therefore end with a discussion of the relative advantages and disadvantages of each.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 1×
“In order to consider issues of cause and effect, we turn to the potential outcomes (or counterfactual) framework.(11) Each individual has two potential outcomes: the outcome that would occur if that individual was exposed, Y1, and the outcome that would occur if that individual was not exposed, Y0.”
BackgroundReducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Constructing Inverse Probability Weights for Marginal Structural Models
Cole, S. R., & Hernan, M. A. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn164 · Cited by 2,796
Rosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
Variable Selection for Propensity Score Models
Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Stürmer, T. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj149 · Cited by 2,336
Characterizing Selection Bias Using Experimental Data
Heckman, J., Ichimura, H., Smith, J., & Todd, P. (1998) · Econometrica · doi:10.2307/2999630 · Cited by 2,286
The role of the propensity score in estimating dose-response functions
Imbens, G. (2000) · Biometrika · doi:10.1093/biomet/87.3.706 · Cited by 1,776
Lunceford, J. K., & Davidian, M. (2004) · Statistics in Medicine · doi:10.1002/sim.1903 · Cited by 1,674
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317 · cited 2×
“Sensitivity analyses for assessing the potential impact of unmeasured confounders have been proposed for propensity score matching and stratification methods(36) and extended to inverse-weighting.(26)”
BackgroundMethodA critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249
Breast milk and subsequent intelligence quotient in children born preterm
Lucas, A., Morley, R., Cole, T. J., Lister, G., & Leeson-Payne, C. (1992) · The Lancet · doi:10.1016/0140-6736(92)91329-7 · Cited by 1,222
Self-citationInvited Commentary: Propensity Scores
Joffe, M. M., & Rosenbaum, P. R. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010011 · Cited by 1,048
The performance of different propensity score methods for estimating marginal hazard ratios
Austin, P. C. (2013) · Statistics in Medicine · doi:10.1002/sim.5705 · Cited by 1,006
Confounding and Collapsibility in Causal Inference
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Statistical Science · doi:10.1214/ss/1009211805 · Cited by 933 · cited 1×
“In the odds ratio setting, however, the definition of the causal estimand becomes much more complex due to a property called the ‘non-collapsibility’ of the odds ratio.(40) For example, if p1 denotes the proportion of the whole population who would have the outcome of interest if the whole population were exposed and…”
BackgroundKurth, T., Walker, A. M., Glynn, R. J., Chan, K. A., Gaziano, J. M., Berger, K., & Robins, J. M. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj047 · Cited by 730
Little, R. J., & Rubin, D. B. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.121 · Cited by 721
Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms
Gu, X. S., & Rosenbaum, P. R. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474623 · Cited by 702 · cited 1×
“This correction for chance as well as systematic imbalance is the reason why the estimated propensity score has often been found to perform better than the true (population) propensity score.(1,18,29) Conversely, including predictors of exposure but not outcome will generally increase the variance of the estimate of e…”
BackgroundAustin, P. C., & Mamdani, M. M. (2006) · Statistics in Medicine · doi:10.1002/sim.2328 · Cited by 560
INTERPRETATION AND CHOICE OF EFFECT MEASURES IN EPIDEMIOLOGIC ANALYSES1
GREENLAND, S. (1987) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114593 · Cited by 543
Bias Reduction Using Mahalanobis-Metric Matching
Rubin, D. B. (1980) · Biometrics · doi:10.2307/2529981 · Cited by 530
Combining Propensity Score Matching with Additional Adjustments for Prognostic Covariates
Rubin, D. B., & Thomas, N. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474233 · Cited by 513
Combining Propensity Score Matching with Additional Adjustments for Prognostic Covariates
Thomas, N. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.025 · Cited by 508
Shah, B. R., Laupacis, A., Hux, J. E., & Austin, P. C. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.016 · Cited by 493
Early diet in preterm babies and developmental status at 18 months
Lucas, A., Morley, R., Cole, T. J., Lucas, P. J., Gore, S. M., Crowle, P., Pearse, R., Boon, A. J., & Powell, R. (1990) · The Lancet · doi:10.1016/0140-6736(90)93026-l · Cited by 460
Self-citationEstimating Exposure Effects by Modelling the Expectation of Exposure Conditional on Confounders
Robins, J. M., Mark, S. D., & Newey, W. K. (1992) · Biometrics · doi:10.2307/2532304 · Cited by 391
Zhao, Z. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023705 · Cited by 389
Too Much Ado about Propensity Score Models? Comparing Methods of Propensity Score Matching
Baser, O. (2006) · Value in Health · doi:10.1111/j.1524-4733.2006.00130.x · Cited by 372
Effects of Misspecification of the Propensity Score on Estimators of Treatment Effect
Drake, C. (1993) · Biometrics · doi:10.2307/2532266 · Cited by 347
Principles for modeling propensity scores in medical research: a systematic literature review
Weitzen, S., Lapane, K. L., Toledano, A. Y., Hume, A. L., & Mor, V. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.969 · Cited by 344
Multicentre trial on feeding low birthweight infants: effects of diet on early growth.
Lucas, A., Gore, S. M., Cole, T. J., Bamford, M. F., Dossetor, J. F., Barr, I., Dicarlo, L., Cork, S., & Lucas, P. J. (1984) · Archives of Disease in Childhood · doi:10.1136/adc.59.8.722 · Cited by 312
Self-citationOn principles for modeling propensity scores in medical research
Rubin, D. B. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.968 · Cited by 287
Evaluating uses of data mining techniques in propensity score estimation: a simulation study
Setoguchi, S., Schneeweiss, S., Brookhart, M. A., Glynn, R. J., & Cook, E. F. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1555 · Cited by 271
The performance of different propensity score methods for estimating marginal odds ratios
Austin, P. C. (2007) · Statistics in Medicine · doi:10.1002/sim.2781 · Cited by 249
Austin, P. C. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1673 · Cited by 238
Stürmer, T., Schneeweiss, S., Avorn, J., & Glynn, R. J. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi192 · Cited by 232
Austin, P. C., Grootendorst, P., Normand, S. T., & Anderson, G. M. (2007) · Statistics in Medicine · doi:10.1002/sim.2618 · Cited by 230
The performance of different propensity-score methods for estimating relative risks
Austin, P. C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.07.011 · Cited by 213
Feeding in Infancy and Later Ability and Attainment: a Longitudinal Study
Rodgers, B. (1978) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.1978.tb15242.x · Cited by 199
Austin, P. C. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1674 · Cited by 187
Interval estimation for treatment effects using propensity score matching
Hill, J., & Reiter, J. P. (2005) · Statistics in Medicine · doi:10.1002/sim.2277 · Cited by 181
Hill, J. (2008) · Statistics in Medicine · doi:10.1002/sim.3245 · Cited by 157
Sensitivity of propensity score methods to the specifications
Zhao, Z. (2007) · Economics Letters · doi:10.1016/j.econlet.2007.05.010 · Cited by 150
Propensity score modeling strategies for the causal analysis of observational data
Hullsiek, K. H., & Louis, T. A. (2002) · Biostatistics · doi:10.1093/biostatistics/3.2.179 · Cited by 137
Stuart, E. A. (2008) · Statistics in Medicine · doi:10.1002/sim.3207 · Cited by 119
Weitzen, S. H., Lapane, K. L., Toledano, A. Y., Hume, A. L., & Mor, V. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.986 · Cited by 110
Qu, Y., & Lipkovich, I. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3549 · Cited by 108
Senn, S. J., Graf, E., & Caputo, A. (2007) · Statistics in Medicine · doi:10.1002/sim.3133 · Cited by 101
Mattei, A. (2008) · Statistical Methods & Applications · doi:10.1007/s10260-007-0086-0 · Cited by 97
Variable selection and raking in propensity scoring
Judkins, D., Morganstein, D., Zador, P., Piesse, A., Barrett, B., & Mukhopadhyay, P. (2006) · Statistics in Medicine · doi:10.1002/sim.2591 · Cited by 42
Confounding: Propensity score adjustment
Fitzmaurice, G. M. (2006) · Nutrition · doi:10.1016/j.nut.2006.08.015 · Cited by 34
Tu, W., & Zhou, X. (2002) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1024212107921 · Cited by 24
Forbes, A. B., & Shortreed, S. M. (2008) · Statistics in Medicine · doi:10.1002/sim.3362 · Cited by 24
Martens, E. P., Pestman, W. R., & Klungel, O. H. (2007) · Statistics in Medicine · doi:10.1002/sim.2878 · Cited by 19
Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3243 · Cited by 17
Funatogawa, I., & Funatogawa, T. (2006) · Statistics in Medicine · doi:10.1002/sim.2723 · Cited by 11
D’Agostino (1998) · doi:10.1002/(sici)1097-0258(19981015)17:19<2265::aid-sim918>3.0.co;2-b
Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians
Carpenter (2000) · doi:10.1002/(sici)1097-0258(20000515)19:9<1141::aid-sim479>3.0.co;2-f
Cited by
Comparison of Propensity Score Methods and Covariate Adjustment
Elze, M. C., Gregson, J., Baber, U., Williamson, E., Sartori, S., Mehran, R., Nichols, M., Stone, G. W., & Pocock, S. J. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.10.060 · Cited by 713
Self-citationA comparison of two methods of estimating propensity scores after multiple imputation
Mitra, R., & Reiter, J. P. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280212445945 · Cited by 282
Synthetic and External Controls in Clinical Trials – A Primer for Researchers
Thorlund, K., Dron, L., Park, J. J., & Mills, E. J. (2020) · Clinical Epidemiology · doi:10.2147/clep.s242097 · Cited by 257
Freemantle, N., Marston, L., Walters, K., Wood, J., Reynolds, M. R., & Petersen, I. (2013) · BMJ · doi:10.1136/bmj.f6409 · Cited by 211
Raman, G., Adam, G. P., Halladay, C. W., Langberg, V. N., Azodo, I. A., & Balk, E. M. (2016) · Annals of Internal Medicine · doi:10.7326/m16-1053 · Cited by 81
Metadata
- Authors
- Williamson, E., Morley, R., Lucas, A., & Carpenter, J.
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2011-01-24
- Volume
- 21
- Issue
- 3
- Pages
- 273-293
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W1980027106
- Cited by
- 254
- References
- 59
- FWCI
- 12.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.