Drawing Causal Inferences Using Propensity Scores: A Practical Guide for Community Psychologists
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Confounding present in observational data impede community psychologists’ ability to draw causal inferences. This paper describes propensity score methods as a conceptually straightforward approach to drawing causal inferences from observational data. A step‐by‐step demonstration of three propensity score methods—weighting, matching, and subclassification—is presented in the context of an empirical examination of the causal effect of preschool experiences (Head Start vs. parental care) on reading development in kindergarten. Although the unadjusted population estimate indicated that children with parental care had substantially higher reading scores than children who attended Head Start, all propensity score adjustments reduce the size of this overall causal effect by more than half. The causal effect was also defined and estimated among children who attended Head Start. Results provide no evidence for improved reading if those children had instead received parental care. We carefully define different causal effects and discuss their respective policy implications, summarize advantages and limitations of each propensity score method, and provide SAS and R syntax so that community psychologists may conduct causal inference in their own research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242 · cited 2×
“In addition, a related paper (Austin 2011b) illustrates the use of these methods in the context of an empirical example investigating the effect of smoking cessation counseling on later mortality among current smokers hospitalized for a heart attack.”
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478 · cited 6×
“For example, Stuart (2010) provides a comprehensive review of different propensity score matching strategies, as well as a thorough review of available functionality in R, SAS, and Stata for conducting matching.”
InfluentialReducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Variable Selection for Propensity Score Models
Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Stürmer, T. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj149 · Cited by 2,336
Allison, P. (2002) · doi:10.4135/9781412985079 · Cited by 2,050
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317 · cited 2×
“…are typically obtained by logistic or probit regression of the treatment on the potential confounders, although more flexible alternatives such as generalized boosted modeling (GBM; McCaffrey et al. 2004) and classification and regression trees (CART; Luellen et al. 2005) have also been applied.”
Hirano, K., & Imbens, G. W. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020371312283 · Cited by 1,039 · cited 2×
“More technical details of weighting may be found in Hirano and Imbens (2001).”
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2010) · Psychological Methods · doi:10.1037/a0019623 · Cited by 802 · cited 4×
“Harder et al. (2010) presents a thorough comparison of the performance of different propensity score techniques (e.g., one-to-one matching, full matching, inverse propensity weighting).”
InfluentialLimitations of the Randomized Controlled Trial in Evaluating Population-Based Health Interventions
Sanson-Fisher, R. W., Bonevski, B., Green, L. W., & D’Este, C. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.007 · Cited by 514 · cited 1×
“Even when an RCT is feasible and carried out, issues such as treatment noncompliance can interfere with our ability to draw causal inferences about the treatment (Mercer et al. 2007; Sanson-Fisher et al. 2007; Stuart et al. 2008).”
The importance of covariate selection in controlling for selection bias in observational studies.
Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010) · Psychological Methods · doi:10.1037/a0018719 · Cited by 490 · cited 2×
“For example, including a few demographic variables in an ANCOVA model is most often not sufficient (Steiner et al. 2010).”
Study Designs for Effectiveness and Translation Research
Mercer, S. L., DeVinney, B. J., Fine, L. J., Green, L. W., & Dougherty, D. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.005 · Cited by 222
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn184 · Cited by 76
Cited by
Latent Class Analysis for Developmental Research
Lanza, S. T., & Cooper, B. R. (2016) · Child Development Perspectives · doi:10.1111/cdep.12163 · Cited by 537
Self-citationHIV and substance use stigma, intersectional stigma and healthcare among HIV-positive PWID in Russia
Vetrova, M. V., Cheng, D. M., Bendiks, S., Gnatienko, N., Lloyd-Travaglini, C., Jiang, W., Luoma, J., Blokhina, E., Krupitsky, E., Lioznov, D., et al. (2021) · AIDS and Behavior · doi:10.1007/s10461-021-03172-5 · Cited by 52
Childhood sexual trauma and subsequent parenting beliefs and behaviors
Zvara, B. J., Mills-Koonce, W. R., Appleyard Carmody, K., & Cox, M. (2015) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.01.012 · Cited by 50
Propensity score weighting: an application to anEarlyHeadStart dental study
Burgette, J. M., Preisser, J. S., & Rozier, R. G. (2016) · Journal of Public Health Dentistry · doi:10.1111/jphd.12106 · Cited by 25
“Estimating propensity scores using GBMs has been well developed in the statistical literature (7-9,11-16) and has become popular in many fields including education, health services, psychology, and drug addiction (4-6,10,17-24).”
Method
Metadata
- Authors
- Lanza, S. T., Moore, J. E., & Butera, N. M.
- Venue
- American Journal of Community Psychology
- Publisher
- Wiley
- Published
- 2013-10-02
- Volume
- 52
- Issue
- 3-4
- Pages
- 380-392
- ISSN
- 0091-0562 (ISSN-L)
- 1573-2770
- OpenAlex
- W2053148876
- Cited by
- 115
- References
- 14
- FWCI
- 6.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.