Quasi-Experimental Designs for Causal Inference
Open accessThe DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.
Abstract
When randomized experiments are infeasible, quasi-experimental designs can be exploited to evaluate causal treatment effects. The strongest quasi-experimental designs for causal inference are regression discontinuity designs, instrumental variable designs, matching and propensity score designs, and comparative interrupted time series designs. This article introduces for each design the basic rationale, discusses the assumptions required for identifying a causal effect, outlines methods for estimating the effect, and highlights potential validity threats and strategies for dealing with them. Causal estimands and identification results are formalized with the potential outcomes notations of the Rubin causal model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The quasi-experimental design of our study limited our ability to draw causal inferences regarding the effectiveness of Restorative Practices (e.g., Kim & Steiner, 2016;Shadish et al., 2002).”
From Restorative Practices: Using local evidence on costs and student outcomes to inform school district decisions about behavioral interventions (2022) · cites this paper as Kim & Steiner, 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241 · cited 2×
“Rosenbaum and Rubin (1983) proved that if the assignment is strongly ignorable given X, then it is also strongly ignorable given the PS alone.”
BackgroundMethodIntroductory Econometrics: A Modern Approach
Wooldridge, J. M. (1999) · Cited by 14,458
(2002) · Cited by 13,211
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467 · cited 1×
“Excellent introductions to IV designs can be found in Angrist and Pischke (2009, 2015).”
BackgroundStatistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 3×
“The RCM (Holland, 1986) formalizes causal inference in terms of potential outcomes, which allow us to precisely define causal quantities of interest and to explicate the assumptions required for identifying them.”
BackgroundInfluentialMostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
Regression discontinuity designs in economics
Lee, D. S., & Lemieux, T. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.281 · Cited by 4,534 · cited 1×
“Imbens and Lemieux (2008) and Lee and Lemieux (2010) provided comprehensive introductions to RD designs.”
MatchIt : Nonparametric Preprocessing for Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2011) · Journal of Statistical Software · doi:10.18637/jss.v042.i08 · Cited by 4,385 · cited 1×
“The R packages optmatch (Hansen & Klopfer, 2006) and MatchIt (Ho et al., 2011) and the STATA command teffects, in particular teffects psmatch (StataCorp, 2015), can be useful for matching or PS analyses.”
MethodA generalization of sampling without replacement from a finite universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483446 · Cited by 4,293 · cited 1×
“Inverse-propensity weighting follows the same logic as inverse-probability weighting in survey research (Horvitz & Thompson, 1952) and requires the computation of weights that refer to either the overall population (ATE) or the population of treated subjects only (ATT).”
Method
Research works printed but not linked: 3
- Black D, Galdo J, & Smith JA (2007). Evaluating the bias of the regression discontinuity design using experimental data (Working paper). Chicago, IL: University of Chicago.
- Somers M, Zhu P, Jacob R, & Bloom H (2013). The validity and precision of the comparative interrupted time series design and the difference-in-difference design in educational evaluation (MDRC working paper in research methodology). New York, NY: MDRC.
- StataCorp. (2015). Stata treatment-effects reference manual: Potential outcomes/counterfactual outcomes. College Station, TX: Stata Press Retrieved from http://www.stata.com/manuals14/te.pdf
Cited by
Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets
Weston, S. J., Ritchie, S. J., Rohrer, J. M., & Przybylski, A. K. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919848684 · Cited by 203
McMenamin, A., Turi, E., Schlak, A., & Poghosyan, L. (2023) · Medical Care Research and Review · doi:10.1177/10775587231186720 · Cited by 88
“…we observed that these studies did not use causal inference statistical methods, which represents a missed opportunity to move beyond associative statistics and establish causality, especially in low-resource settings where RCTs may be infeasible (Hammerton & Munafò, 2021; Kim & Steiner, 2016).”
BackgroundSpatial Causality: A Systematic Review on Spatial Causal Inference
Akbari, K., Winter, S., & Tomko, M. (2021) · Geographical Analysis · doi:10.1111/gean.12312 · Cited by 111
The role of environmental attitude in the efficacy of smart-meter-based feedback interventions
Henn, L., Taube, O., & Kaiser, F. G. (2019) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.04.007 · Cited by 62
Young, J. D., Evans, A. M., Iniguez, J. M., Thode, A. E., Meyer, M. D., Hedwall, S. J., McCaffrey, S., Shin, P., & Huang, C.-H. (2020) · International Journal of Wildland Fire · doi:10.1071/wf19189 · Cited by 52
Metadata
- Authors
- Kim, Y., & Steiner, P.
- Affiliations
- University of Wisconsin–Madison (US)
- Corresponding author
- Kim, Yongnam
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2016-09-02
- Volume
- 51
- Issue
- 3-4
- Pages
- 395-405
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- PMC
- PMC6086368
- OpenAlex
- W2510789027
- Semantic Scholar
- 1f56c9a168c21e2d8c928a2684c55c0a4b58078d
- Cited by
- 135
- References
- 59
- Citations by year
- 2026: 33 · 2025: 26 · 2024: 19 · 2023: 17 · 2022: 15 · 2021: 4 · 2020: 11 · 2019: 4 · 2018: 3 · 2017: 2 · 2016: 1
- FWCI
- 3.37
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Educational Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD047873)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- quasi-experimental design, causal inference, causal treatment effects, regression discontinuity design, instrumental variables, matching, propensity score matching, interrupted time series, causal estimands, potential outcomes, threats to validity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quasi-Experimental Designs for Causal Inference. https://app.cochat.ai/papers/10.1080/00461520.2016.1207177
- The paper
- Kim, Y., & Steiner, P. (2016). Quasi-Experimental Designs for Causal Inference. Educational Psychologist. https://doi.org/10.1080/00461520.2016.1207177
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.