Statistical Power for Regression Discontinuity Designs in Education Evaluations
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
This article examines theoretical and empirical issues related to the statistical power of impact estimates under clustered regression discontinuity (RD) designs. The theory is grounded in the causal inference and hierarchical linear modeling literature, and the empirical work focuses on common designs used in education research to test intervention effects on student test scores. The main conclusion is that three to four times larger samples are typically required under RD than experimental clustered designs to produce impacts with the same level of statistical precision. Thus, the viability of using RD designs for new impact evaluations of educational interventions may be limited and will depend on the point of treatment assignment, the availability of pretests, and key research questions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While the ESPAD sample is not huge, power calculations ( Schochet, 2009 ) show reasonable minimum detectable effect sizes.”
From Minimum legal drinking age and the social gradient in binge drinking (2022) · cites this paper as Schochet, 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 1×
“In what follows, the RD design is discussed in the context of the causal inference theory underlying RA designs (Holland, 1986; Imbens & Rubin, in press; Neyman, 1923/1990; Rubin, 1974; Schochet, 2007).”
MethodStatistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 1×
“In what follows, the RD design is discussed in the context of the causal inference theory underlying RA designs (Holland, 1986; Imbens & Rubin, in press; Neyman, 1923/1990; Rubin, 1974; Schochet, 2007).”
MethodIdentification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Structural Equations, Treatment Effects, and Econometric Policy Evaluation1
Heckman, J. J., & Vytlacil, E. (2005) · Econometrica · doi:10.1111/j.1468-0262.2005.00594.x · Cited by 1,220
Empirical Benchmarks for Interpreting Effect Sizes in Research
Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00061.x · Cited by 950
Statistical analysis and optimal design for cluster randomized trials.
Raudenbush, S. W. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.2.173 · Cited by 636
On regression adjustments to experimental data
Freedman, D. A. (2008) · Advances in Applied Mathematics · doi:10.1016/j.aam.2006.12.003 · Cited by 417 · cited 2×
“These assumptions are consistent with ordinary least squares (OLS) methods that are typically used to estimate program impacts in education research, and are required to ensure that variances based on OLS methods are justified by the Neyman model of causal inference (Freedman, 2008; Schochet, 2007).”
BackgroundMethodStatistical power for random assignment evaluations of education programs
Schochet, P. Z. (2008) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998607302714 · Cited by 216
Self-citation
Research works printed but not linked: 32
- Bloom H, 2004, Randomizing groups to evaluate place-based programs
- 10.1177/0193841X9902300405 · DOI · Paper page
- Bloom H, 2005, Using covariates to improve precision
- Byrk A, 1992, Hierarchical linear models for social and behavioral research Applications and data analysis Methods
- Campbell D, 1963, Handbook of research on teaching, 171
- 10.1177/0193841X9401800202 · DOI
- 10.1201/b14760-40 · doi:10.1201/b14760-40
- 10.1177/0193841X9101500401 · DOI
- Cochran W, 1963, Sampling techniques
- Cohen J, 1988, Statistical power analysis for behavioral sciences
- 10.1016/j.jeconom.2007.05.002 · DOI · Paper page
- Donner A, 2000, Design and analysis of cluster randomization trials in health research
- Fan J, 1996, Local polynomial modelling and its applications
- Goldberger A, 1972, Selection bias in evaluating treatment effects: Some formal illustrations
- Griliches Z, 1971, Economies of scale and the form of the production function
- 10.1111/1468-0262.00183 · DOI · Paper page
- 10.3102/0162373707299706 · DOI · Paper page
- 10.1016/j.jeconom.2007.05.001 · DOI · Paper page
- Imbens G, Causal inference: Statistical methods for estimating causal effects in biomedical, social, and behavioral sciences
- 10.1162/003465304323023778 · DOI · Paper page
- Kish L, 1965, Survey sampling
- 10.1162/qjec.122.1.159 · DOI · Paper page
- 10.1017/CBO9780511810176 · DOI · Paper page
- Murray D, 1998, Design and analysis of group-randomized trials
- 10.1214/ss/1177012031 · DOI · Paper page
- Porter J, 2003, Estimation in the regression discontinuity model
- 10.1002/9780470316436 · DOI · Paper page
- 10.3102/10769986002001001 · DOI · Paper page
- Schochet P, 2007, Is regression adjustment supported by the Neyman model for causal inference?
- Shadish W, 2002, Experimental and quasi-experimental designs for generalized causal inference
- Trochim W, 1984, Research design for program evaluation: The regression-discontinuity design
- 10.1198/000313001753272466 · DOI · Paper page
Cited by
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Wing, C., & Cook, T. D. (2013) · Journal of Policy Analysis and Management · doi:10.1002/pam.21721 · Cited by 87
Minimum legal drinking age and the social gradient in binge drinking
Ahammer, A., Bauernschuster, S., Halla, M., & Lachenmaier, H. (2022) · Journal of Health Economics · doi:10.1016/j.jhealeco.2021.102571 · Cited by 27
Metadata
- Authors
- Schochet, P. Z.
- Affiliations
- Mathematica Policy Research Inc
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 2009-06
- Volume
- 34
- Issue
- 2
- Pages
- 238-266
- ISSN
- 1076-9986
- 1935-1054
- Cited by
- 90
- References
- 8
- Language
- en
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Statistical Power for Regression Discontinuity Designs in Education Evaluations. https://app.cochat.ai/papers/10.3102/1076998609332748
- The paper
- Schochet, P. Z. (2009). Statistical Power for Regression Discontinuity Designs in Education Evaluations. Journal of Educational and Behavioral Statistics. https://doi.org/10.3102/1076998609332748
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.