The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools
Open accessAbstract
Many programs reward or penalize schools based on students' average performance. Mean reversion is a potentially serious hindrance to the evaluation of such interventions. Chile's 900 Schools Program (P-900) allocated resources based on cutoffs in schools' mean test scores. This paper shows that transitory noise in average scores and mean reversion lead conventional estimation approaches to overstate the impacts of such programs. It further shows how a regressiondiscontinuity design can be used to control for reversion biases. It concludes that P-900 had significant effects on test score gains, albeit much smaller than is widely believed
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement
Angrist, J. D., & Lavy, V. (1999) · The Quarterly Journal of Economics · doi:10.1162/003355399556061 · Cited by 1,482
Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs
Ashenfelter, O., & Card, D. (1985) · The Review of Economics and Statistics · doi:10.2307/1924810 · Cited by 1,023
Van Der Klaauw, W. (2002) · International Economic Review · doi:10.1111/1468-2354.t01-1-00055 · Cited by 722
Remedial Education and Student Achievement: A Regression-Discontinuity Analysis
Jacob, B. A., & Lefgren, L. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023778 · Cited by 590
The Promise and Pitfalls of Using Imprecise School Accountability Measures
Kane, T. J., & Staiger, D. O. (2002) · Journal of Economic Perspectives · doi:10.1257/089533002320950993 · Cited by 503
Evaluating the Effect of Teachers’ Group Performance Incentives on Pupil Achievement
Lavy, V. (2002) · Journal of Political Economy · doi:10.1086/342810 · Cited by 448
The Effectiveness and Efficiency of Private Schools in Chile's Voucher System
McEwan, P. J., & Carnoy, M. (2000) · Educational Evaluation and Policy Analysis · doi:10.2307/1164241 · Cited by 334
Self-citationEstimating the Labor Market Signaling Value of the GED
Tyler, J. H., Murnane, R. J., & Willett, J. B. (2000) · The Quarterly Journal of Economics · doi:10.1162/003355300554818 · Cited by 221
Jacob, B. A., & Lefgren, L. (2004) · The Journal of Human Resources · doi:10.2307/3559005 · Cited by 188
Cited by
Regression discontinuity designs in economics
Lee, D. S., & Lemieux, T. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.281 · Cited by 4,534
Regression discontinuity designs: A guide to practice
Imbens, G. W., & Lemieux, T. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.05.001 · Cited by 3,694
Regression Discontinuity Designs: A Guide to Practice
Imbens, G., & Lemieux, T. (2007) · National Bureau of Economic Research · doi:10.3386/w13039 · Cited by 853
Do Consumers Respond to Marginal or Average Price? Evidence from Nonlinear Electricity Pricing
Ito, K. (2014) · American Economic Review · doi:10.1257/aer.104.2.537 · Cited by 820
Regression Discontinuity Designs in Economics
Lee, D., & Lemieux, T. (2009) · National Bureau of Economic Research · doi:10.3386/w14723 · Cited by 566
Metadata
- Authors
- Chay, K. Y., Mcewan, P. J., & Urquiola, M.
- Venue
- American Economic Review
- Publisher
- American Economic Association
- Published
- 2005-08-01
- Volume
- 95
- Issue
- 4
- Pages
- 1237-1258
- ISSN
- 0002-8282 (ISSN-L)
- OpenAlex
- W3123799203
- Cited by
- 277
- References
- 10
- FWCI
- 73.14
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools. https://app.cochat.ai/papers/10.1257/0002828054825529
- The paper
- Chay, K. Y., Mcewan, P. J., & Urquiola, M. (2005). The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools. American Economic Review. https://doi.org/10.1257/0002828054825529
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.