The DOI matches its Crossref record.
Limitations in the Use of Achievement Tests as Measures of Educators' Productivity
Abstract
Test-based accountability rests on the assumption that accountability for scores on tests will provide needed incentives for teachers to improve student performance. Evidence shows, however, that simple test-based accountability can generate perverse incentives and seriously inflated scores. This paper discusses the logic of achievement tests, issues that arise in using them as proxy indicators of educational quality, and the mechanism underlying the inflation of scores. It ends with suggestions, some speculative, for improving the incentives faced by teachers by modifying systems of student assessment and combining them with numerous other measures, many of which are more subjective than are test scores.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
What does certification tell us about teacher effectiveness? Evidence from New York City
Kane, T. J., Rockoff, J. E., & Staiger, D. O. (2008) · Economics of Education Review · doi:10.1016/j.econedurev.2007.05.005 · Cited by 946
Teacher Performance Pay: Experimental Evidence from India
Muralidharan, K., & Sundararaman, V. (2011) · Journal of Political Economy · doi:10.1086/659655 · Cited by 823
Roth, G., Assor, A., Kanat-Maymon, Y., & Kaplan, H. (2007) · Journal of Educational Psychology · doi:10.1037/0022-0663.99.4.761 · Cited by 723
The Promise and Pitfalls of Using Imprecise School Accountability Measures
Kane, T. J., & Staiger, D. O. (2002) · Journal of Economic Perspectives · doi:10.1257/089533002320950993 · Cited by 503
Left Behind by Design: Proficiency Counts and Test-Based Accountability
Neal, D., & Schanzenbach, D. W. (2010) · Review of Economics and Statistics · doi:10.1162/rest.2010.12318 · Cited by 460
Restrained Teaching: The Common Core of Didaktik
Hopmann, S. (2007) · European Educational Research Journal · doi:10.2304/eerj.2007.6.2.109 · Cited by 408
The Use and Usefulness of Performance Measures in the Public Sector
Propper, C. (2003) · Oxford Review of Economic Policy · doi:10.1093/oxrep/19.2.250 · Cited by 340
Teacher performance pay: A review
Podgursky, M. J., & Springer, M. G. (2007) · Journal of Policy Analysis and Management · doi:10.1002/pam.20292 · Cited by 316
A Validity Argument Approach to Evaluating Teacher Value-Added Scores
Hill, H. C., Kapitula, L., & Umland, K. (2011) · American Educational Research Journal · doi:10.3102/0002831210387916 · Cited by 269
No child, no school, no state left behind: schooling in the age of accountability1
Hopmann, S. T. (2008) · Journal of Curriculum Studies · doi:10.1080/00220270801989818 · Cited by 265
Methodological Concerns About the Education Value-Added Assessment System
Amrein-Beardsley, A. (2008) · Educational Researcher · doi:10.3102/0013189x08316420 · Cited by 199
Improving the education of children living in poverty.
Murnane, R. J. (2007) · The Future of Children · doi:10.1353/foc.2007.0019 · Cited by 139
Using Multiple Measures to Address Perverse Incentives and Score Inflation
Koretz, D. (2003) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2003.tb00124.x · Cited by 56
Self-citationSaeki, E., Pendergast, L., Segool, N. K., & von der Embse, N. P. (2015) · Contemporary School Psychology · doi:10.1007/s40688-014-0043-5 · Cited by 29
Metadata
- Authors
- Koretz, D. M.
- Venue
- The Journal of Human Resources
- Publisher
- JSTOR
- Published
- 2002
- Volume
- 37
- Issue
- 4
- Pages
- 752
- ISSN
- 0022-166X (ISSN-L)
- OpenAlex
- W1550141888
- Cited by
- 235
- References
- 0
- FWCI
- 36.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.