The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
The Intertemporal Variability of Teacher Effect Estimates
Abstract
The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher performance. This article studies the year-to-year variability in value-added measures for elementary and middle school mathematics teachers from five large Florida school districts. We find year-to-year correlations in value-added measures in the range of 0.2–0.5 for elementary school and 0.3–0.7 for middle school teachers. Much of the variation in measured teacher performance (roughly 30–60 percent) is due to sampling error from “noise” in student test scores. Persistent teacher effects account for about 50 percent of the variation not due to noise for elementary teachers and about 70 percent for middle school teachers. The remaining variance is due to teacher-level time-varying factors, but little of it is explained by observed teacher characteristics. Averaging estimates from two years greatly improves their ability to predict future performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data
Rockoff, J. E. (2004) · American Economic Review · doi:10.1257/0002828041302244 · Cited by 2,432
Bayes and Empirical Bayes Methods for Data Analysis
(2001) · Technometrics · doi:10.1198/tech.2001.s608 · Cited by 2,098
On the Specification and Estimation of the Production Function for Cognitive Achievement
Todd, P. E., & Wolpin, K. I. (2003) · The Economic Journal · doi:10.1111/1468-0297.00097 · Cited by 1,514 · cited 1×
“Applying such a policy with estimated effects rather than true performance would proportionately reduce the gains in the average teacher performance by one minus the square root of the stability coefficient for the estimated effects. With a single-year estimate this would imply a reduction of about 47 percent for elem…”
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448
Teacher training, teacher quality and student achievement
Harris, D. N., & Sass, T. R. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2010.11.009 · Cited by 1,348
Self-citationTeachers and Student Achievement in the Chicago Public High Schools
Aaronson, D., Barrow, L., & Sander, W. (2007) · Journal of Labor Economics · doi:10.1086/508733 · Cited by 1,291
Hill, H. C., Blunk, M. L., Charalambous, C. Y., Lewis, J. M., Phelps, G. C., Sleep, L., & Ball, D. L. (2008) · Cognition and Instruction · doi:10.1080/07370000802177235 · Cited by 996 · cited 1×
“Further, there is currently active research on the development of new classroom observation protocols to measure teacher performance (Blunk, 2007; Danielson and McGreal, 2000; Hill et al., 2007; Pianta and Hamre, forthcoming; Pianta, LaParo, and Hamre, 2006) that may prove”
BackgroundWhat does certification tell us about teacher effectiveness? Evidence from New York City
Kane, T. J., Rockoff, J. E., & Staiger, D. O. (2008) · Economics of Education Review · doi:10.1016/j.econedurev.2007.05.005 · Cited by 946
Generalizations about Using Value-Added Measures of Teacher Quality
Hanushek, E. A., & Rivkin, S. G. (2010) · American Economic Review · doi:10.1257/aer.100.2.267 · Cited by 793
Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation
Kane, T., & Staiger, D. (2008) · National Bureau of Economic Research · doi:10.3386/w14607 · Cited by 778
The Market for Teacher Quality
Hanushek, E., Kain, J., O'Brien, D., & Rivkin, S. (2005) · National Bureau of Economic Research · doi:10.3386/w11154 · Cited by 635
Teacher Evaluation to Enhance Professional Practice
Danielson, C., & McGreal, T. L. (2000) · Cited by 591
The Promise and Pitfalls of Using Imprecise School Accountability Measures
Kane, T. J., & Staiger, D. O. (2002) · Journal of Economic Perspectives · doi:10.1257/089533002320950993 · Cited by 503
Jacob, B. A., & Lefgren, L. (2008) · Journal of Labor Economics · doi:10.1086/522974 · Cited by 494
Clotfelter, C., Ladd, H., & Vigdor, J. (2007) · National Bureau of Economic Research · doi:10.3386/w13617 · Cited by 432
Charter Schools and Student Achievement in Florida
Sass, T. R. (2006) · Education Finance and Policy · doi:10.1162/edfp.2006.1.1.91 · Cited by 344
Self-citationGrossman, P., Loeb, S., Cohen, J., & Wyckoff, J. (2013) · American Journal of Education · doi:10.1086/669901 · Cited by 271
Do Value-Added Estimates Add Value? Accounting for Learning Dynamics
Andrabi, T., Das, J., Ijaz Khwaja, A., & Zajonc, T. (2011) · American Economic Journal: Applied Economics · doi:10.1257/app.3.3.29 · Cited by 249
Goldhaber, D., Gross, B., & Player, D. (2011) · Journal of Policy Analysis and Management · doi:10.1002/pam.20549 · Cited by 225
The Market for Teacher Quality. NBER Working Paper No. 11154.
Hanushek, E. A., Kain, J. F., O’Brien, D. M., & Rivkin, S. G. (2005) · National Bureau of Economic Research · Cited by 217
Koedel, C., & Betts, J. R. (2011) · Education Finance and Policy · doi:10.1162/edfp_a_00027 · Cited by 216
Kane, T. J., & Staiger, D. O. (2008) · National Bureau of Economic Research · Cited by 208
Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement
Rothstein, J. (2008) · National Bureau of Economic Research · doi:10.3386/w14442 · Cited by 207
Determinants of Student Achievement: New Evidence from San Diego
Betts, J. R., Zau, A. C., & Rice, L. A. (2003) · Cited by 179
Re-Examining the Role of Teacher Quality In the Educational Production FunctionPreprint
Koedel, C., & Betts, J. R. (2007) · RePEc: Research Papers in Economics · Cited by 157
Dynamic criteria and the measurement of change.
Hofmann, D. A., Jacobs, R. R., & Baratta, J. E. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.2.194 · Cited by 148
How and why do teacher credentials matter for student achievement?
Clotfelter, C. T., Ladd, H. F., & Vigdor, J. L. (2007) · PsycEXTRA Dataset · doi:10.1037/e722762011-001 · Cited by 145
Using Performance on the Job to Inform Teacher Tenure Decisions
Goldhaber, D. D., & Hansén, M. (2010) · American Economic Review · doi:10.1257/aer.100.2.250 · Cited by 145
Using Panel Data to Improve Estimates of the Determinants of Educational Achievement
Boardman, A. E., & Murnane, R. J. (1979) · Sociology of Education · doi:10.2307/2112449 · Cited by 143
Mapping individual performance over time.
Hofmann, D. A., Jacobs, R. R., & Gerras, S. J. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.2.185 · Cited by 137
Ployhart, R. E., & Hakel, M. D. (1998) · Personnel Psychology · doi:10.1111/j.1744-6570.1998.tb00744.x · Cited by 132
Lockwood, J. R., McCaffrey, D. F., Hamilton, L. S., Stecher, B., Le, V., & Martinez, J. F. (2007) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2007.00026.x · Cited by 105
Self-citationStability of skilled performance across time: Some generalizations and limitations on utilities.
Henry, R. A., & Hulin, C. L. (1987) · Journal of Applied Psychology · doi:10.1037/0021-9010.72.3.457 · Cited by 100
DYNAMIC CRITERIA REVISITED: A LONGITUDINAL STUDY OF PERFORMANCE STABILITY AND PREDICTIVE VALIDITY
Deadrick, D. L., & Madigan, R. M. (1990) · Personnel Psychology · doi:10.1111/j.1744-6570.1990.tb00680.x · Cited by 97
Harris, D. N. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.319 · Cited by 84
Uncertainty in Rank Estimation: Implications for Value-Added Modeling Accountability Systems
Lockwood, J. R., Louis, T. A., & McCaffrey, D. F. (2002) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986027003255 · Cited by 71
Self-citationIs It Just a Bad Class? Assessing the Stability of Measured Teacher Performance
Goldhaber, D. D., & Hansén, M. (2010) · Cited by 61
Stability of performance: An interactionist perspective.
Hanges, P. J., Schneider, B., & Niles, K. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.6.658 · Cited by 60
Koedel, C., & Betts, J. R. (2007) · Cited by 53
Centering and Reference Groups for Estimates of Fixed Effects: Modifications to Felsdvreg
Mihály, K., McCaffrey, D. F., Lockwood, J. R., & Sass, T. R. (2010) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x1001000109 · Cited by 49
Self-citationConsistency of performance under stable conditions of work.
Rambo, W. W., Chomiak, A. M., & Price, J. M. (1983) · Journal of Applied Psychology · doi:10.1037/0021-9010.68.1.78 · Cited by 45
Comparisons Among Various Educational Assessment Value-Added Models
Sanders, W. L. (2006) · Cited by 34
What Makes for a Good Teacher and Who Can Tell? Working Paper 30.
Harris, D. N., & Sass, T. R. (2009) · Cited by 32
Self-citationClotfelter, C. T., Ladd, H. F., & Vigdor, J. L. (2007) · Cited by 30
Rothstein, J. (2008) · National Bureau of Economic Research · Cited by 29
How and Why Do Teacher Credentials Matter for Student Achievement? Working Paper 2. Revised.
Clotfelter, C. T., Ladd, H. F., & Vigdor, J. L. (2007) · Cited by 17
Using Stata for a memory saving fixed effects estimation for the three-way error component modelPreprint
Cornelißen, T. (2006) · RePEc: Research Papers in Economics · Cited by 13
Using Stata for a memory-saving fixed-effects estimation of the three-way error-components modelPreprint
Cornelißen, T. (2008) · RePEc: Research Papers in Economics · Cited by 12
Estimating Teacher and School Effectiveness in Pittsburgh Value-Added Modeling and ResultsPreprint
Lipscomb, S., Gill, B., Booker, K., & Johnson, M. (2010) · RePEc: Research Papers in Economics · Cited by 4
(2007) · National Bureau of Economic Research
Research works printed but not linked: 2
- 10.1177/1527002506296366 · doi:10.1177/1527002506296366
- 10.1037/0021-9010.63.1.40 · doi:10.1037/0021-9010.63.1.40
Cited by
Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates
Chetty, R., Friedman, J. N., & Rockoff, J. E. (2014) · American Economic Review · doi:10.1257/aer.104.9.2593 · Cited by 1,241
Generalizations about Using Value-Added Measures of Teacher Quality
Hanushek, E. A., & Rivkin, S. G. (2010) · American Economic Review · doi:10.1257/aer.100.2.267 · Cited by 793
Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement*
Rothstein, J. (2010) · Quarterly Journal of Economics · doi:10.1162/qjec.2010.125.1.175 · Cited by 735
Classroom Peer Effects and Student Achievement
Burke, M. A., & Sass, T. R. (2013) · Journal of Labor Economics · doi:10.1086/666653 · Cited by 443
Self-citationDuflo, E., Dupas, P., & Kremer, M. (2015) · Journal of Public Economics · doi:10.1016/j.jpubeco.2014.11.008 · Cited by 398
Metadata
- Authors
- McCaffrey, D. F., Sass, T. R., Lockwood, J. R., & Mihaly, K.
- Venue
- Education Finance and Policy
- Publisher
- MIT Press - Journals
- Published
- 2009-10
- Volume
- 4
- Issue
- 4
- Pages
- 572-606
- ISSN
- 1557-3060 (ISSN-L)
- 1557-3079
- OpenAlex
- W2120520658
- Cited by
- 331
- References
- 50
- FWCI
- 104.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.