Value-Added Modeling and Educational Accountability: Are We Answering the Real Questions?
Abstract
Value-added estimates of teacher or school quality are increasingly used for both high- and low-stakes accountability purposes, making understanding of their limitations critical. A review of the recent value-added literature suggests three concerns with the state of the research. First, the issues receiving the most research attention have not always been the concerns of greatest importance to theorists or critics. Second, there has been insufficient research on the interactions among various issues or assumption violations. Third, some of the big issues in value-added modeling have been challenging to address and may require educators to step back and answer some underlying philosophical questions about the nature of teacher and school quality.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
It remains uncertain to what extent the digital affordances of AI chatbots contribute to measurable learning gains, and there is a need to analyze and distinguish these learning gains and their assessment methods.
“Lastly, it remains uncertain to what extent the digital affordances of AI chatbot contributes to measurable learning gains, and there is a need to analyze and distinguish these learning gains and their assessment methods (21, 22).”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [21]
Cites
Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood
Chetty, R., Friedman, J. N., & Rockoff, J. E. (2014) · American Economic Review · doi:10.1257/aer.104.9.2633 · Cited by 1,717 · see citing works
Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates
Chetty, R., Friedman, J. N., & Rockoff, J. E. (2014) · American Economic Review · doi:10.1257/aer.104.9.2593 · Cited by 1,241 · see citing works
Generalizations about Using Value-Added Measures of Teacher Quality
Hanushek, E. A., & Rivkin, S. G. (2010) · American Economic Review · doi:10.1257/aer.100.2.267 · Cited by 793 · see citing works
Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation
Kane, T. J., & Staiger, D. O. (2008) · National Bureau of Economic Research · doi:10.3386/w14607 · Cited by 784 · see citing works
Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement<sup>*</sup>
Rothstein, J. (2010) · Quarterly Journal of Economics · doi:10.1162/qjec.2010.125.1.175 · Cited by 735 · see citing works
Controlling for Student Background in Value-Added Assessment of Teachers
Ballou, D., Sanders, W. L., & Wright, P. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029001037 · Cited by 434 · see citing works
Sanders, W. L., & Horn, S. P. (1994) · Journal of Personnel Evaluation in Education · doi:10.1007/bf00973726 · Cited by 414 · see citing works
The Intertemporal Variability of Teacher Effect Estimates
McCaffrey, D., Sass, T. R., Lockwood, J. R., & Mihaly, K. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.572 · Cited by 406 · see citing works
Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables
Rothstein, J. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.537 · Cited by 332 · see citing works
Jackson, C. K. (2009) · Journal of Labor Economics · doi:10.1086/599334 · Cited by 310 · see citing works
A Validity Argument Approach to Evaluating Teacher Value-Added Scores
Hill, H. C., Kapitula, L. R., & Umland, K. L. (2010) · American Educational Research Journal · doi:10.3102/0002831210387916 · Cited by 276 · see citing works
Different Tests, Different Answers
Papay, J. P. (2010) · American Educational Research Journal · doi:10.3102/0002831210362589 · Cited by 219 · see citing works
Koedel, C., & Betts, J. R. (2010) · Education Finance and Policy · doi:10.1162/edfp_a_00027 · Cited by 216 · see citing works
Methodological Concerns About the Education Value-Added Assessment System
Amrein-Beardsley, A. (2008) · Educational Researcher · doi:10.3102/0013189x08316420 · Cited by 199 · see citing works
Lockwood, J. R., III, McCaffrey, D. F., Hamilton, L. S., Stecher, B. M., Le, V., & Martínez, J. F. (2007) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2007.00026.x · Cited by 191 · see citing works
Newton, X. A., Darling‐Hammond, L., Haertel, E. H., & Thomas, E. A. C. (2010) · Education Policy Analysis Archives · doi:10.14507/epaa.v18n23.2010 · Cited by 178 · see citing works
Sanders, W. L. (1998) · The School Administrator · Cited by 167 · see citing works
Value-added models and the measurement of teacher productivity
Sass, T. R., Semykina, A., & Harris, D. N. (2013) · Economics of Education Review · doi:10.1016/j.econedurev.2013.10.003 · Cited by 147 · see citing works
Leckie, G. (2009) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2008.00577.x · Cited by 129 · see citing works
Assumptions of Value-Added Models for Estimating School Effects
Reardon, S. F., & Raudenbush, S. W. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.492 · Cited by 124 · see citing works
Using School Choice Lotteries to Test Measures of School Effectiveness
Deming, D. J. (2014) · American Economic Review · doi:10.1257/aer.104.5.406 · Cited by 123 · see citing works
Test Scaling and Value-Added Measurement
Ballou, D. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.351 · Cited by 121 · see citing works
Snijders, T. A. B. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa234 · Cited by 115 · see citing works
Is it Just a Bad Class? Assessing the Long‐term Stability of Estimated Teacher Performance
Goldhaber, D. D., & Hansén, M. (2012) · Economica · doi:10.1111/ecca.12002 · Cited by 112 · see citing works
The Choice Between Fixed and Random Effects Models: Some Considerations for Educational ResearchPreprint
Clarke, P., Crawford, C., Steele, F., & Vignoles, A. F. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1700456 · Cited by 105 · see citing works
Loeb, S., Soland, J. G., & Fox, L. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373714527788 · Cited by 101 · see citing works
A longitudinal study on the stability over time of school and teacher effects on student outcomes
Kyriakides, L. E., & Creemers, B. (2008) · Oxford Review of Education · doi:10.1080/03054980701782064 · Cited by 100 · see citing works
Value Added to What? How a Ceiling in the Testing Instrument Influences Value-Added Estimation
Koedel, C., & Betts, J. R. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.5.1.5104 · Cited by 96 · see citing works
Exogenous Variables and Value-Added Assessments: A Fatal Flaw
Berliner, D. C. (2014) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/016146811411600102 · Cited by 91 · see citing works
Bayesian Methods for Scalable Multivariate Value-Added Assessment
Lockwood, J. R., III, McCaffrey, D. F., Mariano, L. T., & Setodji, C. M. (2007) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998606298039 · Cited by 87 · see citing works
Validating Teacher Effect Estimates Using Changes in Teacher Assignments in Los Angeles
Bacher-Hicks, A., Kane, T. J., & Staiger, D. O. (2014) · National Bureau of Economic Research · doi:10.3386/w20657 · Cited by 81 · see citing works
Harris, D. N. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.319 · Cited by 81 · see citing works
An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures
Guarino, C. M., Maxfield, M., Reckase, M. D., Thompson, P. N., & Wooldridge, J. M. (2015) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998615574771 · Cited by 67 · see citing works
An empirical analysis of teacher spillover effects in secondary school
Koedel, C. (2009) · Economics of Education Review · doi:10.1016/j.econedurev.2009.02.003 · Cited by 67 · see citing works
What Are Error Rates for Classifying Teacher and School Performance Using Value-Added Models?
Schochet, P. Z., & Chiang, H. S. (2012) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998611432174 · Cited by 65 · see citing works
Composition, Context, and Endogeneity in School and Teacher Comparisons
Castellano, K. E., Rabe‐Hesketh, S., & Skrondal, A. (2014) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998614547576 · Cited by 65 · see citing works
Dieterle, S. G., Guarino, C. M., Reckase, M. D., & Wooldridge, J. M. (2014) · Journal of Policy Analysis and Management · doi:10.1002/pam.21781 · Cited by 64 · see citing works
Exploring Student-Teacher Interactions in Longitudinal Achievement Data
Lockwood, J. R., III, & McCaffrey, D. F. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.439 · Cited by 61 · see citing works
The Sensitivity of Value-Added Modeling to the Creation of a Vertical Score Scale
Briggs, D. C., & Weeks, J. P. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.384 · Cited by 57 · see citing works
Using Value-Added Models to Measure Teacher Effects on Students’ Motivation and Achievement
Ruzek, E. A., Domina, T., Conley, A. M., Duncan, G. J., & Karabenick, S. A. (2015) · The Journal of Early Adolescence · doi:10.1177/0272431614525260 · Cited by 57 · see citing works
Is a good elementary teacher always good? Assessing teacher performance estimates across subjects
Goldhaber, D. D., Cowan, J., & Walch, J. (2013) · Economics of Education Review · doi:10.1016/j.econedurev.2013.06.010 · Cited by 51 · see citing works
Conceptual and empirical differences among various value-added models for accountability
Timmermans, A. C., Doolaard, S., & de Wolf, I. (2011) · School Effectiveness and School Improvement · doi:10.1080/09243453.2011.590704 · Cited by 51 · see citing works
Assessing Rothstein's critique of teacher value-added models
Kinsler, J. (2012) · Quantitative Economics · doi:10.3982/qe132 · Cited by 49 · see citing works
The Persistence of Teacher-Induced Learning Gains
Jacob, B. A., Lefgren, L. J., & Sims, D. (2008) · National Bureau of Economic Research · doi:10.3386/w14065 · Cited by 49 · see citing works
Teacher heterogeneity, value-added and education policy
Condie, S. S., Lefgren, L. J., & Sims, D. (2014) · Economics of Education Review · doi:10.1016/j.econedurev.2013.11.009 · Cited by 49 · see citing works
Goldhaber, D. D., & Hansén, M. (2008) · PsycEXTRA Dataset · doi:10.1037/e722392011-001 · Cited by 47 · see citing works
Impediments to the Estimation of Teacher Value Added
Ishii, J., & Rivkin, S. G. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.520 · Cited by 46 · see citing works
Methodological issues in achieving school accountability1
Linn, R. L. (2008) · Journal of Curriculum Studies · doi:10.1080/00220270802105729 · Cited by 44 · see citing works
Evaluating value‐added models: A validity argument approach
Hill, H. C. (2009) · Journal of Policy Analysis and Management · doi:10.1002/pam.20463 · Cited by 43 · see citing works
Adjusting for measurement error in the value added model: evidence from Portugal
Ferrão, M. E., & Goldstein, H. (2008) · Quality & Quantity · doi:10.1007/s11135-008-9171-1 · Cited by 42 · see citing works
Value-added measures for schools in England: looking inside the ‘black box’ of complex metrics
Kelly, A. E., & Downey, C. (2010) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-010-9100-4 · Cited by 41 · see citing works
The Gains From Vertical Scaling
Briggs, D. C., & Domingue, B. W. (2013) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998613508317 · Cited by 39 · see citing works
Teacher value‐added: Don't end the search before it starts
Harris, D. N. (2009) · Journal of Policy Analysis and Management · doi:10.1002/pam.20464 · Cited by 38 · see citing works
Betebenner, D. W. (2011) · Cited by 37 · see citing works
Lenkeit, J. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2012.680892 · Cited by 36 · see citing works
Using Subject Test Scores Efficiently to Predict Teacher Value-Added
Lefgren, L. J., & Sims, D. (2012) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373711422377 · Cited by 36 · see citing works
Teacher Value-Added at the High-School Level
Goldhaber, D. D., Goldschmidt, P., & Tseng, F. (2013) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373712466938 · Cited by 35 · see citing works
Value Added in English Schools
Ray, A., McCormack, T., & Evans, H. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.415 · Cited by 35 · see citing works
Should Value-Added Measures Be Used for Performance Pay?
Eckert, J. M., & Dabrowski, J. (2010) · Phi Delta Kappan · doi:10.1177/003172171009100821 · Cited by 35 · see citing works
Measuring Teaching Using Value-Added Modeling
Scherrer, J. (2011) · NASSP Bulletin · doi:10.1177/0192636511410052 · Cited by 34 · see citing works
Kersting, N. B., Chen, M., & Stigler, J. W. (2013) · Education Policy Analysis Archives · doi:10.14507/epaa.v21n7.2013 · Cited by 32 · see citing works
Test Measurement Error and Inference from Value-Added Models
Koedel, C., Leatherman, R., & Parsons, E. (2012) · The B E Journal of Economic Analysis & Policy · doi:10.1515/1935-1682.3314 · Cited by 29 · see citing works
Reliability and validity in measuring the value added of schools
van de Grift, W. J. C. M. (2009) · School Effectiveness and School Improvement · doi:10.1080/09243450902883946 · Cited by 28 · see citing works
Strunk, K. O., Weinsten, T. L., & Makkonen, R. (2014) · Education Policy Analysis Archives · doi:10.14507/epaa.v22.1590 · Cited by 28 · see citing works
Value Added and Its Uses: Where You Stand Depends on Where You Sit
Corcoran, S. P., & Goldhaber, D. D. (2013) · Education Finance and Policy · doi:10.1162/edfp_a_00104 · Cited by 28 · see citing works
The Persistence of School-Level Value-Added
Briggs, D. C., & Weeks, J. P. (2011) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998610396887 · Cited by 28 · see citing works
The value‐added of primary schools: what is it really measuring?
Gorard, S. A. C. (2008) · Educational Review · doi:10.1080/00131910801934185 · Cited by 26 · see citing works
Measuring School Value Added with Administrative Data: The Problem of Missing Variables*
Dearden, L., Miranda, A., & Rabe‐Hesketh, S. (2011) · Fiscal Studies · doi:10.1111/j.1475-5890.2011.00136.x · Cited by 26 · see citing works
Altonji, J. G., & Mansfield, R. K. (2014) · National Bureau of Economic Research · doi:10.3386/w20781 · Cited by 26 · see citing works
Associations Between Student Achievement and Student Learning
Ready, D. D. (2012) · Educational Policy · doi:10.1177/0895904811429289 · Cited by 23 · see citing works
Beyond Levels and Growth: Estimating Teacher Value-Added and its Persistence
Kinsler, J. (2012) · The Journal of Human Resources · doi:10.1353/jhr.2012.0023 · Cited by 22 · see citing works
Multidimensional Assessment of Value Added by Teachers to Real-World Outcomes
Broatch, J., & Lohr, S. L. (2011) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998610396900 · Cited by 22 · see citing works
Rethinking Teacher Evaluation: A Conversation about Statistical Inferences and Value-Added Models
Everson, K. C., Feinauer, E., & Sudweeks, R. R. (2013) · Harvard Educational Review · doi:10.17763/haer.83.2.m32hk8q851u752h0 · Cited by 21 · see citing works
Self-citationPalardy, G. J. (2009) · Educational and Psychological Measurement · doi:10.1177/0013164409355693 · Cited by 20 · see citing works
Can Value-Added Measures of Teacher Performance Be Trusted?Preprint
Guarino, C. M., Reckase, M. D., & Wooldridge, J. M. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2085189 · Cited by 19 · see citing works
Clear Away the Smoke and Mirrors of Value-Added
Harris, D. N. (2010) · Phi Delta Kappan · doi:10.1177/003172171009100813 · Cited by 18 · see citing works
Are measured school effects just sorting?
Levine, D. I., & Painter, G. D. (2007) · Economics of Education Review · doi:10.1016/j.econedurev.2007.01.004 · Cited by 15 · see citing works
Was That a Result of My Teaching? A Brief Exploration of Value-Added Assessment
Misco, T. J. (2008) · The Clearing House A Journal of Educational Strategies Issues and Ideas · doi:10.3200/tchs.82.1.11-14 · Cited by 15 · see citing works
On the stability of value added indicators
Ferrão, M. E. (2011) · Quality & Quantity · doi:10.1007/s11135-010-9417-6 · Cited by 14 · see citing works
In Search of Value Added in the Case of Complex School Effects
Timmermans, A. C., Snijders, T. A. B., & Bosker, R. (2012) · Educational and Psychological Measurement · doi:10.1177/0013164412460392 · Cited by 14 · see citing works
Karl, A. T. (2012) · Arizona State University Library Digital Repository (Arizona State University) · Cited by 12 · see citing works
Karl, A. T., Yang, Y., & Lohr, S. L. (2013) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998613494819 · Cited by 10 · see citing works
Stacy, B. W., Guarino, C. M., Reckase, M. D., et al. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2345593 · Cited by 10 · see citing works
Teacher Quality at the High-School Level: The Importance of Accounting for Tracks
Jackson, C. K. (2012) · National Bureau of Economic Research · doi:10.3386/w17722 · Cited by 10 · see citing works
“Beware of Geeks Bearing Formulas”
Jennings, J. L., & Corcoran, S. P. (2009) · Phi Delta Kappan · doi:10.1177/003172170909000906 · Cited by 9 · see citing works
Now You See it, Now You don't: School Effectiveness as Conjuring?
Gorard, S. A. C. (2011) · Research in Education · doi:10.7227/rie.86.4 · Cited by 8 · see citing works
Martín, E. L., Kuosmanen, T., & Gaviria, J. L. (2014) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-014-9194-1 · Cited by 8 · see citing works
The principal axis approach to value-added calculation
He, Q., & Tymms, P. B. (2013) · Educational Research and Evaluation · doi:10.1080/13803611.2013.860036 · Cited by 6 · see citing works
The Validity of Value-Added Models: An Allegory
Martineau, J. A. (2010) · Phi Delta Kappan · doi:10.1177/003172171009100713 · Cited by 5 · see citing works
Evaluating Specification Tests in the Context of Value-Added EstimationPreprint
Guarino, C. M., Reckase, M. D., Stacy, B. W., et al. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2403111 · Cited by 5 · see citing works
Henry, G., Rose, R. A., & Lauen, D. (2014) · Cited by 2 · see citing works
Disentangling Disadvantage: Can We Distinguish Good Teaching from Classroom Composition?Preprint
Zamarro, G., Engberg, J., Saavedra, J. E., et al. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2378528 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Reviewing affective, behavioural and cognitive learning gains in higher education
Rogaten, J., Rienties, B., Sharpe, R., Cross, S., Whitelock, D., Lygo-Baker, S., & Littlejohn, A. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1504277 · Cited by 67 · see citing works
Making Inferences About Teacher Observation Scores Over Time
Briggs, D. C., & Alzen, J. L. (2019) · Educational and Psychological Measurement · doi:10.1177/0013164419826237 · Cited by 14 · see citing works
Wei, S., Wei, W., & Zou, G. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1832598 · Cited by 2 · see citing works
“Lastly, it remains uncertain to what extent the digital affordances of AI chatbot contributes to measurable learning gains, and there is a need to analyze and distinguish these learning gains and their assessment methods (21, 22).”
- Authors
- Everson, K. C.
- Affiliations
- Western Kentucky University (US)
- Corresponding author
- Everson, Kimberlee C.
- Venue
- Review of Educational Research
- Published
- 2016-07-09
- Volume
- 87
- Issue
- 1
- Pages
- 35-70
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2294369017
- Cited by
- 68
- References
- 92
- Citations by year
- 2026: 7 · 2025: 16 · 2024: 2 · 2023: 5 · 2022: 7 · 2021: 4 · 2020: 8 · 2019: 8 · 2018: 9 · 2017: 1
- FWCI
- 26.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Review of Educational Research (publishedVersion)
- Topics
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Decision Sciences › Information Systems and Management › Educational Assessment and Improvement
- Social Sciences › Education › Teacher Education and Assessments
- Keywords
- value-added modeling, educational accountability, teacher quality, school quality, high-stakes testing, assumption violations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review