Evaluating Value-Added Models for Teacher Accountability
The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Abstract
Evaluates leading applications of VAM, clarifies questions raised by its use for measuring teacher effectiveness, and discusses a variety of statistical and measurement issues that might affect the validity of inferences resulting from use of the model.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“RAND studies, nevertheless, have raised some questions regarding the limitations of these analyses (McCaffrey et al., 2003).”
From Making Sense of Data-Driven Decision Making in Education: Evidence from Recent RAND Research (2006) · cites this paper as McCaffrey et al., 2003
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 1×
“1 Rubin (1974), Holland (1986), and West, Biesanz, and Pitts (2000) provide details on statistical models that formalize such causal modeling.”
BackgroundOn the Theory of Scales of Measurement
Stevens, S. S. (1946) · Science · doi:10.1126/science.103.2684.677 · Cited by 4,761
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
The Central Role of the Propensity Score in Observational Studies for Causal Effects
Rosenbaum, P. R., & Rubin, D. B. (1983) · Biometrika · doi:10.2307/2335942 · Cited by 3,261
Searle, S. R., & Searle, S. R. (1971) · Cited by 3,229
Cited by
Johnson, S. M., Kraft, M. A., & Papay, J. P. (2012) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811211401004 · Cited by 822
Teacher Preparation and Student Achievement
Boyd, D. J., Grossman, P. L., Lankford, H., Loeb, S., & Wyckoff, J. (2009) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373709353129 · Cited by 818
“These approaches are referred to as value-added analysis and differ along a number of dimensions including what variables are included and how the error structure is defined (for reviews, see Ballou, Sanders, & Wright, 2004; Lissitz, 2005; McCaffrey et al., 2003; Meyer, 1997).”
BackgroundEstimating Teacher Impacts on Student Achievement: An Experimental Evaluation
Kane, T., & Staiger, D. (2008) · National Bureau of Economic Research · doi:10.3386/w14607 · Cited by 778
Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement*
Rothstein, J. (2010) · Quarterly Journal of Economics · doi:10.1162/qjec.2010.125.1.175 · Cited by 735
Thoonen, E. E. J., Sleegers, P. J. C., Oort, F. J., Peetsma, T. T. D., & Geijsel, F. P. (2011) · Educational Administration Quarterly · doi:10.1177/0013161x11400185 · Cited by 641
Teacher Turnover in High-Poverty Schools: What We Know and Can Do
Simon, N., & Johnson, S. M. (2015) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811511700305 · Cited by 554
Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors
Carrell, S. E., & West, J. E. (2010) · Journal of Political Economy · doi:10.1086/653808 · Cited by 508
“…value-added be uncorrelated with all other explanatory variables in the model.16 This requirement is almost certainly violated when students self-select into course work or sections of a given course, but the requirement is satisfied in our context (Raudenbush and Bryk 2002; McCaffrey et al. 2004).”
Stupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425
The Distribution of Teacher Quality and Implications for Policy
Hanushek, E. A., & Rivkin, S. G. (2012) · Annual Review of Economics · doi:10.1146/annurev-economics-080511-111001 · Cited by 350
Zeichner, K. (2006) · Journal of Teacher Education · doi:10.1177/0022487105285893 · Cited by 327
Teacher performance pay: A review
Podgursky, M. J., & Springer, M. G. (2007) · Journal of Policy Analysis and Management · doi:10.1002/pam.20292 · Cited by 316
What is the Relationship Between Teacher Quality and Student Achievement? An Exploratory Study
Stronge, J. H., Ward, T. J., Tucker, P. D., & Hindman, J. L. (2007) · Journal of Personnel Evaluation in Education · doi:10.1007/s11092-008-9053-z · Cited by 293
Palardy, G. J., & Rumberger, R. W. (2008) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373708317680 · Cited by 279
A Validity Argument Approach to Evaluating Teacher Value-Added Scores
Hill, H. C., Kapitula, L., & Umland, K. (2011) · American Educational Research Journal · doi:10.3102/0002831210387916 · Cited by 269
Making Sense of Data-Driven Decision Making in Education: Evidence from Recent RAND Research
(2006) · RAND Corporation eBooks · doi:10.7249/op170 · Cited by 202
Self-citationMethodological Concerns About the Education Value-Added Assessment System
Amrein-Beardsley, A. (2008) · Educational Researcher · doi:10.3102/0013189x08316420 · Cited by 199
The gateway to the profession: Assessing teacher preparation programs based on student achievement
Goldhaber, D., Liddle, S., & Theobald, R. (2013) · Economics of Education Review · doi:10.1016/j.econedurev.2013.01.011 · Cited by 178
Teacher Evaluation Policy and Conflicting Theories of Motivation
Firestone, W. A. (2014) · Educational Researcher · doi:10.3102/0013189x14521864 · Cited by 159
(2004) · Cited by 117
A longitudinal study of principals’ activities and student performance
May, H., Huff, J., & Goldring, E. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2012.678866 · Cited by 103
Making Inferences About Teacher Observation Scores Over Time
Briggs, D. C., & Alzen, J. L. (2019) · Educational and Psychological Measurement · doi:10.1177/0013164419826237 · Cited by 14
Metadata
- Authors
- McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., & Hamilton, L. S.
- Venue
- PsycEXTRA Dataset
- Published
- 2003
- OpenAlex
- W1533590221
- Cited by
- 541
- References
- 66
- Type
- dataset
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.