The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Models for Value-Added Modeling of Teacher Effects
Open accessAbstract
The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating teachers and schools. In this article, we present a general multivariate, longitudinal mixed-model that incorporates the complex grouping structures inherent to longitudinal student data linked to teachers. We summarize the principal existing modeling approaches, show how these approaches are special cases of the proposed model, and discuss possible extensions to model more complex data structures. We present simulation and analytical results that clarify the interplay between estimated teacher effects and repeated outcomes on students over time. We also explore the potential impact of model misspecifications, including missing student covariates and assumptions about the accumulation of teacher effects over time, on key inferences made from the models. We conclude that mixed models that account for student correlation over time are reasonably robust to such misspecifications when all the schools in the sample serve similar student populations. However, student characteristics are likely to confound estimated teacher effects when schools serve distinctly different populations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language for Data Analysis and Graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,220
Searle, S. R., Casella, G., & McCulloch, C. E. (1992) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316856 · Cited by 1,926
The Trade-off between Child Quantity and Quality
Hanushek, E. A. (1992) · Journal of Political Economy · doi:10.1086/261808 · Cited by 1,181
Modeled Variance in Two-Level Models
SNIJDERS, T. A. B., & BOSKER, R. J. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003004 · Cited by 724
A Multilevel Model of the Social Distribution of High School Achievement
Lee, V. E., & Bryk, A. S. (1989) · Sociology of Education · doi:10.2307/2112866 · Cited by 654
The Estimation of School Effects
Raudenbush, S. W., & Willms, J. D. (1995) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165304 · Cited by 546
Controlling for Student Background in Value-Added Assessment of Teachers
Ballou, D., Sanders, W., & Wright, P. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029001037 · Cited by 434
Rowan, B., Correnti, R., & Miller, R. J. (2002) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146810210400804 · Cited by 412
Value-added indicators of school performance: A primer
Meyer, R. H. (1997) · Economics of Education Review · doi:10.1016/s0272-7757(96)00081-7 · Cited by 205
Multilevel Cross-Classified Models
GOLDSTEIN, H. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003005 · Cited by 198
Research works printed but not linked: 14
- BallouDSizing up test scoresEducation Next2002221015
- 10.1111/j.1745-3992.1984.tb00769.x · doi:10.1111/j.1745-3992.1984.tb00769.x
- DanielsMJKassREA note on first-stage approximation in two-stage hierarchical modelsSankhya, Ser. B1998601930
- DigglePJLiangKYZegerSLAnalysis of longitudinal data1996New YorkOxford University Press
- GoldsteinHMultilevel statistical models1995London UKArnold
- 10.1111/j.1745-3992.1984.tb00770.x · doi:10.1111/j.1745-3992.1984.tb00770.x
- LittleRSARubinDBStatistical Analysis with Missing Data1987New YorkJohn Wiley & Sons
- PumaMJKarweitNPriceCRicciutiAThompsonWVaden KiernanMProspects: Student Outcomes Final Report1997Cambridge, MAAbt Associates, IncTechnical Report 1997-04-00
- RaudenbushSWBrykASHierarchical linear models: Applications and data analysis methods2002Newbury Park, CASAGE Publications
- 10.3102/10769986020004307 · doi:10.3102/10769986020004307 · Paper page
- SandersWSaxtonAHornBMillmanJThe Tennessee Value-Added Assessment System: A quantitative outcomes-based approach to educational assessmentGrading teachers, grading schools: Is student achievement a valid evaluational Measure?1997Thousand Oaks, CACorwin Press, Inc137162
- ShkolnikJHikawaHSuttorpMLockwoodJStecherBBohrnstedtGBohrnstedtGWStecherBMAppendix D: The relationship between teacher characteristics and student achievement in reduced-size classes: A study of 6 California districtsWhat we have learned about class size reduction in California Technical Appendix2002Palo Alto, CAAmerican Institutes for Research
- WebsterWJMendroRLMillmanJThe Dallas Value-Added Accountability SystemGrading teachers, grading schools: Is student achievement a valid evaluation measure?1997Thousand Oaks, CACorwin Press, Inc8199
- 10.1037/h0028330 · doi:10.1037/h0028330
Cited by
Professional competence of teachers: Effects on instructional quality and student development.
Kunter, M., Klusmann, U., Baumert, J., Richter, D., Voss, T., & Hachfeld, A. (2013) · Journal of Educational Psychology · doi:10.1037/a0032583 · Cited by 1,553
How teacher turnover harms student achievement
Ronfeldt, M., Loeb, S., & Wyckoff, J. (2013) · American Educational Research Journal · doi:10.3102/0002831212463813 · Cited by 1,324
Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation
Kane, T., & Staiger, D. (2008) · National Bureau of Economic Research · doi:10.3386/w14607 · Cited by 778
Heck, R. H., & Hallinger, P. (2009) · American Educational Research Journal · doi:10.3102/0002831209340042 · Cited by 585
Evaluating Value-Added Models for Teacher Accountability
McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., & Hamilton, L. S. (2003) · PsycEXTRA Dataset · doi:10.1037/e658712010-001 · Cited by 541
Self-citationKleickmann, T., Richter, D., Kunter, M., Elsner, J., Besser, M., Krauss, S., & Baumert, J. (2013) · Journal of Teacher Education · doi:10.1177/0022487112460398 · Cited by 538
Fauth, B., Decristan, J., Decker, A.-T., Büttner, G., Hardy, I., Klieme, E., & Kunter, M. (2019) · Teaching and Teacher Education · doi:10.1016/j.tate.2019.102882 · Cited by 484
Educational effectiveness research (EER): a state-of-the-art review
Reynolds, D., Sammons, P., De Fraine, B., Van Damme, J., Townsend, T., Teddlie, C., & Stringfield, S. (2014) · School Effectiveness and School Improvement · doi:10.1080/09243453.2014.885450 · Cited by 474
The COACTIV Model of Teachers’ Professional Competence
Baumert, J., & Kunter, M. (2013) · Cognitive Activation in the Mathematics Classroom and Professional Competence of Teachers · doi:10.1007/978-1-4614-5149-5_2 · Cited by 442
Controlling for Student Background in Value-Added Assessment of Teachers
Ballou, D., Sanders, W., & Wright, P. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029001037 · Cited by 434
Kraft, M. A., & Papay, J. P. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713519496 · Cited by 517
Papay, J. P., & Kraft, M. A. (2015) · Journal of Public Economics · doi:10.1016/j.jpubeco.2015.02.008 · Cited by 370
Value-added modeling: A review
Koedel, C., Mihaly, K., & Rockoff, J. E. (2015) · Economics of Education Review · doi:10.1016/j.econedurev.2015.01.006 · Cited by 367
Goldhaber, D., Lavery, L., & Theobald, R. (2015) · Educational Researcher · doi:10.3102/0013189x15592622 · Cited by 351
Searching for Effective Teachers with Imperfect Information
Staiger, D. O., & Rockoff, J. E. (2010) · Journal of Economic Perspectives · doi:10.1257/jep.24.3.97 · Cited by 345
Teacher performance pay: A review
Podgursky, M. J., & Springer, M. G. (2007) · Journal of Policy Analysis and Management · doi:10.1002/pam.20292 · Cited by 316
Teacher Effects and Teacher-Related Policies
Jackson, C. K., Rockoff, J. E., & Staiger, D. O. (2014) · Annual Review of Economics · doi:10.1146/annurev-economics-080213-040845 · Cited by 300
“Recent studies have found that the impact of being assigned a more effective teacher declines by half or more between end-of-year test scores and test scores two years later (McCaffrey et al., 2004; Jacob, Lefgren, and Sims, 2010; Kane and Staiger, 2008; Rothstein, 2010; Chetty et al., 2013a).”
BackgroundModeling the longitudinal effects of school leadership on teaching and learning
H. Heck, R., & Hallinger, P. (2014) · Journal of Educational Administration · doi:10.1108/jea-08-2013-0097 · Cited by 273
The High School Environment and the Gender Gap in Science and Engineering
Legewie, J., & DiPrete, T. A. (2014) · Sociology of Education · doi:10.1177/0038040714547770 · Cited by 273
A Validity Argument Approach to Evaluating Teacher Value-Added Scores
Hill, H. C., Kapitula, L., & Umland, K. (2011) · American Educational Research Journal · doi:10.3102/0002831210387916 · Cited by 269
Methodological Concerns About the Education Value-Added Assessment System
Amrein-Beardsley, A. (2008) · Educational Researcher · doi:10.3102/0013189x08316420 · Cited by 199
The gateway to the profession: Assessing teacher preparation programs based on student achievement
Goldhaber, D., Liddle, S., & Theobald, R. (2013) · Economics of Education Review · doi:10.1016/j.econedurev.2013.01.011 · Cited by 178
Refocusing the Debate: Assessing the Purposes and Tools of Teacher Evaluation
Papay, J. (2012) · Harvard Educational Review · doi:10.17763/haer.82.1.v40p0833345w6384 · Cited by 155
The Persistence of Teacher-Induced Learning
Jacob, B. A., Lefgren, L., & Sims, D. P. (2010) · Journal of Human Resources · doi:10.1353/jhr.2010.0029 · Cited by 149
A longitudinal study of principals’ activities and student performance
May, H., Huff, J., & Goldring, E. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2012.678866 · Cited by 103
Using Multiple Measures to Address Perverse Incentives and Score Inflation
Koretz, D. (2003) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2003.tb00124.x · Cited by 56
Self-citationContrasting OLS and Quantile Regression Approaches to Student “Growth” Percentiles
Castellano, K. E., & Ho, A. D. (2013) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998611435413 · Cited by 47
Confidence Intervals for Population Ranks in the Presence of Ties and Near Ties
Xie, M., Singh, K., & Zhang, C.-H. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0142 · Cited by 32
“Table 1 displays a dataset from a health research study on blood glucose (A1c) control of diabetes patients in 79 Veterans Health Administration (VHA) facilities in the United States (Pogach et al. 2005).”
Background
Metadata
- Authors
- McCaffrey, D. F., Lockwood, J. R., Koretz, D., Louis, T. A., & Hamilton, L.
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 2004-03
- Volume
- 29
- Issue
- 1
- Pages
- 67-101
- ISSN
- 1076-9986 (ISSN-L)
- 1935-1054
- OpenAlex
- W318369406
- Cited by
- 513
- References
- 16
- FWCI
- 66.96
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.