An Empirical Comparison of Statistical Models for Value-Added Assessment of School Performance
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Hierarchical Linear Models (HLM) have been used extensively for value-added analysis, adjusting for important student and school-level covariates such as socioeconomic status. A recently proposed alternative, the Layered Mixed Effects Model (LMEM) also analyzes learning gains, but ignores sociodemographic factors. Other features of LMEM, such as its ability to apportion credit for learning gains among multiple schools and its utilization of incomplete observations, make it appealing. A third model that is appealing due to its simplicity is the Simple Fixed Effects Models (SFEM). Statistical and computing specifications are given for each of these models. The models were fitted to obtain value-added measures of school performance by grade and subject area, using a common data set with two years of test scores. We investigate the practical impact of differences among these models by comparing their value-added measures. The value-added measures obtained from the SFEM were highly correlated with those from the LMEM. Thus, due to its simplicity, the SFEM is recommended over LMEM. Results of comparisons of SFEM with HLM were equivocal. Inclusion of student level variables such as minority status and poverty leads to results that differ from those of the SFEM. The question of whether to adjust for such variables is, perhaps, the most important issue faced when developing a school accountability system. Either inclusion or exclusion of them is likely to lead to a biased system. Which bias is most tolerable may depend on whether the system is to be a high-stakes one.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448 · cited 2×
“2 We say “perceived theoretical deficiency” because the shrinkage estimators available for use in practice are only approximations of theoretically superior Stein-type shrinkage estimators (Efron & Morris, 1975; Morris, 1983) and the related best linear unbiased predictors (BLUPs), which are Empirical Bayes estimators…”
BackgroundUsing SAS PROC MIXED to Fit Multilevel Models, Hierarchical Models, and Individual Growth Models
Singer, J. D. (1998) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165280 · Cited by 1,092
Cited by
A Validity Argument Approach to Evaluating Teacher Value-Added Scores
Hill, H. C., Kapitula, L., & Umland, K. (2011) · American Educational Research Journal · doi:10.3102/0002831210387916 · Cited by 269
Methodological Concerns About the Education Value-Added Assessment System
Amrein-Beardsley, A. (2008) · Educational Researcher · doi:10.3102/0013189x08316420 · Cited by 199
A longitudinal study of principals’ activities and student performance
May, H., Huff, J., & Goldring, E. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2012.678866 · Cited by 103
Characteristics of Schools Successful in STEM: Evidence from Two States’ Longitudinal Data
Hansen, M. (2014) · The Journal of Educational Research · doi:10.1080/00220671.2013.823364 · Cited by 48
“See, for instance, Tekwe et al. (2004).”
Metadata
- Authors
- Tekwe, C. D., Carter, R. L., Ma, C.-X., Algina, J., Lucas, M. E., Roth, J., Ariet, M., Fisher, T., & Resnick, M. B.
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 2004-03
- Volume
- 29
- Issue
- 1
- Pages
- 11-36
- ISSN
- 1076-9986 (ISSN-L)
- 1935-1054
- OpenAlex
- W2161481869
- Cited by
- 155
- References
- 3
- FWCI
- 15.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Empirical Comparison of Statistical Models for Value-Added Assessment of School Performance. https://app.cochat.ai/papers/10.3102/10769986029001011
- The paper
- Tekwe, C. D., Carter, R. L., Ma, C.-X., Algina, J., Lucas, M. E., Roth, J., Ariet, M., Fisher, T., & Resnick, M. B. (2004). An Empirical Comparison of Statistical Models for Value-Added Assessment of School Performance. Journal of Educational and Behavioral Statistics. https://doi.org/10.3102/10769986029001011
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.