CoChat

Methodological Concerns About the Education Value-Added Assessment System

Amrein-Beardsley, Audrey · 2008 · Educational Researcher

The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.

Abstract

Value-added models help to evaluate the knowledge that school districts, schools, and teachers add to student learning as students progress through school. In this article, the well-known Education Value-Added Assessment System (EVAAS) is examined. The author presents a practical investigation of the methodological issues associated with the model. Specifically, she argues that, although EVAAS is probably the most sophisticated value-added model, it has flaws that must be addressed before widespread adoption. She explores in depth the shortage of external reviews and validity studies of the model, its insufficient user-friendliness, and methodological issues about missing data, regression to the mean, and student background variables. She also examines a paradigm case in which the model was used to advance unfounded assertions.

Overview

Integrity signals

Registry

Crossref · 10.3102/0013189x08316420

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 13

  1. Battelle for Kids, 2006, Achievement gains study of SOAR pilot and matched districts: Does SOAR make a difference? A summary of the final report to Battelle for Kids
  2. Braun HI, 2004, Value-added modeling: What does due diligence require?
  3. Lockwood JR, 2003, R News, 3, 17
  4. Morgan JP, 2002, Multiple choices: Testing students in Tennessee
  5. Northwest Evaluation Association, 2006, Achievement gaps: An examination of differences in student achievement and growth
  6. Ross SM, 2001, Paper presented at the annual meeting of the American Educational Research Association
  7. Sanders WL, 1998, The School Administrator, 55, 24
  8. SandersWLHow can value-added assessment lead to greater accountability?2004[Biographical sketch with article]. Report presented at First Annual Policy Conference of the New York State Educational Conference Board (Investment and Accountability for Student Success), Albany, NY. Retrieved February 10, 2007, fromhttp://www.nysecb.org/2004conference/04sanders.html
  9. Sanders WL, 1996, Cumulative and residual effects of teachers on future student academic achievement
  10. Sanders WL, 2002, Effects of building change on indicators of student achievement growth: Tennessee Value-Added Assessment System
  11. Stroup W, 1995, Assessment of the statistical methodology used in the Tennessee Value-Added Assessment System
  12. Walberg HJ, 1997, Grading teachers, grading schools: Is student achievement a valid evaluation measure?, 169
  13. 10.1037/0033-2909.91.3.461 · DOI · Paper page

Cited by

See all 199

Metadata

Authors
Amrein-Beardsley, A.
Affiliations
AUDREY AMREIN-BEARDSLEY is an assistant professor at Arizona State University, College of Teacher Education and Leadership, P.O. Box 37100, Phoenix, AZ 85069; . Her areas of interest are educational policy, research methods, and tests and assessments
Venue
Educational Researcher
Published
2008-03
Volume
37
Issue
2
Pages
65-75
ISSN
  • 0013-189X (ISSN-L)
  • 1935-102X
OpenAlex
W2113233414
Cited by
199
References
48
Citations by year
2026: 3 · 2025: 2 · 2024: 7 · 2023: 5 · 2022: 3 · 2021: 8 · 2020: 19 · 2019: 8 · 2018: 14 · 2017: 14 · 2016: 17 · 2015: 9 · 2014: 18 · 2013: 19 · 2012: 18
FWCI
26.20
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Educational Researcher (publishedVersion)
Topics
  • Social Sciences › Education › Educational Assessment and Improvement
  • Social Sciences › Education › School Choice and Performance
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
Keywords
value-added models, student achievement improvement, school accountability, teacher evaluation, external validation, missing data, regression to the mean, student background, methodological critique

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.