CoChat

Revisiting The Widget Effect : Teacher Evaluation Reforms and the Distribution of Teacher Effectiveness

Kraft, Matthew A., Gilmour, Allison F. · 2017 · Educational Researcher

The DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.

Abstract

In 2009, the New Teacher Project’s The Widget Effect documented the failure of U.S. public school districts to recognize and act on differences in teacher effectiveness. We revisit these findings by compiling teacher performance ratings across 24 states that adopted major reforms to their teacher evaluation systems. In the vast majority of these states, the percentage of teachers rated unsatisfactory remains less than 1%. However, the full distributions of ratings vary widely across states, with 0.7% to 28.7% rated below proficient and 6% to 62% rated above proficient. We present original survey data from an urban district illustrating that evaluators perceive more than 3 times as many teachers in their schools to be below proficient than they rate as such. Interviews with principals reveal several potential explanations for these patterns.

Overview

Integrity signals

Registry

Crossref · 10.3102/0013189x17718797

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 37 references

Research works printed but not linked: 5

  1. Donaldson M. L., 2009, So long, Lake Wobegon? Using teacher evaluation to raise teacher quality
  2. Glander M., 2015, Selected statistics from the public elementary and secondary education universe: School year 2013–14. First look
  3. Thomas E., 2010, Newsweek, 155, 24
  4. Toch T., 2008, Rush to judgment: Teacher evaluation in public education
  5. Wechsler M., 2007, The status of the teaching profession 2007

Cited by

See all 211

Metadata

Authors
Kraft, M. A., & Gilmour, A. F.
Affiliations
  • Brown University (US)
  • Temple University (US)
Venue
Educational Researcher
Published
2017-06
Volume
46
Issue
5
Pages
234-249
ISSN
  • 0013-189X (ISSN-L)
  • 1935-102X
OpenAlex
W2739034820
Cited by
211
References
38
Citations by year
2026: 19 · 2025: 16 · 2024: 24 · 2023: 23 · 2022: 19 · 2021: 24 · 2020: 29 · 2019: 29 · 2018: 22 · 2017: 4
FWCI
65.27
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Educational Researcher (publishedVersion)
Topics
  • Social Sciences › Education › School Choice and Performance
  • Social Sciences › Education › School Leadership and Teacher Performance
  • Social Sciences › Education › Teacher Education and Assessments
Keywords
teacher evaluation reform, teacher effectiveness, teacher performance ratings, rating distribution, evaluator perceptions, principal interview, urban school districts

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Revisiting The Widget Effect : Teacher Evaluation Reforms and the Distribution of Teacher Effectiveness. https://app.cochat.ai/papers/10.3102/0013189x17718797
The paper
Kraft, M. A., & Gilmour, A. F. (2017). Revisiting The Widget Effect : Teacher Evaluation Reforms and the Distribution of Teacher Effectiveness. Educational Researcher. https://doi.org/10.3102/0013189x17718797

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.