CoChat

Observational Evaluation of Teachers: Measuring More Than We Bargained for?

Campbell, Shanyce L., Ronfeldt, Matthew · 2018 · American Educational Research Journal

The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.

Abstract

Our secondary analysis of Measures of Effective Teaching data contributes to growing evidence that observation ratings, used as part of comprehensive teacher evaluation systems across the nation, may measure factors outside of a teacher’s performance or control. Specifically, men and teachers in classrooms with high concentrations of Black, Hispanic, male, and low-performing students receive significantly lower observation ratings. By using various methodological approaches and a subsample of teachers randomly assigned to classrooms, we demonstrate that these differences are unlikely due to actual differences in teacher quality. These results suggest that policymakers consider the unintended consequences of using observational ratings to evaluate teachers and consider ways to adjust ratings to ensure they are fair.

Overview

Integrity signals

Registry

Crossref · 10.3102/0002831218776216

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 23 references

Research works printed but not linked: 10

  1. American Educational Research Association, 2015, Educational Researcher, 44
  2. Baker E. L., 2010, Problems with the use of student test scores to evaluate teachers
  3. Cornell S., 2006, Ethnicity and race: Making identities in a changing world
  4. Ho A. D., 2013, The reliability of classroom observations by school personnel
  5. Jiang J. Y., 2016, Teacher evaluation in Chicago: Differences in observation and value-added scores by teacher, student, and school characteristics
  6. Kane T. J., 2012, Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains
  7. Kane T. J., 2011, Journal of Human Resources, 46, 587
  8. Sanders W., 1996, Cumulative and residual effects of teachers on future student academic achievement: Research progress report
  9. White M., 2014, User guide to measures of effective teaching longitudinal database (MET LDB)
  10. Whitehurst G. J. R., 2014, Evaluating teachers with classroom observations

Cited by

See all 111

Metadata

Authors
Campbell, S. L., & Ronfeldt, M.
Affiliations
  • University of California, Irvine (US)
  • University of Michigan (US)
Corresponding author
Campbell, Shanyce L.
Venue
American Educational Research Journal
Published
2018-06-07
Volume
55
Issue
6
Pages
1233-1267
ISSN
  • 0002-8312 (ISSN-L)
  • 1935-1011
OpenAlex
W2556979109
Cited by
111
References
24
Citations by year
2026: 4 · 2025: 9 · 2024: 14 · 2023: 22 · 2022: 18 · 2021: 16 · 2020: 18 · 2019: 10
FWCI
35.67
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • American Educational Research Journal (publishedVersion)
  • 2016 Fall Conference: The Role of Research in Making Government More Effective
Topics
  • Social Sciences › Education › School Choice and Performance
  • Social Sciences › Education › Teacher Education and Assessments
  • Social Sciences › Education › Educational Assessment and Improvement
Keywords
teacher evaluation, Measures of Effective Teaching, teacher quality, student concentration, underachieving students

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Observational Evaluation of Teachers: Measuring More Than We Bargained for? https://app.cochat.ai/papers/10.3102/0002831218776216
The paper
Campbell, S. L., & Ronfeldt, M. (2018). Observational Evaluation of Teachers: Measuring More Than We Bargained for? American Educational Research Journal. https://doi.org/10.3102/0002831218776216

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.