CoChat

Rater Performance Standards for Classroom Observation Instruments

White, Mark C. · 2018 · Educational Researcher

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Abstract

Raters must score accurately and consistently for classroom observation scores to be valid. This requires (a) a standard defining when scoring is accurate and consistent enough and (b) measuring and remediating rater performance against that standard. Current practice has focused on this second problem to the exclusion of the first. My goal here is to start a discussion about identifying a clear, explicit standard that ensures observation scores reflect a consistent view of teaching quality, rather than raters’ idiosyncratic perspectives. In doing so, I connect current certification test cut-scores, the current practice most analogous to a standard, to explicit rater standards, highlighting both the inadequacy of cut-scores and the low standards implicit to current practice.

Overview

Integrity signals

Registry

Crossref · 10.3102/0013189x18785623

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 22 references

Research works printed but not linked: 3

  1. Pianta R. C., 2010, Classroom Assessment Scoring System (CLASS): Upper elementary manual
  2. Rowan B., 2013, Promoting high quality teacher evaluations in Michigan: Lessons from a pilot of educator effectiveness tools
  3. White M. C., 2017, The generalizability of scores from observation instruments

Cited by

See all 32

Metadata

Authors
White, M. C.
Affiliations
University of Michigan (US)
Corresponding author
White, Mark C.
Venue
Educational Researcher
Published
2018-07-09
Volume
47
Issue
8
Pages
492-501
ISSN
  • 0013-189X (ISSN-L)
  • 1935-102X
OpenAlex
W2835004802
Cited by
32
References
20
Citations by year
2026: 1 · 2025: 1 · 2024: 5 · 2023: 3 · 2022: 10 · 2021: 1 · 2020: 8 · 2019: 3
FWCI
9.73
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Educational Researcher (publishedVersion)
Topics
  • Social Sciences › Education › Teacher Education and Assessments
  • Social Sciences › Education › Evaluation of Teaching Practices
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords
classroom observation, rater reliability, rater validity, scoring consistency, cut-off values, teacher certification, teaching quality assessment, observation instruments

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Rater Performance Standards for Classroom Observation Instruments. https://app.cochat.ai/papers/10.3102/0013189x18785623
The paper
White, M. C. (2018). Rater Performance Standards for Classroom Observation Instruments. Educational Researcher. https://doi.org/10.3102/0013189x18785623

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.