CoChat

The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol

Gitomer, Drew, Bell, Courtney, Qi, Yi, Mccaffrey, Daniel, Hamre, Bridget K., Pianta, Robert C. · 2014 · Teachers College Record: The Voice of Scholarship in Education
Cited by 114

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

Background/Context: Teacher evaluation is a major policy initiative intended to improve the quality of classroom instruction. This study documents a fundamental challenge to using teacher evaluation to improve teaching and learning. Purpose: Using an observation instrument (CLASS-S), we evaluate evidence on different aspects of instructional practice in algebra classrooms to consider how much scores vary, how well observers are able to judge practice, and how well teachers are able to evaluate their own practice. Participants: The study includes 82 Algebra I teachers in middle and high schools. Five observers completed almost all observations. Research Design: Each classroom was observed 4–5 times over the school year. Each observation was coded and scored live and by video. All videos were coded by two independent observers, as were 36% of the live observations. Observers assigned scores to each of 10 dimensions. Observer scores were also compared with master coders for a subset of videos. Participating teachers also completed a self-report instrument (CLASS-T) to assess their own skills on dimensions of CLASS-S. Data Collection and Analysis: For each lesson, data were aggregated into three domain scores, Emotional Support, Classroom Organization, and Instructional Support, and then averaged across lessons to create scores for each classroom. Findings/Results: Classroom Observation scores fell in the high range of the protocol. Scores for Emotional Support were in the midlevel range, and the lowest scores were for Instructional Support. Scores for each domain were clustered in narrow ranges. Observers were more consistent over time and agreed more when judging Classroom Organization than the other two domains. Teacher ratings of their own strengths and weaknesses were positively related to observation scores for Classroom Organization and unrelated to observation scores for Instructional Support. Conclusions/Recommendations: This study identifies a critical challenge for teacher evaluation policy if it is to improve teaching and learning. Aspects of teaching and learning in the observation protocol that appear most in need of improvement are those that are the hardest for observers to agree on, and teachers and external observers view most differently. Reliability is a marker of common understanding about important constructs and observation protocols are intended to provide a common language and structure to inform teaching practice. This study suggests the need to focus our efforts on the instructional and interactional aspects of classrooms through shared conversations and clear images of what teaching quality looks like.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/016146811411600607

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 6 references

Cited by

See all 114

Metadata

Authors
Gitomer, D., Bell, C., Qi, Y., Mccaffrey, D., Hamre, B. K., & Pianta, R. C.
Venue
Teachers College Record: The Voice of Scholarship in Education
Published
2014-06
Volume
116
Issue
6
Pages
1-32
ISSN
  • 0040-0475 (ISSN-L)
  • 0161-4681
  • 1467-9620
OpenAlex
W2972179150
Cited by
114
References
6
FWCI
32.46
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol. https://app.cochat.ai/papers/10.1177/016146811411600607
The paper
Gitomer, D., Bell, C., Qi, Y., Mccaffrey, D., Hamre, B. K., & Pianta, R. C. (2014). The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol. Teachers College Record: The Voice of Scholarship in Education. https://doi.org/10.1177/016146811411600607

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.