The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Background/Context: Teacher evaluation is a major policy initiative intended to improve the quality of classroom instruction. This study documents a fundamental challenge to using teacher evaluation to improve teaching and learning. Purpose: Using an observation instrument (CLASS-S), we evaluate evidence on different aspects of instructional practice in algebra classrooms to consider how much scores vary, how well observers are able to judge practice, and how well teachers are able to evaluate their own practice. Participants: The study includes 82 Algebra I teachers in middle and high schools. Five observers completed almost all observations. Research Design: Each classroom was observed 4–5 times over the school year. Each observation was coded and scored live and by video. All videos were coded by two independent observers, as were 36% of the live observations. Observers assigned scores to each of 10 dimensions. Observer scores were also compared with master coders for a subset of videos. Participating teachers also completed a self-report instrument (CLASS-T) to assess their own skills on dimensions of CLASS-S. Data Collection and Analysis: For each lesson, data were aggregated into three domain scores, Emotional Support, Classroom Organization, and Instructional Support, and then averaged across lessons to create scores for each classroom. Findings/Results: Classroom Observation scores fell in the high range of the protocol. Scores for Emotional Support were in the midlevel range, and the lowest scores were for Instructional Support. Scores for each domain were clustered in narrow ranges. Observers were more consistent over time and agreed more when judging Classroom Organization than the other two domains. Teacher ratings of their own strengths and weaknesses were positively related to observation scores for Classroom Organization and unrelated to observation scores for Instructional Support. Conclusions/Recommendations: This study identifies a critical challenge for teacher evaluation policy if it is to improve teaching and learning. Aspects of teaching and learning in the observation protocol that appear most in need of improvement are those that are the hardest for observers to agree on, and teachers and external observers view most differently. Reliability is a marker of common understanding about important constructs and observation protocols are intended to provide a common language and structure to inform teaching practice. This study suggests the need to focus our efforts on the instructional and interactional aspects of classrooms through shared conversations and clear images of what teaching quality looks like.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prevalence and development of psychiatric disorders in childhood and adolescence
Costello, E. J., Mustillo, S., Erkanli, A., Keeler, G., & Angold, A. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.8.837 · Cited by 4,035
Blackwell, L. S., Trzesniewski, K. H., & Dweck, C. S. (2007) · Child Development · doi:10.1111/j.1467-8624.2007.00995.x · Cited by 3,784
Conceptualizing Teacher Professional Learning
Opfer, V. D., & Pedder, D. (2011) · Review of Educational Research · doi:10.3102/0034654311413609 · Cited by 1,814
Hamre, B. K., & Pianta, R. C. (2005) · Child Development · doi:10.1111/j.1467-8624.2005.00889.x · Cited by 1,717 · cited 1×
“…a system of research-based observation protocols (preK, K–3, and secondary) developed at the University of Virginia that is designed to measure PK–12 classroom interactions (Hamre & Pianta, 2005; La Paro, Pianta, & Stuhlman, 2004; Pianta et al., 2005; Rimm-Kaufman, La Paro, Downer, & Pianta, 2005).”
BackgroundSelf-citationBack to the Future: Directions for Research in Teaching and Teacher Education
Grossman, P., & McDonald, M. (2008) · American Educational Research Journal · doi:10.3102/0002831207312906 · Cited by 1,164 · cited 2×
“…and education administration, suggest that educators lack common understandings of critical teaching practices as well as the behaviors that instantiate a specific type of practice (e.g., deep reasoning and conceptual understanding; Cohen, 1990; Grossman & McDonald, 2008; Sherin & Han, 2004).”
BackgroundAn Argument Approach to Observation Protocol Validity
Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., & Qi, Y. (2012) · Educational Assessment · doi:10.1080/10627197.2012.715014 · Cited by 236
Self-citation
Cited by
Trends in Classroom Observation Scores
Casabianca, J. M., Lockwood, J. R., & McCaffrey, D. F. (2015) · Educational and Psychological Measurement · doi:10.1177/0013164414539163 · Cited by 105
“This may be indicative of the lack of common understanding of quality instruction among educators noted often in the literature (Gitomer et al., 2014; Goe, Bell, & Little, 2008) and the emphasis of teachers and principals on classroom management which raters observe accurately with less drift and…”
BackgroundSelf-citationRater Performance Standards for Classroom Observation Instruments
White, M. C. (2018) · Educational Researcher · doi:10.3102/0013189x18785623 · Cited by 32
Weston, T. J., Hayward, C. N., & Laursen, S. L. (2021) · American Journal of Evaluation · doi:10.1177/1098214020931941 · Cited by 20
Metadata
- Authors
- Gitomer, D., Bell, C., Qi, Y., Mccaffrey, D., Hamre, B. K., & Pianta, R. C.
- Venue
- Teachers College Record: The Voice of Scholarship in Education
- Publisher
- SAGE Publications
- Published
- 2014-06
- Volume
- 116
- Issue
- 6
- Pages
- 1-32
- ISSN
- 0040-0475 (ISSN-L)
- 0161-4681
- 1467-9620
- OpenAlex
- W2972179150
- Cited by
- 114
- References
- 6
- FWCI
- 32.46
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol. https://app.cochat.ai/papers/10.1177/016146811411600607
- The paper
- Gitomer, D., Bell, C., Qi, Y., Mccaffrey, D., Hamre, B. K., & Pianta, R. C. (2014). The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol. Teachers College Record: The Voice of Scholarship in Education. https://doi.org/10.1177/016146811411600607
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.