Effect of Observation Mode on Measures of Secondary Mathematics Teaching
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Classroom observation of teachers is a significant part of educational measurement; measurements of teacher practice are being used in teacher evaluation systems across the country. This research investigated whether observations made live in the classroom and from video recording of the same lessons yielded similar inferences about teaching. Using scores on the Classroom Assessment Scoring System–Secondary (CLASS-S) from 82 algebra classrooms, we explored the effect of observation mode on inferences about the level or ranking of teaching in a single lesson or in a classroom for a year. We estimated the correlation between scores from the two observation modes and tested for mode differences in the distribution of scores, the sources of variance in scores, and the reliability of scores using generalizability and decision studies for the latter comparisons. Inferences about teaching in a classroom for a year were relatively insensitive to observation mode. However, time trends in the raters’ use of the score scale were significant for two CLASS-S domains, leading to mode differences in the reliability and inferences drawn from individual lessons. Implications for different modes of classroom observation with the CLASS-S are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Agresti, A. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/0471249688 · Cited by 6,746
Hamre, B. K., & Pianta, R. C. (2005) · Child Development · doi:10.1111/j.1467-8624.2005.00889.x · Cited by 1,717 · cited 1×
“…Pianta, Gregory, Mikami, & Lun, 2011; Bill and Melinda Gates Foundation, 2012; Burchinal et al., 2009; Hafen et al., 2012; Howes et al., 2008; Mashburn et al., 2008) and supports the proposed domain structure in empirical studies (e.g., Hamre & Pianta, 2005; La Paro, Pianta, & Stuhlman, 2004).”
BackgroundSelf-citationClassroom emotional climate, student engagement, and academic achievement.
Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012) · Journal of Educational Psychology · doi:10.1037/a0027268 · Cited by 1,229
Brennan, R. L. (2001) · doi:10.1007/978-1-4757-3456-0 · Cited by 1,121
Hill, H. C., Charalambous, C. Y., & Kraft, M. A. (2012) · Educational Researcher · doi:10.3102/0013189x12437203 · Cited by 331
An Argument Approach to Observation Protocol Validity
Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., & Qi, Y. (2012) · Educational Assessment · doi:10.1080/10627197.2012.715014 · Cited by 236
Self-citationAn Examination of Rater Drift Within a Generalizability Theory Framework
Harik, P., Clauser, B. E., Grabovsky, I., Nungester, R. J., Swanson, D., & Nandakumar, R. (2009) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2009.01068.x · Cited by 59
Cited by
An Argument Approach to Observation Protocol Validity
Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., & Qi, Y. (2012) · Educational Assessment · doi:10.1080/10627197.2012.715014 · Cited by 236
Self-citationTrends in Classroom Observation Scores
Casabianca, J. M., Lockwood, J. R., & McCaffrey, D. F. (2015) · Educational and Psychological Measurement · doi:10.1177/0013164414539163 · Cited by 105
“Given the small size of this study, we aimed to replicate and expand the work of Casabianca et al. (2013) by studying how classroom observation scores vary as a function of both the day on which lessons occurred and the day on which scoring of video recordings of those lessons occurred using data…”
BackgroundMethodResultInfluentialSelf-citationMaking Inferences About Teacher Observation Scores Over Time
Briggs, D. C., & Alzen, J. L. (2019) · Educational and Psychological Measurement · doi:10.1177/0013164419826237 · Cited by 14
Charalambous, C. Y., Kyriakides, E., Tsangaridou, N., & Kyriakides, L. (2017) · School Effectiveness and School Improvement · doi:10.1080/09243453.2017.1311929 · Cited by 11
Metadata
- Authors
- Casabianca, J. M., McCaffrey, D. F., Gitomer, D. H., Bell, C. A., Hamre, B. K., & Pianta, R. C.
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 2013-04-30
- Volume
- 73
- Issue
- 5
- Pages
- 757-783
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- OpenAlex
- W2000374318
- Cited by
- 80
- References
- 7
- FWCI
- 30.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effect of Observation Mode on Measures of Secondary Mathematics Teaching. https://app.cochat.ai/papers/10.1177/0013164413486987
- The paper
- Casabianca, J. M., McCaffrey, D. F., Gitomer, D. H., Bell, C. A., Hamre, B. K., & Pianta, R. C. (2013). Effect of Observation Mode on Measures of Secondary Mathematics Teaching. Educational and Psychological Measurement. https://doi.org/10.1177/0013164413486987
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.