The Best of Both Worlds: Building on the COPUS and RTOP Observation Protocols to Easily and Reliably Measure Various Levels of Reformed Instructional Practice
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in science, technology, engineering, and mathematics (STEM) courses at the college level. Specifically, there is keen interest in comparing instructional practices between courses, monitoring changes over time, and mapping observed practices to research-based teaching. While increasingly common observation protocols (Reformed Teaching Observation Protocol [RTOP] and Classroom Observation Protocol in Undergraduate STEM [COPUS]) at the postsecondary level help achieve some of these goals, they also suffer from weaknesses that limit their applicability. In this study, we leverage the strengths of these protocols to provide an easy method that enables the reliable and valid characterization of instructional practices. This method was developed empirically via a cluster analysis using observations of 269 individual class periods, corresponding to 73 different faculty members, 28 different research-intensive institutions, and various STEM disciplines. Ten clusters, called COPUS profiles, emerged from this analysis; they represent the most common types of instructional practices enacted in the classrooms observed for this study. RTOP scores were used to validate the alignment of the 10 COPUS profiles with reformed teaching. Herein, we present a detailed description of the cluster analysis method, the COPUS profiles, and the distribution of the COPUS profiles across various STEM courses at research-intensive universities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peer Instruction: Ten years of experience and results
Crouch, C. H., & Mazur, E. (2001) · American Journal of Physics · doi:10.1119/1.1374249 · Cited by 2,682 · cited 2×
“PI is a particular instructional strategy that prompts students to think and answer conceptual questions individually; this is followed by a discussion of their answers with their peers and an opportunity to provide their final answers back to the instructor (Mazur, 1997; Crouch and Mazur, 2001; Vickrey et al., 2015).”
BackgroundSawada, D., Piburn, M. D., Judson, E., Turley, J., Falconer, K., Benford, R., & Bloom, I. (2002) · School Science and Mathematics · doi:10.1111/j.1949-8594.2002.tb17883.x · Cited by 564 · cited 6×
“The RTOP is an instrument that is grounded in the literature on inquiry-based teaching (Piburn et al., 2000; Sawada et al., 2002).”
BackgroundMethodInfluentialHenderson, C., & Dancy, M. H. (2007) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.3.020102 · Cited by 541
What We Say Is Not What We Do: Effective Evaluation of Faculty Professional Development Programs
Ebert-May, D., Derting, T. L., Hodder, J., Momsen, J. L., Long, T. M., & Jardeleza, S. E. (2011) · BioScience · doi:10.1525/bio.2011.61.7.9 · Cited by 420 · cited 3×
“This level of interrater reliability is above the one achieved in other studies using intraclass correlation coefficients (Ebert-May et al., 2011).”
BackgroundResultNovak, G. M., Patterson, E. T., Gavrin, A. D., Christian, W., & Forinash, K. (1999) · American Journal of Physics · doi:10.1119/1.19159 · Cited by 384
Pedagogical practices and instructional change of physics faculty
Dancy, M., & Henderson, C. (2010) · American Journal of Physics · doi:10.1119/1.3446763 · Cited by 297 · cited 2×
“This is consistent with results from prior studies published in physics and geosciences, which found that more experienced faculty members are in general interested in implementing evidence-based instructional strategies and achieve higher RTOP scores (Dancy and Henderson, 2010; Budd et al., 2013).”
Result
Cited by
Anatomy of STEM teaching in North American universities
Stains, M., Harshman, J., Barker, M. K., Chasteen, S. V., Cole, R., DeChenne-Peters, S. E., Eagan, M. K., Esson, J. M., Knight, J. K., Laski, F. A., et al. (2018) · Science · doi:10.1126/science.aap8892 · Cited by 772
Self-citationNadile, E. M., Alfonso, E., Barreiros, B. M., Bevan-Thomas, W. D., Brownell, S. E., Chin, M. R., Ferreira, I., Ford, S. A., Gin, L. E., Gomez-Rosado, J. O., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0243731 · Cited by 46
Weston, T. J., Hayward, C. N., & Laursen, S. L. (2021) · American Journal of Evaluation · doi:10.1177/1098214020931941 · Cited by 20
Metadata
- Authors
- Lund, T. J., Pilarz, M., Velasco, J. B., Chakraverty, D., Rosploch, K., Undersander, M., & Stains, M.
- Venue
- CBE—Life Sciences Education
- Published
- 2015-06
- Volume
- 14
- Issue
- 2
- Pages
- ar18
- ISSN
- 1931-7913 (ISSN-L)
- OpenAlex
- W2208011556
- Cited by
- 132
- References
- 6
- FWCI
- 66.12
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Best of Both Worlds: Building on the COPUS and RTOP Observation Protocols to Easily and Reliably Measure Various Levels of Reformed Instructional Practice. https://app.cochat.ai/papers/10.1187/cbe.14-10-0168
- The paper
- Lund, T. J., Pilarz, M., Velasco, J. B., Chakraverty, D., Rosploch, K., Undersander, M., & Stains, M. (2015). The Best of Both Worlds: Building on the COPUS and RTOP Observation Protocols to Easily and Reliably Measure Various Levels of Reformed Instructional Practice. CBE—Life Sciences Education. https://doi.org/10.1187/cbe.14-10-0168
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.