Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.
Abstract
This article reviews research indicating that, under appropriate conditions, students' evaluations of teaching (SETs) are (a) multidimensional; (b) reliable and stable; (c) primarily a function of the instructor who teaches a course rather than the course that is taught; (d) relatively valid against a variety of indicators of effective teaching; (e) relatively unaffected by a variety of variables hypothesized as potential biases (e.g., grading leniency, class size, workload, prior subject interest); and (f) useful in improving teaching effectiveness when SETS are coupled with appropriate consultation. The authors recommend rejecting a narrow criterion-related approach to validity and adopting a broad construct-validation approach, recognizing that effective teaching and SETs that reflect teaching effectiveness are multidimensional; no single criterion of effective teaching is sufficient; and tentative interpretations of relations with validity criteria and potential biases should be evaluated critically in different contexts, in relation to multiple criteria of effective teaching, theory, and existing knowledge.
Cites (1)
- Students’ evaluations of university teaching: research findings, methodological issues, and directions for future research.Marsh, Herbert W. · 1987 · International Journal of Educational Research
Cited by (12)
- Exploratory Structural Equation Modeling, Integrating CFA and EFA: Application to Students' Evaluations of University TeachingMarsh, Herbert W., Muthén, Bengt, Asparouhov, Tihomir, Lüdtke, Oliver, Robitzsch, Alexander, Morin, Alexandre J. S., Trautwein, Ulrich · 2009 · Structural Equation Modeling: A Multidisciplinary Journal
- Student evaluations of teaching (mostly) do not measure teaching effectivenessBoring, Anne, Ottoboni, Kellie, Stark, Philip B. · 2016 · ScienceOpen Research
- Increasing the Use of Evidence‐Based Teaching in STEM Higher Education: A Comparison of Eight Change StrategiesBorrego, Maura, Henderson, Charles · 2014 · Journal of Engineering Education
- The validity of student evaluation of teaching in higher education. Love me, love my lectures?Shevlin, Mark, Banyard, Philip, Davies, Mark, Griffiths, Mark · 2000 · Assessment & Evaluation in Higher Education
- An evaluation of course evaluationsStark, Philip B., Freishtat, Richard · 2014 · ScienceOpen Research
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. https://app.cochat.ai/papers/10.1037//0003-066x.52.11.1187
- The paper
- Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist. https://doi.org/10.1037//0003-066x.52.11.1187
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.