Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.
Abstract
This article reviews research indicating that, under appropriate conditions, students' evaluations of teaching (SETs) are (a) multidimensional; (b) reliable and stable; (c) primarily a function of the instructor who teaches a course rather than the course that is taught; (d) relatively valid against a variety of indicators of effective teaching; (e) relatively unaffected by a variety of variables hypothesized as potential biases (e.g., grading leniency, class size, workload, prior subject interest); and (f) useful in improving teaching effectiveness when SETS are coupled with appropriate consultation. The authors recommend rejecting a narrow criterion-related approach to validity and adopting a broad construct-validation approach, recognizing that effective teaching and SETs that reflect teaching effectiveness are multidimensional; no single criterion of effective teaching is sufficient; and tentative interpretations of relations with validity criteria and potential biases should be evaluated critically in different contexts, in relation to multiple criteria of effective teaching, theory, and existing knowledge.
Cites (42)
- Students’ evaluations of university teaching: research findings, methodological issues, and directions for future research.Marsh, Herbert W. · 1987 · International Journal of Educational Research
- Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility.Herbert W. Marsh · 1984 · Journal of Educational Psychology
- The Relationship Between Research and Teaching: A Meta-AnalysisHattie, John, Marsh, H. W. · 1996 · Review of Educational Research
- Student ratings: The validity of use.Wilbert J. McKeachie · 1997 · American Psychologist
- Grading leniency is a removable contaminant of student ratings.Greenwald, Anthony G., Gillmore, Gerald M. · 1997 · American Psychologist
- Navigating student ratings of instruction.d'Apollonia, Sylvia, Abrami, Philip C. · 1997 · American Psychologist
- Validity concerns and usefulness of student ratings of instruction.Greenwald, Anthony G. · 1997 · American Psychologist
- Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findingsCohen, Peter A. · 1980 · Research in Higher Education
- The Use of Students' Evaluations and an Individually Structured Intervention to Enhance University Teaching EffectivenessMarsh, Herbert W., Roche, Lawrence · 1993 · American Educational Research Journal
- An afterword for ?the association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies?Feldman, Kenneth A. · 1990 · Research in Higher Education
Cited by (20)
- Exploratory Structural Equation Modeling, Integrating CFA and EFA: Application to Students' Evaluations of University TeachingMarsh, Herbert W., Muthén, Bengt, Asparouhov, Tihomir, Lüdtke, Oliver, Robitzsch, Alexander, Morin, Alexandre J. S., Trautwein, Ulrich · 2009 · Structural Equation Modeling: A Multidisciplinary Journal
- On the Validity of Student Evaluation of Teaching: The State of the ArtSpooren, Pieter, Brockx, Bert, Mortelmans, Dimitri · 2013 · Review of Educational Research
- Assessing the impact of learning environments: How to use student ratings of classroom or school characteristics in multilevel modelingLüdtke, Oliver, Robitzsch, Alexander, Trautwein, Ulrich, Kunter, Mareike · 2009 · Contemporary Educational Psychology
- Student evaluations of teaching (mostly) do not measure teaching effectivenessBoring, Anne, Ottoboni, Kellie, Stark, Philip B. · 2016 · ScienceOpen Research
- Increasing the Use of Evidence‐Based Teaching in STEM Higher Education: A Comparison of Eight Change StrategiesBorrego, Maura, Henderson, Charles · 2014 · Journal of Engineering Education
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. https://app.cochat.ai/papers/10.1037//0003-066x.52.11.1187
- The paper
- Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist. https://doi.org/10.1037//0003-066x.52.11.1187
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.