Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.

Herbert W. Marsh, Lawrence A. Roche·1997·American Psychologist

Abstract

This article reviews research indicating that, under appropriate conditions, students' evaluations of teaching (SETs) are (a) multidimensional; (b) reliable and stable; (c) primarily a function of the instructor who teaches a course rather than the course that is taught; (d) relatively valid against a variety of indicators of effective teaching; (e) relatively unaffected by a variety of variables hypothesized as potential biases (e.g., grading leniency, class size, workload, prior subject interest); and (f) useful in improving teaching effectiveness when SETS are coupled with appropriate consultation. The authors recommend rejecting a narrow criterion-related approach to validity and adopting a broad construct-validation approach, recognizing that effective teaching and SETs that reflect teaching effectiveness are multidimensional; no single criterion of effective teaching is sufficient; and tentative interpretations of relations with validity criteria and potential biases should be evaluated critically in different contexts, in relation to multiple criteria of effective teaching, theory, and existing knowledge.

Cites (42)

  1. Students’ evaluations of university teaching: research findings, methodological issues, and directions for future research.
    Marsh, Herbert W. · 1987 · International Journal of Educational Research
  2. Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility.
    Herbert W. Marsh · 1984 · Journal of Educational Psychology
  3. The Relationship Between Research and Teaching: A Meta-Analysis
    Hattie, John, Marsh, H. W. · 1996 · Review of Educational Research
  4. Student ratings: The validity of use.
    Wilbert J. McKeachie · 1997 · American Psychologist
  5. Grading leniency is a removable contaminant of student ratings.
    Greenwald, Anthony G., Gillmore, Gerald M. · 1997 · American Psychologist
  6. Navigating student ratings of instruction.
    d'Apollonia, Sylvia, Abrami, Philip C. · 1997 · American Psychologist
  7. Validity concerns and usefulness of student ratings of instruction.
    Greenwald, Anthony G. · 1997 · American Psychologist
  8. Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings
    Cohen, Peter A. · 1980 · Research in Higher Education
  9. The Use of Students' Evaluations and an Individually Structured Intervention to Enhance University Teaching Effectiveness
    Marsh, Herbert W., Roche, Lawrence · 1993 · American Educational Research Journal
  10. An afterword for ?the association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies?
    Feldman, Kenneth A. · 1990 · Research in Higher Education

Show all 42 references

Cited by (20)

  1. Exploratory Structural Equation Modeling, Integrating CFA and EFA: Application to Students' Evaluations of University Teaching
    Marsh, Herbert W., Muthén, Bengt, Asparouhov, Tihomir, Lüdtke, Oliver, Robitzsch, Alexander, Morin, Alexandre J. S., Trautwein, Ulrich · 2009 · Structural Equation Modeling: A Multidisciplinary Journal
  2. On the Validity of Student Evaluation of Teaching: The State of the Art
    Spooren, Pieter, Brockx, Bert, Mortelmans, Dimitri · 2013 · Review of Educational Research
  3. Assessing the impact of learning environments: How to use student ratings of classroom or school characteristics in multilevel modeling
    Lüdtke, Oliver, Robitzsch, Alexander, Trautwein, Ulrich, Kunter, Mareike · 2009 · Contemporary Educational Psychology
  4. Student evaluations of teaching (mostly) do not measure teaching effectiveness
    Boring, Anne, Ottoboni, Kellie, Stark, Philip B. · 2016 · ScienceOpen Research
  5. Increasing the Use of Evidence‐Based Teaching in STEM Higher Education: A Comparison of Eight Change Strategies
    Borrego, Maura, Henderson, Charles · 2014 · Journal of Engineering Education

See all 882

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. https://app.cochat.ai/papers/10.1037//0003-066x.52.11.1187
The paper
Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist. https://doi.org/10.1037//0003-066x.52.11.1187

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.