Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?

Herbert W. Marsh, Lawrence A. Roche·2000·Journal of Educational Psychology

Abstract

Two studies debunk popular myths that student evaluations of teaching (SETs) are substantially biased by low workload and grading leniency. A workload bias is untenable because the workload-SET relation is positive. The small grade-SET relation (.20 for overall ratings) has many well-supported explanations that do not involve bias. Some SET factors (e.g., Organization, Enthusiasm) are unrelated to grades, and the highest relation is with Learning (.30), implying valid teaching effects rather than bias. Structural equation models confirmed that perceived learning and prior characteristics (course level, prior subject interest) account for much of the grade-SET relation. The relation is also nonlinear, so that high grades (sometimes misused as a leniency measure) are unrelated to SETs. Contrary to dire predictions based on bias claims, Workload, expected grades, and their relations with SETs were stable over 12 years.

Cites (44)

  1. Multiple regression: testing and interpreting interactions
    1992 · Choice Reviews Online
  2. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
    Cohen, Patricia, Cohen, Patricia, West, Stephen G., Aiken, Leona S. · 2014 · Psychology Press eBooks
  3. Untitled work
    1993 · Medical Entomology and Zoology
  4. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
    Henry, Neil W., Cohen, Jacob, Cohen, Patricia · 1977 · Contemporary Sociology
  5. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
    Tufte, Edward R., Cohen, Jacob, Cohen, Patricia · 1979 · Journal of the American Statistical Association
  6. Higher Education: Handbook of Theory and Research
    2007 · Higher Education: Handbook of Theory and Research
  7. Advanced Structural Equation Modeling: Issues and Techniques
    Rigdon, Edward E. · 1998 · Applied Psychological Measurement
  8. Students’ evaluations of university teaching: research findings, methodological issues, and directions for future research.
    Marsh, Herbert W. · 1987 · International Journal of Educational Research
  9. Advanced Structural Equation Modeling
    2013 · Psychology Press eBooks
  10. Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility.
    Herbert W. Marsh · 1984 · Journal of Educational Psychology

Show all 44 references

Cited by (6)

  1. Exploratory Structural Equation Modeling, Integrating CFA and EFA: Application to Students' Evaluations of University Teaching
    Marsh, Herbert W., Muthén, Bengt, Asparouhov, Tihomir, Lüdtke, Oliver, Robitzsch, Alexander, Morin, Alexandre J. S., Trautwein, Ulrich · 2009 · Structural Equation Modeling: A Multidisciplinary Journal
  2. On the Validity of Student Evaluation of Teaching: The State of the Art
    Spooren, Pieter, Brockx, Bert, Mortelmans, Dimitri · 2013 · Review of Educational Research
  3. Student Evaluations of Teaching: Are They Related to What Students Learn?: A Meta-Analysis and Review of the Literature
    Clayson, Dennis E. · 2009 · Journal of Marketing Education
  4. Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness
    Marsh, Herbert W · 2007 · The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective
  5. Are students customers? TQM and marketing perspectives
    Eagle, Lynne, Brennan, Ross · 2007 · Quality Assurance in Education

See all 309

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? https://app.cochat.ai/papers/10.1037//0022-0663.92.1.202
The paper
Marsh, H. W., & Roche, L. A. (2000). Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology. https://doi.org/10.1037//0022-0663.92.1.202

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.