Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?
Abstract
Two studies debunk popular myths that student evaluations of teaching (SETs) are substantially biased by low workload and grading leniency. A workload bias is untenable because the workload-SET relation is positive. The small grade-SET relation (.20 for overall ratings) has many well-supported explanations that do not involve bias. Some SET factors (e.g., Organization, Enthusiasm) are unrelated to grades, and the highest relation is with Learning (.30), implying valid teaching effects rather than bias. Structural equation models confirmed that perceived learning and prior characteristics (course level, prior subject interest) account for much of the grade-SET relation. The relation is also nonlinear, so that high grades (sometimes misused as a leniency measure) are unrelated to SETs. Contrary to dire predictions based on bias claims, Workload, expected grades, and their relations with SETs were stable over 12 years.
Cites (44)
- Multiple regression: testing and interpreting interactions1992 · Choice Reviews Online
- Applied Multiple Regression/Correlation Analysis for the Behavioral SciencesCohen, Patricia, Cohen, Patricia, West, Stephen G., Aiken, Leona S. · 2014 · Psychology Press eBooks
- Untitled work1993 · Medical Entomology and Zoology
- Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.Henry, Neil W., Cohen, Jacob, Cohen, Patricia · 1977 · Contemporary Sociology
- Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.Tufte, Edward R., Cohen, Jacob, Cohen, Patricia · 1979 · Journal of the American Statistical Association
- Higher Education: Handbook of Theory and Research2007 · Higher Education: Handbook of Theory and Research
- Advanced Structural Equation Modeling: Issues and TechniquesRigdon, Edward E. · 1998 · Applied Psychological Measurement
- Students’ evaluations of university teaching: research findings, methodological issues, and directions for future research.Marsh, Herbert W. · 1987 · International Journal of Educational Research
- Advanced Structural Equation Modeling2013 · Psychology Press eBooks
- Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility.Herbert W. Marsh · 1984 · Journal of Educational Psychology
Cited by (6)
- Exploratory Structural Equation Modeling, Integrating CFA and EFA: Application to Students' Evaluations of University TeachingMarsh, Herbert W., Muthén, Bengt, Asparouhov, Tihomir, Lüdtke, Oliver, Robitzsch, Alexander, Morin, Alexandre J. S., Trautwein, Ulrich · 2009 · Structural Equation Modeling: A Multidisciplinary Journal
- On the Validity of Student Evaluation of Teaching: The State of the ArtSpooren, Pieter, Brockx, Bert, Mortelmans, Dimitri · 2013 · Review of Educational Research
- Student Evaluations of Teaching: Are They Related to What Students Learn?: A Meta-Analysis and Review of the LiteratureClayson, Dennis E. · 2009 · Journal of Marketing Education
- Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and UsefulnessMarsh, Herbert W · 2007 · The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective
- Are students customers? TQM and marketing perspectivesEagle, Lynne, Brennan, Ross · 2007 · Quality Assurance in Education
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? https://app.cochat.ai/papers/10.1037//0022-0663.92.1.202
- The paper
- Marsh, H. W., & Roche, L. A. (2000). Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology. https://doi.org/10.1037//0022-0663.92.1.202
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.