Grading leniency is a removable contaminant of student ratings.
Abstract
It is well established that students' evaluative ratings of instruction correlate positively with expected course grades. The authors identify 4 additional data patterns that, collectively, discriminate among 5 theories of the grades--ratings correlation. The presence of all 4 of these markers in student ratings data (obtained at University of Washington) was most consistent with the theory that the grades--ratings correlation is due to an unwanted influence of instructors' grading leniency on ratings. This conclusion justifies use of a statistical correction--illustrated here with actual ratings data--to remove the unwanted inflation of ratings produced by lenient grading. Additional research can profitably seek other inappropriate influences on ratings to identify more opportunities for validity-enhancing adjustments.
Cites (2)
- Alternative Ways of Assessing Model FitBrowne, Michael W., Cudeck, Robert · 1992 · Sociological Methods & Research
- The totalitarian ego: Fabrication and revision of personal history.Greenwald, Anthony G. · 1980 · American Psychologist
Cited by (14)
- Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.Herbert W. Marsh, Lawrence A. Roche · 1997 · American Psychologist
- Student Evaluations of Teaching: Are They Related to What Students Learn?: A Meta-Analysis and Review of the LiteratureClayson, Dennis E. · 2009 · Journal of Marketing Education
- Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and UsefulnessMarsh, Herbert W · 2007 · The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective
- Identifying Exemplary Teachers and Teaching: Evidence from Student Ratings1Feldman, Kenneth A. · 2007 · The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective
- The validity of student evaluation of teaching in higher education. Love me, love my lectures?Shevlin, Mark, Banyard, Philip, Davies, Mark, Griffiths, Mark · 2000 · Assessment & Evaluation in Higher Education
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Grading leniency is a removable contaminant of student ratings. https://app.cochat.ai/papers/10.1037//0003-066x.52.11.1209
- The paper
- Greenwald, A. G., & Gillmore, G. M. (1997). Grading leniency is a removable contaminant of student ratings. American Psychologist. https://doi.org/10.1037//0003-066x.52.11.1209
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.