Grading leniency is a removable contaminant of student ratings.
Abstract
It is well established that students' evaluative ratings of instruction correlate positively with expected course grades. The authors identify 4 additional data patterns that, collectively, discriminate among 5 theories of the grades--ratings correlation. The presence of all 4 of these markers in student ratings data (obtained at University of Washington) was most consistent with the theory that the grades--ratings correlation is due to an unwanted influence of instructors' grading leniency on ratings. This conclusion justifies use of a statistical correction--illustrated here with actual ratings data--to remove the unwanted inflation of ratings produced by lenient grading. Additional research can profitably seek other inappropriate influences on ratings to identify more opportunities for validity-enhancing adjustments.
Cites (21)
- Alternative Ways of Assessing Model FitBrowne, Michael W., Cudeck, Robert · 1992 · Sociological Methods & Research
- Power analysis and determination of sample size for covariance structure modeling.MacCallum, Robert C., Browne, Michael W., Sugawara, Hazuki M. · 1996 · Psychological Methods
- Testing Structural Equation Models.Clogg, Clifford C., Bollen, Kenneth A., Long, J. Scott · 1995 · Social Forces
- The totalitarian ego: Fabrication and revision of personal history.Greenwald, Anthony G. · 1980 · American Psychologist
- Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility.Herbert W. Marsh · 1984 · Journal of Educational Psychology
- Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.Herbert W. Marsh, Lawrence A. Roche · 1997 · American Psychologist
- Student ratings: The validity of use.Wilbert J. McKeachie · 1997 · American Psychologist
- Navigating student ratings of instruction.d'Apollonia, Sylvia, Abrami, Philip C. · 1997 · American Psychologist
- Validity concerns and usefulness of student ratings of instruction.Greenwald, Anthony G. · 1997 · American Psychologist
- Identifying Exemplary Teachers and Teaching: Evidence from Student Ratings1Feldman, Kenneth A. · 2007 · The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective
Cited by (20)
- Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.Herbert W. Marsh, Lawrence A. Roche · 1997 · American Psychologist
- Instruments for obtaining student feedback: a review of the literatureRichardson, John T. E. · 2005 · Assessment & Evaluation in Higher Education
- Student ratings: The validity of use.Wilbert J. McKeachie · 1997 · American Psychologist
- Navigating student ratings of instruction.d'Apollonia, Sylvia, Abrami, Philip C. · 1997 · American Psychologist
- Student Evaluations of Teaching: Are They Related to What Students Learn?: A Meta-Analysis and Review of the LiteratureClayson, Dennis E. · 2009 · Journal of Marketing Education
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Grading leniency is a removable contaminant of student ratings. https://app.cochat.ai/papers/10.1037//0003-066x.52.11.1209
- The paper
- Greenwald, A. G., & Gillmore, G. M. (1997). Grading leniency is a removable contaminant of student ratings. American Psychologist. https://doi.org/10.1037//0003-066x.52.11.1209
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.