Grading leniency is a removable contaminant of student ratings.

Greenwald, Anthony G., Gillmore, Gerald M.·1997·American Psychologist

Abstract

It is well established that students' evaluative ratings of instruction correlate positively with expected course grades. The authors identify 4 additional data patterns that, collectively, discriminate among 5 theories of the grades--ratings correlation. The presence of all 4 of these markers in student ratings data (obtained at University of Washington) was most consistent with the theory that the grades--ratings correlation is due to an unwanted influence of instructors' grading leniency on ratings. This conclusion justifies use of a statistical correction--illustrated here with actual ratings data--to remove the unwanted inflation of ratings produced by lenient grading. Additional research can profitably seek other inappropriate influences on ratings to identify more opportunities for validity-enhancing adjustments.

Cites (21)

  1. Alternative Ways of Assessing Model Fit
    Browne, Michael W., Cudeck, Robert · 1992 · Sociological Methods & Research
  2. Power analysis and determination of sample size for covariance structure modeling.
    MacCallum, Robert C., Browne, Michael W., Sugawara, Hazuki M. · 1996 · Psychological Methods
  3. Testing Structural Equation Models.
    Clogg, Clifford C., Bollen, Kenneth A., Long, J. Scott · 1995 · Social Forces
  4. The totalitarian ego: Fabrication and revision of personal history.
    Greenwald, Anthony G. · 1980 · American Psychologist
  5. Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility.
    Herbert W. Marsh · 1984 · Journal of Educational Psychology
  6. Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.
    Herbert W. Marsh, Lawrence A. Roche · 1997 · American Psychologist
  7. Student ratings: The validity of use.
    Wilbert J. McKeachie · 1997 · American Psychologist
  8. Navigating student ratings of instruction.
    d'Apollonia, Sylvia, Abrami, Philip C. · 1997 · American Psychologist
  9. Validity concerns and usefulness of student ratings of instruction.
    Greenwald, Anthony G. · 1997 · American Psychologist
  10. Identifying Exemplary Teachers and Teaching: Evidence from Student Ratings1
    Feldman, Kenneth A. · 2007 · The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective

Show all 21 references

Cited by (20)

  1. Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility.
    Herbert W. Marsh, Lawrence A. Roche · 1997 · American Psychologist
  2. Instruments for obtaining student feedback: a review of the literature
    Richardson, John T. E. · 2005 · Assessment & Evaluation in Higher Education
  3. Student ratings: The validity of use.
    Wilbert J. McKeachie · 1997 · American Psychologist
  4. Navigating student ratings of instruction.
    d'Apollonia, Sylvia, Abrami, Philip C. · 1997 · American Psychologist
  5. Student Evaluations of Teaching: Are They Related to What Students Learn?: A Meta-Analysis and Review of the Literature
    Clayson, Dennis E. · 2009 · Journal of Marketing Education

See all 519

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Grading leniency is a removable contaminant of student ratings. https://app.cochat.ai/papers/10.1037//0003-066x.52.11.1209
The paper
Greenwald, A. G., & Gillmore, G. M. (1997). Grading leniency is a removable contaminant of student ratings. American Psychologist. https://doi.org/10.1037//0003-066x.52.11.1209

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.