The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Student Evaluations of Teaching: Are They Related to What Students Learn?: A Meta-Analysis and Review of the Literature
Abstract
Although the student evaluation of teaching has been extensively researched, no general consensus has been reached about the validity of the process. One contentious issue has been the relationship between the evaluations and learning. If good instruction increases the amount of learning that takes place, then learning and the evaluations should be validly related to each other. A review of the literature shows that attempts to find such a nomological relationship has been complicated by practice, methodology, and interpretation. A meta-analysis of the literature shows that a small average relationship exists between learning and the evaluations but that the association is situational and not applicable to all teachers, academic disciplines, or levels of instruction. It is concluded that the more objectively learning is measured, the less likely it is to be related to the evaluations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2013) · American Economic Review · doi:10.1257/aer.103.5.i · Cited by 15,100
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Cohen, D. (1998) · The Women's Review of Books · doi:10.2307/4022859 · Cited by 4,261
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Peil, M. (1996) · International Journal of Educational Development · doi:10.1016/s0738-0593(97)87238-0 · Cited by 2,709
Marsh, H. W. (1987) · International Journal of Educational Research · doi:10.1016/0883-0355(87)90001-2 · Cited by 1,333 · cited 1×
“There is evidence that the belief alone modifies faculty and student behavior (Birnbaum, 2000; Goldman, 1985; Kolevzon, 1981; Marsh, 1987; Moore & Trahan, 1998; Redding, 1998; Ryan, Anderson, & Birchler, 1980; Simpson & Siguaw, 2000).”
BackgroundMarsh, H. W., & Roche, L. A. (1997) · American Psychologist · doi:10.1037//0003-066x.52.11.1187 · Cited by 882
Cohen, P. A. (1981) · Review of Educational Research · doi:10.3102/00346543051003281 · Cited by 818
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804403 · Cited by 535
Grading leniency is a removable contaminant of student ratings.
Greenwald, A. G., & Gillmore, G. M. (1997) · American Psychologist · doi:10.1037//0003-066x.52.11.1209 · Cited by 519
Educational Administration and Supervision
Secretariat, C. (1981) · Commonwealth Secretariat eBooks · doi:10.14217/9781848593169-en · Cited by 460
Validity concerns and usefulness of student ratings of instruction.
Greenwald, A. G. (1997) · American Psychologist · doi:10.1037//0003-066x.52.11.1182 · Cited by 373
Assessing Faculty Work: Enhancing Individual and Institutional Performance
Dilts, D. A. (1995) · The Journal of Higher Education · doi:10.1080/00221546.1995.11774794 · Cited by 337
Student Rating Myths Versus Research Facts from 1924 to 1998
Aleamoni, L. M. (1999) · Journal of Personnel Evaluation in Education · doi:10.1023/a:1008168421283 · Cited by 331
Marsh, H. W., & Roche, L. A. (2000) · Journal of Educational Psychology · doi:10.1037//0022-0663.92.1.202 · Cited by 309
Student Ratings: Validity, Utility, and Controversy
Kulik, J. A. (2001) · New Directions for Institutional Research · doi:10.1002/ir.1 · Cited by 281
Validity of student ratings of instruction: What we know and what we do not.
Abrami, P. C., d’Apollonia, S., & Cohen, P. A. (1990) · Journal of Educational Psychology · doi:10.1037//0022-0663.82.2.219 · Cited by 277
Will Teachers Receive Higher Student Evaluations by Giving Higher Grades and Less Course Work?
Centra, J. A. (2003) · Research in Higher Education · doi:10.1023/a:1025492407752 · Cited by 266
Grade Inflation: A Crisis in College Education
Perry, R. P., & Johnson, V. E. (2004) · Academe · doi:10.2307/40252602 · Cited by 259
Student Evaluations of Teachers: Students rate most highly instructors from whom they learn least.
Rodin, M., & Rodin, B. (1972) · Science · doi:10.1126/science.177.4055.1164 · Cited by 246
No pain, no gain? The importance of measuring course workload in student ratings of instruction.
Greenwald, A. G., & Gillmore, G. M. (1997) · Journal of Educational Psychology · doi:10.1037//0022-0663.89.4.743 · Cited by 244
Student Evaluations of Teaching: An Exploratory Study of the Faculty Response
Simpson, P. M., & Siguaw, J. A. (2000) · Journal of Marketing Education · doi:10.1177/0273475300223004 · Cited by 235
Theall, M., & Franklin, J. L. (2001) · New Directions for Institutional Research · doi:10.1002/ir.3 · Cited by 217
Student Observations of Outstanding Teaching: Implications for Marketing Educators
Faranda, W. T., & Clarke, I. (2004) · Journal of Marketing Education · doi:10.1177/0273475304268782 · Cited by 199
“How'm I Doing?” Problems with Student Ratings of Instructors and Courses
Williams, W. M., & Ceci, S. J. (1997) · Change: The Magazine of Higher Learning · doi:10.1080/00091389709602331 · Cited by 178
Personality and the Student Evaluation of Teaching
Clayson, D. E., & Sheffet, M. J. (2006) · Journal of Marketing Education · doi:10.1177/0273475306288402 · Cited by 173
Self-citationDeterminants of Student Evaluations of Global Measures of Instructor and Course Value
Marks, R. B. (2000) · Journal of Marketing Education · doi:10.1177/0273475300222005 · Cited by 157
Student Ratings of Instruction and Their Relationship to Student Learning
Centra, J. A. (1977) · American Educational Research Journal · doi:10.3102/00028312014001017 · Cited by 155
Validity of student evaluation of teaching and the characteristics of successful instructors.
Sullivan, A. M., & Skanes, G. R. (1974) · Journal of Educational Psychology · doi:10.1037/h0036929 · Cited by 143
Student Ratings of Teaching: Validity of Several Rating Factors
Frey, P. W. (1973) · Science · doi:10.1126/science.182.4107.83 · Cited by 143
Student Ratings of Instruction: Validation Research
Frey, P. W., Leonard, D. W., & Beatty, W. W. (1975) · American Educational Research Journal · doi:10.3102/00028312012004435 · Cited by 142
The Overconfident Principles of Economics Student: An Examination of a Metacognitive Skill
Grimes, P. W. (2002) · The Journal of Economic Education · doi:10.1080/00220480209596121 · Cited by 140
Correlation between student satisfaction and grades: A case of mistaken causation?
Howard, G. S., & Maxwell, S. E. (1980) · Journal of Educational Psychology · doi:10.1037/0022-0663.72.6.810 · Cited by 130
Student Evaluation of Instructor: A Nomological Investigation Using Structural Equation Modeling
Paswan, A. K., & Young, J. A. (2002) · Journal of Marketing Education · doi:10.1177/0273475302238042 · Cited by 122
A Selective Review of the Validity of Student Ratings of Teaching
Dowell, D. A., & Neal, J. A. (1982) · The Journal of Higher Education · doi:10.1080/00221546.1982.11780424 · Cited by 118
Implementation Problems in Meta-Analysis
Abrami, P. C., Cohen, P. A., & d’Apollonia, S. (1988) · Review of Educational Research · doi:10.3102/00346543058002151 · Cited by 118
Student Ratings as Criteria for Effective Teaching
Doyle, K. O., & Whitely, S. E. (1974) · American Educational Research Journal · doi:10.3102/00028312011003259 · Cited by 111
Student evaluation: The faculty responds
Ryan, J. J., Anderson, J. A., & Birchler, A. B. (1980) · Research in Higher Education · doi:10.1007/bf00976185 · Cited by 110
Student Ratings of Teaching: The Research Revisited. IDEA Paper No. 32.
Cashin, W. E. (1995) · Cited by 107
Are Student Evaluations of Teaching Valid? Evidence From an Analytical Business Core Course
Yunker, P. J., & Yunker, J. A. (2003) · Journal of Education for Business · doi:10.1080/08832320309598619 · Cited by 102
Grades and the Student Evaluation of Instruction: A Test of the Reciprocity Effect
Clayson, D. E., Frost, T. F., & Sheffet, M. J. (2006) · Academy of Management Learning and Education · doi:10.5465/amle.2006.20388384 · Cited by 99
Self-citationPerformance Overconfidence: Metacognitive Effects or Misplaced Student Expectations?
Clayson, D. E. (2005) · Journal of Marketing Education · doi:10.1177/0273475304273525 · Cited by 94
Self-citationGremler, D. D., & McCollough, M. A. (2002) · Journal of Marketing Education · doi:10.1177/027753024002008 · Cited by 93
Attributes of Effective Economics Instructors: An Analysis of Student Evaluations
Boex, L. F. J. (2000) · The Journal of Economic Education · doi:10.1080/00220480009596780 · Cited by 89
Grades, learning, and student evaluation of instruction
Powell, R. W. (1977) · Research in Higher Education · doi:10.1007/bf00991986 · Cited by 80
Current methods for meta-analysis
Schulze, R. (2007) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.215.2.90 · Cited by 79
What Are They Thinking? Students' Expectations and Self-Assessments
Chonko, L. B., Tanner, J. F., & Davis, R. (2002) · Journal of Education for Business · doi:10.1080/08832320209599676 · Cited by 79
Pollio, H. R., & Beck, H. P. (2000) · The Journal of Higher Education · doi:10.1080/00221546.2000.11780817 · Cited by 75
Blissful Ignorance: The Problem of Unrecognized Incompetence and Academic Performance
Kennedy, E. J., Lawton, L., & Plumlee, E. L. (2002) · Journal of Marketing Education · doi:10.1177/0273475302238047 · Cited by 74
Student achievement as a measure of instructor effectiveness.
Morsh, J. E., Burgess, G. G., & Smith, P. N. (1956) · Journal of Educational Psychology · doi:10.1037/h0043123 · Cited by 70
Student Evaluations of University Teaching
Sheehan, E. P., & DuPrey, T. (1999) · Journal of instructional psychology · Cited by 69
Student Ratings and Instructor Self-Ratings and Their Relationship to Student Achievement
Braskamp, L. A., Caulley, D. N., & Costin, F. (1979) · American Educational Research Journal · doi:10.3102/00028312016003295 · Cited by 69
Wilhelm, W. B. (2004) · Journal of Marketing Education · doi:10.1177/0273475303258276 · Cited by 63
Grade Inflation: A Crisis in College Education
Duncan, K. A. (2004) · The American Statistician · doi:10.1198/000313004x775 · Cited by 54
Marsh, H. W., Hau, K., Chung, C.-M., & Siu, T. L. P. (1997) · Journal of Educational Psychology · doi:10.1037/0022-0663.89.3.568 · Cited by 52
Stapleton, R. J., & Murkison, G. (2001) · Organizational Behavior Teaching Review · doi:10.1177/105256290102500302 · Cited by 51
Student ratings of instruction: A function of grading standards.
Chacko, T. I. (1983) · Educational research quarterly · Cited by 47
Academic achievement and self-evaluations of academic performance.
Moreland, R. L., Miller, J. G., & Laucka, F. (1981) · Journal of Educational Psychology · doi:10.1037/0022-0663.73.3.335 · Cited by 47
How Much Do Students Learn in College? Cross-Sectional Estimates Using the College BASE
Flowers, L. A., Osterlind, S. J., Pascarella, E. T., & Pierson, C. T. (2001) · The Journal of Higher Education · doi:10.1080/00221546.2001.11777114 · Cited by 44
Exploring Achievement Striving as a Moderator of the Grading Leniency Effect
Bacon, D. R., & Novotny, J. A. (2002) · Journal of Marketing Education · doi:10.1177/0273475302241002 · Cited by 40
Evaluating Methods for Evaluating Instruction: The Case of Higher Education
Weinberg, B. A., Fleisher, B. M., & Hashimoto, M. (2007) · National Bureau of Economic Research · doi:10.3386/w12844 · Cited by 39
EVALUATING TEACHING: LISTENING TO STUDENTS WHILE ACKNOWLEDGING BIAS
Steiner, S. J., Holley, L. C., Gerdes, K. E., & Campbell, H. E. (2006) · Journal of Social Work Education · doi:10.5175/jswe.2006.200404113 · Cited by 38
Bendig, A. W. (1953) · Educational and Psychological Measurement · doi:10.1177/001316445301300307 · Cited by 37
Using statistical adjustment to reduce biases in student ratings.
Gillmore, G. M., & Greenwald, A. G. (1999) · American Psychologist · doi:10.1037/0003-066x.54.7.518 · Cited by 32
Leniency, learning, and evaluations.
Palmer, J. C., Carliner, G., & Romer, T. (1978) · Journal of Educational Psychology · doi:10.1037//0022-0663.70.5.855 · Cited by 32
Do Student Ratings of College Teachers Predict Student Achievement?
Costin, F. (1978) · Teaching of Psychology · doi:10.1207/s15328023top0502_7 · Cited by 30
Soft Research on a Hard Subject: Student Evaluations Reconsidered
Soper, J. C. (1973) · The Journal of Economic Education · doi:10.1080/00220485.1973.10845377 · Cited by 26
The Impact of Voice and Justification on Students’ Perceptions of Professors’ Fairness
Schmidt, T. A., Houston, M. B., Bettencourt, L. A., & Boughton, P. D. (2003) · Journal of Marketing Education · doi:10.1177/0273475303254024 · Cited by 26
Within‐Class Variability in Student–Teacher Evaluations: Examples and Problems
Clayson, D. E. (2004) · Decision Sciences Journal of Innovative Education · doi:10.1111/j.1540-4609.2005.00055.x · Cited by 24
Self-citationA Test of the Reciprocity Effect in the Student Evaluation of Instructors in Marketing Classes
Clayson, D. E. (2004) · Marketing Education Review · doi:10.1080/10528008.2004.11488863 · Cited by 24
Self-citationOn "Construct validity of measures of college teaching effectiveness."
Gaski, J. F. (1987) · Journal of Educational Psychology · doi:10.1037/0022-0663.79.3.326 · Cited by 20
Marsh, H. W., & Roche, L. A. (1999) · American Psychologist · doi:10.1037/0003-066x.54.7.517 · Cited by 20
On the Measurement of Teacher Effectiveness
Shmanske, S. (1988) · The Journal of Economic Education · doi:10.1080/00220485.1988.10845278 · Cited by 19
Conceptual and Statistical Problems of Using Between-Class Data in Educational Research
Clayson, D. E. (2007) · Journal of Marketing Education · doi:10.1177/0273475306297383 · Cited by 12
Self-citation
Cited by
On the Validity of Student Evaluation of Teaching: The State of the Art
Spooren, P., Brockx, B., & Mortelmans, D. (2013) · Review of Educational Research · doi:10.3102/0034654313496870 · Cited by 665
Uttl, B., White, C. A., & Gonzalez, D. W. (2017) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2016.08.007 · Cited by 615
A meta-analysis of the effects of teacher personality on teacher effectiveness and burnout
Kim, L. E., Jörg, V., & Klassen, R. M. (2019) · Educational Psychology Review · doi:10.1007/s10648-018-9458-2 · Cited by 406
Student evaluations of teaching are an inadequate assessment tool for evaluating faculty performance
Hornstein, H. A. (2017) · Cogent Education · doi:10.1080/2331186x.2017.1304016 · Cited by 307
An evaluation of course evaluations
Stark, P. B., & Freishtat, R. (2014) · ScienceOpen Research · doi:10.14293/s2199-1006.1.sor-edu.aofrqa.v1 · Cited by 220
“Background SET scores are the most common method to evaluate teaching (Cashin, 1999; Clayson, 2009; Davis, 2009; Seldin, 1999).”
Method
Metadata
- Authors
- Clayson, D. E.
- Venue
- Journal of Marketing Education
- Publisher
- SAGE Publications
- Published
- 2008-10-13
- Volume
- 31
- Issue
- 1
- Pages
- 16-30
- ISSN
- 0273-4753 (ISSN-L)
- 1552-6550
- OpenAlex
- W2059105943
- Cited by
- 383
- References
- 74
- FWCI
- 27.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.