The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies
Abstract
The present study used meta-analytic methodology to synthesize research on the relationship between student ratings of instruction and student achievement. The data for the meta-analysis came from 41 independent validity studies reporting on 68 separate multisection courses relating student ratings to student achievement. The average correlation between an overall instructor rating and student achievement was .43; the average correlation between an overall course rating and student achievement was .47. While large effect sizes were also found for more specific rating dimensions such as Skill and Structure, other dimensions showed more modest relationships with student achievement. A hierarchical multiple regression analysis showed that rating/achievement correlations were larger for full-time faculty when students knew their final grades before rating instructors and when an external evaluator graded students’ achievement tests. The results of the meta-analysis provide strong support for the validity of student ratings as measures of teaching effectiveness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Review of research in education
Shulman, L. S., Mowry, S., & Berliner, D. C. (1973) · F.E. Peacock eBooks · Cited by 7,754
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Henry, N. W., Cohen, J., & Cohen, P. (1977) · Contemporary Sociology · doi:10.2307/2064799 · Cited by 7,089
Self-citationPrimary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Dissertation Abstracts International
(2017) · The SHAFR Guide Online · doi:10.1163/2468-1733_shafr_sim010020122 · Cited by 4,159
(2020) · Journal of Medical Education · doi:10.5812/jme · Cited by 3,490
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
The Handbook of Research on Teaching
Ryans, D. G., & Gage, N. L. (1962) · Journal of Teacher Education · doi:10.1177/002248716201300121 · Cited by 1,959
(1975) · Sociological Bulletin · doi:10.1177/0038022919750111 · Cited by 1,919
The characteristics of subject matter in different academic areas.
Biglan, A. (1973) · Journal of Applied Psychology · doi:10.1037/h0034701 · Cited by 1,766
Experimenter Effects in Behavioral Research
McGuigan, F. J., & Rosenthal, R. (1968) · The American Journal of Psychology · doi:10.2307/1420816 · Cited by 1,621
Experimental and quasi-experimental designs for research on teaching
Campbell, D. T. (1963) · Medical Entomology and Zoology · Cited by 1,541
9: Integrating Findings: The Meta-Analysis of Research
Glass, G. V. (1977) · Review of Research in Education · doi:10.3102/0091732x005001351 · Cited by 832
Gender effects in decoding nonverbal cues.
Hall, J. A. (1978) · Psychological Bulletin · doi:10.1037/0033-2909.85.4.845 · Cited by 766
The External Validity of Experiments
Bracht, G. H., & Glass, G. V. (1968) · American Educational Research Journal · doi:10.2307/1161993 · Cited by 602
Recommendations for APA test standards regarding construct, trait, or discriminant validity.
Campbell, D. T. (1960) · American Psychologist · doi:10.1037/h0048255 · Cited by 560
Proceedings of the 78th Annual Convention of the American Psychological Association: (465412008-001)
(1970) · PsycEXTRA Dataset · doi:10.1037/e465412008-001 · Cited by 518
Meta-Analysis of Research on Class Size and Achievement
Glass, G. V., & Smith, M. L. (1979) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737001001002 · Cited by 517
Effectiveness of Computer-based College Teaching: A Meta-analysis of Findings
Kulik, J. A., Kulik, C.-L. C., & Cohen, P. A. (1980) · Review of Educational Research · doi:10.3102/00346543050004525 · Cited by 517
Self-citationStudent Ratings of College Teaching: Reliability, Validity, and Usefulness
Costin, F., Greenough, W. T., & Menges, R. J. (1971) · Review of Educational Research · doi:10.3102/00346543041005511 · Cited by 506
A classification of institutions of higher education
Boyer, E. L. (1987) · University Microfilms International eBooks · Cited by 457
Cohen, P. A. (1980) · Research in Higher Education · doi:10.1007/bf00976252 · Cited by 372
Self-citationA meta-analysis of outcome studies of Keller's personalized system of instruction.
Kulik, J. A., Kulik, C.-L. C., & Cohen, P. A. (1979) · American Psychologist · doi:10.1037//0003-066x.34.4.307 · Cited by 322
Self-citationDetermining Faculty Effectiveness
Wilson, R., & Centra, J. A. (1981) · The Journal of Higher Education · doi:10.2307/1981044 · Cited by 299
Student Ratings of Faculty: A Reprise
McKeachie, W. J. (1979) · Academe · doi:10.2307/40248725 · Cited by 292
Experimenter Effects in Behavioral Research.
Selvin, H. C., & Rosenthal, R. (1978) · Contemporary Sociology · doi:10.2307/2065929 · Cited by 279
Student Evaluations of Teachers: Students rate most highly instructors from whom they learn least.
Rodin, M., & Rodin, B. (1972) · Science · doi:10.1126/science.177.4055.1164 · Cited by 246
Student Ratings of Instruction
Kulik, J. A., & Kulik, C. C. (1974) · Teaching of Psychology · doi:10.1177/009862837400100201 · Cited by 234
Grades and college students' evaluations of their courses and teachers
Feldman, K. A. (1976) · Research in Higher Education · doi:10.1007/bf00991462 · Cited by 213
Student Ratings of Teacher Effectiveness: Validity Studies
McKeachie, W. J., Lin, Y.-G., & Mann, W. (1971) · American Educational Research Journal · doi:10.3102/00028312008003435 · Cited by 186
Gessner, P. K. (1973) · Science · doi:10.1126/science.180.4086.566 · Cited by 164
7: The Evaluation of Teachers in Higher Education
Kulik, J. A., & McKeachie, W. J. (1975) · Review of Research in Education · doi:10.3102/0091732x003001210 · Cited by 158
Student Ratings of Instruction and Their Relationship to Student Learning
Centra, J. A. (1977) · American Educational Research Journal · doi:10.3102/00028312014001017 · Cited by 155
Student Evaluation of Instruction
Kunz, D., Doyle, K. O., & Gaff, J. G. (1977) · AAUP Bulletin · doi:10.2307/40225060 · Cited by 143
Validity of student evaluation of teaching and the characteristics of successful instructors.
Sullivan, A. M., & Skanes, G. R. (1974) · Journal of Educational Psychology · doi:10.1037/h0036929 · Cited by 143
Student Ratings of Teaching: Validity of Several Rating Factors
Frey, P. W. (1973) · Science · doi:10.1126/science.182.4107.83 · Cited by 143
Student Ratings of Instruction: Validation Research
Frey, P. W., Leonard, D. W., & Beatty, W. W. (1975) · American Educational Research Journal · doi:10.3102/00028312012004435 · Cited by 142
Instructional Technology and College Teaching
Kulik, C. C., Kulik, J. A., & Cohen, P. A. (1980) · Teaching of Psychology · doi:10.1207/s15328023top0704_1 · Cited by 124
Self-citationValidity and usefulness of student evaluations of instructional quality.
Marsh, H. W., Fleiner, H., & Thomas, C. S. (1975) · Journal of Educational Psychology · doi:10.1037/0022-0663.67.6.833 · Cited by 119
Validity of students' evaluations of teaching effectiveness: Cognitive and affective criteria.
Marsh, H. W., & Overall, J. U. (1980) · Journal of Educational Psychology · doi:10.1037/0022-0663.72.4.468 · Cited by 117
Student Ratings as Criteria for Effective Teaching
Doyle, K. O., & Whitely, S. E. (1974) · American Educational Research Journal · doi:10.3102/00028312011003259 · Cited by 111
A meta-analysis of outcome studies of visual-based instruction
Cohen, P. A., Ebeling, B. J., & Kulik, J. A. (1981) · ECTJ · doi:10.1007/bf02765190 · Cited by 110
Self-citationTeacher behavior and student learning.
Solomon, D., Rosenberg, L., & Bezdek, W. E. (1964) · Journal of Educational Psychology · doi:10.1037/h0040516 · Cited by 84
Student achievement as a measure of instructor effectiveness.
Morsh, J. E., Burgess, G. G., & Smith, P. N. (1956) · Journal of Educational Psychology · doi:10.1037/h0043123 · Cited by 70
Student Ratings and Instructor Self-Ratings and Their Relationship to Student Achievement
Braskamp, L. A., Caulley, D. N., & Costin, F. (1979) · American Educational Research Journal · doi:10.3102/00028312016003295 · Cited by 69
Student, peer, and self evaluations of college instructors.
Doyle, K. O., & Crichton, L. I. (1978) · Journal of Educational Psychology · doi:10.1037/0022-0663.70.5.815 · Cited by 69
Research on audio-tutorial instruction: A meta-analysis of comparative studies
Kulik, J. A., Kulik, C. C., & Cohen, P. A. (1979) · Research in Higher Education · doi:10.1007/bf00975623 · Cited by 68
Self-citationEffectiveness of Programmed Instruction in Higher Education: A Meta-analysis of Findings
Kulik, J. A., Cohen, P. A., & Ebeling, B. J. (1980) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737002006051 · Cited by 66
Self-citationValidity of Student Instructional Ratings: Does Timing Matter?
Frey, P. W. (1976) · The Journal of Higher Education · doi:10.1080/00221546.1976.11774047 · Cited by 61
The Student as Consumer of the Teaching Process
Grush, J. E., & Costin, F. (1975) · American Educational Research Journal · doi:10.3102/00028312012001055 · Cited by 41
Bendig, A. W. (1953) · Educational and Psychological Measurement · doi:10.1177/001316445301300307 · Cited by 37
Leventhal, L., Abrami, P. C., Perry, R. P., & Breen, L. J. (1975) · Educational and Psychological Measurement · doi:10.1177/001316447503500415 · Cited by 36
Evaluating the Teaching of Introductory Psychology
Ellis, N. R., & Rickard, H. C. (1977) · Teaching of Psychology · doi:10.1207/s15328023top0403_6 · Cited by 34
Bendig, A. W. (1953) · The Journal of Psychology · doi:10.1080/00223980.1953.9712910 · Cited by 31
Do Student Ratings of College Teachers Predict Student Achievement?
Costin, F. (1978) · Teaching of Psychology · doi:10.1207/s15328023top0502_7 · Cited by 30
Long-term predictive validity of the Scholastic Aptitude Test.
Mauger, P. A., & Kolmodin, C. A. (1975) · Journal of Educational Psychology · doi:10.1037//0022-0663.67.6.847 · Cited by 30
Validity and generalizability of student ratings from between-classes and within-class data.
Whitely, S. E., & Doyle, K. O. (1979) · Journal of Educational Psychology · doi:10.1037/0022-0663.71.1.117 · Cited by 28
Variables Affecting University Student Ratings of Instructor Behavior
Hoffman, R. G. (1978) · American Educational Research Journal · doi:10.3102/00028312015002287 · Cited by 28
Greenwood, G. E., Hazelton, A., Smith, A. B., & Ware, W. B. (1976) · Research in Higher Education · doi:10.1007/bf00992010 · Cited by 21
Teacher Evaluations and Student Learning: A Reexamination
Bryson, R. (1974) · The Journal of Educational Research · doi:10.1080/00220671.1974.10884692 · Cited by 21
COMPARISON BETWEEN A PERFORMANCE TEST AND CRITERIA OF INSTRUCTOR EFFECTIVENESS
Borg, W. R., & Hamilton, E. R. (1956) · Psychological Reports · doi:10.2466/pr0.1956.2.3.111 · Cited by 18
Ratings of Instruction, Examination Performance, and Subsequent Enrollment in Psychology Courses
Bolton, B., Bonge, D. R., & Marr, J. N. (1979) · Teaching of Psychology · doi:10.1207/s15328023top0602_6 · Cited by 16
A Meta-Analysis of the Relationship Between Student Ratings of Instruction and Student Achievement.
Cohen, P. A. (1980) · Deep Blue (University of Michigan) · Cited by 16
Self-citationA Validation Study of Course Evaluation Ratings
Endo, G. T., & Della‐Piana, G. M. (1976) · Improving College and University Teaching · doi:10.1080/00193089.1976.9927302 · Cited by 15
Relationships Between College Student Ratings of Instructors and Residual Learning.
Turner, R. L., & Thompson, R. P. (1973) · Cited by 11
Verbal Behavior of College Instructors and Attendant Effect Upon Student Attitudes and Achievement.
Sorge, D. H., & Kline, C. E. (1973) · College student journal · Cited by 6
Cited by
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Marsh, H. W. (1987) · International Journal of Educational Research · doi:10.1016/0883-0355(87)90001-2 · Cited by 1,333
Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. S., & Trautwein, U. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903008220 · Cited by 1,093
Marsh, H. W. (1984) · Journal of Educational Psychology · doi:10.1037//0022-0663.76.5.707 · Cited by 1,016
Ambady, N., & Rosenthal, R. (1993) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.64.3.431 · Cited by 1,004
Metadata
- Authors
- Cohen, P. A.
- Venue
- Review of Educational Research
- Published
- 1981-09
- Volume
- 51
- Issue
- 3
- Pages
- 281-309
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2127136536
- Cited by
- 818
- References
- 67
- FWCI
- 16.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.