The use of scoring rubrics: Reliability, validity and educational consequences
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Sharing rubrics with students can enhance learning by allowing for feedback and self-assessment.
“Sharing the rubrics with students can have the added benefit of enhancing learning by allowing for feedback and self-assessment (Jonsson and Svingby, 2007; Reddy and Andrade, 2010).”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Jonsson and Svingby, 2007
Designing and using rubrics to grade assignments or tests can reduce inconsistencies and make grading written work more objective.
“Designing and using rubrics to grade assignments or tests can reduce inconsistencies and make grading written work more objective.”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Jonsson and Svingby, 2007
Sharing grading rubrics with students can support them in identifying where their thinking has gone wrong and promote learning (Jonsson and Svingby, 2007; Reddy and Andrade, 2010).
“Perhaps most importantly, sharing grading rubrics with students can support them in identifying where their thinking has gone wrong and promote learning (Jonsson and Svingby, 2007; Reddy and Andrade, 2010).”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Jonsson and Svingby, 2007
Cites
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,733 · see citing works
Educational Research: Fundamentals for the Consumer
McMillan, J. H. (1991) · Cited by 1,265 · see citing works
The use of self-, peer and co-assessment in higher education: A review
Dochy, F., Segers, M., & Sluijsmans, D. (1999) · Studies in Higher Education · doi:10.1080/03075079912331379935 · Cited by 1,206 · see citing works
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170 · see citing works
Stemler, S. E. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/96jp-xz07 · Cited by 1,025 · see citing works
Assessing Student Learning in Higher Education
Brown, G. A., Bull, J., & Pendlebury, M. (2013) · Routledge eBooks · doi:10.4324/9781315004914 · Cited by 931 · see citing works
Student Self-Assessment in Higher Education: A Meta-Analysis
Falchikov, N., & Boud, D. J. (1989) · Review of Educational Research · doi:10.3102/00346543059004395 · Cited by 782 · see citing works
Authentic assessment of teaching in context
Darling-Hammond, L., & Snyder, J. (2000) · Teaching and Teacher Education · doi:10.1016/s0742-051x(00)00015-9 · Cited by 715 · see citing works
A Systems Approach to Educational Testing
Frederiksen, J. R., & Collins, A. (1989) · Educational Researcher · doi:10.3102/0013189x018009027 · Cited by 607 · see citing works
The Impact of Self- and Peer-Grading on Student Learning
Sadler, P., & Good, E. (2006) · Educational Assessment · doi:10.1207/s15326977ea1101_1 · Cited by 535 · cited 3× · see citing works
“The study by Sadler and Good (2006) puts the presumed benefits of peer-grading to the test.”
BackgroundScoring Rubric Development: Validity and Reliability
Moskal, B., & Leydens, J. A. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/q7rm-gg74 · Cited by 502 · see citing works
Reflection as a visible outcome for preservice teachers
Ward, J. R., & McCotter, S. S. (2004) · Teaching and Teacher Education · doi:10.1016/j.tate.2004.02.004 · Cited by 424 · see citing works
Validation of the Fresno test of competence in evidence based medicine
Ramos, K., Schafer, S., & Tracz, S. M. (2003) · BMJ · doi:10.1136/bmj.326.7384.319 · Cited by 391 · see citing works
Self and Peer Assessment in School and University: Reliability, Validity and Utility
Topping, K. J. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-306-48125-1_4 · Cited by 366 · see citing works
Cho, K., Schunn, C. D., & Wilson, R. W. (2006) · Journal of Educational Psychology · doi:10.1037/0022-0663.98.4.891 · Cited by 355 · see citing works
Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.06.001 · Cited by 328 · see citing works
The Importance of Marking Criteria in the Use of Peer Assessment
Orsmond, P., Merry, S. P., & Reiling, K. (1996) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293960210304 · Cited by 287 · see citing works
Design and Use of a Rubric to Assess and Encourage Interactive Qualities in Distance Courses
Roblyer, M. D., & Wiencke, W. R. (2003) · American Journal of Distance Education · doi:10.1207/s15389286ajde1702_2 · Cited by 279 · see citing works
Alternatives in Assessment of Achievements, Learning Processes and Prior Knowledge
(1996) · Springer eBooks · doi:10.1007/978-94-011-0657-3 · Cited by 278 · see citing works
Hafner, J., & Hafner, P. (2003) · International Journal of Science Education · doi:10.1080/0950069022000038268 · Cited by 258 · see citing works
Dunbar, N. E., Brooks, C., & Kubicka-Miller, T. (2006) · Innovative Higher Education · doi:10.1007/s10755-006-9012-x · Cited by 223 · see citing works
Toth, E. E., Suthers, D. D., & Lesgold, A. M. (2002) · Science Education · doi:10.1002/sce.10004 · Cited by 205 · see citing works
Concept maps as assessment in science inquiry learning - a report of methodology
Stoddart, T., Abrams, R., Gasper, E., & Canaday, D. (2000) · International Journal of Science Education · doi:10.1080/095006900750036235 · Cited by 204 · see citing works
A learning Integrated Assessment System
Birenbaum, M., Breuer, K., Cascallar, E. C., Dochy, F. J. R. C., Dori, Y. J., Ridgway, J., Wiesemes, R., & Nickmans, G. (2006) · Educational Research Review · doi:10.1016/j.edurev.2006.01.001 · Cited by 201 · see citing works
The wheel of competency assessment: Presenting quality criteria for competency assessment programs
Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2006) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2006.04.006 · Cited by 192 · see citing works
A New Method for Assessing Critical Thinking in the Classroom
Bissell, A. N., & Lemons, P. P. (2006) · BioScience · doi:10.1641/0006-3568(2006)056[0066:anmfac]2.0.co;2 · Cited by 191 · see citing works
Prozesky, D. R. (2001) · PubMed · Cited by 177 · see citing works
Paying for high- and low-quality teaching
Schacter, J., & Thum, Y. M. (2004) · Economics of Education Review · doi:10.1016/j.econedurev.2003.08.002 · Cited by 174 · see citing works
Weigle, S. C. (1999) · Assessing Writing · doi:10.1016/s1075-2935(00)00010-6 · Cited by 157 · see citing works
Brown, G., Glasswell, K., & Harland, D. (2004) · Assessing Writing · doi:10.1016/j.asw.2004.07.001 · Cited by 155 · see citing works
Generalizability of Performance Assessments
Brennan, R. L., & Johnson, E. G. (1995) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1995.tb00882.x · Cited by 130 · see citing works
Gielen, S., Dochy, F. J. R. C., & Dierick, S. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-306-48125-1_3 · Cited by 120 · see citing works
Self-, peer- and teacher-assessment of student essays
Lindblom‐Ylänne, S., Pihlajamäki, H., & Kotkas, T. (2006) · Active Learning in Higher Education · doi:10.1177/1469787406061148 · Cited by 117 · see citing works
Technical Issues in Large-Scale Performance Assessment.
Phillips, G. W. (1996) · Cited by 110 · see citing works
Johnson, R. L., Penny, J., & Gordon, B. (2000) · Applied Measurement in Education · doi:10.1207/s15324818ame1302_1 · Cited by 93 · see citing works
Scoring Rubrics in the Classroom
McTighe, J., & Arter, J. A. (2000) · Cited by 86 · see citing works
Mabry, L. (1999) · Phi Delta Kappan · Cited by 84 · see citing works
Instructional Psychology: Past, present and future trends
Entwistle, N. J., McCune, V., & Scheja, M. (2006) · Cited by 79 · see citing works
Writing assessment: Raters' elaboration of the rating task
DeRemer, M. (1998) · Assessing Writing · doi:10.1016/s1075-2935(99)80003-8 · Cited by 75 · see citing works
Student Self-Assessment: At the Intersection of Metacognition and Authentic Assessment.
Andrade, H. G. (1999) · Cited by 71 · see citing works
Green, R., & Bowser, M. (2006) · Journal of Library Administration · doi:10.1300/j111v45n01_10 · Cited by 70 · see citing works
de Watering, G. V., & van der Rijt, J. (2006) · Educational Research Review · doi:10.1016/j.edurev.2006.05.001 · Cited by 70 · see citing works
Schamber, J. F., & Mahoney, S. L. (2006) · The Journal of General Education · doi:10.1353/jge.2006.0025 · Cited by 70 · see citing works
The effect of rating augmentation on inter-rater reliability
Penny, J., Johnson, R. L., & Gordon, B. (2000) · Assessing Writing · doi:10.1016/s1075-2935(00)00012-x · Cited by 67 · see citing works
Effects of Teacher Knowledge of Rubrics on Student Achievement in Four Content Areas
Schafer, W. D., Swanson, G., Bené, N. H., & Newberry, G. (2001) · Applied Measurement in Education · doi:10.1207/s15324818ame1402_3 · Cited by 66 · see citing works
A rubric for scoring postsecondary academic skills
Simon, M., & Forgette-Giroux, R. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/bh4d-me80 · Cited by 65 · see citing works
Scenario assignments as assessment tools for undergraduate engineering education
McMartin, F. P., McKenna, A. F., & Youssefi, K. (2000) · IEEE Transactions on Education · doi:10.1109/13.848061 · Cited by 63 · see citing works
Rubrics: Design and Use in Science Teacher Education
Luft, J. A. (1999) · Journal of Science Teacher Education · doi:10.1023/a:1009471931127 · Cited by 61 · see citing works
Score Resolution and the Interrater Reliability of Holistic Scores in Rating Essays
Johnson, R. L., Penny, J., & Gordon, B. (2001) · Written Communication · doi:10.1177/0741088301018002003 · Cited by 52 · see citing works
A Comparison of Selected Methods of Scoring Classroom Assessments
Marzano, R. J. (2002) · Applied Measurement in Education · doi:10.1207/s15324818ame1503_2 · Cited by 50 · see citing works
Osana, H. P., & Seymour, J. R. (2004) · Educational Research and Evaluation · doi:10.1080/13803610512331383529 · Cited by 48 · see citing works
Janice Stuhlmann, C. D. (1999) · Reading Psychology · doi:10.1080/027027199278439 · Cited by 45 · see citing works
Boston, M. D., & Wolf, M. K. (2006) · National Center for Research on Evaluation, Standards, and Student Testing · Cited by 44 · see citing works
Dimensionality and Generalizability of Domain-Independent Performance Assessments
Baker, E. L., Abedi, J., Linn, R. L., & Niemi, D. (1996) · The Journal of Educational Research · doi:10.1080/00220671.1996.9941205 · Cited by 42 · see citing works
Using Rating Augmentation to Expand the Scale of an Analytic Rubric
Penny, J., Johnson, R. L., & Gordon, B. (2000) · The Journal of Experimental Education · doi:10.1080/00220970009600096 · Cited by 39 · see citing works
Choinski, E., Mark, A. E., & Murphey, M. (2003) · portal Libraries and the Academy · doi:10.1353/pla.2003.0078 · Cited by 39 · see citing works
Boston, M. D., & Wolf, M. K. (2006) · PsycEXTRA Dataset · doi:10.1037/e644922011-001 · Cited by 39 · see citing works
On the Content Validity of Performance Assessments: Centrality of Domain Specification
Shavelson, R. J., Gao, X. W., & Baxter, G. P. (1996) · Springer eBooks · doi:10.1007/978-94-011-0657-3_5 · Cited by 37 · see citing works
Performance Assessment: Designing Appropriate Performance Tasks and Scoring Rubrics.
Perlman, C. C. (2003) · Cited by 35 · see citing works
Confirmatory Factor Analysis of Scores on the Clinical Experience Rubric
Flowers, C. P. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164405282458 · Cited by 35 · see citing works
Technical Education Curriculum Assessment
Keiser, J., Lawrenz, F. P., & Appleton, J. (2004) · Journal of Vocational Education Research · doi:10.5328/jver29.3.181 · Cited by 32 · see citing works
Aschbacher, P. R. (1999) · Cited by 30 · see citing works
Using a Writing Assessment Rubric for Writing Development of Children who are Deaf
Schirmer, B. R., Bailey, J., & Fitzgerald, S. M. (1999) · Exceptional Children · doi:10.1177/001440299906500308 · Cited by 29 · see citing works
Comparing Several Human and Computer-Based Methods for Scoring Concept Maps and Essays
Koul, R., Clariana, R. B., & Salehi, R. M. (2005) · Journal of Educational Computing Research · doi:10.2190/5x9y-0etn-213u-8fv7 · Cited by 28 · see citing works
Gearhart, M., Herman, J. L., Novak, J. R., & Wolf, S. A. (1995) · Assessing Writing · doi:10.1016/1075-2935(95)90013-6 · Cited by 27 · see citing works
Learning-based assessments of history understanding
Baker, E. L. (1994) · Educational Psychologist · doi:10.1207/s15326985ep2902_5 · Cited by 26 · see citing works
An Interview Protocol and Scoring Rubric for Evaluating Teacher Performance
Flowers, C. P., & Hancock, D. R. (2003) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594032000121261 · Cited by 26 · see citing works
Using Rubrics for Documentation of Clinical Work Supervision
Hanna, M., & Smith, J. (1998) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1998.tb00550.x · Cited by 24 · see citing works
Learning and the emerging new assessment culture
Dochy, F. J. R. C., Gijbels, D., & Segers, M. S. R. (2006) · Cited by 24 · see citing works
Chapter 5: Teacher Competency Using Observational Scoring Rubrics
Williams, L. H., & Rink, J. E. (2003) · Journal of Teaching in Physical Education · doi:10.1123/jtpe.22.5.552 · Cited by 22 · see citing works
Clare, L., Valdés, R. M. T., Pascal, J., & Steinberg, J. R. (2001) · Cited by 21 · see citing works
Comparing holistic and analytic scoring for performance assessment with many-facet Rasch model.
Chi, E. (2001) · PubMed · Cited by 19 · see citing works
Criteria Teachers Use to Score Performance Items
Pomplun, M. R., Capps, L., & Sundbye, N. (1998) · Educational Assessment · doi:10.1207/s15326977ea0502_2 · Cited by 17 · see citing works
Effects of Ethnicity and Violent Content on Rubric Scores in Writing Samples
Davidson, M. R., Howell, K. W., & Hoekema, P. (2000) · The Journal of Educational Research · doi:10.1080/00220670009598731 · Cited by 17 · see citing works
Evaluating Technology‐Based Processes and Products
Morrison, G. R., & Ross, S. M. (1998) · New Directions for Teaching and Learning · doi:10.1002/tl.7407 · Cited by 17 · see citing works
Denner, P. R., Salzman, S. A., & Harris, L. B. (2002) · Cited by 14 · see citing works
Busching, B. A. (1998) · New Directions for Teaching and Learning · doi:10.1002/tl.7409 · Cited by 13 · see citing works
Matsumura, L. C., Slater, S. C., Wolf, M. K., Crosson, A. C., Levison, A., Peterson, M., Resnick, L. Β., & Junker, B. W. (2006) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 12 · see citing works
Olson, L. M., Schieve, A. D., Ruit, K. G., & Vari, R. C. (2003) · Academic Medicine · doi:10.1097/00001888-200308000-00021 · Cited by 12 · see citing works
Brookhart, S. M. (2005) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.2005.00007.x · Cited by 12 · see citing works
Operationalizing the Rubric: The Effect of Benchmark Selection on the Assessed Quality of Writing.
Popp, S. E. O., Ryan, J. M., Thompson, M. S., & Behrens, J. T. (2003) · Cited by 12 · see citing works
Scoring Rubric for Assessing Students' Performance on Functional Behavior Assessment Cases
Pindiprolu, S. S., Kraft, B. L., Rule, S., Peterson, S. M. P., & Slocum, T. A. (2005) · Teacher Education and Special Education The Journal of the Teacher Education Division of the Council for Exceptional Children · doi:10.1177/088840640502800201 · Cited by 11 · see citing works
A Continuum For Assessing Science Process Knowledge In Grades K-6
Beeth, M. E., Cross, L. B., Pearl, C., Pirro, J., Yagnesak, K., & Kennedy, J. (2001) · The Electronic Journal of Science Education · Cited by 10 · see citing works
A question of choice: The implications of assessing expressive writing in multiple genres
Goldberg, G. L., Roswell, B. S., & Michaels, H. R. (1998) · Assessing Writing · doi:10.1016/s1075-2935(99)80005-1 · Cited by 9 · see citing works
Duke, B. L. (2003) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University) · Cited by 9 · see citing works
Waltman, K. K., Kahn, A., & Koency, G. (1998) · PsycEXTRA Dataset · doi:10.1037/e650352011-001 · Cited by 9 · see citing works
Paratore, J. R. (1995) · Topics in Language Disorders · doi:10.1097/00011363-199511000-00006 · Cited by 8 · see citing works
Johnson, R. L., Fisher, S., Willeke, M. J., & McDaniel, F. (2003) · Evaluation and Program Planning · doi:10.1016/s0149-7189(03)00053-3 · Cited by 8 · see citing works
Student Improvement in Middle School Science.
Mullen, Y. K. (2003) · Cited by 7 · see citing works
Borko, H., & Stecher, B. M. (2006) · National Center for Research on Evaluation, Standards, and Student Testing · Cited by 7 · see citing works
Using Rubrics for Assessment and Evaluation in Art.
Piscitello, M. E. (2001) · Cited by 6 · see citing works
Andrade, H. G. (1999) · Cited by 6 · see citing works
Abedi, J., & Baker, E. L. (1995) · Educational and Psychological Measurement · doi:10.1177/0013164495055005001 · Cited by 5 · see citing works
Harrison, J. A., McAfee, H., & Caldwell, A. (2002) · Cited by 4 · see citing works
Practicing What We Teach: Assessing Pre-Service Teachers' Performance Using Scoring Guides.
Morrell, P. D., & Ackley, B. C. (1999) · Cited by 4 · see citing works
Lunsford, B. E. (2002) · Cited by 4 · see citing works
Money, Money, Money: Taking the Pain out of Grant Writing.
Maxwell, J. D. (2005) · Teacher librarian · Cited by 3 · see citing works
Stoering, J. M., & Lu, L. (2002) · Cited by 3 · see citing works
Waltman, K. K., Kahn, A., & Koency, G. (1998) · Cited by 3 · see citing works
Constructing Scoring Rubrics: Using "Facets" To Study Design Features of Descriptive Rating Scales.
Myford, C. M. (1996) · Cited by 3 · see citing works
Technology-Supported Formative and Summative Assessment of Collaborative Scientific Inquiry.
Hickey, D. T., DeCuir‐Gunby, J. T., Hand, B., Kyser, B., Laprocina, S., & Mordica, J. (2002) · Cited by 3 · see citing works
Laveault, D., & Miles, C. (2002) · Cited by 2 · see citing works
Validity and internal consistency of two district-developed assessments of Title I students
Watkins, T. (1996) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1 · see citing works
Flagged first, then by citations
7 of the 112 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
A review of rubric use in higher education
Reddy, Y. M., & Andrade, H. (2010) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930902862859 · Cited by 917 · see citing works
The use of scoring rubrics for formative assessment purposes revisited: A review
Panadero, E., & Jonsson, A. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.002 · Cited by 839 · see citing works
Publication Bias in the Organizational Sciences
Kepes, S., Banks, G. C., McDaniel, M. A., & Whetzel, D. L. (2012) · Organizational Research Methods · doi:10.1177/1094428112452760 · Cited by 400 · see citing works
Voss, T., Kunter, M., & Baumert, J. (2011) · Journal of Educational Psychology · doi:10.1037/a0025125 · Cited by 427 · see citing works
Assessment rubrics: towards clearer and more replicable design, research and practice
Dawson, P. (2017) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1111294 · Cited by 368 · see citing works
Reliability and validity of rubrics for assessment through writing
Rezaei, A. R., & Lovorn, M. (2010) · Assessing Writing · doi:10.1016/j.asw.2010.01.003 · Cited by 312 · see citing works
Teaching More by Grading Less (or Differently)
Schinske, J., & Tanner, K. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.cbe-14-03-0054 · Cited by 282 · see citing works
The quality and effectiveness of descriptive rubrics
Brookhart, S., & Chen, F. (2015) · Educational Review · doi:10.1080/00131911.2014.929565 · Cited by 254 · see citing works
Online peer assessment: effects of cognitive and affective feedback
Lu, J., & Law, N. W. Y. (2011) · Instructional Science · doi:10.1007/s11251-011-9177-2 · Cited by 272 · see citing works
König, J. A., Blömeke, S., Klein, P., Suhl, U., Busse, A., & Kaiser, G. (2014) · Teaching and Teacher Education · doi:10.1016/j.tate.2013.11.004 · Cited by 273 · see citing works
Abrahams, L., Pancorbo, G., Primi, R., Santos, D., Kyllonen, P., John, O. P., & De Fruyt, F. (2019) · Psychological Assessment · doi:10.1037/pas0000591 · Cited by 245 · see citing works
Panadero, E., & Roméro, M. (2014) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2013.877872 · Cited by 263 · see citing works
König, J., & Rothland, M. (2012) · Asia-Pacific Journal of Teacher Education · doi:10.1080/1359866x.2012.700045 · Cited by 249 · see citing works
Brantley‐Dias, L., & Ertmer, P. A. (2013) · Journal of Research on Technology in Education · doi:10.1080/15391523.2013.10782615 · Cited by 244 · see citing works
Appropriate criteria: key to effective rubrics
Brookhart, S. M. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00022 · Cited by 243 · see citing works
Panadero, E., Tapia, J. A., & Martínez, J. A. H. (2012) · Learning and Individual Differences · doi:10.1016/j.lindif.2012.04.007 · Cited by 244 · see citing works
König, J. A., Blömeke, S., Paine, L., Schmidt, W., & Hsieh, F.-J. (2011) · Journal of Teacher Education · doi:10.1177/0022487110388664 · Cited by 230 · see citing works
Bias in grading: A meta-analysis of experimental research findings
Malouff, J. M., & Thorsteinsson, E. B. (2016) · Australian Journal of Education · doi:10.1177/0004944116664618 · Cited by 222 · see citing works
Panadero, E., Jonsson, A., & Strijbos, J.-W. (2016) · The Enabling Power of Assessment · doi:10.1007/978-3-319-39211-0_18 · Cited by 212 · see citing works
Panadero, E., Romero, M., & Strijbos, J.-W. (2013) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.10.005 · Cited by 195 · see citing works
Murillo‐Zamorano, L. R., Sánchez, J. Á. L., Caballero, A. L. G., & Muñoz, C. B. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00249-y · Cited by 248 · see citing works
Educational Milestone Development in the First 7 Specialties to Enter the Next Accreditation System
Swing, S. R., Beeson, M. S., Carraccio, C. L., Coburn, M. C., Iobst, W. F., Selden, N. R. W., Stern, P. J., & Vydareny, K. H. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-05-01-33 · Cited by 193 · see citing works
A critical review of the arguments against the use of rubrics
Panadero, E., & Jonsson, A. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100329 · Cited by 191 · see citing works
Formative and shared assessment in higher education. Lessons learned and challenges for the future
Pastor, V. M. L., & Sicilia, Á. (2015) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1083535 · Cited by 210 · see citing works
Docktor, J. L., Dornfeld, J., Frodermann, E., Heller, K., Hsu, L., Jackson, K. A., Mason, A., Ryan, Q. X., & Yang, J. (2016) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.12.010130 · Cited by 198 · see citing works
Rubrics as a way of providing transparency in assessment
Jönsson, A. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.875117 · Cited by 180 · see citing works
Implementing summative assessment with a formative flavour: a case study in a large class
Broadbent, J., Panadero, E., & Boud, D. J. (2017) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1343455 · Cited by 191 · see citing works
Rubrics to assess critical thinking and information processing in undergraduate STEM courses
Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020) · International Journal of STEM Education · doi:10.1186/s40594-020-00208-5 · Cited by 174 · see citing works
Socio-scientific reasoning and environmental literacy in a field-based ecology class
Kinslow, A. T., Sadler, T. D., & Nguyen, H. T. (2018) · Environmental Education Research · doi:10.1080/13504622.2018.1442418 · Cited by 184 · see citing works
Rubric‐referenced self‐assessment and middle school students’ writing
Andrade, H., Du, Y., & Mycek, K. (2010) · Assessment in Education Principles Policy and Practice · doi:10.1080/09695941003696172 · Cited by 161 · see citing works
A Practicum Turn in Teacher Education
Mattsson, M., Rorrison, D., & Eilertsen, T. V. (2011) · SensePublishers eBooks · doi:10.1007/978-94-6091-711-0 · Cited by 156 · see citing works
van de Ridder, J. M. M., McGaghie, W. C., Stokking, K. M., & ten Cate, O. T. J. (2015) · Medical Education · doi:10.1111/medu.12744 · Cited by 154 · see citing works
Menoyo, M. Á. M. (2015) · Foro de Educación · doi:10.14516/fde.2015.013.019.004 · Cited by 147 · see citing works
T/E design based learning: assessing student critical thinking and problem solving abilities
Shanta, S., & Wells, J. G. (2020) · International Journal of Technology and Design Education · doi:10.1007/s10798-020-09608-8 · Cited by 144 · see citing works
Panadero, E., Jönsson, A., Pinedo, L., & Fernández‐Castilla, B. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09823-4 · Cited by 212 · see citing works
Journal of University Teaching & Learning Practice
Harvey, M., & Luzia, K. (2013) · Cited by 141 · see citing works
The relation between content-specific and general teacher knowledge and skills
Blömeke, S., Busse, A., Kaiser, G., König, J. A., & Suhl, U. (2016) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.02.003 · Cited by 112 · see citing works
Fostering oral presentation competence through a virtual reality-based task for delivering feedback
van Ginkel, S. O., Gulikers, J. T. M., Biemans, H. J. A., Noroozi, O., Roozen, M. C., Bos, T., van Tilborg, R., van Halteren, M., & Mulder, M. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.02.006 · Cited by 138 · see citing works
Experimental Evidence on Teachers’ Racial Bias in Student Evaluation: The Role of Grading Scales
Quinn, D. M. (2020) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373720932188 · Cited by 124 · see citing works
Examining pre-service teacher competence in lesson planning pertaining to collaborative learning
Ruys, I., Keer, H. V., & Aelterman, A. (2012) · Journal of Curriculum Studies · doi:10.1080/00220272.2012.675355 · Cited by 115 · see citing works
Parsazadeh, N., Ali, R., & Rezaei, M. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.01.010 · Cited by 113 · see citing works
Panadero, E., Alonso‐Tapia, J., & Urbano, E. R. (2013) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2013.04.001 · Cited by 113 · see citing works
The Facade of Fit in Faculty Search Processes
White-Lewis, D. K. (2020) · The Journal of Higher Education · doi:10.1080/00221546.2020.1775058 · Cited by 108 · see citing works
Assessment for Learning: Meeting the Challenge of Implementation
Laveault, D., Allal, L., & Publishing, S. I. (2016) · The enabling power of assessment · doi:10.1007/978-3-319-39211-0 · Cited by 105 · see citing works
Gradescope: A Fast, Flexible, and Fair System for Scalable Assessment of Handwritten Work
Singh, A., Karayev, S., Gutowski, K., & Abbeel, P. (2017) · Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale · doi:10.1145/3051457.3051466 · Cited by 113 · see citing works
Considering rigor and relevance when evaluating test driven development: A systematic review
Munir, H., Moayyed, M., & Petersen, K. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.01.002 · Cited by 104 · see citing works
Wang, W. (2016) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2016.1261993 · Cited by 105 · see citing works
Fraile, J., Panadero, E., & Pardo, R. (2017) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2017.03.003 · Cited by 139 · see citing works
Koh, J. H. L. (2013) · Australasian Journal of Educational Technology · doi:10.14742/ajet.228 · Cited by 97 · see citing works
Beyond Fairness and Consistency in Grading: The Role of Rubrics in Higher Education
Ragupathi, K., & Lee, A. (2020) · Springer eBooks · doi:10.1007/978-981-15-1628-3_3 · Cited by 93 · see citing works
Artificial intelligence in sport management education: Playing the AI game with ChatGPT
Keiper, M. C., Fried, G. B., Lupinek, J. M., & Nordstrom, H. (2023) · Journal of Hospitality Leisure Sport & Tourism Education · doi:10.1016/j.jhlste.2023.100456 · Cited by 114 · see citing works
Stolarova, M., Wolf, C., Rinker, T., & Brielmann, A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00509 · Cited by 93 · see citing works
Chowdhury, F. (2018) · International Education Studies · doi:10.5539/ies.v12n1p61 · Cited by 91 · see citing works
Oral presentations in higher education: a comparison of the impact of peer and teacher feedback
Murillo‐Zamorano, L. R., & Montanero, M. (2017) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1303032 · Cited by 98 · see citing works
Open innovation in software engineering: a systematic mapping study
Munir, H., Wnuk, K., & Runeson, P. (2015) · Empirical Software Engineering · doi:10.1007/s10664-015-9380-x · Cited by 88 · see citing works
OECD Reviews of Evaluation and Assessment in Education: Norway 2011
Nusche, D., Earl, L. M., Maxwell, W. E., & Shewbridge, C. (2011) · OECD reviews of evaluation and assessment in education · doi:10.1787/9789264117006-en · Cited by 86 · see citing works
Is GPT-4 a reliable rater? Evaluating consistency in GPT-4's text ratings
Hackl, V., Müller, A. E., Granitzer, M., & Sailer, M. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1272229 · Cited by 94 · see citing works
A meta-analysis on the reliability of comparative judgement
Verhavert, S., Bouwer, R., Donche, V., & Mæyer, S. D. (2019) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2019.1602027 · Cited by 86 · see citing works
E-Task-Based Learning Approach to Enhancing 21st-Century Learning Outcomes
Kandari, A. M. H. A., & Qattan, M. M. A. (2019) · International Journal of Instruction · doi:10.29333/iji.2020.13136a · Cited by 82 · see citing works
Córdova, K. E. G. (2020) · Problems of Education in the 21st Century · doi:10.33225/pec/20.78.61 · Cited by 93 · see citing works
Developing Science Process Skills through Mobile Scientific Inquiry
Ekici, M., & Erdem, M. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100658 · Cited by 82 · see citing works
Effect of blended learning environment on transfer of learning: an experimental study
Demirer, V., & Sahin, I. (2013) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12009 · Cited by 85 · see citing works
Puanlayıcılar Arası Güvenirlik Belirleme Tekniklerinin Karşılaştırılması
Bilgen, Ö. B., & Doğan, N. (2017) · Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi · doi:10.21031/epod.294847 · Cited by 80 · see citing works
How Accurate Are Our Students? A Meta-analytic Systematic Review on Self-assessment Scoring Accuracy
León, S. P., Panadero, E., & García‐Martínez, I. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09819-0 · Cited by 94 · see citing works
Examining the characteristics of game-based learning: A content analysis and design framework
Nadolny, L., Valai, A., Cherrez, N. V. J., Elrick, D., Lovett, A., & Nowatzke, M. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103936 · Cited by 78 · see citing works
Kulakow, S. (2020) · Learning and Motivation · doi:10.1016/j.lmot.2020.101632 · Cited by 59 · see citing works
Saxton, E. A., Belanger, S., & Becker, W. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.07.002 · Cited by 75 · see citing works
Common Structural Design Features of Rubrics May Represent a Threat to Validity
Humphry, S. M., & Heldsinger, S. (2014) · Educational Researcher · doi:10.3102/0013189x14542154 · Cited by 78 · see citing works
Blömeke, S., König, J., Busse, A., Suhl, U., Benthien, J., Döhrmann, M., & Kaiser, G. (2014) · Zeitschrift für Erziehungswissenschaft · doi:10.1007/s11618-014-0564-8 · Cited by 74 · see citing works
Understanding variations between student and teacher application of rubrics
Li, J., & Lindsey, P. (2015) · Assessing Writing · doi:10.1016/j.asw.2015.07.003 · Cited by 72 · see citing works
Howitz, W. J., McKnelly, K. J., & Link, R. D. (2020) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c00450 · Cited by 72 · see citing works
OECD Reviews of Evaluation and Assessment in Education
Shewbridge, C., Jang, E. E., Matthews, P. J., Santiago, P., Nusche, D., Earl, L. M., Maxwell, W. E., Laveault, D., MacBeath, J., Gilmore, A. M., et al. (2011) · Cited by 72 · see citing works
Becker, A. (2016) · Assessing Writing · doi:10.1016/j.asw.2016.05.002 · Cited by 72 · see citing works
Jescovitch, L. N., Scott, E. E., Cerchiara, J. A., MERRILL, J. E., Urban‐Lurain, M., Doherty, J. H., & Haudek, K. C. (2020) · Journal of Science Education and Technology · doi:10.1007/s10956-020-09858-0 · Cited by 73 · see citing works
Designing a rubric for feedback on code quality in programming courses
Stegeman, M., Barendsen, E., & Smetsers, S. (2016) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2999541.2999555 · Cited by 76 · see citing works
Rakedzon, T., & Baram‐Tsabari, A. (2017) · Assessing Writing · doi:10.1016/j.asw.2016.12.004 · Cited by 70 · see citing works
The Use and Design of Rubrics to Support Assessment for Learning
Jönsson, A., & Panadero, E. (2016) · The enabling power of assessment · doi:10.1007/978-981-10-3045-1_7 · Cited by 69 · see citing works
Panadero, E., Alonso‐Tapia, J., & Martínez, J. A. H. (2014) · Journal for the Study of Education and Development Infancia y Aprendizaje · doi:10.1080/02103702.2014.881655 · Cited by 69 · see citing works
Greenberg, K. P. (2015) · Teaching of Psychology · doi:10.1177/0098628315587618 · Cited by 68 · see citing works
Insights about large-scale online peer assessment from an analysis of an astronomy MOOC
Formánek, M., Wenger, M., Buxner, S., Impey, C., & Sonam, T. (2017) · Comput. Educ. · doi:10.1016/j.compedu.2017.05.019 · Cited by 71 · see citing works
¿Cómo emplear las rúbricas para implementar una verdadera evaluación formativa?
Fraile, J., Pardo, R., & Panadero, E. (2017) · Revista Complutense de Educación · doi:10.5209/rced.51915 · Cited by 75 · see citing works
König, J. (2013) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-013-9420-1 · Cited by 66 · see citing works
Nielsen, K. (2012) · Journal of Research in Reading · doi:10.1111/j.1467-9817.2012.01533.x · Cited by 65 · see citing works
Authentic science with citizen science and student‐driven science fair projects
Koomen, M. H., Rodriguez, E., Hoffman, A., Petersen, C., & Oberhauser, K. S. (2018) · Science Education · doi:10.1002/sce.21335 · Cited by 67 · see citing works
Improving and evaluating reflective narratives: A rubric for higher education students
Alsina, ́., Ayllón, S., Colomer, J., Fernández‐Peña, R., Noell, J. F., Díaz, M. P. I., Burriel, M. P., & Serra, L. (2017) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.12.015 · Cited by 64 · see citing works
Simulated versus traditional occupational therapy placements: A randomised controlled trial
Imms, C., Froude, E., Chu, E. M. Y., Sheppard, L., Darzins, S. W., Guinea, S., Gospodarevskaya, E., Carter, R., Symmons, M. A., Penman, M., et al. (2018) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12513 · Cited by 64 · see citing works
Beyond Traditional Assessment: Exploring the Impact of Large Language Models on Grading Practices
Fagbohun, O., Iduwe, N. P., Abdullahi, M., Ifaturoti, A., & Nwanna, O. (2024) · Journal of Artificial Intelligence, Machine Learning and Data Science · doi:10.51219/jaimld/oluwole-fagbohun/19 · Cited by 68 · see citing works
Christ, A. A., Capon-Sieber, V., Grob, U., & Praetorius, A.-K. (2022) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2022.101209 · Cited by 66 · see citing works
Yuan, M., & Recker, M. M. (2015) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v16i5.2389 · Cited by 62 · see citing works
Blömeke, S., Paine, L. W., Houang, R. T., Hsieh, F.-J., Schmidt, W. H., Tatto, M. T., Банков, К., Cedilllo, T., Cogan, L. S., Han, S. I., et al. (2008) · ZDM · doi:10.1007/s11858-008-0123-y · Cited by 61 · see citing works
González-Betancor, S. M., Cruz, A. M. B., & Tacoronte, D. V. (2017) · Active Learning in Higher Education · doi:10.1177/1469787417735604 · Cited by 62 · see citing works
Rethinking online assessment strategies: Authenticity versus AI chatbot intervention
Ifelebuegu, A. O. (2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.2.2 · Cited by 70 · see citing works
Instructional rubrics: Effects of presentation options on writing quality
Sundeen, T. H. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.03.003 · Cited by 60 · see citing works
Values in evaluation – The use of rubrics
Dickinson, P., & Adams, J. (2017) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2017.07.005 · Cited by 60 · see citing works
The impact of the feedback source on developing oral presentation competence
van Ginkel, S., Gulikers, J., Biemans, H., & Mulder, M. (2017) · Studies in Higher Education · doi:10.1080/03075079.2015.1117064 · Cited by 94 · see citing works
Sung, Y., Lee, H.-Y., Yang, J.-M., & Chang, K.-E. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.05.001 · Cited by 64 · see citing works
Supporting Peer Feedback on Learning Strategies: Effects on Self-Efficacy and Feedback Quality
Bürgermeister, A., Glogger-Frey, I., & Saalbach, H. (2021) · Psychology Learning & Teaching · doi:10.1177/14757257211016604 · Cited by 60 · see citing works
Towards an empirically validated model for assessment of code quality
Stegeman, M., Barendsen, E., & Smetsers, S. (2014) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2674683.2674702 · Cited by 56 · see citing works
Teachers’ reasons for using self-assessment: a survey self-report of Spanish teachers
Panadero, E., Brown, G. T. L., & Courtney, M. (2014) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2014.919247 · Cited by 57 · see citing works
Machine Learning and Hebrew NLP for Automated Assessment of Open-Ended Questions in Biology
Ariely, M., Nazaretsky, T., & Alexandron, G. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00283-x · Cited by 54 · see citing works
- Authors
- Jonsson, A., & Svingby, G.
- Affiliations
- Malmö University (SE)
- Venue
- Educational Research Review
- Publisher
- Elsevier BV
- Published
- 2007-01
- Volume
- 2
- Issue
- 2
- Pages
- 130-144
- ISSN
- 1747-938X (ISSN-L)
- OpenAlex
- W2115389369
- Cited by
- 1,509
- References
- 112
- Citations by year
- 2026: 221 · 2025: 145 · 2024: 91 · 2023: 100 · 2022: 93 · 2021: 94 · 2020: 108 · 2019: 90 · 2018: 137 · 2017: 103 · 2016: 66 · 2015: 73 · 2014: 70 · 2013: 42 · 2012: 34
- FWCI
- 27.98
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Research Review (publishedVersion)
- Malmö University Publications (Malmö University) (submittedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Education › Teacher Education and Assessments
- Keywords
- rubrics, performance evaluation, scoring reliability, assessment validity, rater training, exemplars, analytic rubrics, rubric validation, learning promotion, feedback, self-assessment, teaching improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review