The DOI matches its Crossref record; 105 of the 112 references it cites were found in a registry or an index.
The use of scoring rubrics: Reliability, validity and educational consequences
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Sharing the rubrics with students can have the added benefit of enhancing learning by allowing for feedback and self-assessment (Jonsson and Svingby, 2007; Reddy and Andrade, 2010).”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Jonsson and Svingby, 2007
In the citing paper
“Designing and using rubrics to grade assignments or tests can reduce inconsistencies and make grading written work more objective.”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Jonsson and Svingby, 2007
In the citing paper
“Perhaps most importantly, sharing grading rubrics with students can support them in identifying where their thinking has gone wrong and promote learning (Jonsson and Svingby, 2007; Reddy and Andrade, 2010).”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Jonsson and Svingby, 2007
Citations
Cites
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,733
Educational Research: Fundamentals for the Consumer
McMillan, J. H. (1991) · Cited by 1,265
The use of self-, peer and co-assessment in higher education: A review
Dochy, F., Segers, M., & Sluijsmans, D. (1999) · Studies in Higher Education · doi:10.1080/03075079912331379935 · Cited by 1,206
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170
Stemler, S. E. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/96jp-xz07 · Cited by 1,064
Assessing Student Learning in Higher Education
Brown, G. A., Bull, J., & Pendlebury, M. (2013) · Routledge eBooks · doi:10.4324/9781315004914 · Cited by 929
Authentic assessment of teaching in context
Darling-Hammond, L., & Snyder, J. (2000) · Teaching and Teacher Education · doi:10.1016/s0742-051x(00)00015-9 · Cited by 715
A Systems Approach to Educational Testing
Frederiksen, J. R., & Collins, A. (1989) · Educational Researcher · doi:10.3102/0013189x018009027 · Cited by 607
The Impact of Self- and Peer-Grading on Student Learning
Sadler, P., & Good, E. (2006) · Educational Assessment · doi:10.1207/s15326977ea1101_1 · Cited by 535 · cited 3×
“The study by Sadler and Good (2006) puts the presumed benefits of peer-grading to the test.”
BackgroundScoring Rubric Development: Validity and Reliability
Moskal, B., & Leydens, J. A. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/q7rm-gg74 · Cited by 502
Student Self-Assessment in Higher Education: A Meta-Analysis
Falchikov, N., & Boud, D. (1989) · Review of Educational Research · doi:10.3102/00346543059004395 · Cited by 496
Reflection as a visible outcome for preservice teachers
Ward, J. R., & McCotter, S. S. (2004) · Teaching and Teacher Education · doi:10.1016/j.tate.2004.02.004 · Cited by 453
Validation of the Fresno test of competence in evidence based medicine
Ramos, K., Schafer, S., & Tracz, S. M. (2003) · BMJ · doi:10.1136/bmj.326.7384.319 · Cited by 391
Self and Peer Assessment in School and University: Reliability, Validity and Utility
Topping, K. J. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-306-48125-1_4 · Cited by 374
Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.06.001 · Cited by 365
Cho, K., Schunn, C. D., & Wilson, R. W. (2006) · Journal of Educational Psychology · doi:10.1037/0022-0663.98.4.891 · Cited by 355
The Importance of Marking Criteria in the Use of Peer Assessment
Orsmond, P., Merry, S. P., & Reiling, K. (1996) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293960210304 · Cited by 287
Alternatives in Assessment of Achievements, Learning Processes and Prior Knowledge
(1996) · Springer eBooks · doi:10.1007/978-94-011-0657-3 · Cited by 281
Design and Use of a Rubric to Assess and Encourage Interactive Qualities in Distance Courses
Roblyer, M. D., & Wiencke, W. R. (2003) · American Journal of Distance Education · doi:10.1207/s15389286ajde1702_2 · Cited by 279
Hafner, J., & Hafner, P. (2003) · International Journal of Science Education · doi:10.1080/0950069022000038268 · Cited by 258
Dunbar, N. E., Brooks, C., & Kubicka-Miller, T. (2006) · Innovative Higher Education · doi:10.1007/s10755-006-9012-x · Cited by 223
Toth, E. E., Suthers, D. D., & Lesgold, A. M. (2002) · Science Education · doi:10.1002/sce.10004 · Cited by 211
Concept maps as assessment in science inquiry learning - a report of methodology
Stoddart, T., Abrams, R., Gasper, E., & Canaday, D. (2000) · International Journal of Science Education · doi:10.1080/095006900750036235 · Cited by 204
The wheel of competency assessment: Presenting quality criteria for competency assessment programs
Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2006) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2006.04.006 · Cited by 203
A learning Integrated Assessment System
Birenbaum, M., Breuer, K., Cascallar, E. C., Dochy, F. J. R. C., Dori, Y. J., Ridgway, J., Wiesemes, R., & Nickmans, G. (2006) · Educational Research Review · doi:10.1016/j.edurev.2006.01.001 · Cited by 201
A New Method for Assessing Critical Thinking in the Classroom
Bissell, A. N., & Lemons, P. P. (2006) · BioScience · doi:10.1641/0006-3568(2006)056[0066:anmfac]2.0.co;2 · Cited by 191
Prozesky, D. R. (2001) · PubMed · Cited by 177
Paying for high- and low-quality teaching
Schacter, J., & Thum, Y. M. (2004) · Economics of Education Review · doi:10.1016/j.econedurev.2003.08.002 · Cited by 174
Weigle, S. C. (1999) · Assessing Writing · doi:10.1016/s1075-2935(00)00010-6 · Cited by 157
Brown, G., Glasswell, K., & Harland, D. (2004) · Assessing Writing · doi:10.1016/j.asw.2004.07.001 · Cited by 155
Generalizability of Performance Assessments
Brennan, R. L., & Johnson, E. G. (1995) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1995.tb00882.x · Cited by 130
Self-, peer- and teacher-assessment of student essays
Lindblom‐Ylänne, S., Pihlajamäki, H., & Kotkas, T. (2006) · Active Learning in Higher Education · doi:10.1177/1469787406061148 · Cited by 122
Gielen, S., Dochy, F. J. R. C., & Dierick, S. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-306-48125-1_3 · Cited by 120
Technical Issues in Large-Scale Performance Assessment.
Phillips, G. W. (1996) · Cited by 110
Johnson, R. L., Penny, J., & Gordon, B. (2000) · Applied Measurement in Education · doi:10.1207/s15324818ame1302_1 · Cited by 93
Schamber, J. F., & Mahoney, S. L. (2006) · The Journal of General Education · doi:10.1353/jge.2006.0025 · Cited by 90
Scoring Rubrics in the Classroom
McTighe, J., & Arter, J. A. (2000) · Cited by 86
Mabry, L. (1999) · Phi Delta Kappan · Cited by 84
Instructional Psychology: Past, present and future trends
Entwistle, N. J., McCune, V., & Scheja, M. (2006) · Cited by 79
Writing assessment: Raters' elaboration of the rating task
DeRemer, M. (1998) · Assessing Writing · doi:10.1016/s1075-2935(99)80003-8 · Cited by 75
Student Self-Assessment: At the Intersection of Metacognition and Authentic Assessment.
Andrade, H. G. (1999) · Cited by 71
Green, R., & Bowser, M. (2006) · Journal of Library Administration · doi:10.1300/j111v45n01_10 · Cited by 70
de Watering, G. V., & van der Rijt, J. (2006) · Educational Research Review · doi:10.1016/j.edurev.2006.05.001 · Cited by 70
The effect of rating augmentation on inter-rater reliability
Penny, J., Johnson, R. L., & Gordon, B. (2000) · Assessing Writing · doi:10.1016/s1075-2935(00)00012-x · Cited by 67
Effects of Teacher Knowledge of Rubrics on Student Achievement in Four Content Areas
Schafer, W. D., Swanson, G., Bené, N. H., & Newberry, G. (2001) · Applied Measurement in Education · doi:10.1207/s15324818ame1402_3 · Cited by 66
A rubric for scoring postsecondary academic skills
Simon, M., & Forgette-Giroux, R. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/bh4d-me80 · Cited by 65
Scenario assignments as assessment tools for undergraduate engineering education
McMartin, F. P., McKenna, A. F., & Youssefi, K. (2000) · IEEE Transactions on Education · doi:10.1109/13.848061 · Cited by 63
Rubrics: Design and Use in Science Teacher Education
Luft, J. A. (1999) · Journal of Science Teacher Education · doi:10.1023/a:1009471931127 · Cited by 61
Score Resolution and the Interrater Reliability of Holistic Scores in Rating Essays
Johnson, R. L., Penny, J., & Gordon, B. (2001) · Written Communication · doi:10.1177/0741088301018002003 · Cited by 52
A Comparison of Selected Methods of Scoring Classroom Assessments
Marzano, R. J. (2002) · Applied Measurement in Education · doi:10.1207/s15324818ame1503_2 · Cited by 50
Osana, H. P., & Seymour, J. R. (2004) · Educational Research and Evaluation · doi:10.1080/13803610512331383529 · Cited by 48
Janice Stuhlmann, C. D. (1999) · Reading Psychology · doi:10.1080/027027199278439 · Cited by 45
Boston, M. D., & Wolf, M. K. (2006) · National Center for Research on Evaluation, Standards, and Student Testing · Cited by 44
Dimensionality and Generalizability of Domain-Independent Performance Assessments
Baker, E. L., Abedi, J., Linn, R. L., & Niemi, D. (1996) · The Journal of Educational Research · doi:10.1080/00220671.1996.9941205 · Cited by 42
Using Rating Augmentation to Expand the Scale of an Analytic Rubric
Penny, J., Johnson, R. L., & Gordon, B. (2000) · The Journal of Experimental Education · doi:10.1080/00220970009600096 · Cited by 39
Choinski, E., Mark, A. E., & Murphey, M. (2003) · portal Libraries and the Academy · doi:10.1353/pla.2003.0078 · Cited by 39
Boston, M. D., & Wolf, M. K. (2006) · PsycEXTRA Dataset · doi:10.1037/e644922011-001 · Cited by 39
On the Content Validity of Performance Assessments: Centrality of Domain Specification
Shavelson, R. J., Gao, X. W., & Baxter, G. P. (1996) · Springer eBooks · doi:10.1007/978-94-011-0657-3_5 · Cited by 37
Performance Assessment: Designing Appropriate Performance Tasks and Scoring Rubrics.
Perlman, C. C. (2003) · Cited by 35
Confirmatory Factor Analysis of Scores on the Clinical Experience Rubric
Flowers, C. P. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164405282458 · Cited by 35
Technical Education Curriculum Assessment
Keiser, J., Lawrenz, F. P., & Appleton, J. (2004) · Journal of Vocational Education Research · doi:10.5328/jver29.3.181 · Cited by 32
Aschbacher, P. R. (1999) · Cited by 30
Using a Writing Assessment Rubric for Writing Development of Children who are Deaf
Schirmer, B. R., Bailey, J., & Fitzgerald, S. M. (1999) · Exceptional Children · doi:10.1177/001440299906500308 · Cited by 29
Comparing Several Human and Computer-Based Methods for Scoring Concept Maps and Essays
Koul, R., Clariana, R. B., & Salehi, R. M. (2005) · Journal of Educational Computing Research · doi:10.2190/5x9y-0etn-213u-8fv7 · Cited by 28
Gearhart, M., Herman, J. L., Novak, J. R., & Wolf, S. A. (1995) · Assessing Writing · doi:10.1016/1075-2935(95)90013-6 · Cited by 27
Learning-based assessments of history understanding
Baker, E. L. (1994) · Educational Psychologist · doi:10.1207/s15326985ep2902_5 · Cited by 26
An Interview Protocol and Scoring Rubric for Evaluating Teacher Performance
Flowers, C. P., & Hancock, D. R. (2003) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594032000121261 · Cited by 26
Using Rubrics for Documentation of Clinical Work Supervision
Hanna, M., & Smith, J. (1998) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1998.tb00550.x · Cited by 24
Learning and the emerging new assessment culture
Dochy, F. J. R. C., Gijbels, D., & Segers, M. S. R. (2006) · Cited by 24
Chapter 5: Teacher Competency Using Observational Scoring Rubrics
Williams, L. H., & Rink, J. E. (2003) · Journal of Teaching in Physical Education · doi:10.1123/jtpe.22.5.552 · Cited by 22
Clare, L., Valdés, R. M. T., Pascal, J., & Steinberg, J. R. (2001) · Cited by 21
Comparing holistic and analytic scoring for performance assessment with many-facet Rasch model.
Chi, E. (2001) · PubMed · Cited by 19
Criteria Teachers Use to Score Performance Items
Pomplun, M. R., Capps, L., & Sundbye, N. (1998) · Educational Assessment · doi:10.1207/s15326977ea0502_2 · Cited by 17
Effects of Ethnicity and Violent Content on Rubric Scores in Writing Samples
Davidson, M. R., Howell, K. W., & Hoekema, P. (2000) · The Journal of Educational Research · doi:10.1080/00220670009598731 · Cited by 17
Evaluating Technology‐Based Processes and Products
Morrison, G. R., & Ross, S. M. (1998) · New Directions for Teaching and Learning · doi:10.1002/tl.7407 · Cited by 17
Denner, P. R., Salzman, S. A., & Harris, L. B. (2002) · Cited by 14
Busching, B. A. (1998) · New Directions for Teaching and Learning · doi:10.1002/tl.7409 · Cited by 13
Matsumura, L. C., Slater, S. C., Wolf, M. K., Crosson, A. C., Levison, A., Peterson, M., Resnick, L. Β., & Junker, B. W. (2006) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 12
Olson, L. M., Schieve, A. D., Ruit, K. G., & Vari, R. C. (2003) · Academic Medicine · doi:10.1097/00001888-200308000-00021 · Cited by 12
Brookhart, S. M. (2005) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.2005.00007.x · Cited by 12
Operationalizing the Rubric: The Effect of Benchmark Selection on the Assessed Quality of Writing.
Popp, S. E. O., Ryan, J. M., Thompson, M. S., & Behrens, J. T. (2003) · Cited by 12
Scoring Rubric for Assessing Students' Performance on Functional Behavior Assessment Cases
Pindiprolu, S. S., Kraft, B. L., Rule, S., Peterson, S. M. P., & Slocum, T. A. (2005) · Teacher Education and Special Education The Journal of the Teacher Education Division of the Council for Exceptional Children · doi:10.1177/088840640502800201 · Cited by 11
A Continuum For Assessing Science Process Knowledge In Grades K-6
Beeth, M. E., Cross, L. B., Pearl, C., Pirro, J., Yagnesak, K., & Kennedy, J. (2001) · The Electronic Journal of Science Education · Cited by 10
A question of choice: The implications of assessing expressive writing in multiple genres
Goldberg, G. L., Roswell, B. S., & Michaels, H. R. (1998) · Assessing Writing · doi:10.1016/s1075-2935(99)80005-1 · Cited by 9
Duke, B. L. (2003) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University) · Cited by 9
Waltman, K. K., Kahn, A., & Koency, G. (1998) · PsycEXTRA Dataset · doi:10.1037/e650352011-001 · Cited by 9
Paratore, J. R. (1995) · Topics in Language Disorders · doi:10.1097/00011363-199511000-00006 · Cited by 8
Johnson, R. L., Fisher, S., Willeke, M. J., & McDaniel, F. (2003) · Evaluation and Program Planning · doi:10.1016/s0149-7189(03)00053-3 · Cited by 8
Student Improvement in Middle School Science.
Mullen, Y. K. (2003) · Cited by 7
Borko, H., & Stecher, B. M. (2006) · National Center for Research on Evaluation, Standards, and Student Testing · Cited by 7
Using Rubrics for Assessment and Evaluation in Art.
Piscitello, M. E. (2001) · Cited by 6
Andrade, H. G. (1999) · Cited by 6
Abedi, J., & Baker, E. L. (1995) · Educational and Psychological Measurement · doi:10.1177/0013164495055005001 · Cited by 5
Harrison, J. A., McAfee, H., & Caldwell, A. (2002) · Cited by 4
Practicing What We Teach: Assessing Pre-Service Teachers' Performance Using Scoring Guides.
Morrell, P. D., & Ackley, B. C. (1999) · Cited by 4
Lunsford, B. E. (2002) · Cited by 4
Money, Money, Money: Taking the Pain out of Grant Writing.
Maxwell, J. D. (2005) · Teacher librarian · Cited by 3
Stoering, J. M., & Lu, L. (2002) · Cited by 3
Waltman, K. K., Kahn, A., & Koency, G. (1998) · Cited by 3
Constructing Scoring Rubrics: Using "Facets" To Study Design Features of Descriptive Rating Scales.
Myford, C. M. (1996) · Cited by 3
Technology-Supported Formative and Summative Assessment of Collaborative Scientific Inquiry.
Hickey, D. T., DeCuir‐Gunby, J. T., Hand, B., Kyser, B., Laprocina, S., & Mordica, J. (2002) · Cited by 3
Laveault, D., & Miles, C. (2002) · Cited by 2
Validity and internal consistency of two district-developed assessments of Title I students
Watkins, T. (1996) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1
Flagged first, then by citations
7 of the 112 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & Van der Vleuten, C. P. M. (submitted for publication). Assessment in competence-based education: How can assessment quality be evaluated? Educational Research Review.
- Mott, 2003, Applying an analytic writing rubric to children's hypermedia “narratives”, Early Childhood Research & Practice: An Internet Journal on the Development, Care, and Education of Young Children, 5
Cited by
Sorted by citations
A review of rubric use in higher education
Reddy, Y. M., & Andrade, H. (2010) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930902862859 · Cited by 917
“As with any form of assessment, the clarity of the language in a rubric is a matter of validity because an ambiguous rubric cannot be accurately or consistently interpreted by instructors, students or scorers (Payne 2003).”
BackgroundThe use of scoring rubrics for formative assessment purposes revisited: A review
Panadero, E., & Jonsson, A. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.002 · Cited by 839
“In one review of research on the use of rubrics, Jonsson and Svingby (2007) noted that it was not possible to draw any conclusions about student improvement since the results were mixed.”
BackgroundInfluentialPublication Bias in the Organizational Sciences
Kepes, S., Banks, G. C., McDaniel, M. A., & Whetzel, D. L. (2012) · Organizational Research Methods · doi:10.1177/1094428112452760 · Cited by 416
“Furthermore, the development of reliable and valid scoring rubrics for an overall quality score may be possible when objective characteristics are used in the rating procedure (Jonsson & Svingby, 2007).”
MethodVoss, T., Kunter, M., & Baumert, J. (2011) · Journal of Educational Psychology · doi:10.1037/a0025125 · Cited by 464
Assessment rubrics: towards clearer and more replicable design, research and practice
Dawson, P. (2017) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1111294 · Cited by 368
“Jonsson and Svingby’s (2007) review of 75 studies identifies two classification dimensions: whether a rubric is analytic or holistic, and if it is generic or task-specific.”
BackgroundMethod
Metadata
- Authors
- Jonsson, A., & Svingby, G.
- Affiliations
- Malmö University (SE)
- Venue
- Educational Research Review
- Publisher
- Elsevier BV
- Published
- 2007-01
- Volume
- 2
- Issue
- 2
- Pages
- 130-144
- ISSN
- 1747-938X (ISSN-L)
- OpenAlex
- W2115389369
- Cited by
- 1,509
- References
- 112
- Citations by year
- 2026: 221 · 2025: 145 · 2024: 91 · 2023: 100 · 2022: 93 · 2021: 94 · 2020: 108 · 2019: 90 · 2018: 137 · 2017: 103 · 2016: 66 · 2015: 73 · 2014: 70 · 2013: 42 · 2012: 34
- FWCI
- 27.98
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Research Review (publishedVersion)
- Malmö University Publications (Malmö University) (submittedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Education › Teacher Education and Assessments
- Keywords
- rubrics, performance evaluation, scoring reliability, assessment validity, rater training, exemplars, analytic rubrics, rubric validation, learning promotion, feedback, self-assessment, teaching improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review