Cited by 1,509Student Assessment and FeedbackEducational Assessment and PedagogyTeacher Education and Assessments

The DOI matches its Crossref record; 105 of the 112 references it cites were found in a registry or an index.

The use of scoring rubrics: Reliability, validity and educational consequences

Jonsson, Anders, Svingby, Gunilla·2007·Educational Research Review

DOI 10.1016/j.edurev.2007.05.002

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1016/j.edurev.2007.05.002

Cites

105 of 105 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Concept of Validity.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,733
Educational Research: Fundamentals for the Consumer
McMillan, J. H. (1991) · Cited by 1,265
The use of self-, peer and co-assessment in higher education: A review
Dochy, F., Segers, M., & Sluijsmans, D. (1999) · Studies in Higher Education · doi:10.1080/03075079912331379935 · Cited by 1,206
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170
A Comparison of Consensus, Consistency, and Measurement Approaches to Estimating Interrater Reliability
Stemler, S. E. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/96jp-xz07 · Cited by 1,064
Assessing Student Learning in Higher Education
Brown, G. A., Bull, J., & Pendlebury, M. (2013) · Routledge eBooks · doi:10.4324/9781315004914 · Cited by 929
Authentic assessment of teaching in context
Darling-Hammond, L., & Snyder, J. (2000) · Teaching and Teacher Education · doi:10.1016/s0742-051x(00)00015-9 · Cited by 715
A Systems Approach to Educational Testing
Frederiksen, J. R., & Collins, A. (1989) · Educational Researcher · doi:10.3102/0013189x018009027 · Cited by 607
The Impact of Self- and Peer-Grading on Student Learning
Sadler, P., & Good, E. (2006) · Educational Assessment · doi:10.1207/s15326977ea1101_1 · Cited by 535 · cited 3×
“The study by Sadler and Good (2006) puts the presumed benefits of peer-grading to the test.”
Background
Scoring Rubric Development: Validity and Reliability
Moskal, B., & Leydens, J. A. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/q7rm-gg74 · Cited by 502

Flagged first, then by citations

Show all 112 references

7 of the 112 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & Van der Vleuten, C. P. M. (submitted for publication). Assessment in competence-based education: How can assessment quality be evaluated? Educational Research Review.
Mott, 2003, Applying an analytic writing rubric to children's hypermedia “narratives”, Early Childhood Research & Practice: An Internet Journal on the Development, Care, and Education of Young Children, 5

Sorted by citations

Items 301–400 of 1,001

Development and application of assessment standards to advanced written assignments
Miihkinen, A., & Virtanen, T. (2017) · Accounting Education · doi:10.1080/09639284.2017.1396480 · Cited by 19
“Jonsson and Svingby (2007) conclude in their review article that rubrics have the potential to promote learning and/or refine teaching, mainly because rubrics make expectations and criteria explicit, which also improves feedback and self-assessment.”
Background
Global Interprofessional Therapeutic Communication Scale© (GITCS©): Development and Validation
Campbell, S., & Aredes, N. D. (2019) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2019.05.006 · Cited by 17
Using a criterion-referenced rubric to enhance student learning: a case study in a critical thinking and writing module
Pui, P., Yuen, B., & Goh, H. (2020) · Higher Education Research & Development · doi:10.1080/07294360.2020.1795811 · Cited by 17
“The positive, albeit weak correlations between student-teacher rated scores for their task performance suggest that rubric use could help students assess and rate their own work, supporting previous studies (Jonsson & Svingby, 2007; Panadero & Jonsson, 2013).”
Result
Designing a rubric for reflection in nursing: a Legitimation Code Theory and systemic functional linguistics-informed framework
Monbec, L., Tilakaratna, N. L., Brooke, M., Lau, S. T., Chan, Y. S., & Wu, X. V. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1855414 · Cited by 17
STEAM Education for Enhancing Creativity in Packaging Design
Sakon, T., & Petsangsri, S. (2021) · Archives of Design Research · doi:10.15187/adr.2021.02.34.1.21 · Cited by 19
Linking Rubrics and Academic Performance: An Engagement Theory Perspective
Francis, J. (2018) · Journal of University Teaching and Learning Practice · doi:10.53761/1.15.1.2 · Cited by 17
“Various studies show that when students have little or no involvement with the otherwise available rubric, the effect on marks can be minimal or inconsistent (Jonsson & Svingby 2007; Panadero & Jonsson 2013).”
Background
Monitoring progression of clinical reasoning skills during health sciences education using the case method – a qualitative observational study
Orban, K., Ekelin, M., Edgren, G., Sandgren, O., Hovbrandt, P., & Persson, E. K. (2017) · BMC Medical Education · doi:10.1186/s12909-017-1002-4 · Cited by 19
“To increase the reliability of observations a rubric can be used, preferably complemented with examples [36] as was done in this study.”
Method
Estimating the Intra-Rater Reliability of Essay Raters
Cohen, Y. (2017) · Frontiers in Education · doi:10.3389/feduc.2017.00049 · Cited by 17
“Jonsson and Svingby (2007), for example, note that in their data base of 75 studies, only 7 studies report intra-rater reliability (consistency of the ratings), while the majority of the studies report measures of inter-rater (consensus) reliability.”
Background
On the design and validation of a rubric for the evaluation of performance in a musical contest
Álvarez-Díaz, M., Muñiz-Bascón, L. M., Soria-Alemany, A., Veintimilla-Bonet, A., & Fernández-Alonso, R. (2020) · International Journal of Music Education · doi:10.1177/0255761420936443 · Cited by 16
“Analysis of intra-rater reliability gave a mean Cronbach’s alpha of .94 which can be considered excellent (Hernández et al., 2016; Jonsson & Svingby, 2007).”
BackgroundMethod
Can assessment-specific marking criteria and electronic comment libraries increase student engagement with assessment and feedback?
Graham, A. I., Harner, C., & Marsham, S. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.1986468 · Cited by 19
“The provision of marking criteria does not in and of itself enhance learning (Jonsson and Svingby 2007; Panadero and Jonsson 2013), and detailed rubrics may lead students to focus on the mechanics of the task rather than on more complex skills and content (Norton 2004).”
Background
The effects of using analytical rubrics in peer and self-assessment on EFL students’ writing proficiency: a Vietnamese contextual study
Yen, P. H., Phan, Q. T., & Thảo, L. T. (2023) · Language Testing in Asia · doi:10.1186/s40468-023-00256-y · Cited by 16
“Besides, the use of rubrics can enhance both the reliability and the professionalization of writing assessments (Jonsson & Svingby, 2007).”
Method
Qualitative assessment of a challenge-based learning and teamwork applied in electronics program
Romero, S., Fonseca, D., Aláez, M., & Amo, D. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e22739 · Cited by 16
Investigation of primary mathematics student teachers’ concept images: cylinder and cone
Ertekin, E., Yazıcı, E., & Delice, A. (2013) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2013.868537 · Cited by 16
“Kendall w coefficients can be used as interrater reliability measurements.[41,43] In this study, percentage of agreement was used and it was determined that 196 of the 238 student teachers’ scores are the same.”
Method
Effect of a résumé‐writing workshop on résumé‐writing skills
Tillotson, K., & Osborn, D. S. (2012) · Journal of Employment Counseling · doi:10.1002/j.2161-1920.2012.00011.x · Cited by 16
An Evaluation of the Surgical Foundations Curriculum: A National Study
Kouzmina, E., Mann, S. M., Chaplin, T., & Zevin, B. (2020) · Journal of surgical education · doi:10.1016/j.jsurg.2020.10.002 · Cited by 16
Eliciting Teachers’ Practical Knowledge through Mentoring Conversations in Practicum Settings
Mena, J., & Clarke, A. (2015) · SensePublishers eBooks · doi:10.1007/978-94-6300-058-1_3 · Cited by 16
Reliability and validity test of a Scoring Rubric for Information Literacy
van Helvoort, A. A. J., Brand‐Gruwel, S., Huysmans, F., & Sjoer, E. (2017) · Journal of Documentation · doi:10.1108/jd-05-2016-0066 · Cited by 16
Examining student learning and perceptions in social annotation-based translation activities
Zhao, N., Gao, F., & Yang, D. (2018) · Interactive Learning Environments · doi:10.1080/10494820.2017.1421564 · Cited by 17
“Both exceeded the acceptable values (Jonsson & Svingby, 2007; Stemler, 2004).”
BackgroundInfluential
Solving instructional design dilemmas to develop a Video Enhanced Rubric with modeling examples to support mental model development of complex skills: the Viewbrics-project use case
Ackermans, K., Rusman, E., Brand‐Gruwel, S., & Specht, M. M. (2019) · Educational Technology Research and Development · doi:10.1007/s11423-019-09668-1 · Cited by 16
“A rubric is an assessment tool for the qualitative rating of complex student performance (Jonsson and Svingby 2007).”
Method
Validation of a novel intraoperative assessment tool: The Surgical Procedure Feedback Rubric
Toprak, A., Luhanga, U., Jones, S., WINTHROP, A. L., & McEwen, L. A. (2015) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2015.08.032 · Cited by 16
Assessment as a Learning Tool in a Flipped English Language Classroom in Higher EducationPreprint
Journal, A. W. E., Khalil, R. M. R., & Shahu, K. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2895534 · Cited by 18
“There is a strong conviction that the use of performance assessment in combination with rubrics has a positive impact on students’ efforts and learning (Jonsson & Svingby, 2007).”
Background
Preservice teachers’ enactment of formative assessment using rubrics in the inquiry-based chemistry laboratory
Zemel, Y., Shwartz, G., & Avargil, S. (2021) · Chemistry Education Research and Practice · doi:10.1039/d1rp00001b · Cited by 16
Teaching second-grade students to write science expository text: Does a holistic or analytic rubric provide more meaningful results?
Imbler, A. C., Clark, S., Young, T. A., & Feinauer, E. (2022) · Assessing Writing · doi:10.1016/j.asw.2022.100676 · Cited by 15
Having qualified arguments: Promoting Pre-service teachers’ critical thinking through deliberate computer-assisted argument mapping practices
Yilmaz-Na, E., & Sönmez, E. (2022) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2022.101216 · Cited by 15
Self-regulation of peer feedback quality aspects through different dimensions of experience within prior peer feedback assignments
Zhang, Y., & Schunn, C. D. (2023) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2023.102210 · Cited by 19
The Impact of Assessment for 21st Century Skills in Higher Education Institutions: A Narrative Literature Review
Long, C., Sam, R., Ny, C., Chhang, C., Ren, R., Ngork, C., Sorn, R., Sorn, M., & Sor, C. (2024) · International Journal of Advance Social Sciences and Education (IJASSE) · doi:10.59890/ijasse.v2i1.1378 · Cited by 15
“Moreover, rubrics can be tailored to assess specific dimensions of 21st-century skills, allowing educators to emphasize key aspects such as problem-solving strategies, teamwork dynamics, and the quality of communication and presentation (Jonsson & Svingby, 2007).”
Background
Impact of self-assessment on dental student’s performance in pre-clinical conservative dentistry course
Mittal, P., Jadhav, G. R., Pawar, M., Banerjee, S., Wangaskar, S. A., Blasio, M. D., Cervino, G., & Minervini, G. (2024) · BMC Oral Health · doi:10.1186/s12903-024-04140-w · Cited by 15
“By using rubrics in self- assessment, it is possible to measure the level of learning and performance of students in different learning areas [45, 46].”
Why does a self-learning environment matter? Motivational support of teachers and peers, enjoyment and learning strategies
Schweder, S., & Raufelder, D. (2024) · Learning and Motivation · doi:10.1016/j.lmot.2024.102067 · Cited by 15
Rubrics as Assessment, Evaluation and Scoring Tools
Muhammad, A., Lebar, O., & Mokshein, S. E. (2018) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v8-i10/5309 · Cited by 15
“The rubric is beneficial in terms of: • Saving time, facilitating and speeding up the feedback process (Churches, 2015; Jonsson & Svingby, 2007; Reynolds-Keefer, 2010; Stevens & Levi, 2013) • Helping to explain learning goals and standards (Andrade & Du, 2005; Hattie & Timperley, 2007) • Improving…”
Background
FOPA-MC: fuzzy multi-criteria group decision making for peer assessment
Capuano, N., Caballé, S., Percannella, G., & Ritrovato, P. (2020) · Soft Computing · doi:10.1007/s00500-020-05155-5 · Cited by 15
“Several researchers have pointed out that reliability of assessment is improved when a rubric is used Jonsson and Svingby (2007), Rezaei and Lovorn (2010), especially where grading is less objective, such as in the area of arts, humanities and social sciences.”
BackgroundInfluential
An Assessment Using Rubrics and the Rasch Model of 14/15-Year-Old Students’ Difficulties in Arguing About Bottled Water Consumption
Mora, F. R., Robles, D. C., & López, Á. B. (2021) · Research in Science Education · doi:10.1007/s11165-020-09985-z · Cited by 15
Das unvergleichliche Abitur
Hoffmann, L., Schröter, P., Groß, A., Schmid-Kühn, S. M., & Stanat, P. (2022) · doi:10.3278/9783763972494 · Cited by 15
Evaluation of open items using the many-facet Rasch model
Toffoli, S. F. L., de Andrade, D. F., & Bornia, A. C. (2015) · Journal of Applied Statistics · doi:10.1080/02664763.2015.1049938 · Cited by 15
“It is believed that the open-question exams may not only offer more opportunity for the examinees to answer more practically and realistically, but also provide more valid information on the skills that are being evaluated [11,25].”
Background
Development and evaluation of a summative assessment program for senior teacher competence
Bakx, A. W. E. A., Baartman, L. K. J., & van Schilt-Mol, T. (2013) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2013.11.004 · Cited by 20
Weaving Together Science and English: An Interconnected Model of Language Development for Emergent Bilinguals
Ciechanowski, K. (2014) · Bilingual Research Journal · doi:10.1080/15235882.2014.963737 · Cited by 15
“Jonsson and Svingby (2007) report that rubrics “enhance the consistency of scoring across students, assignments, as well as between different raters” (p. 132).”
Background
The Surprising Foil to Online Education: Why Students Won’t Give Up Paper Textbooks
McNeish, J., Foster, M. K., Francescucci, A., & West, B. (2012) · Journal for Advancement of Marketing Education · doi:10.63963/001c.150532 · Cited by 15
Evaluación de recursos tecnológicos didácticos mediante e-rúbricas
Barrera, A. G. (2016) · Revista de Educación a Distancia (RED) · doi:10.6018/red/49/13 · Cited by 15
“En este contexto surge el auge de las rúbricas, entendidas como (Jonsson & Svingby, 2007; Fernández March, 2010; Reddy & Andrade, 2010; Cebrián y Monedero, 2014; Valverde y Ciudad, 2014; Marín-García y Santandreu-Mascarell, 2015) documentos que: a) describen los criterios que se van a seguir para…”
Background
Impact of AWE Rubrics and Automated Assessment on EFL Writing Instruction
Tang, J., & Wu, Y. (2017) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.2017040104 · Cited by 15
Analytic or Holistic: A Study of Agreement Between Different Grading Models
Jönsson, A., & Balan, A. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/mg59-xq60 · Cited by 15
Towards Universal Accessibility on the Web: Do Grammar Checking Tools Improve Text Readability?
Kaushik, H. M., Eika, E., & Sandnes, F. E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49282-3_19 · Cited by 15
Understanding Finnish student craft teachers’ conceptions of sustainability
Väänänen, N., Vartiainen, L., Kaipainen, M., Pitkäniemi, H., & Pöllänen, S. (2018) · International Journal of Sustainability in Higher Education · doi:10.1108/ijshe-11-2017-0200 · Cited by 14
Building Better Courses: Examining the Content Validity of the iNACOL National Standards for Quality Online Courses
Adelstein, D., & Barbour, M. K. (2016) · Touro Scholar (Touro College) · Cited by 14
An Assessment Framework for First-Year Introduction to Engineering Courses
Purzer, Ş., Douglas, K. A., Folkerts, J., & Williams, T. (2018) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--27552 · Cited by 14
How do student teachers reflect on their practice through practicum courses? A case study from Iran
Azimi, E., Kuusisto, E., Tirri, K. A., & Hatami, J. (2019) · Journal of Education for Teaching International Research and Pedagogy · doi:10.1080/09589236.2019.1599511 · Cited by 14
“This framework can be considered as a reliable tool for assessing the reflection performance, even though it faces challenges to ‘facilitate valid judgment of performance assessment per se’ (Jonsson and Svingby 2007, 130).”
Method
Evaluación de la competencia oral con rúbricas digitales para el Espacio Iberoamericano del Conocimiento
Medina, C. R. F., Guerrero, C. R. L., Rey, F. J. R., Rivera, D., Andrade-Vargas, L., & de la Serna, M. C. (2021) · Pixel-Bit Revista de Medios y Educación · doi:10.12795/pixelbit.83050 · Cited by 14
Examining Pre-Service Teachers’ Critical Thinking Competences within the Framework of Education for Sustainable Development: A Qualitative Analysis
Christodoulou, P., & Papanikolaou, A. (2023) · Education Sciences · doi:10.3390/educsci13121187 · Cited by 14
INTEGRATING ETHICS AND PROFESSIONALISM IN ACCOUNTING EDUCATION FOR SECONDARY SCHOOL STUDENTS
Babalola, F. I., Oriji, O., Oladayo, G. O., Abitoye, O., & Daraojimba, C. (2023) · International Journal of Management & Entrepreneurship Research · doi:10.51594/ijmer.v5i12.622 · Cited by 14
Evaluating the Impact of an Educational Intervention Using Project-Based Learning on Postpandemic Recovery in Rural Colombia
Arrieta-Cohen, M. C., Torres-Arizal, L. A., & Gómez-Yepes, R. L. (2024) · Education Sciences · doi:10.3390/educsci14121341 · Cited by 14
Sustainable Engineering Assessment Using Rubric-Based Analysis of Challenge Question Responses
McCormick, M., Lawyer, K., Wiggins, J., Swan, C. W., Paterson, K. G., & Bielefeldt, A. R. (2014) · Journal of Professional Issues in Engineering Education and Practice · doi:10.1061/(asce)ei.1943-5541.0000211 · Cited by 17
“6 (Jonsson and Svingby 2007).”
The Rubric: An Assessment Tool to Guide Students and Markers
Cox, G. C., Morrison, J., & Brathwaite, B. (2015) · International Conference on Higher Education Advances (HEAd) · doi:10.4995/head15.2015.414 · Cited by 14
Flipping to Teach the Conceptual Foundations of Successful Workplace Writing
Campbell, K. S. (2015) · Business and Professional Communication Quarterly · doi:10.1177/2329490615608847 · Cited by 15
“Use of rubrics promotes learning and improves instruction partly because it makes foundational concepts explicit (Jonsson & Svingby, 2007).”
Background
Design and Validation of a Rubric to Assess the Use of American Psychological Association Style in scientific articles
Merma-Molina, G., Alfaro, H. P., & González, S. R. P. A. (2017) · Journal of New Approaches in Educational Research · doi:10.7821/naer.2017.1.220 · Cited by 14
“…precision appears (Brown, Glasswell, & Harland, 2004), which refers to the psychometric position of quality between validity and reliability indicators, which is normally expressed by an exact percentage of correlation between the two factors (Cho, Schunn, & Wilson, 2006; Jonsson & Svingby, 2007).”
Applying a Thurstonian, Two-Stage Method in the Standardized Assessment of Writing
McGrane, J. A., Humphry, S. M., & Heldsinger, S. (2018) · Applied Measurement in Education · doi:10.1080/08957347.2018.1495216 · Cited by 14
“…involved in the matching task had separately undertaken NAPLAN rubric training and so they likely drew on some of this experience when making their matching judgments, which may have enhanced the efficiency of these judgments (Heldsinger & Humphry, 2013; Jonsson & Svingby, 2007; Shermis, 2014).”
BackgroundMethod
A surgical skills assessment rubric for pterygium surgery
Zarei-Ghanavati, M., Ghassemi, H., Salabati, M., Mahmoudzadeh, R., Liu, C., Daniell, M. D., Huang, A., Kheirkhah, A., & Djalilian, A. R. (2020) · The Ocular Surface · doi:10.1016/j.jtos.2020.02.004 · Cited by 14
Rúbrica de evaluación. Usos y aprendizajes en un grupo de docentes universitarios
Kweksilber, C., & Trías, D. (2020) · Páginas de Educación · doi:10.22235/pe.v13i2.2234 · Cited by 14
Inter-rater reliability of query/probe-based techniques for measuring situation awareness
Lau, N. K. C., Jamieson, G. A., & Skraaning, G. (2014) · Ergonomics · doi:10.1080/00140139.2014.910612 · Cited by 14
“Jonsson and Svingby (2007) reviewed the literature in education, concluding that topic-speciﬁc and analytical scoring rubrics could improve inter-rater reliability.”
Background
The Implementation of Self-Assessment in EFL Writing Classroom: An Experimental Study
Meihami, H., & Varmaghani, Z. (2013) · International Letters of Social and Humanistic Sciences · doi:10.18052/www.scipress.com/ilshs.9.39 · Cited by 14
Generic Assessment Rubrics for Computer Programming Courses
Mustapha, A., Samsudin, N. A., Arbaiy, N. B., Mohammed, R., & Hamid, I. R. A. (2016) · The Turkish Online Journal of Educational Technology · Cited by 14
The behavioural process underlying augmentative and alternative communication usage in direct support staff
Rombouts, E., Maes, B., & Zink, I. (2016) · Journal of Intellectual & Developmental Disability · doi:10.3109/13668250.2016.1219023 · Cited by 14
“As the agreement between coders was rather low (Cordes, 1994; Kazdin, 2011) but may have been dependent on the proficiency of the student coders (Cordes, 1994; Jonsson & Svingby, 2007), intrarater reliability was calculated.”
Background
Authentic Assessment Design in Accounting Courses: A Literature Review
Nkhoma, C., Nkhoma, M. Z., & Tu, K. G. C. K. L. (2018) · Issues in Informing Science and Information Technology · doi:10.28945/4036 · Cited by 15
“While rubrics can help facilitate the grading of assignments, the key benefit of rubrics is the promotion of learning (J. S. Anderson & Mohrweis, 2008; Jonsson & Svingby, 2007).”
Background
Assessing creative outcomes in studio-based learning: a comparative assessment of analytical rubrics
Abdellatif, R. A., & El-Wakeel, H. A. (2024) · International Journal of Design Creativity and Innovation · doi:10.1080/21650349.2024.2426645 · Cited by 13
“…be effective, fair and consistent, and optimize its use in assessment and learning of complex competencies in studio-based learning, it must undergo a validation process to be fully effective and enhance the reliability of grading (Jonsson & Svingby, 2007; Menéndez-Varela & Gregori-Giralt, 2018).”
Assessing the ability of generative AI in English literary analysis through Bloom’s Taxonomy
Chan, C. K. Y., & Wong, H. Y. H. (2025) · Discover Computing · doi:10.1007/s10791-025-09572-8 · Cited by 23
“Analytic rubrics were adopted in this study due to their ability to provide detailed insights into ChatGPT’s performance at each cognitive level, allowing for a more comprehensive understanding of its strengths and limitations [46].”
Efficacy of a knowledge translation approach in changing allied health practitioner use of evidence-based practices with children with cerebral palsy: a before and after longitudinal study
Imms, C., Kerr, C., Bowe, S. J., Karlsson, P., Novak, I., Shields, N., Reddihough, D. S., & the Best Service Best Time Author Group (2020) · Disability and Rehabilitation · doi:10.1080/09638288.2020.1727576 · Cited by 13
Students’ Perceptions of Instructional Rubrics in Neurological Physical Therapy and Their Effects on Students’ Engagement and Course Satisfaction
García-Ros, R., Ruescas-Nicolau, M.-A., Serrano, N. C., Carrasco, J. J., Pérez‐Alenda, S., Sastre-Arbona, C., Valenzuela, C. S. M., Flor-Rufino, C., & Sánchez-Sánchez, M. L. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18094957 · Cited by 13
Implementation of Specifications Grading in an Upper-Division Chemical Biology Lecture Course
Kelz, J. I., Uribe, J. L., Rasekh, M. F., Takahashi, G. R., Gibson, W. S., Link, R. D., McKnelly, K. J., & Martin, R. W. (2023) · The Biophysicist · doi:10.35459/tbp.2022.000239 · Cited by 13
“This does a disservice to students as individuals by denying them effective opportunities to learn through reflection 49,50 as they work toward the ultimate goal of becoming self-regulated learners 51 , as well as to the broader scientific community if we are complicit in accepting the loss of…”
Assessment rubrics: thinking inside the boxes
Bennett, C. (2016) · Learning and Teaching · doi:10.3167/latiss.2016.090104 · Cited by 17
Teaching optics as inquiry under lockdown: how we transformed a teaching-learning sequence from face-to-face to distance teaching
Carli, M., Fontolan, M. R., & Pantano, O. (2021) · Physics Education · doi:10.1088/1361-6552/abcca7 · Cited by 13
“Research suggests that formative, task-specific, rubric-referenced self-assessment can contribute positively to students’ learning [18, 19].”
Competencias Profesionales de Futuros Docentes de Educación Secundaria. Estudio de Caso de la Evaluación Formativa Promovida Mediante e-Rubricas en la Especialidad de Física Y Química
Cobos, T. L., & González, M. C. (2021) · Profesorado Revista de Currículum y Formación del Profesorado · doi:10.30827/profesorado.v25i1.8374 · Cited by 13
Supervisors’ untrained postgraduate rubric use for formative and summative purposes
Postmes, L., Bouwmeester, R. A. M., de Kleijn, R. A. M., & van der Schaaf, M. F. (2022) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.2021390 · Cited by 15
“Higher education research performed in the past decades shows a considerable interest in rubrics (Jonsson and Svingby 2007; Reddy and Andrade 2010; Panadero and Jonsson 2013; Brookhart 2018; Panadero and Jonsson 2020).”
Background
Assessment of Context-Based Chemistry Problem-Solving Skills: Test Design and Results from Ninth-Grade Students
Chi, S., Wang, Z., & Liu, X. (2022) · Research in Science Education · doi:10.1007/s11165-022-10056-8 · Cited by 13
“Inter-rater reliability was checked to ensure scoring reliability (Jonsson & Svingby, 2007).”
Method
Is University Students’ Self-Assessment Accurate?
Cruz, A. M. B., Tacoronte, D. V., & González-Betancor, S. M. (2014) · Innovation, technology and knowledge management · doi:10.1007/978-3-319-10804-9_2 · Cited by 13
“…that makes it possible to rate the quality of students’ contributions and performance levels in different areas, specifying, before doing the activity, the factors or variables that will be analyzed and the requirements for each (Andrade & Du, 2005 ; García-Ros, 2011 ; Jonsson & Svingby, 2007 ).”
Background
The effect of using games in teaching conservation
Tan, C. K. W., Lee, J. W., Hii, A., Loo, Y. Y., Campos‐Arceiz, A., & Macdonald, D. W. (2018) · PeerJ · doi:10.7717/peerj.4509 · Cited by 13
“Our inter-observer correlation coefficients were 0.71, 0.78, 0.72 and 0.80 for 305 Diploma 2015, Diploma 2016, WCC 2015 and WCC 2016 respectively and thus above the 306 recommended criterion of >70% or greater (Jonsson & Svingby 2007).”
MethodInfluential
Evaluating the Impact of EBP Education: Development of a Modified Fresno Test for Acute Care Nursing
Halm, M. A. (2018) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12291 · Cited by 13
Learning to See New Things: Using Criteria to Support Pre-service Teachers' Discernment in the Context of Teachers' Relational Work
Holmstedt, P., Jönsson, A., & Aspelin, J. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00054 · Cited by 15
“This understanding of criteria is also reflected in findings from empirical research, where several research reviews suggest that explicit criteria (in the form of scoring rubrics) may have the potential to promote student learning by clarifying expectations, but not without a thorough implementation (Jonsson and Svin…”
Result
Writing Matrix and Assessing Literature Review: A Methodological Element of a Scientific Project
Murniarti, E., Nainggolan, B., Panjaitan, H., Pandiangan, L. E. A., Widyani, I. D. A., & Dakhi, S. (2018) · Journal of Asian Development · doi:10.5296/jad.v4i2.13895 · Cited by 13
“Furthermore, Johnsson and Svingby (2007) concluded that the reliable scoring of performance assessments can be enhanced by the use of rubrics, especially if they are analytic, topic-specific, and complemented with exemplars and or rater training; rubrics do not facilitate valid judgment of…”
Background
Development and Reliability Testing of the Sweeney-Clark Simulation Evaluation Rubric©
Sweeney, L., Rollins, M. C., Gantt, L. T., Swanson, M., & Ravitz, J. L. (2019) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2019.04.002 · Cited by 13
Writing Development in Struggling Learners
Miller, B., McCardle, P., & Connelly, V. J. (2018) · BRILL eBooks · doi:10.1163/9789004346369 · Cited by 13
An Insight into Teachers’ Classroom Practices: The Case of Secondary Education Science Teachers
Sofianidis, A., & Kallery, M. (2021) · Education Sciences · doi:10.3390/educsci11100583 · Cited by 13
“Questionnaire reliability is usually assessed by calculating the Cronbach’s Alpha coefficient, while a rubric’s reliability is usually assessed by calculating the Spear an rho for data gathered by t o or ore observers [34].”
Method
Assessing Teacher Competency During Practicum
Jönsson, A., & Mattsson, M. (2011) · SensePublishers eBooks · doi:10.1007/978-94-6091-711-0_9 · Cited by 13
What predicts variation in reliability and validity of online peer assessment? A large‐scale cross‐context study
Xiong, Y., Schunn, C. D., & Wu, Y. (2023) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12861 · Cited by 13
Analysis of online rubric platforms: advancing toward erubrics
Panadero, E., Fernández-Ortube, A., Krebs, R., & Roelle, J. (2024) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2024.2345657 · Cited by 12
“The empirical reviews show that rubrics can enhance the quality of summative assessment, such as increasing scoring reliability (Jonsson and Svingby 2007), and they can also increase students’ academic performance, metacognitive and self-regulatory strategies among others (Panadero et al. 2024).”
Rubric Development and Validation for Assessing Tasks' Solving via AI Chatbots
Hmoud, M., Swaity, H., Anjass, E., & Ramírez, E. M. A. (2024) · The Electronic Journal of e-Learning · doi:10.34190/ejel.22.6.3292 · Cited by 18
“Performance scores, ranging from 1 to 5, are assigned based on the extent to which performance indicators are met by the student, with higher scores indicating a better level of standard achievement (Chi, 2013; Jonsson and Svingby, 2007; Stanley, 2021).”
Assessment and Recognition of Open Learning
Camilleri, A. F., & Tannhäuser, A.-C. (2013) · Emerald Group Publishing Limited eBooks · doi:10.1108/s2051-2295(2013)0000000004 · Cited by 12
Revisiting the Writing Assessment Process at a Saudi English Language Institute: Problems and Solutions
Alshakhi, A. (2018) · English Language Teaching · doi:10.5539/elt.v12n1p176 · Cited by 12
“Similarly, Jonsson and Svingby (2007) carried out a text analysis of 75 relevant studies regarding the usefulness of analytic scoring.”
Background
Inter-rater Reliability of a Clinical Documentation Rubric Within Pharmacotherapy Problem-Based Learning Courses
Villa, K. R., Sprunger, T. L., Walton, A. M., Costello, T. J., & Isaacs, A. N. (2020) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7648 · Cited by 12
“To properly incorporate clinical documentation, colleges of pharmacy use evaluation as part of their teaching and learning processes in addition to curriculum design; however, this can be a challenging task.(3-11) One challenge to evaluation globally, but specifically with clinical documentation, is the subjective nat…”
BackgroundMethodInfluential
Implementing specifications grading in MPA courses: A potential strategy for better work-life balance
Jones, P. A. (2020) · Journal of Public Affairs Education · doi:10.1080/15236803.2020.1773713 · Cited by 12
“Generally, students and faculty have viewed the use of rubrics positively (Jonsson & Svingby, 2007; Reddy & Andrade, 2010), regarding them as more transparent than traditional scoring.”
Developing a Generic Rubric for Evaluating Students' Work in STEM Education
Huang, B., & Jong, M. S. (2020) · International Symposium on Educational Technology · doi:10.1109/iset49818.2020.00053 · Cited by 12
“In comparison to traditional scoring tests for multiple-choice and short answers, rubrics are more compatible with open-ended tasks that allow for open responses and the elicitation of higher-order thinking [16].”
Background
Does Benchmarking of Rating Scales Improve Ratings of Search Performance Given by Specialist Search Dog Handlers?
Clark, C. C. A., & Rooney, N. J. (2021) · Frontiers in Veterinary Science · doi:10.3389/fvets.2021.545398 · Cited by 12
Capstone portfolios and geography student learning outcomes
Mossa, J. (2014) · Journal of Geography in Higher Education · doi:10.1080/03098265.2014.958659 · Cited by 12
“Research on rubrics has suggested that they improve consistency in scoring, better communicate expectations and performance to students, measure student progress over time, facilitate the evaluation of complex and subjective skills, and promote learning (Jonsson & Svingby, 2007).”
Background
Diseño de una rúbrica para evaluar las competencias del Prácticum del Grado en Fisioterapia. Percepción de su utilidad por los estudiantes
Ramírez, N. L. M., Alonso, M. R., López, M. J. T., & Gallego, T. (2014) · Fisioterapia · doi:10.1016/j.ft.2014.06.005 · Cited by 12
An Algorithm for Peer Review Matching in Massive Courses for Minimising Students' Frustration
Kloos, C. D., Ayres, I. E., Fisteus, J. A., & Crespo-García, R. M. (2020) · e-Archivo (Carlos III University of Madrid) · doi:10.3217/jucs-019-15-2173 · Cited by 12
Exploring the Effectiveness of Implementing Seminars as a Teaching and an Assessment Method in a Children’s Literature Course
Al’Adawi, S. S. A. (2017) · English Language Teaching · doi:10.5539/elt.v10n11p1 · Cited by 12
A Preliminary Instrument for Measuring Students’ Subjective Perceptions of Difficulties in Learning Recursion
Lacave, C., Molina, A. I., & Redondo, M. Á. (2017) · IEEE Transactions on Education · doi:10.1109/te.2017.2758346 · Cited by 12
“and can serve as a basis for the interpretation of the results in different populations [22].”
Background
La rúbrica de evaluación de la competencia en expresión escrita. Percepción del alumnado sobre su funcionalidad.
Ruiz-Terroba, R., Cano, E. V., & Sevillano-García, M. L. (2017) · Ocnos Revista de Estudios sobre Lectura · doi:10.18239/ocnos_2017.16.2.1349 · Cited by 12
Protocol: Literature review on the psychometric properties of the short versions of the scales of social desirability in the answers to competency self-assessment questionnaires
Marin-Garcia, J. A., Betancour, E., & Giraldo-O’Meara, M. (2018) · WPOM - Working Papers on Operations Management · doi:10.4995/wpom.v9i1.9172 · Cited by 13
“…de si, en general, los alumnos o los profesionales pueden ser unos buenos evaluadores de sus propias competencias o habilidades (De Grez et al., 2012; Diez et al., 2013; García-Ros, 2011; Gopinath, 1999; Jonsson & Svingby, 2007; Leach, 2010; Marin-Garcia & SantandreuMascarell, 2015; Stefani, 1994).”
Background
Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework
Hodwitz, K., Tays, W. J., & Reardon, R. (2018) · Canadian Medical Education Journal · doi:10.36834/cmej.42286 · Cited by 12
Does audience matter? Comparing teachers’ and non-teachers’ application and perception of quality rubrics for evaluating Open Educational Resources
Yuan, M., & Recker, M. M. (2018) · Educational Technology Research and Development · doi:10.1007/s11423-018-9605-y · Cited by 18
“One benefit of using rubrics in evaluation tasks is that they are assumed to make judgments more reliable (Jonsson & Svingby, 2007).”
Influential
ODNI as an analytic ombudsman: is Intelligence Community Directive 203 up to the task?
Marcoci, A., Vercammen, A., & Burgman, M. A. (2018) · Intelligence & National Security · doi:10.1080/02684527.2018.1546265 · Cited by 12
Teachers’ cognitions and handling strategies regarding bully-victims
Sung, Y., Lu, C.-Y., Chen, L., & Valcke, M. (2018) · Research Papers in Education · doi:10.1080/02671522.2018.1547919 · Cited by 12
“The qualitative data was coded individually and independently by two researchers involved in this study (Jonsson and Svingby 2007).”
Method
The English Language Proficiency Assessment for the 21st Century (ELPA21)
Huang, B. H., & Flores, B. B. (2018) · Language Assessment Quarterly · doi:10.1080/15434303.2018.1549241 · Cited by 12
“Furthermore, research on the use of rubrics has indicated the requirement of rater training for the rubrics to be effective (Jonsson & Svingby, 2007; Rezaei & Lovorn, 2010).”
Background

Authors: Jonsson, A., & Svingby, G.
Affiliations: Malmö University (SE)
Venue: Educational Research Review
Publisher: Elsevier BV
Published: 2007-01
Volume: 2
Issue: 2
Pages: 130-144
ISSN: 1747-938X (ISSN-L)
DOI: 10.1016/j.edurev.2007.05.002
OpenAlex: W2115389369
Cited by: 1,509
References: 112
Citations by year: 2026: 221 · 2025: 145 · 2024: 91 · 2023: 100 · 2022: 93 · 2021: 94 · 2020: 108 · 2019: 90 · 2018: 137 · 2017: 103 · 2016: 66 · 2015: 73 · 2014: 70 · 2013: 42 · 2012: 34
FWCI: 27.98
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Educational Research Review (publishedVersion)
Malmö University Publications (Malmö University) (submittedVersion)
Topics: Social Sciences › Education › Student Assessment and Feedback
Social Sciences › Education › Educational Assessment and Pedagogy
Social Sciences › Education › Teacher Education and Assessments
Keywords: rubrics, performance evaluation, scoring reliability, assessment validity, rater training, exemplars, analytic rubrics, rubric validation, learning promotion, feedback, self-assessment, teaching improvement

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The use of scoring rubrics: Reliability, validity and educational consequences

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks