The use of scoring rubrics: Reliability, validity and educational consequences

Jonsson, Anders, Svingby, Gunilla·2007·Educational Research Review

DOI 10.1016/j.edurev.2007.05.002

Cited by (1,001)

Items 101–200 of 1,001

Machine Learning and Hebrew NLP for Automated Assessment of Open-Ended Questions in Biology
Moriah Ariely, Tanya Nazaretsky, Giora Alexandron · 2022 · International Journal of Artificial Intelligence in Education
Holistic versus Analytic Evaluation of EFL Writing: A Case Study
Thikra Kaed Ali Ghalib, Abdulghani Ali Al-Hattami · 2015 · English Language Teaching
Assuring the quality of standards-oriented classroom assessment with rubrics for complex competencies
Robbert Smit, Thomas Birri · 2014 · Studies In Educational Evaluation
Effects of self-assessment scripts on self-regulation and learning
J. Alonso-Tapia, E. Panadero · 2010 · Journal for the Study of Education and Development Infancia y Aprendizaje
Fostering oral presentation performance: does the quality of feedback differ when provided by the teacher, peers or peers guided by tutor?
Stan O. van Ginkel, Judith T. M. Gulikers, Harm J. A. Biemans, Martin Mulder · 2016 · Assessment & Evaluation in Higher Education
Aligning formative and summative assessments: A collaborative action research challenging teacher conceptions
Judith T. M. Gulikers, Harm J. A. Biemans, R. Wesselink, Marjan van der Wel · 2013 · Studies In Educational Evaluation
The Use of Rubrics in Benchmarking and Assessing Employability Skills
Linda Riebe, Denise A Jackson · 2014 · Organizational Behavior Teaching Review
Teacher judgments in school exams: Influences of students' lower-order-thinking skills on the assessment of students’ higher-order-thinking skills
Thorben Jansen, Jens Møller · 2021 · Teaching and Teacher Education
Making sense of quality teaching and learning in higher education in Ethiopia: Unfolding existing realities for future promises
Tefera Tadesse, Catherine E. Manathunga, Robyn Margaret Gillies · 2018 · Journal of University Teaching and Learning Practice
Future teachers’ general pedagogical knowledge from a comparative perspective: does school experience matter?
Johannes König, Sigrid Blömeke · 2012 · ZDM
La evaluación de competencias en Educación Superior mediante rúbricas: un caso práctico
María Paz García Sanz · 2014 · Revista Electrónica Interuniversitaria de Formación del Profesorado
A prospective comparison of live and video-based assessments of colonoscopy performance
Michael A. Scaffidi, Samir C. Grover, Heather Carnahan, Jeffrey J. Yu, Elaine Yong, Geoffrey C. Nguyen, Simon C. Ling, Nitin V. Khanna, Catharine M. Walsh · 2017 · Gastrointestinal Endoscopy
Automated formative writing assessment using a levels of language framework
Joshua Wilson, Rod D. Roscoe, Yusra Ahmed · 2017 · Assessing Writing
Rubrics in higher education: an exploration of undergraduate students’ understanding and perspectives
Benjamin L. Taylor, Flora Kisby, Alice Reedy · 2024 · Assessment & Evaluation in Higher Education
Using calibrated exemplars in the teacher-assessment of writing: an empirical study
Sandra Heldsinger, Stephen Mark Humphry · 2013 · Educational Research
Improving Students With Rubric-Based Self-Assessment and Oral Feedback
Sebastian Barney, Mahvish Khurum, Kai Petersen, Michael Unterkalmsteiner, Ronald Jabangwe · 2011 · IEEE Transactions on Education
International and domestic tourists’ “a priori” and “in situ” image differences and the impact of direct destination experience on destination image: the case of Linz, Austria
Elitza Iordanova, Dimitrios Stylidis · 2017 · Current Issues in Tourism
Teamwork skill assessment: Development of a measure for academia
Otmar E. Varela, Esther L. Mead · 2018 · Journal of Education for Business
Information and communication technologies and climate change adaptation in Latin America and the Caribbean: a framework for action
Hallie C. Eakin, Pedro M. Wightman, David Hsu, Vladimir R. Gil Ramón, Eduardo Fuentes‐Contreras, Megan P. Cox, Tracy-Ann Hyman, Carlos Pacas, Fernando Borráz, Claudia N. González-Brambila et al. · 2014 · Climate and Development
Measuring pre-service teachers' professional vision of inclusive classrooms: A video-based comparative judgement instrument
Karolien Keppens, Els Consuegra, Maarten Goossens, Sven De Mæyer, Ruben Vanderlinde · 2018 · Teaching and Teacher Education
Marking as judgment
Brooks, Val · 2012 · Research Papers in Education
Understanding the Effectiveness of Online Peer Assessment: A Path Model
Jing-Yan Lu, Zhidong Zhang · 2012 · Journal of Educational Computing Research
Mobile app selection for 5th through 12th grade science: The development of the MASS rubric
Lucy Santos Green, Richard P. Hechter, P. Dawn Tysinger, Karen D. Chassereau · 2014 · Computers & Education
Evaluación formativa de los aprendizajes en el contexto universitario: resistencias y paradojas del profesorado
Leonor Margalef García · 2014 · Educación XX1
Students’ perceptions of the peer-feedback experience in MOOCs
Julia Kasch, Peter van Rosmalen, Ansje Löhr, Roland Klemke, Alessandra Antonaci, Marco Kalz · 2021 · Distance Education
Teacher candidate performance assessments: Local scoring and implications for teacher preparation program improvement
Kevin C. Bastian, Gary T. Henry, Yi Pan, Diana B. Lys · 2016 · Teaching and Teacher Education
Behaviorally anchored rating scales: An application for evaluating teaching practice
Michelle P. Martín‐Raugh, Richard J. Tannenbaum, Cynthia M. Tocci, Clyde M. Reese · 2016 · Teaching and Teacher Education
Use of universal screening scores to predict distal academic and behavioral outcomes: A multilevel approach.
Katie R. Eklund, Stephen Patrick Kilgus, Nathaniel P. von der Embse, Megan Beardmore, Nick Tanner · 2016 · Psychological Assessment
A critique of grading: Policies, practices, and technical matters
Lorin W. Anderson · 2018 · Education Policy Analysis Archives
Twelve tips for assessing medical knowledge with open-ended questions: Designing constructed response examinations in medical education
Karen E. Hauer, Christy Boscardin, Judith M Brenner, Sandrijn M. van Schaik, Klara K. Papp · 2019 · Medical Teacher
Dance, ten; looks, three: Why rubrics matter
Deborah J. Crusan · 2015 · Assessing Writing
Performance Assessments for English Language Learners.
Jamal Abedi · 2010
Reviewing and analyzing peer review Inter-Rater Reliability in a MOOC platform
Félix García-Loro, Sergio Martín, José A. Ruipérez‐Valiente, Elio Sancristobal, Manuel A. Castro · 2020 · Computers & Education
Changes in classroom assessment practices during emergency remote teaching due to COVID-19
Ernesto Panadero, Juan Fraile, Leire Pinedo, Carlos Felipe Rodríguez-Hernández, Fernando Díez · 2022 · Assessment in Education Principles Policy and Practice
Increasing the effectiveness of automated assessment by increasing marking granularity and feedback units
Nickolas Falkner, Rebecca Vivian, David Piper, Katrina E. Kerry Falkner · 2014 · ACM Technical Symposium on Computer Science Education (SIGCSE)
Design and Validation of Patient-Centered Communication Tools (PaCT) to Measure Students’ Communication Skills
Gloria R. Grice, Nicole M. Gattas, Theresa R. Prosser, Mychal A. Voorhees, Clark D. Kebodeaux, Amy M. Tiemeier, Tricia M. Berry, Alexandria Garavaglia Wilson, Janelle Mann, Paul Juang · 2017 · American Journal of Pharmaceutical Education
A scoring rubric for performance assessment of information literacy in Dutch higher education
A.A.J. van Helvoort · 2010 · Journal of Information Literacy
College student perceptions of writing errors, text quality, and author characteristics
Adam C. Johnson, Joshua Wilson, Rod D. Roscoe · 2017 · Assessing Writing
A Web-Based Serious Game on Delirium as an Educational Intervention for Medical Students: Randomized Controlled Trial
Kiki R Buijs-Spanjers, Harianne HM Hegge, Carolien J. Jansen, Evert Hoogendoorn, Sophia E. de Rooij · 2018 · JMIR Serious Games
Students’ Perception of the Use of a Rubric and Peer Reviews in an Online Learning Environment
Letebele Mphahlele · 2022 · Journal of risk and financial management
Validating the Narrative Reflection Assessment Rubric (NARRA) for reflective narratives in higher education
́Àngel Alsina, Sara Ayllón, Jordi Colomer · 2018 · Assessment & Evaluation in Higher Education
Formative Assessment – Ein erfolgversprechendes Konzept zur Reform von Unterricht und Leistungsmessung?
Uwe Maier · 2010 · Zeitschrift für Erziehungswissenschaft
Rubric system for evaluation of crown preparation performed by dental students
Syed Rashid Habib · 2018 · European Journal Of Dental Education
Using Large Language Models for Automated Grading of Student Writing about Science
Chris D. Impey, Matthew C. Wenger, Nikhil Garuda, Shahriar Golchin, Sarah Stamer · 2025 · International Journal of Artificial Intelligence in Education
Evaluating Student Learning Outcomes in Counselor Education
Casey A. Barrio Minton, Donna M. Gibson · 2012 · Counseling Outcome Research and Evaluation
Exploring Third-Grade Student Model-Based Explanations about Plant Relationships within an Ecosystem
Laura Zangori, Cory T. Forbes · 2015 · International Journal of Science Education
Comparative Judgement as a Promising Alternative to Score Competences
Marije Lesterhuis, San Verhavert, Liesje Coertjens, Vincent Donche, Sven De Mæyer · 2016 · Advances in higher education and professional development book series
Exploring mentors' interpretation of terminology and levels of competence when assessing nursing students: An integrative review
Ibraheim Almalkawi, Rebecca Jester, Louise M. Terry · 2018 · Nurse Education Today
Surveillance of Internalizing Behaviors: A Reliability and Validity Generalization Study of Universal Screening Evidence
Amanda N. Allen, Stephen Patrick Kilgus, Matthew K. Burns, Caroline Hodgson · 2018 · School Mental Health
Students’ use of a rubric for research theses
Frans J. Prins, Renske A.M. de Kleijn, Jan van Tartwijk · 2015 · Assessment & Evaluation in Higher Education
Development of an Empirically Based Learning Performances Framework for Third‐Grade Students’ Model‐Based Explanations About Plant Processes
Laura Zangori, Cory T. Forbes · 2016 · Science Education
Simulated patient training: Using inter-rater reliability to evaluate simulated patient consistency in nursing education
Sharon MacLean, Fiona Geddes, Michelle Kelly, Phillip Roy Della · 2017 · Nurse Education Today
Evaluating peer feedback as a reliable and valid complementary aid to teacher feedback in EFL writing classrooms: A feedback giver perspective
Wenyan Wu, Jinyan Huang, Chunwei Han, Jin Zhang · 2022 · Studies In Educational Evaluation
Análisis y validación de una rúbrica para evaluar habilidades de presentación oral en contextos universitarios
Rafael García-Ros · 2017 · Electronic Journal of Research in Educational Psychology
Fostering oral presentation competence in higher education
Stan O. van Ginkel · 2019
STEM professional development program for gifted education teachers: STEM lesson plan design competence, self-efficacy, computational thinking and entrepreneurial skills
Erhan Şahin, Uğur Sarı, Ömer Faruk Şen · 2023 · Thinking Skills and Creativity
eRubrics in cooperative assessment of learning at university
Manuel Cebrián de la Serna, José Serrano Angulo, Mayerly Zulay Ruiz Torres · 2014 · Comunicar
Supporting sustained adoption of education innovations: The Designing for Sustained Adoption Assessment Instrument
Courtney Stanford, Renée S. Cole, Jeffrey E. Froyd, Debra Friedrichsen, Raina Khatri, Charles Henderson · 2015 · International Journal of STEM Education
A Course-Based Undergraduate Research Experience (CURE) in Biology: Developing Systems Thinking through Field Experiences in Restoration Ecology
E Stanfield, Corin D. Slown, Quentin Charles Sedlacek, Suzanne E. Worcester · 2022 · CBE—Life Sciences Education
El uso de e-rúbricas para la evaluación de competencias en estudiantes universitarios : estudio sobre fiabilidad del instrumento
J. V. Berrocoso, Adelaida Ciudad Gómez · 2014 · REDU Revista de Docencia Universitaria
Using Tablet Technology and Instructional Videos to Enhance Preclinical Dental Laboratory Learning
Cynthia C. Gadbury‐Amyot, John H. Purk, Brian Joseph Williams, Christopher J. Van Ness · 2014 · Journal of Dental Education
Secondary Science and Mathematics Teachers’ Environmental Issues Engagement through Socioscientific Reasoning
David Owens, Benjamin C. Herman, Robert T. Oertli, Amy Lannin, Troy D. Sadler · 2019 · Eurasia Journal of Mathematics Science and Technology Education
Desarrollo de Competencias Docentes en la Formación Inicial del Profesorado de Educación Física. Relación con los Instrumentos de Evaluación
Francisco Javier Castejón, Marisa Santos-Pastor, Laura Cañadas · 2018 · Estudios pedagógicos
The Role of Rubrics in Learning and Implementation of Authentic Assessment: A Literature Review
Clara Nkhoma, Mathews Zanda Nkhoma, Susan Thomas, Nha Quoc Le · 2020 · Informing Science and IT Education Conference
Integrative Learning Through Simulation and Problem-Based Learning
Nuala Walshe, Sinéad O’Brien, Siobhan Murphy, Irene Hartigan · 2011 · Clinical Simulation in Nursing
Assessing oral presentation performance
Stan O. van Ginkel, Ramona Laurentzen, Martin Mulder, Asko Mononen, Janika Kyttä, Mika J. Kortelainen · 2017 · Journal of Applied Research in Higher Education
Rubric Rating with MFRM versus Randomly Distributed Comparative Judgment: A Comparison of Two Approaches to Second‐Language Writing Assessment
Maureen E. Sims, Troy Leigh Cox, Grant Eckstein, K. James Hartshorn, Matthew Porter Wilcox, Judson M. Hart · 2020 · Educational Measurement Issues and Practice
Radiography education with VR using head mounted display: proficiency evaluation by rubric method
Kengo Kato, Daisuke Kon, Teruo Ito, Shigeji Ichikawa, Katsuhiko Ueda, Yoshihiro Kuroda · 2022 · BMC Medical Education
Analytic or holistic? A study about how to increase the agreement in teachers’ grading
Anders Jönsson, Andreia Balan, Eva Hartell · 2021 · Assessment in Education Principles Policy and Practice
Transparent Human Evaluation for Image Captioning
Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Joseph Le Bras, Yejin Choi, Noah A. Smith · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
Engaging students with self-assessment and tutor feedback to improve performance and support assessment capacity
Conor McKevitt · 2016 · Journal of University Teaching and Learning Practice
Scoring rubric reliability and internal validity in rater-mediated EFL writing assessment: Insights from many-facet Rasch measurement
Albert W. Li · 2022 · Reading and Writing
Standardizing an approach to the evaluation of implementation science proposals
Erika L. Crable, Dea L. Biancarelli, Allan J. Walkey, Caitlin G. Allen, Enola K. Proctor, Mari‐Lynn Drainoni · 2018 · Implementation Science
When classroom interactions have to go online: the move to specifications grading in a project-based design course
Rebecca M. Quintana, Chris Quintana · 2020 · Information and Learning Sciences
Cultivating Water Literacy in STEM Education: Undergraduates’ Socio-Scientific Reasoning about Socio-Hydrologic Issues
David Owens, Destini N. Petitt, Diane Lally, Cory T. Forbes · 2020 · Water
Rubrics and formative assessment in K-12 education: A scoping review of literature
Narelle English, Pamela Robertson, Shelley Gillis, Lorraine E. Graham · 2022 · International Journal of Educational Research
The PULSE Vision & Change Rubrics, Version 1.0: A Valid and Equitable Tool to Measure Transformation of Life Sciences Departments at All Institution Types
Loretta Brancaccio-Taras, Pamela A. Pape-Lindstrom, M. Peteroy-Kelly, Karen Aguirre, J. Awong-Taylor, Teresa C. Balser, Michael J. Cahill, Regina F. Frey, Thomas P. Jack, M. Kelrick et al. · 2016 · CBE - Life Sciences Education
Analysis of Propagation Plans in NSF-Funded Education Development Projects
Courtney Stanford, Renée S. Cole, Jeffrey E. Froyd, Charles Henderson, Debra Friedrichsen, Raina Khatri · 2017 · Journal of Science Education and Technology
Exploring the role of scaffolds in problem-based learning (PBL) in an undergraduate chemistry laboratory
Sujatha Varadarajan, Savita Ladage · 2021 · Chemistry Education Research and Practice
Using an ePortfolio to Assess the Outcomes of a First-Year Seminar: Student Narrative and Authentic Assessment
Catherine A. Buyarski, Cynthia M. Landis · 2014 · International Journal of ePortfolio
Practical assessment on the run – iPads as an effective mobile and paperless tool in physical education and teaching
Roslyn Franklin, Jubilee Smith · 2015 · Research in Learning Technology
Use of an Analytical Grading Rubric for Self‐Assessment: A Pilot Study for a Periodontal Oral Competency Examination in Predoctoral Dental Education
Keerthana M. Satheesh, Lorraine B. Brockmann, Ying Liu, Cynthia C. Gadbury‐Amyot · 2015 · Journal of Dental Education
Measuring professional vision of inclusive classrooms in secondary education through video-based comparative judgement: An expert study
Iris Roose, Maarten Goossens, Ruben Vanderlinde, Wendelien Vantieghem, Piet Van Avermaet · 2017 · Studies In Educational Evaluation
Workshops of innovation in chemical engineering to train communication skills in science and technology
Pau San‐Valero, Ángel Robles, Maria Victoria Ruano, Nuria Marti, Amparo Cháfer, José David Badia-Valiente · 2018 · Education for Chemical Engineers
Exploring the Impact of Grading Rubrics on Academic Performance: Findings from a Quasi-Experimental, Pre-Post Evaluation.
Rebecca J. Howell · 2011
Examining the impact of self-assessment with the use of rubrics on primary school students’ performance
Vasileiadou, Despina, Karadimitriou, Konstantinos · 2021 · International Journal of Educational Research Open
The impact of essay organization and overall quality on the holistic scoring of EFL writing: Perspectives from classroom english teachers and national writing raters
Li, Junfei, Huang, Jinyan · 2022 · Assessing Writing
Bridging the gap between self‐assessment and faculty assessment of clinical performance in restorative dentistry: A prospective pilot study
Ghaith Alfakhry, Khattab Mustafa, M. Abdulhadi Alagha, Hussam Milly, Mayssoon Dashash, Issam Jamous · 2022 · Clinical and Experimental Dental Research
The Assessment of Speaking Skills at the Tertiary Level
Asma Ounis · 2017 · International Journal of English Linguistics
Effectiveness and cost-effectiveness of embedded simulation in occupational therapy clinical practice education: study protocol for a randomised controlled trial
Christine Imms, Eli Mang Yee Chu, Stephen Guinea, Loretta Sheppard, Elspeth Froude, Rob Carter, Susan W. Darzins, Samantha Ashby, Susan Gilbert‐Hunt, Nigel Gribble et al. · 2017 · Trials
The Development of ESL Writing Quality and Lexical Proficiency: Suggestions for Assessing Writing Achievement
Hyung‐Jo Yoon · 2018 · Language Assessment Quarterly
Uso de rúbricas en educación superior y evaluación de competencias
Leticia Concepción Velasco Martínez, Juan Carlos Tójar Hurtado · 2018 · Profesorado Revista de Currículum y Formación del Profesorado
The Teacher Accessibility, Equity, and Content (TEC) Rubric for Evaluating Computing Curricula
David Weintrop, Merijke Coenraad, Jen Palmer, Diana M. Franklin · 2019 · ACM Transactions on Computing Education
Supporting connectivism in knowledge based engineering with graph theory, filtering techniques and model quality assurance
Joel Johansson, Manuel Contero, Fredrik Per Wilhelm Elgh · 2018 · Advanced Engineering Informatics
Valoración de la competencia de comunicación oral de estudiantes universitarios a través de una rúbrica fiable y válida
Domingo Verano Tacoronte, Sara María González-Betancor, Alicia María Bolívar Cruz, Margarita Fernández Monroy, Inmaculada Sánchez · 2015 · Revista Brasileira de Educação
A Systematic Review of Paraprofessional Training Materials
Sarah Nathel Douglas, Denise J. Uitto, Claudia Louise Reinfelds, Sophia R. D’Agostino · 2018 · The Journal of Special Education
An information system design theory for the comparative judgement of competences
Tanguy Coenen, Liesje Coertjens, Peter Vlerick, Marije Lesterhuis, Anneleen Viona Mortier, Vincent Donche, Pieter Ballon, Sven De Mæyer · 2018 · European Journal of Information Systems
The effects of rubrics on evaluative judgement: a randomised controlled experiment
George Gyamfi, Barbara Elizabeth Hanna, Hassan Khosravi · 2021 · Assessment & Evaluation in Higher Education
Grading rubrics: hoopla or help?
R. Howell · 2014 · Innovations in Education and Teaching International
Learning to prescribe and instruct exercise in physiotherapy education through authentic continuous assessment and rubrics
Chong, Doris Yin Kei, Tam, Barbara, Yau, Suk Yu, Wong, Arnold Yu Lok · 2020 · BMC Medical Education