The Impact of Self- and Peer-Grading on Student Learning
Abstract
The 2001 U.S. Supreme Court Case of Falvo v. Owasso School System (Owasso Independent School District No I-011 v. Falvo) has focused national attention on the common classroom practice of peer-grading. In a unanimous decision the court reaffirmed the popular view that students grading each others' tests is valuable, saving teachers' time and augmenting student learning. Our study puts these presumed benefits to the test in 4 middle school science classrooms. We compared teacher-assigned grades to those awarded either by students to themselves or by their peers. By training students to grade with the help of a scoring rubric, a very high correlation was obtained between students and their teacher on test questions (r = 0.91 to 0.94). We found patterns of bias when students assigned grades. When grading others, students awarded lower grades to the best performing students than their teacher did. When grading themselves, lower performing students tended to inflate their own low scores. Performance on an unan...
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Both self- and peer-evaluation of work are avenues for providing meaningful feedback without formal grading on correctness that can positively influence students' learning (Sadler and Good, 2006; Freeman et al., 2007; Freeman and Parks, 2010).
“In summary, both self- and peer-evaluation of work are avenues for providing meaningful feedback without formal grading on correctness that can positively influence students' learning (Sadler and Good, 2006; Freeman et al., 2007; Freeman and Parks, 2010).”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Sadler and Good, 2006
Cites
Formative assessment and the design of instructional systems
Sadler, D. R. (1989) · Instructional Science · doi:10.1007/bf00117714 · Cited by 4,285 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509 · see citing works
“The study by Sadler and Good (2006) puts the presumed benefits of peer-grading to the test.”
BackgroundRethinking feedback practices in higher education: a peer review perspective
Nicol, D., Thomson, A., & Breslin, C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.795518 · Cited by 966 · see citing works
“…to produce feedback both as marks and comments, despite some researchers having shown that students do not learn much from simply grading peer work (Sadler and Good 2006), and others highlighting that students are uncomfortable about being assessed by peers and that they have reservations about…”
The use of scoring rubrics for formative assessment purposes revisited: A review
Panadero, E., & Jonsson, A. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.002 · Cited by 839 · see citing works
“…lessons (Goodrich Andrade & Boulay, 2003), self-assessment of a first draft (Andrade et al., 2010; Andrade et al., 2008), peer and self-assessment (Andrade, Buff, et al., 2009; Panadero, 2011; Panadero et al., 2012; Sadler & Good, 2006), and selfassessment and exemplars (Jonsson, 2010).”
BackgroundInfluentialTopping, K. J. (2009) · Theory Into Practice · doi:10.1080/00405840802577569 · Cited by 785 · see citing works
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615 · see citing works
“Peer grading is often supplemented by self grading to encourage the development of self-evaluative skills and is generally thought to “augment student learning” [25].”
BackgroundThe Impact of Peer Assessment on Academic Performance: A Meta-analysis of Control Group Studies
Double, K. S., McGrane, J. A., & Hopfenbeck, T. N. (2020) · Educational Psychology Review · doi:10.1007/s10648-019-09510-3 · Cited by 446 · see citing works
A review of feedback models and typologies: Towards an integrative model of feedback elements
Panadero, E., & Lipnevich, A. A. (2022) · Educational Research Review · doi:10.1016/j.edurev.2021.100416 · Cited by 389 · see citing works
The future of student self-assessment: a review of known unknowns and potential directions.
Panadero, E., Brown, G. T. L., & Strijbos, J.-W. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9350-2 · Cited by 388 · see citing works
“SSA for initially lower performing students (Ross et al. 1999; Sadler and Good 2006), while”
BackgroundResultDoes peer assessment promote student learning? A meta-analysis
Li, H., Xiong, Y., Hunter, C. V., Guo, X., & Tywoniw, R. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1620679 · Cited by 375 · see citing works
“…and Schoonen (1988) 4 Q 9th grade Written composition Essay writing Sadeghi and Khonbi (2015) 3 Q Undergraduate Teaching methodology Exam Sadler and Good (2006) 2 Q 7th grade Science Exam Sch€onrock-Adema et al. (2007) 6 E Undergraduate Medical study Medical professional…”
BackgroundPeer reviewers learn from giving comments
Cho, Y. H., & Cho, K. (2011) · Instructional Science · doi:10.1007/s11251-010-9146-1 · Cited by 294 · see citing works
“Studies of peer assessment have shown that students did not learn very much from simply grading peer papers (Sadler and Good 2006) or from providing low-quality comments (Althauser and Darnall 2001; Li et al.”
BackgroundThe assessment cycle: a model for learning through peer assessment
Reinholz, D. (2016) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1008982 · Cited by 285 · see citing works
“Nevertheless, when the learning impacts of peer and self-assessment are considered, these activities are generally considered independently (e.g. Sadler and Good 2006).”
BackgroundTeaching More by Grading Less (or Differently)
Schinske, J., & Tanner, K. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.cbe-14-03-0054 · Cited by 282 · see citing works
“In summary, both self- and peer-evaluation of work are avenues for providing meaningful feedback without formal grading on correctness that can positively influence students’ learning (Sadler and Good, 2006; Freeman et al., 2007; Freeman and Parks, 2010).”
Tuned Models of Peer Assessment in MOOCs
Piech, C., Huang, J., Chen, Z., Do, C., Ng, A., & Koller, D. (2013) · arXiv · doi:10.48550/arxiv.1307.2579 · Cited by 262 · see citing works
“Peer assessment — which has been historically used for logistical, pedagogical, metacognitive, and affective benefits [18] — offers a promising solution that can scale the grading of complex assignments in courses with tens or even hundreds of thousands of students.”
BackgroundOnline peer assessment: effects of cognitive and affective feedback
Lu, J., & Law, N. W. Y. (2011) · Instructional Science · doi:10.1007/s11251-011-9177-2 · Cited by 272 · see citing works
“Praise is usually recommended and is found to be one of the most common features present in the feedback provided by undergraduates (Cho et al. 2006; Nilson 2003; Sadler and Good 2006).”
BackgroundThe quality and effectiveness of descriptive rubrics
Brookhart, S., & Chen, F. (2015) · Educational Review · doi:10.1080/00131911.2014.929565 · Cited by 254 · see citing works
Lyubart, T., & Mushiru, K. (2005) · Aesthetic Experience · doi:10.1163/b9789042033009_008 · Cited by 242
“Sadler and Good (2006) state that peer-grading leads to many benefits when students receive training by the teacher on grading.”
Panadero, E., & Romero, M. (2014) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2013.877872 · Cited by 239 · see citing works
“Thus, self-assessed scores can be reliable when a rubric – shared by the teacher and the students – is used, which gives evidence that the use of self-assessment grading through a rubric to reduce the burden of teachers assessing a high number of students can be very effective (Sadler & Good, 2006).”
BackgroundWulf, J., Blohm, I., Leimeister, J. M., & Brenner, W. (2014) · Business & Information Systems Engineering · doi:10.1007/s12599-014-0313-9 · Cited by 223 · see citing works
Reflections on Stanford's MOOCs
Cooper, S., & Sahami, M. (2013) · CACM · doi:10.1145/2408776.2408787 · Cited by 217 · see citing works
The Impact of Peer Assessment on Academic Performance: A Meta-analysis of Control Group StudiesPreprint
Double, K. S. (2018) · Educational Psychology Review · doi:10.31234/osf.io/c4rkv · Cited by 9 · see citing works
“Ameta-regression indicated that the effect size was not significantly different when comparing peer assessment with teacher assessment, than when comparing peer assessment with no assessment (b = Table 2 Descriptive characteristics of the included studies Authors Year Pub. type Subject Country Ed. level Hwang et al. 2…”
BackgroundPanadero, E., Romero, M., & Strijbos, J.-W. (2013) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.10.005 · Cited by 195 · see citing works
Peer assessment in the digital age: a meta-analysis comparing peer and teacher ratings
Li, H., Xiong, Y., Zang, X., Kornhaber, M. L., Lyu, Y., Chung, K. S., & Suen, H. K. (2015) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2014.999746 · Cited by 215 · see citing works
Exploring student engagement with peer feedback on L2 writing
Fan, Y., & Xu, J. (2020) · Journal of Second Language Writing · doi:10.1016/j.jslw.2020.100775 · Cited by 222 · see citing works
Factors explaining the learning of generic skills: a study of university students’ experiences
Virtanen, A., & Tynjälä, P. (2018) · Teaching in Higher Education · doi:10.1080/13562517.2018.1515195 · Cited by 192 · see citing works
(2010) · OpenCommons - UConn (University of Connecticut) · doi:10.4324/9780203874851-12 · Cited by 190 · see citing works
“That is self-evaluation, which involves students in grading their work, perhaps as part of their final grade for an assignment or a class (e.g., Sadler & Good, 2006).”
BackgroundThe Future of Self-Assessment in Classroom Practice: Reframing Self-Assessment as a Core Competency.
Brown, G. T. L., & Harris, L. (2014) · Frontline Learning Research · doi:10.14786/flr.v2i1.24 · Cited by 189 · see citing works
“…or rewards, especially for achieving challenging goals (Barling, 1980; Miller, Duffy, & Zane, 1993; Wall, 1982), (f) contributing to the design of a scoring rubric (Sadler & Good, 2006), or (g) judging the accuracy of answers to standardized test items (Koivula, Hassmén, & Hunt, 2001).”
BackgroundAccuracy in student self-assessment: directions and cautions for research
Brown, G. T. L., Andrade, H. L., & Chen, F. (2015) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2014.996523 · Cited by 186 · see citing works
“Indeed, having students involved in the process of creating criteria for rubrics is especially associated with greater learning outcomes (Andrade, Du, & Mycek, 2010; Andrade, Du, & Wang, 2008; Ross, Rolheiser, & Hogaboam-Grey, 1998a; Sadler & Good, 2006).”
BackgroundResultA collaborative working model for enhancing the learning process of science & engineering students
Mora, H., Signes-Pont, M. T., Fuster-Guilló, A., & Pertegal-Felices, M. L. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2019.09.008 · Cited by 164 · see citing works
Rubric‐referenced self‐assessment and middle school students’ writing
Andrade, H., Du, Y., & Mycek, K. (2010) · Assessment in Education Principles Policy and Practice · doi:10.1080/09695941003696172 · Cited by 161 · see citing works
“In a study of rubric‐referenced self‐grading by seventh grade students of constructed‐response biology test items, Sadler and Good ( 2006 ) found significant and large gains in post‐test scores, particularly for students whose pre‐test scores were in the lower third of the range.”
BackgroundAn inventory of peer assessment diversity
Gielen, S., Dochy, F., & Onghena, P. (2011) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930903221444 · Cited by 160 · see citing works
“Saito and Fujita 2004 use a double-blind procedure)? Is the output communicated confidentially (e.g. Pâquet and Des Marchais 1998) between assessor and assessee? Is the teacher present during the assessment, or does he or she have access to the assessment results (e.g. in some courses in the study of van den Berg, Adm…”
BackgroundLynch, R., McNamara, P., & Seery, N. (2012) · European Journal of Teacher Education · doi:10.1080/02619768.2011.643396 · Cited by 152 · see citing works
“Peer feedback and assessment helps support the building of student capacity to critically evaluate tasks and their own performance, which are essential skills for student teachers to develop (Sadler 1998; Sadler and Good 2006).”
Chang, C.-C., Tseng, K.-H., & Lou, S.-J. (2012) · Comput. Educ. · doi:10.1016/j.compedu.2011.08.005 · Cited by 124 · see citing works
“A number of studies discovered the consistency between self- and teacher-assessment (Bouzidi & Jaillet, 2009; Cho, Schunn, & Wilson, 2006; Liu, 2002; Sadler & Good, 2006; Sung et al., 2005; Tsai & Liang, 2009; Tseng & Tsai, 2007).”
BackgroundResultInfluentialWu, Y., & Schunn, C. D. (2020) · American Educational Research Journal · doi:10.3102/0002831220945266 · Cited by 150 · see citing works
Impact of self-assessment by students on their learning
Sharma, R., Jain, A., Gupta, N., Garg, S., Batta, M., & Dhir, S. (2016) · International Journal of Applied and Basic Medical Research · doi:10.4103/2229-516x.186961 · Cited by 115 · see citing works
“by evaluating the answers themselves, they were able to critically analyze their deficiencies and tried to be careful while attempting the second test Herbert has also suggested that by this process of self‐assessment, students begin to internalize instructional goals and begin to apply them to future efforts [6] Boud…”
BackgroundSanchez, C. E., Atkinson, K. M., Koenka, A. C., Moshontz, H., & Cooper, H. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000190 · Cited by 112 · see citing works
Usher, M., & Barak, M. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1405238 · Cited by 110 · see citing works
“Past studies have focused on peer assessment of PBL outcomes in the conventional classroom (e.g. Falchikov 1995; Sadler and Good 2006), in hybrid courses (e.g. Wengrowicz, Dori, and Dori 2017) and in distance learning courses with a limited number of participants (e.g. Li and Gao 2016).”
BackgroundPersonalized and Adaptive Learning
Taylor, D. L., Yeung, M., & Bashet, A. (2021) · Innovative Learning Environments in STEM Higher Education · doi:10.1007/978-3-030-58948-6_2 · Cited by 100 · see citing works
“The value of formative assessment cannot be denied, yet the over-emphasis on summative assessment has resulted in inadequate resources for formative assessment (Ecclestone 2010; Sadler and Good 2006).”
BackgroundA blended learning framework for curriculum design and professional development
Mirriahi, N., Alonzo, D., & Fox, B. (2015) · Research in Learning Technology · doi:10.3402/rlt.v23.28451 · Cited by 99 · see citing works
“In the case of peer assessment, such rubrics can provide an objective way for peers to offer feedback that is focused on criteria and standards (Sadler and Good 2006).”
BackgroundUnderstanding online interaction in language MOOCs through learning analytics
Martín-Monje, E., Castrillo, M. D., & Mañana-Rodríguez, J. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2017.1378237 · Cited by 98 · see citing works
“Although the effectiveness of P2P has been repeatedly questioned (Sadler & Good, 2006; Sluijsmans, Dochy & Moer-kerke, 1998), it seems proven that P2P tasks can enhance students ’ cognitive skills (Nelson & Schunn, 2009).”
BackgroundChang, C.-C., Tseng, K.-H., Chou, P.-N., & Chen, Y.-H. (2011) · Comput. Educ. · doi:10.1016/j.compedu.2011.01.014 · Cited by 97 · see citing works
“Except for Chen’s (2010) conclusion, our findings are contrary tomost studies, such as Bouzidi and Jaillet (2009), Cho, Schunn andWilson (2006), Liu (2002), Sadler and Good (2006), Sung et al. (2005), Topping (1998), Tsai and Liang (2009), and Tseng and Tsai (2007).”
BackgroundResultInfluentialSelf-Assessment of Pronunciation.
Dlaska, A., & Krekeler, C. (2008) · doi:10.1016/j.system.2008.03.003 · Cited by 96
Structuring Interactions for Large-Scale Synchronous Peer Learning
Coetzee, D., Lim, S., Fox, A., Hartmann, B., & Hearst, M. A. (2015) · Conference on Computer Supported Cooperative Work · doi:10.1145/2675133.2675251 · Cited by 90 · see citing works
“Work has also been done on self-evaluation of assignments within MOOCs [60], replicating earlier results in smaller class settings showing that self-evaluation helps improve student outcomes [47].”
ResultThe Reliability and Validity of Peer Review of Writing in High School AP English Classes.
Schunn, C. D., Godley, A., & Martino, S. D. (2016) · Journal of Adolescent & Adult Literacy · doi:10.1002/jaal.525 · Cited by 87 · see citing works
Blurring Boundaries in Education: Context and Impact of MOOCs
Loeckx, J. (2016) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v17i3.2395 · Cited by 86 · see citing works
“Furthermore, evidence seem to indicate that students learn from these kinds of grading (Sadler & Good, 2006).”
BackgroundGoals of peer assessment and their associated quality concepts
Gielen, S., Dochy, F., Onghena, P., Struyven, K., & Smeets, S. (2011) · Studies in Higher Education · doi:10.1080/03075071003759037 · Cited by 85 · see citing works
“Concerning this last goal, the quality criterion may be whether one accomplishes the creation of a ‘sense of shared ownership’ (Sadler and Good 2006 ) of the learning and assessment processes for each learner.”
BackgroundMultimodality of AI for Education: Towards Artificial General IntelligencePreprint
Lee, G.-G., Shi, L.-H., Latif, E., Gao, Y.-Z., Bewersdorff, A., Nyaaba, M., Guo, S.-C., Wu, Z.-H., Liu, Z., Wang, H., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2312.06037 · Cited by 84 · see citing works
“Peer assessment is a process by which students give feedback on another student’s work based on a rubric provided by the instructor [183].”
BackgroundDoes peer assessment in on-line learning environments work? A systematic review of the literature
Tenório, T., Bittencourt, I., Isotani, S., & Silva, A. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.06.020 · Cited by 82 · see citing works
Ibrahim, K. A. A.-A., Carbajal, N. C., Zuta, M. E. C., & Bayat, S. (2023) · Language Testing in Asia · doi:10.1186/s40468-023-00229-1 · Cited by 79 · see citing works
“According to the theory of Sadler and Good (2006), the purpose of self-assessment is to allow students to reflect on their work and make changes.”
MethodDivide and correct: using clusters to grade short answers at scale
Brooks, M., Basu, S., Jacobs, C., & Vanderwende, L. (2014) · ACM Conference on Learning @ Scale · doi:10.1145/2556325.2566243 · Cited by 77 · see citing works
“However, Sadler and Good found no evidence that peergrading improves peer performance on subsequent tests on the same material [18].”
BackgroundAudio peer feedback to promote deep learning in online education
Filius, R. M., de Kleijn, R. D., Uijl, S., Prins, F., van Rijen, H. V. M., & Grobbee, D. (2019) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12363 · Cited by 75 · see citing works
“Peer feedback helps recipients to develop skills for reflection, self‐regulation, and critical thinking (Boud, 2001; Dochy, Segers, & Sluijsmans, 1999; Ion, Sánchez Martí, & Morell, 2019, Sadler & Good, 2006).”
BackgroundHsia, L., Huang, I., & Hwang, G. (2016) · British Journal of Educational Technology · doi:10.1111/bjet.12248 · Cited by 73 · see citing works
Insights about large-scale online peer assessment from an analysis of an astronomy MOOC
Formánek, M., Wenger, M., Buxner, S., Impey, C., & Sonam, T. (2017) · Comput. Educ. · doi:10.1016/j.compedu.2017.05.019 · Cited by 71 · see citing works
“On the other hand Sadler and Good (2006) points out a tendency to award lower grade to the best performing students in themiddle school science class settings.”
BackgroundDiscouraged by Peer Excellence
Rogers, T., & Feller, A. (2016) · Psychological Science · doi:10.1177/0956797615623770 · Cited by 97 · see citing works
“Peer assessment is a popular practice in both online and offline educational settings (Piech et al., 2013; Sadler & Good, 2006; Topping, 1998).”
BackgroundA gamified peer assessment model for on-line learning environments in a competitive context
Tenório, T., Bittencourt, I., Isotani, S., Pedro, A., & Ospina, P. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.06.049 · Cited by 67 · see citing works
Improving the Peer Assessment Experience on MOOC Platforms
Staubitz, T., Petrick, D., Bauer, M., Renz, J., & Meinel, C. (2016) · ACM Conference on Learning @ Scale · doi:10.1145/2876034.2876043 · Cited by 66 · see citing works
“Therefore, it depends on the teaching teams to narrow down quality expectations, for example by providing detailed rubrics to ensure the success of PAs and to keep assessments comparable, consistent, and fair [9, 27].”
BackgroundInfluentialNieminen, J., Asikainen, H., & Rämö, J. (2019) · Studies in Higher Education · doi:10.1080/03075079.2019.1688282 · Cited by 65 · see citing works
Cheng, K.-H., & Hou, H.-T. (2015) · Technology Pedagogy and Education · doi:10.1080/1475939x.2013.822416 · Cited by 65 · see citing works
Cifrián, E., Andrés, A., Galán, B., & Viguri, J. R. (2020) · Education for Chemical Engineers · doi:10.1016/j.ece.2020.04.006 · Cited by 80 · see citing works
An integrated model of learning from errors
Zhang, Q., & Fiorella, L. (2022) · Educational Psychologist · doi:10.1080/00461520.2022.2149525 · Cited by 73 · see citing works
“…that provided students with object-ive reference criteria (e.g., normative solutions, rubrics, or scripts) or self-assessment training can improve students ’ subsequent monitoring accuracy on new tasks (Baars et al., 2014; Kostons et al., 2012; Sadler & Good, 2006; Zamora et al., 2018b).”
Developing laboratory skills by incorporating peer-review and digital badges
Seery, M., Agustian, H. Y., Doidge, E. D., Kucharski, M., O'Connor, H., & Price, A. N. (2017) · Chemistry Education Research and Practice · doi:10.1039/c7rp00003k · Cited by 62 · see citing works
“Four reasons to incorporate self- and peer-assessment are suggested (P. M. Sadler & Good, 2006).”
BackgroundPanadero, E., Alonso-Tapia, J., & Huertas, J. (2014) · Journal for the Study of Education and Development Infancia y Aprendizaje · doi:10.1080/02103702.2014.881655 · Cited by 61 · see citing works
“The fact that the rubrics enhanced learning in the present study is in line with prior research (Andrade et al., 2008; Panadero & Jonsson, 2013; Sadler & Good, 2006).”
ResultLan, A. S., Vats, D., Waters, A. E., & Baraniuk, R. G. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724664 · Cited by 60 · see citing works
“While peer grading appears to have some pedagogical value for learners [30], each learner typically needs to grade several solutions from other learners for each question they solve, in order to obtain an accurate grade estimate.”
BackgroundSupporting Peer Feedback on Learning Strategies: Effects on Self-Efficacy and Feedback Quality
Bürgermeister, A., Glogger-Frey, I., & Saalbach, H. (2021) · Psychology Learning & Teaching · doi:10.1177/14757257211016604 · Cited by 60 · see citing works
“Sadler and Good (2006) showed in this context a high correlation between student and teacher grading (r¼ 0.91–0.94), after training middle school students to use scoring rubrics.”
BackgroundInfluentialCEFR-aligned school-based assessment in the Malaysian primary ESL classroom
Sidhu, G. K., Kaur, S., & Lee, J.-C. (2018) · Indonesian Journal of Applied Linguistics · doi:10.17509/ijal.v8i2.13311 · Cited by 60
“According to Sadler and Good (2006) peer evaluation and selfevaluation both help teachers save time, and improve pupils‘ metacognitive skills and understanding of their learning experiences.”
BackgroundPereira, J., Fernández-Raga, M., Osuna-Acedo, S., Roura-Redondo, M., Almazán-López, O., & Buldón-Olalla, A. (2019) · Technology Knowledge and Learning · doi:10.1007/s10758-019-09414-9 · Cited by 59 · see citing works
“Most of the P2P are based on traditional written productions (Sadler and Good 2006; Tenório et al. 2016).”
BackgroundEffects of self-assessment scripts on self-regulation and learning
Alonso-Tapia, J., & Panadero, E. (2010) · Journal for the Study of Education and Development Infancia y Aprendizaje · doi:10.1174/021037010792215145 · Cited by 58 · see citing works
“A couple of recent studies (Lejk & Wyvill, 2001; Sadler & Good, 2006) have also found that, in order for self-grading to be done well, some kind of agreement needs to be made between the students and the teachers.”
BackgroundLi, Y.-K., Hartline, J. D., Shan, L., & Wu, Y.-F. (2020) · ACM Conference on Economics and Computation · doi:10.1145/3490486.3538338 · Cited by 57
Teachers’ reasons for using self-assessment: a survey self-report of Spanish teachers
Panadero, E., Brown, G. T. L., & Courtney, M. (2014) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2014.919247 · Cited by 57 · see citing works
“Children who contribute to the development of evaluative criteria and who subsequently use the criteria to self-assess also achieve better (Andrade, Du, & Mycek, 2010; Ross, 2006; Sadler & Good, 2006).”
BackgroundHwang, G.-J., Zou, D., & Wu, Y. (2023) · Educational technology research and development · doi:10.1007/s11423-022-10184-y · Cited by 55 · see citing works
“Specifically, peer feed-back includes both formalized feedback, which refers to the feedback provided by students according to rating systems (Lu & Law, 2012; Sadler & Good, 2006), and elaborate feedback, which refers to detailed open-ended feedback (Gielen & De Wever, 2015; Luo et al., 2014).”
BackgroundPrevention–Permission–Promotion: A Review of Approaches to Errors in Learning
Wong, S., & Lim, S. (2018) · Educational Psychology · doi:10.1080/00461520.2018.1501693 · Cited by 53 · see citing works
“For instance, Sadler and Good (2006) found that students who graded their peers’ tests did not display better performance on a second, unannounced administration of the same test a week later, as compared to students who did not grade any tests at all.”
BackgroundPeer assessment using comparative and absolute judgement
Jones, I., & Wheadon, C. (2015) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2015.09.004 · Cited by 52 · see citing works
“…are many contexts in which the development and understanding of such criteria is an inherently valuable learning activity (e.g. Hunter & Russ, 1996; Sadler & Good, 2006), but there may exist other contexts in which it is desirable or at least pragmatically useful for students to assess peers’ work…”
BackgroundInfluentialChang, C.-C., Liang, C.-Y., & Chen, Y.-H. (2013) · Comput. Educ. · doi:10.1016/j.compedu.2012.05.012 · Cited by 52 · see citing works
“The conclusion is supported by a number of research results (Sadler & Good, 2006; Sung et al., 2005) but contradictory to the findings of Knowles et al. (2005).”
Peer Grading in a MOOC: Reliability, Validity, and Perceived Effects.
Luo, H., Robinson, A., & Park, J.-Y. (2014) · Online Learning · doi:10.24059/olj.v18i2.429 · Cited by 51 · see citing works
Moşteanu, N. (2021) · International journal of innovative research and scientific studies · doi:10.53894/ijirss.v4i4.298 · Cited by 49 · see citing works
“enables students to gauge or refine their comprehension and enhance their ability to analyze, evaluate, and synthesize information [45].”
BackgroundSmit, R., & Birri, T. (2014) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2014.02.002 · Cited by 49 · see citing works
Peer-Assisted Reflection: A Design-Based Intervention for Improving Success in Calculus
Reinholz, D. (2015) · International Journal of Research in Undergraduate Mathematics Education · doi:10.1007/s40753-015-0005-y · Cited by 46 · see citing works
“Even studies focused on learning rarely measured quantitative changes in student outcomes (Sadler and Good 2006).”
BackgroundAssuring privacy and reliability in crowdsourcing with coding
Varshney, L., Vempaty, A., & Varshney, P. (2014) · Information Theory and Applications Workshop · doi:10.1109/ita.2014.6804213 · Cited by 46
“When given standard grading rubrics that decomposes assessment into smaller queries, students do seem to be able to provide scores effectively [26].”
BackgroundMethodUnderstanding the Effectiveness of Online Peer Assessment: A Path Model
Lu, J.-Y., & Zhang, Z. (2012) · Journal of Educational Computing Research · doi:10.2190/ec.46.3.f · Cited by 45 · see citing works
“Few quantitative studies have examined the learning effects of assessment rubrics, feedback quality, and domain knowledge in the same model (Sadler & Good, 2006) and even fewer ones compared the effects of peer assessment on both assessors and assessees.”
BackgroundBerrocoso, J. V., & Gómez, A. C. (2014) · REDU Revista de Docencia Universitaria · doi:10.4995/redu.2014.6415 · Cited by 43 · see citing works
The contribution of reflective learning to experiential learning in business education
Perusso, A., Blankesteijn, M., & Leal, R. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1705963 · Cited by 40 · see citing works
Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays
Esfandiari, R., & Myford, C. (2013) · Assessing Writing · doi:10.1016/j.asw.2012.12.002 · Cited by 40 · see citing works
“…by reading their peers’ comments); metacognitive (i.e., students could be made aware of their strengths and weaknesses and could take responsibility for their own learning); and affective (i.e., classes could become more productive, friendlier, and more cooperative) (Sadler & Good, 2006).”
BackgroundChanges in the reliability and validity of peer assessment across the college years
Zhang, F., Schunn, C. D., Li, W.-T., & Long, M. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1724260 · Cited by 39 · see citing works
“Given the strong possible pedagogical benefits as well as pragmatic benefits of reducing grading burden (Sadler and Good 2006; Cho and MacArthur 2011), understanding CONTACT Wentao Li liwt283@nenu.edu.cn 2020 Informa UK Limited, trading as Taylor & Francis Group when peer assessment can be used is…”
Background5 Language Teaching in MOOCs: the Integral Role of the Instructor
de Larreta-Azelain, M. D. C. (2014) · doi:10.2478/9783110420067.5 · Cited by 39 · see citing works
López-Pastor, V., Fernández-Balboa, J.-M., Santos-Pastor, M. L., & Aranda, A. F. (2012) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2010.545868 · Cited by 39 · see citing works
Suryanti, N., & Nurhuda, N. (2021) · International Journal of Instruction · doi:10.29333/iji.2021.14237a · Cited by 38 · see citing works
“Some others have revealed that the use of rubrics as one of the tools in learning assessment can enhance the students’ critical thinking skills, problem-solving skills, and self-assessment in the learning environment (Shafer, et al., 2001; Green & Bowser, 2006; Sadler & Good, 2006).”
Sun, D. L., Harris, N., Walther, G., & Baiocchi, M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143177 · Cited by 38 · see citing works
Luaces, O., Díez, J., & Bahamonde, A. (2018) · Comput. Educ. · doi:10.1016/j.compedu.2018.07.016 · Cited by 35 · see citing works
“…been explored as an efficient procedure to deal with this problem; see for instance (Kulkarni et al., 2015; Piech et al., 2013; Raman and Joachims, 2014, 2015; Sadler and Good, 2006; Shah et al., 2013; Labutov and Studer, 2016; D´ıez et al., 2013; Luaces et al., 2015a,b, 2017; Formanek et al., 2017).”
MethodFactors leading to an effective MOOC from participiants perspective
Gamage, D., Fernando, S., & Perera, I. (2015) · 2015 8th International Conference on Ubi-Media Computing (UMEDIA) · doi:10.1109/umedia.2015.7297460 · Cited by 35 · see citing works
Luaces, O., Díez, J., Alonso-Betanzos, A., Troncoso, A., & Bahamonde, A. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.05.019 · Cited by 35 · see citing works
“Since it is unpractical that an instructor evaluates all the assignments, or even a set of Teaching Assistants (TA), researchers have been exploring the possibilities of using methods previously employed in Journals or Conferences: peer grading or peer assessment [2, 3, 4, 5, 6, 7].”
BackgroundMethodKousoulas, F. (2010) · doi:10.1080/10400419.2010.523404 · Cited by 35
“Students’ self-assessments are a reliable form of assessing them at school level (Higgins et al., 1994; Ross et al., 2002) and contribute to the demands for an authentic, alternative method of evaluation (Sadler & Good, 2006).”
MethodZhang, Y., Chen, B.-L., Ge, J., Hung, C.-Y., & Mei, L. (2018) · Interactive Learning Environments · doi:10.1080/10494820.2018.1553187 · Cited by 34 · see citing works
“Apart from being an instrumental tool for teacher assessment and feedback, rubrics can also support formative assessment and enhance student learning by promoting re fl ections on their own work (Andrade & Valtcheva, 2009; Panadero et al., 2013) or works by other students (Sadler & Good, 2006).”
BackgroundMethodProbabilistic Graphical Models for Boosting Cardinal and Ordinal Peer Grading in MOOCs
Mi, F., & Yeung, D.-Y. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9210 · Cited by 34 · see citing works
“A practical approach to tackle this problem is peer grading or peer assessment (Godlee et al. 2003; Sadler and Good 2006), in which students also play the role of graders in grading a small number of assignments submitted by other students according to the rubrics or benchmarks provided by the…”
BackgroundALL-IN-ONE: Multi-Task Learning BERT models for Evaluating Peer Assessments
Jia, Q., Cui, J., Xiao, Y., Liu, C., Rashid, P., & Gehringer, E. F. (2021) · arXiv · doi:10.48550/arxiv.2110.03895 · Cited by 33 · see citing works
Reviewing and analyzing peer review Inter-Rater Reliability in a MOOC platform
García-Loro, F., Martín, S., Ruipérez‐Valiente, J. A., Sancristobal, E., & Castro, M. A. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103894 · Cited by 42 · see citing works
Peer assessment of professionalism in undergraduate medical education
Curran, V., Fairbridge, N., & Deacon, D. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02412-x · Cited by 31
Investigating the allocation and corroboration of individual grades for project-based learning
Williams, S. (2017) · doi:10.1016/j.stueduc.2016.10.009 · Cited by 31
On the validity of peer grading and a cloud teaching assistant system
Vogelsang, T., & Ruppertz, L. (2015) · International Conference on Learning Analytics and Knowledge · doi:10.1145/2723576.2723633 · Cited by 31 · see citing works
“Consequently, the existing digital peer grading systems differ from one another in both design and underlying statistical models: Common features of a peer grading system are self grading[13, 22, 12] and calibration[2].”
MethodThe Use of a Mobile Assistant Learning System for Health Education Based on Project-Based Learning
Wu, T.-T. (2014) · Computers, Informatics, Nursing · doi:10.1097/cin.0000000000000089 · Cited by 31 · see citing works
“These results are consistent with the study of Sung et al(23) and Sadler et al.(24) Based on observations by the nurse educator, competition among students is the major reason for lower peer evaluation outcome because the students scored each other more strictly and cautiously.”
ResultCalibrated peer review for computer‐assisted learning of biological research competencies
Clase, K. L., Gundlach, E., & Pelaez, N. J. (2010) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20415 · Cited by 31 · see citing works
“Sadler and Good (2006) [6] showed that self-grading and peer-grading are reasonable aids for saving time.”
BackgroundZhao, X., Shao, M., & Su, Y.-S. (2022) · Sustainability · doi:10.3390/su141710699 · Cited by 30 · see citing works
- Authors
- Sadler, P., & Good, E.
- Affiliations
- Harvard University (US)
- ORCID
- Sadler, Philip
- Venue
- Educational Assessment
- Publisher
- Informa UK Limited
- Published
- 2006-02-01
- Volume
- 11
- Issue
- 1
- Pages
- 1-31
- ISSN
- 1062-7197 (ISSN-L)
- OpenAlex
- W1996469193
- Cited by
- 535
- References
- 0
- Citations by year
- 2026: 9 · 2025: 17 · 2024: 25 · 2023: 27 · 2022: 31 · 2021: 29 · 2020: 40 · 2019: 44 · 2018: 38 · 2017: 36 · 2016: 48 · 2015: 58 · 2014: 49 · 2013: 28 · 2012: 15
- FWCI
- 24.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Assessment (publishedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
- Keywords
- peer grading, self-assessment, student grading, grading bias, rubrics, junior high school science, student learning, test scoring
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review