Peer assessment: judging the quality of students’ work by comments rather than marks
Abstract
This paper reports the results of a study into the quality of peer feedback provided by students within a computerised peer‐assessment environment. The study looks at the creation of a ‘feedback index’ that represents the quality of an essay based upon the feedback provided during a peer‐marking process and identifies a significant positive correlation between this index and the average marks produced for an essay. The data produced are analysed in an attempt to ascertain whether specific groups of students, based upon their ability in developing an essay within this subject area, in general tend to mark and/or comment on their peers either too generously or too critically.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Positively phrased comments were observed at the global and specific levels at a similar frequency.
“Inconsistent with Davies' (2006) finding that 'the students tended to provide positive support for the holistic rather than the specific nature of an essay' (p. 81), positively phrased comments were observed at the global and specific levels at a similar frequency.”
From 'Sorry, I don't good English': Japanese L2 students' written peer feedback in the face-to-face and anonymous review modes (2023) · cites this paper as Davies' (2006)
Cites
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 1× · see citing works
“Feedback is unequivocally considered central to learning and plays an important role in a student’s educational development (Black & Wiliam, 1998).”
BackgroundBoud, D. J., Cohen, R., & Sampson, J. (1999) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293990240405 · Cited by 1,035 · see citing works
The Conscientious Consumer: Reconsidering the role of assessment feedback in student learning
Higgins, R., Hartley, P., & Skelton, A. (2002) · Studies in Higher Education · doi:10.1080/03075070120099368 · Cited by 795 · see citing works
Assessing Self- and Peer-assessment: The students' views
Hanrahan, S. J., & Isaacs, G. (2001) · Higher Education Research & Development · doi:10.1080/07294360123776 · Cited by 516 · see citing works
Peer Feedback Marking: Developing Peer Assessment
Falchikov, N. (1995) · Innovations in Education and Training International · doi:10.1080/1355800950320212 · Cited by 493 · see citing works
Peer, self and tutor assessment: Relative reliabilities
Stefani, L. A. J. (1994) · Studies in Higher Education · doi:10.1080/03075079412331382153 · Cited by 346 · see citing works
Ballantyne, R., Hughes, K., & Mylonas, A. (2002) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293022000009302 · Cited by 329 · see citing works
Web‐based peer assessment: feedback for students with various thinking‐styles
Lin, S. S. J., Liu, E. Z. F., & Yuan, S. (2001) · Journal of Computer Assisted Learning · doi:10.1046/j.0266-4909.2001.00198.x · Cited by 305 · see citing works
Exploring the Practice of Feedback to Students
Mutch, A. (2003) · Active Learning in Higher Education · doi:10.1177/1469787403004001003 · Cited by 187 · see citing works
Assessment in Partnership with Learners
Stefani, L. A. J. (1998) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293980230402 · Cited by 173 · see citing works
Davies, P. (2000) · Innovations in Education and Training International · doi:10.1080/135580000750052955 · Cited by 162 · see citing works
Self-citationBrown, S. A., Race, P., & Smith, B. (2004) · Routledge eBooks · doi:10.4324/9780203307359 · Cited by 161 · see citing works
Holroyd, C. (2000) · Active Learning in Higher Education · doi:10.1177/1469787400001001003 · Cited by 73 · see citing works
Towards electronically assisted peer assessment: a case study
Bhalerao, A. H., & Ward, A. (2001) · ALT-J · doi:10.1080/09687760108656773 · Cited by 60 · see citing works
Using Student Reflective Self-Assessment for Awarding Degree Classifications
Davies, P. (2002) · Innovations in Education and Teaching International · doi:10.1080/13558000210161034 · Cited by 47 · see citing works
Self-citationPatterns in student-student commenting
Rada, R., & Hu, K. (2002) · IEEE Transactions on Education · doi:10.1109/te.2002.1024619 · Cited by 29 · see citing works
Closing the communications loop on the computerized peer-assessment of essays
Davies, P. (2003) · Research in Learning Technology · doi:10.3402/rlt.v11i1.11266 · Cited by 22 · see citing works
Self-citationDavies, P. (2004) · Research in Learning Technology · doi:10.3402/rlt.v12i3.11258 · Cited by 22 · see citing works
Self-citationIn Search of Fairness: An application of multi-reviewer anonymous peer review in a large class
Robinson, J. M. (2002) · Journal of Further and Higher Education · doi:10.1080/03098770220129451 · Cited by 21 · see citing works
Closing the communications loop on the computerized peer-assessment of essays
Davies, P. (2003) · ALT-J · doi:10.1080/0968776030110105 · Cited by 14 · see citing works
Self-citationDavies, P. (2004) · ALT-J · doi:10.1080/0968776042000259573 · Cited by 9 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Making Sense of Assessment Feedback in Higher Education
Evans, C. (2013) · Review of Educational Research · doi:10.3102/0034654312474350 · Cited by 1,143 · see citing works
Effective peer assessment processes: Research findings and future directions
van Zundert, M., Sluijsmans, D., & van Merriënboer, J. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.004 · Cited by 536 · see citing works
Engaging student teachers in meaningful reflective practice
Harford, J., & Ruairc, G. M. (2008) · Teaching and Teacher Education · doi:10.1016/j.tate.2008.02.010 · Cited by 309 · see citing works
Xiao, Y., & Lucking, R. (2008) · The Internet and Higher Education · doi:10.1016/j.iheduc.2008.06.005 · Cited by 243 · see citing works
Student perspectives on formative peer assessment: an attempt to deepen learning?
Vickerman, P. (2008) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930801955986 · Cited by 225 · see citing works
Peer assessment in the digital age: a meta-analysis comparing peer and teacher ratings
Li, H., Xiong, Y., Zang, X., Kornhaber, M. L., Lyu, Y., Chung, K. S., & Suen, H. K. (2015) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2014.999746 · Cited by 215 · see citing works
Hovardas, T., Tsivitanidou, O. E., & Zacharia, Z. C. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.09.019 · Cited by 176 · see citing works
A systematic review of tools that support peer assessment
Luxton-Reilly, A. (2009) · Computer Science Education · doi:10.1080/08993400903384844 · Cited by 125 · see citing works
Peer-assessment in higher education--Twenty-first Century practices, challenges and the way Forward
Ashenafi, M. M. (2017) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1100711 · Cited by 120 · see citing works
Assessing collaboration in a wiki: The reliability of university students' peer assessment
Wever, B. D., Keer, H. V., Schellens, T., & Valcke, M. (2011) · The Internet and Higher Education · doi:10.1016/j.iheduc.2011.07.003 · Cited by 93 · see citing works
Peer assessment in an EFL context: attitudes and friendship bias
Azarnoosh, M. (2013) · Language Testing in Asia · doi:10.1186/2229-0443-3-11 · Cited by 94 · see citing works
A comparison of peer and tutor feedback
Hamer, J., Purchase, H. C., Luxton-Reilly, A., & Denny, P. C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2014.893418 · Cited by 87 · see citing works
Ng, E. M. W. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.03.015 · Cited by 87 · see citing works
An educational research course facilitated by online peer assessment
Chen, Y., & Tsai, C. (2009) · Innovations in Education and Teaching International · doi:10.1080/14703290802646297 · Cited by 72 · see citing works
The conundrum of low achievement and feedback for learning
Pitt, E., Bearman, M., & Esterhazy, R. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1630363 · Cited by 70 · see citing works
Understanding the Effectiveness of Online Peer Assessment: A Path Model
Lu, J.-Y., & Zhang, Z. (2012) · Journal of Educational Computing Research · doi:10.2190/ec.46.3.f · Cited by 45 · see citing works
Strijbos, J.-W., Ochoa, T. A., Sluijsmans, D. M. A., Segers, M. S. R., & Tillema, H. H. (2009) · Cognitive and Emotional Processes in Web-Based Education · doi:10.4018/978-1-60566-392-0.ch018 · Cited by 48 · see citing works
Kumar, T., Soozandehfar, S. M. A., Hashemifardnia, A., & Mombeini, R. (2023) · Language Testing in Asia · doi:10.1186/s40468-023-00251-3 · Cited by 68 · see citing works
Peer assessment as a learning tool for enhancing student teachers' preparation
Al‐Barakat, A. A., & Al-Hassan, O. M. (2009) · Asia-Pacific Journal of Teacher Education · doi:10.1080/13598660903247676 · Cited by 51 · see citing works
Peer Assessment in an EFL Context: Attitudes and Correlations
Peng, J.-C. F. (2010) · Cited by 40 · see citing works
Anonymous Peer Assessment of Medication Management Reviews
Basheti, I. A., Ryan, G., Woulfe, J., & Bartimote-Aufflick, K. (2010) · American Journal of Pharmaceutical Education · doi:10.5688/aj740577 · Cited by 37 · see citing works
Peters, O., Körndle, H., & Narciss, S. (2018) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0344-y · Cited by 37 · see citing works
Teacher Candidates’ Views On Self And Peer Assessment As A Tool For Student Development
Bozkurt, F. (2020) · The Australian journal of teacher education · doi:10.14221/ajte.2020v45n1.4 · Cited by 31 · see citing works
Ng, E. M. W. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.12.016 · Cited by 31 · see citing works
Ching, Y., & Hsu, Y. (2016) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v17i2.2221 · Cited by 28 · see citing works
Student Experiences of Peer Review Marking of Team Projects
Keith, P. (2007) · The International Journal of Management Education · doi:10.3794/ijme.62.190 · Cited by 25 · see citing works
Dickson, H., Harvey, J., & Blackwood, N. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1528341 · Cited by 26 · see citing works
An Overview of Peer-Assessment: The Benefits and Importance
Karami, A., & Rezaei, A. (2015) · Journal for the Study of English Linguistics · doi:10.5296/jsel.v3i1.7889 · Cited by 24 · see citing works
Jeffery, D., Yankulov, K., Crerar, A., & Ritchie, K. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2014.987721 · Cited by 20 · see citing works
Calibrated Peer Review for Interpreting Linear Regression Parameters: Results from a Graduate Course
Enders, F. B., Jenkins, S. M., & Hoverman, V. R. (2010) · Journal of Statistics Education · doi:10.1080/10691898.2010.11889489 · Cited by 20 · see citing works
Ngwenya, J. C., & Maistry, S. M. (2012) · Journal of Social Sciences · doi:10.1080/09718923.2012.11893083 · Cited by 19 · see citing works
Exploring the impact of role-playing on peer feedback in an online case-based learning activity
Ching, Y. (2014) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v15i3.1765 · Cited by 17 · see citing works
Argumentation Skills: A Peer Assessment Approach to Discussions in the EFL Classroom
Ubaque-Casallas, D., & Castellanos, F. S. P. (2016) · PROFILE Issues in Teachers Professional Development · doi:10.15446/profile.v18n2.53314 · Cited by 16 · see citing works
Baguley, M. M., & Brown, A. (2009) · Teaching in Higher Education · doi:10.1080/13562510902757286 · Cited by 11 · see citing works
Accounting students' experience of an improved strategy of feedback on assessment
Stegmann, N., & Malan, M. (2016) · Journal of Economic and Financial Sciences · doi:10.4102/jef.v9i3.70 · Cited by 8 · see citing works
Using peer review to develop professional competencies: an Ubuntu perspective
Barac, K., Kirstein, M., & Kunz, R. (2021) · Accounting Education · doi:10.1080/09639284.2021.1942089 · Cited by 11 · see citing works
The impact of training adolescent EFL learners on their perceptions of peer assessment of writing
Meletiadou, E. (2012) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 10 · see citing works
Improving Teacher Candidates' Lesson Planning Competencies Through Peer Review in a Wiki Environment
Salajan, F. D., Nyachwaya, J. M., Hoffman, J. G., & Hill, B. (2016) · The Teacher Educator · doi:10.1080/08878730.2016.1153179 · Cited by 10 · see citing works
Sluijsmans, D. M. A., & Strijbos, J.-W. (2010) · Advances in social networking and online communities book series · doi:10.4018/978-1-61520-729-9.ch008 · Cited by 10 · see citing works
The Impacts of Dialogic Interaction to Engage Students in Peer Assessment
Ng, W. S., & Yu, G. (2021) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-021-00633-2 · Cited by 13 · see citing works
Shams, N., & Tavakoli, M. (2014) · Journal of applied linguistics and language research · Cited by 9 · see citing works
Boon, S. (2015) · Education 3-13 · doi:10.1080/03004279.2013.856930 · Cited by 9 · see citing works
Nagori, R., & Cooper, M. (2014) · IAFOR Journal of Education · doi:10.22492/ije.2.2.07 · Cited by 8 · see citing works
Affective Language in Student Peer Reviews: Exploring Data from Three Institutional Contexts
Wärnsby, A., Kauppinen, A., Aull, L. L., Leijen, D. A. J., & Moxley, J. (2018) · Journal of Academic Writing · doi:10.18552/joaw.v8i1.429 · Cited by 8 · see citing works
Pengembangan Multimedia Integratif Bahasa Inggris untuk Siswa di Pendidikan Dasar
Wijirahayu, S., & Syarif, M. S. (2019) · Jurnal SOLMA · doi:10.29405/solma.v8i2.3093 · Cited by 7 · see citing works
Ghadi, S. A., & Khodabakhshzadeh, H. (2016) · Theory and Practice in Language Studies · doi:10.17507/tpls.0612.06 · Cited by 7 · see citing works
Implementing Peer Assessment in a Russian University ESP Classroom
Stognieva, O. (2015) · Journal of language and Education · doi:10.17323/2411-7390-2015-1-4-63-73 · Cited by 9 · see citing works
Kim, S. (2023) · Journal of Writing Research · doi:10.17239/jowr-2023.15.02.02 · Cited by 6 · see citing works
A GEARed peer feedback model and implications for learning facilitation
Huang, S.-C. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1439881 · Cited by 7 · see citing works
Peer mentoring and collaboration in the clinical setting: a case study in dental hygiene
Parkison, P. T., & Bartek, J. K. (2010) · Reflective Practice · doi:10.1080/14623941003665893 · Cited by 6 · see citing works
Some limits in peer assessment
Peña, J. D., García, H. M., Castro, S. G., & Gámiz, J. (2014) · Journal of Technology and Science Education · doi:10.3926/jotse.90 · Cited by 6 · see citing works
The PASCA: A Mail Based Randomized Blinded Peer Assessment System for Complex Artifacts
Neznanov, A. A., & Maksimenkova, O. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.08.261 · Cited by 5 · see citing works
L2 writers’ perspectives on face-to-face and anonymous peer review: Voices from China
Kim, S., & Lan, Y. (2021) · Porta Linguarum Revista Interuniversitaria de Didáctica de las Lenguas Extranjeras · doi:10.30827/portalin.v0i35.13887 · Cited by 5 · see citing works
Educating Students in Technology Enhanced Learning Design by Interweaving Instruction and Assessment
Γόγουλου, Α., & Grigoriadou, M. (2021) · Informatics in Education · doi:10.15388/infedu.2021.17 · Cited by 6 · see citing works
Technology and distance learning.
Brown, M. C., & Udas, K. (2005) · Cited by 5 · see citing works
Aben, J. E. J., Timmermans, A. C., Dingyloudi, F., & Strijbos, J.-W. (2023) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2023.101248 · Cited by 6 · see citing works
Chang, C., & Huang, K.-H. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13044-9 · Cited by 4 · see citing works
Peer Assessment in L2 Pronunciation Instruction in Russia: Students’ Attitude Research
Kolesnikova, A., Maslova, A., & Mishieva, E. (2020) · IAFOR Journal of Education · doi:10.22492/ije.8.1.08 · Cited by 1 · see citing works
Peer Feedback - what are students telling each other?
Gardner, A., & Willey, K. (2011) · UTS ePRESS (University of Technology Sydney) · Cited by 4 · see citing works
Hispanic Preservice Teachers’ Peer Evaluations of Interdisciplinary Curriculum Development
An, S. A., Tillman, D. A., Zhang, M., Robertson, W. H., & Tinajero, J. (2015) · Journal of Hispanic Higher Education · doi:10.1177/1538192715612912 · Cited by 4 · see citing works
Sanaeifar, S. H., & Mirshojaee, S. B. (2020) · Theory and Practice in Language Studies · doi:10.17507/tpls.1008.12 · Cited by 4 · see citing works
The Effectiveness of and Students’ Perceptions of Peer Feedback: A Vietnam Action Research Project
Phan, T. N. L. (2023) · Rupkatha Journal on Interdisciplinary Studies in Humanities · doi:10.21659/rupkatha.v15n1.09 · Cited by 3 · see citing works
Meihami, H., & Esfandiari, R. (2020) · XLinguae · doi:10.18355/xl.2020.13.04.7 · Cited by 2 · see citing works
Abo, A. L., Wubshet, H., & Abeba, B. D. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.102117 · Cited by 4 · see citing works
Fan, M., Robson, S., & Leat, D. (2015) · Palgrave Macmillan US eBooks · doi:10.1057/9781137475145_8 · Cited by 2 · see citing works
Peer Assessing in Higher Education: Perspectives of Students and Staff
Sealey, R. (2013) · Education Research and Perspectives · doi:10.70953/erpv40.13013 · Cited by 2 · see citing works
Kolomiets, A., Maksimenkova, O., & Neznanov, A. A. (2016) · Бизнес-информатика · doi:10.17323/1998-0663.2016.4.35.46 · Cited by 2 · see citing works
Al‐Barakat, A. A., & Al-Hassan, O. M. (2013) · Journal of Educational & Psychological Sciences · doi:10.12785/jeps/140410 · Cited by 2 · see citing works
Using Peer Review to Promote Writing Development in ESL Classes
Thokwane, D. (2011) · Cornerstone (Minnesota State University, Mankato) · Cited by 2 · see citing works
Siddiqui, A., Illyas, R., & Jokhio, R. A. (2017) · International Journal of Language and Literature · doi:10.15640/ijll.v5n2a16 · Cited by 2 · see citing works
Assessment Practices in a Cambodian University: Through the Lens of Lecturers and Students
Nguon, S. (2013) · doi:10.26686/wgtn.17004847.v1 · Cited by 3 · see citing works
INSTRUCTIONAL DESIGN AND ASSESSMENT Anonymous Peer Assessment of Medication Management Reviews
Basheti, I. A., Ryan, G., Woulfe, J., & Bartimote-Aufflick, K. (2010) · Cited by 1 · see citing works
Constructing Successful Video Reflection Experiences in Practicum Settings
Deeney, T. A., & Dozier, C. L. (2015) · Emerald Group Publishing Limited eBooks · doi:10.1108/s2048-045820150000005009 · Cited by 1 · see citing works
Implementing peer assessment practices in the “Academic writing” course in English
Николаевна, С. О. (2024) · Педагогика и психология образования · doi:10.31862/2500-297x-2024-2-48-68 · Cited by 1 · see citing works
Peer evaluation of academic presentations by Japanese graduate students: Qualitative evaluation
Jie, S., & Cross, J. (2015) · International Conference on Advanced Mechatronic Systems · doi:10.1109/icamechs.2015.7287104 · Cited by 1 · see citing works
An Analysis of Peer-Assessment in Chinese as a Second Language Classroom Presentation
Lu, L. (2018) · EngagedScholarship @ Cleveland State University (Cleveland State University) · Cited by 1 · see citing works
Chu, T. L. H. (2014) · eSpace (Curtin University) · Cited by 1 · see citing works
Software for determining the quality of an exam test
Svoboda, V., Marek, J., & Brozek, J. (2016) · ELEKTRO · doi:10.1109/elektro.2016.7512166
Understanding how faculty integrate peer assessment in project management education
Rainford, K. J. (2014) · ProQuest Demo Repository
Swartz, D. (2019) · ReiDoCrea Revista electrónica de investigación Docencia Creativa · doi:10.30827/digibug.58471
Applying the Benefits of Peer Assessment to the High School English Classroom
OʼFlaherty, D. (2015) · The Language Teacher · doi:10.37546/jalttlt39.6-4
Authors, V. (2014) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v15i3.1941
Morton, L. M., & Reynaud, D. (2021) · TEACH Journal of Christian Education · doi:10.55254/1835-1492.1439
Teachers’ Perspective on Using Oral Peer Feedback in Public Speaking
Hidayat, N. S., Purwanti, O., & Setiawan, S. (2023) · EDUKASIA Jurnal Pendidikan dan Pembelajaran · doi:10.62775/edukasia.v4i2.385
Cheong, C. M., Zhu, X., & Lu, Q. (2025) · ECNU Review of Education · doi:10.1177/20965311251346498
Assessment and Grading Rubrics
(2013) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-62396-294-420251008
Paul, U., Mantravadi, A., Shah, J., Shah, S., Mylavarapu, S. V., Rashid, M. P., & Gehringer, E. F. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328205
TATL—360° Assessment for Teaching and Learning: A Case Study in Digital Electronics Lab
Daibes, J. V. D., & Zanghi, R. (2026) · IEEE Transactions on Education · doi:10.1109/te.2026.3658034
What have researchers examined? Capturing the conceptual diversity of peer feedback quality measures
Zhang, Y., & Schunn, C. D. (2026) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2026.101642
- Authors
- Davies, P.
- Affiliations
- University of Glamorgan (GB)
- Corresponding author
- Davies, Phil
- Venue
- Innovations in Education and Teaching International
- Publisher
- Informa UK Limited
- Published
- 2006-02
- Volume
- 43
- Issue
- 1
- Pages
- 69-82
- ISSN
- 1470-3297 (ISSN-L)
- 1470-3300
- OpenAlex
- W2000405589
- Cited by
- 94
- References
- 21
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 2 · 2023: 5 · 2022: 1 · 2021: 5 · 2020: 5 · 2019: 3 · 2018: 4 · 2017: 2 · 2016: 10 · 2015: 9 · 2014: 11 · 2013: 9 · 2012: 3
- FWCI
- 14.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Innovations in Education and Teaching International (publishedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Evaluation of Teaching Practices
- Keywords
- peer assessment, peer feedback, peer marking, essay quality, student ability differences, academic writing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
