Marking as judgment
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
An aspect of assessment which has received little attention compared with perennial concerns, such as standards or reliability, is the role of judgment in marking. This paper explores marking as an act of judgment, paying particular attention to the nature of judgment and the processes involved. It brings together studies which have explored marking from a psychological perspective for the purpose of critical discussion of the light they shed on each other and on the practice of marking. Later stages speculate on recent developments in psychology and neuroscience which may cast further light on educational assessment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Studies in the field of human judgement have brought to bear better understandings regarding our own fallibility in evaluating or judging student work (Brooks 2012).”
From Developing evaluative judgement: enabling students to make decisions about the quality of work (2018) · cites this paper as Brooks 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1999) · Cited by 28,356
Communities of Practice: Learning, Meaning, and Identity
Wenger, E. (1998) · doi:10.1017/cbo9780511803932 · Cited by 23,500
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Tversky, A., & Kahneman, D. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.293 · Cited by 3,991
Slovic, P., Finucane, M., Peters, E., & MacGregor, D. G. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.025 · Cited by 2,349
Non‐formal learning and tacit knowledge in professional work
Eraut, M. (2000) · British Journal of Educational Psychology · doi:10.1348/000709900158001 · Cited by 2,013
The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes
van Someren, M. (1994) · Cited by 1,730
The use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509 · cited 1×
“Jonsson and Svingby 2007 ; Price and Rust 1999 ).”
BackgroundWe Feel, Therefore We Learn: The Relevance of Affective and Social Neuroscience to Education
Immordino‐Yang, M. H., & Damasio, A. (2007) · Mind, Brain, and Education · doi:10.1111/j.1751-228x.2007.00004.x · Cited by 1,463 · cited 1×
“Immordino‐Yang and Damasio ( 2007 , 3) argue that ‘Modern biology reveals humans to be fundamentally emotional and social creatures … It is not that emotions rule our cognition, nor that rational thought does not exist’.”
BackgroundBlackwell Handbook of Judgment and Decision Making
(2004) · Wiley eBooks · doi:10.1002/9780470752937 · Cited by 961
The Role of Constructs in Psychological and Educational Measurement
(2001) · Routledge eBooks · doi:10.4324/9781410607454 · Cited by 871
Research works printed but not linked: 9
- Bridges D., 1995, Competence‐based Higher Education and the Standards Methodology
- Harlen W., 2004, Research evidence in education library
- Laming D., 2004, Human judgement: The eye of the beholder
- Milanovic M., 1996, Studies in language testing 3: Performance testing, cognition and assessment, 92
- Pollitt A., 1996, Studies in language testing 3: Performance testing, cognition and assessment, 74
- 2006, Code of practice for the assurance of academic quality and standards in higher education
- 2009, Thematic enquiries into concerns about academic quality and standards in higher education in England: Final report
- Wiliam D., 1992, British Journal of Curriculum and Assessment, 2, 11
- Wilmut J., 1996, A review of research into the reliability of examinations: Discussion paper prepared for the School Curriculum and Assessment Authority
Cited by
Developing evaluative judgement: enabling students to make decisions about the quality of work
Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018) · Higher Education · doi:10.1007/s10734-017-0220-3 · Cited by 810
“Studies in the field of human judgement have brought to bear better understandings regarding our own fallibility in evaluating or judging student work (Brooks 2012).”
BackgroundBloxham, S., Hughes, C., & Adie, L. E. (2015) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1039932 · Cited by 73
External examining: fit for purpose?
Bloxham, S., & Price, M. (2013) · Studies in Higher Education · doi:10.1080/03075079.2013.823931 · Cited by 50
Rise of the Machines? The Evolving Role of AI Technologies in High-Stakes Assessment
Richardson, M., & Clesham, R. (2021) · London Review of Education · doi:10.14324/lre.19.1.09 · Cited by 48
“As might be expected, the reliability of assessing speaking and writing skills (that is, open-ended productive skills) has always been a significant challenge on a local and national level (Brooks, 2012; Rhead and Black, 2018).”
AI-Assisted Enhancement of Student Presentation Skills: Challenges and Opportunities
Chen, J., Lai, P., Chan, A., Man, V., & Chan, C.-H. (2022) · Sustainability · doi:10.3390/su15010196 · Cited by 43
Metadata
- Authors
- Brooks, V.
- Affiliations
- University of Warwick (GB)
- Corresponding author
- Brooks, Val
- Venue
- Research Papers in Education
- Publisher
- Informa UK Limited
- Published
- 2012-03
- Volume
- 27
- Issue
- 1
- Pages
- 63-80
- ISSN
- 0267-1522 (ISSN-L)
- 1470-1146
- OpenAlex
- W2081690553
- Cited by
- 45
- References
- 56
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 5 · 2023: 2 · 2022: 3 · 2021: 3 · 2020: 2 · 2019: 2 · 2018: 5 · 2017: 5 · 2016: 3 · 2015: 2 · 2013: 5
- FWCI
- 2.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Research Papers in Education (publishedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational and Psychological Assessments
- Keywords
- marking, judgment, assessment, grading, educational assessment practices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Marking as judgment. https://app.cochat.ai/papers/10.1080/02671520903331008
- The paper
- Brooks, V. (2012). Marking as judgment. Research Papers in Education. https://doi.org/10.1080/02671520903331008
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.