The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index; 18 of the 72 sources its claims cite were checked for support.
Developing evaluative judgement: enabling students to make decisions about the quality of work
Open accessAbstract
Evaluative judgement is the capability to make decisions about the quality of work of oneself and others. In this paper, we propose that developing students’ evaluative judgement should be a goal of higher education, to enable students to improve their work and to meet their future learning needs: a necessary capability of graduates. We explore evaluative judgement within a discourse of pedagogy rather than primarily within an assessment discourse, as a way of encompassing and integrating a range of pedagogical practices. We trace the origins and development of the term ‘evaluative judgement’ to form a concise definition then recommend refinements to existing higher education practices of self-assessment, peer assessment, feedback, rubrics, and use of exemplars to contribute to the development of evaluative judgement. Considering pedagogical practices in light of evaluative judgement may lead to fruitful methods of engendering the skills learners require both within and beyond higher education settings.
Overview
CoChat Summary
TL;DR
This conceptual paper proposes that developing students’ evaluative judgement—the capability to make decisions about the quality of work of self and others—should be a goal of higher education. It traces the term’s origins, offers a concise definition, and recommends refinements to five existing pedagogical practices to better support it.
Key findings
- The paper defines evaluative judgement as “the capability to make decisions about the quality of work of self and others,” with two integral components: understanding what constitutes quality and applying that understanding through appraisal of one’s own or another’s work.
- It argues evaluative judgement should be an integrating, encompassing goal of higher education, not primarily an assessment concern, and that it can reframe pedagogies to prepare students for future learning and work.
- It identifies five common practices with potential to develop evaluative judgement—self-assessment, peer assessment/review, feedback, rubrics, and exemplars—and contrasts sub-optimal implementations with potential improvements in Table 1.
- It states that “very little empirical work exists” on strategies for developing evaluative judgement, citing Nicol et al. (2014), Tai et al. (2016), and Barton et al. (2016) as exceptions within an explicit evaluative judgement framework.
Methods
- Conceptual/theoretical paper: traces the evolution of “evaluative judgement” in the literature, converges on a definition, discusses five pedagogical approaches, and concludes with implications for research and practice.
- No empirical sample, participants, dataset, or data collection is reported.
- Main analysis is literature-based conceptual synthesis and argument, including a table contrasting sub-optimal strategies with potential improvements.
Limitations
- The paper states that evaluative judgement is undertheorised and under-researched, with very little empirical work on the effectiveness of strategies for developing it.
- It calls for further theoretical work and empirical studies to test strategies, track longitudinal development, and examine professional practice outcomes; it also notes possible motivational, attitudinal, and embodied aspects to consider.
- Evident from the text: as a conceptual paper, it presents no primary data or outcome measures, and its proposed refinements are not empirically tested here.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
18 Valid · 3 Not valid · 39 Not checked · 77 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Despite longstanding criticisms (Boud and Falchikov 1989), this strategy remains common in selfassessment research (Panadero et al. 2016).”
§ The Author(s) 2017. This article is an open access publication > Self-assessment · p. 7
What the sources say
- Not checked — no full text of the sourcecites Boud and Falchikov 1989 source
- Supportedcites Panadero et al. 2016 source
Section 2 (p. 17) says self-assessment accuracy research has focused predominantly on students predicting a grade or score, including whether they give the same grade a teacher would give. The paper also says the vast majority of accuracy research focuses on closeness to an external score. The citing sentence attributes the longstanding criticisms separately to Boud and Falchikov, not to this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Students have been shown to value teacher explanation more than their own interactions with exemplars (Hendry and Jukic 2014).”
§ The Author(s) 2017. This article is an open access publication > Exemplars · p. 11
What the sources say
- Supportedcites Hendry and Jukic 2014 source
The Discussion reports that students valued both marking exemplars themselves and the teacher’s explanation, but regarded the explanation as the most beneficial part of the experience. The study concerns undergraduate and postgraduate nutrition students, as described in the Abstract. (LLM, conf=0.93)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Studies in the field of human judgement have brought to bear better understandings regarding our own fallibility in evaluating or judging student work (Brooks 2012).”
§ The Author(s) 2017. This article is an open access publication > Introduction · p. 2
What the sources say
- Supportedcites Brooks 2012 source
The Introduction explains that most marking depends on individual judgment. “Judgment under uncertainty: The role of biases” reports that a wide range of biases can affect assessments of student work, supporting the claim that judgment research illuminates assessors’ fallibility. Page numbers were not provided. (LLM, conf=0.91)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“This literature supports students developing capability for evaluative judgement either through strategies that involve self-assessment (e.g. Boud 1992; Panadero et al. 2016), peer assessment (e.g. Panadero 2016; Topping 2010), or self-regulated learning (e.g. Nicol and MacfarlaneDick 2006; Panadero and Alonso-Tapia 2013).”
§ The Author(s) 2017. This article is an open access publication > Defining evaluative judgement · p. 5
What the sources say
- Not checked — no full text of the sourcecites Boud 1992 source
- Supportedcites Panadero et al. 2016 source
The citation to Panadero et al. is attached to the self-assessment strategy, not the separate peer-assessment or self-regulated-learning examples. In §2.1 (p. 22), the review says students can be taught self-assessment skills and that feedback on their assessments can help them become more accurate self-assessors. This supports developing evaluative judgement through self-assessment. (LLM, conf=0.92)
- Not matchedcites Panadero 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Self-assessment is typically focused on a specific task, whereby a student comes to understand the required standard and thus improves their work on the specific task at hand (Panadero et al. 2016).”
§ The Author(s) 2017. This article is an open access publication > Self-assessment · p. 9
What the sources say
- Partly supportedcites Panadero et al. 2016 sourceExperimental — accuracy not yet measured
Section 1 (p. 6) describes self-assessment as judging specific aspects of achievement, and Section 2.1 (p. 21) says specific, well-understood criteria help students assess their work accurately. But Section 2.2 cautions that accurate self-assessment does not automatically lead to improved performance; students must also identify and carry out appropriate changes. The claim overstates that final step. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
31 more claims · 1 with their cited sources checked
Create a free account to see all 137 claims and to verify the 2 references still open.
- It may state two separate claims as one. 33
- Probably not a substantial claim. 88
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The workflow scaffolded three behaviours associated with productive feedback use that the Directed Feedback and Self-Directed Feedback conditions left to students' discretion: student agency through selection, evaluative judgement through prioritisation, and dialogic engagement through targeted AI assistance [3, 20, 61].”
From Making AI-Generated Feedback Matter: A Large-Scale Study of Feedback Workflows and Student Enactment (2026) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Rubrics serve as a catalyst for reviewers’ engagement in peer feedback (Yu, 2021), enhance their genre-specific knowledge and enable them to generate constructive critiques of their peers’ academic work (Ciampa and Wolfe, 2023; Tai et al., 2018).”
From Incorporating peer feedback in academic writing: a systematic review of benefits and challenges (2024) · cites this paper as Tai et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Peer assessment is a common strategy in online group work, and not only serves as a tool for evaluation but also helps students develop evaluative judgement.”
From Exploring the experiences of social loafing in group work among online psychology students (2025) · cites this paper as Tai et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This approach may improve the fairness and accuracy of peer assessments and help students build evaluative judgment skills (Tai et al., 2018).”
From Exploring the experiences of social loafing in group work among online psychology students (2025) · cites this paper as Tai et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When students compare external comments with task criteria, prior understanding, and their own initial diagnosis of the work, they generate internal feedback that can inform planning, monitoring, and strategic adjustment during revision”
From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Tai et al., 2018
Experimental — accuracy not yet measured
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The Author(s) 2017. This article is an open access publication > Rubrics · p. 10
“There is extensive diversity of rubric practices (Dawson 2015),”
§ The Author(s) 2017. This article is an open access publication > References · p. 13
“Dawson, P. (2017). Assessment rubrics: towards clearer and more replicable design, research and practice.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The Author(s) 2017. This article is an open access publication > Rubrics · p. 10
“Student co-creation of rubrics may support the development of evaluative judgement (Fraile et al. 2016).”
§ The Author(s) 2017. This article is an open access publication > References · p. 14
“Fraile, J., Panadero, E., & Pardo, R. (2017). Co-creating rubrics: the effects on self-regulated learning, selfefficacy and performance of establishing assessment criteria with students.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The Author(s) 2017. This article is an open access publication > Exemplars · p. 11
“However, teachers may need to reserve their own evaluative judgement to allow students to co-construct understandings of quality (Carless and Chan 2016).”
§ The Author(s) 2017. This article is an open access publication > References · p. 13
“Carless, D., & Chan, K. K. H. (2017). Managing dialogic use of exemplars.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The Author(s) 2017. This article is an open access publication > Introduction · p. 2
“Heuristics and biases are also likely to influence decision-making (Joughin et al. 2016).”
§ The Author(s) 2017. This article is an open access publication > References · p. 14
“Joughin, G., Dawson, P., & Boud, D. (2017). Improving assessment tasks through addressing our unconscious limits to change.”
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846 · cited 3×
“These proposals were specifically made in relation to the role of formative assessment in learning design: formative assessments were to aid students in understanding how complex judgements were made and to allow students to have direct, authentic experiences of evaluating others and being evaluated (Nicol and Macfarl…”
BackgroundInfluentialFormative assessment and the design of instructional systems
Sadler, D. R. (1989) · Instructional Science · doi:10.1007/bf00117714 · Cited by 4,285 · cited 1×
“Feedback Feedback as ‘telling’ (Sadler 1989) or ‘corrections’ or as information handed to the student; information provided at times and on tasks, or in a manner which does not allow it to be easily used for future work; provision of information without follow-up on whether it was able to be used…”
BackgroundBrown, R. D. (1992) · The Journal of Higher Education · doi:10.1080/00221546.1992.11778372 · Cited by 3,493 · cited 1×
“Metacognition and ‘reflective judgement thinking’ (Pascarella and Terenzini 2005) also fall within this category of largely self-oriented ideas.”
BackgroundFlawed Self-Assessment: Implications for Health, Education, and the Workplace
Dunning, D., Heath, C., & Suls, J. M. (2004) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2004.00018.x · Cited by 1,865
Rethinking models of feedback for learning: the challenge of design
Boud, D., & Molloy, E. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2012.691462 · Cited by 1,636 · cited 3×
“…in recent years to move beyond merely providing students with information about their work to emphasising the effects on students’ subsequent work and to involving them as active agents in a forwardlooking dialogue about their studies (Boud and Molloy 2013; Carless et al. 2011; Merry et al. 2013).”
BackgroundSelf-citationSustainable Assessment: Rethinking assessment for the learning society
Boud, D. (2000) · Studies in Continuing Education · doi:10.1080/713695728 · Cited by 1,545 · cited 1×
“Sustainable assessment was proposed as assessment ‘that meets the needs of the present and [also] prepares students to meet their own future learning needs’(Boud 2000, p. 151).”
BackgroundSelf-citation(2005) · Jossey-Bass, An Imprint of Wiley · Cited by 1,462
The use of self-, peer and co-assessment in higher education: A review
Dochy, F., Segers, M., & Sluijsmans, D. (1999) · Studies in Higher Education · doi:10.1080/03075079912331379935 · Cited by 1,206 · cited 1×
“Simultaneously, others have pointed to the formative, educative, and pedagogical purposes of peer assessment (Dochy et al. 1999; Liu and Carless 2006; Panadero 2016) and consider both the receiving and the giving of peer feedback to be important for learning (van den Berg et al. 2006), particularly…”
BackgroundStudent Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170 · cited 1×
“…to the literature regarding self-assessment, a significant proportion of studies of peer assessment have focused on the accuracy of marks generated and the potential for a number calculated from peer assessments to contribute to grades (Falchikov and Goldfinch 2000; Speyer et al. 2011).”
Background
Research works printed but not linked: 1
- Panadero, E., & Alonso-Tapia, J. (2013). Self-Assessment: theoretical and Practical Connotations. When It Happens, How Is It Acquired and What to Do to Develop It in Our Students. Electronic Journal of Research in Educational Psychology, 11(2), 551–576.
Cited by
The development of student feedback literacy: Enabling uptake of feedback
Carless, D., & Boud, D. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1463354 · Cited by 2,428
“To make the most of feedback processes, students need to be developing evaluative judgment: capability to make decisions about the quality of work of oneself and others (Tai et al. 2017).”
Self-citationTeacher feedback literacy and its interplay with student feedback literacy
Carless, D., & Winstone, N. (2023) · Teaching in Higher Education · doi:10.1080/13562517.2020.1782372 · Cited by 603
Developing a learning-centred framework for feedback literacy
Molloy, E., Boud, D., & Henderson, M. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1667955 · Cited by 555
Self-citationWhat makes for effective feedback: staff and student perspectives
Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., & Molloy, E. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1467877 · Cited by 514
Self-citationThe power of internal feedback: Exploiting natural comparison processes
Nicol, D. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1823314 · Cited by 402
Metadata
- Authors
- Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E.
- Affiliations
- Deakin University (AU)
- University of Technology Sydney (AU)
- Corresponding author
- Tai, Joanna
- Venue
- Higher Education
- Published
- 2017-12-16
- Volume
- 76
- Issue
- 3
- Pages
- 467-481
- ISSN
- 0018-1560 (ISSN-L)
- 1573-174X
- OpenAlex
- W2774723506
- Cited by
- 810
- References
- 64
- Citations by year
- 2026: 216 · 2025: 93 · 2024: 83 · 2023: 107 · 2022: 94 · 2021: 92 · 2020: 69 · 2019: 46 · 2018: 10
- FWCI
- 121.08
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Higher Education (publishedVersion, cc-by)
- Middlesex University Research Repository (Middlesex University Of London) (acceptedVersion)
- Deakin Research Online (Deakin University) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- UTS ePRESS (University of Technology Sydney) (submittedVersion)
- Funders
- Deakin University
- Ministerio de Economía y Competitividad (RYC-2013-13469)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Evaluation of Teaching Practices
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- evaluative judgments, quality of work, self-assessment, peer assessment, feedback, rubrics, exemplars, graduate competencies, teaching practice, student decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Developing evaluative judgement: enabling students to make decisions about the quality of work. https://app.cochat.ai/papers/10.1007/s10734-017-0220-3
- The paper
- Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement: enabling students to make decisions about the quality of work. Higher Education. https://doi.org/10.1007/s10734-017-0220-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.