The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index; none of the 28 sources its claims cite is checked for support yet.
Identifying what our students have learned: a framework for practical assessment validation
Open accessAbstract
Universities are responsible for safeguarding the value of qualifications through assessment that generates trustworthy evidence about what students know and can do. Public trust in higher education depends on the credibility of these inferences. Yet, in practice, assessment often rests on inappropriate inferences drawn from misaligned or inadequate evidence. This conceptual article addresses that problem by reframing assessment validity, not as the alignment of outcomes and tasks, but in terms of the challenge of evidencing learning through a series of proxies. We introduce the 4Ps framework (product, process, performance and practice) which identifies four primary types of evidence used in assessment. The framework highlights strengths and limitations of each type of proxy, the risks of over-reliance or misuse, and the consequences for assessment validity. By exposing often-overlooked differences between intended outcomes and assessment evidence, the 4Ps framework offers a practical resource for educators, programme teams and institutions to interrogate existing practices, design more credible and balanced assessment systems, and consider reforms at both unit and programme levels. In doing so, it contributes to the broader project of strengthening the robustness, fairness and public legitimacy of assessment in higher education.
Overview
CoChat Summary
TL;DR
This conceptual article argues that assessment validity should be reframed not as alignment between outcomes and tasks, but as the challenge of evidencing learning through indirect proxies. It introduces the 4Ps framework (product, process, performance, practice) to help educators interrogate which proxies their assessments rely on and what inferences those proxies can credibly support.
Key findings
- The 4Ps framework identifies four primary types of assessment evidence: product (tangible artefacts such as essays, reports, code, artworks), performance (synchronous, directly observed demonstration in action), process (steps, strategies and approaches used in preparation), and practice (patterned, situated ways of working across contexts, often with real stakes beyond assessment). Each is a partial lens with distinct strengths and limitations.
- The authors argue validity is "not a property of a task, but of the inferences made from a set of evidence," and identify recurring forms of misalignment: mismatching (wrong proxy chosen), mismanagement (right proxy, flawed assessment), misinterpreting (inappropriate conclusions drawn), slippage (intending one proxy but assessing another), spillage (unintended additional proxies assessed), and over-saturation (repeated reliance on one proxy, especially products, across a curriculum).
- Three approaches to synthesising evidence from multiple proxies are contrasted: aggregation (adding/averaging marks, which the authors argue can undermine validity because "a strong exam result and a weak oral presentation do not average out to a 'moderate' capability"), triangulation (comparing evidence sources for convergence or gaps), and holistic assessment (assessor judgement across multiple evidence pieces).
- The paper argues that programme-level assessment is often a more feasible site than unit-level assessment for meaningful sampling and synthesis, and that assessment design involves "satisficing" among competing purposes and trade-offs (validity, reliability, educational impact, acceptability, cost).
Methods
- Conceptual/theoretical article; no primary empirical data, sample, or statistical analysis is reported. The authors state: "This conceptual article addresses that problem by reframing assessment validity..."
- The argument is developed through literature synthesis and three hypothetical illustrative scenarios (students named Phill, Dave and Tim) showing how product-based evidence can over-extrapolate, under-recognise, or misread achievement.
- The framework is positioned in dialogue with prior work, including a broader framework by Steel (cited as a URL) and existing literature on constructive alignment, programmatic assessment, and performance assessment sampling.
Limitations
- The paper states no formal limitations section; it acknowledges only that "Our critique is not radical" and that the challenges raised "are significant, [but] they are not insurmountable."
- Evident from the text: the framework is not empirically tested or validated in this article — no data are presented on its use in practice, and the illustrative scenarios are hypothetical rather than drawn from a study.
- Evident from the text: the authors note that extensive sampling across proxies is "resource-intensive, and it is neither possible nor desirable to assess every aspect of every learning outcome in every context," leaving open how institutions should resolve the resource trade-offs the framework surfaces.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 24 Not checked · 92 Own results and interpretations
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The interpretation of assessment evidence is the point at which task design, assessment conditions, criteria and sampling crystallise into judgement and, as such, is a point of risk for validity.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“They conceal the skills, effort, decisions or forms of contribution involved in producing the artefact.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most conceptions foreground some dimensions of learning that are difficult, if not impossible, to observe directly.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These examples illustrate how the interpretation of assessment evidence can misrepresent students’ achievements.”
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No single task can perfectly align with a learning outcome.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
32 more claims
Create a free account to see all 117 claims and every source verdict.
- Probably not a substantial claim. 68
- It may state two separate claims as one. 30
Citations
Cites
Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324
Situated Cognition and the Culture of Learning
Brown, J. S., Collins, A., & Duguid, P. (1989) · Educational Researcher · doi:10.3102/0013189x018001032 · Cited by 13,645
Enhancing teaching through constructive alignment
Biggs, J. (1996) · Higher Education · doi:10.1007/bf00138871 · Cited by 4,084
On Two Metaphors for Learning and the Dangers of Choosing Just One
Sfard, A. (1998) · Educational Researcher · doi:10.2307/1176193 · Cited by 3,819
Developing the theory of formative assessment
Black, P., & Wiliam, D. (2009) · Educational Assessment, Evaluation and Accountability · doi:10.1007/s11092-008-9068-5 · Cited by 3,301
Sustainable Assessment: Rethinking assessment for the learning society
Boud, D. (2000) · Studies in Continuing Education · doi:10.1080/713695728 · Cited by 1,545
Self-citationMezirow, J. (1978) · Adult Education · doi:10.1177/074171367802800202 · Cited by 1,463
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
A model for programmatic assessment fit for purpose.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652239 · Cited by 892
Authentic assessment: creating a blueprint for course design
Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1412396 · Cited by 560
Research works printed but not linked: 11
- Bloxham, S. 2014. “Assessing Assessment: New Developments in Assessment Design, Feedback Practices and Marking in Higher Education.” In S. Marshall, H. Fry, & S. Ketteridge (Eds.), A Handbook for Teaching and Learning in Higher Education: Enhancing Academic Practice (pp. 107–122). Abingdon: Routledge.
- Bloxham, S., and P. Boyd. 2007. Developing Effective Assessment in Higher Education: A Practical Guide. Maidenhead: The Open University Press.
- Boud, D., & Molloy, E. (Eds.) 2013. Feedback in Higher and Professional Education: Understanding It and Doing It Well. London: Routledge.
- Brown, J. S., and P. Duguid. 2002. The Social Life of Information. Boston: Harvard Business School Press.
- Erikson, E. 1959. Identity and the Life Cycle. New York, NY: Norton.
- Meyer, J. H. F., and R. Land. 2003. “Threshold Concepts and Troublesome Knowledge: Linkages to Thinking and Practising within the Disciplines.” In Rust C. (Ed.), Improving Student Learning: Theory and Practice—Ten Years on (pp. 412–424). Oxford, England: Centre for Staff and Learning Development.
- Palm, T. 2008. “Performance Assessment and Authentic Assessment: A Conceptual Analysis of the Literature.” Practical Assessment, Research & Evaluation 13 (4): 1–11.
- Prosser, M., and K. Trigwell. 1999. “Understanding Learning and Teaching: The Experience in Higher Education.” Buckingham: Open University Press.
- Rowntree, D. 1987. Assessing Students: How Shall we Know Them? London: Kogan Page.
- Schoenfeld, A. 2010. “Noticing Matters. A Lot. Now What?.” In Sherin, M. G., V. R. Jacobs, & R. A. Philipp (Eds.), Mathematics Teacher Noticing: Seeing Through Teachers’ Eyes (pp. 223–238). London: Routledge.
- Skinner, B. F. 1938. The Behavior of Organisms:An Experimental Analysis. New York: Appleton-Century-Crofts.
Cited by
Educational integrity in GenAI-augmented assessment: making judgement visible
Sharma, S. (2026) · International Journal for Educational Integrity · doi:10.1007/s40979-026-00216-y · Cited by 21
Assessment validity in the age of generative artificial intelligence: a critical review
Ali, R., & Maroulis, J. (2026) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2026.2683046 · Cited by 10
Which inference is at risk? Assessment validity reasoning and generative AI
Weidlich, J. (2026) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2026.2734795 · Cited by 6
Gonsalves, C., Vuren, S. V., & Gill-Simmen, L. (2026) · Journal of Marketing Education · doi:10.1177/02734753261454375 · Cited by 3
Graduate teachers’ and the teacher performance assessment: the case for architectures of judgement
Weston, H. E., Mooney, A., Thomas, M. K. E., & Iannucci, C. (2026) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2026.2658631 · Cited by 2
Metadata
- Authors
- Fawns, T., Boud, D., & Dawson, P.
- Affiliations
- Monash University (AU)
- University of Technology Sydney (AU)
- Deakin University (AU)
- Corresponding author
- Fawns, Tim
- Venue
- Assessment & Evaluation in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2026-02
- Pages
- 1-17
- ISSN
- 0260-2938 (ISSN-L)
- 1469-297X
- OpenAlex
- W7127041370
- Semantic Scholar
- a48f7fb9860f73a082dd0b6fdc748f03fb790403
- Cited by
- 28
- References
- 30
- Citations by year
- 2026: 28
- FWCI
- 138.97
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Assessment & Evaluation in Higher Education (publishedVersion, cc-by)
- OPUS - Open Publications of UTS Scholars (University of Technology Sydney) (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Teacher Education and Assessments
- Keywords
- assessment validity, 4Ps framework, evidence of learning, higher education assessment, assessment design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Identifying what our students have learned: a framework for practical assessment validation. https://app.cochat.ai/papers/10.1080/02602938.2026.2620053
- The paper
- Fawns, T., Boud, D., & Dawson, P. (2026). Identifying what our students have learned: a framework for practical assessment validation. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2026.2620053
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.