Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index; none of the 28 sources its claims cite is checked for support yet.

Identifying what our students have learned: a framework for practical assessment validation

Open access
Fawns, Tim, Boud, David, Dawson, Phillip · 2026 · Assessment & Evaluation in Higher Education

Abstract

Universities are responsible for safeguarding the value of qualifications through assessment that generates trustworthy evidence about what students know and can do. Public trust in higher education depends on the credibility of these inferences. Yet, in practice, assessment often rests on inappropriate inferences drawn from misaligned or inadequate evidence. This conceptual article addresses that problem by reframing assessment validity, not as the alignment of outcomes and tasks, but in terms of the challenge of evidencing learning through a series of proxies. We introduce the 4Ps framework (product, process, performance and practice) which identifies four primary types of evidence used in assessment. The framework highlights strengths and limitations of each type of proxy, the risks of over-reliance or misuse, and the consequences for assessment validity. By exposing often-overlooked differences between intended outcomes and assessment evidence, the 4Ps framework offers a practical resource for educators, programme teams and institutions to interrogate existing practices, design more credible and balanced assessment systems, and consider reforms at both unit and programme levels. In doing so, it contributes to the broader project of strengthening the robustness, fairness and public legitimacy of assessment in higher education.

Overview

CoChat Summary

TL;DR

This conceptual article argues that assessment validity should be reframed not as alignment between outcomes and tasks, but as the challenge of evidencing learning through indirect proxies. It introduces the 4Ps framework (product, process, performance, practice) to help educators interrogate which proxies their assessments rely on and what inferences those proxies can credibly support.

Key findings

  • The 4Ps framework identifies four primary types of assessment evidence: product (tangible artefacts such as essays, reports, code, artworks), performance (synchronous, directly observed demonstration in action), process (steps, strategies and approaches used in preparation), and practice (patterned, situated ways of working across contexts, often with real stakes beyond assessment). Each is a partial lens with distinct strengths and limitations.
  • The authors argue validity is "not a property of a task, but of the inferences made from a set of evidence," and identify recurring forms of misalignment: mismatching (wrong proxy chosen), mismanagement (right proxy, flawed assessment), misinterpreting (inappropriate conclusions drawn), slippage (intending one proxy but assessing another), spillage (unintended additional proxies assessed), and over-saturation (repeated reliance on one proxy, especially products, across a curriculum).
  • Three approaches to synthesising evidence from multiple proxies are contrasted: aggregation (adding/averaging marks, which the authors argue can undermine validity because "a strong exam result and a weak oral presentation do not average out to a 'moderate' capability"), triangulation (comparing evidence sources for convergence or gaps), and holistic assessment (assessor judgement across multiple evidence pieces).
  • The paper argues that programme-level assessment is often a more feasible site than unit-level assessment for meaningful sampling and synthesis, and that assessment design involves "satisficing" among competing purposes and trade-offs (validity, reliability, educational impact, acceptability, cost).

Methods

  • Conceptual/theoretical article; no primary empirical data, sample, or statistical analysis is reported. The authors state: "This conceptual article addresses that problem by reframing assessment validity..."
  • The argument is developed through literature synthesis and three hypothetical illustrative scenarios (students named Phill, Dave and Tim) showing how product-based evidence can over-extrapolate, under-recognise, or misread achievement.
  • The framework is positioned in dialogue with prior work, including a broader framework by Steel (cited as a URL) and existing literature on constructive alignment, programmatic assessment, and performance assessment sampling.

Limitations

  • The paper states no formal limitations section; it acknowledges only that "Our critique is not radical" and that the challenges raised "are significant, [but] they are not insurmountable."
  • Evident from the text: the framework is not empirically tested or validated in this article — no data are presented on its use in practice, and the illustrative scenarios are hypothetical rather than drawn from a study.
  • Evident from the text: the authors note that extensive sampling across proxies is "resource-intensive, and it is neither possible nor desirable to assess every aspect of every learning outcome in every context," leaving open how institutions should resolve the resource trade-offs the framework surfaces.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/02602938.2026.2620053

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 1 Not valid · 24 Not checked · 92 Own results and interpretations

32 more claims

Create a free account to see all 117 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 68
  • It may state two separate claims as one. 30

Create a free account to see these claims.

Citations

Cites

Show all 30 references

Research works printed but not linked: 11

  1. Bloxham, S. 2014. “Assessing Assessment: New Developments in Assessment Design, Feedback Practices and Marking in Higher Education.” In S. Marshall, H. Fry, & S. Ketteridge (Eds.), A Handbook for Teaching and Learning in Higher Education: Enhancing Academic Practice (pp. 107–122). Abingdon: Routledge.
  2. Bloxham, S., and P. Boyd. 2007. Developing Effective Assessment in Higher Education: A Practical Guide. Maidenhead: The Open University Press.
  3. Boud, D., & Molloy, E. (Eds.) 2013. Feedback in Higher and Professional Education: Understanding It and Doing It Well. London: Routledge.
  4. Brown, J. S., and P. Duguid. 2002. The Social Life of Information. Boston: Harvard Business School Press.
  5. Erikson, E. 1959. Identity and the Life Cycle. New York, NY: Norton.
  6. Meyer, J. H. F., and R. Land. 2003. “Threshold Concepts and Troublesome Knowledge: Linkages to Thinking and Practising within the Disciplines.” In Rust C. (Ed.), Improving Student Learning: Theory and Practice—Ten Years on (pp. 412–424). Oxford, England: Centre for Staff and Learning Development.
  7. Palm, T. 2008. “Performance Assessment and Authentic Assessment: A Conceptual Analysis of the Literature.” Practical Assessment, Research & Evaluation 13 (4): 1–11.
  8. Prosser, M., and K. Trigwell. 1999. “Understanding Learning and Teaching: The Experience in Higher Education.” Buckingham: Open University Press.
  9. Rowntree, D. 1987. Assessing Students: How Shall we Know Them? London: Kogan Page.
  10. Schoenfeld, A. 2010. “Noticing Matters. A Lot. Now What?.” In Sherin, M. G., V. R. Jacobs, & R. A. Philipp (Eds.), Mathematics Teacher Noticing: Seeing Through Teachers’ Eyes (pp. 223–238). London: Routledge.
  11. Skinner, B. F. 1938. The Behavior of Organisms:An Experimental Analysis. New York: Appleton-Century-Crofts.

Cited by

See all 29

Metadata

Authors
Fawns, T., Boud, D., & Dawson, P.
Affiliations
  • Monash University (AU)
  • University of Technology Sydney (AU)
  • Deakin University (AU)
Corresponding author
Fawns, Tim
Venue
Assessment & Evaluation in Higher Education
Published
2026-02
Pages
1-17
ISSN
  • 0260-2938 (ISSN-L)
  • 1469-297X
OpenAlex
W7127041370
Cited by
28
References
30
Citations by year
2026: 28
FWCI
138.97
Type
journal article
Language
en
Open access
Locations
  • Assessment & Evaluation in Higher Education (publishedVersion, cc-by)
  • OPUS - Open Publications of UTS Scholars (University of Technology Sydney) (submittedVersion, cc-by)
Topics
  • Social Sciences › Education › Educational Assessment and Pedagogy
  • Social Sciences › Education › Student Assessment and Feedback
  • Social Sciences › Education › Teacher Education and Assessments
Keywords
assessment validity, 4Ps framework, evidence of learning, higher education assessment, assessment design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Identifying what our students have learned: a framework for practical assessment validation. https://app.cochat.ai/papers/10.1080/02602938.2026.2620053
The paper
Fawns, T., Boud, D., & Dawson, P. (2026). Identifying what our students have learned: a framework for practical assessment validation. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2026.2620053

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.