Determining validity in national curriculum assessments
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Background: Validity is a central concern in any assessment, though this has often not been made explicit in the UK assessment context. This article applies current validity theorising, largely derived from American formulations, to national curriculum assessments in England. Purpose: The aim is to consider validity arguments in relation to the multiple purposes which national curriculum assessments serve. This is because validity is now understood in terms of how the test results are interpreted and used. Multiple purposes mean multiple uses of the results, each requiring justification. Sources of evidence: A validity framework for national curriculum assessments is presented which is organised around purposes, fitness-for-purpose, reliability and the interpretation and impact of the results. Current tests are evaluated against this framework. Main argument and conclusions: The analysis finds the national test regime successfully meets some of the common threats to validity. The main concerns are about the multiple high-stakes purposes for which the tests are used and their impact on teaching and learning. Some alternative approaches are then considered, which could reduce the burden of interpretation which the tests currently bear.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Stobart, G. (2008) · doi:10.4324/9780203930502 · Cited by 479
Self-citationThe Construct of Content Validity
Sireci, S. G. (1998) · Social Indicators Research · doi:10.1023/a:1006985528729 · Cited by 430
Cited by
A review of the benefits and drawbacks of high-stakes final examinations in higher education
French, S., Dickerson, A., & Mulder, R. A. (2024) · Higher Education · doi:10.1007/s10734-023-01148-z · Cited by 126
Can teachers’ summative assessments produce dependable results and also enhance classroom learning?
Black, P., Harrison, C., Hodgen, J., Marshall, B., & Serret, N. (2011) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969594x.2011.557020 · Cited by 98
“One aspect of this debate has been concern about the dependence on summative tests, in respect of their validity, their reliability (Stobart 2009; H of C 2008), and their harmful effects on teaching and learning (Mansell, James, and the Assessment Reform Group 2009).”
BackgroundRise of the Machines? The Evolving Role of AI Technologies in High-Stakes Assessment
Richardson, M., & Clesham, R. (2021) · London Review of Education · doi:10.14324/lre.19.1.09 · Cited by 48
“A good example of this is the removal of speaking skills assessment from the national curriculum in England, mainly due to the low reliability of the assessment outcomes (Stobart, 2009).”
Metadata
- Authors
- Stobart, G.
- Venue
- Educational Research
- Publisher
- Informa UK Limited
- Published
- 2009-05-20
- Volume
- 51
- Issue
- 2
- Pages
- 161-179
- ISSN
- 0013-1881 (ISSN-L)
- 1469-5847
- OpenAlex
- W1971170556
- Cited by
- 62
- References
- 2
- FWCI
- 19.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.