When Can Subscores Have Value?
Abstract
In educational tests, subscores are often generated from a portion of the items in a larger test. Guidelines based on mean squared error are proposed to indicate whether subscores are worth reporting. Alternatives considered are direct reports of subscores, estimates of subscores based on total score, combined estimates based on subscores and total scores, and residual analysis of subscores. Applications are made to data from two testing programs.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
If the ratio of PRMSE based on subscale scores over total score exceeds one, the subscore does not have added value and it is not recommended to use the subscore in statistical models.
“If the ratio of these values, subscore over total score, exceed one, the subscore does not have added value and it is not recommended to use the subscore in statistical models.”
From Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis (2020) · cites this paper as [41]
The citation lists haven’t been fetched yet
References 9 · Cited by 240
- Authors
- Haberman, S. J.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Haberman, Shelby J.
- ORCID
- Haberman, Shelby J.
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 2008-06
- Volume
- 33
- Issue
- 2
- Pages
- 204-229
- ISSN
- 1076-9986 (ISSN-L)
- 1935-1054
- OpenAlex
- W2035895739
- Cited by
- 240
- References
- 9
- Citations by year
- 2026: 10 · 2025: 14 · 2024: 11 · 2023: 14 · 2022: 8 · 2021: 8 · 2020: 24 · 2019: 16 · 2018: 26 · 2017: 21 · 2016: 12 · 2015: 20 · 2014: 10 · 2013: 11 · 2012: 9
- FWCI
- 7.66
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Educational and Behavioral Statistics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Educational Assessment and Pedagogy
- Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
- Keywords
- test score reporting, mean squared error, residual analysis, educational testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
