The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
The Interplay of Evidence and Consequences in the Validation of Performance Assessments
Abstract
Authentic and direct assessments of performances and products are examined in the light of contrasting functions and purposes having implications for validation, especially with respect to the need for specialized validity criteria tailored for performance assessment. These include contrasts between performances and products, between assessment of performance per se and performance assessment of competence or other constructs, between structured and unstructured problems and response modes, and between breadth and depth of domain coverage. These distinctions are elaborated in the context of an overarching contrast between task-driven and construct-driven performance assessment. Rhetoric touting performance assessments because they eschew decomposed skills and decontextualized tasks is viewed as misguided, in that component skills and abstract problems have a legitimate place in pedagogy. Hence, the essence of authentic assessment must be sought elsewhere, that is, in the quest for complete construct representation. With this background, the concepts of “authenticity” and “directness” of performance assessment are treated as tantamount to promissory validity claims that they offset, respectively, the two major threats to construct validity, namely, construct underrepresentation and construct-irrelevant variance. With respect to validation, the salient role of both positive and negative consequences is underscored as well as the need, as in all assessment, for evidence of construct validity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One way to characterise assessment is as an argument from evidence (Messick, 1994).”
From Assessment in the age of artificial intelligence (2022) · cites this paper as Messick, 1994
In the citing paper
“Yet this promise of comprehensive assessment of learning in all its forms obscures that any form of assessment demarcates and delineates what is understood by learning in any education system (Messick, 1994).”
From Assessment in the age of artificial intelligence (2022) · cites this paper as Messick, 1994
Citations
Cites
Frames of Mind: The Theory of Multiple Intelligences
Klitgaard, R., & Gardner, H. (1984) · Journal of Policy Analysis and Management · doi:10.2307/3324560 · Cited by 13,636
Chomsky, N. (1957) · doi:10.1515/9783112316009 · Cited by 7,885
Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer
Dreyfus, H. L., Drey-fus, S. E., & Zadeh, L. A. (1987) · IEEE Expert · doi:10.1109/mex.1987.4307079 · Cited by 3,172
Saeverot, H. (2022) · Indirect Education · doi:10.4324/9781003193463-8 · Cited by 3,059
Perception and the Representative Design of Psychological Experiments
Brunswik, E. (1956) · doi:10.1525/9780520350519 · Cited by 2,974
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,882
Beyond IQ: A Triarchic Theory of Human Intelligence
Clarke, A. M., & Sternberg, R. J. (1986) · British Journal of Educational Studies · doi:10.2307/3121332 · Cited by 2,866
(1968) · Cited by 2,682
Douglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
Differential Item Functioning.
Gudgeon, A. C., Holland, P. W., & Wainer, H. (1994) · The Statistician · doi:10.2307/2348590 · Cited by 2,091
Research works printed but not linked: 11
- American Psychological Association, American Educational Research Association, & National Council on Measurement in Education, 1985, Standards for educational and psychological testing
- 10.1037/0033-2909.93.1.179 · doi:10.1037/0033-2909.93.1.179 · Paper page
- Fitzpatrick R, 1971, Educational measurement, 237
- 10.3102/0013189X018009027 · doi:10.3102/0013189x018009027 · Paper page
- 10.1037/0003-066X.39.3.193 · doi:10.1037/0003-066x.39.3.193 · Paper page
- Guilford JP, 1936, Psychometric methods
- Kirst MW, 1991, Educational Researcher, 20, 21
- 10.3102/0013189X020008015 · doi:10.3102/0013189x020008015 · Paper page
- Messick S, 1988, Test validity, 33
- 10.3102/00346543062003229 · doi:10.3102/00346543062003229 · Paper page
- Wiggins G, 1989, Phi Delta Kappan, 79, 703
Cited by
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
Self-citationDesign-based research: Putting a stake in the ground
Barab, S., & Squire, K. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1301_1 · Cited by 2,642
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
Educational Data Mining and Learning Analytics
Baker, R. S., & Inventado, P. S. (2014) · Learning Analytics · doi:10.1007/978-1-4614-3305-7_4 · Cited by 1,029
Assessing professional competence: from methods to programmes
Van Der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02094.x · Cited by 1,268
Metadata
- Authors
- Messick, S.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Messick, Samuel
- Venue
- Educational Researcher
- Published
- 1994-03
- Volume
- 23
- Issue
- 2
- Pages
- 13-23
- ISSN
- 0013-189X (ISSN-L)
- 1935-102X
- OpenAlex
- W2156832302
- Cited by
- 1,315
- References
- 48
- Citations by year
- 2026: 24 · 2025: 26 · 2024: 20 · 2023: 33 · 2022: 37 · 2021: 91 · 2020: 36 · 2019: 63 · 2018: 43 · 2017: 46 · 2016: 72 · 2015: 71 · 2014: 64 · 2013: 71 · 2012: 53
- FWCI
- 171.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Educational Researcher (publishedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Teacher Education and Assessments
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- performance evaluation, construct validity, authenticity of assessment, construct underrepresentation, construct-irrelevant variance, validity evidence, competency assessment, response mode, domain coverage
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Interplay of Evidence and Consequences in the Validation of Performance Assessments. https://app.cochat.ai/papers/10.3102/0013189x023002013
- The paper
- Messick, S. (1994). The Interplay of Evidence and Consequences in the Validation of Performance Assessments. Educational Researcher. https://doi.org/10.3102/0013189x023002013
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.