Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.

The Interplay of Evidence and Consequences in the Validation of Performance Assessments

Messick, Samuel · 1994 · Educational Researcher

Abstract

Authentic and direct assessments of performances and products are examined in the light of contrasting functions and purposes having implications for validation, especially with respect to the need for specialized validity criteria tailored for performance assessment. These include contrasts between performances and products, between assessment of performance per se and performance assessment of competence or other constructs, between structured and unstructured problems and response modes, and between breadth and depth of domain coverage. These distinctions are elaborated in the context of an overarching contrast between task-driven and construct-driven performance assessment. Rhetoric touting performance assessments because they eschew decomposed skills and decontextualized tasks is viewed as misguided, in that component skills and abstract problems have a legitimate place in pedagogy. Hence, the essence of authentic assessment must be sought elsewhere, that is, in the quest for complete construct representation. With this background, the concepts of “authenticity” and “directness” of performance assessment are treated as tantamount to promissory validity claims that they offset, respectively, the two major threats to construct validity, namely, construct underrepresentation and construct-irrelevant variance. With respect to validation, the salient role of both positive and negative consequences is underscored as well as the need, as in all assessment, for evidence of construct validity.

Overview

Integrity signals

Registry

Crossref · 10.3102/0013189x023002013

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 48 references

Research works printed but not linked: 11

  1. American Psychological Association, American Educational Research Association, & National Council on Measurement in Education, 1985, Standards for educational and psychological testing
  2. 10.1037/0033-2909.93.1.179 · doi:10.1037/0033-2909.93.1.179 · Paper page
  3. Fitzpatrick R, 1971, Educational measurement, 237
  4. 10.3102/0013189X018009027 · doi:10.3102/0013189x018009027 · Paper page
  5. 10.1037/0003-066X.39.3.193 · doi:10.1037/0003-066x.39.3.193 · Paper page
  6. Guilford JP, 1936, Psychometric methods
  7. Kirst MW, 1991, Educational Researcher, 20, 21
  8. 10.3102/0013189X020008015 · doi:10.3102/0013189x020008015 · Paper page
  9. Messick S, 1988, Test validity, 33
  10. 10.3102/00346543062003229 · doi:10.3102/00346543062003229 · Paper page
  11. Wiggins G, 1989, Phi Delta Kappan, 79, 703

Cited by

See all 1,315

Metadata

Authors
Messick, S.
Affiliations
Educational Testing Service (US)
Corresponding author
Messick, Samuel
Venue
Educational Researcher
Published
1994-03
Volume
23
Issue
2
Pages
13-23
ISSN
  • 0013-189X (ISSN-L)
  • 1935-102X
OpenAlex
W2156832302
Cited by
1,315
References
48
Citations by year
2026: 24 · 2025: 26 · 2024: 20 · 2023: 33 · 2022: 37 · 2021: 91 · 2020: 36 · 2019: 63 · 2018: 43 · 2017: 46 · 2016: 72 · 2015: 71 · 2014: 64 · 2013: 71 · 2012: 53
FWCI
171.71
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Educational Researcher (publishedVersion)
Topics
  • Social Sciences › Education › Student Assessment and Feedback
  • Social Sciences › Education › Teacher Education and Assessments
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords
performance evaluation, construct validity, authenticity of assessment, construct underrepresentation, construct-irrelevant variance, validity evidence, competency assessment, response mode, domain coverage

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Interplay of Evidence and Consequences in the Validation of Performance Assessments. https://app.cochat.ai/papers/10.3102/0013189x023002013
The paper
Messick, S. (1994). The Interplay of Evidence and Consequences in the Validation of Performance Assessments. Educational Researcher. https://doi.org/10.3102/0013189x023002013

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.