Standards of validity and the validity of standards in performance asessment
Abstract
What are six distinct aspects of construct validation? How do these aspects apply to performance assessment? Are the consequences of performance assessment on teaching and learning relevant to construct validation?
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The authors avoided construct irrelevance or construct under-representation as described by Messick [30] and applied to literature studies by Dellinger [4] via six countermeasures.
“In addition, we avoided construct irrelevance or construct under-representation as described by Messick [30] and applied to literature studies by Dellinger [4] via six countermeasures.”
From The pipeline for the continuous development of artificial intelligence models—Current state of research and practice (2023) · cites this paper as [30]
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · see citing works
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,091 · see citing works
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198 · see citing works
Self-citationDouglas, O. B., & Holland, B. F. (2015) · MacMillan Co eBooks · doi:10.1037/14910-020 · Cited by 2,283 · see citing works
Standards for educational and psychological testing
(1985) · PsycEXTRA Dataset · doi:10.1037/e500832009-001 · Cited by 1,493 · see citing works
Objective Tests as Instruments of Psychological Theory
Loevinger, J. (1957) · Psychological Reports · doi:10.2466/pr0.1957.3.3.635 · Cited by 1,476 · see citing works
The interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315 · see citing works
Self-citationAn argument-based approach to validity.
Kane, M. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.3.527 · Cited by 995 · see citing works
Test validity and the ethics of assessment.
Messick, S. (1980) · American Psychologist · doi:10.1037/0003-066x.35.11.1012 · Cited by 922 · see citing works
Self-citationConstruct validity: Construct representation versus nomothetic span.
Whitely, S. E. (1983) · Psychological Bulletin · doi:10.1037/0033-2909.93.1.179 · Cited by 605 · see citing works
Argument-Based Approach to Validity
Kane, M. T. (2022) · The SAGE Encyclopedia of Research Design · doi:10.4135/9781071812082.n28 · Cited by 557 · see citing works
Psychological Tests and Personnel Decisions.
Laming, D., Cronbach, L. J., & Gleser, G. C. (1966) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2343921 · Cited by 397 · see citing works
Research Methods in the Behavioral Sciences
Furfey, P. H., Festinger, L., & Katz, D. M. (1954) · The American Catholic Sociological Review · doi:10.2307/3708336 · Cited by 294 · see citing works
Messick, S. (1994) · ETS Research Report Series · doi:10.1002/j.2333-8504.1994.tb01618.x · Cited by 287 · see citing works
Self-citationAssessment: Authenticity, Context, and Validity.
Wiggins, G. (1993) · Phi Delta Kappan · Cited by 255 · see citing works
Linking Educational Assessments: Concepts, Issues, Methods, and Prospects.
Mislevy, R. J. (1992) · Cited by 189 · see citing works
Reconstruction of Educational Research
Shulman, L. S. (1970) · Review of Educational Research · doi:10.3102/00346543040003371 · Cited by 137 · see citing works
Assumptions Underlying the Use of Content Validity
Lennon, R. T. (1956) · Educational and Psychological Measurement · doi:10.1177/001316445601600303 · Cited by 110 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Constructing validity: New developments in creating objective measuring instruments.
Clark, L. A., & Watson, D. (2019) · Psychological Assessment · doi:10.1037/pas0000626 · Cited by 1,470 · see citing works
Validity: on the meaningful interpretation of assessment data
Downing, S. M. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01594.x · Cited by 1,434 · see citing works
Swami, V., & Barron, D. (2019) · Body Image · doi:10.1016/j.bodyim.2018.08.014 · Cited by 454 · see citing works
Some reflections on task-based language performance assessment
Bachman, L. F. (2002) · Language Testing · doi:10.1191/0265532202lt240oa · Cited by 318 · see citing works
Identifying Entrustable Professional Activities in Internal Medicine Training
Hauer, K. E., Kohlwes, J., Cornett, P., Hollander, H., ten Cate, O., Ranji, S. R., Soni, K., Iobst, W., & O'Sullivan, P. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-12-00060.1 · Cited by 147 · see citing works
Steidl, M., Felderer, M., & Ramler, R. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111615 · Cited by 126 · see citing works
Hauer, K. E., Holmboe, E. S., & Kogan, J. R. (2011) · Medical Teacher · doi:10.3109/0142159x.2010.507710 · Cited by 118 · see citing works
Curriculum-Based Measurement: A Brief History of Nearly Everything from the 1970s to the Present
Tindal, G. (2013) · ISRN Education · doi:10.1155/2013/958530 · Cited by 59 · see citing works
“Christ et al. [140] review computation CBMs and use Messick’s validity framework [1] relating content and criterion-related evidence while also noting the lack of research addressing consequential validity.”
MethodInfluentialAn online testing design choice typology towards cheating threat minimisation
Munoz, A., & Mackay, J. (2019) · Journal of University Teaching and Learning Practice · doi:10.53761/1.16.3.5 · Cited by 51 · see citing works
The Effect of Baseline Patient and Caregiver Mindfulness on Dementia Outcomes
Innis, A. D., Tolea, M. I., & Galvin, J. E. (2021) · Journal of Alzheimer’s Disease · doi:10.3233/jad-201292 · Cited by 18 · see citing works
- Authors
- Messick, S.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Messick, Samuel
- Venue
- Educational Measurement Issues and Practice
- Publisher
- Wiley
- Published
- 1995-12
- Volume
- 14
- Issue
- 4
- Pages
- 5-8
- ISSN
- 0731-1745 (ISSN-L)
- 1745-3992
- OpenAlex
- W2014174447
- Cited by
- 697
- References
- 18
- Citations by year
- 2026: 34 · 2025: 29 · 2024: 36 · 2023: 41 · 2022: 43 · 2021: 58 · 2020: 39 · 2019: 35 · 2018: 32 · 2017: 46 · 2016: 39 · 2015: 31 · 2014: 37 · 2013: 16 · 2012: 14
- FWCI
- 6.91
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Measurement Issues and Practice (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Teacher Education and Assessments
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- construct validity, performance evaluation, construct validation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
