The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Shifting Conceptions of Validity in Educational Measurement: Implications for Performance Assessment
Abstract
Recent developments in the philosophy of validity, highlighting the importance of investigating the consequences of assessment use, provide theoretical support for the move toward performance assessment. The problem for validity researchers is finding the appropriate set of criteria and standards to simultaneously support the validity of an assessment-based interpretation and the validity of its impact on the educational system. My intent is to provide an integrative and critical review of the guidance available for conducting validity inquiry in the context of performance assessment. In the first section is a summary of the emerging consensus among measurement scholars—not reflected in the 1985 Standards for Educational and Psychological Testing (American Educational Research Association [AERA], American Psychological Association [APA], & National Council on Measurement in Education [NCME])—about the centrality of construct validity to the evaluation of any assessment-based interpretation and about the importance of expanding the concept of validity to include explicit consideration of the consequences of assessment use. The description of this emerging consensus suggests general epistemological principles for validity inquiry. In the second section is a description and synthesis of various categories of questions, evidence, or criteria that have been used to describe or guide validity inquiry, either for assessment in general or for performance assessment in particular. These analytic schemes, like the traditional construct-content-criterion categories, highlight specific issues that their authors consider important for validity researchers to address. Each balances technical concerns about such issues as reliability, generalizability, and comparability with concerns about the consequences of assessment. In the final section is an overview of concerns, expressed largely by interpretive researchers, about validity criteria that privilege standardized forms of assessment, whether performance-based or multiple-choice. These arguments suggest the importance of further expanding the conception of validity inquiry to treat as problematic the epistemological principles used to warrant validity conclusions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(85)90062-8 · Cited by 45,787
Basics of Qualitative Research
Ozanne, J. L., Strauss, A., & Corbin, J. (1992) · Journal of Marketing Research · doi:10.2307/3172751 · Cited by 17,850
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Qualitative Research for Education: An Introduction to Theory and Methods
Bogdan, R., & Biklen, S. K. (1997) · Medical Entomology and Zoology · Cited by 15,148
(1963) · Medical Entomology and Zoology · Cited by 15,085
(1979) · Medical Entomology and Zoology · Cited by 11,252
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
(1990) · Cited by 11,110
Handbook of research on teaching
Wittrock, M. C. (1986) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 10,623
(2014) · The SAGE Encyclopedia of Action Research · doi:10.4135/9781446294406.n148 · Cited by 7,250
Cited by
Enhancing teaching through constructive alignment
Biggs, J. (1996) · Higher Education · doi:10.1007/bf00138871 · Cited by 4,084
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,674
The interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315
Thompson, B., & Daniel, L. G. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056002001 · Cited by 918
Current Concerns in Validity Theory
Kane, M. T. (2001) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2001.tb01130.x · Cited by 748
Can There Be Validity without Reliability?
Moss, P. A. (1994) · Educational Researcher · doi:10.2307/1176218 · Cited by 556
Self-citationShepard, L. A. (1993) · Review of Research in Education · doi:10.2307/1167347 · Cited by 466
Chapter 10: Socio-Cultural Aspects of Assessment
GIPPS, C. (1999) · Review of Research in Education · doi:10.3102/0091732x024001355 · Cited by 208
Sambell, K., McDowell, L., & Brown, S. (1997) · Studies in Educational Evaluation · doi:10.1016/s0191-491x(97)86215-3 · Cited by 320
Modern language testing at the turn of the century: assuring that what we count counts
Bachman, L. F. (2000) · Language Testing · doi:10.1177/026553220001700101 · Cited by 309
Examining Rater Errors in the Assessment of Written Composition With a Many‐Faceted Rasch Model
Engelhard, G. (1994) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1994.tb00436.x · Cited by 288
Rapanta, C., Garcia-Mila, M., & Gilabert, S. (2013) · Review of Educational Research · doi:10.3102/0034654313487606 · Cited by 228
Nuthall, G., & Alton-Lee, A. (1995) · American Educational Research Journal · doi:10.3102/00028312032001185 · Cited by 94
The organizational climate of middle schools: The development and test of the OCDQ‐RM
Hoy, W. K., Hoffman, J., Sabo, D., & Bliss, J. (1996) · Journal of Educational Administration · doi:10.1108/09578239610107156 · Cited by 64
An online testing design choice typology towards cheating threat minimisation
Munoz, A., & Mackay, J. (2019) · Journal of University Teaching and Learning Practice · doi:10.53761/1.16.3.5 · Cited by 51
Metadata
- Authors
- Moss, P. A.
- Venue
- Review of Educational Research
- Publisher
- SAGE Publications
- Published
- 1992
- Volume
- 62
- Issue
- 3
- Pages
- 229
- ISSN
- 0034-6543 (ISSN-L)
- OpenAlex
- W2157540565
- Cited by
- 434
- References
- 79
- FWCI
- 34.77
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.