The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning.
Abstract
The traditional conception of validity divides it into three separate and substitutable types—namely, content, criterion, and construct validities. This view is fragmented and incomplete, especially because it fails to take into account both evidence of the value implications of score meaning as a basis for action and the social consequences of score use. The new unified concept of validity interrelates these issues as fundamental aspects of a more comprehensive theory of construct validity that addresses both score meaning and social values in test interpretation and test use. That is, unified validity integrates considerations of content, criteria, and consequences into a construct framework for the empirical testing of rational hypotheses about score meaning and theoretically relevant relationships, including those of an applied and a scientific nature. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of validity as a unified concept. These are content, substantive, structural, generalizability, external, and consequential aspects of construct validity. In effect, these six aspects function as general validity criteria or standards for all educational and psychological measurement, including performance assessments, which are discussed in some detail because of their increasing emphasis in educational and employment settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is fundamentally a construct-validity problem: neighboring measures should support distinct interpretations within a nomological network rather than be treated as interchangeable indicators (Cronbach and Meehl, 1955; Messick, 1995).”
From Beyond checking: verification quality, reliance calibration, and learning in generative AI-assisted higher education (2026) · cites this paper as Messick, 1995
In the citing paper
“Contemporary validity theory positions assessment consequences as integral to assessment quality rather than external to it (Hubley and Zumbo, 2011; Messick, 1995).”
From Reducing classification risk in developmental performance assessment using fuzzy logic: evidence from preservice mathematics teacher education (2026) · cites this paper as Messick, 1995
In the citing paper
“This was explicitly argued by Messick (1995), as he emphasized a unified concept of construct validity that integrates the traditional single conceptions, namely content, criterion, and construct validities.”
From Taking a future perspective by learning from the past – A systematic review of assessment instruments that aim to measure primary and secondary school students' ICT literacy (2016) · cites this paper as Messick, 1995
In the citing paper
“This definition indicates that all phases of the assessment development framework, for instance, are important for establishing an argument for how well the measures derived from an assessment reflect the construct of interest.”
From Taking a future perspective by learning from the past – A systematic review of assessment instruments that aim to measure primary and secondary school students' ICT literacy (2016) · cites this paper as Messick, 1995
In the citing paper
“computer-based assessments have the potential to provide better evidence for construct validity, by collecting data describing how students approach tasks when they are involved in solving real-world problems”
From Taking a future perspective by learning from the past – A systematic review of assessment instruments that aim to measure primary and secondary school students' ICT literacy (2016) · cites this paper as Messick, 1995
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Handbook of Industrial and Organizational Psychology.
Hammer, T. H., Anderson, J. F., Gurdon, M. A., Jick, T. D., Petit, A., Stern, R. N., Schwartz, H., Vardi, Y., & Dunnette, M. D. (1977) · Administrative Science Quarterly · doi:10.2307/2391755 · Cited by 11,947
(1979) · Medical Entomology and Zoology · Cited by 11,252
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Perception and the Representative Design of Psychological Experiments
Brunswik, E. (1956) · doi:10.1525/9780520350519 · Cited by 2,974
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,858
Differential Item Functioning.
Gudgeon, A. C., Holland, P. W., & Wainer, H. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348590 · Cited by 2,088
Objective Tests as Instruments of Psychological Theory
Loevinger, J. (1957) · Psychological Reports · doi:10.2466/pr0.1957.3.3.635 · Cited by 1,476
The interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315
Self-citationMeaning and Values in Test Validation: The Science and Ethics of Assessment
Messick, S. (1989) · Educational Researcher · doi:10.3102/0013189x018002005 · Cited by 948
Self-citation
Cited by
Sorted by citations
Toward a definition of mixed methods research
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689806298224 · Cited by 6,464
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00149 · Cited by 5,925
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.006 · Cited by 4,465
Psychometric assessment of three newly developed implementation outcome measures
Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0635-3 · Cited by 2,819
Introducing the Short Dark Triad (SD3): A Brief Measure of Dark Personality Traits
Jones, D. N., & Paulhus, D. L. (2014) · Assessment · doi:10.1177/1073191113514105 · Cited by 2,162
Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application
Cook, D. A., & Beckman, T. J. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.10.036 · Cited by 1,745
Validity: on the meaningful interpretation of assessment data
Downing, S. M. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01594.x · Cited by 1,434
Development of the Gender Minority Stress and Resilience Measure.
Testa, R. J., Habarth, J., Peta, J., Balsam, K., & Bockting, W. (2015) · Psychology of Sexual Orientation and Gender Diversity · doi:10.1037/sgd0000081 · Cited by 1,406
Beyond Dichotomies: Competence Viewed as a Continuum
Blömeke, S., Gustafsson, J.-E., & Shavelson, R. J. (2015) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000194 · Cited by 1,205
Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Martinez, J. L., & Richard, C. A. (2008) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.2.2.68 · Cited by 912
Kalshoven, K., Den Hartog, D. N., & De Hoogh, A. H. B. (2011) · The Leadership Quarterly · doi:10.1016/j.leaqua.2010.12.007 · Cited by 824
Standards of validity and the validity of standards in performance asessment
Messick, S. (1995) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1995.tb00881.x · Cited by 697
Self-citationVlachopoulos, S. P., & Michailidou, S. (2006) · Measurement in Physical Education and Exercise Science · doi:10.1207/s15327841mpee1003_4 · Cited by 661
A meta-analytic review of authentic and transformational leadership: A test for redundancy
Banks, G. C., McCauley, K. D., Gardner, W. L., & Guler, C. E. (2016) · The Leadership Quarterly · doi:10.1016/j.leaqua.2016.02.006 · Cited by 681
Collins, K. M. T., Onwuegbuzie, A. J., & Jiao, Q. G. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689807299526 · Cited by 552
The Fallacy of Formative Measurement
Edwards, J. R. (2011) · Organizational Research Methods · doi:10.1177/1094428110378369 · Cited by 495
“It's Who I Am … Really!’ The Importance of Integrated Regulation in Exercise Contexts1
Wilson, P. M., Rodgers, W. M., Loitz, C. C., & Scime, G. (2006) · Journal of Applied Biobehavioral Research · doi:10.1111/j.1751-9861.2006.tb00021.x · Cited by 457
Measuring Well-Being: A Review of Instruments
Cooke, P. J., Melchert, T. P., & Connor, K. (2016) · The Counseling Psychologist · doi:10.1177/0011000016633507 · Cited by 468
The Addiction Severity Index at 25: Origins, contributions, and transitions
McLellan, A. T., Cacciola, J. C., Alterman, A. I., Rikoon, S. H., & Carise, C. (2006) · The American Journal on Addictions · doi:10.1080/10550490500528316 · Cited by 450
A New Psychosocial Screening Instrument for Use With Cancer Patients
Zabora, J., Brintzenhofeszoc, K., Jacobsen, P., Curbow, B., Piantadosi, S., Hooker, C., Owens, A., & Derogatis, L. (2001) · Psychosomatics · doi:10.1176/appi.psy.42.3.241 · Cited by 440
Using large language models in psychology
Demszky, D., Yang, D., Yeager, D. S., Bryan, C. J., Clapper, M., Chandhok, S., Eichstaedt, J. C., Hecht, C., Jamieson, J., Johnson, M., et al. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00241-5 · Cited by 369
Measuring Learning Outcomes in Higher Education: Motivation Matters
Liu, O. L., Bridgeman, B., & Adler, R. M. (2012) · Educational Researcher · doi:10.3102/0013189x12459679 · Cited by 285
Siddiq, F., Hatlevik, O. E., Olsen, R. V., Throndsen, I., & Scherer, R. (2016) · Educational Research Review · doi:10.1016/j.edurev.2016.05.002 · Cited by 269
Investigating Validity Evidence of the Satisfaction with Life Scale Adapted for Children
Gadermann, A. M., Schonert-Reichl, K. A., & Zumbo, B. D. (2010) · Social Indicators Research · doi:10.1007/s11205-009-9474-1 · Cited by 258
Wilson, P. M., Rodgers, W. M., Blanchard, C. M., & Gessell, J. (2003) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2003.tb01890.x · Cited by 249
Experiential Avoidance: An Examination of the Construct Validity of the AAQ-II and MEAQ
Rochefort, C., Baldwin, A. S., & Chmielewski, M. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.08.008 · Cited by 247
Instrumentation issues in implementation science
Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014) · Implementation Science · doi:10.1186/s13012-014-0118-8 · Cited by 243
Technical Features of Curriculum-Based Measurement in Writing: A Literature Review
McMaster, K., & Espin, C. (2007) · The Journal of Special Education · doi:10.1177/00224669070410020301 · Cited by 231
Assessing Intercultural Competence in Higher Education: Existing Research and Future Directions
Griffith, R. L., Wolfeld, L., Armon, B. K., Rios, J., & Liu, O. L. (2016) · ETS Research Report Series · doi:10.1002/ets2.12112 · Cited by 211
Dinsmore, D. L., & Alexander, P. A. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9198-7 · Cited by 205
Panadero, E., Romero, M., & Strijbos, J.-W. (2013) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.10.005 · Cited by 195
Emotional Appetite Questionnaire. Construct validity and relationship with BMI
Nolan, L. J., Halperin, L. B., & Geliebter, A. (2010) · Appetite · doi:10.1016/j.appet.2009.12.004 · Cited by 170
Development and preliminary validation of the mindfulness inventory for sport.
Thienot, E., Jackson, B., Dimmock, J., Grove, J. R., Bernier, M., & Fournier, J. F. (2014) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2013.10.003 · Cited by 165
Assessing vocabulary size through multiple-choice formats: Issues with guessing and sampling rates
Gyllstad, H., Vilkaitė, L., & Schmitt, N. (2015) · ITL - International Journal of Applied Linguistics · doi:10.1075/itl.166.2.04gyl · Cited by 164
Psychological measurement and the replication crisis: Four sacred cows
Lilienfeld, S. O., & Strother, A. N. (2020) · Canadian Psychology / Psychologie canadienne · doi:10.1037/cap0000236 · Cited by 144
Rees, E. L., Hawarden, A. W., Dent, G., Hays, R., Bates, J., & Hassell, A. B. (2016) · Medical Teacher · doi:10.3109/0142159x.2016.1158799 · Cited by 139
Meyer, R. E., Salzman, C., Youngstrom, E. A., Clayton, P. J., Goodwin, F. K., Mann, J. J., Alphs, L. D., Broich, K., Goodman, W. K., Greden, J. F., et al. (2010) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.10cs06070blu · Cited by 129
Analytics of time management strategies in a flipped classroom
Ahmad Uzir, N., Gašević, D., Matcha, W., Jovanović, J., & Pardo, A. (2020) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12392 · Cited by 129
Informal workplace learning: development and validation of a measure
Decius, J., Schaper, N., & Seifert, A. (2019) · Human Resource Development Quarterly · doi:10.1002/hrdq.21368 · Cited by 127
Advancing implementation science through measure development and evaluation: a study protocol
Lewis, C. C., Weiner, B. J., Stanick, C., & Fischer, S. M. (2015) · Implementation Science · doi:10.1186/s13012-015-0287-0 · Cited by 115
Gresham, F. M., & Witt, J. C. (1997) · School Psychology Quarterly · doi:10.1037/h0088961 · Cited by 113
Watkins, M. W. (2010) · Psychological Assessment · doi:10.1037/a0020043 · Cited by 99
Lost in Translation: The Construct Representation of Character Virtues
Ng, V., & Tay, L. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691619886014 · Cited by 99
School-Based Evidence for the Validity of Curriculum-Based Measurement of Reading and Writing
Fewster, S., & Macmillan, P. D. (2002) · Remedial and Special Education · doi:10.1177/07419325020230030301 · Cited by 97
Assessing the Instructional Level for Mathematics: A Comparison of Methods
Burns, M. K., VanDerHeyden, A. M., & Jiban, C. L. (2006) · School Psychology Review · doi:10.1080/02796015.2006.12087975 · Cited by 96
Fiedeldey-Van Dijk, C., Rowan, M., Dell, C., Mushquash, C., Hopkins, C., Fornssler, B., Hall, L., Mykota, D., Farag, M., & Shea, B. (2017) · Journal of Ethnicity in Substance Abuse · doi:10.1080/15332640.2015.1119774 · Cited by 88
The Emergence and Possible Futures of Response To Intervention
VanDerHeyden, A. M., Witt, J. C., & Barnett, D. W. (2005) · Journal of Psychoeducational Assessment · doi:10.1177/073428290502300404 · Cited by 86
Duncan, M. J., Wunderlich, K., Zhao, Y., & Faulkner, G. (2018) · Journal of Sports Sciences · doi:10.1080/02640414.2017.1409855 · Cited by 76
Reliability of Decision-Making Frameworks for Response to Intervention for Reading
Burns, M. K., Scholin, S. E., Kosciolek, S., & Livingston, J. (2010) · Journal of Psychoeducational Assessment · doi:10.1177/0734282909342374 · Cited by 76
Schwarz (1999) · doi:10.1097/acm.0000000000002002 · Cited by 67
Zhang, H., Perry, A., & Lee, I. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00398-x · Cited by 75
Physical activity and negative affective reactivity in daily life
Puterman, E., Weiss, J., Beauchamp, M. R., Mogle, J., & Almeida, D. M. (2017) · Health Psychology · doi:10.1037/hea0000532 · Cited by 65
A review of instruments assessing participation in persons with spinal cord injury
the SCIRE Research Team, Noonan, V. K., Miller, W. C., & Noreau, L. (2009) · Spinal Cord · doi:10.1038/sc.2008.171 · Cited by 65
Flanagan, D. P. (2000) · School Psychology Quarterly · doi:10.1037/h0088789 · Cited by 61
Flake, J. K. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1898962 · Cited by 58
Brunet, J., Gunnell, K. E., Teixeira, P., Sabiston, C. M., & Bélanger, M. (2016) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.2016-0256 · Cited by 50
Construct Mixology: Forming New Management Constructs by Combining Old Ones
Newman, D. A., Harrison, D. A., Carpenter, N. C., & Rariden, S. M. (2016) · Academy of Management Annals · doi:10.5465/19416520.2016.1161965 · Cited by 60
Structural Validity of the WISC-IV for Students With Learning Disabilities
Styck, K. M., & Watkins, M. W. (2016) · Journal of Learning Disabilities · doi:10.1177/0022219414539565 · Cited by 40
Kleemola, K., Hyytinen, H., & Toom, A. (2022) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.1946482 · Cited by 38
Kranzler, J. H., Benson, N., & Floyd, R. G. (2015) · Psychological Assessment · doi:10.1037/pas0000119 · Cited by 39
Examination of the Underlying Structure of the NEPSY: A Developmental Neuropsychological Assessment
Stinnett, T. A., Oehler-Stinnett, J., Fuqua, D. R., & Palmer, L. S. (2002) · Journal of Psychoeducational Assessment · doi:10.1177/073428290202000105 · Cited by 39
Gehlbach, H., Robinson, C. D., Finefter-Rosenbluh, I., Benshoof, C., & Schneider, J. (2018) · Educational Psychology · doi:10.1080/01443410.2017.1349876 · Cited by 33
Learmonth, Y. C., Hubbard, E. A., McAuley, E., & Motl, R. W. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0639-2 · Cited by 28
Structural Validity of the WISC-IV for Students With ADHD
Styck, K. M., & Watkins, M. W. (2017) · Journal of Attention Disorders · doi:10.1177/1087054714553052 · Cited by 28
Nakano, S., & Watkins, M. W. (2013) · Psychology in the Schools · doi:10.1002/pits.21724 · Cited by 27
Tractenberg, R. E., Lindvall, J. M., Attwood, T. K., & Via, A. (2019) · PLOS ONE · doi:10.1371/journal.pone.0225256 · Cited by 27
Confirmatory factor analysis of the WISC-IV in a hospital referral sample.
Devena, S. E., Gay, C. E., & Watkins, M. W. (2013) · Journal of Psychoeducational Assessment · doi:10.1177/0734282913483981 · Cited by 22
Anvari, F., Richards, D., Hitchens, M., & Tran, H. M. T. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) · doi:10.1109/icse-seet.2019.00015 · Cited by 23
Reading Paper – Reading Screen - A Comparison of Reading Literacy in Two Different Modes
Rasmusson, M. (2015) · Nordic Studies in Education · doi:10.18261/issn1891-5949-2015-01-02 · Cited by 16
Military enlistment selection and classification: Moving forward
Rumsey, M. G., & Arabian, J. M. (2014) · Military Psychology · doi:10.1037/mil0000040 · Cited by 7
Computing Education Research Today
Fincher, S. A., Tenenberg, J., Dorn, B., Hundhausen, C., McCartney, R., & Murphy, L. (2019) · The Cambridge Handbook of Computing Education Research · doi:10.1017/9781108654555.003 · Cited by 7
Tyner, C. E., Kisala, P. A., Heinemann, A. W., Fyffe, D., Tate, D. G., Slavin, M. D., Jette, A. M., & Tulsky, D. S. (2022) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2020.12.009 · Cited by 5
When Can AI Models Explain Learning? Validity Criteria for AI as Cognitive Models in Education
Wang, P., Viberg, O., Law, E. L.-C., & Greiff, S. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10202-y · Cited by 3
Naccache, H., & Hleiss, R. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1840093
Wei, J., & Shang, Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1965371 · Cited by 1
Metadata
- Authors
- Messick, S.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Messick, Samuel
- Venue
- American Psychologist
- Published
- 1995-09
- Volume
- 50
- Issue
- 9
- Pages
- 741-749
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2028829385
- Cited by
- 4,198
- References
- 33
- Citations by year
- 2026: 411 · 2025: 181 · 2024: 163 · 2023: 164 · 2022: 168 · 2021: 183 · 2020: 190 · 2019: 228 · 2018: 219 · 2017: 218 · 2016: 202 · 2015: 198 · 2014: 192 · 2013: 158 · 2012: 165
- FWCI
- 45.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- construct validity, content validity, criterion validity, consequential validity, performance evaluation (human resources), test interpretation, validity criteria
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review