Quantifying construct validity: Two simple measures.

Drew Westen, Robert Rosenthal·2003·Journal of Personality and Social Psychology

Abstract

Construct validity is one of the most central concepts in psychology. Researchers generally establish the construct validity of a measure by correlating it with a number of other measures and arguing from the pattern of correlations that the measure is associated with these variables in theoretically predictable ways. This article presents 2 simple metrics for quantifying construct validity that provide effect size estimates indicating the extent to which the observed pattem of correlations in a convergent-discriminant validity matrix matches the theoretically predicted pattern of correlations. Both measures, based on contrast analysis, provide simple estimates of validity that can be compared across studies, constructs, and measures meta-analytically, and can be implemented without the use of complex statistical procedures that may limit their accessibility.

Cites (28)

  1. Diagnostic and Statistical Manual of Mental Disorders
    Williams, Janet B. W., First, Michael · 2013 · Encyclopedia of Social Work
  2. Convergent and discriminant validation by the multitrait-multimethod matrix.
    Campbell, Donald T., Fiske, Donald W. · 1959 · Psychological Bulletin
  3. Construct validity in psychological tests.
    Cronbach, Lee J., Meehl, Paul E. · 1955 · Psychological Bulletin
  4. Implicit social cognition: Attitudes, self-esteem, and stereotypes
    Greenwald, Anthony G., Banaji, Mahzarin R. · 1995 · Psychological Review
  5. Validation of the five-factor model of personality across instruments and observers.
    McCrae, Robert R., Costa, Paul T. · 1987 · Journal of Personality and Social Psychology
  6. Meta-Analytic Procedures for Social Research
    Rosenthal, Robert · 1991
  7. Tests for comparing elements of a correlation matrix
    Steiger, James H. · 1980 · Psychological Bulletin
  8. Meta-Analytic Procedures for Social Research.
    Metcalfe, Andrew, Rosenthal, R. · 1994 · The Statistician
  9. Statistical methods in psychology journals: Guidelines and explanations.
    Wilkinson, Leland, Task Force on Statistical Inference · 1999 · American Psychologist
  10. Comparing correlated correlation coefficients
    Meng, Xiao-li, Rosenthal, Robert, Rubin, Donald B. · 1992 · Psychological Bulletin

Show all 28 references

Cited by (27)

  1. The Posttraumatic Stress Disorder Checklist for DSM‐5 (PCL‐5): Development and Initial Psychometric Evaluation
    Blevins, Christy A., Weathers, Frank W., Davis, Margaret T., Witte, Tracy K., Domino, Jessica L. · 2015 · Journal of Traumatic Stress
  2. A meta-analysis of the five-factor model of personality and academic performance.
    Poropat, Arthur E. · 2009 · Psychological Bulletin
  3. The Concept of Validity.
    Borsboom, Denny, Mellenbergh, Gideon J., van Heerden, Jaap · 2004 · Psychological Review
  4. The validity of the multi-informant approach to assessing child and adolescent mental health.
    De Los Reyes, Andres, Augenstein, Tara M., Wang, Mo, Thomas, Sarah A., Drabick, Deborah A. G., Burgers, Darcy E., Rabinowitz, Jill · 2015 · Psychological Bulletin
  5. Psychometric analysis of the PTSD Checklist-5 (PCL-5) among treatment-seeking military service members.
    Wortmann, Jennifer H., Jordan, Alexander H., Weathers, Frank W., Resick, Patricia A., Dondanville, Katherine A., Hall-Clark, Brittany, Foa, Edna B., Young-McCaughan, Stacey, Yarvis, Jeffrey S., Hembree, Elizabeth A. et al. · 2016 · Psychological Assessment

See all 542

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Quantifying construct validity: Two simple measures. https://app.cochat.ai/papers/10.1037//0022-3514.84.3.608
The paper
Westen, D., & Rosenthal, R. (2003). Quantifying construct validity: Two simple measures. Journal of Personality and Social Psychology. https://doi.org/10.1037//0022-3514.84.3.608

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.