The Comparative Validity of 11 Modern Personality Inventories: Predictions of Behavioral Acts, Informant Reports, and Clinical Indicators
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
In science, multiple measures of the same constructs can be useful, but they are unlikely to all be equally valid indicators. In psychological assessment, the many popular personality inventories available in the marketplace also may be useful, but their comparative validity has long remained unassessed. This is the first comprehensive comparison of 11 such multiscale instruments against each of three types of criteria: clusters of behavioral acts, descriptions by knowledgeable informants, and clinical indicators potentially associated with various types of psychopathology. Using 1,000 bootstrap resampling analyses from a sample of roughly 700 adult research participants, we assess the relative predictability of each criterion and the comparative validity of each inventory. Although there was a wide range of criterion predictability, most inventories exhibited quite similar cross-validities when averaged across all three types of criteria. On the other hand, there were important differences between inventories in their predictive capabilities for particular criteria. We discuss the factors that lead to differential validity across predictors and criteria.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Efron, B., & Tibshirani, R. (1986) · Statistical Science · doi:10.1214/ss/1177013815 · Cited by 6,033
The development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
A psychobiological model of temperament and character
Cloninger, C. R. (1993) · Archives of General Psychiatry · doi:10.1001/archpsyc.1993.01820240059008 · Cited by 5,458
Development, reliability, and validity of a dissociation scale
BERNSTEIN, E. M., & PUTNAM, F. W. (1986) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198612000-00004 · Cited by 3,793 · cited 2×
“…of as a well-characterized measure of subjective dysphoria and psychological distress, as well as a fallible indicator of more serious clinical depression. e. Goldberg’s (1999b) Curious Experiences Survey, a revised version of the Dissociative Experiences Scale (DES: Bernstein & Putnam, 1986).”
BackgroundMethodEstimating the error rate of a prediction rule: improvement on cross-validation
Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300 · cited 1×
“To accomplish these two aims, we employed a method that combines bootstrap resampling procedures with split-sample crossvalidation (Browne & Cudeck, 1989; Efron, 1983; Efron & Tibshirani, 1986).”
MethodBenet-Martínez, V., & John, O. P. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.75.3.729 · Cited by 1,996
Psychometric Properties of the HEXACO Personality Inventory
Lee, K., & Ashton, M. C. (2004) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3902_8 · Cited by 1,961 · cited 2×
“The HEXACO Personality Inventory (HEXACO-PI: Lee & Ashton, 2004) included 192 items with five-step response options, and contained 24 lower-level “facet” scales, four subsumed within each of its six higher-level “domains,” labeled Honesty–Humility (H), Emotionality (E), eXtraversion (X),…”
MethodKrueger, R. F., Hicks, B. M., Patrick, C. J., Carlson, S. R., Iacono, W. G., & McGue, M. (2002) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.111.3.411 · Cited by 1,378 · cited 1×
“Twin and family studies have suggested that common genetic factors may influence both personality measurements and psychiatric outcomes, bolstering the argument that measures of normal personality are of clinical interest (eg, Fanous, Gardner, Prescott, Cancro, & Kendler, 2002 ; Farmer, Mahmood, Redman, Harris, Sadler…”
BackgroundBig Five factors and facets and the prediction of behavior.
Paunonen, S. V., & Ashton, M. C. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.3.524 · Cited by 1,097
Tellegen, A., & Waller, N. G. (2008) · The SAGE Handbook of Personality Theory and Assessment: Volume 2 — Personality Measurement and Testing · doi:10.4135/9781849200479.n13 · Cited by 905
Integration of the Big Five and circumplex approaches to trait structure
Hofstee, W. K., de Raad, B., & Goldberg, L. R. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.63.1.146 · Cited by 891
Self-citationThe validation of a new obsessive–compulsive disorder scale: The Obsessive–Compulsive Inventory
Foa, E. B., Kozak, M. J., Salkovskis, P. M., Coles, M. E., & Amir, N. (1998) · Psychological Assessment · doi:10.1037/1040-3590.10.3.206 · Cited by 719 · cited 1×
“Obsessive-Compulsive Inventory (OCI: Foa, Kozak, Salkovskis, Coles, & Amir, 1998 ).”
Psychometric properties of the OCI-R in a college sample
Hajcak, G., Huppert, J. D., Simons, R. F., & Foa, E. B. (2004) · Behaviour Research and Therapy · doi:10.1016/j.brat.2003.08.002 · Cited by 392 · cited 1×
“The measure exhibited strong convergent validity with other such instruments, both in an initial validity study and in non-clinical samples ( Hajcak, Huppert, Simons, & Foa, 2004 ).”
BackgroundDissociation and posttraumatic stress disorder in Vietnam combat veterans
(1992) · American Journal of Psychiatry · doi:10.1176/ajp.149.3.328 · Cited by 381 · cited 4×
“Widely used as a screen or a proxy for major depressive disorder, CES-D scores are also correlated with generalized anxiety disorder, depressive personality disorder, and other depressionrelated psychiatric conditions (Breslau, 1985; Myers & Weissman, 1980; Roberts & Vernon, 1983). Hence, the CES-D is best thought of…”
BackgroundInfluentialPatterns of dissociation in clinical and nonclinical samples
PUTNAM, F. W., CARLSON, E. B., ROSS, C. A., ANDERSON, G., CLARK, P., TOREM, M., BOWMAN, E. S., COONS, P., CHU, J. A., DILL, D. L., et al. (1996) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199611000-00004 · Cited by 292 · cited 2×
“Although a few dissociative experiences are relatively common in normal populations, most of them are prominent features of dissociative disorders, as well as post-traumatic stress disorders, and they are correlated with other psychotic-like symptoms (Bremner et al., 1992; Moskowitz, Barker-Collo, & Ellson, 2005; Putn…”
BackgroundMershon, B., & Gorsuch, R. L. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.55.4.675 · Cited by 257
The Criterion Validity of Broad Factor Scales versus Specific Facet Scales
Ashton, M. C., Jackson, D. N., Paunonen, S. V., Helmes, E., & Rothstein, M. G. (1995) · Journal of Research in Personality · doi:10.1006/jrpe.1995.1025 · Cited by 116
Cited by
Internal consistency, retest reliability, and their implications for personality scale validity
McCrae, R. R., Kurtz, J. E., Yamagata, S., & Terracciano, A. (2011) · Personality and Social Psychology Review · doi:10.1177/1088868310366253 · Cited by 874
“In these respects, they resemble most published personality scales (Grucza & Goldberg, 2007).”
BackgroundHow Should the Internal Structure of Personality Inventories Be Evaluated?
Hopwood, C. J., & Donnellan, M. B. (2010) · Personality and Social Psychology Review · doi:10.1177/1088868310361240 · Cited by 659
Statistically controlling for confounding constructs is harder than you think
Westfall, J., & Yarkoni, T. (2016) · PLOS ONE · doi:10.1371/journal.pone.0152719 · Cited by 547
“chewing gum, playing chess, or yelling at a stranger (for details, see [49]).”
BackgroundPersonality and the perception of health and happiness
Cloninger, C. R., & Zohar, A. H. (2011) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.06.012 · Cited by 446
Predicting actual behavior from the explicit and implicit self-concept of personality.
Back, M. D., Schmukle, S. C., & Egloff, B. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0016229 · Cited by 394
Metadata
- Authors
- Grucza, R. A., & Goldberg, L. R.
- Venue
- Journal of Personality Assessment
- Publisher
- Informa UK Limited
- Published
- 2007-11
- Volume
- 89
- Issue
- 2
- Pages
- 167-187
- ISSN
- 0022-3891 (ISSN-L)
- 1532-7752
- OpenAlex
- W2039303205
- Cited by
- 228
- References
- 17
- FWCI
- 15.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.