On the invalidity of validity scales: Evidence from self-reports and observer ratings in volunteer samples.
Abstract
Because of the potential for bias and error in questionnaire responding, many personality inventories include validity scales intended to correct biased scores or identify invalid protocols. The authors evaluated the utility of several types of validity scales in a volunteer sample of 72 men and 106 women who completed the Revised NEO Personality Inventory (NEO-PI-R; P. T. Costa & R. R. McCrae, 1992) and the Multidimensional Personality Questionnaire (MPQ; A. Tellegen, 1978/1982) and were rated by 2 acquaintances on the observer form of the NEO-PI-R. Analyses indicated that the validity indexes lacked utility in this sample. A partial replication (N = 1,728) also failed to find consistent support for the use of validity scales. The authors illustrate the use of informant ratings in assessing protocol validity and argue that psychological assessors should limit their use of validity scales and seek instead to improve the quality of personality assessments.
Cites (46)
- Applied Multiple Regression/Correlation Analysis for the Behavioral SciencesCohen, Patricia, Cohen, Patricia, West, Stephen G., Aiken, Leona S. · 2014 · Psychology Press eBooks
- A new scale of social desirability independent of psychopathology.Crowne, Douglas P., Marlowe, David · 1960 · Journal of Consulting Psychology
- Measurement and Control of Response BiasPaulhus, Delroy L. · 1991 · Measures of Personality and Social Psychological Attitudes
- Measures of Personality and Social Psychological Attitudes1991 · Elsevier eBooks
- Progress of Veterinary Science.Douglas N. Jackson · 1882 · PubMed Central
- Personality in adulthood: A six-year longitudinal study of self-reports and spouse ratings on the NEO Personality Inventory.Paul T. Costa, Robert R. McCrae · 1988 · Journal of Personality and Social Psychology
- The Social Desirability Variable in Personality Assessment and Research.Sprott, D. A., Edwards, Allen L. · 1959 · Journal of the American Statistical Association
- Facet Scales for Agreeableness and Conscientiousness: A Revision of the NEO Personality InventoryCosta, Paul T., McCrae, Robert R., Dye, David A. · 1991 · Personality and Individual Differences
- Role of social desirability in personality testing for personnel selection: The red herring.Ones, Deniz S., Viswesvaran, Chockalingam, Reiss, Angelika D. · 1996 · Journal of Applied Psychology
- Criterion-related validities of personality constructs and the effect of response distortion on those validities.Hough, Leaetta M., Eaton, Newell K., Dunnette, Marvin D., Kamp, John D., McCloy, Rodney A. · 1990 · Journal of Applied Psychology
Cited by (29)
- The international personality item pool and the future of public-domain personality measuresGoldberg, Lewis R., Johnson, John A., Eber, Herbert W., Hogan, Robert, Ashton, Michael C., Cloninger, C. Robert, Gough, Harrison G. · 2006 · Journal of Research in Personality
- Universal Features of Personality Traits From the Observer's Perspective: Data From 50 Cultures.McCrae, Robert R., 78 Members of the Personality Profiles of Cultures Project, Terracciano, Antonio · 2005 · Journal of Personality and Social Psychology
- Detecting and Deterring Insufficient Effort Responding to SurveysHuang, Jason L., Curran, Paul G., Keeney, Jessica, Poposki, Elizabeth M., DeShon, Richard P. · 2012 · Journal of Business and Psychology
- Temperament and developmental psychopathologyNigg, Joel T. · 2006 · Journal of Child Psychology and Psychiatry
- Untitled work2007
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On the invalidity of validity scales: Evidence from self-reports and observer ratings in volunteer samples. https://app.cochat.ai/papers/10.1037//0022-3514.78.3.582
- The paper
- Piedmont, R. L., McCrae, R. R., Riemann, R., & Angleitner, A. (2000). On the invalidity of validity scales: Evidence from self-reports and observer ratings in volunteer samples. Journal of Personality and Social Psychology. https://doi.org/10.1037//0022-3514.78.3.582
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.