ARE WE GETTING FOOLED AGAIN? COMING TO TERMS WITH LIMITATIONS IN THE USE OF PERSONALITY TESTS FOR PERSONNEL SELECTION
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
We recently published an article in which we highlighted a number of issues associated with the use of self‐report personality tests in personnel selection contexts (Morgeson et al., 2007). Both Ones, Dilchert, Viswesvaran, and Judge (2007) and Tett and Christiansen (2007) have written responses to this article. In our response to these articles we address many of the issues raised by Ones et al. and Tett and Christiansen. In addition to a detailed response, we make the following 4 key points: (1) Our criticisms of personality testing apply only to the selection context, not to all research on personality; (2) the observed validities of personality tests predicting job performance criteria are low and have not changed much over time; (3) when evaluating the usefulness of using personality tests to select applicants, one must not ignore the observed, uncorrected validity; and (4) when discussing the value of personality tests for selection contexts, the most important criteria are those that reflect job performance. Implications for personality testing research and practice are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
Review of Psychometric theory (2nd ed.).
SITGREAVES, R. (1979) · Contemporary Psychology: A Journal of Reviews · doi:10.1037/018882 · Cited by 11,425
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Kemp, F. (2003) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1046/j.1467-9884.2003.t01-2-00383_4.x · Cited by 9,293
THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META‐ANALYSIS
BARRICK, M. R., & MOUNT, M. K. (1991) · Personnel Psychology · doi:10.1111/j.1744-6570.1991.tb00688.x · Cited by 8,689
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180 · cited 1×
“In addition, the corrected R values do not seem all that impressive when compared to the corrected univariate validity estimates reported by Schmidt and Hunter (1998) for cognitive tests (.51), work samples (.54), structured interviews (.51), job knowledge tests (.44), peer ratings (.49), or job tryout procedures (.44…”
ResultORGAN, D. W., & RYAN, K. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01781.x · Cited by 3,222
Personality and leadership: A qualitative and quantitative review
Judge, T. A., Bono, J. E., Ilies, R., & Gerhardt, M. W. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.4.765 · Cited by 3,190
Personality and job performance: The Big Five revisited.
Hurtz, G. M., & Donovan, J. J. (2000) · Journal of Applied Psychology · doi:10.1037//0021-9010.85.6.869 · Cited by 1,745
A contrarian view of the five-factor approach to personality description.
Block, J. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.2.187 · Cited by 1,682 · cited 2×
“There is clear evidence that the Big Five factors are not as orthogonal as suggested by these low intercorrelations (Block, 1995; Funder, 2001). For example, the revised NEO Personality Inventory (Costa & McCrae, 1992) reports domain–scale intercorrelations as high as .53 in self-ratings. The intercorrelations among t…”
BackgroundThe five factor model of personality and job performance in the European Community.
Salgado, J. F. (1997) · Journal of Applied Psychology · doi:10.1037//0021-9010.82.1.30 · Cited by 1,581
Relationship of personality to performance motivation: A meta-analytic review.
Judge, T. A., & Ilieș, R. (2002) · Journal of Applied Psychology · doi:10.1037//0021-9010.87.4.797 · Cited by 1,291
Role of social desirability in personality testing for personnel selection: The red herring.
Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996) · Journal of Applied Psychology · doi:10.1037//0021-9010.81.6.660 · Cited by 924
Hough, L. M., Eaton, N. K., Dunnette, M. D., Kamp, J. D., & McCloy, R. A. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.5.581 · Cited by 842 · cited 3×
“Based on these previous findings, Hough et al. (1990) report that the items on the ABLE inventory were written to “consist of obvious, rather than subtle, items that can readily be distorted” (p. 593).”
BackgroundMethodInfluentialBarrick, M. R., Mount, M. K., & Strauss, J. P. (1993) · Journal of Applied Psychology · doi:10.1037//0021-9010.78.5.715 · Cited by 830
Applicant Reactions to Selection Procedures: An Updated Model and Meta‐Analysis
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004) · Personnel Psychology · doi:10.1111/j.1744-6570.2004.00003.x · Cited by 816 · cited 2×
“In light of evidence that applicant perceptions about selection are related to evaluations of the organization, intentions to accept job offers, and recommend the employer to others (Hausknecht et al., 2004), negative reactions to personality inventories must be taken as seriously as validity data.”
BackgroundInfluentialMcCrae, R. R., Zonderman, A. B., Costa, P. T., Jr., & Bond, M. H. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.3.552 · Cited by 797
Vroom's expectancy models and work-related criteria: A meta-analysis.
van Eerde, W., & Thierry, H. (1996) · Journal of Applied Psychology · doi:10.1037//0021-9010.81.5.575 · Cited by 687
RECONSIDERING THE USE OF PERSONALITY TESTS IN PERSONNEL SELECTION CONTEXTS
MORGESON, F. P., CAMPION, M. A., DIPBOYE, R. L., HOLLENBECK, J. R., MURPHY, K., & SCHMITT, N. (2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00089.x · Cited by 638
Self-citationValidity Of Personality Measures In Personnel Selection
Guion, R. M., & Gottier, R. F. (1965) · Personnel Psychology · doi:10.1111/j.1744-6570.1965.tb00273.x · Cited by 587
IN SUPPORT OF PERSONALITY ASSESSMENT IN ORGANIZATIONAL SETTINGS
ONES, D. S., DILCHERT, S., VISWESVARAN, C., & JUDGE, T. A. (2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00099.x · Cited by 563
SCHMITT, N., GOODING, R. Z., NOE, R. A., & KIRSCH, M. (1984) · Personnel Psychology · doi:10.1111/j.1744-6570.1984.tb00519.x · Cited by 553
Self-citationComparative analysis of the reliability of job performance ratings.
Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.5.557 · Cited by 505
APPLICANT REACTIONS TO SELECTION PROCEDURES
SMITHER, J. W., REILLY, R. R., MILLSAP, R. E., AT&T, K. P., & STOFFEY, R. W. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00867.x · Cited by 489
The impact of response distortion on preemployment personality testing and hiring decisions.
Rosse, J. G., Stecher, M. D., Miller, J. L., & Levin, R. A. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.4.634 · Cited by 486
The Big Five in personnel selection: Factor structure in applicant and nonapplicant populations.
Schmit, M. J., & Ryan, A. M. (1993) · Journal of Applied Psychology · doi:10.1037//0021-9010.78.6.966 · Cited by 416
Frame-of-reference effects on personality scale scores and criterion-related validity.
Schmit, M. J., Ryan, A. M., Stierwalt, S. L., & Powell, A. B. (1995) · Journal of Applied Psychology · doi:10.1037//0021-9010.80.5.607 · Cited by 402
A Meta‐Analytic Investigation of Job Applicant Faking on Personality Measures
Birkeland, S. A., Manson, T. M., Kisamore, J. L., Brannick, M. T., & Smith, M. A. (2006) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2006.00354.x · Cited by 401
TETT, R. P., & CHRISTIANSEN, N. D. (2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00098.x · Cited by 242
Investigating the influence of social desirability on personality factor structure.
Ellingson, J. E., Smith, D. B., & Sackett, P. R. (2001) · Journal of Applied Psychology · doi:10.1037//0021-9010.86.1.122 · Cited by 212
CHRISTIANSEN, N. D., GOFFIN, R. D., JOHNSTON, N. G., & ROTHSTEIN, M. G. (1994) · Personnel Psychology · doi:10.1111/j.1744-6570.1994.tb01581.x · Cited by 188
INTERRATER CORRELATIONS DO NOT ESTIMATE THE RELIABILITY OF JOB PERFORMANCE RATINGS
MURPHY, K. R., & DESHON, R. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb02421.x · Cited by 183
Self-citationPrinciples for the Validation and Use of Personnel Selection Procedures: (633072007-001)
Tippins, N. T. (2004) · PsycEXTRA Dataset · doi:10.1037/e633072007-001 · Cited by 175
Effects of the testing situation on item responding: Cause for concern.
Stark, S., Chernyshenko, O. S., Chan, K.-Y., Lee, W. C., & Drasgow, F. (2001) · Journal of Applied Psychology · doi:10.1037//0021-9010.86.5.943 · Cited by 164
Meta-Analysis of Bidirectional Relations in Personality-Job Performance Research
Tett, R. P., Jackson, D. N., Rothstein, M., & Reddon, J. R. (1999) · Human Performance · doi:10.1207/s15327043hup1201_1 · Cited by 128
Do people fake on personality inventories? A verbal protocol analysis
Robie, C., Brown, D. J., & Beaty, J. C. (2007) · Journal of Business and Psychology · doi:10.1007/s10869-007-9038-9 · Cited by 124
Smith, D. B., Hanges, P. J., & Dickson, M. W. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.2.304 · Cited by 123
Personality assessment across selection and development contexts: Insights into response distortion.
Ellingson, J. E., Sackett, P. R., & Connelly, B. S. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.2.386 · Cited by 121
TETT, R. R., JACKSON, D. N., ROTHSTEIN, M., & REDDON, J. R. (1994) · Personnel Psychology · doi:10.1111/j.1744-6570.1994.tb02415.x · Cited by 110
MCMANUS, M. A., & KELLY, M. L. (1999) · Personnel Psychology · doi:10.1111/j.1744-6570.1999.tb01817.x · Cited by 104
PERSONALITY AND JOB PERFORMANCE: A CRITIQUE OF THE TETT, JACKSON, AND ROTHSTEIN (1991) META‐ANALYSIS
ONES, D. S., MOUNT, M. K., BARRICK, M. R., & HUNTER, J. E. (1994) · Personnel Psychology · doi:10.1111/j.1744-6570.1994.tb02414.x · Cited by 104
The impact of corrections for faking on the validity of noncognitive measures in selection settings.
Schmitt, N., & Oswald, F. L. (2006) · Journal of Applied Psychology · doi:10.1037/0021-9010.91.3.613 · Cited by 100
Self-citationPersonality at work: Issues and evidence.
Hough, L. M. (1998) · Cited by 72
A managerial potential scale for the California Psychological Inventory.
Gough, H. G. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.2.233 · Cited by 52
The Impact of Item Characteristics on Item and Scale Validity
Johnson, J. A. (2004) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3902_6 · Cited by 47
PROGRESS IN PSYCHOMETRICS: CAN INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY CATCH UP?
Murphy, K. R., & SHON, R. D. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb02423.x · Cited by 39
Self-citationPerceptions of Overt and Personality‐based Integrity Tests
Whitney, D. J., Díaz, J., Mineghino, M. E., & Powers, K. (1999) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00102 · Cited by 20
The human use of personality tests: A dissenting view.
Lovell, V. R. (1967) · American Psychologist · doi:10.1037/h0024934 · Cited by 18
Personality Validity: The Role of Schemas and Motivated Reasoning
Aronson, Z. H., & Reilly, R. R. (2006) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2006.00358.x · Cited by 15
ITEMS AND PERSONS: FORMAL DUALS AND PSYCHOLOGICAL DIFFERENCES
Fiske, D. W. (1968) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0304_2 · Cited by 12
Research works printed but not linked: 19
- 10.1037/0021-9010.78.5.715 · doi:10.1037/0021-9010.78.5.715 · Paper page
- Costa PT, 1992, Revised NEO Personality Inventory (NEO PI‐R) and NEO Five‐Factor Inventory (NEO‐FFI) professional manual
- Funder DC., 2001, The really, really fundamental attribution error, Psychological Inquiry, 12, 21
- Guion RM., 1965, Personnel testing
- Hough LM., 1998, Beyond multiple choice: Evaluating alternatives to traditional testing for selection
- 10.1037/0021-9010.85.6.869 · doi:10.1037/0021-9010.85.6.869 · Paper page
- Jayne MEA, 2000, Managing selection in changing organizations, 123
- 10.1037/0021-9010.87.4.797 · doi:10.1037/0021-9010.87.4.797 · Paper page
- Kuncel RB, 1995, Personality research, methods, and theory: A festschrift honoring Donald W. Fiske, 183
- 10.1037/0022-3514.70.3.552 · doi:10.1037/0022-3514.70.3.552 · Paper page
- Nunnally JC., 1978, Psychometric Theory
- 10.1037/0021-9010.81.6.660 · doi:10.1037/0021-9010.81.6.660 · Paper page
- 10.1037/0021-9010.83.4.634 · doi:10.1037/0021-9010.83.4.634 · Paper page
- 10.1037/0021-9010.82.1.30 · DOI · Paper page
- 10.1037/0033-2909.124.2.262 · doi:10.1037/0033-2909.124.2.262 · Paper page
- 10.1037/0021-9010.78.6.966 · doi:10.1037/0021-9010.78.6.966 · Paper page
- 10.1037/0021-9010.80.5.607 · doi:10.1037/0021-9010.80.5.607 · Paper page
- 10.1037/0021-9010.86.5.943 · doi:10.1037/0021-9010.86.5.943 · Paper page
- 10.1037/0021-9010.81.5.575 · doi:10.1037/0021-9010.81.5.575 · Paper page
Cited by
The relation between emotional intelligence and job performance: A meta-analysis
O'Boyle, E. H., Humphrey, R. H., Pollack, J. M., Hawver, T. H., & Story, P. A. (2011) · Journal of Organizational Behavior · doi:10.1002/job.714 · Cited by 1,122
Judge, T. A., Piccolo, R. F., & Kosalka, T. (2009) · The Leadership Quarterly · doi:10.1016/j.leaqua.2009.09.004 · Cited by 990
Which CEO Characteristics and Abilities Matter?
KAPLAN, S. N., KLEBANOV, M. M., & SORENSEN, M. (2012) · The Journal of Finance · doi:10.1111/j.1540-6261.2012.01739.x · Cited by 740
Judge, T. A., & Zapata, C. P. (2015) · Academy of Management Journal · doi:10.5465/amj.2010.0837 · Cited by 738
“As for the latter, while some have questioned the practical relevance of personality variables for human resource selection decisions (Morgeson et al., 2007a, 2007b; Murphy & Dzieweczynski, 2005), our results show that, when there is reason to believe that the trait is relevant to the job context,…”
BackgroundResultInfluentialThe dark side of personality at work: DARK PERSONALITY REVIEW
Spain, S. M., Harms, P., & LeBreton, J. M. (2014) · Journal of Organizational Behavior · doi:10.1002/job.1894 · Cited by 521
Metadata
- Authors
- MORGESON, F. P., CAMPION, M. A., DIPBOYE, R. L., HOLLENBECK, J. R., MURPHY, K., & SCHMITT, N.
- Venue
- Personnel Psychology
- Publisher
- Wiley
- Published
- 2007-11-13
- Volume
- 60
- Issue
- 4
- Pages
- 1029-1049
- ISSN
- 0031-5826 (ISSN-L)
- 1744-6570
- OpenAlex
- W2028877361
- Cited by
- 283
- References
- 49
- FWCI
- 14.00
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.