Noncognitive Constructs and Their Assessment in Graduate Education: A Review
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
We reviewed the literature on "noncognitive" predictors-specifically, personality as it pertains to graduate education. The review is divided into 3 sections. In the first section, we reviewed measures typically used in studies of graduate school outcomes, such as attrition and time to degree. We also reviewed which student qualities faculty and administrators said they desired and cultivated in graduate programs. We also noted that there are many qualities faculty ranked high in desirability but which could only imperfectly be gleaned from sources such as letters of recommendation and personal statements. In the second section, we reviewed general personality factors (e.g., the "Big Five"), specifically, definitions, measures, correlates, and the validity of those measures. We concluded with a discussion of how personality factors might be used in admissions and guidance applications for graduate education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180 · cited 2×
“Because personality is uncorrelated with cognitive ability (with the exception of the openness factor), personality validities for job performance, particularly conscientiousness and integrity, are incremental (Schmidt & Hunter, 1998).”
BackgroundToward a cognitive social learning reconceptualization of personality
Mischel, W. (1973) · Psychological Review · doi:10.1037/h0035002 · Cited by 3,181 · cited 1×
“A second is that for many years, a predominant view in psychology was that situational factors were more important than personal factors in governing behavior (Mischel, 1973).”
BackgroundCacioppo, J. T., Petty, R. E., Feinstein, J. A., & Jarvis, W. B. G. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.197 · Cited by 2,517
Barrick, M. R., Mount, M. K., & Judge, T. A. (2001) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00160 · Cited by 2,356
Academic self-efficacy and first year college student performance and adjustment.
Chemers, M. M., Hu, L.-T., & Garcia, B. F. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.1.55 · Cited by 2,031
Benet-Martínez, V., & John, O. P. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.75.3.729 · Cited by 1,996
Big Five factors and facets and the prediction of behavior.
Paunonen, S. V., & Ashton, M. C. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.3.524 · Cited by 1,097 · cited 1×
“Again, in some situations, these facets may be more important (i.e., valid) than the five factors themselves (Paunonen & Ashton, 2001).”
BackgroundIntegration of the Big Five and circumplex approaches to trait structure
Hofstee, W. K., de Raad, B., & Goldberg, L. R. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.63.1.146 · Cited by 891 · cited 1×
“Hogan (1986) and Hough (1997) suggest that this factor can be divided into sociability or affiliativeness on the one hand (e.”
BackgroundFive-Factor Model of personality and Performance in Jobs Involving Interpersonal Interactions
Mount, M., Barrick, M., & Stewart, G. (1998) · Human Performance · doi:10.1207/s15327043hup1102&3_3 · Cited by 832
McAdams, D. P., Reynolds, J., Lewis, M., Patten, A. H., & Bowman, P. J. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201274008 · Cited by 822
The 'Big Five' Personality Variables--Construct Confusion: Description Versus Prediction
Hough, L. M. (1992) · Human Performance · doi:10.1080/08959285.1992.9667929 · Cited by 735
Kuncel, N. R., Hezlett, S. A., & Ones, D. S. (2001) · Psychological Bulletin · doi:10.1037/0033-2909.127.1.162 · Cited by 639
Cross-Cultural Assessment of the Five-Factor Model: The Revised NEO Personality Inventory
McCrae, R. R., Costa, P. T., Del Pilar, G. H., Rolland, J.-P., & Parker, W. D. (1998) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022198291009 · Cited by 406
Sackett, P. R., Schmitt, N., Ellingson, J. E., & Kabin, M. B. (2001) · American Psychologist · doi:10.1037/0003-066x.56.4.302 · Cited by 387
Goldberg, L. R., Sweeney, D., Merenda, P. F., & Hughes, J. E. (1998) · Personality and Individual Differences · doi:10.1016/s0191-8869(97)00110-4 · Cited by 378
Self-Esteem and Emotion: Some Thoughts about Feelings
Brown, J. D., & Marshall, M. A. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201275006 · Cited by 304
Research works printed but not linked: 62
- Barrick M. R., 1991, Personnel Psychology, 44, 1, 10.1111/j.1744-6570.1991.tb00688.x · DOI · Paper page
- Briggs, K. C., Myers, I. B. & McCaulley, M. H. (1985). Manual: A guide to the development and use of the Myers-Briggs Type Indicator. Palo Alto, CA: Consulting Psychologists Press.
- Brody, N. & Crowley, M. J. (1995). Environmental (and genetic) influences on personality and intelligence. In D. H. Saklofske & M. Zeidner (Eds.), International handbook on personality and intelligence (pp. 59-80). New York: Plenum Press. · DOI
- 10.1016/S0191-8869(99)00253-6 · DOI · Paper page
- Cable D. M., 1999, Academy of Management Journal, 42, 439, 10.2307/257014 · DOI
- 10.1037//0033-2909.119.2.197 · doi:10.1037//0033-2909.119.2.197 · Paper page
- Campbell J. P., 1990, Personnel Psychology, 43, 231, 10.1111/j.1744-6570.1990.tb01556.x · DOI
- Campbell, J. P., McCloy, R. A., Oppler, S. H. & Sager, C. E. (1993). A theory of performance. In N. Schmitt & W. Borman (Eds.), Personnel selection in organizations (pp. 35-70). San Francisco: Jossey-Bass.
- 10.1037//0021-9010.83.4.531 · DOI · Paper page
- Dahlstrom, W. G., Welsh, G. S. & Dahlstrom, L. E. (1972). An MMPI handbook: I. Clinical interpretation (Rev. ed.). Minneapolis: University of Minnesota Press.
- de Raad B., 1997, European Journal of Psychological Assessment, 13, 85, 10.1027/1015-5759.13.2.85 · DOI
- 10.1037//0021-9010.84.2.155 · doi:10.1037//0021-9010.84.2.155 · Paper page
- 10.1037//0021-9010.86.1.122 · doi:10.1037//0021-9010.86.1.122 · Paper page
- Eysenck, H. J. (1991). Dimensions of personality: The biosocial approach to personality. In J. Strelau & A. Angleitner (Eds.), Explorations in temperament: International perspectives on theory and measurement (pp. 87-103). London: Plenum. · DOI · Paper page
- Fernandez-Ballesteros, R. (Ed.). (2003). Encyclopedia of psychological assessment. Thousand Oaks, CA: Sage. · doi:10.4135/9780857025753
- 10.1146/annurev.psych.52.1.197 · DOI · Paper page
- 10.1037//0022-0663.84.4.537 · doi:10.1037//0022-0663.84.4.537 · Paper page
- Goldberg E. L., 1992, Educational and Psychological Measurement, 52, 1019, 10.1177/0013164492052004026 · DOI
- 10.1037//1040-3590.4.1.26 · doi:10.1037//1040-3590.4.1.26 · Paper page
- Goldberg, L. R. (1999). A broad-bandwidth, public-domain, personality inventory measuring the lower-level facets of several five-factor models. In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality psychology in Europe, Vol. 7 (pp. 7-28). Tilburg, The Netherlands: Tilburg University Press.
- Goldberg, L. R. (2001, June). The Big-Five Factor structure as a framework for the consideration of noncognitive assessments for graduate admissions (Oregon Research Institute). Symposium conducted at the meeting on Noncognitive Assessments for Graduate Admissions, Graduate Record Examinations Board, Toronto, Ontario.
- Gough, H. (1975). The California Psychological Inventory. Palo Alto, CA: Consulting Psychologists Press.
- 10.1037//0022-3514.63.1.85 · DOI · Paper page
- 10.1016/S0191-8869(98)00245-1 · DOI · Paper page
- 10.1177/00027640021956125 · DOI
- 10.1037//0003-066X.33.12.1083 · DOI
- 10.1037//0021-9010.74.2.273 · DOI
- Hogan, R. & Hogan, J. (1995). Hogan Personality Inventory manual: Second edition. Tulsa, OK: Hogan Assessment Systems.
- 10.1207/s15327043hup0501&2_8 · DOI
- 10.1080/026999498378006 · doi:10.1080/026999498378006
- Hough, L. M. (2001). I/Owes its advances to personality. In B. W. Roberts & R. Hogan (Eds.), Personality psychology in the workplace. Decade of behavior (pp. 19-44). Washington, DC: American Psychological Association. · DOI
- 10.1037//0021-9010.85.6.869 · doi:10.1037//0021-9010.85.6.869 · Paper page
- Jackson, D. N. (1976). Jackson Personality Inventory. Port Huron, MI: Research Psychologists Press.
- James L. R., 1998, Organizational Research Methods, 1, 131, 10.1177/109442819812001 · DOI · Paper page
- Jamison, D. (1996). Occupational goals and persistence in African-American students attending four-year colleges. Dissertation Abstracts International Section A: Humanities and Social Sciences. Vol. 57(1-A): 0101.
- Kinney J. R., 1999, Dissertation Abstracts International, 60, 3001B
- Kirnan J. P., 1981, Educational and Psychological Measurement, 41, 815, 10.1177/001316448104100322 · DOI
- Kuncel, N. R., Campbell, J. P., Hezlett, S. A. & Ones, D. S. (2001, April). Performance in college: The criterion problem. In D. S. Ones & S. A. Hezlett (Chairs), Predicting performance: The interface of I/O psychology and educational research. Symposium presented at the annual conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
- Lanthier R. P., 2000, Psychological Reports, 86, 400, 10.2466/pr0.2000.86.2.400 · DOI
- McAdams, D. P. (1999). Personal narratives and the life story. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 478-500). New York: Guilford Press.
- Mount M. K., 1994, Journal of Personality Psychology, 79, 272
- Musgrave-Marquart D., 1997, Journal of Social Behavior and Personality, 12, 501
- Nelson, N. G. (2000, September). Correlates of health and success among psychology graduate students: Stress, distress, coping, well being, and social support. Dissertation Abstracts International Section A: Humanities and Social Sciences. 61(3-A), 883.
- Norman W. T., 1963, Journal of Abnormal and Social Psychology, 66, 574, 10.1037/h0040291 · DOI · Paper page
- Ones, D. S. & Viswesvaran, C. (1998). Integrity testing in organizations. In R. W. Griffin, A. O'Leary-Kelly, & J. M. Collins (Eds.), Dysfunctional behavior in organizations: Nonviolent behaviors in organizations (Vol. 2, pp. 243-276). Greenwich, CT: JAI Press.
- 10.1037//0021-9010.78.4.679 · doi:10.1037//0021-9010.78.4.679 · Paper page
- 10.1037//0022-3514.56.5.823 · doi:10.1037//0022-3514.56.5.823
- 10.1037//0022-3514.81.3.524 · doi:10.1037//0022-3514.81.3.524 · Paper page
- Reeve, C. L. & Hakel, M. D. (2001, June). Criterion issues and practical considerations concerning noncognitive assessment in graduate admissions (Bowling Green State University). Symposium conducted at the meeting of Noncognitive Assessments for Graduate Admissions, Graduate Record Examinations Board, Toronto, Ontario.
- 10.1037//0003-066X.56.4.302 · doi:10.1037//0003-066x.56.4.302 · Paper page
- Sackett P. R., 1996, Personnel Psychology, 47, 787, 10.1111/j.1744-6570.1996.tb02450.x · DOI · Paper page
- 10.1207/s15327043hup1102&3_8 · DOI
- 10.1037//0022-3514.78.2.366 · DOI · Paper page
- 10.1111/1467-6494.00022 · DOI · Paper page
- Schmidt, F. L. (1994). The future of personnel selection in the U.S. Army. In M. G. Rumsey & C. B. Walker (Eds.), Personnel selection and classification (pp. 333-350). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
- 10.1037//0021-9010.86.1.122 · doi:10.1037//0021-9010.86.1.122 · Paper page
- Sternberg, R. J. (1985). Beyond IQ: A triarchic theory of human intelligence. New York: Cambridge University Press.
- 10.1037//0003-066X.52.6.630 · DOI
- Tett R. P., 1991, Personnel Psychology, 44, 703, 10.1111/j.1744-6570.1991.tb00696.x · DOI · Paper page
- 10.1016/S0191-8869(98)00131-7 · DOI
- Tupes E. C. & Christal, R. C. (1958). Stability of personality trait rating factors obtained under diverse conditions (WADC-TN-58-61, AD-151 041). Lackland AFB, TX: Personnel Research Laboratory, Wright Air Development Center · DOI · Paper page
- Van-Heyningen J. J., 1997, Dissertation Abstracts International Section, 58, 2076A
Cited by
Personality Psychology and Economics
Almlund, M., Duckworth, A. L., Heckman, J., & Kautz, T. (2011) · Handbook of the Economics of Education · doi:10.1016/b978-0-444-53444-6.00001-8 · Cited by 1,204
The Economics and Psychology of Personality Traits
Borghans, L., Duckworth, A. L., Heckman, J. J., & ter Weel, B. (2008) · Journal of Human Resources · doi:10.1353/jhr.2008.0017 · Cited by 1,049
The economics and psychology of personality traits
L., B., A.L., D., J., H., & B.J., T. W. (2008) · Research Publications (Maastricht University) · doi:10.26481/umaror.2008001 · Cited by 960
Personality Psychology and Economics
Almlund, M., Duckworth, A. L., Heckman, J., & Kautz, T. (2011) · National Bureau of Economic Research · doi:10.3386/w16822 · Cited by 540
Meta-Analysis of the Relationship Between the Big Five and Academic Success at University
Trapmann, S., Hell, B., Hirn, J.-O. W., & Schuler, H. (2007) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.215.2.132 · Cited by 367
Metadata
- Authors
- Kyllonen, P., Walters, A. M., & Kaufman, J. C.
- Venue
- Educational Assessment
- Publisher
- Informa UK Limited
- Published
- 2005-09
- Volume
- 10
- Issue
- 3
- Pages
- 153-184
- ISSN
- 1062-7197 (ISSN-L)
- 1532-6977
- OpenAlex
- W1991638301
- Cited by
- 105
- References
- 17
- FWCI
- 4.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.