What grades and achievement tests measure
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Significance: Grades and scores on achievement tests are widely used as measures of cognition. This paper examines these measures and their constituent parts. We establish that, on average, grades and achievement tests are generally better predictors of life outcomes than “pure” measures of intelligence. The reason is that they capture aspects of personality that have been shown to be predictive in their own right. All of the standard measures of “intelligence” or “cognition” are influenced by aspects of personality, albeit to varying degrees, depending on the measure. This result has important implications for the interpretation of studies using scores on achievement tests and grades to explain differences in outcomes and for the use of standard cognitive measures to evaluate the effectiveness of public policies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In line with previous research (21, 34), acquired knowledge (i.e., invested) abilities tended to be more strongly correlated with personality traits than non-invested abilities were.”
From Meta-analytic relations between personality and cognitive ability (2023) · cites this paper as [34]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
RETRACTED: Role of test motivation in intelligence testing
Duckworth, A. L., Quinn, P. D., Lynam, D. R., Loeber, R., & Stouthamer-Loeber, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1018601108 · Cited by 344
RetractedGrit: perseverance and passion for long-term goals
Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.6.1087 · Cited by 6,911 · cited 1×
“Wage Any Welfare (31-45) Depression Physical Health Mental Health Voted Ad ju st ed R -s qu ar ed”
BackgroundThe development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
The Bell Curve: Intelligence and Class Structure in American Life.
Preston, S. H., Herrnstein, R. J., & Murray, C. (1995) · Population and Development Review · doi:10.2307/2137757 · Cited by 3,998
A meta-analysis of the five-factor model of personality and academic performance.
Poropat, A. E. (2009) · Psychological Bulletin · doi:10.1037/a0014996 · Cited by 2,729
The Role of Cognitive Skills in Economic Development
Hanushek, E. A., & Woessmann, L. (2008) · Journal of Economic Literature · doi:10.1257/jel.46.3.607 · Cited by 2,435
Self-discipline outdoes IQ in predicting academic performance of adolescents.
Duckworth, A. L., & Seligman, M. E. P. (2005) · Psychological Science · doi:10.1111/j.1467-9280.2005.01641.x · Cited by 2,253
Heckman, J. J., & Kautz, T. (2012) · Labour Economics · doi:10.1016/j.labeco.2012.05.014 · Cited by 2,007 · cited 1×
“Achievement tests were thought to be independent of teacher assessments of noncognitive traits that were often deemed to be biased (4, 5).”
BackgroundSelf-citationIntelligence, personality, and interests: Evidence for overlapping traits
Ackerman, P. L., & Heggestad, E. D. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.2.219 · Cited by 1,829 · cited 1×
“18), and between personality and grades.”
The Black-White Test Score Gap
(2011) · Rowman & Littlefield Publishers eBooks · doi:10.5771/9780815746119 · Cited by 1,715
Moses, L. E., & Lindquist, E. F. (1951) · Journal of the American Statistical Association · doi:10.2307/2280411 · Cited by 1,661
The black-white test score gap
(1999) · Choice Reviews Online · doi:10.5860/choice.36-5211 · Cited by 1,471
Murray, C. A., & Herrnstein, R. J. (1994) · Cited by 1,383
The bell curve: intelligence and class structure in American life
(1995) · Choice Reviews Online · doi:10.5860/choice.32-5357 · Cited by 1,261
Dynamics of the Gender Gap for Young Professionals in the Financial and Corporate Sectors
Bertrand, M., Goldin, C., & Katz, L. F. (2010) · American Economic Journal: Applied Economics · doi:10.1257/app.2.3.228 · Cited by 1,256
Personality Psychology and Economics
Almlund, M., Duckworth, A. L., Heckman, J., & Kautz, T. (2011) · Handbook of the Economics of Education · doi:10.1016/b978-0-444-53444-6.00001-8 · Cited by 1,204
Self-citationThe Growing Importance of Cognitive Skills in Wage Determination
Murnane, R. J., Willett, J. B., & Levy, F. (1995) · The Review of Economics and Statistics · doi:10.2307/2109863 · Cited by 1,160
Personality predictors of academic outcomes: Big five correlates of GPA and SAT scores.
Noftle, E. E., & Robins, R. W. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.1.116 · Cited by 1,068
Intelligence: New findings and theoretical developments
Nisbett, R. E., Aronson, J., Blair, C., Dickens, W., Flynn, J., Halpern, D. F., & Turkheimer, E. (2012) · American Psychologist · doi:10.1037/a0026699 · Cited by 1,031
The economics and psychology of personality traits
L., B., A.L., D., J., H., & B.J., T. W. (2008) · Research Publications (Maastricht University) · doi:10.26481/umaror.2008001 · Cited by 960
Self-citationThe Economics of Human Development and Social Mobility
Heckman, J. J., & Mosso, S. (2014) · Annual Review of Economics · doi:10.1146/annurev-economics-080213-040753 · Cited by 940 · cited 2×
“For example, personality or noncognitive skills are more malleable at later ages than IQ, and there are effective adolescent interventions that promote personality but are much less successful in boosting IQ (31, 32).”
BackgroundSelf-citationMeasurement Error in Survey Data
Bound, J., Brown, C., & Mathiowetz, N. (2001) · Handbook of Econometrics · doi:10.1016/s1573-4412(01)05012-7 · Cited by 893
Kautz, T., Heckman, J., Diris, R., ter Weel, B., & Borghans, L. (2014) · National Bureau of Economic Research · doi:10.3386/w20749 · Cited by 744
Self-citationGender Differences in Risk Aversion and Ambiguity Aversion
Borghans, L., Golsteyn, B. H. H., Heckman, J. J., & Meijers, H. (2009) · Journal of the European Economic Association · doi:10.1162/jeea.2009.7.2-3.649 · Cited by 652
Self-citation(2014) · OECD Education Working Papers · doi:10.1787/5jxsr7vr78f7-en · Cited by 468
Self-citationDuckworth, A. L., Quinn, P. D., & Tsukayama, E. (2012) · Journal of Educational Psychology · doi:10.1037/a0026280 · Cited by 416
Intelligence and how to get it: why schools and cultures count
(2009) · Choice Reviews Online · doi:10.5860/choice.46-7095 · Cited by 331
The Economics and Psychology of Personality Traits
Borghans, L., Duckworth, A. L., Heckman, J. J., & Weel, B. T. (2008) · Journal of Human Resources · doi:10.3368/jhr.43.4.972 · Cited by 291
Self-citationTHE ROLE OF NONCOGNITIVE SKILLS IN EXPLAINING COGNITIVE TEST SCORES
BORGHANS, L., MEIJERS, H., & TER WEEL, B. (2008) · Economic Inquiry · doi:10.1111/j.1465-7295.2007.00073.x · Cited by 261
Self-citationSelf-Regulation and School Success
Duckworth, A. L., & Carlson, S. M. (2013) · Self-Regulation and Autonomy · doi:10.1017/cbo9781139152198.015 · Cited by 209
Identification problems in personality psychology
Borghans, L., Golsteyn, B. H. H., Heckman, J., & Humphries, J. E. (2011) · Personality and Individual Differences · doi:10.1016/j.paid.2011.03.029 · Cited by 166
Self-citationWorking When No One Is Watching: Motivation, Test Scores, and Economic Success
Segal, C. (2012) · Management Science · doi:10.1287/mnsc.1110.1509 · Cited by 147
A meta‐analysis of adult‐rated child personality and academic performance in primary education
Poropat, A. E. (2014) · British Journal of Educational Psychology · doi:10.1111/bjep.12019 · Cited by 123
The Myth of achievement tests: the GED and the role of character in American life
(2014) · Choice Reviews Online · doi:10.5860/choice.52-0980 · Cited by 89
Educational Evaluation: Classic Works of Ralph W. Tyler
(1988) · Springer eBooks · doi:10.1007/978-94-009-2679-0 · Cited by 68
Personality and IQ measures as predictors of school achievement.
Barton, K., Dielman, T. E., & Cattell, R. B. (1972) · Journal of Educational Psychology · doi:10.1037/h0033573 · Cited by 59
What Do Test Scores Miss? The Importance of Teacher Effects on Non-Test Score Outcomes
Jackson, C. K. (2016) · National Bureau of Economic Research · doi:10.3386/w22226 · Cited by 39
Lee, G. P., & Loring, D. W. (2020) · CRC Press eBooks · doi:10.1201/9781003066736-70 · Cited by 33
Book Reviews: Educational Evaluation: Classic Works of Ralph W. Tyler
Stone, J. C., Madaus, G. F., Stufflebeam, D., & Tyler, R. W. (1990) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737012001102 · Cited by 24
Educational Evaluation: Classic Works of Ralph W. Tyler
Stone, J. C., Madaus, G. F., Stufflebeam, D. L., et al. (1990) · Educational Evaluation and Policy Analysis · doi:10.2307/1163590 · Cited by 20
The Place of Evaluation in Modern Education
Tyler, R. W. (1940) · The Elementary School Journal · doi:10.1086/457850 · Cited by 10
Research works printed but not linked: 2
- Green DR, ed (1974) The Aptitude-Achievement Distinction: Proceedings of the Second CTB/McGraw-Hill Conference on Issues in Educational Measurement (Cal- ifornia Test Bureau/McGraw-Hill, Monterey, CA).
- Elango S, Hojman A, García JL, Heckman JJ (2016) Early childhood education. Means- Tested Transfer Programs in the United States II, ed Moffitt R (Univ of Chicago Press, Chicago).
Cited by
Global Evidence on Economic Preferences*
Falk, A., Becker, A., Dohmen, T., Enke, B., Huffman, D., & Sunde, U. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjy013 · Cited by 1,724
Gender differences in individual variation in academic grades fail to fit expected patterns for STEM
O’Dea, R. E., Lagisz, M., Jennions, M. D., & Nakagawa, S. (2018) · Nature Communications · doi:10.1038/s41467-018-06292-0 · Cited by 253
Bardach, L., & Klassen, R. M. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100312 · Cited by 251
The Scandinavian Fantasy: The Sources of Intergenerational Mobility in Denmark and the US
Landersø, R., & Heckman, J. J. (2017) · The Scandinavian Journal of Economics · doi:10.1111/sjoe.12219 · Cited by 203
Self-citationParents’ Beliefs about Their Children’s Academic Ability: Implications for Educational Investments
Dizon-Ross, R. (2019) · American Economic Review · doi:10.1257/aer.20171172 · Cited by 197
Metadata
- Authors
- Borghans, L., Golsteyn, B. H. H., Heckman, J. J., & Humphries, J. E.
- Affiliations
- Maastricht University (NL)
- American Bar Foundation (US)
- University of Chicago (US)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2016-11-08
- Volume
- 113
- Issue
- 47
- Pages
- 13354-13359
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC5127298
- OpenAlex
- W2557104988
- Cited by
- 288
- References
- 41
- Citations by year
- 2026: 26 · 2025: 26 · 2024: 32 · 2023: 43 · 2022: 42 · 2021: 31 · 2020: 31 · 2019: 25 · 2018: 19 · 2017: 11 · 2016: 2
- FWCI
- 26.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, other-oa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion, other-oa)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Funders
- American Bar Foundation (na)
- J.B. and M.K. Pritzker Family Foundation (na)
- Buffett Foundation Early Childhood Fund (na)
- HHS | NIH | National Institute of Child Health and Human Development (R37HD065072, R01HD54702)
- HHS | NIH | National Institute on Aging (R24AG048081)
- Anonymous (na)
- Successful Pathways from School to Work, University of Chicago Committee on Education (na)
- Hymen Milgrom Supporting Organization (na)
- Institute for New Economic Thinking (na)
- Handelsbanken Research Foundation (na)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Education › Educational Outcomes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Education, Achievement, and Giftedness
- Keywords
- intelligence quotient, student grades, achievement tests, personality traits, personality and academic achievement, cognitive ability measurement
- MeSH terms
- Achievement, Cognition, Female, Humans, Intelligence Tests, Male, Neuropsychological Tests, Personality, Personality Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.