The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Cognitive Reflection and Decision Making
Abstract
This paper introduces a three-item “Cognitive Reflection Test” (CRT) as a simple measure of one type of cognitive ability—the ability or disposition to reflect on a question and resist reporting the first response that comes to mind. The author will show that CRT scores are predictive of the types of choices that feature prominently in tests of decision-making theories, like expected utility theory and prospect theory. Indeed, the relation is sometimes so strong that the preferences themselves effectively function as expressions of cognitive ability—an empirical fact begging for a theoretical explanation. The author examines the relation between CRT scores and two important decision-making characteristics: time preference and risk preference. The CRT scores are then compared with other measures of cognitive ability or cognitive “style.” The CRT scores exhibit considerable difference between men and women and the article explores how this relates to sex differences in time and risk preferences. The final section addresses the interpretation of correlations between cognitive abilities and decision-making characteristics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“we find the participants’ accuracy increased by 2.1 percentage points (z(16002) = 4.6, β = 2.1, p < 0.001, 95% CI = [1.2, 3.0]) for each of the three Cognitive Reflection Test (CRT)73 questions they answered correctly.”
From Human detection of political speech deepfakes across transcripts, audio, and video (2024) · cites this paper as [73]
In the citing paper
“To assess metacognitive bias, the present study employed the Cognitive Reflection Test (CRT; Frederick, 2005), a measure of reflective reasoning and the ability to override intuitive, automatic responses.”
From “ ChatGPT can make mistakes. Check important info.” Epistemic beliefs and metacognitive accuracy in students' integration of ChatGPT content into academic writing (2025) · cites this paper as Frederick, 2005
In the citing paper
“we also included the following measures as covariates, which research has shown are associated with susceptibility to misinformation:”
From Psychological inoculation improves resilience against misinformation on social media (2022) · cites this paper as [38]
In the citing paper
“Frederick (2005) found that large numbers of highly select university students at MIT, Princeton, and Harvard were cognitive misers; they responded that the cost was 10 cents, rather than the correct answer... 5 cents.”
From The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks (2011) · cites this paper as Frederick, 2005
In the citing paper
“The Cognitive Reflection Test (CRT;Frederick, 2005) is designed to measure the tendency to override a prepotent response alternative that is incorrect and to engage in further reflection that leads to the correct response.”
From The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks (2011) · cites this paper as Frederick, 2005
In the citing paper
“Frederick (2005) observed that with as few as three items, his CRT could predict performance on measures of temporal discounting, the tendency to choose high-expected-value gambles, and framing effects.”
From The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks (2011) · cites this paper as Frederick, 2005
In the citing paper
“Frederick (2005) reported a correlation of .44 between CRT performance and SAT total scores, as well as a .43correlation between CRT scores and performance on the Wonderlic IQ test.”
From The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks (2011) · cites this paper as Frederick, 2005
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D. J., & Tversky, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609220.014 · Cited by 32,720
Anderson, N. H. (2001) · Psychology Press eBooks · doi:10.4324/9781410600004-24 · Cited by 6,939
Time Discounting and Time Preference: A Critical Review
Frederick, S., Loewenstein, G., & O’Donoghue, T. (2002) · Journal of Economic Literature · doi:10.1257/002205102320161311 · Cited by 6,106
Self-citation(1999) · Cited by 6,104
Cacioppo, J. T., & Petty, R. E. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.42.1.116 · Cited by 5,359
Individual differences in reasoning: Implications for the rationality debate?
Stanovich, K. E., & West, R. F. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00003435 · Cited by 4,481
The empirical case for two systems of reasoning.
Sloman, S. A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.1.3 · Cited by 3,942
Gender differences in risk taking: a meta-analysis
Byrnes, J. P., Miller, D. C., & Schafer, W. D. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.3.367 · Cited by 3,723
Representativeness revisited: Attribute substitution in intuitive judgment.
Kahneman, D., & Frederick, S. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.004 · Cited by 3,476
Self-citation
Research works printed but not linked: 1
- Becker Gary, 1977, American Economic Review., 67, 76
Cited by
Sorted by citations
Items 101–121 of 121
Lempert, K. M., Mechanic-Hamilton, D. J., Xie, L., Wisse, L. E. M., de Flores, R., Wang, J., Das, S. R., Yushkevich, P. A., Wolk, D. A., & Kable, J. W. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107549 · Cited by 38
Nye, M., Tessler, M. H., Tenenbaum, J. B., & Lake, B. M. (2021) · arXiv · doi:10.48550/arxiv.2107.02794 · Cited by 40
The Motivational Underpinnings of Belief in God
Laurin, K., & Kay, A. C. (2017) · Advances in Experimental Social Psychology · doi:10.1016/bs.aesp.2017.02.004 · Cited by 38
Studying and improving reasoning in humans and machines
Yax, N., Anlló, H., & Palminteri, S. (2024) · Communications Psychology · doi:10.1038/s44271-024-00091-8 · Cited by 40
Urban, M., Brom, C., Lukavský, J., Děchtěrenko, F., Hein, V., Svacha, F., Kmoníčková, P., & Urban, K. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13591 · Cited by 47
Danry, V., Pataranutaporn, P., Groh, M., & Epstein, Z. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713408 · Cited by 35
Exploring the diffusion of low-energy houses: An empirical study in the European Union
Olsthoorn, M., Schleich, J., & Faure, C. (2019) · Energy Policy · doi:10.1016/j.enpol.2019.03.043 · Cited by 32
Cognitive abilities and portfolio choice
Christelis, D., Jappelli, T., & Padula, M. (2010) · European Economic Review · doi:10.1016/j.euroecorev.2009.04.001 · Cited by 30
What Makes Everyday Scientific Reasoning So Challenging?
(2017) · Psychology of Learning and Motivation · doi:10.1016/bs.plm.2016.11.006 · Cited by 29
The link between intuitive thinking and social conservatism is stronger in WEIRD societies
Yilmaz, O., & Alper, S. (2019) · Judgment and Decision Making · doi:10.1017/s1930297500003399 · Cited by 27
Understanding and Combating Misinformation Across 16 Countries on Six Continents
Arechar, A. A., Allen, J. N. L., Berinsky, A. J., Cole, R., Epstein, Z., Garimella, K., Gully, A., Lu, J. G., Ross, R. M., Stagnaro, M., et al. (2022) · doi:10.31234/osf.io/a9frz · Cited by 25
Reynolds, C. J., Makhanova, A., Ng, B. K. L., & Conway, P. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2019.109632 · Cited by 22
Toeing the Party Lie: Ostracism Promotes Endorsement of Partisan Election Falsehoods
Garrett, R. K., Sude, D., & Riva, P. (2020) · Political Communication · doi:10.1080/10584609.2019.1666943 · Cited by 15
Psychologists update their beliefs about effect sizes after replication studies
McDiarmid, A. D., Tullett, A. M., Whitt, C. M., Vazire, S., Smaldino, P. E., & Stephens, J. E. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01220-7 · Cited by 16
Mandel, D. R., Collins, R. N., Walker, A. C., Fugelsang, J. A., & Risko, E. F. (2022) · Judgment and Decision Making · doi:10.1017/s1930297500009475 · Cited by 10
Rose, D. (2020) · Oxford Studies in Experimental Philosophy Volume 3 · doi:10.1093/oso/9780198852407.003.0007 · Cited by 13
Schincariol, A., Otgaar, H., Greene, C. M., Murphy, G., Riesthuis, P., Mangiulli, I., & Battista, F. (2024) · Memory, Mind & Media · doi:10.1017/mem.2024.14 · Cited by 8
Individual differences in intelligence and personality guide human social learning
Burtenshaw, T., Walker, B., Gignac, G., Grueter, C. C., & Fay, N. (2026) · Personality and Individual Differences · doi:10.1016/j.paid.2026.113639
Weatherhead, S., Salim, F., & Belbasis, A. (2025) · arXiv · doi:10.48550/arxiv.2510.18254 · Cited by 1
Deepfakes, Democracy, and the Ethics of Synthetic Media: A Synthesis of the SOLARIS Project
(2026) · University of Maribor Press · doi:10.18690/um.feri.2.2026
Metadata
- Authors
- Frederick, S.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Frederick, Shane
- ORCID
- Frederick, Shane
- Venue
- Journal of Economic Perspectives
- Publisher
- American Economic Association
- Published
- 2005-11-01
- Volume
- 19
- Issue
- 4
- Pages
- 25-42
- ISSN
- 0895-3309 (ISSN-L)
- OpenAlex
- W2161080627
- Cited by
- 5,256
- References
- 46
- Citations by year
- 2026: 317 · 2025: 394 · 2024: 420 · 2023: 455 · 2022: 415 · 2021: 459 · 2020: 392 · 2019: 380 · 2018: 309 · 2017: 320 · 2016: 266 · 2015: 287 · 2014: 195 · 2013: 176 · 2012: 136
- FWCI
- 22.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Economic Perspectives (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Literacy, Pension, Retirement Analysis
- Keywords
- cognitive reflection, Cognitive Reflection Test, decision-making, expected utility theory, prospect theory, time preference, risk preferences, cognitive ability, sex differences, cognitive style
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
