The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Individual Differences in Numeracy and Cognitive Reflection, with Implications for Biases and Fallacies in Probability Judgment
Open accessAbstract
Despite evidence that individual differences in numeracy affect judgment and decision making, the precise mechanisms underlying how such differences produce biases and fallacies remain unclear. Numeracy scales have been developed without sufficient theoretical grounding, and their relation to other cognitive tasks that assess numerical reasoning, such as the Cognitive Reflection Test (CRT), has been debated. In studies conducted in Brazil and in the USA, we administered an objective Numeracy Scale (NS), Subjective Numeracy Scale (SNS), and the CRT to assess whether they measured similar constructs. The Rational–Experiential Inventory, inhibition (go/no‐go task), and intelligence were also investigated. By examining factor solutions along with frequent errors for questions that loaded on each factor, we characterized different types of processing captured by different items on these scales. We also tested the predictive power of these factors to account for biases and fallacies in probability judgments. In the first study, 259 Brazilian undergraduates were tested on the conjunction and disjunction fallacies. In the second study, 190 American undergraduates responded to a ratio‐bias task. Across the different samples, the results were remarkably similar. The results indicated that the CRT is not just another numeracy scale, that objective and subjective numeracy scales do not measure an identical construct, and that different aspects of numeracy predict different biases and fallacies. Dimensions of numeracy included computational skills such as multiplying, proportional reasoning, mindless or verbatim matching, metacognitive monitoring, and understanding the gist of relative magnitude, consistent with dual‐process theories such as fuzzy‐trace theory. Copyright © 2011 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587
A perspective on judgment and choice: mapping bounded rationality.
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.697 · Cited by 5,540
Cacioppo, J. T., & Petty, R. E. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.42.1.116 · Cited by 5,359
Cognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Measurement, Design, and Analysis: An Integrated Approach.
Funk, S. G., Pedhazur, E. J., & Schmelkin, L. P. (1992) · Journal of the American Statistical Association · doi:10.2307/2290248 · Cited by 4,018
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Tversky, A., & Kahneman, D. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.293 · Cited by 3,991
Deciding advantageously before knowing the advantageous strategy
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997) · Science · doi:10.1126/science.275.5304.1293 · Cited by 3,547
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T., Griffin, D., & Kahneman, D. (2004) · The Academy of Management Review · doi:10.2307/20159081 · Cited by 3,536
Representativeness revisited: Attribute substitution in intuitive judgment.
Kahneman, D., & Frederick, S. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.004 · Cited by 3,476
Integration of the cognitive and the psychodynamic unconscious
Epstein, S. (1994) · American Psychologist · doi:10.1037/0003-066x.49.8.709 · Cited by 2,883 · cited 3×
“…individuals who score high in numeracy should be less likely to exhibit biases and fallacies because they think more rationally and objectively, so-called Type 2 thinking (Epstein, 1994; Epstein, Pacini, Denes-Raj, & Heier, 1996; Lipkus & Peters, 2009; Peters et al., 2006; Stanovich & West, 2008).”
BackgroundIndividual differences in reasoning: Implications for the rationality debate?
Stanovich, K. E., & West, R. F. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00003435 · Cited by 2,762
Individual differences in intuitive-experiential and analytical-rational thinking styles.
Epstein, S. J., Pacini, R., Denes-Raj, V., & Heier, H. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.71.2.390 · Cited by 1,925
Flawed Self-Assessment: Implications for Health, Education, and the Workplace
Dunning, D., Heath, C., & Suls, J. M. (2004) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2004.00018.x · Cited by 1,865
In two minds: dual-process accounts of reasoning
Evans, J. S. B. T. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.08.012 · Cited by 1,569
General Performance on a Numeracy Scale among Highly Educated Samples
Lipkus, I. M., Samsa, G., & Rimer, B. K. (2001) · Medical Decision Making · doi:10.1177/0272989x0102100105 · Cited by 1,497
Psychology of Reasoning: Structure and Content
Wason, P. C., & Johnson-Laird, P. N. (1972) · Medical Entomology and Zoology · Cited by 1,421
Pacini, R., & Epstein, S. J. (1999) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.76.6.972 · Cited by 1,249
Reyna, V. F., & Farley, F. (2006) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2006.00026.x · Cited by 1,244 · cited 1×
“N IH -PA Author M anuscript N IH -PA Author M anuscript these individuals has the potential to improve outcomes for the broader society (Nelson, Reyna, Fagerlin, Lipkus, & Peters, 2008; Reyna & Farley, 2006).”
BackgroundSelf-citationFuzzy-trace theory: An interim synthesis
Reyna, V. F., & Brainerd, C. J. (1995) · Learning and Individual Differences · doi:10.1016/1041-6080(95)90031-4 · Cited by 1,203
Self-citationPeters, E., Västfjäll, D., Slovic, P., Mertz, C. K., Mazzocco, K., & Dickert, S. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01720.x · Cited by 1,180
How numeracy influences risk comprehension and medical decision making.
Reyna, V. F., Nelson, W. L., Han, P. K., & Dieckmann, N. F. (2009) · Psychological Bulletin · doi:10.1037/a0017327 · Cited by 1,168
Self-citationThe Role of Numeracy in Understanding the Benefit of Screening Mammography
Schwartz, L. M., Woloshin, S., Black, W. C., & Welch, H. G. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-11-199712010-00003 · Cited by 1,130
The Development of Numerical Estimation: Evidence for Multiple Representations of Numerical Quantity
Siegler, R. S., & Opfer, J. E. (2003) · Psychological Science · doi:10.1111/1467-9280.02438 · Cited by 1,045
Garavan, H. (2002) · NeuroImage · doi:10.1006/nimg.2002.1326 · Cited by 988
Measuring Numeracy without a Math Test: Development of the Subjective Numeracy Scale
Fagerlin, A., Zikmund-Fisher, B. J., Ubel, P. A., Jankovic, A., Derry, H. A., & Smith, D. M. (2007) · Medical Decision Making · doi:10.1177/0272989x07304449 · Cited by 960
On the relative independence of thinking biases and cognitive ability
Stanovich, K. E., & West, R. F. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.4.672 · Cited by 840
Mindful Judgment and Decision Making
Weber, E. U., & Johnson, E. J. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163633 · Cited by 745
How People Make Decisions That Involve Risk: A Dual-Processes Approach
Reyna, V. F. (2004) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2004.00275.x · Cited by 636
Self-citationA theory of medical decision making and health: fuzzy trace theory
Reyna, V. F. (2008) · Medical Decision Making · doi:10.1177/0272989x08327066 · Cited by 602
Self-citationAn experimental investigation of need for cognition.
Cohen, A. R., Stotland, E., & Wolfe, D. M. (1955) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0042761 · Cited by 573
Mindless Eating: Why We Eat More Than We Think
Wansink, B. C. (2006) · Cited by 510
Cognitive abilities and behavioral biases
Oechssler, J., Roider, A., & Schmitz, P. W. (2009) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2009.04.018 · Cited by 491
Numeracy, Ratio Bias, and Denominator Neglect in Judgments of Risk and Probability
Reyna, V. F., & Brainerd, C. J. (2008) · Learning and Individual Differences · doi:10.1016/j.lindif.2007.03.011 · Cited by 481
Self-citationCokely, E. T., & Kelley, C. M. (2009) · Judgment and Decision Making · doi:10.1017/s193029750000067x · Cited by 427
How Can Decision Making Be Improved?
Milkman, K. L., Chugh, D., & Bazerman, M. H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01142.x · Cited by 425
The Development of Mathematical Skills
Donlan, C. (2021) · Psychology Press eBooks · doi:10.4324/9781315784755 · Cited by 392
(1995) · European Journal of Operational Research · doi:10.1016/0377-2217(95)90001-2 · Cited by 364
Kirkpatrick, L. A., & Epstein, S. (1992) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.63.4.534 · Cited by 334
Clinical Implications of Numeracy: Theory and Practice
Nelson, W., Reyna, V. F., Fagerlin, A., Lipkus, I., & Peters, E. (2008) · Annals of Behavioral Medicine · doi:10.1007/s12160-008-9037-8 · Cited by 329
Self-citationReyna, V. F., & Brainerd, C. J. (2007) · Learning and Individual Differences · doi:10.1016/j.lindif.2007.03.010 · Cited by 312
Self-citationDevelopment of a Short form for the Raven Advanced Progressive Matrices Test
Arthur, W., & Day, D. V. (1994) · Educational and Psychological Measurement · doi:10.1177/0013164494054002013 · Cited by 291
Evans, J. S. B. T. (2007) · Psychology Press eBooks · doi:10.4324/9780203947487 · Cited by 279
Reyna, V. F., & Lloyd, F. J. (2006) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.12.3.179 · Cited by 266
Self-citationReyna, V. F., & Kiernan, B. (1994) · Developmental Psychology · doi:10.1037//0012-1649.30.2.178 · Cited by 264
Self-citationMaking Numbers Matter: Present and Future Research in Risk Communication
Fagerlin, A., Ubel, P. A., Smith, D. M., & Zikmund-Fisher, B. J. (2007) · American Journal of Health Behavior · doi:10.5993/ajhb.31.s1.7 · Cited by 229
Understanding the Role of Numeracy in Health: Proposed Theoretical Framework and Practical Insights
Lipkus, I. M., & Peters, E. (2009) · Health Education & Behavior · doi:10.1177/1090198109341533 · Cited by 216
Memory, Development, and Rationality: An Integrative Theory of Judgment and Decision Making
Reyna, V. F., Lloyd, F. J., & Brainerd, C. J. (2003) · Emerging Perspectives on Judgment and Decision Research · doi:10.1017/cbo9780511609978.009 · Cited by 186 · cited 4×
“…intuition, the kind of common wrong answers that people give when answering CRT questions would not be called “intuitive” but rather would be called verbatim, the kind of answer that people give when they lack comprehension or do not think hard enough to answer correctly (e.g., Reyna et al., 2003).”
BackgroundMethodResultInfluentialSelf-citationNeurobiological and memory models of risky decision making in adolescents versus young adults.
Reyna, V. F., Estrada, S. M., DeMarinis, J. A., Myers, R. M., Stanisz, J. M., & Mills, B. A. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0023943 · Cited by 184
Self-citationCacioppo, J. T., Petty, R. E., & Quintanar, L. R. (1982) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.43.3.623 · Cited by 169
Correlations of cognitive reflection with judgments and choices
Campitelli, G., & Labollita, M. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500001066 · Cited by 166
Risky choice framing: Task versions and a comparison of prospect theory and fuzzy‐trace theory
Kühberger, A., & Tanner, C. (2010) · Journal of Behavioral Decision Making · doi:10.1002/bdm.656 · Cited by 162
Class inclusion, the conjunction fallacy, and other cognitive illusions
Reyna, V. F. (1991) · Developmental Review · doi:10.1016/0273-2297(91)90017-i · Cited by 118
Self-citationDevelopment of verbatim and gist memory for numbers.
Brainerd, C. J., & Gordon, L. (1994) · Developmental Psychology · doi:10.1037/0012-1649.30.2.163 · Cited by 89
Explaining Developmental Reversals in False Memory
Brainerd, C. J., & Reyna, V. F. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01919.x · Cited by 75
Self-citationExplaining “Memory Free” Reasoning
Brainerd, C. J., & Reyna, V. F. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00042.x · Cited by 75
Self-citationKlaczynski, P. A., & Cottrell, J. M. (2004) · Thinking & Reasoning · doi:10.1080/13546780442000042 · Cited by 63
Semantic coherence and fallacies in estimating joint probabilities
Wolfe, C. R., & Reyna, V. F. (2009) · Journal of Behavioral Decision Making · doi:10.1002/bdm.650 · Cited by 61
Self-citationMorsanyi, K., Primi, C., Chiesi, F., & Handley, S. J. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2009.05.001 · Cited by 49
Interference processes in fuzzy-trace theory: Aging, Alzheimer's disease, and development.
Reyna, V. F., & Mills, B. A. (2008) · American Psychological Association eBooks · doi:10.1037/11587-010 · Cited by 44
Self-citationReyna, V. F., & Mills, B. A. (2007) · Behavioral and Brain Sciences · doi:10.1017/s0140525x07001872 · Cited by 36
Self-citationDevelopment and individual differences in transitive reasoning: A fuzzy trace theory approach
Bouwmeester, S., Vermunt, J. K., & Sijtsma, K. (2006) · Developmental Review · doi:10.1016/j.dr.2006.08.001 · Cited by 33
Cited by
Ideology, motivated reasoning, and cognitive reflection
Kahan, D. M. (2013) · Judgment and Decision Making · doi:10.1017/s1930297500005271 · Cited by 1,302
Motivated numeracy and enlightened self-government
KAHAN, D. M., PETERS, E., DAWSON, E. C., & SLOVIC, P. (2017) · Behavioural Public Policy · doi:10.1017/bpp.2016.2 · Cited by 883
Assessing miserly information processing: An expansion of the Cognitive Reflection Test
Toplak, M. E., West, R. F., & Stanovich, K. E. (2014) · Thinking & Reasoning · doi:10.1080/13546783.2013.844729 · Cited by 864
Measuring Risk Literacy: The Berlin Numeracy Test
Cokely, E. T., Galesic, M., Schulz, E., Ghazal, S., & Garcia-Retamero, R. (2012) · Judgment and Decision Making · doi:10.1017/s1930297500001819 · Cited by 745
Investigating an alternate form of the cognitive reflection test
Thomson, K. S., & Oppenheimer, D. M. (2016) · Judgment and Decision Making · doi:10.1017/s1930297500007622 · Cited by 609
Metadata
- Authors
- Liberali, J. M., Reyna, V. F., Furlan, S., Stein, L. M., & Pardo, S. T.
- Venue
- Journal of Behavioral Decision Making
- Publisher
- Wiley
- Published
- 2011-08-31
- Volume
- 25
- Issue
- 4
- Pages
- 361-381
- ISSN
- 0894-3257 (ISSN-L)
- 1099-0771
- OpenAlex
- W1831156184
- Cited by
- 344
- References
- 63
- FWCI
- 8.83
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.