A preregistered replication of motivated numeracy
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Motivated numeracy refers to the idea that people with high reasoning capacity will use that capacity selectively to process information in a manner that protects their own valued beliefs. This concept was introduced in a now classic article by Kahan, Peters, Dawson, & Slovic [2017, Behavioral Public Policy 1, 54-86], who used numeracy to index reasoning capacity, and demonstrated that the tendency to engage in ideologically congruent interpretation of facts increased substantially with people's numeracy. Despite the importance of this finding, both from a theoretical and practical point of view, there is yet no consensus in the literature about the factual strength of motivated numeracy. We therefore conducted a large-scale replication of Kahan, Peters, Dawson, and Slovic (2017), using a pre-specified analysis plan with strict evaluation criteria. We did not find good evidence for motivated numeracy; there are distinct patterns in our data at odds with the core predictions of the theory, most notably (i) there is ideologically congruent responding that is not moderated by numeracy, and (ii) when there is moderation, ideologically congruent responding occurs only at the highest levels of numeracy. Our findings suggest that the cumulative evidence for motivated numeracy is weaker than previously thought, and that caution is warranted when this feature of human cognition is leveraged to improve science communication on contested topics such as climate change or immigration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Cognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Motivated Skepticism in the Evaluation of Political Beliefs
Taber, C. S., & Lodge, M. (2006) · American Journal of Political Science · doi:10.1111/j.1540-5907.2006.00214.x · Cited by 4,344
Pennycook, G., & Rand, D. G. (2019) · Cognition · doi:10.1016/j.cognition.2018.06.011 · Cited by 2,022
Cultural cognition of scientific consensus.
Kahan, D. M., Jenkins‐Smith, H., & Braman, D. (2011) · Journal of Risk Research · doi:10.1080/13669877.2010.511246 · Cited by 1,686
Susceptibility to misinformation about COVID-19 around the world
Roozenbeek, J., Schneider, C. R., Dryhurst, S., Kerr, J., Freeman, A. L. J., Recchia, G., van der Bles, A. M., & van der Linden, S. (2020) · Royal Society Open Science · doi:10.1098/rsos.201199 · Cited by 1,447
Ideology, motivated reasoning, and cognitive reflection
Kahan, D. M. (2013) · Judgment and Decision Making · doi:10.1017/s1930297500005271 · Cited by 1,302 · cited 1×
“…where individuals use their intelligence and reasoning skills selectively when assessing new information, seeking support for their own valued beliefs (Kahan, 2013; Kahan et al., 2012; Kahan et al., 2017; Kahan, Jenkins-Smith, & Braman, 2011; Landrum, Lull, Akin, Hasell, & Jamieson, 2017).”
BackgroundCoppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
Motivated numeracy and enlightened self-government
KAHAN, D. M., PETERS, E., DAWSON, E. C., & SLOVIC, P. (2017) · Behavioural Public Policy · doi:10.1017/bpp.2016.2 · Cited by 883 · cited 9×
“Our primary basis for evaluating the replicability of the motivated numeracy-effect in Kahan et al. (2017) is the predicted probabilities plotted in Fig.”
BackgroundMethodResultInfluentialSmall Telescopes: Detectability and the Evaluation of Replication Results
Simonsohn, U. (2015) · Psychological Science · doi:10.1177/0956797614567341 · Cited by 742
Cited by
Misinformation: susceptibility, spread, and interventions to immunize the public
van der Linden, S. (2022) · Nature Medicine · doi:10.1038/s41591-022-01713-6 · Cited by 570
Partisan Bias in Political Judgment
Ditto, P. H., Celniker, J. B., Siddiqi, S. S., Güngör, M., & Relihan, D. P. (2025) · Annual Review of Psychology · doi:10.1146/annurev-psych-030424-122723 · Cited by 25
A motivational systems approach to investigating opinions on climate change
Molden, D. C., Bayes, R., & Druckman, J. N. (2022) · Thinking & Reasoning · doi:10.1080/13546783.2021.1982003 · Cited by 12
Chen, L., Benjamin, R., Guo, Y., Lai, A., & Heine, S. J. (2023) · Research Square · doi:10.21203/rs.3.rs-1254756/v1 · Cited by 5
Metadata
- Authors
- Persson, E., Andersson, D., Koppel, L., Västfjäll, D., & Tinghög, G.
- Venue
- Cognition
- Publisher
- Elsevier BV
- Published
- 2021-09
- Volume
- 214
- Pages
- 104768
- ISSN
- 0010-0277 (ISSN-L)
- OpenAlex
- W3165665947
- Cited by
- 51
- References
- 17
- FWCI
- 6.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A preregistered replication of motivated numeracy. https://app.cochat.ai/papers/10.1016/j.cognition.2021.104768
- The paper
- Persson, E., Andersson, D., Koppel, L., Västfjäll, D., & Tinghög, G. (2021). A preregistered replication of motivated numeracy. Cognition. https://doi.org/10.1016/j.cognition.2021.104768
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.