The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Bayesian or biased? Analytic thinking and political belief updating
Open accessAbstract
A surprising finding from U.S. opinion surveys is that political disagreements tend to be greatest among the most cognitively sophisticated opposing partisans. Recent experiments suggest a hypothesis that could explain this pattern: cognitive sophistication magnifies politically biased processing of new information. However, the designs of these experiments tend to contain several limitations that complicate their support for this hypothesis. In particular, they tend to (i) focus on people's worldviews and political identities, at the expense of their other, more specific prior beliefs, (ii) lack direct comparison with a politically unbiased benchmark, and (iii) focus on people's judgments of new information, rather than on their posterior beliefs following exposure to the information. We report two studies designed to address these limitations. In our design, U.S. subjects received noisy but informative signals about the truth or falsity of partisan political questions, and we measured their prior and posterior beliefs, and cognitive sophistication, operationalized as analytic thinking inferred via performance on the Cognitive Reflection Test. We compared subjects' posterior beliefs to an unbiased Bayesian benchmark. We found little evidence that analytic thinking magnified politically biased deviations from the benchmark. In contrast, we found consistent evidence that greater analytic thinking was associated with posterior beliefs closer to the benchmark. Together, these results are inconsistent with the hypothesis that cognitive sophistication magnifies politically biased processing. We discuss differences between our design and prior work that can inform future tests of this hypothesis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and that individuals act as Bayesian learners who incorporate new information into their evaluations of the political and social environment25,26.”
From Factual knowledge can reduce attitude polarization (2025) · cites this paper as [26]
In the citing paper
“However, few (if any) studies actually connect the dots (see, for example, critiques of existing research on motivated political reasoning103,300,301).”
From Cognitive–motivational mechanisms of political polarization in social-communicative contexts (2022) · cites this paper as [300]
Citations
Cites
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
Cognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Motivated Skepticism in the Evaluation of Political Beliefs
Taber, C. S., & Lodge, M. (2006) · American Journal of Political Science · doi:10.1111/j.1540-5907.2006.00214.x · Cited by 4,344
When Corrections Fail: The Persistence of Political Misperceptions
Nyhan, B., & Reifler, J. (2010) · Political Behavior · doi:10.1007/s11109-010-9112-2 · Cited by 3,173
The Polarizing Impact of Science Literacy and Numeracy on Perceived Climate Change Risks
Braman, D., Kahan, D. M., Peters, E. M., Wittlin, M., Slovic, P., Ouellette, L. L., & Mandel, G. N. (2012) · Scholarly Commons - George Washington University Law School (George Washington University) · Cited by 2,421
McCright, A. M., & Dunlap, R. E. (2011) · The Sociological Quarterly · doi:10.1111/j.1533-8525.2011.01198.x · Cited by 2,340
Pennycook, G., & Rand, D. G. (2019) · Cognition · doi:10.1016/j.cognition.2018.06.011 · Cited by 2,022
Self-citationEmerging Trends in the Social and Behavioral Sciences
Pecher, D., Zeelenberg, R., Scott, R., & Kosslyn, S. M. (2015) · Wiley eBooks · doi:10.1002/9781118900772 · Cited by 1,529
Beyond the Running Tally: Partisan Bias in Political Perceptions
Bartels, L. M. (2002) · Political Behavior · doi:10.1023/a:1021226224601 · Cited by 1,468
Ideology, motivated reasoning, and cognitive reflection
Kahan, D. M. (2013) · Judgment and Decision Making · doi:10.1017/s1930297500005271 · Cited by 1,302
The Generalizability of Survey Experiments
Mullinix, K. J., Leeper, T. J., Druckman, J. N., & Jeremy Freese, A. (2015) · Journal of Experimental Political Science · doi:10.1017/xps.2015.19 · Cited by 1,248
Judd, C. M., Westfall, J., & Kenny, D. A. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0028347 · Cited by 1,236
Motivated inference: Self‐serving generation and evaluation of causal theories
Kunda, Z. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.53.4.636 · Cited by 1,059
The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks
Toplak, M. E., West, R. F., & Stanovich, K. E. (2011) · Memory & Cognition · doi:10.3758/s13421-011-0104-1 · Cited by 1,047
Motivated numeracy and enlightened self-government
KAHAN, D. M., PETERS, E., DAWSON, E. C., & SLOVIC, P. (2017) · Behavioural Public Policy · doi:10.1017/bpp.2016.2 · Cited by 883
Conservatism in a simple probability inference task.
Phillips, L. D., & Edwards, W. (1966) · Journal of Experimental Psychology · doi:10.1037/h0023653 · Cited by 880
On the conflict between logic and belief in syllogistic reasoning
Evans, J. S. B. T., Barston, J. L., & Pollard, P. (1983) · Memory & Cognition · doi:10.3758/bf03196976 · Cited by 841
Climate‐Science Communication and the Measurement Problem
Kahan, D. M. (2015) · Political Psychology · doi:10.1111/pops.12244 · Cited by 750
The evidence for motivated reasoning in climate change preference formation
Druckman, J. N., & McGrath, M. C. (2019) · Nature Climate Change · doi:10.1038/s41558-018-0360-1 · Cited by 733
Are samples drawn from Mechanical Turk valid for research on political ideology?
Clifford, S., Jewell, R., & Waggoner, P. (2015) · Research & Politics · doi:10.1177/2053168015622072 · Cited by 714
The Good News-Bad News Effect: Asymmetric Processing of Objective Information about Yourself
Eil, D., & Rao, J. M. (2011) · American Economic Journal Microeconomics · doi:10.1257/mic.3.2.114 · Cited by 681
Investigating an alternate form of the cognitive reflection test
Thomson, K. S., & Oppenheimer, D. M. (2016) · Judgment and Decision Making · doi:10.1017/s1930297500007622 · Cited by 612
Drummond, C., & Fischhoff, B. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1704882114 · Cited by 607
Malka, A., Krosnick, J. A., & Langer, G. E. (2009) · Risk Analysis · doi:10.1111/j.1539-6924.2009.01220.x · Cited by 560
Divine intuition: Cognitive style influences belief in God.
Shenhav, A., Rand, D. G., & Greene, J. D. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0025391 · Cited by 557
Self-citationBrauer, M., & Curtin, J. J. (2018) · Psychological Methods · doi:10.1037/met0000159 · Cited by 555
The Motivated Processing of Political Arguments
Taber, C. S., Cann, D. M., & Kucsova, S. (2009) · Political Behavior · doi:10.1007/s11109-008-9075-8 · Cited by 465
Generalizability of heterogeneous treatment effect estimates across samples
Coppock, A., Leeper, T. J., & Mullinix, K. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1808083115 · Cited by 457
Bayesian just-so stories in psychology and neuroscience.
Bowers, J. S., & Davis, C. J. (2012) · Psychological Bulletin · doi:10.1037/a0026450 · Cited by 436
Everyday Consequences of Analytic Thinking
Pennycook, G., Fugelsang, J. A., & Koehler, D. J. (2015) · Current Directions in Psychological Science · doi:10.1177/0963721415604610 · Cited by 384
Self-citationThe Influence of Prior Beliefs on Scientific Judgments of Evidence Quality
Koehler, J. J. (1993) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1993.1044 · Cited by 357
Kahan, D. M. (2016) · Emerging Trends in the Social and Behavioral Sciences · doi:10.1002/9781118900772.etrds0417 · Cited by 341
On belief bias in syllogistic reasoning.
Klauer, K. C., Musch, J., & Naumer, B. (2000) · Psychological Review · doi:10.1037/0033-295x.107.4.852 · Cited by 296
Is the cognitive reflection test a measure of both reflection and intuition?
Pennycook, G., Cheyne, J. A., Koehler, D. J., & Fugelsang, J. A. (2015) · Behavior Research Methods · doi:10.3758/s13428-015-0576-1 · Cited by 281
Self-citationScience Curiosity and Political Information Processing
Kahan, D. M., Landrum, A. R., Carpenter, K. L., Helft, L., & Jamieson, K. H. (2017) · Political Psychology · doi:10.1111/pops.12396 · Cited by 279
Deep thoughts and shallow frames: on the susceptibility to framing effects
LeBoeuf, R. A., & Shafir, E. B. (2003) · Journal of Behavioral Decision Making · doi:10.1002/bdm.433 · Cited by 242
Trust in Scientists on Climate Change and Vaccines
Hamilton, L. C., Hartter, J., & Saito, K. (2015) · SAGE Open · doi:10.1177/2158244015602752 · Cited by 241
Partisan Bias and the Bayesian Ideal in the Study of Public Opinion
Bullock, J. G. (2009) · The Journal of Politics · doi:10.1017/s0022381609090914 · Cited by 240
The belief-bias effect in the production and evaluation of logical conclusions
Markovits, H., & Nantel, G. (1989) · Memory & Cognition · doi:10.3758/bf03199552 · Cited by 214
False Equivalence: Are Liberals and Conservatives in the United States Equally Biased?
Baron, J., & Jost, J. T. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691618788876 · Cited by 213
Good news and bad news are still news: experimental evidence on belief updating
Coutts, A. (2018) · Experimental Economics · doi:10.1007/s10683-018-9572-5 · Cited by 208
Tappin, B. M., Pennycook, G., & Rand, D. G. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.01.003 · Cited by 203
Self-citationSample size and the revision of subjective probabilities.
Peterson, C. R., Schneider, R. J., & Miller, A. J. (1965) · Journal of Experimental Psychology · doi:10.1037/h0021720 · Cited by 199
How Gullible are We? A Review of the Evidence from Psychology and Social Science
Mercier, H. (2017) · Review of General Psychology · doi:10.1037/gpr0000111 · Cited by 194
Sensitivity of subjective probability revision.
Peterson, C. R., & Miller, A. J. (1965) · Journal of Experimental Psychology · doi:10.1037/h0022023 · Cited by 181
Learning Together Slowly: Bayesian Learning about Political Facts
Hill, S. J. (2017) · The Journal of Politics · doi:10.1086/692739 · Cited by 159
Rethinking the link between cognitive sophistication and politically motivated reasoning.
Tappin, B. M., Pennycook, G., & Rand, D. G. (2021) · Journal of Experimental Psychology: General · doi:10.1037/xge0000974 · Cited by 154
Self-citationWhat Does It Mean to be Biased
Hahn, U., & Harris, A. J. L. (2014) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-800283-4.00002-2 · Cited by 150
Scientific agreement can neutralize politicization of facts
Linden, S. V. D., Leiserowitz, A., & Maibach, E. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0259-2 · Cited by 136
A four-party view of US environmental concern
Hamilton, L. C., & Saito, K. (2014) · Environmental Politics · doi:10.1080/09644016.2014.976485 · Cited by 134
Cognitive Reflection is a Stable Trait
Stagnaro, M. N., Pennycook, G., & Rand, D. G. (2018) · Judgment and Decision Making · doi:10.1017/s1930297500007695 · Cited by 116
Self-citationA pessimistic view of optimistic belief updating
Shah, P., Harris, A. J. L., Bird, G., Catmur, C., & Hahn, U. (2016) · Cognitive Psychology · doi:10.1016/j.cogpsych.2016.05.004 · Cited by 111
The Determinants and Consequences of Accurate Beliefs About Childhood Vaccinations
Joslyn, M. R., & Sylvester, S. M. (2017) · American Politics Research · doi:10.1177/1532673x17745342 · Cited by 110
A Note on the Perverse Effects of Actively Open-Minded Thinking on Climate-change Polarization
Kahan, D. M., & Corbin, J. C. (2016) · Research & Politics · doi:10.1177/2053168016676705 · Cited by 110
Who Knows Best? Education, Partisanship, and Contested Facts
Joslyn, M. R., & Haider‐Markel, D. P. (2014) · Politics & Policy · doi:10.1111/polp.12098 · Cited by 100
Motivated Reasoning in the Perceived Credibility of Public Opinion Polls
Kuru, O., Josh Pasek, B., & Traugott, M. W. (2017) · Public Opinion Quarterly · doi:10.1093/poq/nfx018 · Cited by 96
The need to control for regression to the mean in social psychology studies
Yu, R., & Chen, L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01574 · Cited by 92
How People Update Beliefs about Climate Change: Good News and Bad NewsPreprint
Sunstein, C. R., Bobadilla-Suarez, S., Lazzaro, S. C., & Sharot, T. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2821919 · Cited by 85
I’ll see it when i believe it: motivated numeracy in perceptions of climate change risk
Nurse, M. S., & Grant, W. J. (2020) · Environmental Communication · doi:10.1080/17524032.2019.1618364 · Cited by 83
Biased belief in the Bayesian brain: A deeper look at the evidence
Tappin, B. M., & Gadsby, S. (2019) · Consciousness and Cognition · doi:10.1016/j.concog.2019.01.006 · Cited by 73
Self-citationHierarchical Bayesian models of delusion
Williams, D. (2018) · Consciousness and Cognition · doi:10.1016/j.concog.2018.03.003 · Cited by 67
Anglin, S. M. (2019) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2019.02.004 · Cited by 61
Assessing the validity of inferences from scores on the cognitive reflection test
Blacksmith, N., Yang, Y., Behrend, T. S., & Ruark, G. A. (2019) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2133 · Cited by 54
Rethinking the link between cognitive sophistication and politically motivated reasoningPreprint
Tappin, B. M., Pennycook, G., & Rand, D. G. (2018) · doi:10.31234/osf.io/yuzfj · Cited by 41
Self-citationMotivated reasoning when assessing the effects of refugee intake
Lind, T., Erlandsson, A., Västfjäll, D., & Tinghög, G. (2018) · Behavioural Public Policy · doi:10.1017/bpp.2018.41 · Cited by 36
How People Update Beliefs about Climate Change: Good News and Bad NewsPreprint
Sunstein, C. R., Bobadilla-Suarez, S., Lazzaro, S. C., & Sharot, T. (2018) · doi:10.31228/osf.io/qn5wp · Cited by 36
MOTIVATED SKEPTICISM OR INEVITABLE CONVICTION? DOGMATISM AND THE STUDY OF POLITICS
Friedman, J. A. (2012) · Critical Review · doi:10.1080/08913811.2012.719663 · Cited by 30
The social functions of explicit coherence evaluation
Mercier, H. (2012) · Mind & Society · doi:10.1007/s11299-011-0095-4 · Cited by 30
Sumner, C., Scofield, J. E., Buchanan, E. M., Evans, M.-R., & Shearing, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1077354 · Cited by 25
Sumner, C., Scofield, J. E., Buchanan, E. M., et al. (2018) · doi:10.31219/osf.io/n5r67 · Cited by 13
How many laypeople holding a popular opinion are needed to counter an expert opinion?
Hornikx, J., Harris, A. J. L., & Boekema, J. (2017) · Thinking & Reasoning · doi:10.1080/13546783.2017.1378721 · Cited by 6
Research works printed but not linked: 2
- Leeper, T. J., Arnold, J., & Arel-Bundock, V. (2018). Marginal Effects for Model Objects (margins). https://cran.r-project.org/web/packages/margins/margins.pdf. · DOI
- Pew Research Center. (2019, January 24). Public's 2019 Priorities: Economy, Health Care, Education and Security All Near Top of List | Pew Research Center. https://www.people-press.org/2019/01/24/publics-2019-priorities-economy-health-care-education-and-security-all-near-top-of-list/.
Cited by
Sorted by citations
Pennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360
Self-citationCognitive–motivational mechanisms of political polarization in social-communicative contexts
Jost, J. T., Baldassarri, D. S., & Druckman, J. N. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00093-5 · Cited by 276
Pennycook, G., McPhetres, J., Bagó, B., & Rand, D. G. (2021) · Personality and Social Psychology Bulletin · doi:10.1177/01461672211023652 · Cited by 335
Self-citationTappin, B. M., Pennycook, G., & Rand, D. G. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.01.003 · Cited by 203
Self-citationA Framework for the Study of Persuasion
Druckman, J. N. (2022) · Annual Review of Political Science · doi:10.1146/annurev-polisci-051120-110428 · Cited by 126
Metadata
- Authors
- Tappin, B. M., Pennycook, G., & Rand, D. G.
- Affiliations
- Massachusetts Institute of Technology (US)
- University of Regina (CA)
- Corresponding author
- Tappin, Ben M.
- Venue
- Cognition
- Publisher
- Elsevier BV
- Published
- 2020-11
- Volume
- 204
- Pages
- 104375
- ISSN
- 0010-0277 (ISSN-L)
- OpenAlex
- W3034853018
- Cited by
- 127
- References
- 70
- Citations by year
- 2026: 10 · 2025: 23 · 2024: 32 · 2023: 20 · 2022: 25 · 2021: 13 · 2020: 4
- FWCI
- 11.57
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Cognition (publishedVersion)
- PubMed (publishedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc-nd)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- John Templeton Foundation (61061)
- Economic and Social Research Council (ES/J500148/1)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Keywords
- analytical thinking, cognitive sophistication, Bayesian updating, cognitive reflection, prior beliefs, posterior beliefs, noisy signals, political bias, partisanship
- MeSH terms
- Bayes Theorem, Humans, Judgment, Neuropsychological Tests, Thinking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review