Cited by 76Decision-Making and Behavioral EconomicsSocial and Intergroup PsychologyEpistemology, Ethics, and Metaphysics

Dogmatism manifests in lowered information search under uncertainty

Open access
Schulz, Lion, Rollwage, Max, Dolan, Raymond J., Fleming, Stephen M.·2020·Proceedings of the National Academy of Sciences

Abstract

Significance: Dogmatic individuals are reluctant to seek out new information to refine their views, often skewing political, scientific, and religious discourse in the process. The cognitive drivers of this reluctance are poorly understood. Here, we isolate an influence of uncertainty on information search using a low-level perceptual decision-making task. We show that people with dogmatic views are both less likely to seek information before committing to a decision and to use fluctuations in uncertainty to guide their search. Our results highlight a cognitive mechanism that may contribute to the formation of dogmatic worldviews.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1073/pnas.2009641117

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • This requires developing an expertise and a well-adjusted confidence that is distinct from existing domain expertise.

    “As it stands, this requires developing an expertise and a well-adjusted confidence that is distinct from existing domain expertise, with, for example,”

    From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [156]

    The Discussion describes confidence-guided information search as metacognitive control and suggests that training could target it. It does not establish that people must develop a separate expertise or well-adjusted confidence distinct from their existing domain expertise; the training proposal is tentative. (LLM, conf=0.76)

    Experimental — accuracy not yet measured
  • Metacognitive efficiency is predictive of individual differences in dogmatism about real-world issues such as politics and climate change, with the parameters governing confidence-based control correlating with people's openness to new information.

    “Conversely, metacognitive efficiency is predictive of individual differences in dogmatism about real-world issues such as politics and climate change (Fischer et al. 2019, Rollwage et al. 2018), with the parameters governing confidence-based control correlating with people's openness to new information (Schulz et al. 2020).”

    From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Schulz et al. 2020

  • GenAI systems present usability challenges around prompting, evaluating and relying on outputs, and optimizing workflows.

    “Generative AI (GenAI) systems offer unprecedented opportunities for transforming professional and personal work, yet present challenges around prompting, evaluating and relying on outputs, and optimizing workflows.”

    From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [156]

    The Discussion addresses dogmatism, uncertainty, and information search, not the use of generative AI. Searches for GenAI prompting, output evaluation, and workflow optimization found no passage addressing those challenges in our copy. (LLM, conf=0.78)

    Experimental — accuracy not yet measured
  • User studies reveal a range of usability challenges around prompting, evaluating and relying on outputs, and deciding on an automation strategy.

    “User studies reveal a range of usability challenges around prompting [208], evaluating and relying on outputs [156], and deciding on an automation strategy: whether and how to integrate GenAI into workflows [14,154].”

    From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [156]

    Citation [156] is attached to the claim about evaluating and relying on outputs. The Materials and Methods describe judgments about flickering-dot displays, while the Results and Discussion address confidence and information-seeking decisions. Searches for output evaluation, GenAI, and automation found no passage about usability challenges in evaluating or relying on generated outputs. (LLM, conf=0.76)

    Experimental — accuracy not yet measured
  • These demands are exacerbated by GenAI's non-determinism and model flexibility in terms of (a) the wide range of explicit and implicit parameters that users can adjust, and (b) systems' ability to work with prompts at a wide range of abstraction.

    “We posit that these demands are exacerbated by GenAI's non-determinism and model flexibility (not to be confused with metacognitive flexibility) in terms of (a) the wide range of explicit and implicit parameters that users can adjust, and (b) systems' ability to work with prompts at a wide range of abstraction [156,157].”

    From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [156]

    Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 43

  1. [1]Hills T. T., The dark side of information proliferation. Perspect. Psychol. Sci. 14, 323– 330 (2019). 30496691
  2. [2]Garrett L., COVID-19: The medium is the message. Lancet 395, 942– 943 (2020). 32171075 PMC7154501
  3. [3]Lazer D. M. J., The science of fake news. Science 359, 1094– 1096 (2018). 29590025
  4. [5]Schulz E., Gershman S. J., The algorithmic architecture of exploration in the human brain. Curr. Opin. Neurobiol. 55, 7– 14 (2019). 30529148
  5. [6]Sharot T., Sunstein C. R., How people decide what they want to know. Nat. Hum. Behav. 4, 14– 19 (2020). 31932690
  6. [8]Hills T. T., Todd P. M., Lazer D., Redish A. D., Couzin I. D.; Cognitive Search Research Group, Exploration versus exploitation in space, mind, and society. Trends Cogn. Sci. 19, 46– 54 (2015). 25487706 PMC4410143
  7. [9]Gesiarz F., Cahill D., Sharot T., Evidence accumulation is biased by motivation: A computational account. PLOS Comput. Biol. 15, e1007089 (2019). 31246955 PMC6597032
  8. [10]Charpentier C. J., Bromberg-Martin E. S., Sharot T., Valuation of knowledge and ignorance in mesolimbic reward circuitry. Proc. Natl. Acad. Sci. U.S.A. 115, E7255– E7264 (2018). 29954865 PMC6077743
  9. [11]Jonas E., Schulz-Hardt S., Frey D., Thelen N., Confirmation bias in sequential information search after preliminary decisions: An expansion of dissonance theoretical research on selective exposure to information. J. Pers. Soc. Psychol. 80, 557– 571 (2001). 11316221
  10. [12]Bakshy E., Messing S., Adamic L. A., Political science. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 1130– 1132 (2015). 25953820
  11. [13]Schmidt A. L., Anatomy of news consumption on Facebook. Proc. Natl. Acad. Sci. U.S.A. 114, 3035– 3039 (2017). 28265082 PMC5373354
  12. [14]Hart W., Feeling validated versus being correct: A meta-analysis of selective exposure to information. Psychol. Bull. 135, 555– 588 (2009). 19586162 PMC4797953
  13. [15]Schwartenbeck P., Computational mechanisms of curiosity and goal-directed exploration. eLife 8, e41703 (2019). 31074743 PMC6510535
  14. [17]Desender K., Boldt A., Yeung N., Subjective confidence predicts information seeking in decision making. Psychol. Sci. 29, 761– 778 (2018). 29608411
  15. [18]Boldt A., Blundell C., De Martino B., Confidence modulates exploration and exploitation in value-based learning. Neurosci. Conscious. 2019, niz004 (2019). 31086679 PMC6505439
  16. [19]Newman T. P., Nisbet E. C., Nisbet M. C., Climate change, cultural cognition, and media effects: Worldviews drive news selectivity, biased processing, and polarized attitudes. Public Underst. Sci. 27, 985– 1002 (2018). 30253695
  17. [21]Altemeyer B., Dogmatic behavior among students: Testing a new measure of dogmatism. J. Soc. Psychol. 142, 713– 721 (2002). 12450346
  18. [22]Toner K., Leary M. R., Asher M. W., Jongman-Sereno K. P., Feeling superior is a bipartisan issue: Extremity (not direction) of political views predicts perceived belief superiority. Psychol. Sci. 24, 2454– 2462 (2013). 24096379
  19. [23]Rokeach M., The nature and meaning of dogmatism. Psychol. Rev. 61, 194– 204 (1954). 13167246
  20. [24]Rollwage M., Dolan R. J., Fleming S. M., Metacognitive failure as a feature of those holding radical beliefs. Curr. Biol. 28, 4014– 4021.e8 (2018). 30562522 PMC6303190
  21. [26]Fast E., Horvitz E., “ Identifying dogmatism in social media: Signals and models” in Proceedings of 2016 Conference Empirical Methods in Natural Language Processing, Su J., Duh K., Carreras X., Eds. (Association for Computational Linguistics, Stroudsburg, PA, 2016), pp. 690– 699.
  22. [27]Long B. H., Ziller R. C., Dogmatism and predecisional information search. J. Appl. Psychol. 49, 376– 378 (1965). 5828989
  23. [30]Wintrobe R., Rational Extremism: The Political Economy of Radicalism (Cambridge University Press, 2006).
  24. [31]Braver S. L., Thoemmes F. J., Rosenthal R., Continuously cumulating meta-analysis and replicability. Perspect. Psychol. Sci. 9, 333– 342 (2014). 26173268
  25. [32]Moutoussis M., Hopkins A. K., Dolan R. J., Hypotheses about the relationship of cognition with psychopathology should be tested by embedding them into empirical priors. Front. Psychol. 9, 2504 (2018). 30618935 PMC6295556
  26. [35]Greenberg J., Jonas E., Psychological motives and political orientation–The left, the right, and the rigid: Comment on Jost et al. (2003). Psychol. Bull. 129, 376– 382, discussion 383–393 (2003). 12784935
  27. [36]Fiagbenu M. E., Proch J., Kessler T., Of deadly beans and risky stocks: Political ideology and attitude formation via exploration depend on the nature of the attitude stimuli. Br. J. Psychol., 10.1111/bjop.12430 (2019). 31724742 · DOI
  28. [38]Zmigrod L., Rentfrow P. J., Robbins T. W., Cognitive underpinnings of nationalistic ideology in the context of Brexit. Proc. Natl. Acad. Sci. U.S.A. 115, E4532– E4540 (2018). 29674447 PMC5948950
  29. [39]Zmigrod L., Rentfrow P. J., Robbins T. W., The partisan mind: Is extreme political partisanship related to cognitive inflexibility? J. Exp. Psychol. Gen. 149, 407– 418 (2020). 31380695
  30. [43]Desender K., Boldt A., Verguts T., Donner T. H., Confidence predicts speed-accuracy tradeoff for subsequent decisions. eLife 8, e43499 (2019). 31429827 PMC6711665
  31. [44]Fleming S. M., Weil R. S., Nagy Z., Dolan R. J., Rees G., Relating introspective accuracy to individual differences in brain structure. Science 329, 1541– 1543 (2010). 20847276 PMC3173849
  32. [45]Vaccaro A. G., Fleming S. M., Thinking about thinking: A coordinate-based meta-analysis of neuroimaging studies of metacognitive judgements. Brain Neurosci. Adv. 2, 2398212818810591 (2018). 30542659 PMC6238228
  33. [46]Rouault M., Seow T., Gillan C. M., Fleming S. M., Psychiatric symptom dimensions are associated with dissociable shifts in metacognition but not task performance. Biol. Psychiatry 84, 443– 451 (2018). 29458997 PMC6117452
  34. [47]Fleming S. M., Daw N. D., Self-evaluation of decision-making: A general Bayesian framework for metacognitive computation. Psychol. Rev. 124, 91– 114 (2017). 28004960 PMC5178868
  35. [50]Schulz E., Structured, uncertainty-driven exploration in real-world consumer choice. Proc. Natl. Acad. Sci. U.S.A. 116, 13903– 13908 (2019). 31235598 PMC6628813
  36. [54]Buhrmester M., Kwang T., Gosling S. D., Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality data? Perspect. Psychol. Sci. 6, 3– 5 (2011). 26162106
  37. [56]Chandler J., Mueller P., Paolacci G., Nonnaïveté among Amazon mechanical turk workers: Consequences and solutions for behavioral researchers. Behav. Res. Methods 46, 112– 130 (2014). 23835650
  38. [57]Malka A., Lelkes Y., Holzer N., “ Rethinking the rigidity of the right model: Three suboptimal methodological practices and their implications” in Frontiers of Social Psychology: Politics of Social Psychology, Crawford J. T., Jussim L., Eds. (Psychology Press, 2017), pp. 116– 135.
  39. [58]Everett J. A., The 12 item social and economic conservatism scale (SECS). PLoS One 8, e82131 (2013). 24349200 PMC3859575
  40. [62]de Leeuw J. R., jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behav. Res. Methods 47, 1– 12 (2015). 24683129
  41. [63]Anwyl-Irvine A. L., Massonnié J., Flitton A., Kirkham N., Evershed J. K., Gorilla in our midst: An online behavioral experiment builder. Behav. Res. Methods 52, 388– 407 (2020). 31016684 PMC7005094
  42. [65]Singmann H., Kellen D., “ An introduction to mixed models for experimental psychology” in New Methods in Cognitive Psychology, Spieler D. H., Schumacher E., Eds. (Psychology Press, London, 2019), pp. 4– 31.
  43. [68]Efron B., Large-Scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction (Cambridge University Press, 2012), vol. 1.

Cited by

Sorted by citations

Authors
Schulz, L., Rollwage, M., Dolan, R. J., & Fleming, S. M.
Affiliations
Wellcome Centre for Human Neuroimaging (GB)
Corresponding author
  • Schulz, Lion
  • Fleming, Stephen M.
Venue
Proceedings of the National Academy of Sciences
Published
2020-11-19
Volume
117
Issue
49
Pages
31527-31534
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W3103896643
Cited by
76
References
13
Citations by year
2026: 10 · 2025: 18 · 2024: 9 · 2023: 17 · 2022: 17 · 2021: 4 · 2020: 1
FWCI
7.18
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • MPG.PuRe (Max Planck Society) (submittedVersion)
Funders
Wellcome (203147/Z/16/Z, 206648/Z/17/Z)
Topics
  • Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
  • Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
  • Social Sciences › Arts and Humanities › Philosophy › Epistemology, Ethics, and Metaphysics
Keywords
dogmatism, information search, perceptual decision making, belief updating, uncertainty, confidence, belief accuracy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review