Neural Mechanisms of Updating under Reducible and Irreducible Uncertainty
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Adaptive decision making depends on an agent9s ability to use environmental signals to reduce uncertainty. However, because of multiple types of uncertainty, agents must take into account not only the extent to which signals violate prior expectations but also whether uncertainty can be reduced in the first place. Here we studied how human brains of both sexes respond to signals under conditions of reducible and irreducible uncertainty. We show behaviorally that subjects9 value updating was sensitive to the reducibility of uncertainty, and could be quantitatively characterized by a Bayesian model where agents ignore expectancy violations that do not update beliefs or values. Using fMRI, we found that neural processes underlying belief and value updating were separable from responses to expectancy violation, and that reducibility of uncertainty in value modulated connections from belief-updating regions to value-updating regions. Together, these results provide insights into how agents use knowledge about uncertainty to make better decisions while ignoring mere expectancy violation. SIGNIFICANCE STATEMENT To make good decisions, a person must observe the environment carefully, and use these observations to reduce uncertainty about consequences of actions. Importantly, uncertainty should not be reduced purely based on how surprising the observations are, particularly because in some cases uncertainty is not reducible. Here we show that the human brain indeed reduces uncertainty adaptively by taking into account the nature of uncertainty and ignoring mere surprise. Behaviorally, we show that human subjects reduce uncertainty in a quasioptimal Bayesian manner. Using fMRI, we characterize brain regions that may be involved in uncertainty reduction, as well as the network they constitute, and dissociate them from brain regions that respond to mere surprise.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The reorienting system of the human brain: from environment to theory of mind
Corbetta, M., Patel, G., & Shulman, G. L. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.017 · Cited by 3,889 · cited 2×
“This localization of expectancy violation is consistent with previous reports that the AI responds to salient events in various domains (Corbetta et al., 2008; Singer et al., 2009; Menon and Uddin, 2010).”
ResultPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 1×
“Distinction between uncertainty reduction and expectancy violation is not clear in some traditionally prevalent frameworks, such as RL and Pearce-Hall (Rescorla and Wagner, 1972; Pearce and Hall, 1980; Sutton and Barto, 1998; Pearce and Bouton, 2001; Roesch et al., 2012).”
BackgroundCircular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927 · cited 1×
“These regions have been long associated with value-related processing, such as valuation of choices or RL (Bartra et al., 2013).”
BackgroundRecent developments in modeling preferences: Uncertainty and ambiguity
Camerer, C., & Weber, M. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122575 · Cited by 1,795 · cited 3×
“Second, decision theory has long emphasized a distinction between reducible and irreducible uncertainty, often referred to as ambiguity and risk respectively (Keynes, 1921; Knight, 1921; Ellsberg, 1961; Camerer and Weber, 1992).”
BackgroundMethodUncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 1×
“It is an open question how agents estimate the reducibility of uncertainty, particularly in nonstationary environments (Yu and Dayan, 2005; Behrens et al., 2007; Payzan-LeNestour and Bossaerts, 2011).”
BackgroundBayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
Cited by
Levy, I., & Schiller, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.11.007 · Cited by 95
Transdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty
Sandhu, T. R., Xiao, B., & Lawson, R. P. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105123 · Cited by 51
Noradrenergic and Cholinergic Modulation of Belief Updating
Jepma, M., Brown, S. B. R. E., Murphy, P. R., Koelewijn, S. C., de Vries, B., van den Maagdenberg, A. M., & Nieuwenhuis, S. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01317 · Cited by 39
Neural and psychophysiological markers of intolerance of uncertainty.
Morriss, J., Abend, R., Zika, O., Bradford, D. E., & Mertens, G. (2023) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2023.01.003 · Cited by 38
Metadata
- Authors
- Kobayashi, K., & Hsu, M.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2017-06-16
- Volume
- 37
- Issue
- 29
- Pages
- 6972-6982
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2625431615
- Cited by
- 52
- References
- 28
- FWCI
- 2.15
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Neural Mechanisms of Updating under Reducible and Irreducible Uncertainty. https://app.cochat.ai/papers/10.1523/jneurosci.0535-17.2017
- The paper
- Kobayashi, K., & Hsu, M. (2017). Neural Mechanisms of Updating under Reducible and Irreducible Uncertainty. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.0535-17.2017
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.