Knowing how much you don't know: a neural organization of uncertainty estimates
Open accessThe DOI matches its Crossref record; 145 of the 146 references it cites were found in a registry or an index.
Abstract
How we estimate uncertainty is important in decision neuroscience and has wide-ranging implications in basic and clinical neuroscience, from computational models of optimality to ideas on psychopathological disorders including anxiety, depression and schizophrenia. Empirical research in neuroscience, which has been based on divergent theoretical assumptions, has focused on the fundamental question of how uncertainty is encoded in the brain and how it influences behaviour. Here, we integrate several theoretical concepts about uncertainty into a decision-making framework. We conclude that the currently available evidence indicates that distinct neural encoding (including summary statistic-type representations) of uncertainty occurs in distinct neural systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Our notion of expected uncertainty is also related to reward variance, risk, or outcome uncertainty,10,11,67–69 but with respect to an entire behavioral policy as opposed to a specific action.”
From Serotonin neurons modulate learning rate through uncertainty (2022) · cites this paper as [67]
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
Knight, F. H. (1921) · Cited by 16,535
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
“Risk, Ambiguity, and the Savage Axioms.”
Ellsberg, D. (1961) · The Quarterly Journal of Economics · doi:10.2307/1884324 · Cited by 7,891
(2001) · Empirical Direction in Design and Analysis · doi:10.4324/9781410600004-24 · Cited by 6,808
The Theory of Games and Economic Behavior
Harrison, R. W., von Neumann, J., & Morgenstern, O. (1945) · Journal of Farm Economics · doi:10.2307/1232672 · Cited by 5,133
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Research works printed but not linked: 2
- Bernoulli, D. Specimen theoriae novae de mensura sortis. Commentarii Academiae Scientiarum Imperialis Petropolitanae 5, 175–192 (1738) (in Latin).
- Markowitz, H. Portfolio selection. J. Finance 7, 77–91 (1952).
Cited by
Uncertainty and anticipation in anxiety: an integrated neurobiological and psychological perspective
Grupe, D. W., & Nitschke, J. B. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3524 · Cited by 2,007
Into the unknown: A review and synthesis of contemporary models involving uncertainty
Carleton, R. N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.02.007 · Cited by 1,104
Information-seeking, curiosity, and attention: computational and neural mechanisms
Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.001 · Cited by 784
Anterior insular cortex and emotional awareness
Gu, X., Hof, P. R., Friston, K. J., & Fan, J. (2013) · Journal of Comparative Neurology · doi:10.1002/cne.23368 · Cited by 712
“…insula) in both humans (Flynn et al., 1999; Butti and Hof, 2010; Bauernfeind et al., 2013; Butti et al., 2013) and macaque monkeys (Mesulam and Mufson, 1982a), although more subdivisions have been revealed in monkeys recently (Gallay et al., 2012; Evrard H, Logothetis NK, Craig AD, in press).”
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
“In behavioral terms, maximizing the entropy of controlled outcomes can be understood in terms of novelty bonuses and related concepts (Bach & Dolan, 2012; Daw et al., 2005; De Martino, Fleming, Garrett, & Dolan, 2012; Kakade & Dayan, 2002; Wittmann et al., 2008).”
BackgroundFear of the unknown: One fear to rule them all?
Carleton, R. N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.03.011 · Cited by 647
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
“…outline in further detail below, decision confidence can be defined as a subjective probability of a decision being correct (Aitchison et al., 2015; Pouget et al., 2016), and is one of many forms of uncertainty that the brain may encode (Bach & Dolan, 2012; Meyniel, Schluneg-ger, & Dehaene, 2015).”
BackgroundAdolphs, R. (2013) · Current Biology · doi:10.1016/j.cub.2012.11.055 · Cited by 524
“There are various types of unpredictability: temporal uncertainty in the occurrence of a stimulus, novelty of the stimulus itself, and even the context of knowing that one does not know much about a given stimulus [99].”
BackgroundTowards a neuroscience of active sampling and curiosity
Gottlieb, J., & Oudeyer, P.-Y. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0078-0 · Cited by 494
Confidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
“…as the Kalman filter, developed by engineers in the 1960s form a foundation for modern accounts of learning in cognitive science and neuroscience (Bach and Dolan, 2012; Bland and Schaefer, 2012; Daunizeau et al., 2010; Mathys et al., 2011; Nassar et al., 2010; Payzan-LeNestour and Bossaerts,…”
Computations of uncertainty mediate acute stress responses in humans
de Berker, A. O., Rutledge, R. B., Mathys, C., Marshall, L., Cross, G. F., Dolan, R. J., & Bestmann, S. (2016) · Nature Communications · doi:10.1038/ncomms10996 · Cited by 330
Self-citationSupra-personal cognitive control and metacognition
Shea, N., Boldt, A., Bang, D., Yeung, N., Heyes, C., & Frith, C. D. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.006 · Cited by 368
Adaptive learning under expected and unexpected uncertainty
Soltani, A., & Izquierdo, A. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0180-y · Cited by 286
Resolving uncertainty in a social world
FeldmanHall, O., & Shenhav, A. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0590-x · Cited by 274
Contributions of the central extended amygdala to fear and anxiety
Shackman, A. J., & Fox, A. S. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0982-16.2016 · Cited by 269
“, where threat imminence or probability is smoothly and continuously varied) would also afford powerful new opportunities for understanding the kinds of uncertainty most relevant to fear and anxiety (Bach and Dolan, 2012; de Berker et al., 2016) and for identifying circuits involved in triggering behavioral and physio…”
BackgroundCognitive control and attentional functions
Mackie, M.-A., Van Dam, N. T., & Fan, J. (2013) · Brain and Cognition · doi:10.1016/j.bandc.2013.05.004 · Cited by 235
“…such that the constructs described as comprising it (e.g., response selection, response inhibition, and task-set switching, among others) are described as discrete functions, measured by different tasks, with no interactions between them (Lenartowicz, Kalar, Congdon, & Poldrack, 2010).”
BackgroundDispositional negativity: An integrative psychological and neurobiological perspective.
Shackman, A. J., Tromp, D. P. M., Stockbridge, M. D., Kaplan, C. M., Tillman, R. M., & Fox, A. S. (2016) · Psychological Bulletin · doi:10.1037/bul0000073 · Cited by 234
“…and continuously varied) would also afford powerful new opportunities for understanding the kinds of uncertainty most relevant to fear and anxiety (Bach & Dolan, 2012; de Berker et al., 2016) and for identifying circuits involved in triggering behavioral and physiological “phase transitions”…”
Interactional synchrony: signals, mechanisms and benefits
Hoehl, S., Fairhurst, M., & Schirmer, A. (2021) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsaa024 · Cited by 231
“Interestingly, similar proposals emerge from the literature on the statistical learning of non-temporal transition probabilities (Bach and Dolan, 2012; Dehaene et al., 2015; Davis and Hasson, 2018), suggesting a perhaps more general role of striato-cortical loops in our ability to derive temporal…”
BackgroundWhat is mood? A computational perspective
Clark, J. E., Watson, S., & Friston, K. J. (2018) · Psychological Medicine · doi:10.1017/s0033291718000430 · Cited by 204
“This has interesting parallels with theories of optimal con-trol and reinforcement learning in which a link between action (e.g. pushing a button) and outcome (e.g. losing money) reinforce avoidance behaviour – a phenomenon which is absent or impaired in mania (see below) (Bach & Dolan, 2012).”
MethodAn information theory account of cognitive control
Fan, J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00680 · Cited by 200
“…of stimulus frequency, there is also a need to consider uncertainty due to the algorithms of mental operation for tasks that involve higher level stages of uncertainty processing (Bach and Dolan, 2012), such as the majority function task (MFT, Fan et al., 2008a, 2014; Wang et al., 2011).”
BackgroundMethodInfluentialThe Sense of Confidence during Probabilistic Learning: A Normative Account
Meyniel, F., Schlunegger, D., & Dehaene, S. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004305 · Cited by 163
“Many animals, human adults and even human babies possess remarkable skills to cope with the pervasive uncertainty in their environment [1,2].”
BackgroundEffects of cortical microstimulation on confidence in a perceptual decision
Fetsch, C. R., Kiani, R., Newsome, W. T., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.07.011 · Cited by 185
“This pattern could have failed to engage the same networks that normally read out sensory information for the purpose of computing confidence (Bach and Dolan, 2012; Barttfeld et al., 2013).”
BackgroundAdvances in the computational understanding of mental illness
Huys, Q. J. M., Browning, M., Paulus, M. P., & Frank, M. J. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-020-0746-4 · Cited by 179
Renfree, A., Martin, L., Micklewright, D., & St Clair Gibson, A. (2014) · Sports Medicine · doi:10.1007/s40279-013-0107-0 · Cited by 174
“Strong evidence from various different animal studies suggests that uncertainty (both sensory and outcome related) heavily influences behaviour, with sensory uncertainty in particular being utilised in a nearoptimal manner [6].”
BackgroundInfluentialInformational and Normative Influences in Conformity from a Neurocomputational Perspective
Toelch, U., & Dolan, R. J. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.007 · Cited by 167
Self-citationSocial Influence in Adolescent Decision-Making: A Formal Framework
Ciranka, S., & van den Bos, W. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01915 · Cited by 168
Schiebener, J., & Brand, M. (2015) · Neuropsychology Review · doi:10.1007/s11065-015-9285-x · Cited by 168
A Unifying Probabilistic View of Associative Learning
Gershman, S. J. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004567 · Cited by 166
Neural plasticity in fathers of human infants
Kim, P., Rigo, P., Mayes, L. C., Feldman, R., Leckman, J. F., & Swain, J. E. (2014) · Social Neuroscience · doi:10.1080/17470919.2014.933713 · Cited by 164
“For videotaped interactions, fathers were asked to interact with their infants for 5 minutes as they normally would.”
The future is here: A review of foresight systems in anxiety and depression
Miloyan, B., Pachana, N. A., & Suddendorf, T. (2014) · Cognition and Emotion · doi:10.1080/02699931.2013.863179 · Cited by 160
“In these models, risk refers to a set of possible outcomes characterised by a known probability distribution, whereas uncertainty refers to a set of possible outcomes characterised by a probability distribution that is not explicitly known (Bach & Dolan, 2012).”
BackgroundSerotonin neurons modulate learning rate through uncertainty
Grossman, C. D., Bari, B. A., & Cohen, J. Y. (2022) · Current Biology · doi:10.1016/j.cub.2021.12.006 · Cited by 164
Anterior cingulate is a source of valence-specific information about value and uncertainty
Monosov, I. E. (2017) · Nature Communications · doi:10.1038/s41467-017-00072-y · Cited by 163
“Hence, the behavioral procedure did not include choice trials in which uncertainty or risk can come about due to many factors (28, 40, 83-85).”
MethodThe Relationship between Perceptual Decision Variables and Confidence in the Human Brain
Hebart, M. N., Schriever, Y., Donner, T. H., & Haynes, J.-D. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhu181 · Cited by 159
Pharmacological Fingerprints of Contextual Uncertainty
Marshall, L., Mathys, C., Ruge, D., de Berker, A. O., Dayan, P., Stephan, K. E., & Bestmann, S. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002575 · Cited by 158
Algorithms for survival: a comparative perspective on emotions
Bach, D. R., & Dayan, P. (2017) · Nature reviews. Neuroscience · doi:10.1038/nrn.2017.35 · Cited by 158
Self-citationTop-down and bottom-up factors in threat-related perception and attention in anxiety
Sussman, T. J., Jin, J., & Mohanty, A. (2016) · Biological Psychology · doi:10.1016/j.biopsycho.2016.08.006 · Cited by 159
Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making
Chakroun, K., Mathar, D., Wiehler, A., Ganzer, F., & Peters, J. (2020) · eLife · doi:10.7554/elife.51260 · Cited by 144
Model averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121
“This gives rise to an additional tier of uncertainty to those customar-ily treated in the neuroscientific literature (Yu and Dayan, 2005; Bach and Dolan, 2012)—uncertainty over models.”
BackgroundSelf-citationBeyond dichotomies in reinforcement learning
Collins, A. G. E., & Cockburn, J. (2020) · Nature reviews. Neuroscience · doi:10.1038/s41583-020-0355-6 · Cited by 174
Confidence modulates exploration and exploitation in value-based learning
Boldt, A., Blundell, C., & Martino, B. D. (2019) · Neuroscience of Consciousness · doi:10.1093/nc/niz004 · Cited by 144
Wise, T., & Dolan, R. J. (2020) · Nature Communications · doi:10.1038/s41467-020-17977-w · Cited by 139
Self-citationHowes, O. D., Hird, E. J., Adams, R. A., Corlett, P. R., & McGuire, P. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.03.012 · Cited by 110
“To optimally update a model of the environment it i s important to resolve mismatches between expectations and observations according to their re lativ certainty(16).”
BackgroundEpistemic Feelings and Epistemic Emotions (Focus Section)
Arango‐Muñoz, S., & Michaelian, K. (2014) · Institutional Repository University of Antioquia (University of Antioquia) · doi:10.4454/philinq.v2i1.79 · Cited by 169
Children’s and Apes’ Preparatory Responses to Two Mutually Exclusive Possibilities
Redshaw, J., & Suddendorf, T. (2016) · Current Biology · doi:10.1016/j.cub.2016.04.062 · Cited by 168
A computational analysis of the neural bases of Bayesian inference
Kolossa, A., Kopp, B., & Fingscheidt, T. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.11.007 · Cited by 133
“In sum, our results suggest how a network of brain areas may allow for plausible probabilistic reasoning (Jaynes, 1988; Dayan et al., 1995; Rangel et al., 2008; Bach and Dolan, 2012; Summerfield and Tsetsos, 2012).”
ResultLearning-Based Control: A Tutorial and Some Recent Results
Jiang, Z., Bian, T., & Weinan, G. (2020) · Foundations and Trends® in Systems and Control · doi:10.1561/2600000023 · Cited by 153
Corcoran, A. W., Pezzulo, G., & Hohwy, J. (2020) · Biology & Philosophy · doi:10.1007/s10539-020-09746-2 · Cited by 161
“2008; for a review, see Bach and Dolan 2012).”
BackgroundThe impact of evidence reliability on sensitivity and bias in decision confidence.
Boldt, A., de Gardelle, V., & Yeung, N. (2017) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000404 · Cited by 110
“…supporting the notion that mental representa- tions are stored and accessed as a probability distribution of activations rather than a point estimate (Bach & Dolan, 2012; Beck et al., 2008; Fiser, Berkes, Orbán, & Lengyel, 2010; Ma et al., 2006) and it has been proposed that confidence could be a…”
BackgroundBehavior- and Modality-General Representation of Confidence in Orbitofrontal Cortex
Masset, P., Ott, T., Lak, A., Hirokawa, J., & Kepecs, A. (2020) · Cell · doi:10.1016/j.cell.2020.05.022 · Cited by 109
Bayesian modeling of flexible cognitive control
Jiang, J., Heller, K., & Egner, T. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.06.001 · Cited by 123
“Bayesian methods have been widely applied in cognitive neuroscience studies (e.g., (Bach and Dolan, 2012; Vilares and Kording, 2011)), and a comprehensive review of studies using Bayesian methods is beyond the scope of this article.”
MethodThalamocortical excitability modulation guides human perception under uncertainty
Kosciessa, J. Q., Lindenberger, U., & Garrett, D. D. (2021) · Nature Communications · doi:10.1038/s41467-021-22511-7 · Cited by 106
Affective Value in the Predictive Mind
Van De Cruys, S. (2017) · Theoretical Philosophy/MIND Group – JGU Mainz · doi:10.15502/9783958573253 · Cited by 100
“Most likely, these computations are performed distributed in the brain (similar to first-order PP), given the widely distributed encoding of uncertainty in the brain depending on the domain concerned (Bach and Dolan 2012).”
BackgroundConfidence predicts speed-accuracy tradeoff for subsequent decisions
Desender, K., Boldt, A., Verguts, T., & Donner, T. H. (2019) · eLife · doi:10.7554/elife.43499 · Cited by 118
“Indeed, normative models prescribe that uncertainty (i.e., the inverse of confidence) should determine how much information needs to be sampled (Bach and Dolan, 2012; Meyniel et al., 2015).”
BackgroundVariance misperception explains illusions of confidence in simple perceptual decisions
Zylberberg, A., Roelfsema, P. R., & Sigman, M. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.05.012 · Cited by 97
How Outcome Uncertainty Mediates Attention, Learning, and Decision-Making
Monosov, I. E. (2020) · Trends in Neurosciences · doi:10.1016/j.tins.2020.06.009 · Cited by 104
“The intent is that it, alongside other reviews that outline how prediction errors mediate our beliefs under uncertainty and painstakingly define distinct forms of uncertainty that animals and humans face [1, 11, 14-17], will guide future experiments to reveal the mechanisms of learning and adaptation in an uncertain w…”
BackgroundInfluentialUnderstanding the human parental brain: A critical role of the orbitofrontal cortex
Parsons, C. E., Stark, E. A., Young, K. S., Stein, A. L., & Kringelbach, M. L. (2013) · Social Neuroscience · doi:10.1080/17470919.2013.842610 · Cited by 98
“of OFC function in terms of monitoring and evaluation, Bach and Dolan (2012) consider the OFC as”
BackgroundKorn, C. W., & Bach, D. R. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0603-9 · Cited by 93
Self-citationDaikoku, T. (2018) · Brain Sciences · doi:10.3390/brainsci8060114 · Cited by 87
“evaluate the neurobiology of SL [60], as well as rule learning [77], decision making [78], anxiety, and”
BackgroundMethodAtonal Music: Can Uncertainty Lead to Pleasure?
Mencke, I., Omigie, D., Wald‐Fuhrmann, M., & Brattico, E. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00979 · Cited by 94
“Since uncertainty estimation is an evolutionary necessity for explorative behavior (Tobler et al., 2005; Bach and Dolan, 2012) we argue that processing and decoding uncertainty in (atonal) music primarily represents an incentive to further engage with this stimulus.”
BackgroundPanitz, C., Endres, D., Buchholz, M., Khosrowtaj, Z., Sperl, M. F. J., Mueller, E. M., Schubö, A., Schütz, A. C., Teige‐Mocigemba, S., & Pinquart, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.726432 · Cited by 93
“, 2006), and the uncertainty that is inherent in them (Feldman and Friston, 2010; Bach and Dolan, 2012; Spicer et al., 2020).”
BackgroundIdentifying Stride-To-Stride Control Strategies in Human Treadmill Walking
Dingwell, J. B., & Cusumano, J. P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124879 · Cited by 81
“Regulating movements only a few steps at a time in this way is consistent with the fact that humans must navigate noisy environments using a noisy neuromotor system [8,27] that must contend with multiple forms and levels of uncertainty [76].”
BackgroundThe neurobiology of uncertainty: implications for statistical learning
Hasson, U. (2016) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0048 · Cited by 88
“A similar argument for parametric manipulations has been made in studies of decision making under uncertainty [5] where it has been argued that the comparison between certain and (almost) certain states may load on brains states not directly related to the coding of uncertainty.”
InfluentialA common neural network differentially mediates direct and social fear learning
Lindström, B., Haaker, J., & Olsson, A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.11.039 · Cited by 88
“3 c), pointing to the AI as an important region for dynamic adjustments of learning rates across modalities under uncertainty (Bach and Dolan, 2012; Grupe and Nitschke, 2013).”
BackgroundMonosov, I. E., & Hikosaka, O. (2013) · Nature Neuroscience · doi:10.1038/nn.3398 · Cited by 83
Risk-Responsive Orbitofrontal Neurons Track Acquired Salience
Ogawa, M., van der Meer, M. A. A., Esber, G. R., Cerri, D. H., Stalnaker, T. A., & Schoenbaum, G. (2013) · Neuron · doi:10.1016/j.neuron.2012.11.006 · Cited by 74
“Decision making is impacted by uncertainty and risk (Bach and Dolan, 2012; D’Acremont and Bossaerts, 2008; Kahneman and Tversky, 1984; Rushworth and Behrens, 2008).”
BackgroundHuman Pavlovian fear conditioning conforms to probabilistic learning
Tzovara, A., Korn, C. W., & Bach, D. R. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006243 · Cited by 85
“Notably, probabilistic models explain other neural systems better than non probabilistic RL models, for example in explaining putative prediction error signals during sensory perception of auditory regularities [47], or in modelling choice-based correlates of associative learning [21,48], in line with other sources of…”
BackgroundSelf-citationWu, T., Chen, C., Spagna, A., Wu, X., Mackie, M., Russell‐Giller, S., Xu, P., Luo, Y., Liu, X., Hof, P. R., et al. (2019) · The Journal of Comparative Neurology · doi:10.1002/cne.24804 · Cited by 75
“Uncertainty can be increased due to conflict between perceptual and behavioral pro- cesses (Bach & Dolan, 2012) with the amount of uncertainty as a pro- portion of the number of competing responses (Hirsh et al., 2012), resulting in the conflict effect in classical cognitive control tasks.”
BackgroundHeuristic and optimal policy computations in the human brain during sequential decision-making
Korn, C. W., & Bach, D. R. (2018) · Nature Communications · doi:10.1038/s41467-017-02750-3 · Cited by 77
“Negative relations of an uncertainty metric have previously been identi fi ed a region of the posterior cingulate cortex, which was slightly more posterior than the cluster identi fi ed here 12, 34 .”
BackgroundSelf-citationShahid, A. H., & Singh, M. P. (2020) · Journal of Applied Biomedicine · doi:10.1016/j.bbe.2020.09.005 · Cited by 73
Hong, J. ‐., Naliboff, B. D., Labus, J. S., Gupta, A., Kilpatrick, L. A., Ashe-McNalley, C., Stains, J., Heendeniya, N., Smith, S. R., Tillisch, K., et al. (2015) · Neurogastroenterology & Motility · doi:10.1111/nmo.12710 · Cited by 64
Schiebener, J., Wegmann, E., Gathmann, B., Laier, C., Pawlikowski, M., & Brand, M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01386 · Cited by 73
Nicotinic receptors in the ventral tegmental area promote uncertainty-seeking
Naudé, J., Tolu, S., Dongelmans, M., Torquet, N., Valverde, S., Rodriguez, G., Pons, S., Maskos, U., Mourot, A., Marti, F., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4223 · Cited by 61
P300 amplitude variations, prior probabilities, and likelihoods: a Bayesian ERP study
Kopp, B., Seer, C., Lange, F., Kluytmans, A., Kolossa, A., Fingscheidt, T., & Hoijtink, H. (2016) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-016-0442-3 · Cited by 60
“The topic has only recently begun to receive attention in cognitive neuroscience (Bach & Dolan, 2012; Glimcher, 2004).”
BackgroundMethodMorris, R. W., Dezfouli, A., Griffiths, K. R., & Balleine, B. W. (2014) · Nature Communications · doi:10.1038/ncomms5390 · Cited by 59
Fan, J., Dam, N. T. V., Gu, X., Liu, X., Wang, H., Tang, C. Y., & Hof, P. R. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00554 · Cited by 60
“…understood (see Badre, 2008; Chase, Clark, Sahakian, Bullmore, & Robbins, 2008), a relationship between the activity of the frontoparieto-cingulate (FPC) system and cognitive control under conditions of uncertainty has been consistently demonstrated in fMRI studies (see Bach & Dolan, 2012).”
BackgroundCategorization=decision making+generalization
Seger, C. A., & Peterson, E. J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.015 · Cited by 76
“Uncertainty has recently attracted significant interest in neuroeconomics, with discussion of uncertainty about perception, action, value, and outcome (Bach and Dolan, 2012).”
BackgroundElectrophysiological indicators of surprise and entropy in dynamic task-switching environments
Kopp, B., & Lange, F. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00300 · Cited by 67
“ORIGINAL RESEARCH ARTICLE published: 03 July 2013 doi: 10.3389/fnhum.2013.00300 Electrophysiological indicators of surprise and entropy in dynamic task-switching environments”
BackgroundMethodInfluentialPredictors of risky foraging behaviour in healthy young people
Bach, D. R., Moutoussis, M., Bowler, A., & Dolan, R. J. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0867-0 · Cited by 62
Self-citationStudying the neural representations of uncertainty
Walker, E. Y., Pohl, S., Denison, R. N., Barack, D. L., Lee, J., Block, N., Ma, W. J., & Meyniel, F. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01444-y · Cited by 56
Monosov, I. E., Leopold, D. A., & Hikosaka, O. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0051-15.2015 · Cited by 58
“…events or uncertain contexts (Pearce and Hall, 1980; Yu and Dayan, 2005; Courville et al., 2006; Esber and Haselgrove, 2011; Le Pelley et al., 2011; Bach and Dolan, 2012; Ogawa et al., 2013), as well as by other factors, such as the expectation of a reward or the fear of an aversive stimulus…”
BackgroundThe neural underpinnings of an optimal exploitation of social information under uncertainty
Toelch, U., Bach, D. R., & Dolan, R. J. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst173 · Cited by 64
“One upshot is that the brain areas we highlight as being recruited for integration of social information are in fact components of a network that is fundamental to decision-making under uncertainty (Platt and Huettel, 2008; Bach and Dolan, 2012).”
BackgroundSelf-citationChoosing to view morbid information involves reward circuitry
Oosterwijk, S., Snoek, L., Koppele, J. T., Engelbert, L. H., & Scholte, H. S. (2020) · Scientific Reports · doi:10.1038/s41598-020-71662-y · Cited by 63
Human perceptual and metacognitive decision-making rely on distinct brain networks
Luzio, P. D., Tarasi, L., Silvanto, J., Avenanti, A., & Romei, V. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001750 · Cited by 62
“By taking into account the evidence that early visual areas and higher-order regions constitute a recurrent feedback system [73], we could also hypothesize the existence of a hierarchical Bayesian architecture in which looping iterations tend to perform near-optimal computations [74,75], combining and updating predict…”
BackgroundRausch, F., Mier, D. U., Eifler, S., Esslinger, C., Schilling, C., Schirmbeck, F. N., Englisch, S., Meyer‐Lindenberg, A., Kirsch, P., & Zink, M. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.04.020 · Cited by 59
“These studies localized the neural organization of uncertainty (risk or ambiguity) in the course of decision-making represented in a fronto-striatal-thalamic network (Grinband et al., 2006; Bach and Dolan, 2012).”
Uncertainty-driven regulation of learning and exploration in adolescents: A computational account
Jepma, M., Schaaf, J. V., Visser, I., & Huizenga, H. M. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008276 · Cited by 58
“Specifically, the optimal rates of 68 learning and exploration depend on various sources of uncertainty, including imperfect 69 knowledge about the current state of the environment (estimation uncertainty, or ambiguity), 70 the amount of random outcome variability (noise, or risk), and the degree of environmental 71 c…”
BackgroundGeneralization in Category Learning: The Roles of Representational and Decisional Uncertainty
Seger, C. A., Braunlich, K., Wehe, H. S., & Liu, Z. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0654-15.2015 · Cited by 60
“One important aspect of decision making that categorization tasks are particularly suited for examining is uncertainty (Bach and Dolan, 2012; Ma and Jazayeri, 2014).”
BackgroundTransdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty
Sandhu, T. R., Xiao, B., & Lawson, R. P. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105123 · Cited by 51
“referred to as ambiguity (Bach and Dolan, 2012), which is a source of second-order uncertainty (Bach et al.”
BackgroundInfluentialFrequency-specific brain dynamics related to prediction during language comprehension
Armeni, K., Willems, R. M., van den Bosch, A. P. J., & Schoffelen, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.04.083 · Cited by 50
Representations of uncertainty: where art thou?
Koblinger, Á., Fiser, J., & Lengyel, M. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.009 · Cited by 61
“However, there are indications that the brain may be closer to the fully Bayesian model and represents uncertainty about sensory as well other variables, and not just the ones related directly to the decision [3].”
The perceptual and social components of metacognition.
Pescetelli, N., Rees, G. E., & Bahrami, B. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000180 · Cited by 72
“For example, confidence ratings (Peirce & Jastrow, 1884), perceptual awareness scale (Overgaard & Sandberg, 2012), and postdecision wagering (Persaud, McLeod, & Cowey, 2007) are forms of type II decisions.”
BackgroundInfluentialNovelty Manipulations, Memory Performance, and Predictive Coding: the Role of Unexpectedness
Reichardt, R., Polner, B., & Simor, P. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00152 · Cited by 57
“The degree of unexpectedness is likely to be represented in the brain, but it does not have a single, unambiguous neural correlate (Bach and Dolan, 2012), which further complicates its assessment.”
BackgroundValuation for Risky and Uncertain Choices
Tobler, P. N., & Weber, E. U. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00009-7 · Cited by 58
“…of variance or skew) and uncertainty in a variety of structures, both at the level of single neurons and of brain regions (for general reviews, see Bach and Dolan, 2012; Burke and Tobler, 2011a; D’Acremont and Bossaerts, 2008; Mohr et al., 2010a; Platt and Huettel, 2008; Rushworth and Behrens,…”
BackgroundCuriosity: primate neural circuits for novelty and information seeking
Monosov, I. E. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00784-9 · Cited by 44
“In theory, there are at least two types of outcome uncertainty or variance that organisms and artificial agents must learn to negotiate 15,86–89 , both of which are usually present in naturalistic settings.”
Brown, V. M., Hallquist, M. N., Frank, M. J., & Dombrovski, A. Y. (2022) · Cognition · doi:10.1016/j.cognition.2022.105233 · Cited by 54
“This variance was calculated from the beta distribution of each segment's value (Bach & Dolan, 2012; E. Payzan-LeNestour & Bossaerts, 2011).”
MethodSocial learning across adolescence: A Bayesian neurocognitive perspective
Hofmans, L., & van den Bos, W. (2022) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2022.101151 · Cited by 57
“Estimating all expected benefits and costs involves various forms of uncertainty (Bach and Dolan, 2012; Yon and Frith, 2021).”
BackgroundNeurons in the primate dorsal striatum signal the uncertainty of object–reward associations
White, J. K., & Monosov, I. E. (2016) · Nature Communications · doi:10.1038/ncomms12735 · Cited by 43
Consensus design of a calibration experiment for human fear conditioning
Bach, D. R., Sporrer, J. K., Abend, R., Beckers, T., Dunsmoor, J. E., Fullana, M. A., Gamer, M., Gee, D. G., Hamm, A. O., Hartley, C. A., et al. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105146 · Cited by 50
“In the case of binary outcomes (US or no US), any metric of outcome uncertainty monotonically relates to how far away from 50% the US probability is (Bach and Dolan, 2012).”
Self-citationDepressive symptoms are associated with blunted reward learning in social contexts
Safra, L., Chevallier, C., & Palminteri, S. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007224 · Cited by 40
Lombard, E., Kometer, M., & Preuschoff, K. (2017) · Organizational Research Methods · doi:10.1177/1094428117730891 · Cited by 60
“Further investigations in this area of decision making invoke, therefore, the context of learning under ambiguity and await further application in neurofinance (Bach & Dolan, 2012; Payzan-LeNestour et al., 2013).”
BackgroundGoldstein Ferber, S., Shoval, G., Zalsman, G., Mikulincer, M., & Weller, A. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.680403 · Cited by 40
Metadata
- Authors
- Bach, D. R., & Dolan, R. J.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- Corresponding author
- Bach, Dominik R.
- Venue
- Nature Reviews Neuroscience
- Published
- 2012-07-11
- Volume
- 13
- Issue
- 8
- Pages
- 572-586
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W2032345561
- Cited by
- 339
- References
- 146
- Citations by year
- 2026: 7 · 2025: 30 · 2024: 31 · 2023: 24 · 2022: 24 · 2021: 19 · 2020: 36 · 2019: 25 · 2018: 13 · 2017: 24 · 2016: 26 · 2015: 25 · 2014: 26 · 2013: 28
- FWCI
- 2.01
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Funders
- Wellcome Trust (091593, 078865/Z/05/Z, 098362, 999998, 091593/Z/10/Z)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- uncertainty estimation, decision-making, internal noise, external noise, summary statistics, anxiety, depression, schizophrenia, brain systems
- MeSH terms
- Animals, Brain, Decision Making, Humans, Magnetic Resonance Imaging, Nerve Net, Uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.