Different Varieties of Uncertainty in Human Decision-Making
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
The study of uncertainty in decision-making is receiving greater attention in the fields of cognitive and computational neuroscience. Several lines of evidence are beginning to elucidate different variants of uncertainty. Particularly, risk, ambiguity, and expected and unexpected forms of uncertainty are well articulated in the literature. In this article we review both empirical and theoretical evidence arguing for the potential distinction between three forms of uncertainty; expected uncertainty, unexpected uncertainty, and volatility. Particular attention will be devoted to exploring the distinction between unexpected uncertainty and volatility which has been less appreciated in the literature. This includes evidence mainly from neuroimaging, neuromodulation, and electrophysiological studies. We further address the possible differentiation of cognitive control mechanisms used to deal with these forms of uncertainty. Finally, we explore whether the dual modes of control theory provides a theoretical framework for understanding the distinction between unexpected uncertainty and volatility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Is the P300 component a manifestation of context updating?
Donchin, E., & Coles, M. G. H. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00058027 · Cited by 3,585
N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies.
Owen, A. M., McMillan, K. M., Laird, A. R., & Bullmore, E. (2005) · Human Brain Mapping · doi:10.1002/hbm.20131 · Cited by 3,560
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273
Anterior Cingulate Conflict Monitoring and Adjustments in Control
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004) · Science · doi:10.1126/science.1089910 · Cited by 2,891 · cited 18×
“Alternatively, a proactive control mode characterized by sustained neural activity in the PFC and the P3/LPC complex may be important for successful integration of past outcomes in order to measures the stochasticity of the environment and deal with expected uncertainty.”
BackgroundInfluentialDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 2×
“In other words, when an agent is faced with a two-options choice, uncertainty is often said to be maximal when the probability of obtaining a reward linked to any of the two options is p = 0.5 but absent at the two extremes (probability = 1 and probability = 0; e.g., Fiorillo et al., 2003).”
BackgroundInfluentialLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Conflict monitoring versus selection-for-action in anterior cingulate cortex
Botvinick, M., Nystrom, L. E., Fissell, K., Carter, C. S., & Cohen, J. D. (1999) · Nature · doi:10.1038/46035 · Cited by 2,044
The neural basis of error detection: Conflict monitoring and the error-related negativity
Yeung, N., Botvinick, M. M., & Cohen, J. D. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.931 · Cited by 1,924
The locus coeruleus and noradrenergic modulation of cognition
Sara, S. J. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2573 · Cited by 1,848 · cited 2×
“Taken together, these observations suggest that the LC-NA system facilitates attentional and cognitive shifts in behavioral adaptation in changing environments (see Sara, 2009).”
BackgroundUncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 18×
“This is consistent with Yu and Dayan (2005) theory of unexpected uncertainty and the adaptive gain theory of LC-NA (noradrenaline) mediated explore/exploit behavior (Aston-Jones and Cohen, 2005).”
BackgroundResultInfluentialNeural systems responding to degrees of uncertainty in human decision-making
Hsu, M., Bhatt, M., Adolphs, R., Tranel, D., & Camerer, C. F. (2005) · Science · doi:10.1126/science.1115327 · Cited by 1,411
Ridderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407
The anterior cingulate as a conflict monitor: fMRI and ERP studies
VANVEEN, V, & CARTER, C. (2002) · Physiology & Behavior · doi:10.1016/s0031-9384(02)00930-7 · Cited by 1,258 · cited 2×
“Interestingly, the P3 has been linked to WM and sustained maintenance of information in WM (Duncan-Johnson and Donchin, 1982) and the N2 has been linked with conflict monitoring and error detection (van Veen and Carter, 2002).”
BackgroundNieuwenhuis, S., Yeung, N., van den Wildenberg, W., & Ridderinkhof, K. R. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.1.17 · Cited by 1,250
Overlapping mechanisms of attention and spatial working memory
Awh, E., & Jonides, J. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01593-x · Cited by 1,229
The cognitive neuroscience of sustained attention: where top-down meets bottom-up.
Sarter, M., Givens, B., & Bruno, J. P. (2001) · Brain Research Reviews · doi:10.1016/s0165-0173(01)00044-3 · Cited by 1,194
An information theoretical approach to prefrontal executive function
Koechlin, E., & Summerfield, C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.04.005 · Cited by 1,183
Distributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · cited 1×
“For instance, during everyday decision-making, there is often only a probabilistic chance (rather than a certainty) of success therefore the lack of reward on a particular occasion may not necessarily signal the need to switch to an alternative course of action (Kennerley et al., 2006).”
BackgroundLearned predictions of error likelihood in the anterior cingulate cortex
Brown, J. W., & Braver, T. S. (2005) · Science · doi:10.1126/science.1105783 · Cited by 928 · cited 16×
“Alternatively, a proactive control mode characterized by sustained neural activity in the PFC and the P3/LPC complex may be important for successful integration of past outcomes in order to measures the stochasticity of the environment and deal with expected uncertainty.”
BackgroundInfluentialChoice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Neural mechanisms of transient and sustained cognitive control during task switching.
Braver, T. S., Reynolds, J. R., & Donaldson, D. I. (2003) · Neuron · doi:10.1016/s0896-6273(03)00466-5 · Cited by 826
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692
Flexible neural mechanisms of cognitive control within human prefrontal cortex.
Braver, T. S., Paxton, J. L., Locke, H. S., & Barch, D. M. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0808187106 · Cited by 689
Neural activity in the human brain relating to uncertainty and arousal during anticipation.
Critchley, H. D., Mathias, C. J., & Dolan, R. J. (2001) · Neuron · doi:10.1016/s0896-6273(01)00225-2 · Cited by 681
A Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590 · cited 6×
“As suggested above, expected forms of uncertainty may be estimated by sustained episodic control (Kouneiher et al., 2009) or proactive control (Braver et al., 2009) whilst unexpected forms of uncertainty may be detected by transient contextual control (Kouneiher et al., 2009) or reactive control…”
BackgroundInfluentialConflict-induced behavioural adjustment: a clue to the executive functions of the prefrontal cortex
Mansouri, F. A., Tanaka, K., & Buckley, M. J. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2538 · Cited by 559 · cited 16×
“Alternatively, a proactive control mode characterized by sustained neural activity in the PFC and the P3/LPC complex may be important for successful integration of past outcomes in order to measures the stochasticity of the environment and deal with expected uncertainty.”
BackgroundInfluentialReward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems
Tobler, P. N., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00745.2006 · Cited by 472
Dalley, J. W., McGaughy, J., O'Connell, M. T., Cardinal, R. N., Levita, L., & Robbins, T. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-13-04908.2001 · Cited by 277 · cited 4×
“For instance, the prefrontal NA system, unlike the ACh system, is engaged by novel S-R-O contingencies, which is compatible with a role in mechanisms of plasticity and new learning (Dalley et al., 2001).”
BackgroundInfluentialRisk, unexpected uncertainty, and estimation uncertainty: Bayesian learning in unstable settings
Payzan-LeNestour, E., & Bossaerts, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001048 · Cited by 267 · cited 2×
“, the stable probability of reward where an agent can learn that a stimulus predicts rewards on 80% of trials is less uncertain than a situation where this probability is set at 50%), and (b) from unexpected and fundamental changes in the S-R-O contingencies of the environment that invalidate prediction based on previ…”
BackgroundMethodKrugel, L. K., Biele, G., Mohr, P. N. C., Li, S.-C., & Heekeren, H. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905191106 · Cited by 229 · cited 3×
“This is an exciting line of research which is beginning to prove fruitful (Yu and Dayan, 2005; Behrens et al., 2007; Doya, 2008; Krugel et al., 2009; Nassar et al., 2010; Bland and Schaefer, 2011; Nieuwenhuis, 2011; Preuschoff et al., 2011).”
BackgroundMethodPredicting events of varying probability: uncertainty investigated by fMRI
Volz, K. G., Schubotz, R. I., & von Cramon, D. Y. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00122-8 · Cited by 214 · cited 4×
“Neuroimaging evidence indicates that the DLPFC (Paulus et al., 2002; Huettel et al., 2005), posterior parietal cortex (Volz et al., 2003; Huettel et al., 2005), anterior cingulate cortex (ACC; Elliott and Dolan, 1998; Critchley et al., 2001; Stern et al., 2010), orbito-frontal cortex (OFC; Goel and…”
BackgroundMethodInfluentialWitte, E. A., Davidson, M. C., & Marrocco, R. T. (1997) · Psychopharmacology · doi:10.1007/s002130050352 · Cited by 187
The regulation of cognitive control following rostral anterior cingulate cortex lesion in humans
di Pellegrino, G., Ciaramelli, E., & Làdavas, E. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.2.275 · Cited by 169 · cited 1×
“Specifically, the ACC is thought to play an essential role in the adjustment of executive control mechanisms governed by the PFC (Botvinick et al., 2001; Kerns et al., 2004; Brown and Braver, 2005; Egner and Hirsch, 2005; di Pellegrino et al., 2007; Mansouri et al., 2009).”
BackgroundPaulus, M. P., Feinstein, J. S., Simmons, A., & Stein, M. B. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.02.023 · Cited by 115 · cited 1×
“Many studies have therefore used variations of a 75/25% S-R-O probability to create certain environments and 50/50% probability to create uncertain environments (Volz et al., 2003; Paulus et al., 2004; Huettel et al., 2005; Krain et al., 2006; Cohen et al., 2007b; Polezzi et al., 2008).”
Method
Cited by
Uncertainty in perception and the Hierarchical Gaussian Filter
Mathys, C. D., Lomakina, E. I., Daunizeau, J., Iglesias, S., Brodersen, K. H., Friston, K. J., & Stephan, K. E. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00825 · Cited by 465
Confidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
Computations of uncertainty mediate acute stress responses in humans
de Berker, A. O., Rutledge, R. B., Mathys, C., Marshall, L., Cross, G. F., Dolan, R. J., & Bestmann, S. (2016) · Nature Communications · doi:10.1038/ncomms10996 · Cited by 330
The neural representation of unexpected uncertainty during value-based decision making
Payzan-LeNestour, E., Dunne, S., Bossaerts, P., & O’Doherty, J. P. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.037 · Cited by 257
Corcoran, A. W., Pezzulo, G., & Hohwy, J. (2020) · Biology & Philosophy · doi:10.1007/s10539-020-09746-2 · Cited by 161
Metadata
- Authors
- Bland, A. R., & Schaefer, A.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2012
- Volume
- 6
- Pages
- 85-85
- ISSN
- 1662-453X (ISSN-L)
- 1662-4548
- OpenAlex
- W1997618609
- Cited by
- 129
- References
- 38
- FWCI
- 2.15
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.