Rapid Processing of Both Reward Probability and Reward Uncertainty in the Human Anterior Cingulate Cortex
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Reward probability and uncertainty are two fundamental parameters of decision making. Whereas reward probability indicates the prospect of winning, reward uncertainty, measured as the variance of probability, indicates the degree of risk. Several lines of evidence have suggested that the anterior cingulate cortex (ACC) plays an important role in reward processing. What is lacking is a quantitative analysis of the encoding of reward probability and uncertainty in the human ACC. In this study, we addressed this issue by analyzing the feedback-related negativity (FRN), an event-related potential (ERP) component that reflects the ACC activity, in a simple gambling task in which reward probability and uncertainty were parametrically manipulated through predicting cues. Results showed that at the outcome evaluation phase, while both win and loss-related FRN amplitudes increased as the probability of win or loss decreased, only the win-related FRN was modulated by reward uncertainty. This study demonstrates the rapid encoding of reward probability and uncertainty in the human ACC and offers new insights into the functions of the ACC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 3×
“Uncertainty was also measured as entropy [4] and similar effects were observed.”
BackgroundMethodInfluentialLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses
Gehring, W. J., & Willoughby, A. R. (2002) · Science · doi:10.1126/science.1066893 · Cited by 1,884
Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.6.788 · Cited by 1,530
Human insula activation reflects risk prediction errors as well as risk
Preuschoff, K., Quartz, S. R., & Bossaerts, P. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4286-07.2008 · Cited by 784
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692 · cited 3×
“As the uncertainty is derived and calculated from the probability [14], in most circumstance, these two factors are highly correlated.”
BackgroundResultNeural activity in the human brain relating to uncertainty and arousal during anticipation.
Critchley, H. D., Mathias, C. J., & Dolan, R. J. (2001) · Neuron · doi:10.1016/s0896-6273(01)00225-2 · Cited by 681
Nieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. H. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.05.003 · Cited by 557 · cited 2×
“The reinforcement learning theory of the FRN proposes that the FRN reflects the impact of the midbrain dopamine signals on the ACC [29,30]; the phasic changes in the midbrain dopamine activity are associated with fluctuations in the FRN amplitude and negative and positive prediction errors increase and decrease the FR…”
BackgroundERP Correlates of Feedback and Reward Processing in the Presence and Absence of Response Choice
Yeung, N., Holroyd, C. B., & Cohen, J. D. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh153 · Cited by 520 · cited 1×
“Moreover, participants may have irrational believe that their actions could influence outcomes [40,41] and they may be overoptimistic about the chances of winning [34].”
Background
Cited by
A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages
Sambrook, T. D., & Goslin, J. (2015) · Psychological Bulletin · doi:10.1037/bul0000006 · Cited by 411
Event-related potential studies of outcome processing and feedback-guided learning
San Martín, R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00304 · Cited by 354
Broyd, S. J., Richards, H. J., Helps, S. K., Chronaki, G., Bamford, S., & Sonuga-Barke, E. J. S. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2012.05.015 · Cited by 167
“…paradigms have manipulated context to examine the behavioural relevance of reward-predicting cues (Nahum et al., 2011), decision-making following learned reward-predicting cue associations (Cohen et al., 2009), and attempted to dissociate reward probability and reward uncertainty (Yu et al., 2011).”
Neuropathology of the Anterior Midcingulate Cortex in Young Children With Autism
Uppal, N., Wicinski, B., Buxbaum, J. D., Heinsen, H., Schmitz, C., & Hof, P. R. (2014) · Journal of Neuropathology & Experimental Neurology · doi:10.1097/nen.0000000000000108 · Cited by 52
Metadata
- Authors
- Yu, R., Zhou, W., & Zhou, X.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-12-27
- Volume
- 6
- Issue
- 12
- Pages
- e29633
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2055838821
- Cited by
- 60
- References
- 18
- FWCI
- 3.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.