Different aspects of performance feedback engage different brain areas: Disentangling valence and expectancy in feedback processing
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Evaluating the positive and negative outcomes of our behaviour is important for action selection and learning. Such reinforcement learning has been shown to engage a specific neural circuitry including the mesencephalic dopamine system and its target areas, the striatum and medial frontal cortex, especially the anterior cingulate cortex (ACC). An intensively pursued debate regards the prevailing influence of feedback expectancy and feedback valence on the engagement of these two brain regions in reinforcement learning and their respective roles are far from being understood. To this end, we used a time estimation task with three different types of feedback that allows disentangling the effect of feedback valence and expectancy using functional magnetic resonance imaging (fMRI). Our results show greater ACC activation after unexpected positive and unexpected negative feedback than after expected feedback and by this sensitivity to unexpected events in general irrespective of their valence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses
Gehring, W. J., & Willoughby, A. R. (2002) · Science · doi:10.1126/science.1066893 · Cited by 1,884
Motor Areas of the Medial Wall: A Review of Their Location and Functional Activation
Picard, N., & Strick, P. L. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.3.342 · Cited by 1,712
Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.6.788 · Cited by 1,530
FMRI visualization of brain activity during a monetary incentive delay task
Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000) · NeuroImage · doi:10.1006/nimg.2000.0593 · Cited by 1,414
Neural mechanisms of autonomic, affective, and cognitive integration
Critchley, H. D. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20749 · Cited by 1,214
Dorsal anterior cingulate cortex: A role in reward-based decision making
Bush, G., Vogt, B. A., Holmes, J., Dale, A. M., Greve, D., Jenike, M. A., & Rosen, B. R. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.012470999 · Cited by 1,096
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Anterior Cingulate Cortex and Response Conflict: Effects of Frequency, Inhibition and Errors
Braver, T. S. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.9.825 · Cited by 1,016
Monchi, O., Petrides, M., Petre, V., Worsley, K., & Dagher, A. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07733.2001 · Cited by 961
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Predictability modulates human brain response to reward
Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02793.2001 · Cited by 711
Motivation of extended behaviors by anterior cingulate cortex
Holroyd, C. B., & Yeung, N. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.008 · Cited by 618
Performance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451
Event-related potential studies of outcome processing and feedback-guided learning
San Martín, R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00304 · Cited by 354
The Error-Related Negativity (ERN/Ne)
Gehring, W. J., Liu, Y., Orr, J. M., & Carp, J. (2011) · Oxford Handbooks Online · doi:10.1093/oxfordhb/9780195374148.013.0120 · Cited by 331
Computational Models of Performance Monitoring and Cognitive Control
Alexander, W. H., & Brown, J. W. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01085.x · Cited by 193
Error effects in anterior cingulate cortex reverse when error likelihood is high
Jessup, R. K., Busemeyer, J. R., & Brown, J. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4130-09.2010 · Cited by 151
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114
Cited by
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140
Hammer, R., Cooke, G. E., Stein, M. A., & Booth, J. R. (2015) · NeuroImage: Clinical · doi:10.1016/j.nicl.2015.08.015 · Cited by 25
Metadata
- Authors
- Ferdinand, N. K., & Opitz, B.
- Venue
- Scientific Reports
- Published
- 2014-08-07
- Volume
- 4
- Issue
- 1
- Pages
- 5986-5986
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W1997617739
- Cited by
- 43
- References
- 21
- FWCI
- 2.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.