The human ventromedial frontal lobe is critical for learning from negative feedback
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Are positive and negative feedback weighed in a common balance in the brain, or do they influence behaviour through distinct neural mechanisms? Recent neuroeconomic studies in both human and non-human primates indicate that the ventromedial frontal lobe carries information about both losses and gains, suggesting that this region may encode value across the continuum from absolute negative to absolute positive outcomes. However, such work does not specify whether or how this value information is applied during behaviour. Observations of patients with ventromedial frontal damage indicate that this region is critical for certain forms of reinforcement learning and value-based decision-making, but the underlying processes remain unclear. We disentangled the influence of cumulative positive and negative feedback on subsequent behaviour with a probabilistic reinforcement learning task in 11 patients with ventromedial frontal damage, 9 lesioned controls and 24 healthy controls, and found that ventromedial frontal damage selectively disrupted the ability to learn from negative feedback.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Deciding advantageously before knowing the advantageous strategy
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997) · Science · doi:10.1126/science.275.5304.1293 · Cited by 3,547
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
The human orbitofrontal cortex: linking reward to hedonic experience
Kringelbach, M. L. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1747 · Cited by 2,180 · cited 1×
“Functional imaging work in humans has implicated various areas of prefrontal cortex (PFC), including OFC, medial PFC and ventrolateral PFC in value-related processes, using different paradigms (Cunningham et al., 2003; Paulus and Frank, 2003; Kringelbach, 2005; Montague et al., 2006).”
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
The neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733 · cited 2×
“…(for example, with gains leading to increases, and losses to decreases in OFC and striatal activity) (Elliott et al., 2003; Knutson et al., 2007; Tom et al., 2007), while other findings suggest that gains and losses may have quite different effects in different regions of the brain (Yacubian et…”
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · cited 2×
“Decision making and reinforcement learning studies have shown that orbitofrontal cortex (OFC) represents value information in non-human primates (Tremblay and Schultz, 1999; Roesch and Olson, 2004; Padoa-Schioppa and Assad, 2006).”
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · cited 3×
“…course involving stimulus evaluation, decision, anticipation of outcome, outcome receipt and learning, and different reinforcement-sensitive brain areas are clearly involved in these various phases in different ways (Tremblay and Schultz, 1999; Schultz et al., 2000; Satterthwaite et al., 2007).”
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 3×
“Furthermore, electrophysiological measurements of dopamine neuron activity have raised questions about whether the so-called ‘dips’ in dopamine release that follow negative feedback carry an adequate signal to support learning from such feedback in vivo (Bayer and Glimcher, 2005).”
Cited by
Hiser, J., & Koenigs, M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.10.030 · Cited by 972
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531
Insights into Human Behavior from Lesions to the Prefrontal Cortex
Szczepanski, S. M., & Knight, R. T. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.011 · Cited by 502
Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., Burke, K. A., & Schoenbaum, G. (2009) · Neuron · doi:10.1016/j.neuron.2009.03.005 · Cited by 284
Frontostriatal functional connectivity in major depressive disorder
Furman, D. J., Hamilton, J. P., & Gotlib, I. H. (2011) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-1-11 · Cited by 208
“Situated just rostral to the sACC, the vmPFC is associated with the production [36] and flexible shifting of emotional states [37] and behavior, as well as with reward processing [38] and reinforcement learning [39].”
Examination of neural systems sub-serving facebook addiction
Turel, O., He, Q., Xue, G., Xiao, L., & Bechara, A. (2014) · Psychological Reports · doi:10.2466/18.pr0.115c31z8 · Cited by 206
“This inhibitory system depends primarily on the functions of the prefrontal cortex (Fellows, 2004; Wheeler & Fellows, 2008).”
BackgroundTsuchida, A., Doll, B. B., & Fellows, L. K. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1958-10.2010 · Cited by 188
“This pattern may seem at odds with a previous lesion study demonstrating that OFC is critical for learning from negative, but not positive, feedback (Wheeler and Fellows, 2008).”
BackgroundResultSelf-citationNeural Components Underlying Behavioral Flexibility in Human Reversal Learning
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp247 · Cited by 180
Neural mechanism of intertemporal choice: From discounting future gains to future losses
Xu, L., Liang, Z.-Y., Wang, K., Li, S., & Jiang, T. (2009) · Brain Research · doi:10.1016/j.brainres.2008.12.061 · Cited by 161
“…in the VMPFC in L-TD compared with G-TD, which has been found in coding for subjective value of both gains and losses (Breiter et al., 2001; Knutson et al., 2000; Tom et al., 2007; Wheeler and Fellows, 2008), indicates that the subjective value of losses was different from that of equivalent gains.”
ResultSpecificity of performance monitoring changes in obsessive-compulsive disorder
Endrass, T., & Ullsperger, M. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.03.024 · Cited by 141
Posttraumatic stress disorder: a theoretical model of the hyperarousal subtype
Weston, C. S. E. (2014) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2014.00037 · Cited by 114
Connections of the human orbitofrontal cortex and inferior frontal gyrus
Heather Hsu, C.-C., Rolls, E. T., Huang, C.-C., Chong, S. T., Zac Lo, C.-Y., Feng, J., & Lin, C.-P. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa160 · Cited by 67
Sex-dependent effects on tasks assessing reinforcement learning and interference inhibition
Evans, K. L., & Hampson, E. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01044 · Cited by 52
“Healthy young participants were recruited from the University of Western Ontario and received monetary compensation or Frontiers in Psychology | www.frontiersin.org 2 July 2015 | Volume 6 | Article 1044 course credits for participating.”
BackgroundMethodInfluentialDissociable processes underlying decisions in the Iowa Gambling Task: a new integrative framework
Stocco, A., Fum, D., & Napoli, A. (2009) · Behavioral and Brain Functions · doi:10.1186/1744-9081-5-1 · Cited by 46
Metadata
- Authors
- Wheeler, E. Z., & Fellows, L. K.
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-03-15
- Volume
- 131
- Issue
- 5
- Pages
- 1323-1331
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2161221573
- Cited by
- 94
- References
- 23
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.