The human ventromedial frontal lobe is critical for learning from negative feedback
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Are positive and negative feedback weighed in a common balance in the brain, or do they influence behaviour through distinct neural mechanisms? Recent neuroeconomic studies in both human and non-human primates indicate that the ventromedial frontal lobe carries information about both losses and gains, suggesting that this region may encode value across the continuum from absolute negative to absolute positive outcomes. However, such work does not specify whether or how this value information is applied during behaviour. Observations of patients with ventromedial frontal damage indicate that this region is critical for certain forms of reinforcement learning and value-based decision-making, but the underlying processes remain unclear. We disentangled the influence of cumulative positive and negative feedback on subsequent behaviour with a probabilistic reinforcement learning task in 11 patients with ventromedial frontal damage, 9 lesioned controls and 24 healthy controls, and found that ventromedial frontal damage selectively disrupted the ability to learn from negative feedback.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Deciding advantageously before knowing the advantageous strategy
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997) · Science · doi:10.1126/science.275.5304.1293 · Cited by 3,547
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
The human orbitofrontal cortex: linking reward to hedonic experience
Kringelbach, M. L. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1747 · Cited by 2,180 · cited 1×
“Functional imaging work in humans has implicated various areas of prefrontal cortex (PFC), including OFC, medial PFC and ventrolateral PFC in value-related processes, using different paradigms (Cunningham et al., 2003; Paulus and Frank, 2003; Kringelbach, 2005; Montague et al., 2006).”
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
The neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733 · cited 2×
“…(for example, with gains leading to increases, and losses to decreases in OFC and striatal activity) (Elliott et al., 2003; Knutson et al., 2007; Tom et al., 2007), while other findings suggest that gains and losses may have quite different effects in different regions of the brain (Yacubian et…”
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · cited 3×
“…course involving stimulus evaluation, decision, anticipation of outcome, outcome receipt and learning, and different reinforcement-sensitive brain areas are clearly involved in these various phases in different ways (Tremblay and Schultz, 1999; Schultz et al., 2000; Satterthwaite et al., 2007).”
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 3×
“Furthermore, electrophysiological measurements of dopamine neuron activity have raised questions about whether the so-called ‘dips’ in dopamine release that follow negative feedback carry an adequate signal to support learning from such feedback in vivo (Bayer and Glimcher, 2005).”
Neural Predictors of Purchases
Knutson, B., Rick, S., Wimmer, G. E., Prelec, D., & Loewenstein, G. (2007) · Neuron · doi:10.1016/j.neuron.2006.11.010 · Cited by 1,171 · cited 4×
“Where punishment (in humans, typically in the form of financial loss) has been studied, some data argue that information about gains and losses is encoded in a common circuitry (for example, with gains leading to increases, and losses to decreases in OFC and striatal activity) (Elliott et al., 2003; Knutson et al., 20…”
InfluentialAdult clinical neuropsychology: lessons from studies of the frontal lobes
Stuss, D. T., & Levine, B. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135220 · Cited by 992 · cited 2×
“A neurologist reviewed the clinical imaging, and assigned each patient a priori to one of two groups, based on whether their damage involved or spared VMF, following the boundaries described in (Stuss and Levine, 2002).”
Reward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942
Fellows, L. K. (2003) · Brain · doi:10.1093/brain/awg180 · Cited by 631
Self-citationO'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
Yacubian, J., Gläscher, J., Schroeder, K., Sommer, T., Braus, D. F., & Büchel, C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2915-06.2006 · Cited by 537
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536
Opponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · cited 2×
“, 2006), others, such as amygdala and various regions within PFC, show response patterns that differ for losses and gains, at least in some paradigms (Bayer and Glimcher, 2005; Seymour et al., 2005; Yacubian et al., 2006; Knutson et al., 2007; Liu et al., 2007).”
Fellows, L. K., & Farah, M. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl176 · Cited by 337
Self-citationMurray, E. A., O'Doherty, J. P., & Schoenbaum, G. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1556-07.2007 · Cited by 238
Neural components of social evaluation.
Cunningham, W. A., Johnson, M. K., Gatenby, J. C., Gore, J. C., & Banaji, M. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.4.639 · Cited by 219
Mnemonic functions of the basal ganglia
White, N. M. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80004-9 · Cited by 204 · cited 2×
“There is now substantial evidence that phasic dopamine release follows such a pattern, and is likely to be important in incrementally acquired responses tendencies (so-called ‘habit’ learning) in the striatum (Knowlton et al., 1996; White, 1997; Schultz, 2002).”
Medial frontal cortex activity and loss-related responses to errors
Taylor, S. F., Martis, B., Fitzgerald, K. D., Welsh, R. C., Abelson, J. L., Liberzon, I., Himle, J. A., & Gehring, W. J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4709-05.2006 · Cited by 160 · cited 2×
“…feedback is consistent with the extensive literature implicating this region in reversal learning, extinction, fear conditioning, (Roberts, 2006; Taylor et al., 2006) and even regret and envy (Camille et al., 2004; Shamay-Tsoory et al., 2007), it is harder to reconcile with recent…”
Cited by
Hiser, J., & Koenigs, M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.10.030 · Cited by 972
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531
Insights into Human Behavior from Lesions to the Prefrontal Cortex
Szczepanski, S. M., & Knight, R. T. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.011 · Cited by 502
Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., Burke, K. A., & Schoenbaum, G. (2009) · Neuron · doi:10.1016/j.neuron.2009.03.005 · Cited by 284
Metadata
- Authors
- Wheeler, E. Z., & Fellows, L. K.
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-03-15
- Volume
- 131
- Issue
- 5
- Pages
- 1323-1331
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2161221573
- Cited by
- 94
- References
- 23
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.