The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes
Open accessAbstract
SUMMARY Humans and other animals change their behavior in response to unexpected outcomes. The orbitofrontal cortex (OFC) is implicated in such adaptive responding, based on evidence from reversal tasks. Yet these tasks confound using information about expected outcomes with learning when those expectations are violated. OFC is critical for the former function; here we show it is also critical for the latter. In a Pavlovian over-expectation task, inactivation of OFC prevented learning driven by unexpected outcomes, even when performance was assessed later. We propose this reflects a critical contribution of outcome signaling by OFC to encoding of reward prediction errors elsewhere. In accord with this proposal, we report that signaling of reward predictions by OFC neurons was related to signaling of prediction errors by dopamine neurons in ventral tegmental area (VTA). Furthermore, bilateral inactivation of VTA or contralateral inactivation of VTA and OFC disrupted learning driven by unexpected outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792
Research works printed but not linked: 30
- Arana, 2003, Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection, J. Neurosci., 23, 9632, 10.1523/JNEUROSCI.23-29-09632.2003 · DOI · Paper page
- Brown, 2003, Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat, Behav. Brain Res., 146, 97, 10.1016/j.bbr.2003.09.019 · DOI · Paper page
- Burke, 2008, The role of orbitofrontal cortex in the pursuit of happiness and more specific rewards, Nature, 454, 340, 10.1038/nature06993 · DOI
- Chudasama, 2007, Rhesus monkeys with orbital prefrontal cortex lesions can learn to inhibit prepotent responses in the reversed reward contingency task, Cereb. Cortex, 17, 1154, 10.1093/cercor/bhl025 · DOI
- Feierstein, 2006, Representation of spatial goals in rat orbitofrontal cortex, Neuron, 51, 495, 10.1016/j.neuron.2006.06.032 · DOI · Paper page
- Hatfield, 1996, Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects, J. Neurosci., 16, 5256, 10.1523/JNEUROSCI.16-16-05256.1996 · DOI · Paper page
- Holland, 1993, Amygdala central nucleus lesions disrupt increments, but not decrements, in conditioned stimulus processing, Behav. Neurosci., 107, 246, 10.1037/0735-7044.107.2.246 · DOI
- Izquierdo, 2005, Opposing effects of amygdala and orbital prefrontal cortex lesions on the extinction of instrumental responding in macaque monkeys, Eur. J. Neurosci., 22, 2341, 10.1111/j.1460-9568.2005.04434.x · DOI
- Izquierdo, 2004, Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency, J. Neurosci., 24, 7540, 10.1523/JNEUROSCI.1921-04.2004 · DOI · Paper page
- Jones, 1972, Limbic lesions and the problem of stimulus-reinforcement associations, Exp. Neurol., 36, 362, 10.1016/0014-4886(72)90030-1 · DOI · Paper page
- Lattal, 1998, Overexpectation in appetitive Pavlovian and instrumental conditioning, Anim. Learn. Behav., 26, 351, 10.3758/BF03199227 · DOI
- McDannald, 2005, Lesions of orbitofrontal cortex impair rats' differential outcome expectancy learning but not conditioned stimulus-potentiated feeding, J. Neurosci., 25, 4626, 10.1523/JNEUROSCI.5301-04.2005 · DOI
- Montague, 1996, A framework for mesencephalic dopamine systems based on predictive hebbian learning, J. Neurosci., 16, 1936, 10.1523/JNEUROSCI.16-05-01936.1996 · DOI · Paper page
- Murschall, 2006, Inactivation of the ventral tegmental area abolished the general excitatory influence of Pavlovian cues on instrumental performance, Learn. Mem., 13, 123, 10.1101/lm.127106 · DOI
- Nobre, 1999, Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention, Nat. Neurosci., 2, 11, 10.1038/4513 · DOI
- O'Doherty, 2002, Neural responses during anticipation of a primary taste reward, Neuron, 33, 815, 10.1016/S0896-6273(02)00603-7 · DOI · Paper page
- O'Doherty, 2002, Neural responses during anticipation of a primary taste reward, Neuron, 33, 815, 10.1016/S0896-6273(02)00603-7 · DOI · Paper page
- Pan, 2005, Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network, J. Neurosci., 25, 6235, 10.1523/JNEUROSCI.1478-05.2005 · DOI · Paper page
- Pickens, 2003, Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task, J. Neurosci., 23, 11078, 10.1523/JNEUROSCI.23-35-11078.2003 · DOI · Paper page
- Pickens, 2005, Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task, Behav. Neurosci., 119, 317, 10.1037/0735-7044.119.1.317 · DOI
- Rescorla, 1970, Reduction in the effectiveness of reinforcement after prior excitatory conditioning, Learn. Motiv., 1, 372, 10.1016/0023-9690(70)90101-3 · DOI
- Roesch, 2007, Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards, Nat. Neurosci., 10, 1615, 10.1038/nn2013 · DOI · Paper page
- Saddoris, 2005, Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex, Neuron, 46, 321, 10.1016/j.neuron.2005.02.018 · DOI
- Schoenbaum, 1998, Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning, Nat. Neurosci., 1, 155, 10.1038/407 · DOI · Paper page
- Schoenbaum, 2003, Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals, Learn. Mem., 10, 129, 10.1101/lm.55203 · DOI · Paper page
- Stalnaker, 2006, Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making, Eur. J. Neurosci., 24, 2643, 10.1111/j.1460-9568.2006.05128.x · DOI
- Stalnaker, 2007, Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments, Neuron, 54, 51, 10.1016/j.neuron.2007.02.014 · DOI
- Tremblay, 1999, Relative reward preference in primate orbitofrontal cortex, Nature, 398, 704, 10.1038/19525 · DOI · Paper page
- Waelti, 2001, Dopamine responses comply with basic assumptions of formal learning theory, Nature, 412, 43, 10.1038/35083500 · DOI · Paper page
- Wheeler, 2008, The human ventromedial frontal lobe is critical for learning from negative feedback, Brain, 131, 1323, 10.1093/brain/awn041 · DOI
Cited by
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Self-citationThe Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Self-citation
Metadata
- Authors
- Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., Burke, K. A., & Schoenbaum, G.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2009-04
- Volume
- 62
- Issue
- 2
- Pages
- 269-280
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2092935454
- Cited by
- 284
- References
- 16
- FWCI
- 10.51
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 1568 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes. https://app.cochat.ai/papers/10.1016/j.neuron.2009.03.005
- The paper
- Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., Burke, K. A., & Schoenbaum, G. (2009). The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes. Neuron. https://doi.org/10.1016/j.neuron.2009.03.005
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.