The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes
Open accessAbstract
SUMMARY Humans and other animals change their behavior in response to unexpected outcomes. The orbitofrontal cortex (OFC) is implicated in such adaptive responding, based on evidence from reversal tasks. Yet these tasks confound using information about expected outcomes with learning when those expectations are violated. OFC is critical for the former function; here we show it is also critical for the latter. In a Pavlovian over-expectation task, inactivation of OFC prevented learning driven by unexpected outcomes, even when performance was assessed later. We propose this reflects a critical contribution of outcome signaling by OFC to encoding of reward prediction errors elsewhere. In accord with this proposal, we report that signaling of reward predictions by OFC neurons was related to signaling of prediction errors by dopamine neurons in ventral tegmental area (VTA). Furthermore, bilateral inactivation of VTA or contralateral inactivation of VTA and OFC disrupted learning driven by unexpected outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,464
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917
Limbic lesions and the problem of stimulus—Reinforcement associations
Jones, B., & Mishkin, M. (1972) · Experimental Neurology · doi:10.1016/0014-4886(72)90030-1 · Cited by 868
Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning
Schoenbaum, G., Chiba, A. A., & Gallagher, M. (1998) · Nature Neuroscience · doi:10.1038/407 · Cited by 850
Self-citationHare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792
Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat
McAlonan, K., & Brown, V. J. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.019 · Cited by 618
Hornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., & Polkey, C. E. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322926791 · Cited by 603
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
Self-citationOrbitofrontal Cortex and Representation of Incentive Value in Associative Learning
Gallagher, M., McMahan, R. W., & Schoenbaum, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-15-06610.1999 · Cited by 593
Self-citationIzquierdo, A., Suda, R. K., & Murray, E. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-04.2004 · Cited by 588
Hatfield, T., Han, J.-S., Conley, M., Gallagher, M., & Holland, P. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-16-05256.1996 · Cited by 555
Chudasama, Y., & Robbins, T. W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-25-08771.2003 · Cited by 543
Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429
Different Roles for Orbitofrontal Cortex and Basolateral Amygdala in a Reinforcer Devaluation Task
Pickens, C. L., Saddoris, M. P., Setlow, B., Gallagher, M., Holland, P. C., & Schoenbaum, G. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-35-11078.2003 · Cited by 384
Self-citationOrbitofrontal Cortex Mediates Outcome Encoding in Pavlovian But Not Instrumental Conditioning
Ostlund, S. B., & Balleine, B. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5443-06.2007 · Cited by 379
Arana, F. S., Parkinson, J. A., Hinton, E., Holland, A. J., Owen, A. M., & Roberts, A. C. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-29-09632.2003 · Cited by 345
Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations
Schoenbaum, G., Nugent, S. L., Saddoris, M. P., & Setlow, B. (2002) · Neuroreport · doi:10.1097/00001756-200205070-00030 · Cited by 319
Self-citationSchoenbaum, G., Setlow, B., Nugent, S. L., Saddoris, M. P., & Gallagher, M. (2003) · Learning & Memory · doi:10.1101/lm.55203 · Cited by 307
Self-citationEncoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation
Roesch, M. R., Taylor, A. R., & Schoenbaum, G. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.027 · Cited by 297
Self-citationRepresentation of Spatial Goals in Rat Orbitofrontal Cortex
Feierstein, C. E., Quirk, M. C., Uchida, N., Sosulski, D. L., & Mainen, Z. F. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.032 · Cited by 252
Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention
Nobre, A. C., Coull, J. T., Frith, C. D., & Mesulam, M. M. (1999) · Nature Neuroscience · doi:10.1038/4513 · Cited by 249
Rapid Associative Encoding in Basolateral Amygdala Depends on Connections with Orbitofrontal Cortex
Saddoris, M. P., Gallagher, M., & Schoenbaum, G. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.018 · Cited by 215
Self-citationHuman neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209
The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards
Burke, K. A., Franz, T. M., Miller, D. N., & Schoenbaum, G. (2008) · Nature · doi:10.1038/nature06993 · Cited by 180
Self-citationBasolateral Amygdala Lesions Abolish Orbitofrontal-Dependent Reversal Impairments
Stalnaker, T. A., Franz, T. M., Singh, T., & Schoenbaum, G. (2007) · Neuron · doi:10.1016/j.neuron.2007.02.014 · Cited by 178
Self-citationHolland, P. C., & Gallagher, M. (1993) · Behavioral Neuroscience · doi:10.1037//0735-7044.107.2.246 · Cited by 160
Orbitofrontal Lesions Impair Use of Cue-Outcome Associations in a Devaluation Task.
Pickens, C. L., Saddoris, M. P., Gallagher, M., & Holland, P. C. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.1.317 · Cited by 155
Reduction in the effectiveness of reinforcement after prior excitatory conditioning
Rescorla, R. A. (1970) · Learning and Motivation · doi:10.1016/0023-9690(70)90101-3 · Cited by 147
The human ventromedial frontal lobe is critical for learning from negative feedback
Wheeler, E. Z., & Fellows, L. K. (2008) · Brain · doi:10.1093/brain/awn041 · Cited by 110
Murschall, A., & Hauber, W. (2006) · Learning & Memory · doi:10.1101/lm.127106 · Cited by 101
Izquierdo, A., & Murray, E. A. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04434.x · Cited by 99
McDannald, M. A., Saddoris, M. P., Gallagher, M., & Holland, P. C. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.5301-04.2005 · Cited by 88
Overexpectation in appetitive Pavlovian and instrumental conditioning
Lattal, K. M., & Nakajima, S. (1998) · Animal Learning & Behavior · doi:10.3758/bf03199227 · Cited by 85
Stalnaker, T. A., Roesch, M. R., Franz, T. M., Burke, K. A., & Schoenbaum, G. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.05128.x · Cited by 84
Self-citationChudasama, Y., Kralik, J. D., & Murray, E. A. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl025 · Cited by 59
Research works printed but not linked: 1
- O'Doherty, 2002, Neural responses during anticipation of a primary taste reward, Neuron, 33, 815, 10.1016/S0896-6273(02)00603-7 · DOI · Paper page
Cited by
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Self-citationThe Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Self-citation
Metadata
- Authors
- Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., Burke, K. A., & Schoenbaum, G.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2009-04
- Volume
- 62
- Issue
- 2
- Pages
- 269-280
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2092935454
- Cited by
- 284
- References
- 49
- FWCI
- 10.51
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 1568 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.