The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes
Open accessAbstract
SUMMARY Humans and other animals change their behavior in response to unexpected outcomes. The orbitofrontal cortex (OFC) is implicated in such adaptive responding, based on evidence from reversal tasks. Yet these tasks confound using information about expected outcomes with learning when those expectations are violated. OFC is critical for the former function; here we show it is also critical for the latter. In a Pavlovian over-expectation task, inactivation of OFC prevented learning driven by unexpected outcomes, even when performance was assessed later. We propose this reflects a critical contribution of outcome signaling by OFC to encoding of reward prediction errors elsewhere. In accord with this proposal, we report that signaling of reward predictions by OFC neurons was related to signaling of prediction errors by dopamine neurons in ventral tegmental area (VTA). Furthermore, bilateral inactivation of VTA or contralateral inactivation of VTA and OFC disrupted learning driven by unexpected outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,462
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314
Research works printed but not linked: 1
- O'Doherty, 2002, Neural responses during anticipation of a primary taste reward, Neuron, 33, 815, 10.1016/S0896-6273(02)00603-7 · DOI · Paper page
Cited by
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Self-citationThe Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Self-citationWhat the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531
Self-citationHow prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512
Double dissociation of value computations in orbitofrontal and anterior cingulate neurons
Kennerley, S. W., Behrens, T. E. J., & Wallis, J. D. (2011) · Nature Neuroscience · doi:10.1038/nn.2961 · Cited by 454
What, If Anything, Is Rodent Prefrontal Cortex?
Laubach, M., Amarante, L. M., Swanson, K., & White, S. R. (2018) · eneuro · doi:10.1523/eneuro.0315-18.2018 · Cited by 441
Toward a neurobiology of delusions
Corlett, P. R., Taylor, J. R., Wang, X.-J., Fletcher, P. C., & Krystal, J. H. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.06.007 · Cited by 394
Rudebeck, P. H., & Murray, E. A. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.049 · Cited by 405
Walton, M. E., Behrens, T. E. J., Buckley, M. J., Rudebeck, P. H., & Rushworth, M. F. S. (2010) · Neuron · doi:10.1016/j.neuron.2010.02.027 · Cited by 397
Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision Making
Sul, J. H., Kim, H., Huh, N., Lee, D., & Jung, M. W. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.033 · Cited by 372
Orbitofrontal Cortex Supports Behavior and Learning Using Inferred But Not Cached Values
Jones, J. L., Esber, G. R., McDannald, M. A., Gruber, A. J., Hernandez, A., Mirenzi, A., & Schoenbaum, G. (2012) · Science · doi:10.1126/science.1227489 · Cited by 335
Self-citationChase, H. W., Eickhoff, S. B., Laird, A. R., & Hogarth, L. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.05.025 · Cited by 316
Dopamine transients are sufficient and necessary for acquisition of model-based associations
Sharpe, M. J., Chang, C. Y., Liu, M. A., Batchelor, H. M., Mueller, L. E., Jones, J. L., Niv, Y., & Schoenbaum, G. (2017) · Nature Neuroscience · doi:10.1038/nn.4538 · Cited by 300
Self-citationThe hippocampal-striatal axis in learning, prediction and goal-directed behavior
Pennartz, C. M. A., Ito, R., Verschure, P. F. M. J., Battaglia, F. P., & Robbins, T. W. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.08.001 · Cited by 287
Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex
Takahashi, Y. K., Roesch, M. R., Wilson, R. C., Toreson, K., O'Donnell, P., Niv, Y., & Schoenbaum, G. (2011) · Nature Neuroscience · doi:10.1038/nn.2957 · Cited by 280
“and interact with VTA to drive learning in response to prediction error”
BackgroundSelf-citationHu, H. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-014106 · Cited by 253
Functional Heterogeneity within Rat Orbitofrontal Cortex in Reward Learning and Decision Making
Izquierdo, A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1678-17.2017 · Cited by 258
Computational mechanisms of curiosity and goal-directed exploration
Schwartenbeck, P., Passecker, J., Hauser, T. U., FitzGerald, T. H., Kronbichler, M., & Friston, K. J. (2019) · eLife · doi:10.7554/elife.41703 · Cited by 254
Projections of the medial orbital and ventral orbital cortex in the rat
Hoover, W. B., & Vertes, R. P. (2011) · Journal of Comparative Neurology · doi:10.1002/cne.22733 · Cited by 252
The Teenage Brain: Sensitivity to Rewards
Galván, A. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721413480859 · Cited by 231
Does the orbitofrontal cortex signal value?
Schoenbaum, G., Takahashi, Y., Liu, T., & McDannald, M. A. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06210.x · Cited by 232
Self-citationBurke, A. R., McCormick, C. M., Pellis, S. M., & Lukkes, J. L. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.01.018 · Cited by 225
Behavioral and Neural Properties of Social Reinforcement Learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Libby, V., Glover, G., Voss, H. U., Ballon, D. J., & Casey, B. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2972-11.2011 · Cited by 191
Neural Components Underlying Behavioral Flexibility in Human Reversal Learning
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp247 · Cited by 180
Emotion and episodic memory in neuropsychiatric disorders
Dere, E., Pause, B. M., & Pietrowsky, R. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.03.017 · Cited by 165
Namboodiri, V. M. K., Otis, J. M., van Heeswijk, K., Voets, E. S., Alghorazi, R. A., Rodriguez-Romaguera, J., Mihalas, S., & Stuber, G. D. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0408-1 · Cited by 150
Winstanley, C. A., Zeeb, F. D., Bedard, A., Fu, K., Lai, B., Steele, C., & Wong, A. C. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.02.044 · Cited by 84
Strengthened Inputs from Secondary Motor Cortex to Striatum in a Mouse Model of Compulsive Behavior
Corbit, V. L., Manning, E. E., Gittis, A. H., & Ahmari, S. E. (2019) · The Journal of Neuroscience · doi:10.1523/jneurosci.1728-18.2018 · Cited by 80
“…1998; Maltby et al., 2005; Chamberlain et al., 2008; Burguière et al., 2013) and related behavioral constructs, including action selection, cognitive flexibility, and reversal learning (Schoenbaum et al., 2002; Takahashi et al., 2009; Sul et al., 2010; Dalton et al., 2016; Gremel et al., 2016).”
BackgroundBurke, K. A., Takahashi, Y. K., Correll, J., Leon Brown, P., & Schoenbaum, G. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06992.x · Cited by 76
Self-citationLasseter, H. C., Wells, A. M., Xie, X., & Fuchs, R. A. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.209 · Cited by 72
Cholinergic modulation of dopamine pathways through nicotinic acetylcholine receptors
de Kloet, S. F., Mansvelder, H. D., & De Vries, T. J. (2015) · Biochemical Pharmacology · doi:10.1016/j.bcp.2015.07.014 · Cited by 69
Hervig, M. E., Fiddian, L., Piilgaard, L., Božič, T., Blanco-Pozo, M., Knudsen, C., Olesen, S. F., Alsiö, J., & Robbins, T. W. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhz144 · Cited by 65
Inactivating anterior insular cortex reduces risk taking
Ishii, H., Ohara, S., Tobler, P. N., Tsutsui, K.-I., & Iijima, T. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.2278-12.2012 · Cited by 64
Ventral Tegmental Dopamine Dysregulation Prevents Appetitive Memory Destabilization
Reichelt, A. C., Exton-McGuinness, M. T., & Lee, J. L. C. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1614-13.2013 · Cited by 61
Clarke, H. F., Cardinal, R. N., Rygula, R., Hong, Y. T., Fryer, T. D., Sawiak, S. J., Ferrari, V., Cockcroft, G., Aigbirhio, F. I., Robbins, T. W., et al. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0718-14.2014 · Cited by 54
Atomoxetine facilitates attentional set shifting in adolescent rats
Cain, R. E., Wasserman, M. C., Waterhouse, B. D., & McGaughy, J. A. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.04.003 · Cited by 55
Rossato, J. I., Köhler, C. A., Radiske, A., Lima, R. H., Bevilaqua, L. R. M., & Cammarota, M. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2014.09.009 · Cited by 48
Merlo, E., Ratano, P., Ilioi, E. C., Robbins, M. A. L. S., Everitt, B. J., & Milton, A. L. (2015) · eneuro · doi:10.1523/eneuro.0024-14.2015 · Cited by 38
Wood, J., LaPalombara, Z., & Ahmari, S. E. (2018) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2017.0023 · Cited by 41
Pauli, W. M., Hazy, T. E., & O'Reilly, R. C. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00155 · Cited by 32
Metadata
- Authors
- Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., Burke, K. A., & Schoenbaum, G.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2009-04
- Volume
- 62
- Issue
- 2
- Pages
- 269-280
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2092935454
- Cited by
- 284
- References
- 49
- FWCI
- 10.51
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 1568 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.