Neural Estimates of Imagined Outcomes in the Orbitofrontal Cortex Drive Behavior and Learning
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
SUMMARY Imagination, defined as the ability to interpret reality in ways that diverge from past experience, is fundamental to adaptive behavior. This can be seen at a simple level in our capacity to predict novel outcomes in new situations. The ability to anticipate outcomes never before received can also influence learning if those imagined outcomes are not received. The orbitofrontal cortex is a key candidate for where the process of imagining likely outcomes occurs; however its precise role in generating these estimates and applying them to learning remain open questions. Here we address these questions by showing that single-unit activity in orbitofrontal cortex reflects novel outcome estimates. The strength of these neural correlates predicted both behavior and learning, learning which was abolished by temporally-specific inhibition of orbitofrontal neurons. These results are consistent with the proposal that the orbitofrontal cortex is critical for integrating information to imagine future outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Ongur, D. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.206 · Cited by 2,627
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
The root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314
Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Neural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855
Hornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., & Polkey, C. E. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322926791 · Cited by 603
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600
Orbitofrontal Cortex and Representation of Incentive Value in Associative Learning
Gallagher, M., McMahan, R. W., & Schoenbaum, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-15-06610.1999 · Cited by 593 · cited 2×
“While these observations do not by themselves preclude a role in also signaling the significance of the individual cues, this role cannot be unique to the OFC, since inactivation or damage of this area does not generally affect Pavlovian conditioned responding or even discrimination learning where performance can be b…”
Self-citationIzquierdo, A., Suda, R. K., & Murray, E. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-04.2004 · Cited by 588
Groenewegen, H. J., Berendse, H. W., Wolters, J. G., & Lohman, A. H. M. (1991) · Progress in brain research · doi:10.1016/s0079-6123(08)62677-1 · Cited by 506
Critchley, H. D., & Rolls, E. T. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.4.1673 · Cited by 468
PRICE, J. L. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.008 · Cited by 395 · cited 1×
“However, major afferent areas to the OFC (Groenewegen et al., 1990; Kahnt et al., 2012; Ongür and Price, 2000; Price, 2007), such as amygdala, medial temporal lobe, or even other prefrontal areas, typically do not have OFC’s broad involvement in tasks that require integration and novel expectancies.”
Le Pelley, M. E. (2004) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724990344000141 · Cited by 360
Connectivity-based parcellation of the human orbitofrontal cortex
Kahnt, T., Chang, L. J., Park, S. Q., Heinzle, J., & Haynes, J.-D. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0257-12.2012 · Cited by 299 · cited 1×
“However, major afferent areas to the OFC (Groenewegen et al., 1990; Kahnt et al., 2012; Ongür and Price, 2000; Price, 2007), such as amygdala, medial temporal lobe, or even other prefrontal areas, typically do not have OFC’s broad involvement in tasks that require integration and novel expectancies.”
Málková, L., Gaffan, D., & Murray, E. A. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-15-06011.1997 · Cited by 295 · cited 1×
“, 1998), and while the basolateral amygdala is important for reinforcer devaluation (Hatfield et al., 1996; Málková et al., 1997), it appears to be preferentially involved in the learning rather than the performance phase (Pickens et al.”
Range-adapting representation of economic value in the orbitofrontal cortex
Padoa-Schioppa, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3751-09.2009 · Cited by 276
Human neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209
Rudebeck, P. H., & Murray, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2272-08.2008 · Cited by 148 · cited 1×
“Indeed, in some recent work, removing the amygdala can facilitate reversal learning (Rudebeck and Murray, 2008).”
GABAA-Mediated Inhibition of Basolateral Amygdala Blocks Reward Devaluation in Macaques
Wellman, L. L., Gale, K., & Malkova, L. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2257-04.2005 · Cited by 126
Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning
Izquierdo, A., & Murray, E. A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3616-06.2007 · Cited by 121
Machado, C. J., & Bachevalier, J. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05525.x · Cited by 120
Choice Coding in Frontal Cortex during Stimulus-Guided or Action-Guided Decision-Making
Luk, C.-H., & Wallis, J. D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4920-12.2013 · Cited by 96
Chudasama, Y., Wright, K. S., & Murray, E. A. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.11.012 · Cited by 65 · cited 1×
“For example, rhinal and hippocampal areas are not required for reinforcer devaluation effects (Chudasama et al., 2008; Thornton et al., 1998), and while the basolateral amygdala is important for reinforcer devaluation (Hatfield et al.”
Thornton, J. A., Malkova, L., & Murray, E. A. (1998) · Behavioral Neuroscience · doi:10.1037/0735-7044.112.4.1020 · Cited by 32
Cited by
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531
Self-citationDecoding subjective decisions from orbitofrontal cortex
Rich, E. L., & Wallis, J. D. (2016) · Nature Neuroscience · doi:10.1038/nn.4320 · Cited by 371
Preparation of Acute Brain Slices Using an Optimized N-Methyl-D-glucamine Protective Recovery Method
Ting, J. T., Lee, B. R., Chong, P., Soler-Llavina, G., Cobbs, C., Koch, C., Zeng, H., & Lein, E. (2018) · Journal of Visualized Experiments · doi:10.3791/53825 · Cited by 314
Functional Heterogeneity within Rat Orbitofrontal Cortex in Reward Learning and Decision Making
Izquierdo, A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1678-17.2017 · Cited by 258
Basolateral amygdala to orbitofrontal cortex projections enable cue-triggered reward expectations
Lichtenberg, N. T., Pennington, Z. T., Holley, S. M., Greenfield, V. Y., Cepeda, C., Levine, M. S., & Wassum, K. M. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.0486-17.2017 · Cited by 171
“…acquire reward representations, whereas the OFC is more important for using this information to generate the expectations that guide action (Pickens et al., 2003; Wellman et al., 2005; Wassum et al., 2009; Jones et al., 2012; Parkes and Balleine, 2013; Takahashi et al., 2013; Gore et al., 2015).”
Metadata
- Authors
- Takahashi, Y. K., Chang, C. Y., Lucantonio, F., Haney, R. Z., Berg, B. A., Yau, H.-J., Bonci, A., & Schoenbaum, G.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2013-10
- Volume
- 80
- Issue
- 2
- Pages
- 507-518
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W1969923483
- Cited by
- 84
- References
- 27
- FWCI
- 4.71
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.