Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Summary Adaptive decision-making in dynamic environments requires multiple reinforcement-learning steps that may be implemented by dissociable neural circuits. Here we used a novel directionally-specific viral ablation approach to investigate the function of several anatomically-defined orbitofrontal cortex (OFC) circuits during adaptive, flexible decision-making in rats trained on a probabilistic reversal learning task. Ablation of OFC neurons projecting to the nucleus accumbens selectively disrupted performance following a reversal, by disrupting the use of negative outcomes to guide subsequent choices. Ablation of amygdala neurons projecting to the OFC also impaired reversal performance, but due to disruptions in the use of positive outcomes to guide subsequent choices. Ablation of OFC neurons projecting to the amygdala, by contrast, enhanced reversal performance by destabilizing action values. Our data are inconsistent with a unitary function of the OFC in decision making. Rather, distinct OFC-amygdala-striatal circuits mediate distinct components of the action-value updating and maintenance necessary for decision making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Using Generalized Estimating Equations for Longitudinal Data Analysis
Ballinger, G. A. (2004) · Organizational Research Methods · doi:10.1177/1094428104263672 · Cited by 1,567 · cited 1×
“…of a working correlation matrix to account for within-subject correlation of responses on dependent variables of different distributions, including normal, binomial, and Poisson, that yields unbiased regression parameters relative to ordinary least squares regression (Ballinger, 2004).”
Ridderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314
Kelley, A. E. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2003.11.015 · Cited by 942
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917 · cited 2×
“Nevertheless, amygdala neurons rapidly modulate their activity following a change in stimulus value (Paton et al., 2006), and emerging evidence indicates that separable neuronal populations encode positive or negative stimulus values (Paton et al.”
BackgroundOrbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678 · cited 1×
“We conducted a two-fold cross validation procedure (Ito and Doya, 2009) to compare the DF RL model to the F RL model that we have previously used (Barraclough et al., 2004; Groman et al., 2016, 2018).”
MethodSelf-citation
Cited by
Single-neuron projectome of mouse prefrontal cortex
Gao, L., Liu, S., Gou, L., Hu, Y., Liu, Y., Deng, L., Ma, D., Wang, H., Yang, Q., Chen, Z., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01041-5 · Cited by 264
Value-guided remapping of sensory cortex by lateral orbitofrontal cortex
Banerjee, A., Parente, G., Teutsch, J., Lewis, C., Voigt, F. F., & Helmchen, F. (2020) · Nature · doi:10.1038/s41586-020-2704-z · Cited by 199
Ahmari, S. E., & Rauch, S. L. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01130-2 · Cited by 95
Modulation of value-based decision making behavior by subregions of the rat prefrontal cortex
Verharen, J. P. H., den Ouden, H. E. M., Adan, R. A. H., & Vanderschuren, L. J. M. J. (2020) · Psychopharmacology · doi:10.1007/s00213-020-05454-7 · Cited by 81
Xie, C., Jia, T., Rolls, E. T., Robbins, T. W., Sahakian, B. J., Zhang, J., Liu, Z., Cheng, W., Luo, Q., Zac Lo, C.-Y., et al. (2021) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2020.08.017 · Cited by 64
Metadata
- Authors
- Groman, S. M., Keistler, C., Keip, A. J., Hammarlund, E., DiLeone, R. J., Pittenger, C., Lee, D., & Taylor, J. R.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2019-08
- Volume
- 103
- Issue
- 4
- Pages
- 734-746.e3
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2954669281
- Cited by
- 142
- References
- 29
- FWCI
- 10.95
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes. https://app.cochat.ai/papers/10.1016/j.neuron.2019.05.042
- The paper
- Groman, S. M., Keistler, C., Keip, A. J., Hammarlund, E., DiLeone, R. J., Pittenger, C., Lee, D., & Taylor, J. R. (2019). Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes. Neuron. https://doi.org/10.1016/j.neuron.2019.05.042
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.