Toward a theoretical role for tonic norepinephrine in the orbitofrontal cortex in facilitating flexible learning
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
To adaptively respond in a complex, changing world, animals need to flexibily update their understanding of the world when their expectations are violated. Though several brain regions in rodents and primates have been implicated in aspects of this updating, current models of orbitofrontal cortex (OFC) and norepinephrine neurons of the locus coeruleus (LC-NE) suggest that each plays a role in responding to environmental change, where the OFC allows updating of prior learning to occur without overwriting or unlearning one’s previous understanding of the world that changed, while elevated tonic NE allows for increased flexibility in behavior that tracks an animal’s uncertainty. In light of recent studies highlighting a specific LC-NE projection to the OFC, in this review we discuss current models of OFC and NE function, and their potential synergy in the updating of associations following environmental change.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Berridge, C. W., & Waterhouse, B. D. (2003) · Brain Research Reviews · doi:10.1016/s0165-0173(03)00143-7 · Cited by 2,529 · cited 1×
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript different effects than maximal increases (Berridge and Waterhouse, 2003).”
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 1×
“…of that choice, or between salient outcomes and their predictors in the environment), computational theories of tonic NE function note that this uncertainty signal may play a role in driving behavioral change to cope with a changing environment (Yu and Dayan, 2005, Cohen et al., 2007, Doya, 2008).”
Cohen, J. D., McClure, S. M., & Yu, A. J. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2098 · Cited by 1,121
Addiction: A Disease of Learning and Memory
Hyman, S. E. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1414 · Cited by 980
Cools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906 · cited 1×
“…1992, Bari et al., 2010, Furr et al., 2012), though this might be receptor dependent (see Boulougouris et al., 2008), and low levels of dopamine can speed reversal learning (Crofts et al., 2001), while high levels can lead to perseverative responding (Ridley et al., 1981, Cools et al., 2001).”
Role of locus coeruleus in attention and behavioral flexibility
Aston-Jones, G., Rajkowski, J., & Cohen, J. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(99)00140-7 · Cited by 900
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885 · cited 2×
“…A uthor M anuscript such models, each configuration of features to which learning can be assigned is termed a ‘state’: the dilemma is then between assigning learning to an existing state, or creating a new state to index the unexpected experience (Redish et al., 2007, Wilson et al., 2014).”
Self-citationViral-genetic tracing of the input-output organization of a central noradrenaline circuit
Schwarz, L. A., Miyamichi, K., Gao, X. J., Beier, K. T., Weissbourd, B., DeLoach, K. E., Ren, J., Ibanes, S., Malenka, R. C., Kremer, E. J., et al. (2015) · Nature · doi:10.1038/nature14600 · Cited by 744 · cited 1×
“One study explored the relationship of inputs to LC neurons on the subsequent projections of those neurons (Schwarz et al., 2015).”
Rational regulation of learning dynamics by pupil-linked arousal systems
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012) · Nature Neuroscience · doi:10.1038/nn.3130 · Cited by 722 · cited 1×
“…and the production of exploratory behavior would be advantageous: changes in LC activity are correlated with environmental uncertainty (Payzan-LeNestour et al., 2013), are correlated with changes in learning rate (Nassar et al., 2012), and precede changes in behavior (Bouret and Sara, 2004).”
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · cited 1×
“…of that choice, or between salient outcomes and their predictors in the environment), computational theories of tonic NE function note that this uncertainty signal may play a role in driving behavioral change to cope with a changing environment (Yu and Dayan, 2005, Cohen et al., 2007, Doya, 2008).”
Cognitive Inflexibility After Prefrontal Serotonin Depletion
Clarke, H. F., Dalley, J. W., Crofts, H. S., Robbins, T. W., & Roberts, A. C. (2004) · Science · doi:10.1126/science.1094987 · Cited by 632
Stress-related noradrenergic activity prompts large-scale neural network reconfiguration
Hermans, E. J., van Marle, H. J. F., Ossewaarde, L., Henckens, M. J. A. G., Qin, S., van Kesteren, M. T. R., Schoots, V. C., Cousijn, H., Rijpkema, M., Oostenveld, R., et al. (2011) · Science · doi:10.1126/science.1209603 · Cited by 627
Schoenbaum, G., Chiba, A. A., & Gallagher, M. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01876.1999 · Cited by 579 · cited 1×
“Interestingly, remapping in OFC seems to lag the remapping of neurons in other regions (like the amygdala), and behavior (Schoenbaum et al., 1999), further suggesting that the activity of OFC neurons is correlated not with changes in behavior following errors in prediction, but instead is…”
Self-citationArnsten, A. F. T., Wang, M. J., & Paspalas, C. D. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.038 · Cited by 538 · cited 1×
“…behavior, as their balance in frontal cortex seems essential for local circuit function thought to underlie aspects of working memory and cognitive control (Arnsten et al., 2012), and the study of their interaction in OFC in the cognitive flexibility described here may be particularly fruitful.”
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531 · cited 1×
“Notably, this model also describes OFC’s role in a range of other tasks (Stalnaker et al., 2015) Damage to the OFC causes deficits consistent with a loss of state information, and the activity of OFC neurons themselves is well described by models of learning state representations.”
Self-citationOpponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Context, learning, and extinction
Gershman, S. J., Blei, D. M., & Niv, Y. (2010) · Psychological Review · doi:10.1037/a0017808 · Cited by 386 · cited 1×
“…states similar to the role we describe for OFC here, and Redish and colleagues have a prominent model (Redish et al., 2007), extended by others (Gershman et al., 2010), suggesting low levels of dopamine in the hippocampus might produce the state-creating effects we attribute to rising tonic NE…”
Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.784 · Cited by 346 · cited 3×
“…A uthor M anuscript such models, each configuration of features to which learning can be assigned is termed a ‘state’: the dilemma is then between assigning learning to an existing state, or creating a new state to index the unexpected experience (Redish et al., 2007, Wilson et al., 2014).”
Heterogeneous organization of the locus coeruleus projections to prefrontal and motor cortices
Chandler, D. J., Gao, W.-J., & Waterhouse, B. D. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320827111 · Cited by 341
Bari, A., Theobald, D. E., Caprioli, D., Mar, A. C., Aidoo-Micah, A., Dalley, J. W., & Robbins, T. W. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.233 · Cited by 325
Crofts, H. S. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.11.1015 · Cited by 284 · cited 1×
“…1992, Bari et al., 2010, Furr et al., 2012), though this might be receptor dependent (see Boulougouris et al., 2008), and low levels of dopamine can speed reversal learning (Crofts et al., 2001), while high levels can lead to perseverative responding (Ridley et al., 1981, Cools et al., 2001).”
The neural representation of unexpected uncertainty during value-based decision making
Payzan-LeNestour, E., Dunne, S., Bossaerts, P., & O’Doherty, J. P. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.037 · Cited by 257
Noradrenergic Suppression of Synaptic Transmission May Influence Cortical Signal-to-Noise Ratio
Hasselmo, M. E., Linster, C., Patil, M., Ma, D., & Cekic, M. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.6.3326 · Cited by 229 · cited 1×
“This seems particularly plausible, as tonic NE has been specifically implicated in functional connectivity changes that might lead to remapping-like effects by changing the relative strength of afferent vs. local, intrinsic input to a region (Hasselmo et al., 1997).”
McGaughy, J., Ross, R. S., & Eichenbaum, H. (2008) · Neuroscience · doi:10.1016/j.neuroscience.2008.01.064 · Cited by 226 · cited 1×
“…manipulations, as ablation of NE inputs to mPFC disrupts mPFCdependent set-shifting behavior, but has no impact on OFC-dependent reversal learning (McGaughy et al., 2008), a sign that there may be fundamental differences between local and global manipulation of NE in a range of learning tasks.”
Boulougouris, V., Glennon, J. C., & Robbins, T. W. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301584 · Cited by 219 · cited 1×
“…et al., 2004, Evers et al., 2005) and rats (Nomura, 1992, Bari et al., 2010, Furr et al., 2012), though this might be receptor dependent (see Boulougouris et al., 2008), and low levels of dopamine can speed reversal learning (Crofts et al., 2001), while high levels can lead to perseverative…”
Brain mechanisms for perceptual and reward-related decision-making
Deco, G., Rolls, E. T., Albantakis, L., & Romo, R. (2013) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2012.01.010 · Cited by 196
Gradual extinction prevents the return of fear: implications for the discovery of state
Gershman, S. J., Jones, C. E., Norman, K. A., Monfils, M.-H., & Niv, Y. (2013) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2013.00164 · Cited by 160 · cited 1×
“…knowledge as, for example, when sounds that were formerly predictors of threats are now non-threatening, or when the use of a formerly pleasurable drug no longer evokes the same pleasure or now leads to adverse outcomes (Hyman, 2005, Redish et al., 2007, Gershman et al., 2013, Vanes et al., 2014).”
Detecting Neural-State Transitions Using Hidden Markov Models for Motor Cortical Prostheses
Kemere, C., Santhanam, G., Yu, B. M., Afshar, A., Ryu, S. I., Meng, T. H., & Shenoy, K. V. (2008) · Journal of Neurophysiology · doi:10.1152/jn.00924.2007 · Cited by 157
Rudebeck, P. H., & Murray, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2272-08.2008 · Cited by 148 · cited 1×
“The impairment in flexible learning caused by OFC lesions (Teitelbaum, 1964, Schoenbaum et al., 2002, Stalnaker et al., 2007, Rudebeck and Murray, 2008) and inactivation (GhodsSharifi et al., 2008, Burke et al., 2009) is described by recent modeling (Wilson et al., 2014) as an inability to create a…”
Neural dynamics of choice: Single-trial analysis of decision-related activity in parietal cortex
Bollimunta, A., Totten, D., & Ditterich, J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5752-11.2012 · Cited by 83 · cited 1×
“Such ‘firing rate-state’ models have been successful in modeling both choice related hidden variables and the dynamics of perceptual processes (Seidemann et al., 1996, Jones et al., 2007, Kemere et al., 2008, Bollimunta et al., 2012, Deco et al., 2013, Moran and Katz, 2014).”
Burke, K. A., Takahashi, Y. K., Correll, J., Leon Brown, P., & Schoenbaum, G. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06992.x · Cited by 76 · cited 1×
“…lesions (Teitelbaum, 1964, Schoenbaum et al., 2002, Stalnaker et al., 2007, Rudebeck and Murray, 2008) and inactivation (GhodsSharifi et al., 2008, Burke et al., 2009) is described by recent modeling (Wilson et al., 2014) as an inability to create a new state to which learning can be assigned…”
Self-citationFurr, A., Lapiz-Bluhm, M. D., & Morilak, D. A. (2012) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145711001441 · Cited by 74 · cited 1×
“…of serotonin lead to impaired reversal learning in primates (Clarke et al., 2004, Evers et al., 2005) and rats (Nomura, 1992, Bari et al., 2010, Furr et al., 2012), though this might be receptor dependent (see Boulougouris et al., 2008), and low levels of dopamine can speed reversal learning…”
Cited by
Helpman, L., Zhu, X., Suarez-Jimenez, B., Lazarov, A., Monk, C., & Neria, Y. (2017) · Current Psychiatry Reports · doi:10.1007/s11920-017-0854-y · Cited by 82
Brain Networks Underlying Eye’s Pupil Dynamics
DiNuzzo, M., Mascali, D., Moraschi, M., Bussu, G., Maugeri, L., Mangini, F., Fratini, M., & Giove, F. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00965 · Cited by 74
Arnaldo, I., Corcoran, A. W., Friston, K. J., & Ramstead, M. J. D. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104590 · Cited by 56
Kotler, S., Mannino, M., Kelso, S., & Huskey, R. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104956 · Cited by 52
Metadata
- Authors
- Sadacca, B. F., Wikenheiser, A. M., & Schoenbaum, G.
- Venue
- Neuroscience
- Publisher
- Elsevier BV
- Published
- 2017-03
- Volume
- 345
- Pages
- 124-129
- ISSN
- 0306-4522 (ISSN-L)
- OpenAlex
- W2338329485
- Cited by
- 62
- References
- 32
- FWCI
- 3.72
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.