Lateral, not medial, prefrontal cortex contributes to punishment and aversive instrumental learning
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Aversive outcomes punish behaviors that cause their occurrence. The prefrontal cortex (PFC) has been implicated in punishment learning and behavior, although the exact roles for different PFC regions in instrumental aversive learning and decision-making remain poorly understood. Here, we assessed the role of the orbitofrontal (OFC), rostral agranular insular (RAIC), prelimbic (PL), and infralimbic (IL) cortex in instrumental aversive learning and decision-making. Rats that pressed two individually presented levers for pellet rewards rapidly suppressed responding to one lever if it also caused mild punishment (punished lever) but continued pressing the other lever that did not cause punishment (unpunished lever). Inactivations of OFC, RAIC, IL, or PL via the GABA agonists baclofen and muscimol (BM) had no effect on the acquisition of instrumental learning. OFC inactivations increased responding on the punished lever during expression of well-learned instrumental aversive learning, whereas RAIC inactivations increased responding on the punished lever when both levers were presented simultaneously in an unpunished choice test. There were few effects of medial PFC (PL and IL) inactivation. These results suggest that lateral PFC, notably OFC and RAIC, have complementary functions in aversive instrumental learning and decision-making; OFC is important for using established aversive instrumental memories to guide behavior away from actions that cause punishment, whereas RAIC is important for aversive decision-making under conditions of choice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making
Bechara, A., Damasio, H., Damasio, A. R., & Lee, G. P. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05473.1999 · Cited by 2,001 · cited 1×
“…following inactivation of the OFC is consistent with previous reports that patients with OFC damage are impaired in tasks involving punishment (Bechara et al. 1999, 2000) and could be used to support the proposed role of OFC in encoding aversive outcomes (Morrison and Salzman 2011; O’Doherty…”
ResultNeurons in medial prefrontal cortex signal memory for fear extinction
Milad, M. R., & Quirk, G. J. (2002) · Nature · doi:10.1038/nature01138 · Cited by 1,836 · cited 1×
“…expression of Pavlovian fear responses (Corcoran and Quirk 2007; Courtin et al. 2013a,b; Senn et al. 2014; Do-monte et al. 2015) and IL suppresses these responses after inhibitory treatments such as extinction (Milad and Quirk 2002; Quirk et al. 2006; Santini et al. 2008; Senn et al. 2014).”
BackgroundGoal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · cited 1×
“Medial PFC contributes to appetitive decision-making, behavioral control, and instrumental learning (Balleine and Dickinson 1998; Arana et al. 2003; Corbit and Balleine 2003; O’Doherty et al. 2003; Ostlund and Balleine 2005; Tanaka et al. 2008; Ostlund et al. 2009) and thus may contribute to…”
BackgroundThe root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342
Input-specific control of reward and aversion in the ventral tegmental area
Lammel, S., Lim, B. K., Ran, C., Huang, K. W., Betley, M. J., Tye, K. M., Deisseroth, K., & Malenka, R. C. (2012) · Nature · doi:10.1038/nature11527 · Cited by 1,300 · cited 1×
“This profile of performance is consistent with OFC as a locus for matching incentive information to guide behavior (Levy and Glimcher 2012).”
ResultLimbic connections of the orbital and medial prefrontal cortex in macaque monkeys
Carmichael, S. T., & Price, J. L. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630408 · Cited by 1,197 · cited 7×
“Moreover, similar and lower doses of BM into PL or IL attenuate lever-press suppression in other behavioral paradigms (Bossert et al. 2011; Fuchs et al. 2007; Peters et al. 2008, 2009), while this same manipulation of BLA attenuates punishment suppression using the current protocol (Jean-Richard and McNally 2015).”
BackgroundInfluentialSierra-Mercado, D., Padilla-Coreano, N., & Quirk, G. J. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.184 · Cited by 1,190 · cited 2×
“Pavlovian associations (Blum et al. 2006; Vidal-Gonzalez et al. 2006; Corcoran and Quirk 2007; Sierra-Mercado et al. 2011; Lammel et al. 2012), whereas IL has been implicated in reductions”
BackgroundDistributed processing of pain and vibration by the human brain
Coghill, R., Talbot, J., Evans, A., Meyer, E., Gjedde, A., Bushnell, M., & Duncan, G. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-07-04095.1994 · Cited by 808
Human insula activation reflects risk prediction errors as well as risk
Preuschoff, K., Quartz, S. R., & Bossaerts, P. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4286-07.2008 · Cited by 784
Extinction circuits for fear and addiction overlap in prefrontal cortex
Peters, J., Kalivas, P. W., & Quirk, G. J. (2009) · Learning & Memory · doi:10.1101/lm.1041309 · Cited by 736 · cited 2×
“…(Blum et al. 2006; Vidal-Gonzalez et al. 2006; Corcoran and Quirk 2007; Sierra-Mercado et al. 2011; Lammel et al. 2012), whereas IL has been implicated in reductions of instrumental responding following extinction (Peters et al. 2008, 2009; Marchant et al. 2010; Peters and De Vries 2013).”
BackgroundMethodVidal-Gonzalez, I., Vidal-Gonzalez, B., Rauch, S. L., & Quirk, G. J. (2006) · Learning & Memory · doi:10.1101/lm.306106 · Cited by 705 · cited 2×
“Pavlovian associations (Blum et al. 2006; Vidal-Gonzalez et al. 2006; Corcoran and Quirk 2007; Sierra-Mercado et al. 2011; Lammel et al. 2012), whereas IL has been implicated in reductions”
BackgroundPrefrontal mechanisms in extinction of conditioned fear
Quirk, G. J., Garcia, R., & González-Lima, F. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.03.010 · Cited by 682 · cited 2×
“…expression of Pavlovian fear responses (Corcoran and Quirk 2007; Courtin et al. 2013a,b; Senn et al. 2014; Do-monte et al. 2015) and IL suppresses these responses after inhibitory treatments such as extinction (Milad and Quirk 2002; Quirk et al. 2006; Santini et al. 2008; Senn et al. 2014).”
BackgroundO'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Infralimbic Prefrontal Cortex Is Responsible for Inhibiting Cocaine Seeking in Extinguished Rats
Peters, J., LaLumiere, R. T., & Kalivas, P. W. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1045-08.2008 · Cited by 537
Prefrontal parvalbumin interneurons shape neuronal activity to drive fear expression
Courtin, J., Chaudun, F., Rozeske, R. R., Karalis, N., Gonzalez-Campo, C., Wurtz, H., Abdi, A., Baufreton, J., Bienvenu, T. C. M., & Herry, C. (2014) · Nature · doi:10.1038/nature12755 · Cited by 524 · cited 2×
“PL regulates expression of Pavlovian fear responses (Corcoran and Quirk 2007; Courtin et al. 2013a,b; Senn et al. 2014; Do-monte et al. 2015) and IL suppresses these responses after inhibitory treatments such as extinction (Milad and Quirk 2002; Quirk et al. 2006; Santini et al. 2008; Senn et al.…”
BackgroundLong-range connectivity defines behavioral specificity of amygdala neurons
Senn, V., Wolff, S. B. E., Herry, C., Grenier, F., Ehrlich, I., Gründemann, J., Fadok, J. P., Müller, C., Letzkus, J. J., & Lüthi, A. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.006 · Cited by 522 · cited 5×
“…expression of Pavlovian fear responses (Corcoran and Quirk 2007; Courtin et al. 2013a,b; Senn et al. 2014; Do-monte et al. 2015) and IL suppresses these responses after inhibitory treatments such as extinction (Milad and Quirk 2002; Quirk et al. 2006; Santini et al. 2008; Senn et al. 2014).”
BackgroundInfluentialA temporal shift in the circuits mediating retrieval of fear memory
Do-Monte, F. H., Quiñones-Laracuente, K., & Quirk, G. J. (2015) · Nature · doi:10.1038/nature14030 · Cited by 491
The role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423
Orbitofrontal cortex, associative learning and expectancies
Schoenbaum, G., & Roesch, M. (2005) · Neuron · doi:10.1016/j.neuron.2005.07.018 · Cited by 404
Cai, W., Ryali, S., Chen, T., Li, C.-S. R., & Menon, V. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3048-14.2014 · Cited by 362 · cited 2×
“Northoff 2011; Wiech and Tracey 2013) and behavioral control (Cai et al. 2014; Ghahremani et al. 2015).”
BackgroundOstlund, S. B., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-05.2005 · Cited by 291
Simmons, A., Strigo, I., Matthews, S. C., Paulus, M. P., & Stein, M. B. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.04.038 · Cited by 287 · cited 1×
“…(JeanRichard and McNally 2015) The RAIC has been strongly implicated in multiple aspects of aversion-coding (Coghill et al. 1994; Flynn et al. 1999; Simmons et al. 2004, 2006; Preuschoff et al. 2008; Franciotti et al. 2009; Furlong et al. 2010; Menon and Uddin 2010; Hayes and Northoff 2011; Wiech…”
BackgroundCalculating Consequences: Brain Systems That Encode the Causal Effects of Actions
Tanaka, S. C., Balleine, B. W., & O'Doherty, J. P. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1808-08.2008 · Cited by 268 · cited 1×
“…instrumental learning (Balleine and Dickinson 1998; Arana et al. 2003; Corbit and Balleine 2003; O’Doherty et al. 2003; Ostlund and Balleine 2005; Tanaka et al. 2008; Ostlund et al. 2009) and thus may contribute to aversive instrumental learning and decision-making, but this lacks experimental…”
BackgroundBalleine, B. W., & Dickinson, A. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-23-08954.2000 · Cited by 218 · cited 1×
“…(PL, IL, RAIC, OFC, BLA, lateral habenula; Jean-Richard and McNally 2014, 2015) and is consistent with the proposed roles for RAIC in encoding relative response value (Talmi and Pine 2012) and/or retrieving representations of outcome value (Balleine and Dickinson 2000; Parkes and Balleine 2013).”
ResultAnticipation of emotionally aversive visual stimuli activates right insula
Simmons, A., Matthews, S. C., Stein, M. B., & Paulus, M. P. (2004) · NeuroReport · doi:10.1097/00001756-200410050-00024 · Cited by 195 · cited 1×
“…(JeanRichard and McNally 2015) The RAIC has been strongly implicated in multiple aspects of aversion-coding (Coghill et al. 1994; Flynn et al. 1999; Simmons et al. 2004, 2006; Preuschoff et al. 2008; Franciotti et al. 2009; Furlong et al. 2010; Menon and Uddin 2010; Hayes and Northoff 2011; Wiech…”
BackgroundPain, decisions, and actions: a motivational perspective
Wiech, K., & Tracey, I. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00046 · Cited by 188 · cited 1×
“…aspects of aversion-coding (Coghill et al. 1994; Flynn et al. 1999; Simmons et al. 2004, 2006; Preuschoff et al. 2008; Franciotti et al. 2009; Furlong et al. 2010; Menon and Uddin 2010; Hayes and Northoff 2011; Wiech and Tracey 2013) and behavioral control (Cai et al. 2014; Ghahremani et al. 2015).”
BackgroundOstlund, S. B., Winterbauer, N. E., & Balleine, B. W. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1176-09.2009 · Cited by 103
Amygdala-Prefrontal Synchronization Underlies Resistance to Extinction of Aversive Memories
Livneh, U., & Paz, R. (2012) · Neuron · doi:10.1016/j.neuron.2012.05.016 · Cited by 87
Clarke, H. F., Horst, N. K., & Roberts, A. C. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1422440112 · Cited by 52 · cited 2×
“was otherwise unable to affect behavior (Clarke et al. 2015).”
Background
Cited by
Functional Heterogeneity within Rat Orbitofrontal Cortex in Reward Learning and Decision Making
Izquierdo, A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1678-17.2017 · Cited by 258
Behavioral and neurobiological mechanisms of punishment: implications for psychiatric disorders
Jean-Richard-Dit-Bressel, P., Killcross, S., & McNally, G. P. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0047-3 · Cited by 160
“However, PrL or IL inactivations or lesions do not affect primary punishment [109, 110].”
BackgroundSelf-citationPrefrontal Regulation of Punished Ethanol Self-administration
Halladay, L. R., Kocharian, A., Piantadosi, P. T., Authement, M. E., Lieberman, A. G., Spitz, N. A., Coden, K., Glover, L. R., Costa, V. D., Alvarez, V. A., et al. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.10.030 · Cited by 74
Pharmacotherapy for Neuropsychiatric Symptoms in Frontotemporal Dementia
Le, C., & Finger, E. (2021) · CNS Drugs · doi:10.1007/s40263-021-00854-5 · Cited by 26
Metadata
- Authors
- Jean-Richard-dit-Bressel, P., & McNally, G. P.
- Venue
- Learning & Memory
- Publisher
- Cold Spring Harbor Laboratory
- Published
- 2016-10-17
- Volume
- 23
- Issue
- 11
- Pages
- 607-617
- ISSN
- 1072-0502 (ISSN-L)
- 1549-5485
- OpenAlex
- W2537182145
- Cited by
- 41
- References
- 31
- Type
- posted content
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.