Disruption of endogenous opioid activity during instrumental learning enhances habit acquisition
Open accessAbstract
Considerable evidence suggests that in instrumental conditioning rats learn the relationship between actions and their consequences, or outcomes. Such goal-directed actions are sensitive to changes in outcome value. The present study assessed the role of the endogenous opioid system in goal-directed reward learning. In two experiments, rats were trained to lever press for food pellets either under vehicle or naloxone-induced opioid receptor blockade. Specific satiety procedures were used for outcome devaluation, and the effect of this devaluation on instrumental responding was then tested in extinction. In Experiment 1 outcome devaluation resulted in a reduction in lever pressing in rats that were trained after vehicle injections, indicating that actions in these rats were goal-directed. In contrast, actions in rats trained under naloxone were insensitive to outcome devaluation when tested off drug, suggesting that lever pressing had become habitual in these rats. Interestingly, in Experiment 2 naloxone-induced habitual behavior was shown to be specific to the context in which the training occurred under naloxone; rats showed normal sensitivity to outcome devaluation when tested in an alternate vehicle-trained context. Additionally, in Experiment 2 we found that the acute administration of naloxone on test had no effect in itself, indicating that opioid receptor-related processes contribute to the acquisition of goal-directed actions and not to their general performance. These data suggest that an intact endogenous opioid system is necessary for normal goal-directed learning and more importantly, reveal that a compromised endogenous opioid system during learning enhances the habitual control of actions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the intact animal, there is likely a dynamic interdependency between goal-directed and habitual systems, and control likely emerges simultaneously and competitively.
“However, it is likely that in the intact animal, there is a dynamic interdependency between goal-directed and habitual systems and that control is likely to emerge simultaneously and competitively (Wassum et al., 2009).”
From Goals and Habits in the Brain (2013) · cites this paper as Wassum et al., 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785 · see citing works
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688 · see citing works
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · see citing works
Self-citationYin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · see citing works
Self-citationActions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217 · see citing works
The role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · see citing works
Self-citationOpposing tonically active endogenous opioid systems modulate the mesolimbic dopaminergic pathway.
Spanagel, R., Herz, A., & Shippenberg, T. S. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.6.2046 · Cited by 1,005 · see citing works
Mu, delta, and kappa opioid receptor mRNA expression in the rat CNS: An in situ hybridization study
Mansour, A., Fox, C. A., Burke, S., Meng, F., Thompson, R. C., Akil, H., & Watson, S. J. (1994) · The Journal of Comparative Neurology · doi:10.1002/cne.903500307 · Cited by 872 · see citing works
Handbook of Contemporary Learning Theories
Mowrer, R. R. (2000) · Psychology Press eBooks · doi:10.4324/9781410600691 · Cited by 789 · see citing works
Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748 · see citing works
Corbit, L. H., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4507-04.2005 · Cited by 589 · see citing works
Self-citationCorbit, L. H., Muir, J. L., & Balleine, B. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03251.2001 · Cited by 564 · see citing works
Self-citationSpanagel, R., Herz, A., & Shippenberg, T. S. (1990) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1990.tb04963.x · Cited by 539 · see citing works
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445 · see citing works
Hedonic Hot Spots in the Brain
Peciña, S., Smith, K. S., & Berridge, K. C. (2006) · The Neuroscientist · doi:10.1177/1073858406293154 · Cited by 441 · see citing works
The role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423 · see citing works
Self-citationLesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation
Faure, A., Haberland, U., Condé, F., & Massioui, N. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3894-04.2005 · Cited by 402 · see citing works
The importance of proving the null
Gallistel, C. R. (2009) · Psychological Review · doi:10.1037/a0015251 · Cited by 392 · see citing works
Palmiter, R. D. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1417.003 · Cited by 375 · see citing works
The effect of lesions of the basolateral amygdala on instrumental conditioning
Balleine, B. W., Killcross, A. S., & Dickinson, A. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-02-00666.2003 · Cited by 355 · see citing works
Self-citationCoutureau, E., & Killcross, S. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.025 · Cited by 342 · see citing works
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
Self-citationOstlund, S. B., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-05.2005 · Cited by 291 · see citing works
Self-citationDopaminergic Mechanisms in Actions and Habits: Figure 1.
Wickens, J. R., Horvitz, J. C., Costa, R. M., & Killcross, S. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1671-07.2007 · Cited by 271 · see citing works
Ostlund, S. B., & Balleine, B. W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5472-07.2008 · Cited by 198 · see citing works
Self-citationCorbit, L. H., Muir, J. L., & Balleine, B. W. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02833.x · Cited by 186 · see citing works
Self-citationDistinct opioid circuits determine the palatability and the desirability of rewarding events
Wassum, K. M., Ostlund, S. B., Maidment, N. T., & Balleine, B. W. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905874106 · Cited by 182 · see citing works
Self-citationShippenberg, T. S., Bals-Kubik, R., & Herz, A. (1987) · Brain Research · doi:10.1016/0006-8993(87)91667-2 · Cited by 166 · see citing works
Selective Reward Deficit in Mice Lacking β-Endorphin and Enkephalin
Hayward, M. D., Pintar, J. E., & Low, M. J. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-18-08251.2002 · Cited by 147 · see citing works
GABA<sub>A</sub>-Mediated Inhibition of Basolateral Amygdala Blocks Reward Devaluation in Macaques
Wellman, L. L., Gale, K., & Malkova, L. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2257-04.2005 · Cited by 126 · see citing works
Consolidation and Reconsolidation of Incentive Learning in the Amygdala
Wang, S., Ostlund, S. B., Nader, K., & Balleine, B. W. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.4716-04.2005 · Cited by 126 · see citing works
Self-citationHjelmstad, G. O., & Fields, H. L. (2003) · Journal of Neurophysiology · doi:10.1152/jn.01115.2002 · Cited by 119 · see citing works
Enkephalinergic afferents of the centromedial amygdala in the rat
Poulin, J., Chevalier, B., Laforest, S., & Drolet, G. (2006) · The Journal of comparative neurology · doi:10.1002/cne.20956 · Cited by 115 · see citing works
Turchan-Cholewo, J. T., Przewłocka, B., Tóth, G., Lasoń, W., Borsodi, A. D., & Przewłocki, R. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00637-x · Cited by 109 · see citing works
Incentive Processes in Instrumental Conditioning
Balleine, B. W. (2000) · Psychology Press eBooks · doi:10.4324/9781410600691-14 · Cited by 99 · see citing works
Self-citationMiura, M., Saino‐Saito, S., Masuda, M., Kobayashi, K., & Aosaki, T. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.2993-07.2007 · Cited by 96 · see citing works
Naloxone effects on sucrose-motivated behavior
Cleary, J. P., Weldon, D. T., O‘Hare, E., Billington, C. J., & Levine, A. S. (1996) · Psychopharmacology · doi:10.1007/bf02246345 · Cited by 90 · see citing works
Naloxone fails to produce conditioned place aversion in μ-opioid receptor knock-out mice
Skoubis, P. D., Matthes, H. W. D., Walwyn, W. M., Kieffer, B. L., & Maidment, N. T. (2001) · Neuroscience · doi:10.1016/s0306-4522(01)00333-5 · Cited by 86 · see citing works
Self-citationEndogenous enkephalins, not endorphins, modulate basal hedonic state in mice
Skoubis, P. D., Lam, H. A., Shoblock, J. R., Narayanan, S., & Maidment, N. T. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.03956.x · Cited by 82 · see citing works
Self-citationDecreased motivation to eat in µ‐opioid receptor‐deficient mice
Papaleo, F., Kieffer, B. L., Tabarin, A., & Contarino, A. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05595.x · Cited by 79 · see citing works
Chefer, V. I., Kieffer, B. L., & Shippenberg, T. S. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02912.x · Cited by 58 · see citing works
Regional distribution of neurotrophin receptors in the developing auditory brainstem
Hafidi, A., Moore, T., & Sanes, D. H. (1996) · The Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19960408)367:3 · Cited by 51 · see citing works
Daunais, J. B., Letchworth, S. R., Sim‐Selley, L. J., Smith, H. R., Childers, S. R., & Porrino, L. J. (2001) · The Journal of Comparative Neurology · doi:10.1002/cne.1154 · Cited by 48 · see citing works
Piepponen, P. T., Honkanen, A., Kivastik, T., Zharkovsky, A., Turtia, A., Mikkola, J., & Ahtee, L. (1999) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(98)00241-x · Cited by 39 · see citing works
Endogenous opioids mediate basal hedonic tone independent of dopamine d-1 or d-2 receptor activation
Narayanan, S., Lam, H. A., Christian, L. J., Levine, M. S., Grandy, D. K., Rubinstein, M., & Maidment, N. T. (2004) · Neuroscience · doi:10.1016/j.neuroscience.2003.11.011 · Cited by 31 · see citing works
Self-citationTrujillo, K. A., Belluzzi, J. D., & Stein, L. (1989) · Brain Research · doi:10.1016/0006-8993(89)90884-6 · Cited by 29 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Dickinson A Balleine BW Gallistel CR The role of learning in motivation Learning, Motivation and Emotion 2002 Volume 3 of Steven’s Handbook of Experimental Psychology, vol. 3 John Wiley & Sons New York
Cited by
Sorted by citations
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · see citing works
Schwabe, L., Tegenthoff, M., Hoffken, O., & Wolf, O. T. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0734-10.2010 · Cited by 150 · see citing works
The role of the opioid system in decision making and cognitive control: a review
van Steenbergen, H., Eikemo, M., & Leknes, S. (2019) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-019-00710-6 · Cited by 118 · see citing works
Kicking the habit: The neural basis of ingrained behaviors in cocaine addiction
Pierce, R. C., & Vanderschuren, L. J. M. J. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.01.007 · Cited by 115 · see citing works
The role of opioid processes in reward and decision-making
Laurent, V., Morse, A. K., & Balleine, B. W. (2015) · British Journal of Pharmacology · doi:10.1111/bph.12818 · Cited by 64 · see citing works
Self-citation
- Authors
- Wassum, K. M., Cely, I. C., Maidment, N. T., & Balleine, B. W.
- Affiliations
- University of California, Los Angeles (US)
- The University of Sydney (AU)
- Corresponding author
- Wassum, K.M.
- Venue
- Neuroscience
- Publisher
- Elsevier BV
- Published
- 2009-10
- Volume
- 163
- Issue
- 3
- Pages
- 770-780
- ISSN
- 0306-4522 (ISSN-L)
- PMC
- PMC3065789
- OpenAlex
- W2057784646
- Cited by
- 46
- References
- 46
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 1 · 2022: 6 · 2020: 2 · 2019: 6 · 2018: 3 · 2017: 1 · 2016: 4 · 2015: 2 · 2014: 7 · 2013: 3 · 2012: 2
- FWCI
- 0.97
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Alcohol Abuse and Alcoholism (R01AA018014, AA18014)
- National Institute on Drug Abuse (F31DA023774, P50DA005010, DA05010, DA-09359, R01DA009359)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- endogenous opioid system, opioid receptor blockade, naloxone, operant conditioning, habit formation, goal-directed behavior, outcome devaluation, extinction, reward learning, context specificity
- MeSH terms
- Animals, Conditioning, Operant, Discrimination, Psychological, Habituation, Psychophysiologic, Learning, Male, Naloxone, Narcotic Antagonists, Receptors, Opioid, Rats, Sprague-Dawley, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
