Reward expectation alters learning and memory: The impact of the amygdala on appetitive-driven behaviors
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
The capacity to seek and obtain rewards is essential for survival. Pavlovian conditioning is one mechanism by which organisms develop predictions about rewards and such anticipatory or expectancy states enable successful behavioral adaptations to environmental demands. Reward expectancies have both affective/motivational and discriminative properties that allow for the modulation of instrumental goal-directed behavior. Recent data provides evidence that different cognitive strategies (cue-outcome associations) and neural systems (amygdala) are used when subjects are trained under conditions that allow Pavlovian-induced reward expectancies to guide instrumental behavioral choices. Furthermore, it has been demonstrated that impairments typically observed in a number of brain-damaged models are alleviated or eliminated by embedding unique reward expectancies into learning/memory tasks. These results suggest that Pavlovian-induced reward expectancies can change both behavioral and brain processes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Modality-Specific Retrograde Amnesia of Fear
Kim, J. J., & Fanselow, M. S. (1992) · Science · doi:10.1126/science.1585183 · Cited by 2,483
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487
Bechara, A., Tranel, D., Damasio, H., Adolphs, R., Rockland, C., & Damasio, A. R. (1995) · Science · doi:10.1126/science.7652558 · Cited by 1,400
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314
Cortical pathways to the mammalian amygdala
McDonald, A. J. (1998) · Progress in Neurobiology · doi:10.1016/s0301-0082(98)00003-3 · Cited by 1,303
Baxter, M. G., & Murray, E. A. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn875 · Cited by 1,200
Pitkänen, A., Savander, V., & LeDoux, J. E. (1997) · Trends in Neurosciences · doi:10.1016/s0166-2236(97)01125-9 · Cited by 980
Brain systems mediating aversive conditioning: an event-related fMRI study
Büchel, C., Morris, J., Dolan, R. J., & Friston, K. J. (1998) · Neuron · doi:10.1016/s0896-6273(00)80476-6 · Cited by 951
New Vistas on Amygdala Networks in Conditioned Fear
Paré, D., Quirk, G. J., & Ledoux, J. E. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00153.2004 · Cited by 841
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836
Quirk, G. J., Repa, J. C., & LeDoux, J. E. (1995) · Neuron · doi:10.1016/0896-6273(95)90092-6 · Cited by 808
Parallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622 · cited 1×
“One hypothesis is that the BLA mediates associations between predictive stimuli (CS) and the unique sensory properties of a reward outcome [3].”
BackgroundSynaptic plasticity in the lateral amygdala: a cellular hypothesis of fear conditioning
Blair, H. T., Schafe, G. E., Bauer, E. P., Rodrigues, S. M., & LeDoux, J. E. (2001) · Learning & Memory · doi:10.1101/lm.30901 · Cited by 610
Orbitofrontal Cortex and Representation of Incentive Value in Associative Learning
Gallagher, M., McMahan, R. W., & Schoenbaum, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-15-06610.1999 · Cited by 593 · cited 1×
“Anticipatory firing has also been shown in orbitofrontal cortex (OFC) neurons [21;30;39;110;113] and is consistant with the finding of regional activation (measured by fMRI) of OFC in humans by CSs that predict reward [68].”
ResultCorbit, L. H., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4507-04.2005 · Cited by 589
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03251.2001 · Cited by 564 · cited 1×
“Data suggest that several interconnected brain structures-- the basolateral amygdala (BLA), the orbitofrontal cortex (OFC), and the nucleus accumbens (NA) are part of the neural circuitry that is integral for cues that predict features of reward and goal-directed behavior [11;20;16;41;84;96].”
BackgroundBeck, C., & Fibiger, H. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-01-00709.1995 · Cited by 547
Schultz, W. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.017 · Cited by 517
Molecular mechanisms underlying emotional learning and memory in the lateral amygdala
Rodrigues, S. M., Schafe, G. E., & LeDoux, J. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.014 · Cited by 491
Relations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388
The effect of lesions of the basolateral amygdala on instrumental conditioning
Balleine, B. W., Killcross, A. S., & Dickinson, A. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-02-00666.2003 · Cited by 355
Hitchcock, J. M., & Davis, M. (1991) · Behavioral Neuroscience · doi:10.1037/0735-7044.105.6.826 · Cited by 345 · cited 1×
“Not surprisingly, lesions of the CeA or it targets result in impaired expression of expectancy behaviors such as fear-potentiated startle [40].”
BackgroundSynaptic Mechanisms of Associative Memory in the Amygdala
Maren, S. (2005) · Neuron · doi:10.1016/j.neuron.2005.08.009 · Cited by 341
Iwata, J., Chida, K., & LeDoux, J. E. (1987) · Brain Research · doi:10.1016/0006-8993(87)90978-4 · Cited by 272
Infralimbic cortex activation increases c-fos expression in intercalated neurons of the amygdala
Berretta, S., Pantazopoulos, H., Caldera, M., Pantazopoulos, P., & Paré, D. (2005) · Neuroscience · doi:10.1016/j.neuroscience.2005.01.020 · Cited by 223 · cited 1×
“Updated models have incorporated a largely-ignored group of cell islands found between BLA and CeA nuclei known as the Intercalated Cell Masses (ICM) whose physiology and anatomy have only recently been explored [9;32;93].”
BackgroundOstlund, S. B., & Balleine, B. W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5472-07.2008 · Cited by 198 · cited 1×
“It has also recently been shown that posttraining BLA lesions abolished outcome-selective transfer in a PIT task [69].”
BackgroundMowrer, O. H. (1956) · Psychological Review · doi:10.1037/h0040613 · Cited by 178
Collins, D. R., & Paré, D. (2000) · Learning & Memory · doi:10.1101/lm.7.2.97 · Cited by 171
Cited by
Kraus, K. S., & Canlon, B. (2012) · Hearing Research · doi:10.1016/j.heares.2012.02.009 · Cited by 267
Risky Decisions and Their Consequences: Neural Processing by Boys with Antisocial Substance Disorder
Crowley, T. J., Dalwani, M. S., Mikulich-Gilbertson, S. K., Du, Y. P., Lejuez, C. W., Raymond, K. M., & Banich, M. T. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012835 · Cited by 142
“Amygdala, together with OFC and NAc, processes cues that predict positive or negative outcomes in goal-directed behavior, guiding decisions with cue-induced positive and negative emotional memories [75]; amygdala damage impairs the use of emotional memories as animals choose among behaviors [76].”
BackgroundFotros, A., Casey, K. F., Larcher, K., Verhaeghe, J. A., Cox, S. M., Gravel, P., Reader, A. J., Dagher, A., Benkelfat, C., & Leyton, M. (2013) · Neuropsychopharmacology · doi:10.1038/npp.2013.77 · Cited by 89
Vagal control of satiety and hormonal regulation of appetite
Owyang, C., & Heldsinger, A. (2011) · Journal of Neurogastroenterology and Motility · doi:10.5056/jnm.2011.17.4.338 · Cited by 87
Metadata
- Authors
- Savage, L. M., & Ramos, R. L.
- Venue
- Behavioural Brain Research
- Publisher
- Elsevier BV
- Published
- 2009-03
- Volume
- 198
- Issue
- 1
- Pages
- 1-12
- ISSN
- 0166-4328 (ISSN-L)
- OpenAlex
- W2072717163
- Cited by
- 60
- References
- 30
- FWCI
- 1.95
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.