Responses of Amygdala Neurons to Positive Reward-Predicting Stimuli Depend on Background Reward (Contingency) Rather Than Stimulus-Reward Pairing (Contiguity)
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Prediction about outcomes constitutes a basic mechanism underlying informed economic decision making. A stimulus constitutes a reward predictor when it provides more information about the reward than the environmental background. Reward prediction can be manipulated in two ways, by varying the reward paired with the stimulus, as done traditionally in neurophysiological studies, and by varying the background reward while holding stimulus-reward pairing constant. Neuronal mechanisms involved in reward prediction should also be sensitive to changes in background reward independently of stimulus-reward pairing. We tested this assumption on a major brain structure involved in reward processing, the central and basolateral amygdala. In a 2 × 2 design, we examined the influence of rewarded and unrewarded backgrounds on neuronal responses to rewarded and unrewarded visual stimuli. Indeed, responses to the unchanged rewarded stimulus depended crucially on background reward in a population of amygdala neurons. Elevating background reward to the level of the rewarded stimulus extinguished these responses, and lowering background reward again reinstated the responses without changes in stimulus-reward pairing. None of these neurons responded specifically to an inhibitory stimulus predicting less reward compared with background (negative contingency). A smaller group of amygdala neurons maintained stimulus responses irrespective of background reward, possibly reflecting stimulus-reward pairing or visual sensory processes without reward prediction. Thus in being sensitive to background reward, the responses of a population of amygdala neurons to phasic stimuli appeared to follow the full criteria for excitatory reward prediction (positive contingency) rather than reflecting simple stimulus-reward pairing (contiguity).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721
Human emotion and memory: Interactions of the amygdala and hippocampal complex
Phelps, E. A. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.015 · Cited by 1,577
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527 · cited 2×
“2005) and switching of reward related behavior (Dias et al. 1996; Shima and Tanji 1998; White and Wise 1999).”
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Self-citationAdaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · cited 2×
“…studies have shown that reward value defined as probability distribution is a viable parameter determining reward responses in prefrontal, parietal, striatal, and dopamine neurons (Cromwell and Schultz 2003; Leon and Shadlen 1999; Musallam et al. 2004; Platt and Glimcher 1999; Tobler et al. 2005).”
Self-citationModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Probability of shock in the presence and absence of cs in fear conditioning.
Rescorla, R. A. (1968) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0025984 · Cited by 1,067 · cited 6×
“The crucial “truly random” control procedure dissociated contingency from contiguity (Rescorla 1967).”
InfluentialA relationship between behavioral choice and the visual responses of neurons in macaque MT
Britten, K. H., Newsome, W. T., Shadlen, M. N., Celebrini, S., & Movshon, J. A. (1996) · Visual Neuroscience · doi:10.1017/s095252380000715x · Cited by 1,049 · cited 2×
“To quantitatively assess differences in neuronal activity, we performed receiver operating characteristic (ROC) analysis to calculate the probability with which an ideal observer would distinguish two different neuronal response distributions (Green and Swets 1966; Britten et al. 1996).”
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Self-citationPITKÄNEN, A., PIKKARAINEN, M., NURMINEN, N., & YLINEN, A. (2000) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2000.tb06738.x · Cited by 962
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917
Cognitive Control Signals for Neural Prosthetics
Musallam, S., Corneil, B. D., Greger, B., Scherberger, H., & Andersen, R. A. (2004) · Science · doi:10.1126/science.1097938 · Cited by 663 · cited 2×
“…studies have shown that reward value defined as probability distribution is a viable parameter determining reward responses in prefrontal, parietal, striatal, and dopamine neurons (Cromwell and Schultz 2003; Leon and Shadlen 1999; Musallam et al. 2004; Platt and Glimcher 1999; Tobler et al. 2005).”
A representation of the hazard rate of elapsed time in macaque area LIP
Janssen, P., & Shadlen, M. N. (2005) · Nature Neuroscience · doi:10.1038/nn1386 · Cited by 601
Baxter, M. G., Parker, A., Lindner, C. C. C., Izquierdo, A. D., & Murray, E. A. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04311.2000 · Cited by 582 · cited 2×
“According to lesion and psychopharmacological studies the amygdala is involved in Pavlovian reward conditioning (Everitt et al. 1991; Gaffan et al. 1993; Hatfield et al. 1996; Han et al. 1997; Malkova et al. 1997; Baxter et al. 2000; Setlow et al. 2002; Everitt et al. 2003).”
Schoenbaum, G., Chiba, A. A., & Gallagher, M. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01876.1999 · Cited by 579 · cited 2×
“Single amygdala neurons in monkeys and rats respond to Pavlovian conditioned stimuli after pairing with reward (Ono et al. 1995; Pratt and Mizumori 1998; Schoenbaum et al. 1999; Carelli et al. 2003; Sugase-Miyamoto and Richmond 2005; Paton et al. 2006; Tye and Janak 2007).”
Everitt, B. J., Morris, K. A., O'Brien, A., & Robbins, T. W. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90145-e · Cited by 507 · cited 2×
“According to lesion and psychopharmacological studies the amygdala is involved in Pavlovian reward conditioning (Everitt et al. 1991; Gaffan et al. 1993; Hatfield et al. 1996; Han et al. 1997; Malkova et al. 1997; Baxter et al. 2000; Setlow et al. 2002; Everitt et al. 2003).”
Leon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449 · cited 1×
“…studies have shown that reward value defined as probability distribution is a viable parameter determining reward responses in prefrontal, parietal, striatal, and dopamine neurons (Cromwell and Schultz 2003; Leon and Shadlen 1999; Musallam et al. 2004; Platt and Glimcher 1999; Tobler et al. 2005).”
Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala
Belova, M. A., Paton, J. J., Morrison, S. E., & Salzman, C. D. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.004 · Cited by 349
Málková, L., Gaffan, D., & Murray, E. A. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-15-06011.1997 · Cited by 295
Task and Content Modulate Amygdala-Hippocampal Connectivity in Emotional Retrieval
Smith, A. P. R., Stephan, K. E., Rugg, M. D., & Dolan, R. J. (2006) · Neuron · doi:10.1016/j.neuron.2005.12.025 · Cited by 252
Moment-to-moment tracking of state value in the amygdala
Belova, M. A., Paton, J. J., & Salzman, C. D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1400-08.2008 · Cited by 221 · cited 2×
“The observed background reward-sensitive stimulus responses may be interesting in terms of amygdala state value coding described recently (Belova et al. 2008).”
Ostlund, S. B., & Balleine, B. W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5472-07.2008 · Cited by 198
Setlow, B., Holland, P. C., & Gallagher, M. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.2.267 · Cited by 160
Amygdala Neurons Differentially Encode Motivation and Reinforcement
Tye, K. M., & Janak, P. H. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5281-06.2007 · Cited by 130
Falls, W. A., & Davis, M. (1995) · Behavioral Neuroscience · doi:10.1037/0735-7044.109.3.379 · Cited by 110 · cited 2×
“In the case of the amygdala, which may not be involved in conditioned inhibition (Falls and Davis 1995), the parallelism may hold only for excitatory reward predictors.”
Cited by
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Self-citationThe neural basis of reversal learning: An updated perspective
Izquierdo, A., Brigman, J. L., Radke, A. K., Rudebeck, P. H., & Holmes, A. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2016.03.021 · Cited by 670
Oxytocin, motivation and the role of dopamine
Love, T. M. (2014) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2013.06.011 · Cited by 369
“Neuronal recordings in non-human primates indicate amygdalar neurons respond to cues predicting future reward and encode reward value and magnitude (Belova et al., 2008, Bermudez and Schultz, 2010a, b, Salinas et al., 1993).”
The basolateral amygdala in reward learning and addiction
Wassum, K. M., & Izquierdo, A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.017 · Cited by 306
Abstract context representations in primate amygdala and prefrontal cortex
Saez, A., Rigotti, M., Ostojic, S., Fusi, S., & Salzman, C. D. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.024 · Cited by 183
“Consistent with this view, context-dependent modulation of responses to sensory stimuli predicting reinforcement have previously been reported in the amygdala (Bermudez and Schultz, 2010; Hirai et al., 2009; Hobin et al., 2003; Orsini et al., 2013) and elsewhere when animals undergo context-specific extinction (Bouton…”
Background
Metadata
- Authors
- Bermudez, M. A., & Schultz, W.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2010-03
- Volume
- 103
- Issue
- 3
- Pages
- 1158-1170
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W1975944724
- Cited by
- 54
- References
- 26
- FWCI
- 1.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.