Behavioral and Neural Changes after Gains and Losses of Conditioned Reinforcers
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Human behaviors can be more powerfully influenced by conditioned reinforcers, such as money, than by primary reinforcers. Moreover, people often change their behaviors to avoid monetary losses. However, the effect of removing conditioned reinforcers on choices has not been explored in animals, and the neural mechanisms mediating the behavioral effects of gains and losses are not well understood. To investigate the behavioral and neural effects of gaining and losing a conditioned reinforcer, we trained rhesus monkeys for a matching pennies task in which the positive and negative values of its payoff matrix were realized by the delivery and removal of a conditioned reinforcer. Consistent with the findings previously obtained with non-negative payoffs and primary rewards, the animal's choice behavior during this task was nearly optimal. Nevertheless, the gain and loss of a conditioned reinforcer significantly increased and decreased, respectively, the tendency for the animal to choose the same target in subsequent trials. We also found that the neurons in the dorsomedial frontal cortex, dorsal anterior cingulate cortex, and dorsolateral prefrontal cortex often changed their activity according to whether the animal earned or lost a conditioned reinforcer in the current or previous trial. Moreover, many neurons in the dorsomedial frontal cortex also signaled the gain or loss occurring as a result of choosing a particular action as well as changes in the animal's behaviors resulting from such gains or losses. Thus, primate medial frontal cortex might mediate the behavioral effects of conditioned reinforcers and their losses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses
Gehring, W. J., & Willoughby, A. R. (2002) · Science · doi:10.1126/science.1066893 · Cited by 1,884 · cited 2×
“For example, studies based on scalp recordings and neuroimaging have shown that information about monetary gains and losses is rapidly processed (Gehring and Willoughby, 2002; Holroyd et al., 2004) and influences neural activity in multiple brain areas (Elliott et al.”
BackgroundNeural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 1×
“…brain areas, including the prefrontal cortex (Watanabe, 1996; Rolls, 2000; Barraclough et al., 2004; Kim et al., 2008), posterior parietal cortex (Platt and Glimcher, 1999), basal ganglia (Schultz, 1998; Samejima et al., 2005), and amygdala (Nishijo et al., 1988; Paton et al., 2006; Tye et al.,…”
BackgroundThe Orbitofrontal Cortex and Reward
Rolls, E. T. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.284 · Cited by 1,595 · cited 2×
“…tend to track the value of reward or punishment expected from a particular stimulus more closely than its physical attributes (Nishijo et al., 1988; Rolls, 2000; Paton et al., 2006), suggesting that these two structures might play an important role in assigning the appropriate values to…”
BackgroundFMRI visualization of brain activity during a monetary incentive delay task
Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000) · NeuroImage · doi:10.1006/nimg.2000.0593 · Cited by 1,414
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116 · cited 2×
“, 2004) and influences neural activity in multiple brain areas (Elliott et al., 1997; Delgado et al., 2000; Knutson et al., 2000; O’Doherty et al., 2001, 2003; Remijnse et al., 2005; Kim et al., 2006; Liu et al., 2007; Seymour et al., 2007; Wrase et al., 2007).”
BackgroundRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · cited 2×
“…areas, including the prefrontal cortex (Watanabe, 1996; Rolls, 2000; Barraclough et al., 2004; Kim et al., 2008), posterior parietal cortex (Platt and Glimcher, 1999), basal ganglia (Schultz, 1998; Samejima et al., 2005), and amygdala (Nishijo et al., 1988; Paton et al., 2006; Tye et al., 2008).”
BackgroundMethodThe primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917 · cited 3×
“…the value of reward or punishment expected from a particular stimulus more closely than its physical attributes (Nishijo et al., 1988; Rolls, 2000; Paton et al., 2006), suggesting that these two structures might play an important role in assigning the appropriate values to conditioned reinforcers…”
BackgroundIn All Likelihood: Statistical Modelling and Inference Using Likelihood
Pawitan, Y. (2001) · doi:10.1093/oso/9780198507659.001.0001 · Cited by 874
Cited by
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards
Bromberg-Martin, E. S., & Hikosaka, O. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.009 · Cited by 548
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 546
Self-citationArnsten, A. F. T., Wang, M. J., & Paspalas, C. D. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.038 · Cited by 538
“…how brain represents information in the absence of sensory stimulation, more recent physiological studies show PFC neurons are also able to represent emotions and more complex concepts, such as ensuing reward or punishment (Seo and Lee, 2009) and changing rules and goals (Wallis et al., 2001).”
Metadata
- Authors
- Seo, H., & Lee, D.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2009-03-18
- Volume
- 29
- Issue
- 11
- Pages
- 3627-3641
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2055514102
- Cited by
- 137
- References
- 25
- FWCI
- 6.24
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Behavioral and Neural Changes after Gains and Losses of Conditioned Reinforcers. https://app.cochat.ai/papers/10.1523/jneurosci.4726-08.2009
- The paper
- Seo, H., & Lee, D. (2009). Behavioral and Neural Changes after Gains and Losses of Conditioned Reinforcers. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.4726-08.2009
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.