Dopamine Encoding of Pavlovian Incentive Stimuli Diminishes with Extended Training
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Dopamine is highly implicated both as a teaching signal in reinforcement learning and in motivating actions to obtain rewards. However, theoretical disconnects remain between the temporal encoding properties of dopamine neurons and the behavioral consequences of its release. Here, we demonstrate in rats that dopamine evoked by pavlovian cues increases during acquisition, but dissociates from stable conditioned appetitive behavior as this signal returns to preconditioning levels with extended training. Experimental manipulation of the statistical parameters of the behavioral paradigm revealed that this attenuation of cue-evoked dopamine release during the postasymptotic period was attributable to acquired knowledge of the temporal structure of the task. In parallel, conditioned behavior became less dopamine dependent after extended training. Thus, the current work demonstrates that as the presentation of reward-predictive stimuli becomes anticipated through the acquisition of task information, there is a shift in the neurobiological substrates that mediate the motivational properties of these incentive stimuli.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 2×
“Reward-related dopamine transmission within the mesolimbic system is hypothesized to function as a reinforcement signal that promotes future behavioral responses to predictive cues (Wise, 2004) as well as a motivational signal that immediately mobilizes behavior through the assignment of incentive value (Berridge, 200…”
BackgroundThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 1×
“In experimental paradigms involving probabilistic rewards, there is evidence that cue-evoked dopamine signaling scales with the probability of reward delivery (Fiorillo et al., 2003).”
BackgroundA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“…in reinforcement learning is suggested by the correlation between phasic patterns of neurotransmission during the contingent pairing of rewards and predictive stimuli and the encoding of a reward prediction error used as a teaching signal in formal models of learning (Montague et al., 1996).”
MethodActions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217
A selective role for dopamine in stimulus-reward learning
Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., Akers, C. A., Clinton, S. M., Phillips, P. E. M., & Akil, H. (2011) · Nature · doi:10.1038/nature09588 · Cited by 1,026
Self-citationResponses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
A representation of the hazard rate of elapsed time in macaque area LIP
Janssen, P., & Shadlen, M. N. (2005) · Nature Neuroscience · doi:10.1038/nn1386 · Cited by 601
Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats
Heien, M. L. A. V., Khan, A. S., Ariansen, J. L., Cheer, J. F., Phillips, P. E. M., Wassum, K. M., & Wightman, R. M. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504657102 · Cited by 482 · cited 2×
“3 V at 400 V/s; National Instruments), and dopamine was isolated from the voltammetric signal with chemometric analysis (Heien et al., 2005) using a standard training set based on stimulated dopamine release detected by chronically implanted electrodes.”
MethodInfluentialSelf-citation
Cited by
Sex differences, gender and addiction
Becker, J. B., McClellan, M. L., & Reed, B. G. (2017) · Journal of Neuroscience Research · doi:10.1002/jnr.23963 · Cited by 557
Social re-orientation and brain development: An expanded and updated view
Nelson, E. E., Jarcho, J. M., & Guyer, A. E. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.12.008 · Cited by 447
Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural Circuitry
Keiflin, R., & Janak, P. H. (2015) · Neuron · doi:10.1016/j.neuron.2015.08.037 · Cited by 382
Excessive cocaine use results from decreased phasic dopamine signaling in the striatum
Willuhn, I., Burgeno, L. M., Groblewski, P. A., & Phillips, P. E. M. (2014) · Nature Neuroscience · doi:10.1038/nn.3694 · Cited by 261
Self-citationCampus, P., Covelo, I. R., Kim, Y., Parsegian, A., Kuhn, B. N., Lopez, S. A., Neumaier, J. F., Ferguson, S. M., Solberg Woods, L. C., Sarter, M., et al. (2019) · eLife · doi:10.7554/elife.49041 · Cited by 92
“For these studies, the effects of PrL-PVT manipulation were examined early in Pavlovian training, when Pavlovian cues are known to evoke a DA response in the NAc to a different degree in STs and GTs (Flagel et al., 2011a; Clark et al., 2013).”
BackgroundInfluential
Metadata
- Authors
- Clark, J. J., Collins, A. L., Sanford, C. A., & Phillips, P. E. M.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2013-02-20
- Volume
- 33
- Issue
- 8
- Pages
- 3526-3532
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2056772459
- Cited by
- 94
- References
- 15
- FWCI
- 4.95
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dopamine Encoding of Pavlovian Incentive Stimuli Diminishes with Extended Training. https://app.cochat.ai/papers/10.1523/jneurosci.5119-12.2013
- The paper
- Clark, J. J., Collins, A. L., Sanford, C. A., & Phillips, P. E. M. (2013). Dopamine Encoding of Pavlovian Incentive Stimuli Diminishes with Extended Training. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.5119-12.2013
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.