The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
The role of dopamine in the accumbens core in the expression of Pavlovian‐conditioned responses
Open accessAbstract
The role of dopamine in reward is a topic of debate. For example, some have argued that phasic dopamine signaling provides a prediction‐error signal necessary for stimulus–reward learning, whereas others have hypothesized that dopamine is not necessary for learning per se , but for attributing incentive motivational value (‘incentive salience’) to reward cues. These psychological processes are difficult to tease apart, because they tend to change together. To disentangle them we took advantage of natural individual variation in the extent to which reward cues are attributed with incentive salience, and asked whether dopamine (specifically in the core of the nucleus accumbens) is necessary for the expression of two forms of Pavlovian‐conditioned approach behavior – one in which the cue acquires powerful motivational properties (sign‐tracking) and another closely related one in which it does not (goal‐tracking). After acquisition of these conditioned responses (CRs), intra‐accumbens injection of the dopamine receptor antagonist flupenthixol markedly impaired the expression of a sign‐tracking CR, but not a goal‐tracking CR. Furthermore, dopamine antagonism did not produce a gradual extinction‐like decline in behavior, but maximally impaired expression of a sign‐tracking CR on the very first trial, indicating the effect was not due to new learning (i.e. it occurred in the absence of new prediction‐error computations). The data support the view that dopamine in the accumbens core is not necessary for learning stimulus–reward associations, but for attributing incentive salience to reward cues, transforming predictive conditional stimuli into incentive stimuli with powerful motivational properties.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Rat Brain in Stereotaxic Coordinates
(1982) · Elsevier eBooks · doi:10.1016/c2009-0-63235-9 · Cited by 51,963
The rat brain in stereotaxic coordinates
Palkovits, M. (1983) · Neuropeptides · doi:10.1016/0143-4179(83)90049-5 · Cited by 28,831
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
The neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346
Self-citationCognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · Psychology of Learning and Motivation · doi:10.1016/c2009-0-62209-1 · Cited by 5,994
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Self-citationLinear Mixed Models for Longitudinal Data
Verbeke, G. (1997) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2294-1_3 · Cited by 3,506
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Integrative activity of the brain
Konorski, J. (1967) · University of Chicago Press eBooks · Cited by 2,222
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869
Self-citationGoal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 2×
“One view is that phasic dopamine activity provides a prediction-error signal necessary for learning stimulus–reward associations (Montague et al., 1996; Schultz et al., 1997; Bayer & Glimcher, 2005).”
BackgroundGläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
A selective role for dopamine in stimulus-reward learning
Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., Akers, C. A., Clinton, S. M., Phillips, P. E. M., & Akil, H. (2011) · Nature · doi:10.1038/nature09588 · Cited by 1,026 · cited 9×
“The fact that dopamine antagonism had little effect on the performance (and learning; Flagel et al., 2011b) of a GT CR suggests, of course, that for GTs the CS did not function as an incentive stimulus.”
BackgroundInfluentialSelf-citationEffort-related functions of nucleus accumbens dopamine and associated forebrain circuits
Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0668-9 · Cited by 1,000
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · cited 2×
“…of dopamine antagonism on the learning and expression of a ST CR vs. a GT CR, it is important to consider the distinction between a CS and an incentive stimulus, long emphasized by learning theorists (Konorski, 1967; Bindra, 1978; Toates, 1986; Dickinson & Balleine, 1994, 2002; Berridge, 2001).”
BackgroundReward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Sign-tracking : the stimulus-reinforcer relation and directed action
Hearst, E. S., & Jenkins, H. M. (1974) · Medical Entomology and Zoology · Cited by 799
Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli
Lammel, S., Ion, D. I., Roeper, J., & Malenka, R. C. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.025 · Cited by 766
How adaptive behavior is produced: a perceptual-motivational alternative to response reinforcements
Bindra, D. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00059380 · Cited by 732
Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710
From prediction error to incentive salience: mesolimbic computation of reward motivation.
Berridge, K. C. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.07990.x · Cited by 700
Witten, I. B., Steinberg, E. E., Lee, S. Y., Davidson, T. J., Zalocusky, K. A., Brodsky, M., Yizhar, O., Cho, S. L., Gong, S., Ramakrishnan, C., et al. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.028 · Cited by 680 · cited 1×
“…and hippocampus, and they are not homogeneous in their pattern of activity (Fields et al., 2007; Bromberg-Martin et al., 2010; Lammel et al., 2011; Witten et al., 2011), raising the possibility that dopamine signaling within other regions is necessary for learning stimulus–reward associations.”
Neuroleptic-Induced "Anhedonia" in Rats: Pimozide Blocks Reward Quality of Food
Wise, R. A., Spindler, J., deWit, H., & Gerberg, G. J. (1978) · Science · doi:10.1126/science.566469 · Cited by 636
Ventral Tegmental Area Neurons in Learned Appetitive Behavior and Positive Reinforcement
Fields, H. L., Hjelmstad, G. O., Margolis, E. B., & Nicola, S. M. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.30.051606.094341 · Cited by 621
Flagel, S. B., Akil, H., & Robinson, T. E. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2008.06.027 · Cited by 561 · cited 4×
“Only in STs is the CS transformed into a powerfully attractive and desirable ‘motivational magnet’ (Flagel et al., 2007, 2009, 2011b; Robinson & Flagel, 2009; Saunders & Robinson, 2010; Yager & Robinson, 2010; Meyer et al., 2012b), and our results suggest that it is this transformation that…”
BackgroundInfluentialSelf-citationConditioned stimulus as a determinant of the form of the Pavlovian conditioned response.
Holland, P. C. (1977) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.3.1.77 · Cited by 561
Erratum to: “Parsing reward” [Trends Neurosci. 26 (2003) 507–513]
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/j.tins.2003.09.001 · Cited by 558
Self-citationIntegrative Activity of the Brain: An Interdisciplinary Approach
Ochs, S. (1968) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1968.03140050055025 · Cited by 522
Operant-Pavlovian Interactions
Davis, H., & Hurwitz, H. M. B. (2021) · Routledge eBooks · doi:10.4324/9781003150404 · Cited by 500
Disentangling pleasure from incentive salience and learning signals in brain reward circuitry
Smith, K. S., Berridge, K. C., & Aldridge, J. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101920108 · Cited by 464 · cited 1×
“These results are complementary to previous studies in which dopaminergic activity was increased by drugs or sensitization, also producing an immediate increase in responding (Wyvell & Berridge, 2001; Tindell et al., 2005, 2009; Smith et al., 2011; for review, see Berridge, 2012).”
ResultWyvell, C. L., & Berridge, K. C. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07831.2001 · Cited by 436
Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429
A computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Read Montague, P. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 422
Robinson, T. E., & Flagel, S. B. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.09.006 · Cited by 416
Self-citationThe Role of Learning in the Operation of Motivational Systems
Dickinson, A., & Balleine, B. (2002) · Stevens' Handbook of Experimental Psychology · doi:10.1002/0471214426.pas0312 · Cited by 384
Di Ciano, P., Cardinal, R. N., Cowell, R. A., Little, S. J., & Everitt, B. J. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-23-09471.2001 · Cited by 354
Functions of dopamine in the dorsal and ventral striatum
Robbins, T. W., & Everitt, B. J. (1992) · Seminars in Neuroscience · doi:10.1016/1044-5765(92)90010-y · Cited by 348
Reward learning: reinforcement, incentives, and expectations
Berridge, K. C. (2000) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(00)80022-5 · Cited by 318
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
Dickinson, A., Smith, J., & Mirenowicz, J. (2000) · Behavioral Neuroscience · doi:10.1037//0735-7044.114.3.468 · Cited by 314
Quantifying Individual Variation in the Propensity to Attribute Incentive Salience to Reward Cues
Meyer, P. J., Lovic, V., Saunders, B. T., Yager, L. M., Flagel, S. B., Morrow, J. D., & Robinson, T. E. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038987 · Cited by 304
Self-citationA Neural Computational Model of Incentive Salience
Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S., & Aldridge, J. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000437 · Cited by 299 · cited 1×
“This concept was formalized in a recent computational model of incentive salience (Zhang et al., 2009, 2012; Berridge, 2012).”
Flagel, S. B., Watson, S. J., Robinson, T. E., & Akil, H. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0535-8 · Cited by 289
Self-citationA Cocaine Cue Acts as an Incentive Stimulus in Some but not Others: Implications for Addiction
Saunders, B. T., & Robinson, T. E. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.11.015 · Cited by 272
Self-citationTindell, A. J., Berridge, K. C., Zhang, J., Peciña, S., & Aldridge, J. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04411.x · Cited by 268
Linear Mixed Models for Longitudinal Data
(2009) · Multivariable Modeling and Multivariate Analysis for the Behavioral Sciences · doi:10.1201/b15854-12 · Cited by 232
Rats prone to attribute incentive salience to reward cues are also prone to impulsive action
Lovic, V., Saunders, B. T., Yager, L. M., & Robinson, T. E. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.04.006 · Cited by 228
Self-citationMahler, S. V., & Berridge, K. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3875-08.2009 · Cited by 223
Individual Variation in the Motivational Properties of Cocaine
Saunders, B. T., & Robinson, T. E. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2011.48 · Cited by 206
Self-citationDistinct opioid circuits determine the palatability and the desirability of rewarding events
Wassum, K. M., Ostlund, S. B., Maidment, N. T., & Balleine, B. W. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905874106 · Cited by 182
Flagel, S. B., Cameron, C., Pickup, K. N., Watson, S. J., Akil, H., & Robinson, T. E. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.004 · Cited by 179
Self-citationTHE BEHAVIORAL PHARMACOLOGY OF EFFORT‐RELATED CHOICE BEHAVIOR: DOPAMINE, ADENOSINE AND BEYOND
Salamone, J. D., Correa, M., Nunes, E. J., Randall, P. A., & Pardo, M. (2012) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2012.97-125 · Cited by 172
The Role of an Amygdalo-Nigrostriatal Pathway in Associative Learning
Han, J., McMahan, R. W., Holland, P. C., & Gallagher, M. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-10-03913.1997 · Cited by 169
Dopamine and performance in a reinforcement learning task: evidence from Parkinson’s disease
Shiner, T., Seymour, B., Wunderlich, K., Hill, C. S., Bhatia, K. P., Dayan, P., & Dolan, R. J. (2012) · Brain · doi:10.1093/brain/aws083 · Cited by 163
Wassum, K. M., Ostlund, S. B., Balleine, B. W., & Maidment, N. T. (2011) · Learning & Memory · doi:10.1101/lm.2229311 · Cited by 155
DiFeliceantonio, A. G., & Berridge, K. C. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2012.02.032 · Cited by 150
Dynamic Computation of Incentive Salience: “Wanting” What Was Never “Liked”
Tindell, A. J., Smith, K. S., Berridge, K. C., & Aldridge, J. W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2499-09.2009 · Cited by 124 · cited 1×
“These results are complementary to previous studies in which dopaminergic activity was increased by drugs or sensitization, also producing an immediate increase in responding (Wyvell & Berridge, 2001; Tindell et al., 2005, 2009; Smith et al., 2011; for review, see Berridge, 2012).”
ResultMeyer, P., Ma, S. T., & Robinson, T. E. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2429-7 · Cited by 106
Self-citationYager, L. M., & Robinson, T. E. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.04.021 · Cited by 98
Self-citationInstrumental learning in hyperdopaminergic mice
Yin, H. H., Zhuang, X., & Balleine, B. W. (2006) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2005.12.001 · Cited by 97
Blaiss, C. A., & Janak, P. H. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.024 · Cited by 95 · cited 1×
“At first glance this may seem inconsistent with recent reports that systemic dopamine antagonism (Wassum et al., 2011) or inactivation of the nucleus accumbens via GABA receptor agonists (Blaiss & Janak, 2009) can decrease goal-directed CRs.”
ResultLomanowska, A. M., Lovic, V., Rankine, M. J., Mooney, S. J., Robinson, T. E., & Kraemer, G. W. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.01.033 · Cited by 95
Self-citationDisruption of conditioned reward association by typical and atypical antipsychotics
Danna, C. L., & Elmer, G. I. (2010) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2010.04.004 · Cited by 74
Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing
Chang, S. E., Wheeler, D. S., & Holland, P. C. (2012) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2012.03.008 · Cited by 68
AUTOSHAPING IN THE RAT: THE EFFECTS OF LOCALIZABLE VISUAL AND AUDITORY SIGNALS FOR FOOD
Cleland, G. G., & Davey, G. C. L. (1983) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1983.40-47 · Cited by 65
Lex, B., & Hauber, W. (2010) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2009.11.002 · Cited by 61
Disruption of autoshaped responding to a signal of brain-stimulation reward by neuroleptic drugs
Phillips, A. G., McDonald, A. C., & Wilkie, D. M. (1981) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(81)90315-4 · Cited by 57
Computational Neuroscience of Drug Addiction
Ahmed, S. H., & Gutkin, B. S. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0751-5 · Cited by 37
Zhang, J., Berridge, K. C., & Aldridge, J. W. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0751-5_7 · Cited by 9
Cited by
Berridge, K. C., & Kringelbach, M. L. (2015) · Neuron · doi:10.1016/j.neuron.2015.02.018 · Cited by 1,730
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036
The Nucleus Accumbens: An Interface Between Cognition, Emotion, and Action
Floresco, S. B. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115159 · Cited by 938
Neuroscience of affect: brain mechanisms of pleasure and displeasure
Berridge, K. C., & Kringelbach, M. L. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.01.017 · Cited by 523
Nieh, E. H., Vander Weele, C. M., Matthews, G. A., Presbrey, K. N., Wichmann, R., Leppla, C. A., Izadmehr, E. M., & Tye, K. M. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.035 · Cited by 387
Metadata
- Authors
- Saunders, B. T., & Robinson, T. E.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2012-07-11
- Volume
- 36
- Issue
- 4
- Pages
- 2521-2532
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2162074174
- Cited by
- 299
- References
- 79
- FWCI
- 9.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.