Rapid dopamine dynamics in the accumbens core and shell Learning and action
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
The catecholamine dopamine (DA) has been implicated in a host of neural processes as diverse as schizophrenia, parkinsonism and reward encoding. Importantly, these distinct features of DA function are due in large part to separate neural circuits involving connections arising from different DA-releasing nuclei and projections to separate afferent targets. Emerging data has suggested that this same principle of separate neural circuits may be applicable within structural subregions, such as the core and shell of the nucleus accumbens (NAc). Further, DA may act selectively on smaller ensembles of cells (or, microcircuits) via differential DA receptor density and distinct inputs and outputs of the microcircuits, thus enabling new learning about Pavlovian cues, instrumental responses, subjective reward processing and decision-making. In this review, by taking advantage of studies using subsecond voltammetric techniques in behaving animals to study how rapid changes in DA levels affect behavior, we examine the spatial and temporal features of DA release and how it relates to both normal learning and similarities to pathological learning in the form of addiction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 1×
“Models of learning such as the RescorlaWagner model (77) and other similar models (78-80) predict that this error term (ΔV in their nomenclature) is the amount of learning that occurs on any given trial.”
BackgroundFrom motivation to action: Functional interface between the limbic system and the motor system
MOGENSON, G., JONES, D., & YIM, C. (1980) · Progress in Neurobiology · doi:10.1016/0301-0082(80)90018-0 · Cited by 2,331 · cited 1×
“This finding indicates that as the “limbic-motor interface” (87), the importance of the NAc exceeds that of action performance alone, and is essential for incorporating aspects of value into chosen courses of action.”
BackgroundA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 2×
“In these experiments, the expected value of one option is pitted against another of a different value by manipulating various features of the outcome or task costs (108).”
BackgroundMethodDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 1×
“For example, dopaminergic midbrain neurons display differential activity based on several factors that reflect reward value such as the cost of performing tasks, the delay to reinforcement, and the probability and magnitude of reinforcement (115-117).”
BackgroundGrace, A. A. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90196-u · Cited by 1,831
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718
A Discounting Framework for Choice With Delayed and Probabilistic Rewards.
Green, L., & Myerson, J. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.5.769 · Cited by 1,676
Pavlovian conditioning: it's not what you think it is
Rescorla, R. A. (1988) · American Psychologist · doi:10.1037/0003-066x.43.3.151 · Cited by 1,542
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · cited 4×
“Attempts to dissociate the relative function of the core and shell in PIT have been equivocal, as different studies have indicated a necessity for either the core (86, 103) or shell (71) in general PIT.”
BackgroundInfluentialIkemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
Krettek, J. E., & Price, J. L. (1978) · Journal of Comparative Neurology · doi:10.1002/cne.901780204 · Cited by 1,293
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · cited 1×
“For example, dopaminergic midbrain neurons display differential activity based on several factors that reflect reward value such as the cost of performing tasks, the delay to reinforcement, and the probability and magnitude of reinforcement (115-117).”
BackgroundSpecificity in the projection patterns of accumbal core and shell in the rat
Heimer, L., Zahm, D. S., Churchill, L., Kalivas, P. W., & Wohltmann, C. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90202-y · Cited by 1,219
Dichotomous dopaminergic control of striatal synaptic plasticity
Shen, W., Flajolet, M., Greengard, P., & Surmeier, D. J. (2008) · Science · doi:10.1126/science.1160575 · Cited by 1,190 · cited 1×
“In the NAc, distinct populations of MSNs selectively express D1-like and D2like receptors in the core and shell (34-35, 42, 44-45).”
BackgroundBreier, A., Su, T.-P., Saunders, R., Carson, R. E., Kolachana, B. S., de Bartolomeis, A., Weinberger, D. R., Weisenfeld, N., Malhotra, A. K., Eckelman, W. C., et al. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.6.2569 · Cited by 1,154 · cited 2×
“In a simple form: (1) animals experience a motivationally salient outcome (for example, food) and determine the value of that reinforcer, (2) cues predictive of those outcomes are detected and attended to, and (3) any actions necessary to produce and obtain the reinforcer are acquired and performed.”
BackgroundSubsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113 · cited 2×
“As such, phasic dopamine release can be detected within hundreds of milliseconds of motivationally significant events such as receipt of natural rewards like food, sucrose (8) or sex (910), brain stimulation (11-13), or drugs of abuse like cocaine (14-15).”
BackgroundDopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · cited 1×
“In a series of experiments, Schultz and colleagues (7, 81) demonstrated that DA neurons in the VTA and SN exhibited neural activity that tracked the error prediction term at the time of reward receipt.”
BackgroundImpulsive choice induced in rats by lesions of the nucleus accumbens core
Cardinal, R. N., Pennicott, D. R., Lakmali, C., Sugathapala, Robbins, T. W., & Everitt, B. J. (2001) · Science · doi:10.1126/science.1060818 · Cited by 923 · cited 1×
“While it does not appear that the NAc core is necessary for simply choosing between a small or large reward, animals with lesions or temporary inactivation of the core were unwilling to choose the better reward after an imposed delay or decrease in reward probability, even though those options would result overall in…”
BackgroundExcitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking
Stuber, G. D., Sparta, D. R., Stamatakis, A. M., van Leeuwen, W. A., Hardjoprajitno, J. E., Cho, S., Tye, K. M., Kempadoo, K. A., Zhang, F., Deisseroth, K., et al. (2011) · Nature · doi:10.1038/nature10194 · Cited by 878
Wyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764 · cited 1×
“Notably, lesions of NAc fail to disrupt the simple conditioning aspects of either Pavlovian or instrumental performance alone, but selectively impair the “transfer” ability of the cue to modulate operant activity (71, 86, 103), while DAenhancing infusions of amphetamine into the NAc shell enhance this effect (104).”
BackgroundDopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · cited 2×
“Similar findings were observed during operant responding for natural rewards, as DA is reliably released in the core and the shell during DS cues predictive of food (8).”
BackgroundResultAssociative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710 · cited 1×
“To address this explicitly, work in this lab measured DA release in the NAc core of rats during acquisition of a Pavlovian task (84).”
MethodBelin, D., & Everitt, B. J. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.019 · Cited by 697 · cited 1×
“thalamic targets (30, 47-50), suggesting a possible role in memory and habit formation.”
BackgroundUnmanageable motivation in addiction: a pathology in prefrontal-accumbens glutamate transmission
Kalivas, P. W., Volkow, N., & Seamans, J. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.005 · Cited by 657
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03251.2001 · Cited by 564 · cited 4×
“Attempts to dissociate the relative function of the core and shell in PIT have been equivocal, as different studies have indicated a necessity for either the core (86, 103) or shell (71) in general PIT.”
BackgroundResultInfluentialBelin, D., Jonkman, S., Dickinson, A., Robbins, T. W., & Everitt, B. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.027 · Cited by 520
Roitman, M. F., Wheeler, R. A., & Carelli, R. M. (2005) · Neuron · doi:10.1016/j.neuron.2004.12.055 · Cited by 453 · cited 2×
“This proportion of excitatory encoding was similar to that seen during unsignaled delivery of a bitter quinine solution (51) or when a tastant had developed a conditioned taste aversion through pairing with illness”
BackgroundResultRelations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388
Mcdonald, A. J. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90248-m · Cited by 372
Hall, J., Parkinson, J. A., Connor, T. M., Dickinson, A., & Everitt, B. J. (2001) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01577.x · Cited by 355
Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation
Garris, P. A., Kilpatrick, M., Bunin, M. A., Michael, D., Walker, Q. D., & Wightman, R. M. (1999) · Nature · doi:10.1038/18019 · Cited by 327 · cited 1×
“DA was released following stimulation as well as time-locked to the lever press (88), though DA transients to the press”
BackgroundRobinson, D. L., Heien, M. L. A. V., & Wightman, R. M. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-23-10477.2002 · Cited by 290
Usuda, I., Tanaka, K., & Chiba, T. (1998) · Brain Research · doi:10.1016/s0006-8993(98)00359-x · Cited by 248
Event representation in Pavlovian conditioning: Image and action
Holland, P. C. (1990) · Cognition · doi:10.1016/0010-0277(90)90020-k · Cited by 229 · cited 2×
“Studies incorporating conditioning designs have reliably demonstrated that animals acquire critical information about the expected outcome (69).”
BackgroundStuber, G. D., Roitman, M. F., Phillips, P. E. M., Carelli, R. M., & Wightman, R. M. (2005) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300619 · Cited by 217
Setlow, B., Holland, P. C., & Gallagher, M. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.2.267 · Cited by 160
Limbic cortical-ventral striatal systems underlying appetitive conditioning
Parkinson, J. A., Cardinal, R. N., & Everitt, B. J. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26019-6 · Cited by 149 · cited 1×
“However, smaller lesions of NAc core have been shown to contribute to deficits in autoshaping (72) and discriminated approach (73).”
BackgroundWright, C. I., & Groenewegen, H. J. (1996) · Neuroscience · doi:10.1016/0306-4522(95)00592-7 · Cited by 148
Cheer, J. F., Heien, M. L. A. V., Garris, P. A., Carelli, R. M., & Wightman, R. M. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0509607102 · Cited by 143
Self-citationNucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm
Day, J. J., Wheeler, R. A., Roitman, M. F., & Carelli, R. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04654.x · Cited by 140
Self-citationOwesson‐White, C. A., Ariansen, J., Stuber, G. D., Cleaveland, N. A., Cheer, J. F., Mark Wightman, R., & Carelli, R. M. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06916.x · Cited by 126 · cited 5×
“to the coincident encoding of DA and neural activity in the NAc, the relative intensity of the two events were also coupled; the greater the strength of neuronal activity, the larger the DA release event (14).”
BackgroundMethodInfluentialBlaiss, C. A., & Janak, P. H. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.024 · Cited by 95 · cited 1×
“However, smaller lesions of NAc core have been shown to contribute to deficits in autoshaping (72) and discriminated approach (73).”
BackgroundSingh, T. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00126 · Cited by 40 · cited 1×
“(74) trained rats to associate a Pavlovian cue light (CS+) with delivery of food.”
Background
Cited by
Val-Laillet, D., Aarts, E., Weber, B., Ferrari, M., Quaresima, V., Stoeckel, L. E., Alonso-Alonso, M., Audette, M., Malbert, C. H., & Stice, E. (2015) · NeuroImage: Clinical · doi:10.1016/j.nicl.2015.03.016 · Cited by 442
Contrasting forms of cocaine-evoked plasticity control components of relapse
Pascoli, V., Terrier, J., Espallergues, J., Valjent, E., O’Connor, E. C., & Lüscher, C. (2014) · Nature · doi:10.1038/nature13257 · Cited by 396
Cooper, S., Robison, A. J., & Mazei-Robison, M. S. (2017) · Neurotherapeutics · doi:10.1007/s13311-017-0525-z · Cited by 265
Wenzel, J. M., Rauscher, N. A., Cheer, J. F., & Oleson, E. B. (2015) · ACS Chemical Neuroscience · doi:10.1021/cn500255p · Cited by 131
Karkhanis (2017) · doi:10.1016/bs.irn.2017.08.001 · Cited by 113
Metadata
- Authors
- Saddoris, M. P.
- Venue
- Frontiers in Bioscience
- Publisher
- IMR Press
- Published
- 2013
- Volume
- E5
- Issue
- 1
- Pages
- 273-288
- ISSN
- 1944-7892 (ISSN-L)
- 1945-0494
- 1945-0508
- DOI
- 10.2741/e615
- OpenAlex
- W2046739058
- Cited by
- 117
- References
- 44
- FWCI
- 4.32
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.