Plastic Corticostriatal Circuits for Action Learning: What's Dopamine Got to Do with It?
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Reentrant corticobasal ganglia circuits are important for voluntary action and for action selection. In vivo and ex vivo studies show that these circuits can exhibit a plethora of short‐ and long‐lasting plastic changes. Convergent evidence at the molecular, cellular, and circuit levels indicates that corticostriatal circuits are involved in the acquisition and automatization of novel actions. There is strong evidence that activity in corticostriatal circuits changes during the learning of novel actions, but the plastic changes observed during the early stages of learning a novel action are different than those observed after extensive training. A variety of studies indicate that the neural mechanisms and the corticostriatal subcircuits involved in the initial acquisition of actions and skills differ from those involved in their automatization or in the formation of habits. Dopamine, a critical modulator of short‐ and long‐term plasticity in corticostriatal circuits, is differentially involved in early and late stages of action learning. Changes in dopaminergic transmission have several concomitant effects in corticostriatal function, which may be important for action selection and action learning. These diverse effects may subserve different roles for dopamine in reinforcement and action learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention
Fries, P., Reynolds, J. H., Rorie, A. E., & Desimone, R. (2001) · Science · doi:10.1126/science.1055465 · Cited by 2,786
The role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Functional MRI evidence for adult motor cortex plasticity during motor skill learning
Kami, A., Meyer, G., Jezzard, P., Adams, M. M., Turner, R., & Ungerleider, L. G. (1995) · Nature · doi:10.1038/377155a0 · Cited by 1,883
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276
Cited by
Corticostriatal connectivity and its role in disease
Shepherd, G. M. G. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3469 · Cited by 824
Decision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580
Cortical and basal ganglia contributions to habit learning and automaticity
Ashby, F. G., Turner, B. O., & Horvitz, J. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.02.001 · Cited by 481
Midbrain circuits that set locomotor speed and gait selection
Caggiano, V., Leiras, R., Goñi-Erro, H., Masini, D., Bellardita, C., Bouvier, J., Caldeira, V., Fisone, G., & Kiehn, O. (2018) · Nature · doi:10.1038/nature25448 · Cited by 444
Dopamine Receptor Activation Is Required for Corticostriatal Spike-Timing-Dependent Plasticity
Pawlak, V., & Kerr, J. N. D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4402-07.2008 · Cited by 412
Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural Circuitry
Keiflin, R., & Janak, P. H. (2015) · Neuron · doi:10.1016/j.neuron.2015.08.037 · Cited by 382
Ashby, F. G., & Maddox, W. T. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2010.05874.x · Cited by 318
Dopaminergic Mechanisms in Actions and Habits: Figure 1.
Wickens, J. R., Horvitz, J. C., Costa, R. M., & Killcross, S. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1671-07.2007 · Cited by 271
“…during low dopaminergic transmission, especially those arriving out of phase with the preferred local field potential oscillation, would not necessarily result in an output and, therefore, the correspondence between input and output would be low (i.e., most inputs would be “gated”) (Costa, 2007).”
BackgroundSelf-citationWhat is reinforced by phasic dopamine signals?
Redgrave, P., Gurney, K., & Reynolds, J. (2008) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.10.007 · Cited by 261
Parallel maturation of goal-directed behavior and dopaminergic systems during adolescence
Naneix, F., Marchand, A. R., Di Scala, G., Pape, J.-R., & Coutureau, E. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3080-12.2012 · Cited by 209
“Growing evidence demonstrates that the dopamine (DA) system plays a central role in the coordination and modulation of corticostriatal loops (Costa, 2007) by differentially innervating the prefrontal cortex (mesocortical pathway), the striatum (nigrostriatal pathway), and the nucleus accumbens (mesolimbic pathway) (Bj…”
BackgroundA dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism
Moustafa, A. A., Sherman, S. J., & Frank, M. J. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.07.011 · Cited by 192
Endocannabinoid signaling is critical for habit formation
Hilário, M. R. F. (2007) · Frontiers in Integrative Neuroscience · doi:10.3389/neuro.07.006.2007 · Cited by 164
“Dopamine may have multiple roles in this process (Costa, 2007; Hitchcott et al., 2007; Wickens et al., 2007b).”
Striatum processes reward differently in adolescents versus adults
Sturman, D. A., & Moghaddam, B. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1114137109 · Cited by 98
Enhanced expectancies facilitate golf putting
Palmer, K., Chiviacowsky, S., & Wulf, G. (2016) · Psychology of Sport and Exercise · doi:10.1016/j.psychsport.2015.08.009 · Cited by 82
“…is proceeding on many fronts, including its 59 association with behaviors such as approach/task engagement and elicitation of effort, and, 60 neurophysiologically with a "stamping in" of memories through modulation of synaptic plasticity 61 (e.g., Costa, 2007; Shohamy & Adcock, 2010; Wise, 2004).”
Zhou, R., Zhang, Z., Zhu, Y., Chen, L., Sokabe, M., & Chen, L. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2008.12.028 · Cited by 48
Motor skill learning depends on protein synthesis in the dorsal striatum after training
Wächter, T., Röhrich, S., Frank, A., Molina-Luna, K., Pekanovic, A., Hertler, B., Schubring-Giese, M., & Luft, A. R. (2010) · Experimental Brain Research · doi:10.1007/s00221-009-2027-7 · Cited by 41
“The sensorimotor cortex interacts with the basal ganglia (Pisani et al. 2005; Costa 2007), the cerebellum and other sensory as well as associative cortical areas (Hikosaka et al.”
BackgroundPerera, M. P. N., Gotsis, E. S., Bailey, N. W., Fitzgibbon, B. M., & Fitzgerald, P. B. (2024) · Cerebral Cortex · doi:10.1093/cercor/bhae327 · Cited by 34
Haynes, W. I. A., Clair, A.-H., Fernandez-Vidal, S., Gholipour, B., Morgiève, M., & Mallet, L. (2018) · European Psychiatry · doi:10.1016/j.eurpsy.2018.01.005 · Cited by 29
Metadata
- Authors
- COSTA, R. M.
- Venue
- Annals of the New York Academy of Sciences
- Publisher
- Wiley
- Published
- 2007-05
- Volume
- 1104
- Issue
- 1
- Pages
- 172-191
- ISSN
- 0077-8923 (ISSN-L)
- 1749-6632
- OpenAlex
- W2150825904
- Cited by
- 125
- References
- 53
- FWCI
- 2.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.