Neuronal Correlates of Instrumental Learning in the Dorsal Striatum
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
We recorded neuronal activity simultaneously in the medial and lateral regions of the dorsal striatum as rats learned an operant task. The task involved making head entries into a response port followed by movements to collect rewards at an adjacent reward port. The availability of sucrose reward was signaled by an acoustic stimulus. During training, animals showed increased rates of responding and came to move rapidly and selectively, following the stimulus, from the response port to the reward port. Behavioral “devaluation” studies, pairing sucrose with lithium chloride, established that entries into the response port were habitual (insensitive to devaluation of sucrose) from early in training and entries into the reward port remained goal-directed (sensitive to devaluation) throughout training. Learning-related changes in behavior were paralleled by changes in neuronal activity in the dorsal striatum, with an increasing number of neurons showing task-related firing over the training period. Throughout training, we observed more task-related neurons in the lateral striatum compared with those in the medial striatum. Many of these neurons fired at higher rates during initiation of movements in the presence of the stimulus, compared with similar movements in the absence of the stimulus. Learning was also accompanied by progressive increases in movement-related potentials and transiently increased theta-band oscillations (5–8 Hz) in simultaneously recorded field potentials. Together, these data suggest that representations of task-relevant stimuli and movements develop in the dorsal striatum during instrumental learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 2×
“…the dorsal striatum in instrumental learning The changes in striatal activity that we observed might reflect 1) the formation of stimulus–response (Daw et al. 2005) or stimulus–reward associations (Corbit and Janak 2007), 2 ) sensorimotor learning as reflected by the large reduction in movement…”
BackgroundHaber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610 · cited 1×
“Through these connections, the ventral striatum may access a system of striatonigrostriatal pathways that influence dopaminergic transmission in the lateral striatum, as recently described in primates (Haber et al. 2000) and rodents (Ikemoto 2007).”
BackgroundIkemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · cited 3×
“486 KIMCHI, TORREGROSSA, TAYLOR, AND LAUBACH directed behavior and our protocol did not sufficiently involve one, it is possible that the medial striatum would otherwise have been more engaged, consistent with specific behavioral predictions (Yin et al. 2004, 2005).”
ResultThe role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · cited 4×
“486 KIMCHI, TORREGROSSA, TAYLOR, AND LAUBACH directed behavior and our protocol did not sufficiently involve one, it is possible that the medial striatum would otherwise have been more engaged, consistent with specific behavioral predictions (Yin et al. 2004, 2005).”
BackgroundResultInfluentialReward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Building neural representations of habits.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834 · cited 1×
“Our results also support recent work on procedural learning in the T maze that highlighted changes in neuronal firing rates and theta-band oscillations in the striatum during initial task acquisition (DeCoteau et al. 2007; Jog et al. 1999).”
ResultDynamic reorganization of striatal circuits during the acquisition and consolidation of a skill
Yin, H. H., Mulcare, S. P., Hilário, M. R. F., Clouse, E., Holloway, T., Davis, M. I., Hansson, A. C., Lovinger, D. M., & Costa, R. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2261 · Cited by 818
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712
Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595
Cited by
Thorn, C. A., Atallah, H., Howe, M., & Graybiel, A. M. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.036 · Cited by 412
A dual operator view of habitual behavior reflecting cortical and striatal dynamics
Smith, K. S., & Graybiel, A. M. (2013) · Neuron · doi:10.1016/j.neuron.2013.05.038 · Cited by 324
The role of the striatum in social behavior
Báez-Mendoza, R., & Schultz, W. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00233 · Cited by 312
“This coding is independent of the stimuli indicating the action required to obtain reward (Kimchi and Laubach, 2009; Kimchi et al., 2009).”
BackgroundStriatal mechanisms underlying movement, reinforcement, and punishment
Kravitz, A. V., & Kreitzer, A. C. (2012) · Physiology · doi:10.1152/physiol.00004.2012 · Cited by 224
Reappraising striatal D1- and D2-neurons in reward and aversion
Soares-Cunha, C., Coimbra, B., Sousa, N., & Rodrigues, A. J. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.05.021 · Cited by 195
“…neurons play a crucial role in decision-making processes, particularly those encoding specific action–outcome associations and the selection of actions on the basis of their currently expected reward value (Gremel and Costa, 2013; Kimchi et al., 2009; Miyachi et al., 2002; Tang et al., 2007).”
Asaad, W. F., & Eskandar, E. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3793-11.2011 · Cited by 105
Striatum processes reward differently in adolescents versus adults
Sturman, D. A., & Moghaddam, B. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1114137109 · Cited by 98
Lost in Transition: Aging-Related Changes in Executive Control by the Medial Prefrontal Cortex
Caetano, M. S., Horst, N. K., Harenberg, L., Liu, B., Arnsten, A. F. T., & Laubach, M. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6011-11.2012 · Cited by 30
“Subsequent changes in firing rate during the response to the stimulus or during the initiation of locomotion were evaluated using change-point methods from the strucchange library for R (Zeileis et al., 2003), as in Kimchi et al. (2009).”
MethodSelf-citationVitet, H., Bruyère, J., Xu, H., Séris, C., Brocard, J., Abada, Y.-S., Delatour, B., Scaramuzzino, C., Venance, L., & Saudou, F. (2023) · eLife · doi:10.7554/elife.81011 · Cited by 13
“Recent studies have suggested that both DMS and DLS are engaged in learning ( Bergstrom et al., 2018 ; Gremel and Costa, 2013 ; Kimchi et al., 2009 ; Kupferschmidt et al., 2017 ; Perez et al., 2022 ; Perrin and Venance, 2019 ; Stalnaker et al., 2010 ; Thorn et al., 2010 ), so targeting the DLS…”
Metadata
- Authors
- Kimchi, E. Y., Torregrossa, M. M., Taylor, J. R., & Laubach, M.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2009-07
- Volume
- 102
- Issue
- 1
- Pages
- 475-489
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2066607700
- Cited by
- 87
- References
- 16
- FWCI
- 3.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.