Neuronal Correlates of Instrumental Learning in the Dorsal Striatum
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
We recorded neuronal activity simultaneously in the medial and lateral regions of the dorsal striatum as rats learned an operant task. The task involved making head entries into a response port followed by movements to collect rewards at an adjacent reward port. The availability of sucrose reward was signaled by an acoustic stimulus. During training, animals showed increased rates of responding and came to move rapidly and selectively, following the stimulus, from the response port to the reward port. Behavioral “devaluation” studies, pairing sucrose with lithium chloride, established that entries into the response port were habitual (insensitive to devaluation of sucrose) from early in training and entries into the reward port remained goal-directed (sensitive to devaluation) throughout training. Learning-related changes in behavior were paralleled by changes in neuronal activity in the dorsal striatum, with an increasing number of neurons showing task-related firing over the training period. Throughout training, we observed more task-related neurons in the lateral striatum compared with those in the medial striatum. Many of these neurons fired at higher rates during initiation of movements in the presence of the stimulus, compared with similar movements in the absence of the stimulus. Learning was also accompanied by progressive increases in movement-related potentials and transiently increased theta-band oscillations (5–8 Hz) in simultaneously recorded field potentials. Together, these data suggest that representations of task-relevant stimuli and movements develop in the dorsal striatum during instrumental learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 2×
“…the dorsal striatum in instrumental learning The changes in striatal activity that we observed might reflect 1) the formation of stimulus–response (Daw et al. 2005) or stimulus–reward associations (Corbit and Janak 2007), 2 ) sensorimotor learning as reflected by the large reduction in movement…”
BackgroundHaber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610 · cited 1×
“Through these connections, the ventral striatum may access a system of striatonigrostriatal pathways that influence dopaminergic transmission in the lateral striatum, as recently described in primates (Haber et al. 2000) and rodents (Ikemoto 2007).”
BackgroundIkemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · cited 3×
“486 KIMCHI, TORREGROSSA, TAYLOR, AND LAUBACH directed behavior and our protocol did not sufficiently involve one, it is possible that the medial striatum would otherwise have been more engaged, consistent with specific behavioral predictions (Yin et al. 2004, 2005).”
ResultThe role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · cited 4×
“486 KIMCHI, TORREGROSSA, TAYLOR, AND LAUBACH directed behavior and our protocol did not sufficiently involve one, it is possible that the medial striatum would otherwise have been more engaged, consistent with specific behavioral predictions (Yin et al. 2004, 2005).”
BackgroundResultInfluentialReward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Building neural representations of habits.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834 · cited 1×
“Our results also support recent work on procedural learning in the T maze that highlighted changes in neuronal firing rates and theta-band oscillations in the striatum during initial task acquisition (DeCoteau et al. 2007; Jog et al. 1999).”
ResultDynamic reorganization of striatal circuits during the acquisition and consolidation of a skill
Yin, H. H., Mulcare, S. P., Hilário, M. R. F., Clouse, E., Holloway, T., Davis, M. I., Hansson, A. C., Lovinger, D. M., & Costa, R. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2261 · Cited by 818
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712
Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445
Differential Corticostriatal Plasticity during Fast and Slow Motor Skill Learning in Mice
Costa, R. M., Cohen, D., & Nicolelis, M. A. L. (2004) · Current Biology · doi:10.1016/j.cub.2004.06.053 · Cited by 373 · cited 4×
“Recent work by this group (Yin et al. 2009), using a rotorod task (as in Costa et al. 2004), reported that the medial striatum is the primary site of changes in neuronal activity early in sensorimotor learning, in a task in which it would be somewhat more difficult to devalue the outcome.”
BackgroundResultInfluentialThe effect of the instrumental training contingency on susceptibility to reinforcer devaluation
Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748308400912 · Cited by 338
Rapid strengthening of thalamo-amygdala synapses mediates cue–reward learning
Tye, K. M., Stuber, G. D., de Ridder, B., Bonci, A., & Janak, P. H. (2008) · Nature · doi:10.1038/nature06963 · Cited by 216 · cited 2×
“The amygdala and orbital frontal cortex (OFC) have also been implicated in mediating the conditioned properties of stimuli (Pickens et al. 2003) and similar changes in learning-related neuronal activity have been found in these areas (Tye et al. 2008).”
BackgroundChanges in activity of the striatum during formation of a motor habit
Tang, C., Pawlak, A. P., Prokopenko, V., & West, M. O. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05353.x · Cited by 122
Carelli, R. M., Wolske, M., & West, M. O. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-05-01804.1997 · Cited by 114
Cited by
Thorn, C. A., Atallah, H., Howe, M., & Graybiel, A. M. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.036 · Cited by 412
A dual operator view of habitual behavior reflecting cortical and striatal dynamics
Smith, K. S., & Graybiel, A. M. (2013) · Neuron · doi:10.1016/j.neuron.2013.05.038 · Cited by 324
The role of the striatum in social behavior
Báez-Mendoza, R., & Schultz, W. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00233 · Cited by 312
“This coding is independent of the stimuli indicating the action required to obtain reward (Kimchi and Laubach, 2009; Kimchi et al., 2009).”
BackgroundStriatal mechanisms underlying movement, reinforcement, and punishment
Kravitz, A. V., & Kreitzer, A. C. (2012) · Physiology · doi:10.1152/physiol.00004.2012 · Cited by 224
Reappraising striatal D1- and D2-neurons in reward and aversion
Soares-Cunha, C., Coimbra, B., Sousa, N., & Rodrigues, A. J. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.05.021 · Cited by 195
“…neurons play a crucial role in decision-making processes, particularly those encoding specific action–outcome associations and the selection of actions on the basis of their currently expected reward value (Gremel and Costa, 2013; Kimchi et al., 2009; Miyachi et al., 2002; Tang et al., 2007).”
Metadata
- Authors
- Kimchi, E. Y., Torregrossa, M. M., Taylor, J. R., & Laubach, M.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2009-07
- Volume
- 102
- Issue
- 1
- Pages
- 475-489
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2066607700
- Cited by
- 87
- References
- 16
- FWCI
- 3.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.