Basal Ganglia Neurons Dynamically Facilitate Exploration during Associative Learning
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
The basal ganglia (BG) appear to play a prominent role in associative learning, the process of pairing external stimuli with rewarding responses. Accumulating evidence suggests that the contributions of various BG components may be described within a reinforcement learning model, in which a broad repertoire of possible responses to environmental stimuli are evaluated before the most profitable one is chosen. The striatum receives diverse cortical inputs, providing a rich source of contextual information about environmental cues. It also receives projections from midbrain dopaminergic neurons, whose phasic activity reflects a reward prediction error signal. These coincident information streams are well suited for evaluating responses and biasing future actions toward the most profitable response. Still lacking in this model is a mechanistic description of how initial response variability is generated. To investigate this question, we recorded the activity of single neurons in the globus pallidus internus (GPi), the primary BG output nucleus, in nonhuman primates (Macaca mulatta) performing a motor associative learning task. A subset (29%) of GPi neurons showed learning-related effects, decreasing firing during the early stages of learning, then returning to higher baseline rates as associations were mastered. On a trial-by-trial basis, lower firing rates predicted exploratory behavior, whereas higher rates predicted an exploitive response. These results suggest that, during associative learning, BG output is initially permissive, allowing exploration of a variety of responses. Once a profitable response is identified, increased GPi activity suppresses alternative responses, sharpening the response profile and encouraging exploitation of the profitable learned behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
Alexander, G. E., & Crutcher, M. D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90107-l · Cited by 4,131 · cited 1×
“The basal ganglia (BG) are a central component of multiple parallel loops that, in the aggregate, engage virtually all parts of the cortex (Alexander and Crutcher, 1990; Parent and Hazrati, 1995; McFarland and Haber, 2000).”
BackgroundFunctional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop
Parent, A., & Hazrati, L.-N. (1995) · Brain Research Reviews · doi:10.1016/0165-0173(94)00007-c · Cited by 2,161
A relationship between behavioral choice and the visual responses of neurons in macaque MT
Britten, K. H., Newsome, W. T., Shadlen, M. N., Celebrini, S., & Movshon, J. A. (1996) · Visual Neuroscience · doi:10.1017/s095252380000715x · Cited by 1,049 · cited 1×
“The ROC analysis approximates the likelihood that an ideal observer would be able to predict the behavioral outcome in an individual trial from the neuronal activity (Britten et al., 1996).”
BackgroundRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · cited 1×
“A growing body of work demonstrates that striatal neurons modify their activity based on this convergent information (Kawagoe et al., 1998, 2004; Lauwereyns et al., 2002; Samejima et al., 2005).”
BackgroundDifferent time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · cited 1×
“Dynamic modulation of striatal activity appears causally related to the behavioral changes observed in associative learning, providing evidence for the third mechanism (Brasted and Wise, 2004; Pasupathy and Miller, 2005; Williams and Eskandar, 2006).”
BackgroundHaber, S. N., Kim, K.-S., Mailly, P., & Calzavara, R. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0271-06.2006 · Cited by 686
Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595 · cited 1×
“The firing pattern of striatal projection neurons correlates with these back-and-forth shifts between exploratory and exploitive behavior (Barnes et al., 2005).”
Background
Cited by
From Movement to Thought: Executive Function, Embodied Cognition, and the Cerebellum
Koziol, L. F., Budding, D. E., & Chidekel, D. (2012) · The Cerebellum · doi:10.1007/s12311-011-0321-y · Cited by 392
Sparseness and Expansion in Sensory Representations
Babadi, B., & Sompolinsky, H. (2014) · Neuron · doi:10.1016/j.neuron.2014.07.035 · Cited by 253
Circuit Mechanisms of Sensorimotor Learning
Makino, H., Hwang, E. J., Hedrick, N. G., & Komiyama, T. (2016) · Neuron · doi:10.1016/j.neuron.2016.10.029 · Cited by 228
“This process is known as motor skill learning and is canonically defined as the repetition-mediated increase in the speed and accuracy of a newly acquired motor behavior (Diedrichsen and Kornysheva, 2015; Shmuelof and Krakauer, 2014).”
Study, F. T. A., Brugulat-Serrat, A., Salvadó, G., Sudre, C. H., Grau-Rivera, O., Suárez-Calvet, M., Falcon, C., Sánchez-Benavides, G., Gramunt, N., Fauria, K., et al. (2020) · Brain Imaging and Behavior · doi:10.1007/s11682-019-00151-2 · Cited by 64
Generative models for active vision
Parr, T., Sajid, N., Da Costa, L., Mirza, M. B., & Friston, K. J. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.651432 · Cited by 46
“The basal ganglia appear to be key in quantifying information gain (Sheth et al., 2011; White et al., 2019).”
Background
Metadata
- Authors
- Sheth, S. A., Abuelem, T., Gale, J. T., & Eskandar, E. N.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2011-03-30
- Volume
- 31
- Issue
- 13
- Pages
- 4878-4885
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1972158955
- Cited by
- 98
- References
- 7
- FWCI
- 2.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Basal Ganglia Neurons Dynamically Facilitate Exploration during Associative Learning. https://app.cochat.ai/papers/10.1523/jneurosci.3658-10.2011
- The paper
- Sheth, S. A., Abuelem, T., Gale, J. T., & Eskandar, E. N. (2011). Basal Ganglia Neurons Dynamically Facilitate Exploration during Associative Learning. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.3658-10.2011
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.