Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
We dissociated the contributions to learning of four corticostriatal “loops” (interacting striatal and cortical regions): motor (putamen and motor cortex), visual (posterior caudate and visual cortex), executive (anterior caudate and prefrontal cortex), and motivational (ventral striatum and ventromedial frontal cortex). Subjects learned to categorize individual repeated images into one of two arbitrary categories via trial and error. We identified (1) Regions sensitive to correct categorization, categorization learning, and feedback valence (2) Regions sensitive to prediction error (violation of feedback expectancy) and reward prediction (expected feedback associated with category response), using reinforcement learning modeling and (3) Directed influences between regions using Granger causality modeling. Each loop showed a unique pattern of sensitivity to each of these factors. Both the motor and visual loops were involved in acquisition of categorization ability: activity during correct categorization increased across learning, and was sensitive to reward prediction. However, the posterior caudate received directed influence from visual cortex, whereas the putamen exerted directed influence on motor cortex. The motivational and executive loops were involved in feedback processing: both regions were sensitive to feedback valence, which interacted with learning across scans. However, the motivational loop activity reflected prediction error, whereas executive loop activity reflected reward prediction, consistent with the executive loop role in integrating reward and action. Granger causality modeling found directed influences between striatal and cortical regions within each loop. Across loops, the motor loop exerted directed influence on the executive loop which is consistent with the role of the executive loop in integrating feedback with stimulus-response history.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gusnard, D. A., Akbudak, E., Shulman, G. L., & Raichle, M. E. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.071043098 · Cited by 2,997
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 6×
“…et al., 2004) and Q-learning (Haruno and Kawato, 2006) have been used in the context of studies of instrumental learning.2 Our results are in accordwith those of O'Doherty et al. (2004), who found that the actor function was associated with activity in the head of the caudate and putamen.”
BackgroundMethodResultInfluentialLearning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“Across all these tasks and species, the basal ganglia and their interacting cortical regions have been shown to be active during learning and necessary for learning to take place (Atallah et al., 2007; Packard and Knowlton, 2002; Poldrack and Rodriguez, 2004; Seger, 2008).”
BackgroundHaber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479 · cited 3×
“…the anterior caudate can be seen as a transitional region between the ventral striatum and the other regions of the dorsal striatum: functionally, it integrates feedback with category and action selection, and anatomically it receives an intermediate level of dopaminergic innervation (Haber, 2003).”
BackgroundInfluentialThe Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
Monchi, O., Petrides, M., Petre, V., Worsley, K., & Dagher, A. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07733.2001 · Cited by 961 · cited 1×
“However, some studies have found equivalent activity or even greater activity for negative feedback than positive feedback (Bischoff-Grethe et al., 2008; Monchi et al., 2001).”
BackgroundReward‐Related Responses in the Human Striatum
DELGADO, M. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.002 · Cited by 736
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 1×
“In the present study we examined signed prediction error and found that this predicted activity in the ventral striatum, consistent with previous studies (Schönberg et al., 2007; Seymour et al., 2004; Brovelli et al., 2008; Cohen, 2008; Rodriguez et al., 2006).”
ResultJoel, D., & Weiner, I. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90536-3 · Cited by 430
Cited by
Category Learning in the Brain
Seger, C. A., & Miller, E. K. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135546 · Cited by 461
Self-citationPrediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 438
The Neurocognition of Developmental Disorders of Language
Ullman, M. T., Earle, F. S., Walenski, M., & Janacsek, K. (2020) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011555 · Cited by 223
Cheetham, M. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00126 · Cited by 176
A critical review of habit learning and the basal ganglia
Seger, C. A., & Spiering, B. J. (2011) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2011.00066 · Cited by 170
Metadata
- Authors
- Seger, C. A., Peterson, E. J., Cincotta, C. M., Lopez-Paniagua, D., & Anderson, C. W.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2010-04
- Volume
- 50
- Issue
- 2
- Pages
- 644-656
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W1995108496
- Cited by
- 100
- References
- 16
- FWCI
- 3.20
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling. https://app.cochat.ai/papers/10.1016/j.neuroimage.2009.11.083
- The paper
- Seger, C. A., Peterson, E. J., Cincotta, C. M., Lopez-Paniagua, D., & Anderson, C. W. (2010). Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling. NeuroImage. https://doi.org/10.1016/j.neuroimage.2009.11.083
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.