Parallel Cortico-Basal Ganglia Mechanisms for Acquisition and Execution of Visuomotor Sequences—A Computational Approach
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Experimental studies have suggested that many brain areas, including the basal ganglia (BG), contribute to procedural learning. Focusing on the basal ganglia-thalamo-cortical (BG-TC) system, we propose a computational model to explain how different brain areas work together in procedural learning. The BG-TC system is composed of multiple separate loop circuits. According to our model, two separate BG-TC loops learn a visuomotor sequence concurrently but using different coordinates, one visual, and the other motor. The visual loop includes the dorsolateral prefrontal (DLPF) cortex and the anterior part of the BG, while the motor loop includes the supplementary motor area (SMA) and the posterior BG. The concurrent learning in these loops is based on reinforcement signals carried by dopaminergic (DA) neurons that project divergently to the anterior (“visual”) and posterior (“motor”) parts of the striatum. It is expected, however, that the visual loop learns a sequence faster than the motor loop due to their different coordinates. The difference in learning speed may lead to inconsistent outputs from the visual and motor loops, and this problem is solved by a mechanism called a “coordinator,” which adjusts the contribution of the visual and motor loops to a final motor output. The coordinator is assumed to be in the presupplementary motor area (pre-SMA). We hypothesize that the visual and motor loops, with the help of the coordinator, achieve both the quick acquisition of novel sequences and the robust execution of well-learned sequences. A computational model based on the hypothesis is examined in a series of computer simulations, referring to the results of the 2 × 5 task experiments that have been used on both monkeys and humans. We found that the dual mechanism with the coordinator was superior to the single (visual or motor) mechanism. The model replicated the following essential features of the experimental results: (1) the time course of learning, (2) the effect of opposite hand use, (3) the effect of sequence reversal, and (4) the effects of localized brain inactivations. Our model may account for a common feature of procedural learning: A spatial sequence of discrete actions (subserved by the visual loop) is gradually replaced by a robust motor skill (subserved by the motor loop).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Baddeley, A. (1992) · Science · doi:10.1126/science.1736359 · Cited by 5,258
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
Alexander, G. E., & Crutcher, M. D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90107-l · Cited by 4,131 · cited 3×
“At least four basal ganglia-thalamocortical (BG-TC) loops have been identiied, namely, the motor, oculomotor, prefrontal, and limbic loops (Alexander and Crutcher 1990).”
BackgroundMethodAcquisition of cognitive skill
Anderson, J. R. (1982) · Psychological Review · doi:10.1037/0033-295x.89.4.369 · Cited by 3,663 · cited 1×
“This attentive-to-automatic process is considered to be a characteristic of procedural learning (Fitts 1964; Anderson 1982; Cohen et al. 1992).”
BackgroundAnterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 2×
“The question still remains , however , if such a coordinating function is realized only in pre - SMA or by the interaction of the pre - SMA with some areas , possibly including CMA ( Carter et al .”
BackgroundMnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex
Funahashi, S., Bruce, C. J., & Goldman-Rakic, P. S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.2.331 · Cited by 2,685 · cited 1×
“The DLPF is well known to have a visuospatial memory with a working memory characteristic such that information retained by DLPF neurons can be stored temporally and rapidly reset (Goldman-Rakic 1987; Funahashi et al. 1989).”
BackgroundA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Temporal dynamics of brain activation during a working memory task
Cohen, J. D., Perlstein, W. M., Braver, T. S., Nystrom, L. E., Noll, D. C., Jonides, J., & Smith, E. E. (1997) · Nature · doi:10.1038/386604a0 · Cited by 1,876 · cited 1×
“This indicates that the working memory property also exists in contextual visual prediction (Goldman-Rakic 1987; Cohen et al. 1997; Monchi and Taylor 1999; O'Reilly et al. 1999).”
BackgroundDifferential-Geometrical Methods in Statistics
Amari, S.-I. (1985) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-5056-2 · Cited by 1,673 · cited 1×
“This multiplicative combination , considered as an e - projection in information geometry ( Amari 1985 ) , gives the sharper output distribution of the two networks than the arithmetic average would ( e . g .”
BackgroundAndersen, R. A., Snyder, L. H., Bradley, D. C., & Xing, J. (1997) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.20.1.303 · Cited by 1,486 · cited 1×
“as visual representations, and joint-angle trajectories, joint torques, and muscle commands as motor representations (Kalaska et al. 1990; Georgopoulos 1994; Rizzolatti et al. 1997; Wise et al. 1997; Andersen et al. 1997; Graziano and Gross 1998; Krakauer et al. 1999).”
BackgroundAnatomical evidence for cerebellar and basal ganglia involvement in higher cognitive function
Middleton, F. A., & Strick, P. L. (1994) · Science · doi:10.1126/science.7939688 · Cited by 1,356 · cited 1×
“Anatomically, a real-time control mechanism presumably includes PMv, M1, and the cerebellum (Kawato 1990; Thach et al. 1993; Middleton and Strick 1994; Houk and Wise 1995; Rizzolatti et al. 1997; Sakai et al. 2000).”
BackgroundSchultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Neural Correlates of Motor Memory Consolidation
Shadmehr, R., & Holcomb, H. H. (1997) · Science · doi:10.1126/science.277.5327.821 · Cited by 1,022
The Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
Parallel neural networks for learning sequential procedures
Hikosaka, O., Nakahara, H., Rand, M. K., Sakai, K., Lu, X., Nakamura, K., Miyachi, S., & Doya, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(99)01439-3 · Cited by 799
Self-citationReward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684
Anatomy of motor learning. I. Frontal cortex and attention to action
Jueptner, M., Stephan, K. M., Frith, C. D., Brooks, D. J., Frackowiak, R. S. J., & Passingham, R. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.3.1313 · Cited by 624
Attentional and nonattentional forms of sequence learning.
Curran, T., & Keele, S. W. (1993) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.19.1.189 · Cited by 594 · cited 1×
“…studies on motor learning have shown that many brain areas, including the basal ganglia, are involved in procedural learning (Passingham 19933 Curran and Keele 19933 Brashers- Krug et al. 19966 Deiber et al. 19977 Karni et al. 19988 Honda et al. 19988 Grafton et al. 19988 Toni et al. 19988…”
BackgroundMatsuzaka, Y., Aizawa, H., & Tanji, J. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.653 · Cited by 500 · cited 6×
“The current coordinator output is closely related to the current visual input; The neural activity in the pre-SMA tends to be more active after receiving sensory inputs and before starting movement, that is, is closely related to the current visual input (Matsuzaka et al. 1992; Halsband et al. 1994; Sakai et al. 1999).”
BackgroundInfluentialDifferential roles of monkey striatum in learning of sequential hand movement
Miyachi, S., Hikosaka, O., Miyashita, K., Kárádi, Z., & Rand, M. K. (1997) · Experimental Brain Research · doi:10.1007/pl00005669 · Cited by 374 · cited 9×
“9, 10 and 11 show the results from the simulations and from experiments with animals (Miyachi et al. 1997; Nakamura et al. 1999).”
BackgroundResultInfluentialSelf-citationDynamic cortical involvement in implicit and explicit motor sequence learning. A PET study
Honda, M. (1998) · Brain · doi:10.1093/brain/121.11.2159 · Cited by 370 · cited 3×
“Although the DLPF has not been experimentally inactivated, human imaging studies have shown that the DLPF is activated in the early stage of sequence learning (Jueptner et al. 997b; Sakai et al. 1998; Honda et al. 1998).”
BackgroundDoyon, J., Owen, A. M., Petrides, M., Sziklas, V., & Evans, A. C. (1996) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1996.tb01249.x · Cited by 326 · cited 1×
“Some of these areas are preferentially related to the acquisition of novel behaviors, while others are related to the execution of previously learned behaviors (Doyon et al. 19966 Rauch e t a l .”
BackgroundSpatial maps for the control of movement.
Graziano, M. S., & Gross, C. G. (1998) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(98)80140-2 · Cited by 323 · cited 1×
“as visual representations, and joint-angle trajectories, joint torques, and muscle commands as motor representations (Kalaska et al. 1990; Georgopoulos 1994; Rizzolatti et al. 1997; Wise et al. 1997; Andersen et al. 1997; Graziano and Gross 1998; Krakauer et al. 1999).”
Background
Cited by
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
Look away: the anti-saccade task and the voluntary control of eye movement
Munoz, D. P., & Everling, S. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1345 · Cited by 1,427
O'Reilly, R. C., & Frank, M. J. (2006) · Neural Computation · doi:10.1162/089976606775093909 · Cited by 1,066
Central mechanisms of motor skill learning
Hikosaka, O., Nakamura, K., Sakai, K., & Nakahara, H. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00307-0 · Cited by 1,023
Self-citation
Metadata
- Authors
- Nakahara, H., Doya, K., & Hikosaka, O.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 2001-07-01
- Volume
- 13
- Issue
- 5
- Pages
- 626-647
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2155705874
- Cited by
- 191
- References
- 24
- FWCI
- 4.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.