The DOI matches its Crossref record.
Models of Information Processing in the Basal Ganglia
Abstract
This book brings together the biology and computational features of the basal ganglia and their related cortical areas along with select examples of how this knowledge can be integrated into neural network models. Recent years have seen a remarkable expansion of knowledge about the anatomical organization of the part of the brain known as the basal ganglia, the signal processing that occurs in these structures, and the many relations both to molecular mechanisms and to cognitive functions. This book brings together the biology and computational features of the basal ganglia and their related cortical areas along with select examples of how this knowledge can be integrated into neural network models. Organized in four parts - fundamentals, motor functions and working memories, reward mechanisms, and cognitive and memory operations - the chapters present a unique admixture of theory, cognitive psychology, anatomy, and both cellular- and systems- level physiology written by experts in each of these areas. The editors have provided commentaries as a helpful guide to each part. Many new discoveries about the biology of the basal ganglia are summarized, and their impact on the computational role of the forebrain in the planning and control of complex motor behaviors discussed. The various findings point toward an unexpected role for the basal ganglia in the contextual analysis of the environment and in the adaptive use of this information for the planning and execution of intelligent behaviors. Parallels are explored between these findings and new connectionist approaches to difficult control problems in robotics and engineering. Contributors James L. Adams, P. Apicella, Michael Arbib, Dana H. Ballard, Andrew G. Barto, J. Brian Burns, Christopher I. Connolly, Peter F. Dominey, Richard P. Dum, John Gabrieli, M. Garcia-Munoz, Patricia S. Goldman-Rakic, Ann M. Graybiel, P. M. Groves, Mary M. Hayhoe, J. R. Hollerman, George Houghton, James C. Houk, Stephen Jackson, Minoru Kimura, A. B. Kirillov, Rolf Kotter, J. C. Linder, T. Ljungberg, M. S. Manley, M. E. Martone, J. Mirenowicz, C. D. Myre, Jeff Pelz, Nathalie Picard, R. Romo, S. F. Sawyer, E Scarnat, Wolfram Schultz, Peter L. Strick, Charles J. Wilson, Jeff Wickens, Donald J. Woodward, S. J. Young Bradford Books imprint
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Actor-critic models145-147 operate within the evaluation system”
From Resolving the neural circuits of anxiety (2015) · cites this paper as [145]
In the citing paper
“dopamine inputs to the striatum push the animal toward obtaining maximum reward, a process that must take into account possible dangers.”
From Resolving the neural circuits of anxiety (2015) · cites this paper as [145]
Citations
Cited by
Sorted by citations
Items 801–900 of 999
Learning Spatial Localization: From Rat Studies to Computational Models of the Hippocampus
Barrera, A., Tejera, G., Llofriu, M., & Weitzenfeld, A. (2014) · Spatial Cognition and Computation · doi:10.1080/13875868.2014.961602 · Cited by 11
Dopamine — Its Role in Behaviour and Cognition in Experimental Animals and Humans
Robbins, T. W., & Everitt, B. J. (2002) · Handbook of experimental pharmacology · doi:10.1007/978-3-662-06765-9_7 · Cited by 11
Beyond the correspondence metaphor: When accuracy cannot be assessed
Newby, I. R., & Ross, M. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042321 · Cited by 10
Activity patterns in mesolimbic regions in rats during operant tasks for reward
Woodward, D. J., Chang, J., Janak, P. H., Azarov, A., & Anstrom, K. K. (2000) · Progress in brain research · doi:10.1016/s0079-6123(00)26021-4 · Cited by 10
A Comparative Perspective on Motor Learning
Striedter, G. F. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3847 · Cited by 10
Tan, C. O., & Bullock, D. H. (2007) · Neuroscience Letters · doi:10.1016/j.neulet.2007.10.039 · Cited by 10
Kitano, K., Câteau, H., & Fukai, T. (2002) · Neurocomputing · doi:10.1016/s0925-2312(02)00404-6 · Cited by 10
de Fockert, J. W., Rees, G. E., Frith, C., & Lavie, N. (2007) · Cited by 10
Reward-Bases: Dopaminergic Mechanisms for Adaptive Acquisition of Multiple Reward TypesPreprint
Millidge, B., Song, Y.-H., Lak, A., Walton, M., & Bogacz, R. (2023) · bioRxiv · doi:10.1101/2023.05.09.540067 · Cited by 7
Mizuhiki, T., Richmond, B. J., & Shidara, M. (2006) · Neuroscience Research · doi:10.1016/j.neures.2006.12.008 · Cited by 14
Levy, Y. Z., Levy, D. J., Barto, A. G., & Meyer, J. S. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00167 · Cited by 10
Santucci, V. G., Baldassarre, G., & Mirolli, M. (2010) · Cited by 10
Kaplan, F., & Oudeyer, P. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511994838.011 · Cited by 10
THE B-I-C-A OF BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES
Stocco, A., Lebiere, C. J., & Samsonovich, A. V. (2010) · International Journal of Machine Consciousness · doi:10.1142/s1793843010000552 · Cited by 9
An empirical solution to the puzzle of weakness of will
Haas, J. (2018) · Synthese · doi:10.1007/s11229-018-1712-0 · Cited by 10
Perceptual factors contribute to akinesia in Parkinson’s disease
Ballanger, B., Gil, R., Audiffren, M. F., & Desmurget, M. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0783-1 · Cited by 14
Modelling the learning of biomechanics and visual planning for decision-making of motor actions
Cos, I., Khamassi, M., & Girard, B. (2013) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2013.07.004 · Cited by 10
The predictive basis of situated and embodied artificial intelligence
Downing, K. L. (2005) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1068009.1068016 · Cited by 9
Motor learning and synaptic plasticity in the cerebellum
Thompson, R. F. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081887 · Cited by 9
Striatal reconstruction by striatal grafts
Dunnett, S. B. (1999) · Springer eBooks · doi:10.1007/978-3-7091-6369-6_11 · Cited by 9
Quantitative Trait Loci: Mapping Drug and Alcohol-Related Genes
Crabbe, J. C., Belknap, J. K., Metten, P., et al. (1997) · Advances in pharmacology · doi:10.1016/s1054-3589(08)60923-0 · Cited by 9
Perhaps it's time to completely rethink cerebellar function
Bower, J. M. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081553 · Cited by 9
Quantitative On-Line Analysis of Physiological Data for Lesion Placement in Pallidotomy
Lehman, R. M., Micheli-Tzanakou, E., Medl, A., et al. (2000) · Stereotactic and Functional Neurosurgery · doi:10.1159/000048378 · Cited by 9
The correspondence metaphor of memory: Right, wrong, or useful?
Koriat, A., & Goldsmith, M. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042394 · Cited by 9
Striatal dopamine in attentional learning: A computational model
Salum, C., da Silva, A. R., & Pickering, A. D. (1999) · Neurocomputing · doi:10.1016/s0925-2312(98)00129-5 · Cited by 9
Neuropsychiatric implications of basal ganglia dysfunction
Lidsky, T. I. (1997) · Biological Psychiatry · doi:10.1016/s0006-3223(96)00515-x · Cited by 9
A reinforcement learning algorithm for rescheduling preempted tasks in fog nodes
Nair, B., & Bhanu, S. M. S. (2022) · Journal of Scheduling · doi:10.1007/s10951-022-00725-x · Cited by 8
Taffoni, F., Formica, D., Schiavone, G., et al. (2012) · Springer eBooks · doi:10.1007/978-3-642-32375-1_16 · Cited by 8
Behavioral plasticity through the modulation of switch neurons
Vassiliades, V., & Christodoulou, C. C. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.11.001 · Cited by 9
Granato, G., Cartoni, E., Rold, F. D., Mattera, A., & Baldassarre, G. (2022) · PLoS ONE · doi:10.1371/journal.pone.0267838 · Cited by 9
Is Short-Term Memory for Discrete Arm Movements Impaired in Huntington's Disease?
Davis, J. D., Filoteo, J. V., & Kesner, R. P. (2007) · Cortex · doi:10.1016/s0010-9452(08)70480-5 · Cited by 8
CURRENT CONTROVERSIES AND FUTURE DIRECTIONS IN BASAL GANGLIA RESEARCH
Garcia‐Cairasco, N., Miguel, E. C., Rauch, S. L., & Leckman, J. F. (1997) · Psychiatric Clinics of North America · doi:10.1016/s0193-953x(05)70354-3 · Cited by 7
A dynamical-systems model for Parkinson's disease
Connolly, C. I., Burns, J. B., & Jog, M. (2000) · Biological Cybernetics · doi:10.1007/pl00007971 · Cited by 8
Modeling Decision-Making Systems in Addiction
Kurth-Nelson, Z. L., & Redish, A. D. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0751-5_6 · Cited by 12
Parallel and Interrelated Neural Systems Underlying Adaptive Navigation
Mizumori, S. J. Y. (2005) · Integrative and Comparative Biology · doi:10.1093/icb/45.3.547 · Cited by 8
Biologically Inspired Neural Controller for Robot Learning and Mapping
Ramírez, A. B., & Ridel, A. W. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2006.247380 · Cited by 8
Dopamine dependence in aggregate feedback learning: A computational cognitive neuroscience approach
Valentin, V. V., Maddox, W. T., & Ashby, F. G. (2016) · Brain and Cognition · doi:10.1016/j.bandc.2016.06.002 · Cited by 8
Auction‐based serious game for bug tracking
Üsfekes, Ç., Tüzün, E., Yılmaz, M., et al. (2019) · IET Software · doi:10.1049/iet-sen.2018.5144 · Cited by 8
Evolution of Valence Systems in an Unstable Environment
Snel, M., & Hayes, G. M. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69134-1_2 · Cited by 8
Ishida, F., Sasaki, T., Sakaguchi, Y., & Shimai, H. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.04.009 · Cited by 8
Probing Striatal Function in Obsessive Compulsive Disorder
Rauch, S. L. (2002) · Advances in behavioral biology · doi:10.1007/978-1-4615-0179-4_9 · Cited by 8
Contexts and functions of retrieval
Winograd, E. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042370 · Cited by 8
Learning in large-scale spiking neural networks
Bekolay, T. (2011) · UWSpace (University of Waterloo) · Cited by 7
Sidibé, M., Paré, J., Raju, D. R., & Smith, Y. (2002) · Advances in behavioral biology · doi:10.1007/978-1-4615-0715-4_41 · Cited by 8
Influences of Reinforcement and Choice Histories on Choice Behavior in Actor-Critic Learning
Katahira, K., & Kimura, K. (2022) · Computational Brain & Behavior · doi:10.1007/s42113-022-00145-2 · Cited by 7
Adaptive Dopaminergic Neurons Report the Appetitive Value of Environmental Stimuli
Schultz, W. (1997) · Advances in psychology · doi:10.1016/s0166-4115(97)80103-3 · Cited by 7
Reinforcement learning and dopamine in the striatum: A modeling perspective
Wanjerkhede, S. M., Bapi, R. S., & Mytri, V. D. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.02.061 · Cited by 5
Adaptive learning via selectionism and Bayesianism, Part II: The sequential case
Zhang, J. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.017 · Cited by 7
Memory, metamemory, and conditional statistics
Bjork, R. A., & Wickens, T. D. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042187 · Cited by 7
Adrenergic receptor-mediated modulation of striatal firing patterns
Ohta, H., Kohno, Y., Arake, M., Tamura, R., Yukawa, S., Sato, Y., Morimoto, Y., Nishida, Y., & Yawo, H. (2016) · Neuroscience Research · doi:10.1016/j.neures.2016.05.004 · Cited by 7
Examining Reward Mechanisms for Effective Usage of Application Lifecycle Management Tools
Üsfekes, Ç., Yılmaz, M., Tüzün, E., et al. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-64218-5_21 · Cited by 7
Alterman, R. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042138 · Cited by 7
Local Circuit Neurons in the Frontal Cortico-Striatal System
Kawaguchi, Y. (2003) · Springer eBooks · doi:10.1007/978-1-4615-0039-1_9 · Cited by 7
Khamassi, M., Girard, B., Berthoz, A., et al. (2004) · Cited by 7
How necessary are the stripes of a tiger?
Grossman, M., Troiani, V., Koenig, P. L., Work, M., & Moore, P. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.09.022 · Cited by 7
Feingold, A., Nini, A., Raz, A., Zelenskaya, V. S., & Bergman, H. (1996) · Advances in behavioral biology · doi:10.1007/978-1-4899-0194-1_25 · Cited by 7
Constructing the Relational Mind
Taylor, J. G. (1998) · Cited by 7
Khamassi, M. (2007) · HAL · doi:10.13140/rg.2.1.4065.8004 · Cited by 7
A multiscale model of striatum microcircuit dynamicsPreprint
Tesler, F., Kozlov, A., Grillner, S. E., & Alain Destexhe, A. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.12.28.573546 · Cited by 7
Girard, B. (2003) · HAL · Cited by 7
Reinforcement learning at the interface of artificial intelligence and cognitive science
Alkam, T., Tarshizi, E., & Benschoten, A. H. V. (2025) · Neuroscience · doi:10.1016/j.neuroscience.2025.09.004 · Cited by 8
A self-learning cognitive architecture exploiting causality from rewards
Li, H., Dou, R., Keil, A., & Príncipe, J. C. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.02.029 · Cited by 6
Rethinking dopamine‐guided action sequence learning
Song, M. R., & Lee, S. W. (2024) · European Journal of Neuroscience · doi:10.1111/ejn.16426 · Cited by 6
Cecchini, G., DePass, M., Baspinar, E., Andujar, M., Ramawat, S., Pani, P., Ferraina, S., Alain Destexhe, A., Moreno‐Bote, R., & Cos, I. (2024) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2024.1399394 · Cited by 7
Attentional Action Selection Using Reinforcement Learning
Nocera, D. D., Finzi, A., Rossi, S., et al. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33093-3_37 · Cited by 6
Warabi, T., Furuyama, H., & Κato, M. (2019) · Experimental Brain Research · doi:10.1007/s00221-019-05704-x · Cited by 6
Iwamoto, M., & Kato, D. (2020) · Neural Computation · doi:10.1162/neco_a_01333 · Cited by 6
Golkhou, V. Z., Lucas, C., & Parnianpour, M. (2004) · Biomedical Engineering Applications Basis and Communications · doi:10.4015/s1016237204000426 · Cited by 6
Schroeder, T. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.3 · Cited by 7
Reinforcement learning algorithms that assimilate and accommodate skills with multiple tasks
Tommasino, P., Caligiore, D., Mirolli, M., & Baldassarre, G. (2012) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2012.6400871 · Cited by 6
Muscle Synergy–Driven Robust Motion Control
Min, K., Iwamoto, M., Kakei, S., et al. (2018) · Neural Computation · doi:10.1162/neco_a_01063 · Cited by 6
A nonlinear hidden layer enables actor–critic agents to learn multiple paired association navigation
Ganeshkumar, M., Tan, C., Libedinsky, C., Yen, S., & Tan, A. Y. Y. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab456 · Cited by 8
Chapter 8 Problem solving, inhibition, and frontal lobe function
Dorfman, J. (1998) · Advances in psychology · doi:10.1016/s0166-4115(98)80010-1 · Cited by 6
Multiple Forward Model Architecture for Sequence Processing
Bapi, R. S., & Doya, K. (2000) · Lecture notes in computer science · doi:10.1007/3-540-44565-x_14 · Cited by 6
Neuropsychologic functioning and structural MRI of the brain in patients with schizophrenia
Premkumar, P., & Sharma, T. (2005) · Expert Review of Neurotherapeutics · doi:10.1586/14737175.5.1.85 · Cited by 6
Functional memory requires a quite different value metaphor
Anderson, N. H. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0004214x · Cited by 6
Kitano, K., Aoyagi, T., & Fukai, T. (2001) · Neuroscience Research · doi:10.1016/s0168-0102(01)00214-0 · Cited by 6
The alternative to the storehouse metaphor
Ben‐Ze’ev, A. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042175 · Cited by 6
Associative memory as a Bayesian building block
Zhu, S. (2008) · doi:10.6083/m4pz56sc · Cited by 6
Extending the Computational Abilities of the Procedural Learning Mechanism in ACT-R
Fu, W., & Anderson, J. R. (2018) · eScholarship (California Digital Library) · doi:10.1184/r1/6614768 · Cited by 6
Language Functions in Parkinson’s Disease: Evidence for a Neurochemistry of Language
McNaniara, P., & Durso, R. (2005) · Kluwer Academic Publishers eBooks · doi:10.1007/0-306-46898-0_13 · Cited by 6
The Behavioral Implementation of Hippocampal Processing
Mizumori, S. J. Y., Pratt, W. E., Cooper, B. G., & Guazzelli, A. (2002) · Springer eBooks · doi:10.1007/978-1-4615-0887-8_11 · Cited by 6
Correspondence to the past: The essence of the archaeology metaphor
Larsen, S. F. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042266 · Cited by 6
Mixing memory and desire: How memory reactivation supports deliberative decision-making.Preprint
Wang, S., Feng, S. F., & Bornstein, A. M. (2020) · doi:10.31234/osf.io/5vksj · Cited by 6
Dynamics of striatal action selection and reinforcement learningPreprint
Lindsey, J. W., Markowitz, J. E., Gillis, W. F., Datta, S. R., & Litwin-Kumar, A. (2024) · eLife · doi:10.7554/elife.101747 · Cited by 6
Hardcastle, K., Marshall, J. D., Gellis, A., Klibaite, U., Bhatia, C., Wang, W. L., Chalyshkan, S., & Ölveczky, B. P. (2025) · Nature Neuroscience · doi:10.1038/s41593-025-02026-w · Cited by 8
Moustafa, A. A., Herzallah, M. M., & Gluck, M. A. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.08.003 · Cited by 5
Combining Modalities with Different Latencies for Optimal Motor Control
Bissmarck, F., Nakahara, H., Doya, K., & Hikosaka, O. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20133 · Cited by 5
Computational Models of Cognitive and Motor Control
Minai, A. A. (2015) · Springer eBooks · doi:10.1007/978-3-662-43505-2_35 · Cited by 5
Boraud, T. (2020) · doi:10.1093/oso/9780198824367.001.0001 · Cited by 6
Why and How Hippocampal Transition Cells Can Be Used in Reinforcement Learning
Hirel, J., Gaussier, P., Quoy, M., et al. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15193-4_34 · Cited by 5
The Role of the Basal Ganglia in Exploratory Behavior in a Model Based on Reinforcement Learning
Sridharan, D., PRASHANTH, P. S., & Chakravarthy, V. S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30499-9_10 · Cited by 5
Wanjerkhede, S., & Bapi, R. (2011) · Biological cybernetics · doi:10.1007/s00422-011-0439-5 · Cited by 9
The relation between reproductive and reconstructive processing of memory content
Bahrick, H. P. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042151 · Cited by 5
Dopamine and reward: Comment on Hernandez et al. (2006).
Gallistel, C. R. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.4.992 · Cited by 5
Hourdakis, E., & Trahanias, P. E. (2012) · Adaptive Behavior · doi:10.1177/1059712312445902 · Cited by 4
Dopaminergic Prediction Errors Persevere in the Nucleus Accumbens Core during Negative Reinforcement
Hollon, N. G., Soden, M. E., & Wanat, M. J. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.5762-12.2013 · Cited by 5
What do memories correspond to?
Conway, M. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00042205 · Cited by 5
Metadata
- Venue
- The MIT Press eBooks
- Publisher
- The MIT Press
- Published
- 1994-11-07
- OpenAlex
- W1607052939
- Cited by
- 1,190
- References
- 0
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 9 · 2023: 38 · 2022: 14 · 2021: 13 · 2020: 47 · 2019: 21 · 2018: 16 · 2017: 17 · 2016: 26 · 2015: 29 · 2014: 28 · 2013: 46 · 2012: 33
- FWCI
- 16.11
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- The MIT Press eBooks (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- basal ganglia, information processing, neural network model, motor control, working memory, reward processing, cognitive function, memory, cortical regions, forebrain, robot control, computational neuroscience
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review