The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions
Abstract
Neurophysiological studies have identified a number of brain regions critically involved in solving the problem of action selection or decision making. In the case of highly practiced tasks, these regions include cortical areas hypothesized to integrate evidence supporting alternative actions and the basal ganglia, hypothesized to act as a central switch in gating behavioral requests. However, despite our relatively detailed knowledge of basal ganglia biology and its connectivity with the cortex and numerical simulation studies demonstrating selective function, no formal theoretical framework exists that supplies an algorithmic description of these circuits. This article shows how many aspects of the anatomy and physiology of the circuit involving the cortex and basal ganglia are exactly those required to implement the computation defined by an asymptotically optimal statistical test for decision making: the multihypothesis sequential probability ratio test (MSPRT). The resulting model of basal ganglia provides a new framework for understanding the computation in the basal ganglia during decision making in highly practiced tasks. The predictions of the theory concerning the properties of particular neuronal populations are validated in existing experimental data. Further, we show that this neurobiologically grounded implementation of MSPRT outperforms other candidates for neural decision making, that it is structurally and parametrically robust, and that it can accommodate cortical mechanisms for decision making in a way that complements those in basal ganglia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513
Handbook of Chemical Neuroanatomy
Stern, C. D. (1986) · Neurochemistry International · doi:10.1016/0197-0186(86)90021-5 · Cited by 4,151
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
Alexander, G. E., & Crutcher, M. D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90107-l · Cited by 4,131
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop
Parent, A., & Hazrati, L.-N. (1995) · Brain Research Reviews · doi:10.1016/0165-0173(94)00007-c · Cited by 2,161
The time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“the difference between the actual and the predicted levels of expected reward) (Montague et al., 1996; Schultz et al., 1997).”
BackgroundBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
Bogacz, R., Brown, E., Moehlis, J., Holmes, P., & Cohen, J. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.700 · Cited by 1,866
Self-citationNeural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 2×
“…actions to be modulated by expected reward in the proficient phase, as it has been shown that the cortical integrators are modulated by expected reward in the study by Platt and Glimcher (1999) in which the stimulus-response mapping was kept constant for many weeks of training and experiment.”
BackgroundParent, A., & Hazrati, L.-N. (1995) · Brain Research Reviews · doi:10.1016/0165-0173(94)00008-d · Cited by 1,358
Probabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
A neuropsychological theory of multiple systems in category learning.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998) · Psychological Review · doi:10.1037//0033-295x.105.3.442 · Cited by 1,223
The basal ganglia: a vertebrate solution to the selection problem?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00319-4 · Cited by 1,199
Self-citationModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Optimum Character of the Sequential Probability Ratio Test
Wald, A., & Wolfowitz, J. (1948) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730197 · Cited by 1,162
Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism
Frank, M. J., Samanta, J., Moustafa, A. A., & Sherman, S. J. (2007) · Science · doi:10.1126/science.1146157 · Cited by 1,120
O'Reilly, R. C., & Frank, M. J. (2006) · Neural Computation · doi:10.1162/089976606775093909 · Cited by 1,066
Graybiel, A. M. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00593-5 · Cited by 1,051
Neural Correlates of Motor Memory Consolidation
Shadmehr, R., & Holcomb, H. H. (1997) · Science · doi:10.1126/science.277.5327.821 · Cited by 1,022
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964
Functional anatomy of the basal ganglia
Yelnik, J. (2002) · Movement Disorders · doi:10.1002/mds.10138 · Cited by 952
Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950
Information theory of choice-reaction times
Laming, D. (1968) · Medical Entomology and Zoology · Cited by 945
(1998) · Neuroscience · doi:10.1016/s0306-4522(98)00004-9 · Cited by 941
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
Neural computations that underlie decisions about sensory stimuli
Gold, J. I., & Shadlen, M. N. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01567-9 · Cited by 881
Disinhibition as a basic process in the expression of striatal functions
Chevalier, G., & Deniau, J. M. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90109-n · Cited by 865
Pathophysiology of the basal ganglia in Parkinson's disease
Obeso, J. A., Rodriguez-Oroz, M. C., Rodriguez, M., Lanciego, J. L., Artieda, J., Gonzalo, N., & Olanow, C. W. (2000) · Trends in Neurosciences · doi:10.1016/s1471-1931(00)00028-8 · Cited by 844
Gerfen, C. R., & Scott Young, W. (1988) · Brain Research · doi:10.1016/0006-8993(88)91217-6 · Cited by 658
Striatum and pre-SMA facilitate decision-making under time pressure
Forstmann, B. U., Dutilh, G., Brown, S., Neumann, J., von Cramon, D. Y., Ridderinkhof, K. R., & Wagenmakers, E.-J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0805903105 · Cited by 648
Probabilistic population codes for Bayesian decision making
Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.021 · Cited by 645
Encyclopedia of cognitive science
(2003) · Choice Reviews Online · doi:10.5860/choice.41-0046 · Cited by 634
Models for Choice-Reaction Time
Stone, M. (1960) · Psychometrika · doi:10.1007/bf02289729 · Cited by 629
A computational model of action selection in the basal ganglia. I. A new functional anatomy
Gurney, K., Prescott, T. J., & Redgrave, P. (2001) · Biological Cybernetics · doi:10.1007/pl00007984 · Cited by 629
Self-citationResponses of neurons in macaque MT to stochastic motion signals
Britten, K. H., Shadlen, M. N., Newsome, W. T., & Movshon, J. A. (1993) · Visual Neuroscience · doi:10.1017/s0952523800010269 · Cited by 594
Connectionist and diffusion models of reaction time.
Ratcliff, R., Van Zandt, T., & McKoon, G. (1999) · Psychological Review · doi:10.1037//0033-295x.106.2.261 · Cited by 591
Gold, J. I., & Shadlen, M. N. (2002) · Neuron · doi:10.1016/s0896-6273(02)00971-6 · Cited by 554
Neural basis of deciding, choosing and acting
Schall, J. D. (2001) · Nature reviews. Neuroscience · doi:10.1038/35049054 · Cited by 528
Chevalier, G., Vacher, S., Deniau, J. M., & Desban, M. (1985) · Brain Research · doi:10.1016/0006-8993(85)90213-6 · Cited by 434
Optimal decision-making theories: linking neurobiology with behaviour
Bogacz, R. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.12.006 · Cited by 379
Self-citationSingle cell studies of the primate putamen: I. Functional organization
Crutcher, M. D., & DeLong, M. R. (1984) · Experimental Brain Research · doi:10.1007/bf00238153 · Cited by 378
A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia
Humphries, M. D., Stewart, R. D., & Gurney, K. N. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3486-06.2006 · Cited by 370
Self-citationEvidence for an Accumulator Model of Psychophysical Discrimination
VICKERS, D. (1970) · Ergonomics · doi:10.1080/00140137008931117 · Cited by 369
Georgopoulos, A., DeLong, M., & Crutcher, M. (1983) · The Journal of Neuroscience · doi:10.1523/jneurosci.03-08-01586.1983 · Cited by 362
Parthasarathy, H., Schall, J., & Graybiel, A. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-11-04468.1992 · Cited by 353
Deniau, J. M., & Chevalier, G. (1985) · Brain Research · doi:10.1016/0006-8993(85)90214-8 · Cited by 349
Laws of visual choice reaction time.
Teichner, W. H., & Krebs, M. J. (1974) · Psychological Review · doi:10.1037/h0035867 · Cited by 326
Gurney, K., Prescott, T. J., & Redgrave, P. (2001) · Biological Cybernetics · doi:10.1007/pl00007985 · Cited by 298
Self-citationThe cells of origin of nigrotectal, nigrothalamic and nigrostriatal projections in the rat
Faull, R. L. M., & Mehler, W. R. (1978) · Neuroscience · doi:10.1016/0306-4522(78)90119-7 · Cited by 293
Multihypothesis sequential probability ratio tests .I. Asymptotic optimality
Draglia, V. P., Tartakovsky, A. G., & Veeravalli, V. V. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.796383 · Cited by 291
Kita, H., & Kitai, S. T. (1991) · Brain Research · doi:10.1016/0006-8993(91)91466-e · Cited by 284
Crutcher, M. D., & DeLong, M. R. (1984) · Experimental Brain Research · doi:10.1007/bf00238154 · Cited by 282
Gold, J. I., & Shadlen, M. N. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-02-00632.2003 · Cited by 281
A sequential procedure for multihypothesis testing
Baum, C. W., & Veeravalli, V. V. (1994) · IEEE Transactions on Information Theory · doi:10.1109/18.340472 · Cited by 268
Brown, J. W., Bullock, D., & Grossberg, S. (2004) · Neural Networks · doi:10.1016/j.neunet.2003.08.006 · Cited by 265
Anatomical aspects of information processing in primate basal ganglia
Parent, A., & Hazrati, L.-N. (1993) · Trends in Neurosciences · doi:10.1016/0166-2236(93)90135-9 · Cited by 256
Neural circuits and functional organization of the striatum
Nakano, K., Kayahara, T., Tsutsumi, T., & Ushiro, H. (2000) · Journal of Neurology · doi:10.1007/pl00007778 · Cited by 250
Neurocomputational models of basal ganglia function in learning, memory and choice
Cohen, M. X., & Frank, M. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.029 · Cited by 237
Electrophysiology of globus pallidus neurons in vitro
Nambu, A., & Llinas, R. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.3.1127 · Cited by 227
Hallworth, N. E., Wilson, C. J., & Bevan, M. D. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-20-07525.2003 · Cited by 210
Amalric, M., & Koob, G. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-07-02129.1987 · Cited by 196
Bogacz, R., Usher, M., Zhang, J., & McClelland, J. L. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2059 · Cited by 186
Self-citationA robot model of the basal ganglia: Behavior and intrinsic processing
Prescott, T. J., Montes González, F. M., Gurney, K., Humphries, M. D., & Redgrave, P. (2006) · Neural Networks · doi:10.1016/j.neunet.2005.06.049 · Cited by 180
Self-citationSequential Tests in Industrial Statistics
Barnard, G. A. (1946) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.2307/2983610 · Cited by 176
Parent, A., & Smith, Y. (1987) · Brain Research · doi:10.1016/0006-8993(87)91674-x · Cited by 160
Nambu, A., & Llin�s, R. (1997) · The Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19970106)377:1<85::aid-cne8>3.0.co;2-f · Cited by 158
Computational models of the basal ganglia: from robots to membranes
GURNEY, K. N., Prescott, T. J., Wickens, J. R., & Redgrave, P. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.06.003 · Cited by 155
Self-citationThe dynamics of choice among multiple alternatives
McMillen, T., & Holmes, P. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.10.003 · Cited by 153
Medina, L. M., & Reiner, A. J. (2008) · Brain Behavior and Evolution · doi:10.1159/000113277 · Cited by 145
Rapid decision threshold modulation by reward rate in a neural network
Simen, P., Cohen, J. D., & Holmes, P. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.05.038 · Cited by 130
Dragalin, V., Tartakovsky, A. G., & Veeravalli, V. V. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.850677 · Cited by 122
Amalric, M., Moukhles, H., Nieoullon, A., & Daszuta, A. (1995) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1995.tb01085.x · Cited by 106
SIMPLE NEURAL NETWORKS THAT OPTIMIZE DECISIONS
Brown, E., Gao, J., Holmes, P. J., Bogacz, R., Gilzenrat, M. S., & Cohen, J. D. (2005) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127405012478 · Cited by 106
Self-citationThe role of intra-thalamic and thalamocortical circuits in action selection
Humphries, M. D., & GURNEY, K. N. (2002) · Network Computation in Neural Systems · doi:10.1080/net.13.1.131.156 · Cited by 104
Self-citationBevan, M. D., Smith, A. D., & Bolam, J. P. (1996) · Neuroscience · doi:10.1016/0306-4522(96)00377-6 · Cited by 99
The Neurobiology of Category Learning
Ashby, F. G., & Spiering, B. J. (2004) · Behavioral and Cognitive Neuroscience Reviews · doi:10.1177/1534582304270782 · Cited by 83
Yehene, E., Meiran, N., & Soroker, N. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20077 · Cited by 79
Inference, Attention, and Decision in a Bayesian Neural Architecture
Yu, A. J., & Dayan, P. (2004) · MPG.PuRe (Max Planck Society) · Cited by 76
A Model of Reverse Spike Frequency Adaptation and Repetitive Firing of Subthalamic Nucleus Neurons
Wilson, C. J., Weyrick, A., Terman, D. H., Hallworth, N. E., & Bevan, M. D. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00924.2003 · Cited by 72
Kha, H. T., Finkelstein, D. I., Tomas, D., Drago, J., Pow, D. V., & Horne, M. K. (2001) · The Journal of Comparative Neurology · doi:10.1002/cne.1367 · Cited by 71
Overton, P. G., & Greenfield, S. A. (1995) · Journal of Neural Transmission - Parkinsons Disease and Dementia Section · doi:10.1007/bf02256628 · Cited by 53
Testing computational hypotheses of brain systems function: a case study with the basal ganglia
GURNEY, K. N., Humphries, M. D., Wood, R., Prescott, T. J., & Redgrave, P. (2004) · Network Computation in Neural Systems · doi:10.1088/0954-898x/15/4/003 · Cited by 48
Self-citationThe role of response mechanisms in determining reaction time performance: Piéron’s law revisited
Stafford, T., & GURNEY, K. N. (2004) · Psychonomic Bulletin & Review · doi:10.3758/bf03196729 · Cited by 47
Self-citationBiologically constrained action selection improves cognitive control in a model of the Stroop task
Stafford, T., & GURNEY, K. N. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2060 · Cited by 32
Self-citationDynamical Analysis of Bayesian Inference Models for the Eriksen Task
Liu, Y. S., Yu, A. J., & Holmes, P. J. (2009) · Neural Computation · doi:10.1162/neco.2009.03-07-495 · Cited by 26
Levels of Analysis in Neural Modeling
Dayan, P. (2005) · Encyclopedia of Cognitive Science · doi:10.1002/0470018860.s00363 · Cited by 20
Optimal decision network with distributed representation
Bogacz, R. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.01.003 · Cited by 15
Self-citation
Cited by
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
Bogacz, R., Brown, E., Moehlis, J., Holmes, P., & Cohen, J. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.700 · Cited by 1,866
Self-citationNeuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
BOTVINICK, M. M. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.356 · Cited by 1,117
Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism
Frank, M. J., Samanta, J., Moustafa, A. A., & Sherman, S. J. (2007) · Science · doi:10.1126/science.1146157 · Cited by 1,120
Metadata
- Authors
- Bogacz, R., & Gurney, K.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2007-02
- Volume
- 19
- Issue
- 2
- Pages
- 442-477
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2167987951
- Cited by
- 417
- References
- 96
- FWCI
- 10.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.