The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions
Abstract
Neurophysiological studies have identified a number of brain regions critically involved in solving the problem of action selection or decision making. In the case of highly practiced tasks, these regions include cortical areas hypothesized to integrate evidence supporting alternative actions and the basal ganglia, hypothesized to act as a central switch in gating behavioral requests. However, despite our relatively detailed knowledge of basal ganglia biology and its connectivity with the cortex and numerical simulation studies demonstrating selective function, no formal theoretical framework exists that supplies an algorithmic description of these circuits. This article shows how many aspects of the anatomy and physiology of the circuit involving the cortex and basal ganglia are exactly those required to implement the computation defined by an asymptotically optimal statistical test for decision making: the multihypothesis sequential probability ratio test (MSPRT). The resulting model of basal ganglia provides a new framework for understanding the computation in the basal ganglia during decision making in highly practiced tasks. The predictions of the theory concerning the properties of particular neuronal populations are validated in existing experimental data. Further, we show that this neurobiologically grounded implementation of MSPRT outperforms other candidates for neural decision making, that it is structurally and parametrically robust, and that it can accommodate cortical mechanisms for decision making in a way that complements those in basal ganglia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · cited 2×
“This procedure is known as a random walk (Laming, 1968; Stone, 1960) or a diffusion (Ratcliff, 1978) model and it may be shown to implement a statistical decision test known as the Sequential Probability Ratio Test (SPRT) (Barnard, 1946; Wald, 1947).”
MethodHandbook of Chemical Neuroanatomy
Stern, C. D. (1986) · Neurochemistry International · doi:10.1016/0197-0186(86)90021-5 · Cited by 4,151
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
Alexander, G. E., & Crutcher, M. D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90107-l · Cited by 4,131 · cited 2×
“Anatomically, the basal ganglia form a component of loops consisting of projections from cortex to basal ganglia, then to thalamus and back to cortex (Alexander & Crutcher, 1990).”
BackgroundBarto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop
Parent, A., & Hazrati, L.-N. (1995) · Brain Research Reviews · doi:10.1016/0165-0173(94)00007-c · Cited by 2,161
Cited by
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
Bogacz, R., Brown, E., Moehlis, J., Holmes, P., & Cohen, J. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.700 · Cited by 1,866
Self-citationConflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
BOTVINICK, M. M. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.356 · Cited by 1,117
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism
Frank, M. J., Samanta, J., Moustafa, A. A., & Sherman, S. J. (2007) · Science · doi:10.1126/science.1146157 · Cited by 1,120
O'Reilly, R. C., & Frank, M. J. (2006) · Neural Computation · doi:10.1162/089976606775093909 · Cited by 1,066
Mendl, M., Burman, O. H. P., Parker, R. M. A., & Paul, E. S. (2009) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2009.02.023 · Cited by 755
Krajbich, I., & Rangel, A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101328108 · Cited by 728
The neural basis of the speed–accuracy tradeoff
Bogacz, R., Wagenmakers, E.-J., Forstmann, B. U., & Nieuwenhuis, S. (2010) · Trends in Neurosciences · doi:10.1016/j.tins.2009.09.002 · Cited by 724
Self-citationFrom reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 722
Shortlist B: A Bayesian model of continuous speech recognition.
Norris, D., & McQueen, J. M. (2008) · Psychological Review · doi:10.1037/0033-295x.115.2.357 · Cited by 686
Probabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615
“Several groups have explored a variation of these ideas in which, rather than coding for the log probability that a feature is present, neurons code for the log probability that a feature takes on a particular value 38–42 .”
BackgroundAction understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
Chapter 2 Design for a Working Memory
Oberauer, K. (2009) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(09)51002-x · Cited by 636
Decision Making as a Window on Cognition
Shadlen, M. N., & Kiani, R. (2013) · Neuron · doi:10.1016/j.neuron.2013.10.047 · Cited by 658
Striatum and pre-SMA facilitate decision-making under time pressure
Forstmann, B. U., Dutilh, G., Brown, S., Neumann, J., von Cramon, D. Y., Ridderinkhof, K. R., & Wagenmakers, E.-J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0805903105 · Cited by 648
Probabilistic population codes for Bayesian decision making
Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.021 · Cited by 645
Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold
Cavanagh, J. F., Wiecki, T. V., Cohen, M. X., Figueroa, C. M., Samanta, J., Sherman, S. J., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2925 · Cited by 645
Neural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Decisions in Changing Conditions: The Urgency-Gating Model
Cisek, P., Puskas, G. A., & El-Murr, S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1844-09.2009 · Cited by 508
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
What insects can tell us about the origins of consciousness.
Barron, A. B., & Klein, C. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1520084113 · Cited by 446
Decision Making and Sequential Sampling from Memory
Shadlen, M. N., & Shohamy, D. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.036 · Cited by 418
Optimal decision-making theories: linking neurobiology with behaviour
Bogacz, R. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.12.006 · Cited by 379
Self-citationAttractor and integrator networks in the brain
Khona, M., & Fiete, I. R. (2022) · Nature Reviews Neuroscience · doi:10.1038/s41583-022-00642-0 · Cited by 306
Frontosubthalamic Circuits for Control of Action and Cognition
Aron, A. R., Herz, D. M., Brown, P., Forstmann, B. U., & Zaghloul, K. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2348-16.2016 · Cited by 291
Caudate Encodes Multiple Computations for Perceptual Decisions
Ding, L., & Gold, J. I. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2894-10.2010 · Cited by 284
A tutorial on the free-energy framework for modelling perception and learning
Bogacz, R. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.11.003 · Cited by 283
“Although it has been proposed that circuits within the basal ganglia can compute the normalization term in case of the discrete probability distributions (Bogacz & Gurney, 2007), computation of the normalization for continuous distributions involves evaluating the integral of Eq.”
BackgroundSelf-citationHolgado, A. J. N., Terry, J. R., & Bogacz, R. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0817-10.2010 · Cited by 282
Self-citationTan, H., Wade, C., & Brown, P. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.3204-15.2016 · Cited by 267
Decision making by urgency gating: theory and experimental support
Thura, D., Beauregard-Racine, J., Fradet, C.-W., & Cisek, P. (2012) · Journal of Neurophysiology · doi:10.1152/jn.01071.2011 · Cited by 258
Neurocognitive mechanisms of action control: resisting the call of the Sirens.
Richard Ridderinkhof, K., Forstmann, B. U., Wylie, S. A., Burle, B., & van den Wildenberg, W. P. M. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.99 · Cited by 215
Embodied choice: how action influences perceptual decision making
Lepora, N. F., & Pezzulo, G. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004110 · Cited by 209
“This idea has been formalized using various methods, which include signal detection theory, neural race models, attractor dynamics and Bayesian inference [1–8].”
BackgroundMethodBrain mechanisms for perceptual and reward-related decision-making
Deco, G., Rolls, E. T., Albantakis, L., & Romo, R. (2013) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2012.01.010 · Cited by 196
Summerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167
Mannella, F., Gurney, K., & Baldassarre, G. (2013) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2013.00135 · Cited by 166
Self-citationTeslovich, T., Mulder, M., Franklin, N. T., Ruberry, E. J., Millner, A., Somerville, L. H., Simen, P., Durston, S., & Casey, B. J. (2014) · Developmental Science · doi:10.1111/desc.12092 · Cited by 45
Metadata
- Authors
- Bogacz, R., & Gurney, K.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2007-02
- Volume
- 19
- Issue
- 2
- Pages
- 442-477
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2167987951
- Cited by
- 417
- References
- 96
- FWCI
- 10.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.