The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
A distributed, hierarchical and recurrent framework for reward-based choice
Open accessAbstract
Many accounts of reward-based choice argue for distinct component processes that are serial and functionally localized. In this Opinion article, we argue for an alternative viewpoint, in which choices emerge from repeated computations that are distributed across many brain regions. We emphasize how several features of neuroanatomy may support the implementation of choice, including mutual inhibition in recurrent neural networks and the hierarchical organization of timescales for information processing across the cortex. This account also suggests that certain correlates of value are emergent rather than represented explicitly in the brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
A massively parallel architecture for a self-organizing neural pattern recognition machine
Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
DEFICITS IN STRATEGY APPLICATION FOLLOWING FRONTAL LOBE DAMAGE IN MAN
SHALLICE, T., & BURGESS, P. W. (1991) · Brain · doi:10.1093/brain/114.2.727 · Cited by 2,017
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
The development and application of optogenetics
Fenno, L., Yizhar, O., & Deisseroth, K. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113817 · Cited by 1,822
Social cognition and the brain: A meta-analysis
Van Overwalle, F. (2009) · Human Brain Mapping · doi:10.1002/hbm.20547 · Cited by 1,792
The importance of mixed selectivity in complex cognitive tasks
Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., & Fusi, S. (2013) · Nature · doi:10.1038/nature12160 · Cited by 1,639
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient EVR
Eslinger, P. J., & Damasio, A. R. (1985) · Neurology · doi:10.1212/wnl.35.12.1731 · Cited by 1,426
Visual fixations and the computation and comparison of value in simple choice
Krajbich, I., Armel, C., & Rangel, A. (2010) · Nature Neuroscience · doi:10.1038/nn.2635 · Cited by 1,408
The future of memory: remembering, imagining, and the brain
Schacter, D. L., Addis, D. R., Hassabis, D., Martin, V. C., Spreng, R. N., & Szpunar, K. K. (2012) · Neuron · doi:10.1016/j.neuron.2012.11.001 · Cited by 1,398
The root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342
The functional neuroanatomy of autobiographical memory: a meta-analysis
Svoboda, E., McKinnon, M. C., & Levine, B. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.05.023 · Cited by 1,274
London, M., & Häusser, M. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135703 · Cited by 1,149
Compte, A. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.9.910 · Cited by 1,143
The anatomical basis of functional localization in the cortex
Passingham, R. E., Stephan, K. E., & Kötter, R. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn893 · Cited by 1,024
Distributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955
Is the rostro-caudal axis of the frontal lobe hierarchical?
Badre, D., & D'Esposito, M. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2667 · Cited by 946
A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex
Markov, N. T., Ercsey-Ravasz, M. M., Ribeiro Gomes, A. R., Lamy, C., Magrou, L., Vezoli, J., Misery, P., Falchier, A., Quilodran, R., Gariel, M. A., et al. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs270 · Cited by 857
‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework
Stokes, M. G. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.05.004 · Cited by 850
Evidence for grid cells in a human memory network
Doeller, C. F., Barry, C., & Burgess, N. (2010) · Nature · doi:10.1038/nature08704 · Cited by 828
Neural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809
Kolling, N., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2012) · Science · doi:10.1126/science.1216930 · Cited by 629
Motivation of extended behaviors by anterior cingulate cortex
Holroyd, C. B., & Yeung, N. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.008 · Cited by 618
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590
Opening the black box: low-dimensional dynamics in high-dimensional recurrent neural networks
Sussillo, D., & Barak, O. (2013) · Neural Computation · doi:10.1162/neco_a_00409 · Cited by 575
Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition
Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419
Walton, M. E., Behrens, T. E. J., Buckley, M. J., Rudebeck, P. H., & Rushworth, M. F. S. (2010) · Neuron · doi:10.1016/j.neuron.2010.02.027 · Cited by 397
The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight
Passingham, R. E., & Wise, S. P. (2012) · doi:10.1093/acprof:osobl/9780199552917.001.0001 · Cited by 379
Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340
Measuring macroscopic brain connections in vivo
Jbabdi, S., Sotiropoulos, S. N., Haber, S. N., Van Essen, D. C., & Behrens, T. E. (2015) · Nature Neuroscience · doi:10.1038/nn.4134 · Cited by 334
Valuation and decision-making in frontal cortex: one or many serial or parallel systems?
Rushworth, M. F., Kolling, N., Sallet, J., & Mars, R. B. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.04.011 · Cited by 309
Reward value-based gain control: divisive normalization in parietal cortex
Louie, K., Grattan, L. E., & Glimcher, P. W. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1237-11.2011 · Cited by 308
Reward value comparison via mutual inhibition in ventromedial prefrontal cortex
Strait, C. E., Blanchard, T. C., & Hayden, B. Y. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.032 · Cited by 294
Self-citationA reservoir of time constants for memory traces in cortical neurons
Bernacchia, A., Seo, H., Lee, D., & Wang, X.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2752 · Cited by 292
The hierarchical organization of the lateral prefrontal cortex
Nee, D. E., & D'Esposito, M. (2016) · eLife · doi:10.7554/elife.12112 · Cited by 233
Choice, difficulty, and confidence in the brain
Rolls, E. T., Grabenhorst, F., & Deco, G. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.073 · Cited by 148
Emergence in Cognitive Science
McClelland, J. L. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01116.x · Cited by 135
The primate amygdala combines information about space and value
Peck, C. J., Lau, B., & Salzman, C. D. (2013) · Nature Neuroscience · doi:10.1038/nn.3328 · Cited by 115
Purcell, B. A., & Kiani, R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1524685113 · Cited by 106
Cited by
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535
Orbitofrontal Cortex: A Neural Circuit for Economic Decisions
Padoa-Schioppa, C., & Conen, K. E. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.031 · Cited by 306
Map Making: Constructing, Combining, and Inferring on Abstract Cognitive Maps
Park, S. A., Miller, D. S., Nili, H., Ranganath, C., & Boorman, E. D. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.030 · Cited by 270
Medial and orbital frontal cortex in decision-making and flexible behavior
Klein-Flügge, M. C., Bongioanni, A., & Rushworth, M. F. S. (2022) · Neuron · doi:10.1016/j.neuron.2022.05.022 · Cited by 244
Functional Heterogeneity within Rat Orbitofrontal Cortex in Reward Learning and Decision Making
Izquierdo, A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1678-17.2017 · Cited by 258
Metadata
- Authors
- Hunt, L. T., & Hayden, B. Y.
- Venue
- Nature Reviews Neuroscience
- Published
- 2017-02-17
- Volume
- 18
- Issue
- 3
- Pages
- 172-182
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W2588849466
- Cited by
- 244
- References
- 52
- FWCI
- 3.50
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.