The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Heterogeneous Coding of Temporally Discounted Values in the Dorsal and Ventral Striatum during Intertemporal Choice
Open accessAbstract
SUMMARY In choosing between different rewards expected after unequal delays, humans and animals often prefer the smaller but more immediate reward, indicating that the subjective value or utility of reward is depreciated according to its delay. Here, we show that the neurons in the primate caudate nucleus and ventral striatum modulate their activity according to temporally discounted values of rewards with a similar time course. However, neurons in the caudate nucleus encoded the difference in the temporally discounted values of the two alternative targets more reliably than the neurons in the ventral striatum. In contrast, the neurons in the ventral striatum largely encoded the sum of the temporally discounted values, and therefore, the overall goodness of available options. These results suggest a more pivotal role for the dorsal striatum in action selection during intertemporal choice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
A Discounting Framework for Choice With Delayed and Probabilistic Rewards.
Green, L., & Myerson, J. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.5.769 · Cited by 1,676
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Time Discounting for Primary Rewards
McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4246-06.2007 · Cited by 971
Impulsive choice induced in rats by lesions of the nucleus accumbens core
Cardinal, R. N., Pennicott, D. R., Lakmali, C., Sugathapala, Robbins, T. W., & Everitt, B. J. (2001) · Science · doi:10.1126/science.1060818 · Cited by 923
Madden, G. J., Petry, N. M., Badger, G. J., & Bickel, W. K. (1997) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.5.3.256 · Cited by 911
Measures of impulsivity in cigarette smokers and non-smokers
Mitchell, S. H. (1999) · Psychopharmacology · doi:10.1007/pl00005491 · Cited by 911
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779
Cited by
The ventral visual pathway: an expanded neural framework for the processing of object quality
Kravitz, D. J., Saleem, K. S., Baker, C. I., Ungerleider, L. G., & Mishkin, M. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.10.011 · Cited by 1,173
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036
Updating dopamine reward signals
Schultz, W. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.012 · Cited by 651
“Reward neurons in most other primary and associated reward structures of the brain show some degrees of temporal discounting, including orbitofrontal cortex [18], prefrontal cortex [19,20], dorsal and ventral striatum [21,22], premotor cortex [19] and parietal cortex [23].”
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 546
Self-citationMechanisms underlying cortical activity during value-guided choice
Hunt, L. T., Kolling, N., Soltani, A., Woolrich, M. W., Rushworth, M. F. S., & Behrens, T. E. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3017 · Cited by 454
Double dissociation of value computations in orbitofrontal and anterior cingulate neurons
Kennerley, S. W., Behrens, T. E. J., & Wallis, J. D. (2011) · Nature Neuroscience · doi:10.1038/nn.2961 · Cited by 454
Orbitofrontal Cortex: A Neural Circuit for Economic Decisions
Padoa-Schioppa, C., & Conen, K. E. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.031 · Cited by 306
Reward value comparison via mutual inhibition in ventromedial prefrontal cortex
Strait, C. E., Blanchard, T. C., & Hayden, B. Y. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.032 · Cited by 294
From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making
Burton, A. C., Nakamura, K., & Roesch, M. R. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.003 · Cited by 238
Triple dissociation of attention and decision computations across prefrontal cortex
Hunt, L. T., Malalasekera, W. M. N., de Berker, A. O., Miranda, B., Farmer, S. F., Behrens, T. E. J., & Kennerley, S. W. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0239-5 · Cited by 222
A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex
Jocham, G., Hunt, L. T., Near, J., & Behrens, T. E. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3140 · Cited by 183
Stable representations of decision variables for flexible behavior
Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., & Cohen, J. Y. (2019) · Neuron · doi:10.1016/j.neuron.2019.06.001 · Cited by 173
“The latter comprise relative value, which biases choices toward one alternative (Samejima et al., 2005; Seo and Lee, 2007; Ito and Doya, 2009; Sul et al., 2010; Cai et al., 2011; Wang et al., 2013; Murakami et al., 2017), and total value, which modulates the vigor of choice (how fast to make an action; Figures S1H– S1…”
The primate amygdala combines information about space and value
Peck, C. J., Lau, B., & Salzman, C. D. (2013) · Nature Neuroscience · doi:10.1038/nn.3328 · Cited by 115
Variation in the human cannabinoid receptor CNR1 gene modulates gaze duration for happy faces
Chakrabarti, B., & Baron-Cohen, S. (2011) · Molecular Autism · doi:10.1186/2040-2392-2-10 · Cited by 57
Striatal action-value neurons reconsidered
Elber-Dorozko, L., & Loewenstein, Y. (2018) · eLife · doi:10.7554/elife.34248 · Cited by 53
Effects of α-2A adrenergic receptor agonist on time and risk preference in primates
Kim, S., Bobeica, I., Gamo, N. J., Arnsten, A. F. T., & Lee, D. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2520-0 · Cited by 47
“In particular, neuroimaging studies in human subjects as well as single neuron recording studies in nonhuman primates have found that the activity in the prefrontal cortex and striatum is influenced by multiple reward parameters and is often correlated with the subjective value of reward chosen by the subject (Cardina…”
Self-citationNicotinic alteration of decision-making
Naudé, J., Dongelmans, M., & Faure, P. (2015) · Neuropharmacology · doi:10.1016/j.neuropharm.2014.11.021 · Cited by 39
“Neural correlates of action value have also been found in the striatum (Samejima et al., 2005; Lau and Glimcher, 2008; Kim et al., 2013; Cai et al., 2011).”
Metadata
- Authors
- Cai, X., Kim, S., & Lee, D.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2011-01
- Volume
- 69
- Issue
- 1
- Pages
- 170-182
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2088386233
- Cited by
- 181
- References
- 19
- FWCI
- 9.20
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.