The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Prefrontal Coding of Temporally Discounted Values during Intertemporal Choice
Open accessAbstract
Summary Reward from a particular action is seldom immediate, and the influence of such delayed outcome on choice decreases with delay. It has been postulated that when faced with immediate and delayed rewards, decision makers choose the option with maximum temporally discounted value. We examined the preference of monkeys for delayed reward in a novel inter-temporal choice task and the neural basis for real-time computation of temporally discounted values in the dorsolateral prefrontal cortex. During this task, the locations of the targets associated with small and large rewards and their corresponding delays were randomly varied. We found that prefrontal neurons often encoded the temporally discounted value of reward expected from a particular option. Furthermore, activity tended to increase with discounted values for targets presented in the neuron's preferred direction, suggesting that activity related to temporally discounted values in the prefrontal cortex might determine the animal's behavior during inter-temporal choice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089
A Discounting Framework for Choice With Delayed and Probabilistic Rewards.
Green, L., & Myerson, J. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.5.769 · Cited by 1,676 · cited 2×
“This can be reasonably well accounted for by a hyperbolic discount function (Mazur, 1987; Rachlin et al., 1991; Green and Myerson, 2004).”
SUBJECTIVE PROBABILITY AND DELAY
Rachlin, H., Raineri, A., & Cross, D. (1991) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1991.55-233 · Cited by 1,341
Time Discounting for Primary Rewards
McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4246-06.2007 · Cited by 971
Impulsive choice induced in rats by lesions of the nucleus accumbens core
Cardinal, R. N., Pennicott, D. R., Lakmali, C., Sugathapala, Robbins, T. W., & Everitt, B. J. (2001) · Science · doi:10.1126/science.1060818 · Cited by 923
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678 · cited 1×
“, 2002), and this makes it difficult to distinguish neural signals related to temporally discounted values from those related to the animal's previous choices and their outcomes (Barraclough et al., 2004; Seo and Lee, 2007).”
Self-citationContrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice
Winstanley, C. A., Theobald, D. E. H., Cardinal, R. N., & Robbins, T. W. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5606-03.2004 · Cited by 675
Intertemporal choice – toward an integrative framework
Berns, G. S., Laibson, D., & Loewenstein, G. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.08.011 · Cited by 580 · cited 1×
“In addition, human DLPFC increases its activity during inter-temporal choice (McClure et al., 2004, 2007; Tanaka et al., 2004; Berns et al., 2007).”
Cited by
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
Peters, J., & Büchel, C. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.026 · Cited by 871
Value, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766
Emotion and the prefrontal cortex: an integrative review
Dixon, M. L., Thiruchselvam, R., Todd, R., & Christoff, K. (2017) · Psychological Bulletin · doi:10.1037/bul0000096 · Cited by 745
The neural mechanisms of inter-temporal decision-making: understanding variability
Peters, J., & Büchel, C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.03.002 · Cited by 693
Boorman, E. D., Behrens, T. E. J., Woolrich, M. W., & Rushworth, M. F. S. (2009) · Neuron · doi:10.1016/j.neuron.2009.05.014 · Cited by 665
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600
Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards
Bromberg-Martin, E. S., & Hikosaka, O. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.009 · Cited by 548
Emotion, Cognition, and Mental State Representation in Amygdala and Prefrontal Cortex
Salzman, C. D., & Fusi, S. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135256 · Cited by 588
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 546
Self-citationNeural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Neuronal basis of sequential foraging decisions in a patchy environment
Hayden, B. Y., Pearson, J. M., & Platt, M. L. (2011) · Nature Neuroscience · doi:10.1038/nn.2856 · Cited by 518
Catecholamine Influences on Dorsolateral Prefrontal Cortical Networks
Arnsten, A. F. T. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.01.027 · Cited by 493
Wang, M., Yang, Y., Wang, C.-J., Gamo, N. J., Jin, L. E., Mazer, J. A., Morrison, J. H., Wang, X.-J., & Arnsten, A. F. T. (2013) · Neuron · doi:10.1016/j.neuron.2012.12.032 · Cited by 489
Double dissociation of value computations in orbitofrontal and anterior cingulate neurons
Kennerley, S. W., Behrens, T. E. J., & Wallis, J. D. (2011) · Nature Neuroscience · doi:10.1038/nn.2961 · Cited by 454
Dissociable neural representations of future reward magnitude and delay during temporal discounting
Ballard, K., & Knutson, B. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.004 · Cited by 453
Neural representations of subjective reward value
Peters, J., & Büchel, C. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.04.031 · Cited by 405
Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision Making
Sul, J. H., Kim, H., Huh, N., Lee, D., & Jung, M. W. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.033 · Cited by 372
Self-citationAn analysis of rat prefrontal cortex in mediating executive function
Kesner, R. P., & Churchwell, J. C. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.07.002 · Cited by 366
Rostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven Exploration
Badre, D., Doll, B. B., Long, N. M., & Frank, M. J. (2012) · Neuron · doi:10.1016/j.neuron.2011.12.025 · Cited by 309
Orbitofrontal Cortex: A Neural Circuit for Economic Decisions
Padoa-Schioppa, C., & Conen, K. E. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.031 · Cited by 306
Dissecting impulsivity and its relationships to drug addictions
Jentsch, J. D., Ashenhurst, J. R., Cervantes, M. C., Groman, S. M., James, A. S., & Pennington, Z. T. (2014) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12388 · Cited by 281
Prefrontal Cortex and Impulsive Decision Making
Kim, S., & Lee, D. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.07.005 · Cited by 275
Self-citationHutcherson, C. A., Plassmann, H., Gross, J. J., & Rangel, A. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6387-11.2012 · Cited by 227
Dopamine Reward Prediction Error Responses Reflect Marginal Utility
Stauffer, W. R., Lak, A., & Schultz, W. (2014) · Current Biology · doi:10.1016/j.cub.2014.08.064 · Cited by 204
Beyond working memory: the role of persistent activity in decision making
Curtis, C. E., & Lee, D. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.03.006 · Cited by 191
Self-citationShanmugan, S., & Epperson, C. N. (2014) · Human Brain Mapping · doi:10.1002/hbm.22218 · Cited by 173
Encoding of Marginal Utility across Time in the Human Brain
Pine, A., Seymour, B., Roiser, J. P., Bossaerts, P., Friston, K. J., Curran, H. V., & Dolan, R. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1126-09.2009 · Cited by 169
Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game
Seo, H., Barraclough, D. J., & Lee, D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1479-09.2009 · Cited by 125
Self-citationNeuronal Correlates of Metacognition in Primate Frontal Cortex
Middlebrooks, P. G., & Sommer, M. A. (2012) · Neuron · doi:10.1016/j.neuron.2012.05.028 · Cited by 124
Griffiths, K. R., Morris, R. W., & Balleine, B. W. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00101 · Cited by 118
“Kim and Shadlen (1999) and Wallis and Miller (2003) found dlPFC neurons that encoded both reward value and the forthcoming response, whereas Kim et al. (2008) found neurons that ramped up or down in their firing rate with increasing or decreasing action values until a choice was made.”
Dopamine neurons learn to encode the long-term value of multiple future rewards
Enomoto, K., Matsumoto, N., Nakai, S., Satoh, T., Sato, T. K., Ueda, Y., Inokawa, H., Haruno, M., & Kimura, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014457108 · Cited by 83
Datta, D., & Arnsten, A. (2019) · Brain Sciences · doi:10.3390/brainsci9050113 · Cited by 78
Effects of α-2A adrenergic receptor agonist on time and risk preference in primates
Kim, S., Bobeica, I., Gamo, N. J., Arnsten, A. F. T., & Lee, D. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2520-0 · Cited by 47
Self-citationDissociable processes underlying decisions in the Iowa Gambling Task: a new integrative framework
Stocco, A., Fum, D., & Napoli, A. (2009) · Behavioral and Brain Functions · doi:10.1186/1744-9081-5-1 · Cited by 46
Valuation of uncertain and delayed rewards in primate prefrontal cortex
Kim, S., Hwang, J., Seo, H., & Lee, D. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.010 · Cited by 37
Self-citationDecision making: effects of methylphenidate on temporal discounting in nonhuman primates
Rajala, A. Z., Jenison, R. L., & Populin, L. C. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00278.2015 · Cited by 25
Metadata
- Authors
- Kim, S., Hwang, J., & Lee, D.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2008-07
- Volume
- 59
- Issue
- 1
- Pages
- 161-172
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2054040367
- Cited by
- 239
- References
- 14
- FWCI
- 8.93
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.