A theoretical account of cognitive effects in delay discounting
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Although delay discounting, the attenuation of the value of future rewards, is a robust finding, the mechanism of discounting is not known. We propose a potential mechanism for delay discounting such that discounting emerges from a search process that is trying to determine what rewards will be available in the future. In this theory, the delay dependence of the discounting of future expected rewards arises from three assumptions. First, that the evaluation of outcomes involves a search process. Second, that the value is assigned to an outcome proportionally to how easy it is to find. Third, that outcomes that are less delayed are typically easier for the search process to find. By relaxing this third assumption (e.g. by assuming that episodically‐cued outcomes are easier to find), our model suggests that it is possible to dissociate discounting from delay. Our theory thereby explains the empirical result that discounting is slower to episodically‐imagined outcomes, because these outcomes are easier for the search process to find. Additionally, the theory explains why improving cognitive resources such as working memory slows discounting, by improving searches and thereby making rewards easier to find. The three assumptions outlined here are likely to be instantiated during deliberative decision‐making, but are unlikely in habitual decision‐making. We model two simple implementations of this theory and show that they unify empirical results about the role of cognitive function in delay discounting, and make new neural, behavioral, and pharmacological predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 2×
“Model 2: Hopfield network This simulation used a standard Hopfield network (Hopfield, 1982; Hertz et al., 1991).”
MethodReinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Golden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 2×
“, 2006), exponential with a bonus for immediate rewards (Laibson, 1997; McClure et al., 2004), and the sum of multiple exponentials (Sozou, 1998; Kurth-Nelson &”
BackgroundThe Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · cited 2×
“Forcing decisions to terminate early produces more inconsistent results (Gold & Shadlen, 2002; Ratcliff & McKoon, 2008), but can also lead to falling back on inherent biases and changing discounting functions (Simonson & Tversky, 1992; Lauwereyns, 2010).”
BackgroundTrope, Y., & Liberman, N. (2003) · Psychological Review · doi:10.1037/0033-295x.110.3.403 · Cited by 3,006
Buckner, R. L., & Carroll, D. C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.11.004 · Cited by 2,691
The Medial Temporal Lobe and Recognition Memory
Eichenbaum, H., Yonelinas, A. P., & Ranganath, C. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.30.051606.094328 · Cited by 2,580
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 6×
“…from multiple decision-making processes, which use different information-processing algorithms, including Pavlovian, deliberative (model-based) and habit (model-free) (Daw et al., 2005; Huys, 2007; Redish et al., 2008; van der Meer & Redish, 2010; van der Meer et al., 2012; Montague et al., 2012).”
BackgroundMethodInfluential
Cited by
Exploration versus exploitation in space, mind, and society
Hills, T. T., Todd, P. M., Lazer, D., Redish, A. D., & Couzin, I. D. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.10.004 · Cited by 549
Self-citationRedish, A. D. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.30 · Cited by 479
Self-citationOver the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex
Wikenheiser, A. M., & Schoenbaum, G. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.56 · Cited by 359
Daniel (2013) · doi:10.1177/0956797613488780 · Cited by 336
Behavioral components of impulsivity.
Stahl, C., Voss, A., Schmitz, F., Nuszbaum, M., Tüscher, O., Lieb, K., & Klauer, K. C. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033981 · Cited by 319
Miller, K. J., Shenhav, A., & Ludvig, E. A. (2019) · Psychological Review · doi:10.1037/rev0000120 · Cited by 280
Decker, J. H., Otto, A. R., Daw, N. D., & Hartley, C. A. (2016) · Psychological Science · doi:10.1177/0956797616639301 · Cited by 263
Daniel, T. O., Stanton, C. M., & Epstein, L. H. (2013) · Appetite · doi:10.1016/j.appet.2013.07.010 · Cited by 200
Episodic future thinking reduces delay discounting and energy intake in children
Daniel, T. O., Said, M., Stanton, C. M., & Epstein, L. H. (2015) · Eating Behaviors · doi:10.1016/j.eatbeh.2015.03.006 · Cited by 192
On weight and waiting: delay discounting in anorexia nervosa pretreatment and posttreatment
Decker, J. H., Figner, B., & Steinglass, J. E. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.12.016 · Cited by 163
Palombo, D. J., Keane, M. M., & Verfaellie, M. (2015) · Hippocampus · doi:10.1002/hipo.22376 · Cited by 145
Does goal relevant episodic future thinking amplify the effect on delay discounting?
O'Donnell, S., Oluyomi Daniel, T., & Epstein, L. H. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2017.02.014 · Cited by 111
Wang, J. X., Cohen, N. J., & Voss, J. L. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.04.003 · Cited by 75
“In general, synaptic facilitation of both afferent pathways and recurrent intra-network circuits likely affect the evolution of PFC networks toward attractor states in the absence of sensory stimulation (Wang, 2008) in a process of cognitive search (Kurth-Nelson et al., 2012).”
BackgroundThe Vivid Present: Visualization Abilities Are Associated with Steep Discounting of Future Rewards
Parthasarathi, T., McConnell, M. H., Luery, J., & Kable, J. W. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00289 · Cited by 59
“Related computational models show how discounting could arise from a prospective process that mirrors retrospective memory – akin to a distant memory, an outcome in the far future is harder to bring to mind (Kurth-Nelson et al., 2012).”
BackgroundPalombo, D. J., Keane, M. M., & Verfaellie, M. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.07.002 · Cited by 43
Metadata
- Authors
- Kurth‐Nelson, Z., Bickel, W., & Redish, A. D.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2012-04
- Volume
- 35
- Issue
- 7
- Pages
- 1052-1064
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2154356623
- Cited by
- 97
- References
- 45
- FWCI
- 5.67
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.