Functional neuroimaging of intertemporal choice models: a review
The DOI matches its Crossref record; 135 of the 136 references it cites were found in a registry or an index.
Abstract
People often forsake a larger reward later for a smaller reward sooner. The process of devaluing the larger, later prize is called temporal discounting or delay discounting, which lies at the core of intertemporal choice. Here, we describe the methodology and findings of research on the mechanisms of intertemporal choice, with a focus on those that utilize functional MRI (fMRI). We consider the neural bases for the most common economic models of intertemporal choice and examine whether these models require neural processes that are common or distinct across types of decision making. Considered as a whole, current research points to potentially distinct contributions from brain systems associated with valuation and with prospective thought, which may be reflected in separable foci in posterior cingulate cortex. Based on open questions in the field, we suggest two core goals for future research: identifying aspects of valuation that are unique to intertemporal choice and evaluating direct or indirect interactions between delay and prize magnitude.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Two other meta-analyses focus on specific decision environments, such as intertemporal choice (Carter et al., 2010) and risky choice (Mohr et al., 2010).”
From Informatic parcellation of the network involved in the computation of subjective value (2014) · cites this paper as Carter et al., 2010
Citations
Cites
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 11×
“Work by Schultz (Schultz et al., 1997) has shown that the dopamine transmitter system is an excellent candidate for implementing these proposed learning models, leading to well motivated hypotheses (Sagvolden, Johansen, Aase, & Russell, 2005; Tripp & Wickens, 2008) that could explain pathological…”
BackgroundInfluentialTime Discounting and Time Preference: A Critical Review
Frederick, S., Loewenstein, G. F., & O’Donoghue, T. (2002) · Journal of Economic Literature · doi:10.1257/002205102320161311 · Cited by 6,381 · cited 1×
“For reference, nearly all such studies within behavioral economics have examined choices for monetary rewards, the majority of which have involved hypothetical rewards (see Frederick et al., 2002, for review).”
BackgroundGolden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122 · cited 4×
“(Equation 2; see Laibson, 1997; Loewenstein, 1996; Shefrin & Thaler, 1988).”
BackgroundInfluentialMaps of Bounded Rationality: Psychology for Behavioral Economics
Kahneman, D. (2003) · American Economic Review · doi:10.1257/000282803322655392 · Cited by 5,377 · cited 1×
“Note that this perspective matches well to the pervasive dual-systems account of behavioral control (Bechara, 2005; Ernst & Paulus, 2005; Kahneman, 2003; Loewenstein, 1996).”
BackgroundAllais, M. (1953) · Econometrica · doi:10.2307/1907921 · Cited by 4,112 · cited 1×
“Moreover, some anomalies are common across probability and delay discounting models (Prelec & Loewenstein, 1991); probabilistically certain outcomes are overvalued (Allais, 1953), just like immediately available outcomes.”
BackgroundThe Handbook of experimental economics
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1645 · Cited by 3,679 · cited 1×
“Random single-trial payments have also been shown to evoke different discount rates than cumulative payment methods (Kagel & Roth, 1997).”
ResultSeparate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 5×
“An alternative perspective was advanced by Kable and Glimcher (2007) who used experimental procedures largely similar to those of McClure and colleagues (McClure et al., 2004) but began with a different framework: they hypothesized that neural systems for valuation reflected a single hyperbolic discounting function th…”
BackgroundMethodInfluentialBarto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Myopia and Inconsistency in Dynamic Utility Maximization
Strotz, R. H. (1973) · Readings in Welfare Economics · doi:10.1007/978-1-349-15492-0_10 · Cited by 2,743
Out of Control: Visceral Influences on Behavior
Loewenstein, G. (1996) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1996.0028 · Cited by 2,610
Anomalies in Intertemporal Choice: Evidence and an Interpretation
Loewenstein, G., & Prelec, D. (1992) · The Quarterly Journal of Economics · doi:10.2307/2118482 · Cited by 2,305 · cited 2×
“As first described by Samuelson (1937) and now replicated and extended in many studies, most individuals willingly sacrifice value to obtain a reward within a shorter time interval (for reviews, see Frederick, Loewenstein, & O’Donoghue, 2002; Kalenscher & Pennartz, 2008; Loewenstein & Prelec, 1992).”
BackgroundResultSelf-regulation failure: an overview.
Baumeister, R. F., & Heatherton, T. F. (1996) · Psychological Inquiry · doi:10.1207/s15327965pli0701_1 · Cited by 2,266 · cited 1×
“Discounting rates are increased by deprivation of self control (Baumeister & Heatherton, 1996), when emotionally or sexually aroused (described in Loewenstein, 1996), or when smokers are deprived of nicotine (Field, Santarcangelo, Sumnall, Goudie, & Cole, 2006; Mitchell, 2004).”
BackgroundCan cognitive processes be inferred from neuroimaging data?
POLDRACK, R. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.004 · Cited by 2,249
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244 · cited 2×
“As described above, there exists substantial evidence that brain regions associated with the evaluation of immediately obtained primary and secondary rewards (Delgado, Nystrom, Fissell, Noll, & Fiez, 2000; Knutson et al., 2001; Schultz, Dayan, & Montague, 1997), both sure and probabilistic (Kuhnen & Knutson, 2005), ar…”
BackgroundSome empirical evidence on dynamic inconsistency
Thaler, R. (1981) · Economics Letters · doi:10.1016/0165-1765(81)90067-7 · Cited by 2,243 · cited 7×
“Most notably, individuals tend to exhibit inconsistent preferences depending on the time until rewards are available (Prelec & Loewenstein, 1991; Thaler, 1981).”
BackgroundInfluentialA Note on Measurement of Utility
Samuelson, P. A. (1937) · The Review of Economic Studies · doi:10.2307/2967612 · Cited by 2,164 · cited 1×
“As first described by Samuelson (1937) and now replicated and extended in many studies, most individuals willingly sacrifice value to obtain a reward within a shorter time interval (for reviews, see Frederick, Loewenstein, & O’Donoghue, 2002; Kalenscher & Pennartz, 2008; Loewenstein & Prelec, 1992).”
ResultDecision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective
Bechara, A. (2005) · Nature Neuroscience · doi:10.1038/nn1584 · Cited by 2,149 · cited 1×
“Note that this perspective matches well to the pervasive dual-systems account of behavioral control (Bechara, 2005; Ernst & Paulus, 2005; Kahneman, 2003; Loewenstein, 1996).”
BackgroundSpreng, R. N., Mar, R. A., & Kim, A. S. N. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.21029 · Cited by 2,143
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 1×
“Specifically, delay discounting is related to recent neuroscience work positing an actor/critic model of decision making (O’Doherty et al., 2004; Paulus, Feinstein, Tapert, & Liu, 2004; Preuschoff, Bossaerts, & Quartz, 2006; Seymour et al., 2004; Sutton & Barto, 1998).”
BackgroundWhat makes us tick? Functional and neural mechanisms of interval timing
Buhusi, C. V., & Meck, W. H. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1764 · Cited by 2,062 · cited 2×
“Describing these effects will require the incorporation of a larger body of behavioral and neuroscience research on time perception and its underlying mechanisms (Buhusi & Meck, 2005).”
Background(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
Bechara, A., Tranel, D., & Damasio, H. (2000) · Brain · doi:10.1093/brain/123.11.2189 · Cited by 1,919
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916 · cited 20×
“Here, we present two proposed models of intertemporal choice, quasi-hyperbolic and hyperbolic discounting, using studies from McClure and colleagues (2004) and Kable and Glimcher (2007).”
BackgroundMethodResultInfluentialAn adjusting procedure for studying delayed reinforcement.
Commons, M. L., Mazur, J., Nevin, J. A., & Rachlin, H. C. (1987) · doi:10.4324/9781315825502-11 · Cited by 1,861 · cited 1×
“A 1 " kD (Equation 3, U $ subjective value, A $ prize amount, D $ delay magnitude, k $ discounting parameter; Laibson, 1997; Mazur, 1987; Strotz, 1956).”
THE BEHAVIORAL LIFE‐CYCLE HYPOTHESIS
Shefrin, H. M., & Thaler, R. H. (1988) · Economic Inquiry · doi:10.1111/j.1465-7295.1988.tb01520.x · Cited by 1,685 · cited 2×
“(Equation 2; see Laibson, 1997; Loewenstein, 1996; Shefrin & Thaler, 1988).”
BackgroundA Discounting Framework for Choice With Delayed and Probabilistic Rewards.
Green, L., & Myerson, J. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.5.769 · Cited by 1,676 · cited 1×
“Some theorists have noted that all forms of reward discounting, whether intertemporal or probabilistic, may share aspects of calculation and comparison (Cardinal, 2006; Green & Myerson, 2004; Prelec & Loewenstein, 1991).”
BackgroundThe Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework
Camerer, C. F., Hogarth, R. M., Budescu, D. V., & Eckel, C. (1999) · Elicitation of Preferences · doi:10.1007/978-94-017-1406-8_2 · Cited by 1,545
Neural systems responding to degrees of uncertainty in human decision-making
Hsu, M., Bhatt, M., Adolphs, R., Tranel, D., & Camerer, C. F. (2005) · Science · doi:10.1126/science.1115327 · Cited by 1,411 · cited 1×
“These regions largely overlapped with those reported in previous studies of risky choice (Dickhaut et al., 2003; Hsu et al., 2005; Huettel et al., 2006; Kuhnen & Knutson, 2005; Paulus, Rogalsky, Simmons, Feinstein, & Stein, 2003; Rogers et al., 1999).”
ResultMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 1×
“There is also a significant literature on temporal difference learning in animal models (Barto, 1995; Bayer & Glimcher, 2005; Lau & Glimcher, 2008; Morris, Nevet, Arkadir, Vaadia, & Bergman, 2006; Samejima, Ueda, Doya, & Kimura, 2005; Schultz et al., 1997; Seo, Barraclough, & Lee, 2007; Seo & Lee,…”
The nature of adolescent competencies predicted by preschool delay of gratification.
Mischel, W., Shoda, Y., & Peake, P. K. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.4.687 · Cited by 1,285
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
The Neural Basis of Financial Risk Taking
Kuhnen, C. M., & Knutson, B. (2005) · Neuron · doi:10.1016/j.neuron.2005.08.008 · Cited by 1,182 · cited 2×
“…rewards (Delgado, Nystrom, Fissell, Noll, & Fiez, 2000; Knutson et al., 2001; Schultz, Dayan, & Montague, 1997), both sure and probabilistic (Kuhnen & Knutson, 2005), are modulated by aspects of rewards obtainable after some delay, including both the relative immediacy of those rewards…”
BackgroundResultEncoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Projection Bias in Predicting Future Utility
Loewenstein, G., O'Donoghue, T., & Rabin, M. (2003) · The Quarterly Journal of Economics · doi:10.1162/003355303322552784 · Cited by 1,117 · cited 1×
“A number of promising candidates await testing (e.g., Fudenberg & Levine, 2006; Kalenscher & Pennartz, 2008; Loewenstein et al., 2003; O’Donoghue & Rabin, 2000; Ok & Masatlioglu, 2007).”
BackgroundToward a behavioral economic understanding of drug dependence: delay discounting processes
Bickel, W. K., & Marsch, L. A. (2001) · Addiction · doi:10.1046/j.1360-0443.2001.961736.x · Cited by 1,117 · cited 1×
“…and inequities in resource allocation (Angeletos, Laibson, Repetto, Tobacman, & Weinberg, 2001; Laibson, 1997), to pathologies of decision making in addiction (Bickel & Marsch, 2001; Perry & Carroll, 2008), and attention deficit disorder (Critchfield & Kollins, 2001; Plichta et al., 2009).”
BackgroundTracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
sagvolden, T., johansen, E. B., aase, H., & russell, V. A. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000075 · Cited by 1,035
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030
The Hyperbolic Consumption Model: Calibration, Simulation, and Empirical Evaluation
Angeletos, G.-M., Laibson, D., Repetto, A., Tobacman, J., & Weinberg, S. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.3.47 · Cited by 1,000
Neural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994 · cited 3×
“The use of a single mechanism for valuation would provide significant advantages (Montague & Berns, 2002; Sugrue, Corrado, & Newsome, 2004), most notably by providing a common currency for comparisons between different forms of reward (Klein, Deaner, & Platt, 2008).”
WITHIN‐SUBJECT COMPARISON OF REAL AND HYPOTHETICAL MONEY REWARDS IN DELAY DISCOUNTING
Johnson, M. W., & Bickel, W. K. (2002) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2002.77-129 · Cited by 991 · cited 1×
“…than real prizes, especially at short delays (Camerer & Hogarth, 1999; Smith & Walker, 1993), though there are also examples where no difference was found (Baker, Johnson, & Bickel, 2003; Johnson & Bickel, 2002; Lagorio & Madden, 2005; Madden, Begotka, Raiff, & Kastern, 2003; Madden et al., 2004).”
BackgroundTime Discounting for Primary Rewards
McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4246-06.2007 · Cited by 971 · cited 7×
“…the range of weeks to years, with the remainder using much shorter delays of seconds to minutes for rewards obtained during the experiment itself (McClure et al., 2007) and for symbolic rewards that are accumulated (Gregorios-Pippas, Tobler, & Schultz, 2009; Luhmann, Chun, Yi, Lee, & Wang, 2008;…”
BackgroundResultInfluentialRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
A Dual-Self Model of Impulse Control
Fudenberg, D., & Levine, D. K. (2006) · American Economic Review · doi:10.1257/aer.96.5.1449 · Cited by 927 · cited 2×
“…upon value can be modeled normatively using a single exponential decay function, more complex functions are needed to describe actual choice behavior (Fudenberg & Levine, 2006; Kalenscher & Pennartz, 2008; Loewenstein, O’Donoghue, & Rabin, 2003; O’Donoghue & Rabin, 2000; Ok & Masatlioglu, 2007).”
BackgroundMethodImpulsive choice induced in rats by lesions of the nucleus accumbens core
Cardinal, R. N., Pennicott, D. R., Lakmali, C., Sugathapala, Robbins, T. W., & Everitt, B. J. (2001) · Science · doi:10.1126/science.1060818 · Cited by 923
Discount Rates Inferred from Decisions: An Experimental Study
Benzion, U., Rapoport, A., & Yagil, J. (1989) · Management Science · doi:10.1287/mnsc.35.3.270 · Cited by 909
ALE meta-analysis: controlling the false discovery rate and performing statistical contrasts
Laird, A. R., Fox, P. M., Price, C. J., Glahn, D. C., Uecker, A. M., Lancaster, J. L., Turkeltaub, P. E., Kochunov, P., & Fox, P. T. (2005) · Human Brain Mapping · doi:10.1002/hbm.20136 · Cited by 868 · cited 1×
“In order to provide a coarse representation of the regions of the brain consistently involved in studies of delay discounting, we performed activation likelihood estimation (ALE) using GingerALE (Laird et al., 2005).”
MethodThe role of impulsive behavior in drug abuse
Perry, J. L., & Carroll, M. E. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1173-0 · Cited by 805 · cited 1×
“…and inequities in resource allocation (Angeletos, Laibson, Repetto, Tobacman, & Weinberg, 2001; Laibson, 1997), to pathologies of decision making in addiction (Bickel & Marsch, 2001; Perry & Carroll, 2008), and attention deficit disorder (Critchfield & Kollins, 2001; Plichta et al., 2009).”
BackgroundPrediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · cited 3×
“…to years, with the remainder using much shorter delays of seconds to minutes for rewards obtained during the experiment itself (McClure et al., 2007) and for symbolic rewards that are accumulated (Gregorios-Pippas, Tobler, & Schultz, 2009; Luhmann, Chun, Yi, Lee, & Wang, 2008; Tanaka et al., 2004).”
BackgroundResultInfluentialPreferences for sequences of outcomes.
Loewenstein, G. F., & Prelec, D. (1993) · Psychological Review · doi:10.1037/0033-295x.100.1.91 · Cited by 767 · cited 1×
“…& Sicherman, 1991); a preference for speeding up rather than slowing payment schedules (Loewenstein, 1988); a preference for distributed rewards (Loewenstein & Prelec, 1993); an effect of reward type, food is discounted more strongly than money (Odum & Rainaud, 2003); and an effect of reward…”
BackgroundAinslie, G. W. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.21-485 · Cited by 759 · cited 1×
“Such discounting effects are ubiquitous for both primary rewards (e.g., food, juice; Ainslie, 1974; Kobayashi & Schultz, 2008; McClure, Ericson, Laibson, Loewenstein, & Cohen, 2007; Richards, Mitchell, Wit, & Seiden, 1997) and secondary rewards (e.g., money; Thaler, 1981; for review see Loewenstein…”
Rogers, R. D., Owen, A. M., Middleton, H. C., Williams, E. J., Pickard, J. D., Sahakian, B. J., & Robbins, T. W. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-20-09029.1999 · Cited by 747 · cited 1×
“These regions largely overlapped with those reported in previous studies of risky choice (Dickhaut et al., 2003; Hsu et al., 2005; Huettel et al., 2006; Kuhnen & Knutson, 2005; Paulus, Rogalsky, Simmons, Feinstein, & Stein, 2003; Rogers et al., 1999).”
ResultPaulus, M. P., Rogalsky, C., Simmons, A., Feinstein, J. S., & Stein, M. B. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00251-9 · Cited by 745
Neural Signatures of Economic Preferences for Risk and Ambiguity
Huettel, S. A., Stowe, C. J., Gordon, E. M., Warner, B. T., & Platt, M. L. (2006) · Neuron · doi:10.1016/j.neuron.2006.01.024 · Cited by 712 · cited 1×
“These regions largely overlapped with those reported in previous studies of risky choice (Dickhaut et al., 2003; Hsu et al., 2005; Huettel et al., 2006; Kuhnen & Knutson, 2005; Paulus, Rogalsky, Simmons, Feinstein, & Stein, 2003; Rogers et al., 1999).”
ResultNeural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692
Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice
Winstanley, C. A., Theobald, D. E. H., Cardinal, R. N., & Robbins, T. W. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5606-03.2004 · Cited by 675
Planning for the future by western scrub-jays
Raby, C. R., Alexis, D. M., Dickinson, A., & Clayton, N. S. (2007) · Nature · doi:10.1038/nature05575 · Cited by 670
Delay discounting of real and hypothetical rewards.
Madden, G. J., Begotka, A. M., Raiff, B. R., & Kastern, L. L. (2003) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.11.2.139 · Cited by 660
Frames of Mind in Intertemporal Choice
Loewenstein, G. F. (1988) · Management Science · doi:10.1287/mnsc.34.2.200 · Cited by 635 · cited 2×
“…are valued more than decreasing sequences (Loewenstein & Sicherman, 1991); a preference for speeding up rather than slowing payment schedules (Loewenstein, 1988); a preference for distributed rewards (Loewenstein & Prelec, 1993); an effect of reward type, food is discounted more strongly…”
BackgroundTemporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 1×
“Specifically, delay discounting is related to recent neuroscience work positing an actor/critic model of decision making (O’Doherty et al., 2004; Paulus, Feinstein, Tapert, & Liu, 2004; Preuschoff, Bossaerts, & Quartz, 2006; Seymour et al., 2004; Sutton & Barto, 1998).”
BackgroundBaker, F., Johnson, M. W., & Bickel, W. K. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.3.382 · Cited by 602
Decision Making Over Time and Under Uncertainty: A Common Approach
Prelec, D., & Loewenstein, G. (1991) · Management Science · doi:10.1287/mnsc.37.7.770 · Cited by 594 · cited 6×
“Most notably, individuals tend to exhibit inconsistent preferences depending on the time until rewards are available (Prelec & Loewenstein, 1991; Thaler, 1981).”
BackgroundInfluentialIntertemporal choice – toward an integrative framework
Berns, G. S., Laibson, D., & Loewenstein, G. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.08.011 · Cited by 580 · cited 2×
“There are also cases where the mental state of the participant preceding the choice modulates discounting (summarized in Berns et al., 2007; Montague & King-Casas, 2007).”
BackgroundApes Save Tools for Future Use
Mulcahy, N. J., & Call, J. (2006) · Science · doi:10.1126/science.1125456 · Cited by 578 · cited 1×
“As examples, apes show long-term planning by retaining tools for use 14 hours later (Mulcahy & Call, 2006) but have not yet demonstrated that they can reject an immediate prize for a larger one that will occur more than a few minutes later (Chimps 123s; Rosati, Stevens, Hare, & Hauser, 2007).”
BackgroundMONETARY REWARDS AND DECISION COST IN EXPERIMENTAL ECONOMICS
SMITH, V. L., & WALKER, J. M. (1993) · Economic Inquiry · doi:10.1111/j.1465-7295.1993.tb00881.x · Cited by 560
Hariri, A. R., Brown, S. M., Williamson, D. E., Flory, J. D., de Wit, H., & Manuck, S. B. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3446-06.2006 · Cited by 557 · cited 2×
“…that computation of the value of a delayed outcome relies on similar mechanisms as other rewards is consistent with work by Hariri and colleagues (Hariri et al., 2006), which shows that reward sensitivity in the ventral striatum scales with a participant’s hyperbolic discounting coefficient.”
ResultMidbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503
Delay discounting and probability discounting as related to cigarette smoking status in adults
Reynolds, B., Richards, J. B., Horn, K., & Karraker, K. (2004) · Behavioural Processes · doi:10.1016/s0376-6357(03)00109-8 · Cited by 495 · cited 1×
“As first described by Samuelson (1937) and now replicated and extended in many studies, most individuals willingly sacrifice value to obtain a reward within a shorter time interval (for reviews, see Frederick, Loewenstein, & O’Donoghue, 2002; Kalenscher & Pennartz, 2008; Loewenstein & Prelec, 1992).”
ResultDETERMINATION OF DISCOUNT FUNCTIONS IN RATS WITH AN ADJUSTING‐AMOUNT PROCEDURE
Richards, J. B., Mitchell, S. H., de Wit, H., & Seiden, L. S. (1997) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1997.67-353 · Cited by 492
Neurobiology of Decision Making: A Selective Review from a Neurocognitive and Clinical Perspective
Ernst, M., & Paulus, M. P. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.06.004 · Cited by 469 · cited 1×
“Note that this perspective matches well to the pervasive dual-systems account of behavioral control (Bechara, 2005; Ernst & Paulus, 2005; Kahneman, 2003; Loewenstein, 1996).”
BackgroundDissociable neural representations of future reward magnitude and delay during temporal discounting
Ballard, K., & Knutson, B. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.004 · Cited by 453 · cited 6×
“And, other researchers have found little or no difference between how well distinct functions fit fMRI data (Ballard & Knutson, 2009; GregoriosPippas et al., 2009) or have found that the best model depends on the experimental conditions (Schweighofer et al., 2006).”
BackgroundResultInfluentialShamosh, N. A., DeYoung, C. G., Green, A. E., Reis, D. L., Johnson, M. R., Conway, A. R. A., Engle, R. W., Braver, T. S., & Gray, J. R. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02175.x · Cited by 452
Modeling Myopic Decisions: Evidence for Hyperbolic Delay-Discounting within Subjects and Amounts
Kirby, K. N., & Maraković, N. N. (1995) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1995.1086 · Cited by 449 · cited 2×
“Proposed al- ternative models that have these characteristics include a hyperbolic function (Kirby & Marakovic, 1995; Laibson, 1997, 1998; Strotz, 1956) as well as a quasi-hyperbolic function utilizing two exponential decay functions (Loewenstein, 1996; Phelps, 1968; Shefrin & Thaler, 1988).”
BackgroundIs Time-Discounting Hyperbolic or Subadditive?
Read, D. (2001) · Journal of Risk and Uncertainty · doi:10.1023/a:1011198414683 · Cited by 447 · cited 2×
“…discounting for smaller rewards (Raineri & Rachlin, 1993; Thaler, 1981); an effect of the number of choices, more choices increases discounting (Read, 2001); an order effect, increasing sequences are valued more than decreasing sequences (Loewenstein & Sicherman, 1991); a preference for…”
BackgroundAdaptive Critics and the Basal Ganglia
Barto, A. G. (1994) · Models of Information Processing in the Basal Ganglia · doi:10.7551/mitpress/4708.003.0018 · Cited by 446 · cited 2×
“There is also a significant literature on temporal difference learning in animal models (Barto, 1995; Bayer & Glimcher, 2005; Lau & Glimcher, 2008; Morris, Nevet, Arkadir, Vaadia, & Bergman, 2006; Samejima, Ueda, Doya, & Kimura, 2005; Schultz et al., 1997; Seo, Barraclough, & Lee, 2007; Seo & Lee,…”
BackgroundTEMPORAL DISCOUNTING: BASIC RESEARCH AND THE ANALYSIS OF SOCIALLY IMPORTANT BEHAVIOR
Critchfield, T. S., & Kollins, S. H. (2001) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2001.34-101 · Cited by 439 · cited 1×
“…and inequities in resource allocation (Angeletos, Laibson, Repetto, Tobacman, & Weinberg, 2001; Laibson, 1997), to pathologies of decision making in addiction (Bickel & Marsch, 2001; Perry & Carroll, 2008), and attention deficit disorder (Critchfield & Kollins, 2001; Plichta et al., 2009).”
BackgroundMonkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques
Deaner, R. O., Khera, A. V., & Platt, M. L. (2005) · Current Biology · doi:10.1016/j.cub.2005.01.044 · Cited by 432
Influence of Reward Delays on Responses of Dopamine Neurons
Kobayashi, S., & Schultz, W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1600-08.2008 · Cited by 430 · cited 1×
“Such discounting effects are ubiquitous for both primary rewards (e.g., food, juice; Ainslie, 1974; Kobayashi & Schultz, 2008; McClure, Ericson, Laibson, Loewenstein, & Cohen, 2007; Richards, Mitchell, Wit, & Seiden, 1997) and secondary rewards (e.g., money; Thaler, 1981; for review see Loewenstein…”
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 409 · cited 1×
“There is also a significant literature on temporal difference learning in animal models (Barto, 1995; Bayer & Glimcher, 2005; Lau & Glimcher, 2008; Morris, Nevet, Arkadir, Vaadia, & Bergman, 2006; Samejima, Ueda, Doya, & Kimura, 2005; Schultz et al., 1997; Seo, Barraclough, & Lee, 2007; Seo & Lee,…”
Do Workers Prefer Increasing Wage Profiles?
Loewenstein, G., & Sicherman, N. (1991) · Journal of Labor Economics · doi:10.1086/298259 · Cited by 400 · cited 1×
“…number of choices, more choices increases discounting (Read, 2001); an order effect, increasing sequences are valued more than decreasing sequences (Loewenstein & Sicherman, 1991); a preference for speeding up rather than slowing payment schedules (Loewenstein, 1988); a preference for distributed…”
BackgroundThe economics of immediate gratification
O'Donoghue, T., & Rabin, M. (2000) · Journal of Behavioral Decision Making · doi:10.1002/(sici)1099-0771(200004/06)13:2<233::aid-bdm325>3.0.co;2-u · Cited by 388 · cited 2×
“…upon value can be modeled normatively using a single exponential decay function, more complex functions are needed to describe actual choice behavior (Fudenberg & Levine, 2006; Kalenscher & Pennartz, 2008; Loewenstein, O’Donoghue, & Rabin, 2003; O’Donoghue & Rabin, 2000; Ok & Masatlioglu, 2007).”
BackgroundMethodLife-cycle consumption and hyperbolic discount functions
Laibson, D. (1998) · European Economic Review · doi:10.1016/s0014-2921(97)00132-3 · Cited by 380 · cited 1×
“Proposed al- ternative models that have these characteristics include a hyperbolic function (Kirby & Marakovic, 1995; Laibson, 1997, 1998; Strotz, 1956) as well as a quasi-hyperbolic function utilizing two exponential decay functions (Loewenstein, 1996; Phelps, 1968; Shefrin & Thaler, 1988).”
BackgroundTripp, G., & Wickens, J. R. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01851.x · Cited by 368 · cited 1×
“…excellent candidate for implementing these proposed learning models, leading to well motivated hypotheses (Sagvolden, Johansen, Aase, & Russell, 2005; Tripp & Wickens, 2008) that could explain pathological failures of intertemporal choice (e.g., in attention deficit/hyperactivity disorder, ADHD).”
BackgroundLagorio, C. H., & Madden, G. J. (2005) · Behavioural Processes · doi:10.1016/j.beproc.2005.02.003 · Cited by 359 · cited 1×
“…than real prizes, especially at short delays (Camerer & Hogarth, 1999; Smith & Walker, 1993), though there are also examples where no difference was found (Baker, Johnson, & Bickel, 2003; Johnson & Bickel, 2002; Lagorio & Madden, 2005; Madden, Begotka, Raiff, & Kastern, 2003; Madden et al., 2004).”
BackgroundRosati, A. G., Stevens, J. R., Hare, B., & Hauser, M. D. (2007) · Current Biology · doi:10.1016/j.cub.2007.08.033 · Cited by 356
Discounting delayed and probabilistic monetary gains and losses by smokers of cigarettes
Ohmura, Y., Takahashi, T., & Kitamura, N. (2005) · Psychopharmacology · doi:10.1007/s00213-005-0110-8 · Cited by 352
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · cited 1×
“…1995; Bayer & Glimcher, 2005; Lau & Glimcher, 2008; Morris, Nevet, Arkadir, Vaadia, & Bergman, 2006; Samejima, Ueda, Doya, & Kimura, 2005; Schultz et al., 1997; Seo, Barraclough, & Lee, 2007; Seo & Lee, 2007), providing an additional method for better connecting their work to animal research.”
Saving for the future self: Neural measures of future self-continuity predict temporal discounting
Ersner-Hershfield, H., Wimmer, G. E., & Knutson, B. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn042 · Cited by 321
Madden, G. J., Raiff, B. R., Lagorio, C. H., Begotka, A. M., Mueller, A. M., Hehli, D. J., & Wegener, A. A. (2004) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.12.4.251 · Cited by 314 · cited 2×
“We note that there are examples of prior behavioral research that provide indications that hypothetical prizes can be treated differently than real prizes, especially at short delays (Camerer & Hogarth, 1999; Smith & Walker, 1993), though there are also examples where no difference was found (Baker, Johnson, & Bickel,…”
BackgroundExponential versus hyperbolic discounting of delayed outcomes: Risk and waiting time.
GREEN, L., & MYERSON, J. (1996) · American Zoologist · doi:10.1093/icb/36.4.496 · Cited by 294 · cited 1×
“At one extreme, evidence that intertemporal choice shares valuation and decision mechanisms with other forms of choice (Benzion, Rapoport, & Yagil, 1989; Green & Myerson, 1996) would support the conclusion that subjective value is represented in a single neural currency.”
BackgroundGiordano, L., Bickel, W., Loewenstein, G., Jacobs, E., Marsch, L., & Badger, G. (2002) · Psychopharmacology · doi:10.1007/s00213-002-1159-2 · Cited by 294 · cited 1×
“…effects like symmetric past and future discounting (Bickel, Yi, Kowal, & Gatchalian, 2008), the hidden zero effect (Magen, Dweck, & Gross, 2008), and changes in discounting with drug state history (e.g., Giordano et al., 2002), all suggest novel pieces for the intertemporal choice puzzle.”
BackgroundThe ecology and evolution of patience in two New World monkeys
Stevens, J. R., Hallinan, E. V., & Hauser, M. D. (2005) · Biology Letters · doi:10.1098/rsbl.2004.0285 · Cited by 289
Plichta, M. M., Vasic, N., Wolf, R. C., Lesch, K.-P., Brummer, D., Jacob, C., Fallgatter, A. J., & Grön, G. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.07.008 · Cited by 272 · cited 1×
“…and inequities in resource allocation (Angeletos, Laibson, Repetto, Tobacman, & Weinberg, 2001; Laibson, 1997), to pathologies of decision making in addiction (Bickel & Marsch, 2001; Perry & Carroll, 2008), and attention deficit disorder (Critchfield & Kollins, 2001; Plichta et al., 2009).”
BackgroundNeurobiological Substrates of Dread
Berns, G. S., Chappelow, J., Cekic, M., Zink, C. F., Pagnoni, G., & Martin-Skurski, M. E. (2006) · Science · doi:10.1126/science.1123721 · Cited by 269 · cited 2×
“, money; Thaler, 1981; for review see Loewenstein & Prelec, 1992; Strotz, 1956; Tesch & Sanfey, 2008), although an opposite phenomenon is sometimes observed for aversive stimuli, which can become more negative if farther away in time (i.e., increasingly dreaded; Berns et al., 2006).”
BackgroundDiscounting delayed and probabilistic rewards: Processes and traits
Myerson, J., Green, L., Scott Hanson, J., Holt, D. D., & Estle, S. J. (2003) · Journal of Economic Psychology · doi:10.1016/s0167-4870(03)00005-9 · Cited by 264
Wittmann, M., Leland, D. S., & Paulus, M. P. (2007) · Experimental Brain Research · doi:10.1007/s00221-006-0822-y · Cited by 255 · cited 4×
“Because of this imprecision, results from other studies, such as increased striatal activation to relatively short delays (Wittmann et al., 2007), would be consistent with either model.”
BackgroundResultInfluentialDiscounting of delayed hypothetical money, alcohol, and food
Odum, A. L., & Rainaud, C. P. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00145-1 · Cited by 250 · cited 1×
“…payment schedules (Loewenstein, 1988); a preference for distributed rewards (Loewenstein & Prelec, 1993); an effect of reward type, food is discounted more strongly than money (Odum & Rainaud, 2003); and an effect of reward valence, gains are more steeply discounted than losses (Thaler, 1981).”
BackgroundField, M., Santarcangelo, M., Sumnall, H., Goudie, A., & Cole, J. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0385-4 · Cited by 250
Neural systems implicated in delayed and probabilistic reinforcement
Cardinal, R. N. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.004 · Cited by 248 · cited 1×
“Some theorists have noted that all forms of reward discounting, whether intertemporal or probabilistic, may share aspects of calculation and comparison (Cardinal, 2006; Green & Myerson, 2004; Prelec & Loewenstein, 1991).”
BackgroundWill Travel for Food: Spatial Discounting in Two New World Monkeys
Stevens, J. R., Rosati, A. G., Ross, K. R., & Hauser, M. D. (2005) · Current Biology · doi:10.1016/j.cub.2005.09.016 · Cited by 228
The effect of temporal constraints on the value of money and other commodities
Raineri, A., & Rachlin, H. (1993) · Journal of Behavioral Decision Making · doi:10.1002/bdm.3960060202 · Cited by 223 · cited 1×
“…of behavioral effects can modulate subjective value in intertemporal choice: a prize magnitude effect, greater discounting for smaller rewards (Raineri & Rachlin, 1993; Thaler, 1981); an effect of the number of choices, more choices increases discounting (Read, 2001); an order effect,…”
BackgroundIs a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making
Kalenscher, T., & Pennartz, C. M. A. (2008) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2007.11.004 · Cited by 222 · cited 3×
“As first described by Samuelson (1937) and now replicated and extended in many studies, most individuals willingly sacrifice value to obtain a reward within a shorter time interval (for reviews, see Frederick, Loewenstein, & O’Donoghue, 2002; Kalenscher & Pennartz, 2008; Loewenstein & Prelec, 1992).”
BackgroundMethodResultCortical activation during delay discounting in abstinent methamphetamine dependent individuals
Hoffman, W. F., Schwartz, D. L., Huckans, M. S., McFarland, B. H., Meiri, G., Stevens, A. A., & Mitchell, S. H. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1261-1 · Cited by 210 · cited 1×
“One study was excluded because its coordinates were reported in an unconventional space (Hoffman et al., 2008).”
BackgroundReward discounting as a measure of impulsive behavior in a psychiatric outpatient population.
Crean, J. P., de Wit, H., & Richards, J. B. (2000) · Experimental and Clinical Psychopharmacology · doi:10.1037//1064-1297.8.2.155 · Cited by 208
Neural representation of interval encoding and decision making
Harrington, D. L., Boyd, L. A., Mayer, A. R., Sheltraw, D. M., Lee, R. R., Huang, M., & Rao, S. M. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.01.010 · Cited by 195 · cited 1×
“A similar portion of the posterior cingulate is also implicated in the encoding of time intervals (Harrington et al., 2004), see Figure 1C.”
BackgroundMitchell, S. (2004) · Nicotine & Tobacco Research · doi:10.1080/14622200412331296002 · Cited by 192 · cited 1×
“Discounting rates are increased by deprivation of self control (Baumeister & Heatherton, 1996), when emotionally or sexually aroused (described in Loewenstein, 1996), or when smokers are deprived of nicotine (Field, Santarcangelo, Sumnall, Goudie, & Cole, 2006; Mitchell, 2004).”
BackgroundBickel, W. K., Yi, R., Kowal, B. P., & Gatchalian, K. M. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.03.009 · Cited by 186
Playing for peanuts: Why is risk seeking more common for low-stakes gambles?
Weber, B. J., & Chapman, G. B. (2005) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2005.03.001 · Cited by 184 · cited 1×
“Increasing magnitude of reward usually has opposite effects on probability and delay: large rewards reduce the immediacy effect but increase the certainty effect (Chapman & Weber, 2006; Prelec & Loewenstein, 1991; Rachlin, Brown, & Cross, 2000; Weber & Chapman, 2005).”
BackgroundUnderstanding Overbidding: Using the Neural Circuitry of Reward to Design Economic Auctions
Delgado, M. R., Schotter, A., Ozbay, E. Y., & Phelps, E. A. (2008) · Science · doi:10.1126/science.1158860 · Cited by 180
The neural substrates of probabilistic and intertemporal decision making
Weber, B. J., & Huettel, S. A. (2008) · Brain Research · doi:10.1016/j.brainres.2008.07.105 · Cited by 178 · cited 2×
“Weber and Huettel examined differences in the neural substrates of risk and delay valuation (Weber & Huettel, 2008) by asking participants to choose between pairs of monetary outcomes differing in their delay or their risk.”
BackgroundResultTemporal Discounting Predicts Risk Sensitivity in Rhesus Macaques
Hayden, B. Y., & Platt, M. L. (2007) · Current Biology · doi:10.1016/j.cub.2006.10.055 · Cited by 163 · cited 1×
“…it differs dramatically from that of the large animal literature on delay discounting, which normally uses delays on the order of several seconds (Hayden & Platt, 2007; Kalenscher et al., 2005; Kalenscher et al., 2004; Rosati, Stevens, & Hauser, 2006; Stevens, Hallinan, & Hauser, 2005; Stevens,…”
BackgroundReynolds, B. A., Karraker, K. H., Horn, K. A., & Richards, J. B. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00168-2 · Cited by 163
Magen, E., Dweck, C. S., & Gross, J. J. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02137.x · Cited by 157
Neural Dissociation of Delay and Uncertainty in Intertemporal Choice
Luhmann, C. C., Chun, M. M., Yi, D.-J., Lee, D., & Wang, X.-J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5058-08.2008 · Cited by 150 · cited 1×
“An important bridging approach will be assessing choices over delays similar to that present in animal models (Luhmann et al., 2008; McClure et al., 2007).”
BackgroundKalenscher, T., Windmann, S., Diekamp, B., Rose, J., Güntürkün, O., & Colombo, M. (2005) · Current Biology · doi:10.1016/j.cub.2005.02.052 · Cited by 145 · cited 2×
“…from that of the large animal literature on delay discounting, which normally uses delays on the order of several seconds (Hayden & Platt, 2007; Kalenscher et al., 2005; Kalenscher et al., 2004; Rosati, Stevens, & Hauser, 2006; Stevens, Hallinan, & Hauser, 2005; Stevens, Rosati, Ross, &…”
BackgroundMethodDynamic Signals Related to Choices and Outcomes in the Dorsolateral Prefrontal Cortex
Seo, H., Barraclough, D. J., & Lee, D. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm064 · Cited by 143
Neural Correlates of Social Target Value in Macaque Parietal Cortex
Klein, J. T., Deaner, R. O., & Platt, M. L. (2008) · Current Biology · doi:10.1016/j.cub.2008.02.047 · Cited by 133
Neuroeconomic Studies of Impulsivity: Now or Just as Soon as Possible?
Glimcher, P. W., Kable, J., & Louie, K. (2007) · American Economic Review · doi:10.1257/aer.97.2.142 · Cited by 118
The impact of the certainty context on the process of choice
Dickhaut, J. W., McCabe, K., Nagode, J. C., Rustichini, A., Smith, K. C. S., & Pardo, J. V. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0530279100 · Cited by 111 · cited 1×
“These regions largely overlapped with those reported in previous studies of risky choice (Dickhaut et al., 2003; Hsu et al., 2005; Huettel et al., 2006; Kuhnen & Knutson, 2005; Paulus, Rogalsky, Simmons, Feinstein, & Stein, 2003; Rogers et al., 1999).”
ResultShort-Term Temporal Discounting of Reward Value in Human Ventral Striatum
Gregorios-Pippas, L., Tobler, P. N., & Schultz, W. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90730.2008 · Cited by 101 · cited 3×
“While there is now general acceptance that a normative exponential model cannot account for real-world discounting behavior (see Ballard & Knutson, 2009; Gregorios-Pippas et al., 2009; Schweighofer et al., 2006, for possible exceptions), there exists no consensus about its replacement.”
BackgroundMethodMeasurement of delay discounting using trial-by-trial consequences
Lane, S. D., Cherek, D. R., Pietras, C. J., & Tcheremissine, O. V. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00143-8 · Cited by 87
Humans Can Adopt Optimal Discounting Strategy under Real-Time Constraints
Schweighofer, N., Shishida, K., Han, C. E., Okamoto, Y., Tanaka, S. C., Yamawaki, S., & Doya, K. (2006) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0020152 · Cited by 82 · cited 3×
“While there is now general acceptance that a normative exponential model cannot account for real-world discounting behavior (see Ballard & Knutson, 2009; Gregorios-Pippas et al., 2009; Schweighofer et al., 2006, for possible exceptions), there exists no consensus about its replacement.”
BackgroundIzawa, E.-I., Zachar, G., Yanagihara, S., & Matsushima, T. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-05-01894.2003 · Cited by 75
A theory of (relative) discounting
Ok, E. A., & Masatlıoĝlu, Y. (2007) · Journal of Economic Theory · doi:10.1016/j.jet.2007.01.008 · Cited by 66 · cited 2×
“…upon value can be modeled normatively using a single exponential decay function, more complex functions are needed to describe actual choice behavior (Fudenberg & Levine, 2006; Kalenscher & Pennartz, 2008; Loewenstein, O’Donoghue, & Rabin, 2003; O’Donoghue & Rabin, 2000; Ok & Masatlioglu, 2007).”
BackgroundMethodKheramin, S., Body, S., Ho, M.-Y., Velázquez-Martínez, D. N., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2003) · Behavioural Processes · doi:10.1016/s0376-6357(03)00142-6 · Cited by 63 · cited 1×
“There is a disconnect between this result and those described in the animal literature (Cardinal, Pennicott, Sugathapala, Robbins, & Everitt, 2001; Izawa, Zachar, Yanagihara, & Matsushima, 2003; Winstanley, Theobald, Cardinal, & Robbins, 2004; but see Kheramin et al., 2003).”
ResultThe effect of handling time on temporal discounting in two New World primates
Rosati, A. G., Stevens, J. R., & HAUSER, M. D. (2006) · Animal Behaviour · doi:10.1016/j.anbehav.2005.11.012 · Cited by 63
Foundations of Neuroeconomics: From Philosophy to Practice
Clithero, J. A., Tankersley, D., & Huettel, S. A. (2008) · PLoS Biology · doi:10.1371/journal.pbio.0060298 · Cited by 57
Decision biases in intertemporal choice and choice under uncertainty: Testing a common account
Chapman, G. B., & Weber, B. J. (2006) · Memory & Cognition · doi:10.3758/bf03193582 · Cited by 56 · cited 2×
“At another extreme, evidence of fundamental differences between intertemporal choice and other types of choice could lead to the conclusion that intertemporal choice reflects, at least in part, the workings of a separate system for valuation (Chapman & Weber, 2006; Prelec & Loewenstein, 1991).”
BackgroundLocal pattern classification differentiates processes of economic valuation
Clithero, J. A., Carter, R. M., & Huettel, S. A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.074 · Cited by 54 · cited 2×
“Three studies were excluded because they used ROIbased analyses (Bjork, Momenan, & Hommer, in press; Clithero et al., 2009; Gregorios-Pippas et al., 2009).”
MethodPaulus, M. P., Feinstein, J. S., Tapert, S. F., & Liu, T. T. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.060 · Cited by 52
Efficient statistics, common currencies and the problem of reward-harvesting
Montague, P. R., & King‐Casas, B. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.10.002 · Cited by 51 · cited 2×
“Together, these questions bear on a topic central to neuroeconomic research: the existence of a common neural currency for reward (Deaner, Khera, & Platt, 2005; Montague & Berns, 2002; Montague & King-Casas, 2007).”
BackgroundModels and Methods in Delay Discounting
Tesch, A. D. K., & Sanfey, A. G. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1399.010 · Cited by 45 · cited 4×
“As summarized by Tesch and Sanfey (2008), a range of behavioral effects can modulate subjective value in intertemporal choice: a prize magnitude effect, greater discounting for smaller rewards (Raineri & Rachlin, 1993; Thaler, 1981); an effect of the number of choices, more choices increases…”
BackgroundInfluential
Cited by
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706
“Two other meta-analyses focus on specific decision environments, such as intertemporal choice (Carter et al., 2010) and risky choice (Mohr et al., 2010).”
BackgroundCohen, J., Ericson, K. M., Laibson, D., & White, J. M. (2020) · Journal of Economic Literature · doi:10.1257/jel.20191074 · Cited by 344
Remember the future II: Meta-analyses and functional overlap of working memory and delay discounting
Wesley, M. J., & Bickel, W. K. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.08.008 · Cited by 205
“First, matched activation likelihood estimation (ALE) meta-analyses confirmed previous reports that delay discounting (12) and working memory (13) engage limbic and neocortical structures, including the striatum, insula, cingulate and portions of the frontal lobe.”
BackgroundActivity in dlPFC and its effective connectivity to vmPFC are associated with temporal discounting
Hare, T. A., Hakimi, S., & Rangel, A. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00050 · Cited by 206
“ORIGINAL RESEARCH ARTICLE published: 18 March 2014 doi: 10.3389/fnins.2014.00050 Activity in dlPFC and its effective connectivity to vmPFC are associated with temporal discounting”
InfluentialIncreased Capacity to Delay Reward in Anorexia Nervosa
Steinglass, J. E., Figner, B., Berkowitz, S., Simpson, H. B., Weber, E. U., & Walsh, B. T. (2012) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617712000446 · Cited by 169
Metadata
- Authors
- Carter, R. M., Meyer, J. R., & Huettel, S. A.
- Affiliations
- Duke University (US)
- Venue
- Journal of Neuroscience Psychology and Economics
- Published
- 2010-05
- Volume
- 3
- Issue
- 1
- Pages
- 27-45
- ISSN
- 1937-321X (ISSN-L)
- 2151-318X
- OpenAlex
- W2109453049
- Cited by
- 124
- References
- 136
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 4 · 2023: 4 · 2022: 6 · 2021: 9 · 2020: 8 · 2019: 5 · 2018: 6 · 2017: 10 · 2016: 11 · 2015: 15 · 2014: 10 · 2013: 9 · 2012: 15
- FWCI
- 6.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Neuroscience Psychology and Economics (publishedVersion)
- Funders
- Duke Institute for Brain Sciences
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- intertemporal choice, delay discounting, functional MRI, neural mechanisms of decision-making, reward valuation, posterior cingulate cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.