The DOI matches its Crossref record; 235 of the 235 references it cites were found in a registry or an index.
Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective
Open accessAbstract
The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
2 retracted
Items 201–235 of 235
The Misbehaviour of Value and the Discipline of the Will
Dayan, P. (2006) · Cited by 60
Evolutionary Foundations of Developmental Psychopathology
Giudice, M. D., & Ellis, B. J. (2016) · Wiley eBooks · doi:10.1002/9781119125556.devpsy201 · Cited by 58
Fields, S., Leraas, K., Collins, C., & Reynolds, B. (2009) · Behavioural Pharmacology · doi:10.1097/fbp.0b013e328330dcff · Cited by 57
Mueller, E. T., Landes, R. D., Kowal, B. P., Yi, R., Stitzer, M. L., Burnett, C. A., & Bickel, W. K. (2009) · Behavioural Pharmacology · doi:10.1097/fbp.0b013e3283305ec7 · Cited by 54 · cited 2×
“…number of studies have shown that monetary discounting predicts response to behavior-change interventions (Dallery and Raiff, 2007; Krishnan-Sarin et al., 2007; MacKillop and Kahler, 2009; Mueller et al., 2009; Washio et al., 2011; Sheffer et al., 2012; Stanger et al., 2012; Brown and Adams, 2013).”
BackgroundA comparison of delay discounting among smokers, substance abusers, and non-dependent controls
Businelle, M. S., McVay, M. A., Kendzor, D., & Copeland, A. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2010.06.010 · Cited by 52
Etiologic Aspects of Alcohol and Drug Abuse
Pattison, Ε. M. (1984) · Journal of Studies on Alcohol · doi:10.15288/jsa.1984.45.554 · Cited by 51
Adolescent smokers rate delayed rewards as less certain than adolescent nonsmokers
Reynolds, B. A., Patak, M., & Shroff, P. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2007.04.008 · Cited by 50
On Average Versus Discounted Reward Temporal-Difference Learning
Tsitsiklis, J. N., & Roy, B. V. (2002) · Machine Learning · doi:10.1023/a:1017980312899 · Cited by 48
Making Sense of Stress: An Evolutionary—Developmental Framework
Giudice, M. D., Ellis, B. J., & Shirtcliff, E. A. (2012) · Springer eBooks · doi:10.1007/978-1-4614-5605-6_2 · Cited by 47
Can state and trait variables be disentangled? A methodological framework for psychiatric disorders
KRAEMER, H. C., Gullion, C. M., Rush, A. J., Frank, E., & Kupfer, D. J. (1994) · Psychiatry Research · doi:10.1016/0165-1781(94)90120-1 · Cited by 45
Jh, G. (1954) · PubMed · Cited by 45
The effect of military service on soldiers’ time preferences — Evidence from Israel
Lahav, E., Ben‐Zion, U., & Shavit, T. (2011) · Judgment and Decision Making · doi:10.1017/s1930297500004071 · Cited by 44
Delay discounting by the children of smokers and nonsmokers
Reynolds, B., Leraas, K., Collins, C., & Melanko, S. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.07.015 · Cited by 43
Rezvanfard, M., Ekhtiari, H., Mokri, A., Djavid, G. E., & Kaviani, H. (2010) · PubMed · Cited by 43
Effects of measurement methods on the relationship between smoking and delay reward discounting
Stillwell, D. J., & Tunney, R. J. (2011) · Addiction · doi:10.1111/j.1360-0443.2011.03742.x · Cited by 43
Kobiella, A., Ripke, S., Kroemer, N. B., Vollmert, C., Vollstädt‐Klein, S., Ulshöfer, D. E., & Smolka, M. N. (2013) · Addiction Biology · doi:10.1111/adb.12057 · Cited by 41
Stea, J. N., Hodgins, D. C., & Lambert, M. J. (2011) · Behavioural Processes · doi:10.1016/j.beproc.2011.09.002 · Cited by 39
Your Money or Your Health: Time Preferences and Trading Money for Health
Chapman, G. B. (2002) · Medical Decision Making · doi:10.1177/027298902236929 · Cited by 39
Delay discounting predicts increase in blood alcohol level in social drinkers
Moore, S., & Cusens, B. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2008.07.024 · Cited by 37
Behavioral considerations suggest an average reward TD model of the dopamine system
Daw, N. D., & Touretzky, D. S. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00232-0 · Cited by 35
Heinz, A. J., Peters, E. N., Boden, M. T., & Bonn‐Miller, M. O. (2013) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0031192 · Cited by 35
Hyperbolically Discounted Temporal Difference Learning
Alexander, W. H., & Brown, J. W. (2010) · Neural Computation · doi:10.1162/neco.2010.08-09-1080 · Cited by 34
Model-Based Reinforcement Learning as Cognitive Search: Neurocomputational Theories
Todd, P. M., Hills, T. T., & Robbins, T. W. (2012) · Cited by 34
Discounting of delayed rewards and executive dysfunction in individuals infected with hepatitis C
Huckans, M. S., Seelye, A. M., Woodhouse, J., Parcel, T., Mull, L. J., Schwartz, D., Mitchell, A., Lahna, D. L., Johnson, A., Loftis, J. M., et al. (2010) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2010.499355 · Cited by 32
A Reinforcement Learning Model of Precommitment in Decision Making
Kurth-Nelson, Z. L., & Redish, A. D. (2010) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2010.00184 · Cited by 32
Alcohol consumption and discounting
Rossow, I. M. (2008) · Addiction Research & Theory · doi:10.1080/16066350801896248 · Cited by 31
Yankelevitz, R. L., Mitchell, S. H., & Zhang, Y. (2011) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2011.11.012 · Cited by 29
Descriptive validity of alternative intertemporal models for health outcomes: an axiomatic test
Pol, M. M. V. D., & Cairns, J. (2010) · Health Economics · doi:10.1002/hec.1628 · Cited by 29
Asenso‐Boadi, F., Peters, T. J., & Coast, J. (2007) · Health Economics · doi:10.1002/hec.1256 · Cited by 24
Andrade, L. F., Alessi, S. M., & Petry, N. M. (2013) · Journal of Psychoactive Drugs · doi:10.1080/02791072.2013.803645 · Cited by 15
Delay-discounting among homeless, out-of-treatment, substance-dependent men who have sex with men
Dierst-Davies, R., Reback, C. J., Peck, J. A., Nuno, M. A., Kamien, J. B., & Amass, L. (2010) · The American Journal of Drug and Alcohol Abuse · doi:10.3109/00952990.2010.540278 · Cited by 13
Brown, H., & Adams, J. M. (2012) · Addiction · doi:10.1111/j.1360-0443.2012.03997.x · Cited by 10
Melanko, S., & Larkin, K. T. (2015) · Journal of Behavioral Medicine · doi:10.1007/s10865-015-9621-x · Cited by 10
Kulendran, M., Vlaev, I., Sugden, C., King, D., Hussein, M., Vay, R. L., Gately, P., & Darzi, A. W. (2013) · The Lancet · doi:10.1016/s0140-6736(13)62480-0 · Cited by 6
Self-citationKeramati, M., Dezfouli, A., & Piray, P. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0751-5_8 · Cited by 5
Cited by
NOW vs LATER brain circuits: implications for obesity and addiction
Volkow, N. D., & Baler, R. D. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.04.002 · Cited by 237
Kable, J. W., Caulfield, M. K., Falcone, M., McConnell, M., Bernardo, L., Parthasarathi, T., Cooper, N., Ashare, R., Audrain-McGovern, J., Hornik, R., et al. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.2832-16.2017 · Cited by 124
Health-promoting lifestyle and quality of life among Chinese nursing students
Mak, Y. W., Kao, A. H. F., Tam, L. W. Y., Tse, V. W. C., Tse, D. T. H., & Leung, D. Y. P. (2018) · Primary Health Care Research & Development · doi:10.1017/s1463423618000208 · Cited by 120
The influence of episodic foresight on delay discounting and demand for alcohol
Bulley, A., & Gullo, M. J. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2016.11.003 · Cited by 95
News from the NIH: using an experimental medicine approach to facilitate translational research
Science of Behavior Change Working Group, & Riddle, M. (2015) · Translational Behavioral Medicine · doi:10.1007/s13142-015-0333-0 · Cited by 79
Metadata
- Authors
- Story, G. W., Vlaev, I., Seymour, B., Darzi, A., & Dolan, R. J.
- Venue
- Frontiers in Behavioral Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2014-03-12
- Volume
- 8
- Pages
- 76-76
- ISSN
- 1662-5153 (ISSN-L)
- OpenAlex
- W2168922309
- Cited by
- 286
- References
- 235
- FWCI
- 1.66
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.