Serotonin and the Evaluation of Future Rewards: Theory, Experiments, and Possible Neural Mechanisms
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
The ability to select an action by considering both delays and amount of reward outcome is critical for survival and well‐being of animals and humans. Previous animal experiments suggest a role of serotonin in action choice by modulating the evaluation of delayed rewards. It remains unclear, however, through which neural circuits, and through what receptors and intracellular mechanisms, serotonin affects the evaluation of delayed rewards. Here, we review experimental studies and computational theory of decisions under delayed rewards, and propose that serotonin controls the timescale of reward prediction by regulating neural activity in the basal ganglia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emotion, Decision Making and the Orbitofrontal Cortex
Bechara, A. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.295 · Cited by 3,589
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708
An economic theory of self-control.
Thaler, R. H., & Shefrin, H. M. (1981) · Journal of Political Economy · doi:10.1086/260971 · Cited by 2,203
Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls.
Kirby, K. N., Petry, N. M., & Bickel, W. K. (1999) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.128.1.78 · Cited by 2,171
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Evenden, J. L. (1999) · Psychopharmacology · doi:10.1007/pl00005481 · Cited by 2,044
Basal ganglia and cerebellar loops: motor and cognitive circuits
Middleton, F. (2000) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00040-5 · Cited by 1,940
The Orbitofrontal Cortex and Reward
Rolls, E. T. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.284 · Cited by 1,595
Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers
Bickel, W. K., Odum, A. L., & Madden, G. J. (1999) · Psychopharmacology · doi:10.1007/pl00005490 · Cited by 1,433
SUBJECTIVE PROBABILITY AND DELAY
Rachlin, H., Raineri, A., & Cross, D. (1991) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1991.55-233 · Cited by 1,341
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964
Self-citationRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
Self-citationImpulsive choice induced in rats by lesions of the nucleus accumbens core
Cardinal, R. N., Pennicott, D. R., Lakmali, C., Sugathapala, Robbins, T. W., & Everitt, B. J. (2001) · Science · doi:10.1126/science.1060818 · Cited by 923
Madden, G. J., Petry, N. M., Badger, G. J., & Bickel, W. K. (1997) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.5.3.256 · Cited by 911
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Parallel neural networks for learning sequential procedures
Hikosaka, O., Nakahara, H., Rand, M. K., Sakai, K., Lu, X., Nakamura, K., Miyachi, S., & Doya, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(99)01439-3 · Cited by 799
Self-citationPrediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779
Self-citationMetalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Self-citationResearch and treatment approaches to depression
Wong, M.-L., & Licinio, J. (2001) · Nature Reviews Neuroscience · doi:10.1038/35072566 · Cited by 656
Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals.
Coffey, S. F., Gudleski, G. D., Saladin, M. E., & Brady, K. T. (2003) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.11.1.18 · Cited by 625
Hyperbolic temporal discounting in social drinkers and problem drinkers.
Vuchinich, R. E., & Simpson, C. A. (1998) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.6.3.292 · Cited by 624
Arousal systems and attentional processes
Robbins, T. W. (1997) · Biological Psychology · doi:10.1016/s0301-0511(96)05222-2 · Cited by 430
Autoradiographic distribution of serotonin transporters and receptor subtypes in human brain.
Varnäs, K., Halldin, C., & Hall, H. (2004) · Human Brain Mapping · doi:10.1002/hbm.20035 · Cited by 332
Meta-learning in Reinforcement Learning
Schweighofer, N., & Doya, K. (2003) · Neural Networks · doi:10.1016/s0893-6080(02)00228-9 · Cited by 261
Self-citation
Cited by
New insights into symptoms and neurocircuit function of anorexia nervosa
Kaye, W. H., Fudge, J. L., & Paulus, M. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2682 · Cited by 843
“From another perspective, studies suggest that 5-HT has a role in action choice by controlling the timescale of delayed rewards through differential effects on ventral and dorsal striatal circuits 93,94 .”
Nothing tastes as good as skinny feels: the neurobiology of anorexia nervosa
Kaye, W. H., Wierenga, C. E., Bailer, U. F., Simmons, A. N., & Bischoff-Grethe, A. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2013.01.003 · Cited by 525
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Serotonin, inhibition, and negative mood
Dayan, P., & Huys, Q. J. M. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040004 · Cited by 263
Overlapping neural systems represent cognitive effort and reward anticipation
Vassena, E., Silvetti, M., Boehler, C. N., Achten, E., Fias, W., & Verguts, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091008 · Cited by 200
Metadata
- Authors
- SCHWEIGHOFER, N., TANAKA, S. C., & DOYA, K.
- Venue
- Annals of the New York Academy of Sciences
- Publisher
- Wiley
- Published
- 2007-05
- Volume
- 1104
- Issue
- 1
- Pages
- 289-300
- ISSN
- 0077-8923 (ISSN-L)
- 1749-6632
- OpenAlex
- W1785688437
- Cited by
- 61
- References
- 27
- FWCI
- 2.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.