Serotonin Selectively Modulates Reward Value in Human Decision-Making
Open accessAbstract
Establishing a function for the neuromodulator serotonin in human decision-making has proved remarkably difficult because if its complex role in reward and punishment processing. In a novel choice task where actions led concurrently and independently to the stochastic delivery of both money and pain, we studied the impact of decreased brain serotonin induced by acute dietary tryptophan depletion. Depletion selectively impaired both behavioral and neural representations of reward outcome value, and hence the effective exchange rate by which rewards and punishments were compared. This effect was computationally and anatomically distinct from a separate effect on increasing outcome-independent choice perseveration. Our results provide evidence for a surprising role for serotonin in reward processing, while illustrating its complex and multifarious effects.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ATD has been shown to affect measures of both 'cold' and 'hot' cognition.
“ATD has been shown to affect measures of both ‘cold’ (rational and non-emotional), and ‘hot’ (social and emotional) cognition [13–18].”
From Chronic escitalopram in healthy volunteers has specific effects on reinforcement sensitivity: a double-blind, placebo-controlled semi-randomised study (2023) · cites this paper as [13]
The Results (page unavailable) report that acute tryptophan depletion changed reward sensitivity and choice perseveration in a task involving money and painful shocks. The paper does not establish effects on both non-emotional (‘cold’) and social or emotional (‘hot’) cognition as distinct categories of measures. (LLM, conf=0.82)
Experimental — accuracy not yet measuredEffects of ATD have been seen on reinforcement behaviour, reversal learning, learning and memory, affective and social cognition, and moral judgement.
“Effects of ATD have also been seen on reinforcement behaviour [13], reversal learning [9, 14], learning and memory [15], affective and social cognition [9, 16, 17] and moral judgement [18].”
From Chronic escitalopram in healthy volunteers has specific effects on reinforcement sensitivity: a double-blind, placebo-controlled semi-randomised study (2023) · cites this paper as [13]
A previous study showed that acute tryptophan depletion decreased reinforcement sensitivity, by impairing the representation of reward outcome value.
“A previous study examining how reinforcement is influenced by serotonergic modulation showed that acute tryptophan depletion decreased reinforcement sensitivity, by impairing the representation of reward outcome value [13].”
From Chronic escitalopram in healthy volunteers has specific effects on reinforcement sensitivity: a double-blind, placebo-controlled semi-randomised study (2023) · cites this paper as [13]
Three decision-making studies that involved avoiding pain or shock examined prediction errors to successful and unsuccessful avoidance, and two found evidence for striatal prediction errors to successful avoidance of shock.
“However, three decision-making studies (Seymour et al., 2012; Roy et al., 2014; Eldar et al., 2016) that involved avoiding pain or shock examined prediction errors to successful and unsuccessful avoidance, and two found evidence for striatal prediction errors to successful avoidance of shock.”
From Active avoidance: Neural mechanisms and attenuation of pavlovian conditioned responding (2017) · cites this paper as Seymour et al., 2012
The vmPFC, rather than regions included in the NPS, correlates with spontaneous, clinical pain, and encodes the learned, behavioral avoidance value associated with painful stimulation.
“The vmPFC, rather than regions included in the NPS, correlates with spontaneous, clinical pain [52], and encodes the learned, behavioral avoidance value associated with painful stimulation [85],[86].”
From Distinct Brain Systems Mediate the Effects of Nociceptive Input and Self-Regulation on Pain (2015) · cites this paper as [85]
Ventromedial prefrontal cortex activity reflects expected positive value across contexts including reward learning, economic choice, pain avoidance, and extinction/extinction recall.
“By contrast, vmPFC activity seems to reflect expected positive value in a variety of contexts and paradigms45, including reward learning, economic choice46, pain avoidance11, and extinction/extinction recall47.”
From Representation of aversive prediction errors in the human periaqueductal gray (2014) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Self-citationCortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works
Self-citationDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Self-citationThe use of analogue scales in rating subjective feelings
BOND, A., & LADER, M. (1974) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1974.tb02285.x · Cited by 1,972 · see citing works
Mowrer, O. H. (1960) · doi:10.1037/10802-000 · Cited by 1,670 · see citing works
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · see citing works
Self-citationGonzalez, R. C., & Mowrer, O. H. (1962) · The American Journal of Psychology · doi:10.2307/1419634 · Cited by 1,584 · see citing works
Conditioning and Associative Learning
Hill, W. F., & Mackintosh, N. J. (1984) · The American Journal of Psychology · doi:10.2307/1422540 · Cited by 1,323 · see citing works
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Brain Serotonin Content: Physiological Regulation by Plasma Neutral Amino Acids
Fernstrom, J. D., & Wurtman, R. J. (1972) · Science · doi:10.1126/science.178.4059.414 · Cited by 1,166 · see citing works
5-HT and mechanisms of defence
Deakin, J. F. W., & Graeff, F. G. (1991) · Journal of Psychopharmacology · doi:10.1177/026988119100500414 · Cited by 1,011 · see citing works
Reconciling the role of central serotonin neurons in human and animal behavior
Soubrié, P. (1986) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00022871 · Cited by 993 · see citing works
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844 · see citing works
Self-citationPeters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738 · see citing works
Adaptation as Information Restriction: The Hot Stove Effect
Denrell, J. C., & March, J. G. (2001) · Organization Science · doi:10.1287/orsc.12.5.523.10092 · Cited by 717 · see citing works
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704 · see citing works
Serotoninergic regulation of emotional and behavioural control processes
Cools, R., Roberts, A. C., & Robbins, T. W. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.10.011 · Cited by 656 · see citing works
Cognitive Inflexibility After Prefrontal Serotonin Depletion
Clarke, H. F., Dalley, J. W., Crofts, H. S., Robbins, T. W., & Roberts, A. C. (2004) · Science · doi:10.1126/science.1094987 · Cited by 632 · see citing works
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · see citing works
Self-citationHarmer, C. J., Goodwin, G. M., & Cowen, P. J. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.051193 · Cited by 542 · see citing works
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O’Doherty, J. P., Hampton, A. N., & Kim, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 509 · see citing works
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485 · see citing works
Serotonin and dopamine: unifying affective, activational, and decision functions.
Cools, R., Nakamura, K., & Daw, N. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.121 · Cited by 464 · see citing works
Self-citationOpponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456 · see citing works
Self-citationDirect Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455 · see citing works
Differential Encoding of Losses and Gains in the Human Striatum
Seymour, B., Daw, N. D., Dayan, P., Singer, T., & Dolan, R. J. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0400-07.2007 · Cited by 455 · see citing works
Self-citationKim, H., Shinsuke Shimojo, A., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 447 · see citing works
Opponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · see citing works
Self-citationPlassmann, H., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0788-10.2010 · Cited by 356 · see citing works
Martín‐Ruiz, R., Puig, M. V., Celada, P., Shapiro, D. A., Roth, B. L., Mengod, G., & Artigas, F. (2001) · Journal of Neuroscience · doi:10.1523/jneurosci.21-24-09856.2001 · Cited by 338 · see citing works
Tryptophan Depletion During Continuous CSF Sampling in Healthy Human Subjects
Carpenter, L. L. (1998) · Neuropsychopharmacology · doi:10.1016/s0893-133x(97)00198-x · Cited by 298 · see citing works
Rogers, R. D., Blackshaw, A. J., Middleton, H. C., Matthews, K., Hawtin, K., Crowley, C., Hopwood, A., Wallace, C., Deakin, J. F. W., Sahakian, B. J., et al. (1999) · Psychopharmacology · doi:10.1007/pl00005494 · Cited by 289 · see citing works
Crockett, M. J., Clark, L., & Robbins, T. W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2513-09.2009 · Cited by 271 · see citing works
Rogers, R. D., Tunbridge, E. M., Bhagwagar, Z., Drevets, W. C., Sahakian, B. J., & Carter, C. S. (2002) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300001 · Cited by 270 · see citing works
Fürst, P., Pollack, L., Graser, T. A., Godel, H. G., & Stehle, P. (1990) · Journal of Chromatography A · doi:10.1016/s0021-9673(00)97000-6 · Cited by 268 · see citing works
Activation of Dorsal Raphe Serotonin Neurons Underlies Waiting for Delayed Rewards
Miyazaki, K., Miyazaki, K. W., & Doya, K. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3714-10.2011 · Cited by 257 · see citing works
Low-Serotonin Levels Increase Delayed Reward Discounting in Humans
Schweighofer, N., Bertin, M., Shishida, K., Okamoto, Y., Tanaka, S., Yamawaki, S., & Doya, K. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.4982-07.2008 · Cited by 255 · see citing works
Rogers, R. D. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.165 · Cited by 248 · see citing works
Pehek, E. A., Nocjar, C., Roth, B., Byrd, T. A., & Mabrouk, O. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300819 · Cited by 212 · see citing works
Evers, E. A. T., Cools, R., Clark, L., van der Veen, F. M., Jolles, J., Sahakian, B. J., & Robbins, T. W. (2005) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300663 · Cited by 208 · see citing works
Delgado, M. R. (2009) · Frontiers in Behavioral Neuroscience · doi:10.3389/neuro.08.033.2009 · Cited by 204 · see citing works
Cools, R., Robinson, O. J., & Sahakian, B. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301598 · Cited by 172 · see citing works
Serotonin control of central dopaminergic function: focus on in vivo microdialysis studies
DIMATTEO, V., Giovanni, G. D., Pierucci, M., & Esposito, E. (2008) · Progress in brain research · doi:10.1016/s0079-6123(08)00902-3 · Cited by 170 · see citing works
STIMULI INEVITABLY GENERATED BY BEHAVIOR THAT AVOIDS ELECTRIC SHOCK ARE INHERENTLY REINFORCING
Dinsmoor, J. A. (2001) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2001.75-311 · Cited by 164 · see citing works
Kocsis, B., Varga, V., Dahan, L., & Attila Gabor, S. I. K. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0508360103 · Cited by 158 · see citing works
Role of serotonin2C receptors in the control of brain dopaminergic function
Matteo, V. D., Cacchio, M., Giulio, C. D., & Esposito, E. (2002) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(01)00705-5 · Cited by 151 · see citing works
Monoamine reuptake inhibitors enhance the discriminative state induced by cocaine in the rat
Cunningham, K. A., & Callahan, P. M. (1991) · Psychopharmacology · doi:10.1007/bf02244175 · Cited by 148 · see citing works
Dopamine, but not serotonin, regulates reversal learning in the marmoset caudate nucleus
Clarke, H. F., Hill, G. J., Robbins, T. W., & Roberts, A. C. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5066-10.2011 · Cited by 144 · see citing works
Coding of Task Reward Value in the Dorsal Raphe Nucleus
Bromberg-Martin, E. S., Hikosaka, O., & Nakamura, K. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0015-10.2010 · Cited by 143 · see citing works
Mechanism of acute tryptophan depletion: is it only serotonin?
van Donkelaar, E. L., Blokland, A., Ferrington, L., Kelly, P. A. T., Steinbusch, H. W. M., & Prickaerts, J. (2011) · Molecular Psychiatry · doi:10.1038/mp.2011.9 · Cited by 127 · see citing works
Vázquez, P. M., Cortés, R., & Artigas, F. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn204 · Cited by 102 · see citing works
Roiser, J. P., Blackwell, A. D., Cools, R., Clark, L., Rubinsztein, D. C., Robbins, T. W., & Sahakian, B. J. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301055 · Cited by 98 · see citing works
Self-citationWalker, S. C., Robbins, T. W., & Roberts, A. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn136 · Cited by 96 · see citing works
Finger, E. C., Marsh, A. A., Buzas, B., Kamel, N., Rhodes, R., Vythilingham, M., Pine, D. S., Goldman, D., & Blair, J. R. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301182 · Cited by 86 · see citing works
Schönberg, T., O’Doherty, J. P., Joel, D., Inzelberg, R., Segev, Y., & Daw, N. D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.011 · Cited by 81 · see citing works
Self-citationConverging evidence for central 5-HT effects in acute tryptophan depletion
Crockett, M. J., Clark, L., Roiser, J. P., Robinson, O. J., Cools, R., Chase, H. W., den Ouden, H. E. M., Apergis-Schoute, A. M., Campbell-Meiklejohn, D. K., Seymour, B., et al. (2011) · Molecular Psychiatry · doi:10.1038/mp.2011.106 · Cited by 71 · see citing works
Self-citationDiscriminative Stimulus Properties of Cocaine: Enhancement by Monoamine Reuptake Blockers
Kleven, M. S., & Koek, W. (1998) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(24)37310-0 · Cited by 67 · see citing works
Serotonin Affects Association of Aversive Outcomes to Past Actions
Tanaka, S., Shishida, K., Schweighofer, N., Okamoto, Y., Yamawaki, S., & Doya, K. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2799-09.2009 · Cited by 61 · see citing works
Converging evidence for central 5-HT effects in acute tryptophan depletion?
Plasse, G. (2012) · Molecular Psychiatry · doi:10.1038/mp.2012.44 · Cited by 52 · see citing works
Simultaneous projections from prefrontal cortex to dopaminergic and serotonergic nuclei
Vázquez, P. M., Celada, P., Cortés, R., & Artigas, F. (2010) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145710000349 · Cited by 46 · see citing works
Robbins, T. W., & Crockett, M. J. (2010) · Handbook of behavioral neuroscience · doi:10.1016/s1569-7339(10)70093-x · Cited by 37 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Serotonin and brain function: a tale of two receptors
Carhart-Harris, R., & Nutt, D. (2017) · Journal of Psychopharmacology · doi:10.1177/0269881117725915 · Cited by 739 · see citing works
Neuroscience of apathy and anhedonia: a transdiagnostic approach
Husain, M., & Roiser, J. P. (2018) · Nature reviews. Neuroscience · doi:10.1038/s41583-018-0029-9 · Cited by 642 · see citing works
Self-citationNeurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634 · see citing works
Circuits and functions of the lateral habenula in health and in disease
Hu, H., Cui, Y., & Yang, Y. (2020) · Nature reviews. Neuroscience · doi:10.1038/s41583-020-0292-4 · Cited by 471 · see citing works
Dorsal raphe neurons signal reward through 5-HT and glutamate
Liu, Z., Zhou, J., Li, Y., Hu, F., Lu, Y., Ma, M., Feng, Q., Zhang, J.-E., Wang, D., Zeng, J., et al. (2014) · Neuron · doi:10.1016/j.neuron.2014.02.010 · Cited by 469 · see citing works
Reward processing by the lateral habenula in normal and depressive behaviors
Proulx, C. D., Hikosaka, O., & Malinow, R. (2014) · Nature Neuroscience · doi:10.1038/nn.3779 · Cited by 461 · see citing works
Reinforcement learning and episodic memory in humans and animals: an integrative framework
Gershman, S. J., & Daw, N. D. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033625 · Cited by 446 · see citing works
Self-citationReduced Reward Learning Predicts Outcome in Major Depressive Disorder
Vrieze, E., Pizzagalli, D. A., Demyttenaere, K., Hompes, T., Sienaert, P. A., de Boer, P., Schmidt, M. E., & Claes, S. J. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.10.014 · Cited by 443 · see citing works
LeDoux, J. E., & Daw, N. D. (2018) · Nature reviews. Neuroscience · doi:10.1038/nrn.2018.22 · Cited by 391 · see citing works
Self-citationReinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362 · see citing works
Martinez, D. L., Brusoni, S., Canessa, N., & Zollo, M. (2013) · Strategic Management Journal · doi:10.1002/smj.2221 · Cited by 351 · see citing works
Beyond happiness: Building a science of discrete positive emotions.
Shiota, M. N., Campos, B., Oveis, C., Hertenstein, M. J., Simon-Thomas, E. R., & Keltner, D. J. (2017) · American Psychologist · doi:10.1037/a0040456 · Cited by 279 · see citing works
Hu, H. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-014106 · Cited by 253 · see citing works
Distinct Brain Systems Mediate the Effects of Nociceptive Input and Self-Regulation on Pain
Woo, C.-W., Roy, M., Buhle, J. T., & Wager, T. D. (2015) · PLoS Biology · doi:10.1371/journal.pbio.1002036 · Cited by 263 · see citing works
Organization of monosynaptic inputs to the serotonin and dopamine neuromodulatory systems
Ogawa, S. K., Cohen, J. Y., Hwang, D., Uchida, N., & Watabe-Uchida, M. (2014) · Cell Reports · doi:10.1016/j.celrep.2014.06.042 · Cited by 249 · see citing works
Representation of aversive prediction errors in the human periaqueductal gray
Roy, M., Shohamy, D., Daw, N., Jepma, M., Wimmer, G. E., & Wager, T. D. (2014) · Nature Neuroscience · doi:10.1038/nn.3832 · Cited by 246 · see citing works
Self-citationNeuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments
Avery, M. C., & Krichmar, J. L. (2017) · Frontiers in Neural Circuits · doi:10.3389/fncir.2017.00108 · Cited by 231 · see citing works
Hauser, T. U., Iannaccone, R., Walitza, S., Brandeis, D., & Brem, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.09.018 · Cited by 203 · see citing works
How Dopamine Enhances an Optimism Bias in Humans
Sharot, T., Guitart‐Masip, M., Korn, C. W., Chowdhury, R., & Dolan, R. J. (2012) · Current Biology · doi:10.1016/j.cub.2012.05.053 · Cited by 216 · see citing works
Self-citationInterplay of approximate planning strategies
Huys, Q. J. M., Lally, N., Faulkner, P., Eshel, N., Seifritz, E., Gershman, S. J., Dayan, P., & Roiser, J. P. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1414219112 · Cited by 207 · see citing works
Self-citationActivation of Dorsal Raphe Serotonergic Neurons Promotes Waiting but Is Not Reinforcing
Fonseca, M. S., Murakami, M., & Mainen, Z. F. (2015) · Current Biology · doi:10.1016/j.cub.2014.12.002 · Cited by 210 · see citing works
Pain, decisions, and actions: a motivational perspective
Wiech, K., & Tracey, I. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00046 · Cited by 188 · see citing works
An Update on the Role of Serotonin and its Interplay with Dopamine for Reward
Fischer, A. G., & Ullsperger, M. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00484 · Cited by 176 · see citing works
Altered learning under uncertainty in unmedicated mood and anxiety disorders
Aylward, J., Valton, V., Ahn, W., Bond, R. L., Dayan, P., Roiser, J. P., & Robinson, O. J. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0628-0 · Cited by 164 · see citing works
Self-citationModulating the Neuromodulators: Dopamine, Serotonin, and the Endocannabinoid System
Peters, K. Z., Cheer, J. F., & Tonini, R. (2021) · Trends in Neurosciences · doi:10.1016/j.tins.2021.02.001 · Cited by 171 · see citing works
Pain: A Precision Signal for Reinforcement Learning and Control
Seymour, B. (2019) · Neuron · doi:10.1016/j.neuron.2019.01.055 · Cited by 167 · see citing works
Self-citationSerotonin neurons modulate learning rate through uncertainty
Grossman, C. D., Bari, B. A., & Cohen, J. Y. (2022) · Current Biology · doi:10.1016/j.cub.2021.12.006 · Cited by 164 · see citing works
Wang, S., Leri, F., & Rizvi, S. J. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2021.110289 · Cited by 164 · see citing works
Chen, C., & Nakagawa, S. (2023) · Ageing Research Reviews · doi:10.1016/j.arr.2023.101868 · Cited by 156 · see citing works
Baliki, M. N., Mansour, A. R., Baria, A. T., Huang, L., Berger, S., Fields, H. L., & Apkarian, A. V. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1731-13.2013 · Cited by 146 · see citing works
Separate mesocortical and mesolimbic pathways encode effort and reward learning signals
Hauser, T. U., Eldar, E., & Dolan, R. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705643114 · Cited by 135 · see citing works
Self-citationActive avoidance: Neural mechanisms and attenuation of pavlovian conditioned responding
Boeke, E. A., Moscarello, J. M., LeDoux, J. E., Phelps, E. A., & Hartley, C. A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.3261-16.2017 · Cited by 131 · see citing works
“However, three decision-making studies (Seymour et al., 2012; Roy et al., 2014; Eldar et al., 2016) that involved avoiding pain or shock examined prediction errors to successful and unsuccessful avoidance, and two found evidence for striatal prediction errors to successful avoidance of shock.”
BackgroundSerotonin Modulates Striatal Responses to Fairness and Retaliation in Humans
Crockett, M. J., Apergis-Schoute, A., Herrmann, B., Lieberman, M. D., Müller, U., Robbins, T. W., & Clark, L. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2761-12.2013 · Cited by 134 · see citing works
Worbe, Y., Savulich, G., Voon, V., Fernandez-Egea, E., & Robbins, T. W. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2013.351 · Cited by 125 · see citing works
Iigaya, K., Fonseca, M. S., Murakami, M., Mainen, Z. F., & Dayan, P. (2018) · Nature Communications · doi:10.1038/s41467-018-04840-2 · Cited by 120 · see citing works
Self-citationReward processing by the dorsal raphe nucleus: 5-HT and beyondPreprint
Luo, M., Zhou, J., & Liu, Z. (2015) · Learning & Memory · doi:10.1101/lm.037317.114 · Cited by 117 · see citing works
Pelloux, Y., Dilleen, R., Economidou, D., Theobald, D. E. H., & Everitt, B. J. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.111 · Cited by 112 · see citing works
Kanen, J. W., Ersche, K. D., Fineberg, N. A., Robbins, T. W., & Cardinal, R. N. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05325-w · Cited by 101 · see citing works
Guitart‐Masip, M., Economides, M., Huys, Q. J. M., Frank, M. J., Chowdhury, R., Düzel, E., Dayan, P., & Dolan, R. J. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3313-4 · Cited by 107 · see citing works
Self-citationReinforcement learning and human behavior
Shteingart, H., & Loewenstein, Y. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.12.004 · Cited by 107 · see citing works
Serotonin regulation of behavior via large-scale neuromodulation of serotonin receptor networks
Salvan, P., Fonseca, M., Winkler, A. M., Beauchamp, A., Lerch, J. P., & Johansen-Berg, H. (2023) · Nature Neuroscience · doi:10.1038/s41593-022-01213-3 · Cited by 101 · see citing works
How serotonin shapes moral judgment and behavior
Siegel, J. Z., & Crockett, M. J. (2013) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12229 · Cited by 98 · see citing works
Origin of perseveration in the trade-off between reward and complexity
Gershman, S. J. (2020) · Cognition · doi:10.1016/j.cognition.2020.104394 · Cited by 97 · see citing works
Rygula, R., Clarke, H. F., Cardinal, R. N., Cockcroft, G. J., Xia, J., Dalley, J. W., Robbins, T. W., & Roberts, A. C. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu102 · Cited by 85 · see citing works
Hauser, T. U., Iannaccone, R., Dolan, R. J., Ball, J., Hättenschwiler, J., Drechsler, R., Rufer, M., Brandeis, D., Walitza, S., & Brem, S. (2017) · Psychological Medicine · doi:10.1017/s0033291716003305 · Cited by 86 · see citing works
Self-citationThe statistical structures of reinforcement learning with asymmetric value updates
Katahira, K. (2018) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2018.09.002 · Cited by 85 · see citing works
Value Learning through Reinforcement
Daw, N. D., & Tobler, P. N. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00015-2 · Cited by 96 · see citing works
Self-citationKatahira, K. (2015) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.03.006 · Cited by 84 · see citing works
Ottenhof, K., Sild, M., Lévesque, M. L., Ruhé, H. G., & Booij, L. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.05.018 · Cited by 81 · see citing works
Dissecting the functional organization of the C. elegans serotonergic system at whole-brain scale
Dag, U., Nwabudike, I., Kang, D., Gomes, M. A., Kim, J. S., Atanas, A. A., Bueno, E., Estrem, C., Pugliese, S. M., Wang, Z., et al. (2023) · Cell · doi:10.1016/j.cell.2023.04.023 · Cited by 93 · see citing works
Striatal structure and function predict individual biases in learning to avoid pain
Eldar, E., Hauser, T. U., Dayan, P., & Dolan, R. J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1519829113 · Cited by 79 · see citing works
Self-citationFaulkner, P., & Deakin, J. F. W. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.07.024 · Cited by 73 · see citing works
Serotonin and Aversive Pavlovian Control of Instrumental Behavior in Humans
Geurts, D. E. M., Huys, Q. J. M., den Ouden, H. E. M., & Cools, R. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.2749-13.2013 · Cited by 78 · see citing works
Valence-dependent influence of serotonin depletion on model-based choice strategy
Worbe, Y., Palminteri, S., Savulich, G., Daw, N. D., Fernandez-Egea, E., Robbins, T. W., & Voon, V (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.46 · Cited by 75 · see citing works
Self-citationGenetic factors in exercise adoption, adherence and obesity
Herring, M. P., Sailors, M. H., & Bray, M. S. (2013) · Obesity Reviews · doi:10.1111/obr.12089 · Cited by 71 · see citing works
Prakash, N., Stark, C. J., Keisler, M. N., Luo, L., Der‐Avakian, A., & Dulcis, D. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.1802-19.2019 · Cited by 70 · see citing works
Tryptophan Depletion Promotes Habitual over Goal-Directed Control of Appetitive Responding in Humans
Worbe, Y., Savulich, G., de Wit, S., Fernandez-Egea, E., & Robbins, T. W. (2015) · International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyv013 · Cited by 64 · see citing works
Roberts, C., Sahakian, B. J., & Robbins, T. W. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.09.001 · Cited by 61 · see citing works
Opponent Brain Systems for Reward and Punishment Learning
Palminteri, S., & Pessiglione, M. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00023-3 · Cited by 63 · see citing works
Modular deep reinforcement learning from reward and punishment for robot navigation
Wang, J., Elfwing, S., & Uchibe, E. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.12.001 · Cited by 62 · see citing works
Langley, C., Armand, S., Luo, Q., Savulich, G., Segerberg, T., Søndergaard, A., Pedersen, E. B., Svart, N., Overgaard-Hansen, O., Johansen, A., et al. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-022-01523-x · Cited by 58 · see citing works
Hierarchical models of pain: Inference, information-seeking, and adaptive control.
Seymour, B., & Mancini, F. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117212 · Cited by 61 · see citing works
Self-citationMolle, R. D., Fatemi, H., Dagher, A., Levitan, R. D., Silveira, P. P., & Dubé, L. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.12.028 · Cited by 61 · see citing works
Dose-response effects of d-amphetamine on effort-based decision-making and reinforcement learning
Soder, H. E., Cooper, J. A., Lopez-Gamundi, P., Hoots, J. K., Nunez, C., Lawlor, V. M., Lane, S. D., Treadway, M. T., & Wardle, M. C. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-020-0779-8 · Cited by 61 · see citing works
Unifying treatments for depression: an application of the free energy principle
Chekroud, A. M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00153 · Cited by 55 · see citing works
Neuroscience: Waiting for Serotonin
Ranade, S., Pi, H.-J., & Kepecs, Á. (2014) · Current Biology · doi:10.1016/j.cub.2014.07.024 · Cited by 59 · see citing works
Relative Valuation of Pain in Human Orbitofrontal Cortex
Winston, J. S., Vlaev, I., Seymour, B., Nick Chater, A., & Dolan, R. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.1706-14.2014 · Cited by 58 · see citing works
Self-citationThe origins of ‘5-HT and mechanisms of defence’ by Deakin and Graeff: A personal perspective
Deakin, J. F. W. (2013) · Journal of Psychopharmacology · doi:10.1177/0269881113503508 · Cited by 59 · see citing works
Scholl, J., Kolling, N., Nelissen, N., Browning, M., Rushworth, M. F. S., & Harmer, C. J. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000756 · Cited by 58 · see citing works
Bayesian Learning Models of Pain: A Call to Action
Tabor, A., & Burr, C. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.10.006 · Cited by 57 · see citing works
Clarke, H. F., Cardinal, R. N., Rygula, R., Hong, Y. T., Fryer, T. D., Sawiak, S. J., Ferrari, V., Cockcroft, G., Aigbirhio, F. I., Robbins, T. W., et al. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0718-14.2014 · Cited by 54 · see citing works
Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies
Macoveanu, J. (2014) · Brain Research · doi:10.1016/j.brainres.2014.02.003 · Cited by 55 · see citing works
Value generalization in human avoidance learning
Norbury, A., Robbins, T. W., & Seymour, B. (2018) · eLife · doi:10.7554/elife.34779 · Cited by 54 · see citing works
Self-citationMyers, C. E., Moustafa, A. A., Sheynin, J., VanMeenen, K. M., Gilbertson, M. W., Orr, S. P., Beck, K. D., Pang, K. C. H., & Servatius, R. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072508 · Cited by 55 · see citing works
Aversive Motivation and Cognitive ControlPreprint
Yee, D. M., Leng, X., Shenhav, A., & Braver, T. S. (2021) · Neuroscience and Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.12.016 · Cited by 57 · see citing works
Model-free and model-based reward prediction errors in EEG
Sambrook, T. D., Hardwick, B., Wills, A. J., & Goslin, J. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.05.023 · Cited by 51 · see citing works
A neurobiological perspective on social influence: Serotonin and social adaptation
Duerler, P., Vollenweider, F. X., & Preller, K. H. (2022) · Journal of Neurochemistry · doi:10.1111/jnc.15607 · Cited by 50 · see citing works
Transdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty
Sandhu, T. R., Xiao, B., & Lawson, R. P. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105123 · Cited by 51 · see citing works
Pain: A Distributed Brain Information Network?
Mano, H., & Seymour, B. (2015) · PLoS Biology · doi:10.1371/journal.pbio.1002037 · Cited by 66 · see citing works
Self-citationBayer, J., Bandurski, P., & Sommer, T. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12347 · Cited by 50 · see citing works
Serotonergic regulation of the dopaminergic system: Implications for reward-related functions
Courtiol, E., Menezes, E. D. C., & Teixeira, C. M. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.022 · Cited by 47 · see citing works
Löffler, M., Levine, S. M., Usai, K., Desch, S., Mišić, M., Nees, F., & Flor, H. (2022) · Cell Reports Medicine · doi:10.1016/j.xcrm.2022.100677 · Cited by 45 · see citing works
Grünblatt, E., Hauser, T. U., & Walitza, S. (2014) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2014.07.003 · Cited by 44 · see citing works
Harm to self outweighs benefit to others in moral decision making
Volz, L. J., Welborn, B. L., Gobel, M. S., Gazzaniga, M. S., & Grafton, S. T. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706693114 · Cited by 46 · see citing works
Stoltenberg, S. F., Christ, C. C., & Carlo, G. (2013) · Social Neuroscience · doi:10.1080/17470919.2013.807874 · Cited by 43 · see citing works
Boecker-Schlier, R., Holz, N. E., Buchmann, A. F., Blomeyer, D., Plichta, M. M., Jennen-Steinmetz, C., Wolf, I., Baumeister, S., Treutlein, J., Rietschel, M., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.006 · Cited by 42 · see citing works
Apathy and Motivation: Biological Basis and Drug Treatment
Costello, H., Masud Husain, B., & Roiser, J. P. (2023) · The Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-022423-014645 · Cited by 46 · see citing works
Self-citationThe Role of Tryptophan and Tyrosine in Executive Function and Reward Processing
Aquili, L. (2020) · International Journal of Tryptophan Research · doi:10.1177/1178646920964825 · Cited by 43 · see citing works
The Influence of Serotonin on Fear Learning
Attar, C. H., Finckh, B., & Büchel, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042397 · Cited by 42 · see citing works
Qu, C., Météreau, É., Butera, L., Villeval, M. C., & Dreher, J. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000283 · Cited by 40 · see citing works
The Misbehavior of Reinforcement Learning
Mongillo, G., Shteingart, H., & Loewenstein, Y. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2307022 · Cited by 42 · see citing works
Basal ganglia lateralization in different types of reward
Arsalidou, M., Vijayarajah, S., & Sharaev, M. (2020) · Brain Imaging and Behavior · doi:10.1007/s11682-019-00215-3 · Cited by 42 · see citing works
Serotonin and aversive processing in affective and social decision-making
Crockett, M. J., & Cools, R. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.08.005 · Cited by 40 · see citing works
The Effect of Motivation on Movement: A Study of Bradykinesia in Parkinson’s Disease
Shiner, T., Seymour, B., Symmonds, M., Dayan, P., Bhatia, K. P., & Dolan, R. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047138 · Cited by 40 · see citing works
Self-citationCorrêa, C. M. C., Noorman, S., Jiang, J., Palminteri, S., Cohen, M. X., Lebreton, M. P., & van Gaal, S. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.0457-18.2018 · Cited by 40 · see citing works
Opinion on monoaminergic contributions to traits and temperament
Robbins, T. W. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0153 · Cited by 38 · see citing works
Neural systems for choice and valuation with counterfactual learning signals
Tobia, M. J., Guo, R., Schwarze, U., Böhmer, W., Gläscher, J. P., Finckh, B., Marschner, A., Büchel, C., Obermayer, K., & Sommer, T. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.051 · Cited by 35 · see citing works
Elfwing, S., & Seymour, B. (2017) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2017.8329799 · Cited by 37 · see citing works
Self-citationReliability of Decision-Making and Reinforcement Learning Computational Parameters
Mkrtchian, A., Valton, V., & Roiser, J. P. (2023) · Computational Psychiatry · doi:10.5334/cpsy.86 · Cited by 41 · see citing works
Self-citation
- Authors
- Seymour, B., Daw, N. D., Roiser, J. P., Dayan, P., & Dolan, R.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- Gatsby Computational Neuroscience Unit (GB)
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2012-04-25
- Volume
- 32
- Issue
- 17
- Pages
- 5833-5842
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- PMC
- PMC5321452
- OpenAlex
- W2083058253
- Cited by
- 252
- References
- 61
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 20 · 2023: 25 · 2022: 15 · 2021: 17 · 2020: 19 · 2019: 13 · 2018: 20 · 2017: 17 · 2016: 17 · 2015: 17 · 2014: 22 · 2013: 19 · 2012: 7
- FWCI
- 8.57
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Neuroscience (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Wellcome Trust (091593, 079866)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- serotonin, decision-making, reward value, tryptophan depletion, monetary rewards, pain, punishment, reward processing, computational modeling of choice
- MeSH terms
- Brain, Brain Mapping, Conditioning, Operant, Decision Making, Double-Blind Method, Electric Stimulation, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Oxygen, Pain, Pain Measurement, Probability, Punishment, Surveys and Questionnaires, Reward, Serotonin, Statistics as Topic, Tryptophan, Dietary Supplements
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
