The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Mesolimbic dopamine signals the value of work
Open accessAbstract
Dopamine cell firing can encode errors in reward prediction, providing a learning signal to guide future behavior. Yet dopamine is also a key modulator of motivation, invigorating current behavior. Existing theories propose that fast (phasic) dopamine fluctuations support learning, whereas much slower (tonic) dopamine changes are involved in motivation. We examined dopamine release in the nucleus accumbens across multiple time scales, using complementary microdialysis and voltammetric methods during adaptive decision-making. We found that minute-by-minute dopamine levels covaried with reward rate and motivational vigor. Second-by-second dopamine release encoded an estimate of temporally discounted future reward (a value function). Changing dopamine immediately altered willingness to work and reinforced preceding action choices by encoding temporal-difference reward prediction errors. Our results indicate that dopamine conveys a single, rapidly evolving decision variable, the available reward for investment of effort, which is employed for both learning and motivational functions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 1×
“Firing rates of presumed dopamine cells have been previously reported to escalate within trials under some conditions 47 , but this has not been typically reported with reward anticipation.”
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030
Cited by
The dopamine motive system: implications for drug and food addiction
Volkow, N. D., Wise, R. A., & Baler, R. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2017.130 · Cited by 939
Berke, J. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0152-y · Cited by 904
Self-citationThe Neuroscience of Drug Reward and Addiction
Volkow, N. D., Michaelides, M., & Baler, R. (2019) · Physiological Reviews · doi:10.1152/physrev.00014.2018 · Cited by 863
Dissociable dopamine dynamics for learning and motivation
Mohebi, A., Pettibone, J. R., Hamid, A. A., Wong, J.-M. T., Vinson, L. T., Patriarchi, T., Tian, L., Kennedy, R. T., & Berke, J. D. (2019) · Nature · doi:10.1038/s41586-019-1235-y · Cited by 735
Self-citationNeuroscience of apathy and anhedonia: a transdiagnostic approach
Husain, M., & Roiser, J. P. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0029-9 · Cited by 640
Rapid signalling in distinct dopaminergic axons during locomotion and reward
Howe, M. W., & Dombeck, D. A. (2016) · Nature · doi:10.1038/nature18942 · Cited by 602
Striatal circuits for reward learning and decision-making
Cox, J., & Witten, I. B. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0189-2 · Cited by 568
Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons
Engelhard, B., Finkelstein, J., Cox, J., Fleming, W., Jang, H. J., Ornelas, S., Koay, S. A., Thiberge, S. Y., Daw, N. D., Tank, D. W., et al. (2019) · Nature · doi:10.1038/s41586-019-1261-9 · Cited by 544
The Role of Variability in Motor Learning
Dhawale, A. K., Smith, M. A., & Ölveczky, B. P. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031548 · Cited by 516
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437
Inflammation Effects on Motivation and Motor Activity: Role of Dopamine
Felger, J. C., & Treadway, M. T. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2016.143 · Cited by 442
How Power Affects People: Activating, Wanting, and Goal Seeking
Guinote, A. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044153 · Cited by 419
Dopamine: The Neuromodulator of Long-Term Synaptic Plasticity, Reward and Movement Control
Speranza, L., di Porzio, U., Viggiano, D., de Donato, A., & Volpicelli, F. (2021) · Cells · doi:10.3390/cells10040735 · Cited by 415
Yang, H., de Jong, J. W., Tak, Y., Peck, J., Bateup, H. S., & Lammel, S. (2018) · Neuron · doi:10.1016/j.neuron.2017.12.022 · Cited by 407
“…which comprise the mesolimbic DA system (Björklund and Dunnett, 2007; Ikemoto, 2007; Morales and Margolis, 2017), play an important role in motivated behaviors, reinforcement learning, and reward processing (Hamid et al., 2016; Salamone and Correa, 2012; Schultz, 2016; Watabe-Uchida et al., 2017).”
Wise, R. A., & Robble, M. A. (2020) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-103337 · Cited by 404
Nieh, E. H., Vander Weele, C. M., Matthews, G. A., Presbrey, K. N., Wichmann, R., Leppla, C. A., Izadmehr, E. M., & Tye, K. M. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.035 · Cited by 387
The anatomy of apathy: a neurocognitive framework for amotivated behaviour
Le Heron, C., Apps., M. A. J., & Husain, M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.07.003 · Cited by 380
Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties
Saunders, B. T., Richard, J. M., Margolis, E. B., & Janak, P. H. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0191-4 · Cited by 374
Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target
Parker, N. F., Cameron, C. M., Taliaferro, J. P., Lee, J., Choi, J. Y., Davidson, T. J., Daw, N. D., & Witten, I. B. (2016) · Nature Neuroscience · doi:10.1038/nn.4287 · Cited by 355
Salamone, J. D., Yohn, S. E., López-Cruz, L., San Miguel, N., & Correa, M. (2016) · Brain · doi:10.1093/brain/aww050 · Cited by 350
An integrative perspective on the role of dopamine in schizophrenia
Maia, T. V., & Frank, M. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.05.021 · Cited by 293
A Unified Framework for Dopamine Signals across Timescales
Kim, H. R., Malik, A. N., Mikhael, J. G., Bech, P., Tsutsui-Kimura, I., Sun, F., Zhang, Y., Li, Y., Watabe-Uchida, M., Gershman, S. J., et al. (2020) · Cell · doi:10.1016/j.cell.2020.11.013 · Cited by 302
Castro, D. C., & Bruchas, M. R. (2019) · Neuron · doi:10.1016/j.neuron.2019.03.003 · Cited by 290
What, If, and When to Move: Basal Ganglia Circuits and Self-Paced Action Initiation
Klaus, A., Alves da Silva, J., & Costa, R. M. (2019) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031033 · Cited by 284
Reinforcement learning in artificial and biological systems
Neftci, E. O., & Averbeck, B. B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0025-4 · Cited by 268
Signalling pathways in autism spectrum disorder: mechanisms and therapeutic implications
Jiang, C.-C., Lin, L.-S., Long, S., Ke, X.-Y., Fukunaga, K., Lu, Y.-M., & Han, F. (2022) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-022-01081-0 · Cited by 258
Dopamine reward prediction errors reflect hidden-state inference across time
Starkweather, C. K., Babayan, B. M., Uchida, N., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4520 · Cited by 206
Next-generation interfaces for studying neural function
Frank, J. A., Antonini, M.-J., & Anikeeva, P. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0198-8 · Cited by 241
Midbrain dopamine neurons signal belief in choice accuracy during a perceptual decision
Lak, A., Nomoto, K., Keramati, M., Sakagami, M., & Kepecs, A. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.026 · Cited by 170
Dopamine neurons respond to errors in the prediction of sensory features of expected rewards
Takahashi, Y. K., Batchelor, H. M., Liu, B., Khanna, A., Morales, M., & Schoenbaum, G. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.025 · Cited by 200
A perceptual inference mechanism for hallucinations linked to striatal dopamine
Cassidy, C. M., Balsam, P. D., Weinstein, J. J., Rosengard, R. J., Slifstein, M., Daw, N. D., Abi-Dargham, A., & Horga, G. (2018) · Current Biology · doi:10.1016/j.cub.2017.12.059 · Cited by 176
Stable representations of decision variables for flexible behavior
Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., & Cohen, J. Y. (2019) · Neuron · doi:10.1016/j.neuron.2019.06.001 · Cited by 173
Current perspectives on incentive salience and applications to clinical disorders
Olney, J. J., Warlow, S. M., Naffziger, E. E., & Berridge, K. C. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.01.007 · Cited by 157
Dopamine, effort-based choice, and behavioral economics: basic and translational research.
Salamone, J. D., Correa, M., Yang, J.-H., Rotolo, R., & Presby, R. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00052 · Cited by 142
Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity
Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150
A neural pathway controlling motivation to exert effort
Proulx, C. D., Aronson, S., Milivojevic, D., Molina, C., Loi, A., Monk, B., Shabel, S. J., & Malinow, R. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1801837115 · Cited by 119
Kramer, P. F., Brill-Weil, S. G., Cummins, A. C., Zhang, R., Camacho-Hernandez, G. A., Newman, A. H., Eldridge, M. A. G., Averbeck, B. B., & Khaliq, Z. M. (2022) · Neuron · doi:10.1016/j.neuron.2022.07.011 · Cited by 104
Multi-transmitter neurons in the mammalian central nervous system
Granger, A. J., Wallace, M. L., & Sabatini, B. L. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.04.007 · Cited by 95
Jeremic, D., Sanchez-Rodriguez, I., Jimenez-Diaz, L., & Navarro-Lopez, J. D. (2021) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2021.107808 · Cited by 89
Influences of dopaminergic system dysfunction on late-life depression
Taylor, W. D., Zald, D. H., Felger, J. C., Christman, S., Claassen, D. O., Horga, G., Miller, J. M., Gifford, K., Rogers, B., Szymkowicz, S. M., et al. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01265-0 · Cited by 89
Hird, E. J., Slanina-Davies, A., Lewis, G., Hamer, M., & Roiser, J. P. (2024) · Translational Psychiatry · doi:10.1038/s41398-024-02922-y · Cited by 79
A genetically defined insula-brainstem circuit selectively controls motivational vigor
Deng, H., Xiao, X., Yang, T., Ritola, K., Hantman, A., Li, Y., Huang, Z. J., & Li, B. (2021) · Cell · doi:10.1016/j.cell.2021.11.019 · Cited by 75
Neural Circuitry of Salience and Reward Processing in Psychosis
Kesby, J. P., Murray, G. K., & Knolle, F. (2023) · Biological Psychiatry Global Open Science · doi:10.1016/j.bpsgos.2021.12.003 · Cited by 55
Clark, L., & Zack, M. (2023) · Addictive Behaviors · doi:10.1016/j.addbeh.2023.107626 · Cited by 59
“, goal box) observed in multiple prior studies (Hamid et al., 2016; Phillips et al., 2003).”
ResultCorticostriatal Circuits Encode the Subjective Value of Perceived Control
Wang, K. S., & Delgado, M. R. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz045 · Cited by 42
Bayassi-Jakowicka, M., Lietzau, G., Czuba, E., Steliga, A., Waśkow, M., & Kowiański, P. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22189806 · Cited by 43
Jhou, T. C. (2021) · Neuropharmacology · doi:10.1016/j.neuropharm.2021.108763 · Cited by 40
Modeling dopamine dysfunction in autism spectrum disorder: from invertebrates to vertebrates
DiCarlo, G. E., & Wallace, M. T. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.12.017 · Cited by 39
Yohn, S. E., Galbraith, J., Calipari, E. S., & Conn, P. J. (2019) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.8b00601 · Cited by 36
Disordered Decision Making: A Cognitive Framework for Apathy and Impulsivity in Huntington’s Disease
Morris, L., O'Callaghan, C., & Le Heron, C. (2022) · Movement Disorders · doi:10.1002/mds.29013 · Cited by 36
Goedhoop, J., Arbab, T., & Willuhn, I. (2023) · The Journal of Neuroscience · doi:10.1523/jneurosci.1527-22.2023 · Cited by 24
Fortin, S. M., & Roitman, M. F. (2017) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.11.021 · Cited by 11
“While there are some aspects of these psychological constructs that are at odds with one another, the prevailing opinion is that dopamine plays a key role in assigning value to relevant stimuli and appropriately directing behavior towards those stimuli [38].”
BackgroundReward magnitude determines reinforcement learning efficiency
Gong, S., Martell, A., Dudman, J. T., & Coddington, L. T. (2026) · Science · doi:10.1126/science.aeb0813 · Cited by 2
Metadata
- Authors
- Hamid, A. A., Pettibone, J. R., Mabrouk, O. S., Hetrick, V. L., Schmidt, R., Vander Weele, C. M., Kennedy, R. T., Aragona, B. J., & Berke, J. D.
- Venue
- Nature Neuroscience
- Published
- 2015-11-23
- Volume
- 19
- Issue
- 1
- Pages
- 117-126
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2214962513
- Cited by
- 824
- References
- 68
- FWCI
- 26.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.