The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Mesolimbic dopamine signals the value of work
Open accessAbstract
Dopamine cell firing can encode errors in reward prediction, providing a learning signal to guide future behavior. Yet dopamine is also a key modulator of motivation, invigorating current behavior. Existing theories propose that fast (phasic) dopamine fluctuations support learning, whereas much slower (tonic) dopamine changes are involved in motivation. We examined dopamine release in the nucleus accumbens across multiple time scales, using complementary microdialysis and voltammetric methods during adaptive decision-making. We found that minute-by-minute dopamine levels covaried with reward rate and motivational vigor. Second-by-second dopamine release encoded an estimate of temporally discounted future reward (a value function). Changing dopamine immediately altered willingness to work and reinforced preceding action choices by encoding temporal-difference reward prediction errors. Our results indicate that dopamine conveys a single, rapidly evolving decision variable, the available reward for investment of effort, which is employed for both learning and motivational functions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879
A causal link between prediction errors, dopamine neurons and learning
Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K., & Janak, P. H. (2013) · Nature Neuroscience · doi:10.1038/nn.3413 · Cited by 869
Striatal Dopamine Release Is Triggered by Synchronized Activity in Cholinergic Interneurons
Threlfell, S., Lalic, T., Platt, N. J., Jennings, K. A., Deisseroth, K., & Cragg, S. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.038 · Cited by 845
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718
Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710
Witten, I. B., Steinberg, E. E., Lee, S. Y., Davidson, T. J., Zalocusky, K. A., Brodsky, M., Yizhar, O., Cho, S. L., Gong, S., Ramakrishnan, C., et al. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.028 · Cited by 680
The goal-gradient hypothesis and maze learning.
Hull, C. L. (1932) · Psychological Review · doi:10.1037/h0072640 · Cited by 593
Prolonged dopamine signalling in striatum signals proximity and value of distant rewards
Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E. M., & Graybiel, A. M. (2013) · Nature · doi:10.1038/nature12475 · Cited by 565
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485
Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats
Heien, M. L. A. V., Khan, A. S., Ariansen, J. L., Cheer, J. F., Phillips, P. E. M., Wassum, K. M., & Wightman, R. M. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504657102 · Cited by 482
Rapoport, J. L. (1980) · Archives of General Psychiatry · doi:10.1001/archpsyc.1980.01780210091010 · Cited by 434
Influence of Reward Delays on Responses of Dopamine Neurons
Kobayashi, S., & Schultz, W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1600-08.2008 · Cited by 430
Influence of Phasic and Tonic Dopamine Release on Receptor Activation
Dreyer, J. K., Herrik, K. F., Berg, R. W., & Hounsgaard, J. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1894-10.2010 · Cited by 423
A computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Read Montague, P. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 422
Basal ganglia contributions to motor control: a vigorous tutor
Turner, R. S., & Desmurget, M. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.08.022 · Cited by 420
Canceling actions involves a race between basal ganglia pathways
Schmidt, R., Leventhal, D. K., Mallet, N., Chen, F., & Berke, J. D. (2013) · Nature Neuroscience · doi:10.1038/nn.3456 · Cited by 407
Self-citationTests of an equivalence rule for fixed and variable reinforcer delays.
Mazur, J. E. (1984) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.10.4.426 · Cited by 404
Adamantidis, A. R., Tsai, H.-C., Boutrel, B., Zhang, F., Stuber, G. D., Budygin, E. A., Tourino, C., Bonci, A., Deisseroth, K., & de Lecea, L. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.2246-11.2011 · Cited by 357
Basal Ganglia Beta Oscillations Accompany Cue Utilization
Leventhal, D. K., Gage, G. J., Schmidt, R., Pettibone, J. R., Case, A. C., & Berke, J. D. (2012) · Neuron · doi:10.1016/j.neuron.2011.11.032 · Cited by 299
Self-citationCorrelated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298
Hart, A. S., Rutledge, R. B., Glimcher, P. W., & Phillips, P. E. M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2489-13.2014 · Cited by 293
Selective Activation of Striatal Fast-Spiking Interneurons during Choice Execution
Gage, G. J., Stoetzner, C. R., Wiltschko, A. B., & Berke, J. D. (2010) · Neuron · doi:10.1016/j.neuron.2010.06.034 · Cited by 290
Self-citationCagniard, B., Balsam, P. D., Brunner, D., & Zhuang, X. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300966 · Cited by 282
Cannon, C. M., & Palmiter, R. D. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-34-10827.2003 · Cited by 280
Amping Up Effort: Effects of d-Amphetamine on Human Effort-Based Decision-Making
Wardle, M. C., Treadway, M. T., Mayo, L. M., Zald, D. H., & de Wit, H. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4387-11.2011 · Cited by 259
Nicola, S. M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3958-10.2010 · Cited by 238
Song, P., Mabrouk, O. S., Hershey, N. D., & Kennedy, R. T. (2012) · Analytical Chemistry · doi:10.1021/ac202794q · Cited by 235
Self-citationDissociable cost and benefit encoding of future rewards by mesolimbic dopamine
Gan, J. O., Walton, M. E., & Phillips, P. E. M. (2010) · Nature Neuroscience · doi:10.1038/nn.2460 · Cited by 233
Dopamine Modulates Reward-Related Vigor
Beierholm, U., Guitart-Masip, M., Economides, M., Chowdhury, R., Düzel, E., Dolan, R., & Dayan, P. (2013) · Neuropsychopharmacology · doi:10.1038/npp.2013.48 · Cited by 219
Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia
Humphries, M. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00009 · Cited by 206
Ainslie, G. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000117 · Cited by 201
Regional Brain Dopamine Metabolism: A Marker for the Speed, Direction, and Posture of Moving Animals
Freed, C. R., & Yamamoto, B. K. (1985) · Science · doi:10.1126/science.4012312 · Cited by 195
Response Times of Carbon Fiber Microelectrodes to Dynamic Changes in Catecholamine Concentration
Venton, B. J., Troyer, K. P., & Wightman, R. M. (2002) · Analytical Chemistry · doi:10.1021/ac010819a · Cited by 174
Representation and timing in theories of the dopamine system
Daw, N. D., Courville, A. C., & Touretzky, D. S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1637 · Cited by 173
The Primate Ventral Pallidum Encodes Expected Reward Value and Regulates Motor Action
Tachibana, Y., & Hikosaka, O. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.030 · Cited by 168
Kim, K. M., Baratta, M. V., Yang, A., Lee, D., Boyden, E. S., & Fiorillo, C. D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033612 · Cited by 152
Fixed and variable ratios and delays: further tests of an equivalence rule.
Mazur, J. (1986) · PubMed · Cited by 145
Evidence for Hyperbolic Temporal Discounting of Reward in Control of Movements
Haith, A. M., Reppert, T. R., & Shadmehr, R. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0424-12.2012 · Cited by 138
The dorsomedial striatum encodes net expected return, critical for energizing performance vigor
Wang, A. Y., Miura, K., & Uchida, N. (2013) · Nature Neuroscience · doi:10.1038/nn.3377 · Cited by 137
Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources
Beeler, J. A., Frazier, C. R. M., & Zhuang, X. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00049 · Cited by 136
Rapid decision threshold modulation by reward rate in a neural network
Simen, P., Cohen, J. D., & Holmes, P. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.05.038 · Cited by 130
Ishiwari, K., Weber, S. M., Mingote, S., Correa, M., & Salamone, J. D. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.08.007 · Cited by 128
Aragona, B. J., Day, J. J., Roitman, M. F., Cleaveland, N. A., Wightman, R. M., & Carelli, R. M. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.07027.x · Cited by 123
Self-citationDopamine Invigorates Reward Seeking by Promoting Cue-Evoked Excitation in the Nucleus Accumbens
du Hoffmann, J., & Nicola, S. M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3492-14.2014 · Cited by 122
Normative and Descriptive Models of Decision Making: Time Discounting and Risk Sensitivity
Kacelnik, A. (2007) · Novartis Foundation symposium · doi:10.1002/9780470515372.ch5 · Cited by 115
How fast to work: Response vigor, motivation and tonic dopamine
Niv, Y., Daw, N. D., & Dayan, P. (2005) · MPG.PuRe (Max Planck Society) · Cited by 103
Ventral striatum: a critical look at models of learning and evaluation
van der Meer, M. A. A., & Redish, A. D. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.02.011 · Cited by 90
Vigor in the Face of Fluctuating Rates of Reward: An Experimental Examination
Guitart‐Masip, M., Beierholm, U., Dolan, R. J., Düzel, E., & Dayan, P. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00090 · Cited by 90
Mass Spectrometry “Sensor” forin VivoAcetylcholine Monitoring
Song, P., Hershey, N. D., Mabrouk, O. S., Slaney, T. R., & Kennedy, R. T. (2012) · Analytical Chemistry · doi:10.1021/ac301203m · Cited by 79
Self-citationDopamine Ramps Are a Consequence of Reward Prediction Errors
Gershman, S. J. (2013) · Neural Computation · doi:10.1162/neco_a_00559 · Cited by 75
What 50 years of research tell us about pausing under ratio schedules of reinforcement
Schlinger, H. D., Derenne, A., & Baron, A. (2008) · The Behavior Analyst · doi:10.1007/bf03392160 · Cited by 55
Morita, K., & Kato, A. (2014) · Frontiers in Neural Circuits · doi:10.3389/fncir.2014.00036 · Cited by 55
Nagano‐Saito, A., Cisek, P., Perna, A. S., Shirdel, F. Z., Benkelfat, C., Leyton, M., & Dagher, A. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00592.2011 · Cited by 50
Dissociable effects of dopamine on learning and performance within sensorimotor striatum
Leventhal, D., Stoetzner, C. R., Abraham, R., Pettibone, J. R., DeMarco, K., & Berke, J. D. (2013) · Basal Ganglia · doi:10.1016/j.baga.2013.11.001 · Cited by 36
Self-citationOptimal indolence: a normative microscopic approach to work and leisure
Niyogi, R. K., Breton, Y.-A., Solomon, R. B., Conover, K. L., Shizgal, P., & Dayan, P. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0969 · Cited by 19
Cited by
The dopamine motive system: implications for drug and food addiction
Volkow, N. D., Wise, R. A., & Baler, R. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2017.130 · Cited by 939
Berke, J. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0152-y · Cited by 904
Self-citationThe Neuroscience of Drug Reward and Addiction
Volkow, N. D., Michaelides, M., & Baler, R. (2019) · Physiological Reviews · doi:10.1152/physrev.00014.2018 · Cited by 863
Dissociable dopamine dynamics for learning and motivation
Mohebi, A., Pettibone, J. R., Hamid, A. A., Wong, J.-M. T., Vinson, L. T., Patriarchi, T., Tian, L., Kennedy, R. T., & Berke, J. D. (2019) · Nature · doi:10.1038/s41586-019-1235-y · Cited by 735
Self-citationNeuroscience of apathy and anhedonia: a transdiagnostic approach
Husain, M., & Roiser, J. P. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0029-9 · Cited by 640
Metadata
- Authors
- Hamid, A. A., Pettibone, J. R., Mabrouk, O. S., Hetrick, V. L., Schmidt, R., Vander Weele, C. M., Kennedy, R. T., Aragona, B. J., & Berke, J. D.
- Venue
- Nature Neuroscience
- Published
- 2015-11-23
- Volume
- 19
- Issue
- 1
- Pages
- 117-126
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2214962513
- Cited by
- 824
- References
- 68
- FWCI
- 26.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.