Cited by 1,133Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesReinforcement Learning in Robotics

The DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index.

Tonic dopamine: opportunity costs and the control of response vigor

Niv, Yael, Daw, Nathaniel D., Joel, Daphna, Dayan, Peter·2007·Psychopharmacology

DOI 10.1007/s00213-006-0502-4

Open this paper in CoChat — free account

Abstract

Rationale Dopamine neurotransmission has long been known to exert a powerful influence over the vigor, strength, or rate of responding. However, there exists no clear understanding of the computational foundation for this effect; predominant accounts of dopamine's computational function focus on a role for phasic dopamine in controlling the discrete selection between different actions and have nothing to say about response vigor or indeed the free-operant tasks in which it is typically measured.Objectives We seek to accommodate free-operant behavioral tasks within the realm of models of optimal control and thereby capture how dopaminergic and motivational manipulations affect response vigor.Methods We construct an average reward reinforcement learning model in which subjects choose both which action to perform and also the latency with which to perform it. Optimal control balances the costs of acting quickly against the benefits of getting reward earlier and thereby chooses a best response latency.Results In this framework, the long-run average rate of reward plays a key role as an opportunity cost and mediates motivational influences on rates and vigor of responding. We review evidence suggesting that the average reward rate is reported by tonic levels of dopamine putatively in the nucleus accumbens.Conclusions Our extension of reinforcement learning models to free-operant tasks unites psychologically and computationally inspired ideas about the role of tonic dopamine in striatum, explaining from a normative point of view why higher levels of dopamine might be associated with more vigorous responding.

Integrity signals

Registry

Crossref · 10.1007/s00213-006-0502-4

Cites

116 of 116 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citation
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Neuro-dynamic Programming
(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 2×
“One possible explanation for these effects is that phasic signals transiently affect dopamine tone (Phillips and Wightman 2004; Roitman et al. 2004; Wise 2004), influencing vigor selection.”
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708
ON THE LAW OF EFFECT 1
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citation

Flagged first, then by citations

Show all 116 references

Sorted by citations

Items 101–200 of 1,000

General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area
Corbit, L. H., Janak, P. H., & Balleine, B. W. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05934.x · Cited by 231
Basal ganglia circuit loops, dopamine and motivation: a review and enquiry
Ikemoto, S., Yang, C., & Tan, A. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.04.018 · Cited by 226
Dopaminergic control of the striatum for high-level cognition
Cools, R. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.04.002 · Cited by 232
Overlapping neural systems represent cognitive effort and reward anticipation
Vassena, E., Silvetti, M., Boehler, C. N., Achten, E., Fias, W., & Verguts, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091008 · Cited by 200
Dopamine Modulates Reward-Related Vigor
Beierholm, U., Guitart‐Masip, M., Economides, M., Chowdhury, R., Düzel, E., Dolan, R. J., & Dayan, P. (2013) · Neuropsychopharmacology · doi:10.1038/npp.2013.48 · Cited by 227
Self-citation
Temporal Discounting of Reward and the Cost of Time in Motor Control
Shadmehr, R., de Xivry, J. O., Xu-Wilson, M., & Shih, T.-Y. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.1343-10.2010 · Cited by 205
Dopaminergic Modulation of Decision Making and Subjective Well-Being
Rutledge, R. B., Skandali, N., Dayan, P., & Dolan, R. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0702-15.2015 · Cited by 217
Self-citation
Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain
Guitart-Masip, M., Fuentemilla, L., Bach, D. R., Huys, Q. J. M., Dayan, P., Dolan, R. J., & Duzel, E. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6376-10.2011 · Cited by 216
Self-citation
Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors
Chang, C. Y., Esber, G. R., Marrero-Garcia, Y., Yau, H., Bonci, A., & Schoenbaum, G. M. (2015) · Nature Neuroscience · doi:10.1038/nn.4191 · Cited by 226
Dopamine agonists and risk: impulse control disorders in Parkinson's; disease
Voon, V., Gao, J., Brezing, C., Symmonds, M., Ekanayake, V., Fernandez, H., Dolan, R. J., & Hallett, M. (2011) · Brain · doi:10.1093/brain/awr080 · Cited by 209
A universal role of the ventral striatum in reward-based learning: Evidence from human studies
Daniel, R., & Pollmann, S. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.002 · Cited by 225
Midbrain dopamine neurons signal belief in choice accuracy during a perceptual decision
Lak, A., Nomoto, K., Keramati, M., Sakagami, M., & Kepecs, A. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.026 · Cited by 170
Dopamine neurons respond to errors in the prediction of sensory features of expected rewards
Takahashi, Y. K., Batchelor, H. M., Liu, B., Khanna, A., Morales, M., & Schoenbaum, G. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.025 · Cited by 200
The role of dopamine in the brain - lessons learned from Parkinson's disease
Meder, D., Herz, D. M., Rowe, J. B., Lehéricy, S., & Siebner, H. R. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.11.021 · Cited by 213
Reward-Dependent Modulation of Movement Variability
Pekny, S. E., Izawa, J., & Shadmehr, R. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3244-14.2015 · Cited by 194
Why Don't You Try Harder? An Investigation of Effort Production in Major Depression
Cléry-Melin, M.-L., Schmidt, L., Lafargue, G., Baup, N., Fossati, P., & Pessiglione, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023178 · Cited by 191
Reappraising striatal D1- and D2-neurons in reward and aversion
Soares‐Cunha, C., Coimbra, B., Sousa, N., & Rodrigues, A. J. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.05.021 · Cited by 203
Deciding How To Decide: Self-Control and Meta-Decision Making
Boureau, Y.-L., Sokol‐Hessner, P., & Daw, N. D. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.08.013 · Cited by 201
Self-citation
The exercise-glucocorticoid paradox: How exercise is beneficial to cognition, mood, and the brain while increasing glucocorticoid levels
Chen, C., Nakagawa, S., An, Y., Ito, K., Kitaichi, Y., & Kusumi, I. (2016) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2016.12.001 · Cited by 209
Twenty-Five Lessons from Computational Neuromodulation
Dayan, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.027 · Cited by 190
Self-citation
A computational reward learning account of social media engagement
Lindström, B., Bellander, M., Schultner, D. T., Chang, A., Tobler, P. N., & Amodio, D. M. (2021) · Nature Communications · doi:10.1038/s41467-020-19607-x · Cited by 185
Cost, Benefit, Tonic, Phasic
Niv, Y. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.018 · Cited by 187
Self-citation
Advances in the computational understanding of mental illness
Huys, Q. J. M., Browning, M. D., Paulus, M. P., & Frank, M. J. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0746-4 · Cited by 204
Tonic Dopamine Modulates Exploitation of Reward Learning
Beeler, J. A., Daw, N. D., Frazier, C. R. M., & Zhuang, X. (2010) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2010.00170 · Cited by 183
Self-citation
Acute and chronic effects of cannabinoids on effort-related decision-making and reward learning: an evaluation of the cannabis ‘amotivational’ hypotheses
Lawn, W., Freeman, T. P., Pope, R. A., Joye, A., Harvey, L. A., Hindocha, C., Mokrysz, C., Moss, A., Wall, M. B., Bloomfield, M., et al. (2016) · Psychopharmacology · doi:10.1007/s00213-016-4383-x · Cited by 182
The intrinsic value of visual information affects saccade velocities
Xu-Wilson, M., Zee, D. S., & Shadmehr, R. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1879-1 · Cited by 160
Reward Processing, Neuroeconomics, and Psychopathology
Zald, D. H., & Treadway, M. T. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044957 · Cited by 190
Movement Vigor as a Reflection of Subjective Economic Utility
Shadmehr, R., Reppert, T. R., Summerside, E. M., Yoon, T., & Ahmed, A. A. (2019) · Trends in Neurosciences · doi:10.1016/j.tins.2019.02.003 · Cited by 186
Computational models of motivated action selection in corticostriatal circuits
Frank, M. J. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.02.013 · Cited by 179
Influence of reward motivation on human declarative memory
Lombard, E., Bavelier, D., & Schwartz, S. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.11.015 · Cited by 191
Stable representations of decision variables for flexible behavior
Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., & Cohen, J. Y. (2019) · Neuron · doi:10.1016/j.neuron.2019.06.001 · Cited by 173
Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior
Gruber, A. J., & McDonald, R. J. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00050 · Cited by 173
Habenula Lesions Reveal that Multiple Mechanisms Underlie Dopamine Prediction Errors
Tian, J., & Uchida, N. (2015) · Neuron · doi:10.1016/j.neuron.2015.08.028 · Cited by 173
Modulating the Neuromodulators: Dopamine, Serotonin, and the Endocannabinoid System
Peters, K. Z., Cheer, J. F., & Tonini, R. (2021) · Trends in Neurosciences · doi:10.1016/j.tins.2021.02.001 · Cited by 180
Dopamine and effort-based decision making
Kurniawan, I. T. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00081 · Cited by 188
The Primate Ventral Pallidum Encodes Expected Reward Value and Regulates Motor Action
Tachibana, Y., & Hikosaka, O. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.030 · Cited by 175
Vigor of reaching movements: reward discounts the cost of effort
Summerside, E. M., Shadmehr, R., & Ahmed, A. A. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00872.2017 · Cited by 175
The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis
Mannella, F., Gurney, K., & Baldassarre, G. (2013) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2013.00135 · Cited by 166
Reconciling cognitive and affective neuroscience perspectives on the brain basis of emotional experience
Panksepp, J., Lane, R. D., Solms, M., & Smith, R. S. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.010 · Cited by 182
Nucleus accumbens neurotransmission and effort-related choice behavior in food motivation: Effects of drugs acting on dopamine, adenosine, and muscarinic acetylcholine receptors
Nunes, E. J., Randall, P. A., Podurgiel, S. J., Correa, M., & Salamone, J. D. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.04.002 · Cited by 170
Action Selection and Action Value in Frontal-Striatal Circuits
Seo, M., Lee, E., & Averbeck, B. B. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.037 · Cited by 170
Behavior-Relevant Changes in Nucleus Accumbens Dopamine Transmission Elicited by Food Reinforcement: An Electrochemical Study in Rat
Richardson, N. R., & Gratton, A. P. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-24-08160.1996 · Cited by 160
Animal affect and decision-making
Mendl, M., & Paul, E. S. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.01.025 · Cited by 171
Dopaminergic modulation of incentive motivation in adolescence: age-related changes in signaling, individual differences, and implications for the development of self-regulation
Luciana, M., Wahlstrom, D., Porter, J. N., & Collins, P. F. (2012) · Developmental Psychology · doi:10.1037/a0027432 · Cited by 156
Adolescent brain development in normality and psychopathology
Luciana, M. M. (2013) · Development and Psychopathology · doi:10.1017/s0954579413000643 · Cited by 175
THE BEHAVIORAL PHARMACOLOGY OF EFFORT‐RELATED CHOICE BEHAVIOR: DOPAMINE, ADENOSINE AND BEYOND
Salamone, J. D., Correa, M., Nunes, E. J., Randall, P. A., & Pardo, M. (2012) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2012.97-125 · Cited by 151
Dopamine, effort-based choice, and behavioral economics: basic and translational research.
Salamone, J. D., Correa, M., Yang, J.-H., Rotolo, R., & Presby, R. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00052 · Cited by 142
Algorithms for survival: a comparative perspective on emotions
Bach, D. R., & Dayan, P. (2017) · Nature reviews. Neuroscience · doi:10.1038/nrn.2017.35 · Cited by 148
Self-citation
Phasic Firing of Single Neurons in the Rat Nucleus Accumbens Correlated with the Timing of Intravenous Cocaine Self-Administration
Peoples, L. L., & West, M. O. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-10-03459.1996 · Cited by 150
The opportunity cost of time modulates cognitive effort
Otto, A. R., & Daw, N. D. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.05.006 · Cited by 138
Self-citation
Habits as action sequences: hierarchical action control and changes in outcome value
Dezfouli, A., Lingawi, N. W., & Balleine, B. W. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0482 · Cited by 139
Dopamine and performance in a reinforcement learning task: evidence from Parkinson’s disease
Shiner, T., Seymour, B., Wunderlich, K., Hill, C. S., Bhatia, K. P., Dayan, P., & Dolan, R. J. (2012) · Brain · doi:10.1093/brain/aws083 · Cited by 157
Self-citation
Distinct Tonic and Phasic Anticipatory Activity in Lateral Habenula and Dopamine Neurons
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.06.016 · Cited by 164
Chemistry of the Adaptive Mind: Lessons from Dopamine
Cools, R. (2019) · Neuron · doi:10.1016/j.neuron.2019.09.035 · Cited by 150
Beyond reward prediction errors: the role of dopamine in movement kinematics
Barter, J. W., Li, S., Lu, D., Bartholomew, R. A., Rossi, M. A., Shoemaker, C. T., Salas-Meza, D., Gaidis, E., & Yin, H. H. (2015) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2015.00039 · Cited by 146
A Bayesian formulation of behavioral control
Huys, Q. J. M., & Dayan, P. (2009) · Cognition · doi:10.1016/j.cognition.2009.01.008 · Cited by 150
Self-citation
Separate mesocortical and mesolimbic pathways encode effort and reward learning signals
Hauser, T. U., Eldar, E., & Dolan, R. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705643114 · Cited by 142
Intense threat switches dorsal raphe serotonin neurons to a paradoxical operational mode
Seo, C., Guru, A., Jin, M., Ito, B. S., Sleezer, B. J., Ho, Y.-Y., Wang, E., Boada, C. M., Krupa, N. A., Kullakanda, D. S., et al. (2019) · Science · doi:10.1126/science.aau8722 · Cited by 155
A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism
Moustafa, A. A., Cohen, M. X., Sherman, S. J., & Frank, M. J. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.3116-08.2008 · Cited by 154
Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex
Wittmann, M. K., Kolling, N., Akaishi, R., Chau, B. K. H., Brown, J. W., Nelissen, N., & Rushworth, M. F. S. (2016) · Nature Communications · doi:10.1038/ncomms12327 · Cited by 146
Transient inhibition and long-term facilitation of locomotion by phasic optogenetic activation of serotonin neurons
Correia, P. A., Lottem, E., Banerjee, D., Machado, A. S., Carey, M. R., & Mainen, Z. F. (2017) · eLife · doi:10.7554/elife.20975 · Cited by 138
Ethanol Action on Dopaminergic Neurons in the Ventral Tegmental Area
Morikawa, H., & Morrisett, R. A. (2010) · International review of neurobiology · doi:10.1016/s0074-7742(10)91008-8 · Cited by 146
An information-theoretic perspective on the costs of cognition
Zénon, A., Solopchuk, O., & Pezzulo, G. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.09.013 · Cited by 153
Freezing revisited: coordinated autonomic and central optimization of threat coping
Roelofs, K., & Dayan, P. (2022) · Nature reviews. Neuroscience · doi:10.1038/s41583-022-00608-2 · Cited by 160
Self-citation
In search of the neural circuits of intrinsic motivation
Kaplan, F. (2007) · Frontiers in Neuroscience · doi:10.3389/neuro.01.1.1.017.2007 · Cited by 151
Overriding Phasic Dopamine Signals Redirects Action Selection during Risk/Reward Decision Making
Stopper, C. M., Tse, M. T. L., Montes, D. R., Wiedman, C. R., & Floresco, S. B. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.033 · Cited by 136
Reward sensitivity deficits modulated by dopamine are associated with apathy in Parkinson’s disease
Muhammed, K., Manohar, S., Yehuda, M. B., Chong, T. T. ‐., Tofaris, G. K., Lennox, G. G., Bogdanovic, M. D., Hu, M., & Husain, M. (2016) · Brain · doi:10.1093/brain/aww188 · Cited by 148
Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources
Beeler, J. A., Frazier, C. R. M., & Zhuang, X. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00049 · Cited by 136
Midbrain dopamine neurons compute inferred and cached value prediction errors in a common framework
Sadacca, B. F., Jones, J. L., & Schoenbaum, G. M. (2016) · eLife · doi:10.7554/elife.13665 · Cited by 136
Quantifying motivation with effort-based decision-making paradigms in health and disease
Chong, T. T. ‐., Bonnelle, V., & Husain, M. (2016) · Progress in brain research · doi:10.1016/bs.pbr.2016.05.002 · Cited by 142
Adaptive effort investment in cognitive and physical tasks: A neurocomputational model
Verguts, T., Vassena, E., & Silvetti, M. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00057 · Cited by 118
Intention, Choice, and the Medial Frontal Cortex
Rushworth, M. F. S. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.014 · Cited by 135
Evidence for Hyperbolic Temporal Discounting of Reward in Control of Movements
Haith, A. M., Reppert, T. R., & Shadmehr, R. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0424-12.2012 · Cited by 129
The novelty exploration bonus and its attentional modulation☆
Krebs, R. M., Schott, B. H., Schütze, H., & Düzel, E. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.01.015 · Cited by 127
A Model of Reward- and Effort-Based Optimal Decision Making and Motor Control
Rigoux, L., & Guigon, E. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002716 · Cited by 139
The costs and benefits of brain dopamine for cognitive control
Cools, R. (2016) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1401 · Cited by 164
Dynamic Nigrostriatal Dopamine Biases Action Selection
Howard, C. D., Li, H., Geddes, C. E., & Jin, X. (2017) · Neuron · doi:10.1016/j.neuron.2017.02.029 · Cited by 125
Rational metareasoning and the plasticity of cognitive control
Lieder, F., Shenhav, A., Musslick, S., & Griffiths, T. L. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006043 · Cited by 136
The dorsomedial striatum encodes net expected return, critical for energizing performance vigor
Wang, A. Y., Miura, K., & Uchida, N. (2013) · Nature Neuroscience · doi:10.1038/nn.3377 · Cited by 135
Neural Basis of Motivational and Cognitive Control
Mars, R., Sallet, J., Mfs., R., & Yeung, N. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/9780262016438.001.0001 · Cited by 128
Nucleus accumbens and effort-related functions: behavioral and neural markers of the interactions between adenosine A2A and dopamine D2 receptors
Farrar, A. M., Segovia, K. N., Randall, P. A., Nunes, E. J., Collins, L. E., Stopper, C. M., Port, R. G., Hockemeyer, J., Müller, C. E., Correa, M., et al. (2010) · Neuroscience · doi:10.1016/j.neuroscience.2009.12.056 · Cited by 128
Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action
Swart, J. C., Froböse, M. I., Cook, J. L., Geurts, D. E. M., Frank, M. J., Cools, R., & den Ouden, H. E. M. (2017) · eLife · doi:10.7554/elife.22169 · Cited by 140
Diazepam actions in the VTA enhance social dominance and mitochondrial function in the nucleus accumbens by activation of dopamine D1 receptors
van der Kooij, M. A., Hollis, F., Lozano, L., Zalachoras, I., Abad, S., Zanoletti, O., Grosse, J., Guillot de Suduiraut, I., Canto, C., & Sandi, C. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.135 · Cited by 127
Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner
Silvetti, M., Vassena, E., Abrahamse, E. L., & Verguts, T. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006370 · Cited by 140
The central executive as a search process: Priming exploration and exploitation across domains.
Hills, T. T., Todd, P. M., & Goldstone, R. L. (2010) · Journal of Experimental Psychology General · doi:10.1037/a0020666 · Cited by 133
Plastic Corticostriatal Circuits for Action Learning
Costa, R. M. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.015 · Cited by 126
Action controls dopaminergic enhancement of reward representations
Guitart‐Masip, M., Chowdhury, R., Sharot, T., Dayan, P., Düzel, E., & Dolan, R. J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1202229109 · Cited by 127
Self-citation
Incentive Motivation, Cognitive Control, and the Adolescent Brain: Is It Time for a Paradigm Shift?
Luciana, M., & Collins, P. F. (2012) · Child Development Perspectives · doi:10.1111/j.1750-8606.2012.00252.x · Cited by 123
Differential effects of dopaminergic manipulations on risky choice
Onge, J. R. S., Chiu, Y. C., & Floresco, S. (2010) · Psychopharmacology · doi:10.1007/s00213-010-1883-y · Cited by 123
The effect of dopamine therapy on ventral and dorsal striatum-mediated cognition in Parkinson’s disease: support from functional MRI
MacDonald, P. A., MacDonald, A. A., Seergobin, K. N., Tamjeedi, R., Ganjavi, H., Provost, J.-S., & Monchi, O. (2011) · Brain · doi:10.1093/brain/awr075 · Cited by 133
Dopamine Invigorates Reward Seeking by Promoting Cue-Evoked Excitation in the Nucleus Accumbens
du Hoffmann, J., & Nicola, S. M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3492-14.2014 · Cited by 122
Control of movement vigor and decision making during foraging
Yoon, T., Geary, R. B., Ahmed, A. A., & Shadmehr, R. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1812979115 · Cited by 122
A specific role for serotonin in overcoming effort cost
Meyniel, F., Goodwin, G. M., Deakin, J. F. W., Klinge, C., MacFadyen, C., Milligan, H., Mullings, E. L., Pessiglione, M., & Gaillard, R. (2016) · eLife · doi:10.7554/elife.17282 · Cited by 120
Previous Cocaine Exposure Makes Rats Hypersensitive to Both Delay and Reward Magnitude
Roesch, M. R., Takahashi, Y. K., Gugsa, N., Bissonette, G. B., & Schoenbaum, G. M. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.4080-06.2007 · Cited by 119
Motivated Cognitive Control: Reward Incentives Modulate Preparatory Neural Activity during Task-Switching
Savine, A. C., & Braver, T. S. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.2052-10.2010 · Cited by 125
Retracted
Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task
Carelli, R. M., Wolske, M., & West, M. O. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-05-01804.1997 · Cited by 114
The case against economic values in the orbitofrontal cortex (or anywhere else in the brain).
Hayden, B. Y., & Niv, Y. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000448 · Cited by 127
Self-citation
Ventral Tegmental Dopamine Neurons Control the Impulse Vector during Motivated Behavior
Hughes, R. N., Bakhurin, K. I., Petter, E. A., Watson, G. D. R., Kim, N., Friedman, A. D., & Yin, H. H. (2020) · Current Biology · doi:10.1016/j.cub.2020.05.003 · Cited by 115
Where attention falls: Increased risk of falls from the converging impact of cortical cholinergic and midbrain dopamine loss on striatal function
Sarter, M. F., Albin, R. L., Kucinski, A. J., & Lustig, C. (2014) · Experimental Neurology · doi:10.1016/j.expneurol.2014.04.032 · Cited by 117
Context-Dependent Urgency Influences Speed–Accuracy Trade-Offs in Decision-Making and Movement Execution
Thura, D., Cos, I., Trung, J., & Cisek, P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0162-14.2014 · Cited by 113

Authors: Niv, Y., Daw, N. D., Joel, D., & Dayan, P.
Affiliations: Hebrew University of Jerusalem (IL)
Gatsby Computational Neuroscience Unit (GB)
Tel Aviv University (IL)
Corresponding author: Niv, Yael
ORCID: Niv, Yael
Daw, Nathaniel D.
Joel, Daphna
Dayan, Peter
Venue: Psychopharmacology
Publisher: Springer Science and Business Media LLC
Published: 2006-10-10
Volume: 191
Issue: 3
Pages: 507-520
ISSN: 0033-3158 (ISSN-L)
1432-2072
DOI: 10.1007/s00213-006-0502-4
OpenAlex: W2156952192
Semantic Scholar: e1625352c7b6e275ec9a63984a5af25a98032671
Cited by: 1,133
References: 116
Citations by year: 2026: 49 · 2025: 65 · 2024: 75 · 2023: 59 · 2022: 76 · 2021: 80 · 2020: 64 · 2019: 63 · 2018: 69 · 2017: 69 · 2016: 84 · 2015: 52 · 2014: 62 · 2013: 61 · 2012: 44
FWCI: 9.35
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Psychopharmacology (publishedVersion)
PubMed (publishedVersion)
UCL Discovery (University College London) (submittedVersion)
MPG.PuRe (Max Planck Society) (submittedVersion)
Funders: Gatsby Charitable Foundation
Hebrew University of Jerusalem
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords: tonic dopamine, response vigor, opportunity cost, optimal control, average-reward reinforcement learning, response latency, nucleus accumbens, striatum, free-operant behavior, reward rate, motivation, phasic dopamine
MeSH terms: Animals, Brain, Choice Behavior, Conditioning, Operant, Dopamine, Models, Psychological, Motivation, Reaction Time, Reinforcement, Psychology, Reinforcement Schedule, Reward, Neurotransmitter Agents, Rats

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Tonic dopamine: opportunity costs and the control of response vigor

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks