Cited by 1,133Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesReinforcement Learning in Robotics

The DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index.

Tonic dopamine: opportunity costs and the control of response vigor

Niv, Yael, Daw, Nathaniel D., Joel, Daphna, Dayan, Peter·2007·Psychopharmacology

DOI 10.1007/s00213-006-0502-4

Open this paper in CoChat — free account

Abstract

Rationale Dopamine neurotransmission has long been known to exert a powerful influence over the vigor, strength, or rate of responding. However, there exists no clear understanding of the computational foundation for this effect; predominant accounts of dopamine's computational function focus on a role for phasic dopamine in controlling the discrete selection between different actions and have nothing to say about response vigor or indeed the free-operant tasks in which it is typically measured.Objectives We seek to accommodate free-operant behavioral tasks within the realm of models of optimal control and thereby capture how dopaminergic and motivational manipulations affect response vigor.Methods We construct an average reward reinforcement learning model in which subjects choose both which action to perform and also the latency with which to perform it. Optimal control balances the costs of acting quickly against the benefits of getting reward earlier and thereby chooses a best response latency.Results In this framework, the long-run average rate of reward plays a key role as an opportunity cost and mediates motivational influences on rates and vigor of responding. We review evidence suggesting that the average reward rate is reported by tonic levels of dopamine putatively in the nucleus accumbens.Conclusions Our extension of reinforcement learning models to free-operant tasks unites psychologically and computationally inspired ideas about the role of tonic dopamine in striatum, explaining from a normative point of view why higher levels of dopamine might be associated with more vigorous responding.

Integrity signals

Registry

Crossref · 10.1007/s00213-006-0502-4

Cites

116 of 116 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citation
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Neuro-dynamic Programming
(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 2×
“One possible explanation for these effects is that phasic signals transiently affect dopamine tone (Phillips and Wightman 2004; Roitman et al. 2004; Wise 2004), influencing vigor selection.”
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708
ON THE LAW OF EFFECT 1
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citation

Show all 116 references

Sorted by citations

Items 201–300 of 1,000

An Integrative Interdisciplinary Perspective on Social Dominance Hierarchies
Qu, C., Ligneul, R., der Henst, J. V., & Dreher, J. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.08.004 · Cited by 123
Multiple Forms of Value Learning and the Function of Dopamine
Balleine, B. W., Daw, N. D., & O’Doherty, J. P. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00024-5 · Cited by 119
Self-citation
Neurocomputational models of motor and cognitive deficits in Parkinson’s disease
Wiecki, T. V., & Frank, M. J. (2010) · Progress in brain research · doi:10.1016/s0079-6123(10)83014-6 · Cited by 111
Phasic Mesolimbic Dopamine Signaling Precedes and Predicts Performance of a Self-Initiated Action Sequence Task
Wassum, K. M., Ostlund, S. B., & Maidment, N. T. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.12.019 · Cited by 119
Vigor of Movements and the Cost of Time in Decision Making
Choi, J. E. S., Vaswani, P. A., & Shadmehr, R. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.2798-13.2014 · Cited by 104
Model-Based Control in Dimensional Psychiatry
Voon, V., Reiter, A. M. F., Sebold, M., & Groman, S. M. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.04.006 · Cited by 121
The geometry of domain-general performance monitoring in the human medial frontal cortex
Fu, Z., Beam, D. E., Chung, J. M., Reed, C. M., Mamelak, A. N., Adolphs, R., & Rutishauser, U. (2022) · Science · doi:10.1126/science.abm9922 · Cited by 110
Dopamine restores cognitive motivation in Parkinson’s disease
McGuigan, S., Zhou, S.-H., Brosnan, M. B., Thyagarajan, D. E., Bellgrove, M. A., & Chong, T. T. ‐. (2018) · Brain · doi:10.1093/brain/awy341 · Cited by 113
Vagus nerve stimulation boosts the drive to work for rewards
Neuser, M. P., Teckentrup, V., Kühnel, A., Hallschmid, M., Walter, M., & Kroemer, N. B. (2020) · Nature Communications · doi:10.1038/s41467-020-17344-9 · Cited by 111
A Reward-Based Framework of Perceived Control
Ly, V., Wang, K. S., Bhanji, J. P., & Delgado, M. R. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00065 · Cited by 117
Differential, but not opponent, effects of l-DOPA and citalopram on action learning with reward and punishment
Guitart‐Masip, M., Economides, M., Huys, Q. J. M., Frank, M. J., Chowdhury, R., Düzel, E., Dayan, P., & Dolan, R. J. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3313-4 · Cited by 113
Self-citation
Dynamic Fluctuations in Dopamine Efflux in the Prefrontal Cortex and Nucleus Accumbens during Risk-Based Decision Making
Onge, J. R. S., Ahn, S., Phillips, A. G., & Floresco, S. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.3807-12.2012 · Cited by 104
Differential actions of adenosine A1 and A2A antagonists on the effort-related effects of dopamine D2 antagonism
Salamone, J. D., Farrar, A. M., Font, L., Patel, V. B., Schlar, D. E., Nunes, E. J., Collins, L. E., & Sager, T. N. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.02.021 · Cited by 105
A Basal Forebrain-Cingulate Circuit in Macaques Decides It Is Time to Act
Khalighinejad, N., Bongioanni, A., Verhagen, L., Folloni, D., Attali, D., Aubry, J.-F., Sallet, J., & Rushworth, M. F. S. (2020) · Neuron · doi:10.1016/j.neuron.2019.10.030 · Cited by 90
BOLD Variability is Related to Dopaminergic Neurotransmission and Cognitive Aging
Guitart‐Masip, M., Salami, A., Garrett, D. D., Rieckmann, A., Lindenberger, U., & Bäckman, L. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv029 · Cited by 109
Are computational models of any use to psychiatry?
Huys, Q. J. M., Moutoussis, M., & Williams, J. H. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.03.001 · Cited by 106
Two-photon imaging in mice shows striosomes and matrix have overlapping but differential reinforcement-related responses
Bloem, B., Huda, R., Sur, M., & Graybiel, A. M. (2017) · eLife · doi:10.7554/elife.32353 · Cited by 101
Forebrain circuitry involved in effort-related choice: Injections of the GABAA agonist muscimol into ventral pallidum alter response allocation in food-seeking behavior
Farrar, A. M., Font, L., Pereira, M., Mingote, S., Bunce, J. G., Chrobak, J. J., & Salamone, J. D. (2008) · Neuroscience · doi:10.1016/j.neuroscience.2007.12.034 · Cited by 103
Impulsivity and apathy in Parkinson's disease
Sinha, N., Manohar, S., & Husain, M. (2013) · Journal of Neuropsychology · doi:10.1111/jnp.12013 · Cited by 125
The Cognitive Neuroscience of Motivation and Learning
Daw, N. D., & Shohamy, D. (2008) · Social Cognition · doi:10.1521/soco.2008.26.5.593 · Cited by 108
Self-citation
Intra-accumbens injections of the adenosine A2A agonist CGS 21680 affect effort-related choice behavior in rats
Font, L., Mingote, S., Farrar, A. M., Pereira, M., Worden, L. T., Stopper, C. M., Port, R. G., & Salamone, J. D. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1174-z · Cited by 102
Cognitive Neurostimulation: Learning to Volitionally Sustain Ventral Tegmental Area Activation
MacInnes, J., Dickerson, K. C., Chen, N., & Adcock, R. A. (2016) · Neuron · doi:10.1016/j.neuron.2016.02.002 · Cited by 100
Dopamine reverses reward insensitivity in apathy following globus pallidus lesions
Adam, R. J., Leff, A. P., Sinha, N., Turner, C., Bays, P. M., Draganski, B., & Husain, M. (2012) · Cortex · doi:10.1016/j.cortex.2012.04.013 · Cited by 108
Signed and unsigned reward prediction errors dynamically enhance learning and memory
Rouhani, N., & Niv, Y. (2021) · eLife · doi:10.7554/elife.61077 · Cited by 114
Self-citation
Adaptive properties of differential learning rates for positive and negative outcomes
Cazé, R. D., & van der Meer, M. A. A. (2013) · Biological Cybernetics · doi:10.1007/s00422-013-0571-5 · Cited by 103
Contextual interaction between novelty and reward processing within the mesolimbic system
Bunzeck, N., Doeller, C. F., Dolan, R. J., & Düzel, E. (2011) · Human Brain Mapping · doi:10.1002/hbm.21288 · Cited by 104
Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task
Wikenheiser, A. M., Stephens, D. W., & Redish, A. D. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1220738110 · Cited by 96
Dopamine blockade impairs the exploration-exploitation trade-off in rats
Cinotti, F., Fresno, V., Aklil, N., Coutureau, É., Girard, B., Marchand, A. R., & Khamassi, M. (2019) · Scientific Reports · doi:10.1038/s41598-019-43245-z · Cited by 105
ADHD, altered dopamine neurotransmission, and disrupted reinforcement processes: Implications for smoking and nicotine dependence
Kollins, S. H., & Adcock, R. A. (2014) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2014.02.002 · Cited by 95
Learning Reward Uncertainty in the Basal Ganglia
Mikhael, J. G., & Bogacz, R. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005062 · Cited by 99
Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking
Collins, A. L., & Saunders, B. T. (2020) · Journal of Neuroscience Research · doi:10.1002/jnr.24587 · Cited by 93
Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning
Ostlund, S. B., Wassum, K. M., Murphy, N. P., Balleine, B. W., & Maidment, N. T. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4759-10.2011 · Cited by 94
Limited Encoding of Effort by Dopamine Neurons in a Cost–Benefit Trade-off Task
Pasquereau, B., & Turner, R. S. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4619-12.2013 · Cited by 97
Explaining dopamine through prediction errors and beyond
Gershman, S. J., Assad, J. A., Datta, S. R., Linderman, S. W., Sabatini, B. L., Uchida, N., & Wilbrecht, L. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01705-4 · Cited by 110
Goal-directed control and its antipodes
Dayan, P. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.004 · Cited by 93
Self-citation
A theory of actions and habits: The interaction of rate correlation and contiguity systems in free-operant behavior.
Perez, O. D., & Dickinson, A. (2020) · Psychological Review · doi:10.1037/rev0000201 · Cited by 98
A quantitative reward prediction error signal in the ventral pallidum
Ottenheimer, D. J., Bari, B. A., Sutlief, E., Fraser, K. M., Kim, T. H., Richard, J. M., Cohen, J. Y., & Janak, P. H. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0688-5 · Cited by 82
Good things come to those who wait: Attenuated discounting of delayed rewards in aged Fischer 344 rats
Simon, N. W., LaSarge, C. L., Montgomery, K. S., Williams, M. T., Mendez, I. A., Setlow, B., & Bizon, J. L. (2008) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2008.06.004 · Cited by 92
Testing Basal Ganglia Motor Functions Through Reversible Inactivations in the Posterior Internal Globus Pallidus
Desmurget, M., & Turner, R. S. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01010.2007 · Cited by 96
Differential effects of selective adenosine antagonists on the effort-related impairments induced by dopamine D1 and D2 antagonism
Nunes, E. J., Randall, P. A., Santerre, J. L., Given, A. M., Sager, T. N., Correa, M., & Salamone, J. D. (2010) · Neuroscience · doi:10.1016/j.neuroscience.2010.05.068 · Cited by 91
Vigor in the Face of Fluctuating Rates of Reward: An Experimental Examination
Guitart‐Masip, M., Beierholm, U., Dolan, R. J., Düzel, E., & Dayan, P. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00090 · Cited by 89
Self-citation
The role of learning-related dopamine signals in addiction vulnerability
Huys, Q. J. M., Tobler, P. N., Hasler, G., & Flagel, S. B. (2014) · Progress in brain research · doi:10.1016/b978-0-444-63425-2.00003-9 · Cited by 92
Influences of dopaminergic system dysfunction on late-life depression
Taylor, W. D., Zald, D. H., Felger, J. C., Christman, S., Claassen, D. O., Horga, G., Miller, J. M., Gifford, K., Rogers, B., Szymkowicz, S. M., et al. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01265-0 · Cited by 89
Chronic and Acute Stress Promote Overexploitation in Serial Decision Making
Lenow, J. K., Constantino, S. M., Daw, N. D., & Phelps, E. A. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.3618-16.2017 · Cited by 94
Self-citation
Dopamine Modulation of Prefrontal Cortex Activity Is Manifold and Operates at Multiple Temporal and Spatial Scales
Lohani, S., Martig, A. K., Deisseroth, K. A., Witten, I. B., & Moghaddam, B. (2019) · Cell Reports · doi:10.1016/j.celrep.2019.03.012 · Cited by 99
Dopamine and the motivation of cognitive control
Cools, R., Froböse, M. I., Aarts, E., & Hofmans, L. (2019) · Handbook of clinical neurology · doi:10.1016/b978-0-12-804281-6.00007-0 · Cited by 99
Why Don't We Move Slower? The Value of Time in the Neural Control of Action
Berret, B., & Jean, F. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.1921-15.2016 · Cited by 97
Effects of Inflammation on Hippocampus and Substantia Nigra Responses to Novelty in Healthy Human Participants
Harrison, N. A., Cercignani, M., Voon, V., & Critchley, H. D. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2014.222 · Cited by 89
Dissociating motivation from reward in human striatal activity
Miller, E. M., Shankar, M. U., Knutson, B., & McClure, S. M. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00535 · Cited by 89
Global reward state affects learning and activity in raphe nucleus and anterior insula in monkeys
Wittmann, M. K., Fouragnan, E. F., Folloni, D., Klein-Flügge, M. C., Chau, B. K. H., Khamassi, M., & Rushworth, M. F. S. (2020) · Nature Communications · doi:10.1038/s41467-020-17343-w · Cited by 88
Vigor
Shadmehr, R., & Ahmed, A. A. (2020) · The MIT Press eBooks · doi:10.7551/mitpress/12940.001.0001 · Cited by 108
Cognitive Control
Badre, D. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022024-103901 · Cited by 111
Developmental imaging genetics: Linking dopamine function to adolescent behavior
Padmanabhan, A., & Luna, B. (2014) · Brain and Cognition · doi:10.1016/j.bandc.2013.09.011 · Cited by 87
The Urge to Decide and Act: Implications for Brain Function and Dysfunction
Carland, M. A., Thura, D., & Cisek, P. (2019) · The Neuroscientist · doi:10.1177/1073858419841553 · Cited by 84
A mosaic of cost–benefit control over cortico-striatal circuitry
Westbrook, A., Frank, M. J., & Cools, R. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.04.007 · Cited by 88
The role of state uncertainty in the dynamics of dopamine
Mikhael, J. G., Kim, H. R., Uchida, N., & Gershman, S. J. (2022) · Current Biology · doi:10.1016/j.cub.2022.01.025 · Cited by 88
Mesoaccumbal Dopamine Heterogeneity: What Do Dopamine Firing and Release Have to Do with It?
de Jong, J. W., Fraser, K. M., & Lammel, S. (2022) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-110920-011929 · Cited by 91
Coordination of rapid cholinergic and dopaminergic signaling in striatum during spontaneous movement
Howe, M. W., Ridouh, I., Mascaro, A. L. A., Larios, A., Azcorra, M., & Dombeck, D. A. (2019) · eLife · doi:10.7554/elife.44903 · Cited by 84
Goal congruency dominates reward value in accounting for behavioral and neural correlates of value-based decision-making
Frömer, R., Wolf, C. K. D., & Shenhav, A. (2019) · Nature Communications · doi:10.1038/s41467-019-12931-x · Cited by 94
Why skill matters
Hikosaka, O., Yamamoto, S., Yasuda, M., & Kim, H. F. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.07.001 · Cited by 88
Foraging across the life span: is there a reduction in exploration with aging?
Mata, R., Wilke, A., & Czienskowski, U. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00053 · Cited by 85
Value Learning through Reinforcement
Daw, N. D., & Tobler, P. N. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00015-2 · Cited by 109
Self-citation
Dopamine Modulates Dynamic Decision-Making during Foraging
Heron, C. J. L., Kolling, N., Plant, O., Kienast, A., Janska, R., Ang, Y., Fallon, S. J., Husain, M., & Apps, M. A. J. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.2586-19.2020 · Cited by 97
The Challenge of Understanding the Brain: Where We Stand in 2015
Lisman, J. E. (2015) · Neuron · doi:10.1016/j.neuron.2015.03.032 · Cited by 92
Anticipating cognitive effort: roles of perceived error-likelihood and time demands
Dunn, T. L., Inzlicht, M., & Risko, E. F. (2017) · Psychological Research · doi:10.1007/s00426-017-0943-x · Cited by 85
Adolescent Development of Value-Guided Goal Pursuit
Davidow, J. Y., Insel, C., & Somerville, L. H. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.05.003 · Cited by 87
Neural correlates of dueling affective reactions to win–win choices
Shenhav, A., & Buckner, R. L. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1405725111 · Cited by 80
An Integrative Model of Effortful Control
André, N., Audiffren, M. F., & Baumeister, R. F. (2019) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2019.00079 · Cited by 96
Dopamine and the interdependency of time perception and reward
Fung, B. J., Sutlief, E., & Shuler, M. G. H. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.02.030 · Cited by 79
A temporal difference account of avoidance learning
Moutoussis, M., Bentall, R. P., Williams, J. H., & Dayan, P. (2008) · Network Computation in Neural Systems · doi:10.1080/09548980802192784 · Cited by 84
Self-citation
Neural substrates underlying effort computation in schizophrenia
Fervaha, G., Foussias, G., Agid, O., & Remington, G. J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.09.001 · Cited by 86
Dopamine role in learning and action inference
Bogacz, R. (2020) · eLife · doi:10.7554/elife.53262 · Cited by 96
The prediction-error hypothesis of schizophrenia: new data point to circuit-specific changes in dopamine activity
Millard, S. J., Bearden, C. E., Karlsgodt, K. H., & Sharpe, M. J. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01188-y · Cited by 83
Levodopa medication does not influence motor inhibition or conflict resolution in a conditional stop-signal task in Parkinson’s disease
Obeso, I., Wilkinson, L., & Jahanshahi, M. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2793-x · Cited by 91
Decision-Theoretic Psychiatry
Huys, Q. J. M., Guitart‐Masip, M., Dolan, R. J., & Dayan, P. (2015) · Clinical Psychological Science · doi:10.1177/2167702614562040 · Cited by 85
Self-citation
Dual credit assignment processes underlie dopamine signals in a complex spatial environment
Krausz, T. A., Comrie, A. E., Kahn, A. E., Frank, L. M., Daw, N. D., & Berke, J. D. (2023) · Neuron · doi:10.1016/j.neuron.2023.07.017 · Cited by 80
Self-citation
Changes in Medial Prefrontal Cortical Dopamine Levels Associated with Response-Contingent Food Reward: An Electrochemical Study in Rat
Richardson, N. R., & Gratton, A. P. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-21-09130.1998 · Cited by 80
From movement to motivation: a proposed framework to understand the antidepressant effect of exercise
Hird, E. J., Slanina-Davies, A., Lewis, G., Hamer, M., & Roiser, J. P. (2024) · Translational Psychiatry · doi:10.1038/s41398-024-02922-y · Cited by 79
The Human Affectome
Schiller, D., Yu, A. N. C., Alia‐Klein, N., Becker, S., Cromwell, H. C., Dolcos, F., Eslinger, P. J., Frewen, P., Kemp, A. H., Pace-Schott, E. F., et al. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105450 · Cited by 89
Calcium‐activated non‐selective cation currents are involved in generation of tonic and bursting activity in dopamine neurons of the substantia nigra pars compacta
Mrejeru, A., Wei, A. D., & Ramirez, J. (2011) · The Journal of Physiology · doi:10.1113/jphysiol.2011.206631 · Cited by 82
Devaluation and sequential decisions: linking goal-directed and model-based behavior
Friedel, E., Koch, S., Wendt, J., Heinz, A., Deserno, L., & Schlagenhauf, F. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00587 · Cited by 85
Dopamine Manipulation Affects Response Vigor Independently of Opportunity Cost
Zénon, A., Devesse, S., & Olivier, E. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.4467-15.2016 · Cited by 79
The Roles of Phasic and Tonic Dopamine in Tic Learning and Expression
Maia, T. V., & Conceição, V. A. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.05.025 · Cited by 78
A genetically defined insula-brainstem circuit selectively controls motivational vigor
Deng, H., Xiao, X., Yang, T., Ritola, K., Hantman, A., Li, Y., Huang, Z. J., & Li, B. (2021) · Cell · doi:10.1016/j.cell.2021.11.019 · Cited by 75
Premonitory urges and tics in Tourette syndrome: computational mechanisms and neural correlates
Conceição, V. A., Dias, Â. J. B., Farinha, A. C., & Maia, T. V. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.009 · Cited by 81
The value of what’s to come: Neural mechanisms coupling prediction error and the utility of anticipation
Iigaya, K., Hauser, T. U., Kurth-Nelson, Z. L., O’Doherty, J. P., Dayan, P., & Dolan, R. J. (2020) · Science Advances · doi:10.1126/sciadv.aba3828 · Cited by 89
Self-citation
The adenosine A2A antagonist MSX-3 reverses the effort-related effects of dopamine blockade: differential interaction with D1 and D2 family antagonists
Worden, L. T., Shahriari, M., Farrar, A. M., Sink, K. S., Hockemeyer, J., Müller, C. E., & Salamone, J. D. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1396-0 · Cited by 79
Taste uncoupled from nutrition fails to sustain the reinforcing properties of food
Beeler, J. A., McCutcheon, J. E., Cao, Z. F. H., Murakami, M., Alexander, E. R., Roitman, M. F., & Zhuang, X. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08167.x · Cited by 73
Explicit knowledge enhances motor vigor and performance: motivation versus practice in sequence tasks
Wong, A. L., Lindquist, M. A., Haith, A. M., & Krakauer, J. W. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00218.2015 · Cited by 76
Role of Prefrontal Cortex in Learning and Generalizing Hierarchical Rules in 8-Month-Old Infants
Werchan, D. M., Collins, A. G. E., Frank, M. J., & Amso, D. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.1351-16.2016 · Cited by 76
Movement vigor as a traitlike attribute of individuality
Reppert, T. R., Rigas, I., Herzfeld, D. J., Sedaghat-Nejad, E., Komogortsev, O. V., & Shadmehr, R. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00033.2018 · Cited by 81
Control of movements and temporal discounting of reward
Shadmehr, R. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.08.017 · Cited by 75
Neural systems analysis of decision making during goal-directed navigation
Penner, M. R., & Mizumori, S. J. Y. (2011) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2011.08.010 · Cited by 80
Instrumental vigour in punishment and reward
Dayan, P. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08026.x · Cited by 73
Self-citation
Performance in a GO/NOGO perceptual task reflects a balance between impulsive and instrumental components of behaviour
Berditchevskaia, A., Cazé, R. D., & Schultz, S. R. (2016) · Scientific Reports · doi:10.1038/srep27389 · Cited by 78
Anxiety, Avoidance, and Sequential Evaluation
Zorowitz, S., Momennejad, I., & Daw, N. D. (2020) · Computational Psychiatry · doi:10.1162/cpsy_a_00026 · Cited by 75
Self-citation
Balancing reward and work: anticipatory brain activation in NAcc and VTA predict effort differentially
Kroemer, N. B., Guevara, A., Ciocanea Teodorescu, I., Wuttig, F., Kobiella, A., & Smolka, M. N. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.060 · Cited by 64
Fuel not fun: Reinterpreting attenuated brain responses to reward in obesity
Kroemer, N. B., & Small, D. M. (2016) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.04.020 · Cited by 74
Decomposing effects of dopaminergic medication in Parkinson’s disease on probabilistic action selection – learning or performance?
Smittenaar, P., Chase, H. W., Aarts, E., Nusselein, B., Bloem, B. R., & Cools, R. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08043.x · Cited by 73
Values and Actions in Aversion
Dayan, P., & Seymour, B. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00012-9 · Cited by 73
Self-citation

Authors: Niv, Y., Daw, N. D., Joel, D., & Dayan, P.
Affiliations: Hebrew University of Jerusalem (IL)
Gatsby Computational Neuroscience Unit (GB)
Tel Aviv University (IL)
Corresponding author: Niv, Yael
ORCID: Niv, Yael
Daw, Nathaniel D.
Joel, Daphna
Dayan, Peter
Venue: Psychopharmacology
Publisher: Springer Science and Business Media LLC
Published: 2006-10-10
Volume: 191
Issue: 3
Pages: 507-520
ISSN: 0033-3158 (ISSN-L)
1432-2072
DOI: 10.1007/s00213-006-0502-4
OpenAlex: W2156952192
Semantic Scholar: e1625352c7b6e275ec9a63984a5af25a98032671
Cited by: 1,133
References: 116
Citations by year: 2026: 49 · 2025: 65 · 2024: 75 · 2023: 59 · 2022: 76 · 2021: 80 · 2020: 64 · 2019: 63 · 2018: 69 · 2017: 69 · 2016: 84 · 2015: 52 · 2014: 62 · 2013: 61 · 2012: 44
FWCI: 9.35
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Psychopharmacology (publishedVersion)
PubMed (publishedVersion)
UCL Discovery (University College London) (submittedVersion)
MPG.PuRe (Max Planck Society) (submittedVersion)
Funders: Gatsby Charitable Foundation
Hebrew University of Jerusalem
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords: tonic dopamine, response vigor, opportunity cost, optimal control, average-reward reinforcement learning, response latency, nucleus accumbens, striatum, free-operant behavior, reward rate, motivation, phasic dopamine
MeSH terms: Animals, Brain, Choice Behavior, Conditioning, Operant, Dopamine, Models, Psychological, Motivation, Reaction Time, Reinforcement, Psychology, Reinforcement Schedule, Reward, Neurotransmitter Agents, Rats

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Tonic dopamine: opportunity costs and the control of response vigor

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks