The DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index.
Tonic dopamine: opportunity costs and the control of response vigor
Abstract
Rationale Dopamine neurotransmission has long been known to exert a powerful influence over the vigor, strength, or rate of responding. However, there exists no clear understanding of the computational foundation for this effect; predominant accounts of dopamine's computational function focus on a role for phasic dopamine in controlling the discrete selection between different actions and have nothing to say about response vigor or indeed the free-operant tasks in which it is typically measured.Objectives We seek to accommodate free-operant behavioral tasks within the realm of models of optimal control and thereby capture how dopaminergic and motivational manipulations affect response vigor.Methods We construct an average reward reinforcement learning model in which subjects choose both which action to perform and also the latency with which to perform it. Optimal control balances the costs of acting quickly against the benefits of getting reward earlier and thereby chooses a best response latency.Results In this framework, the long-run average rate of reward plays a key role as an opportunity cost and mediates motivational influences on rates and vigor of responding. We review evidence suggesting that the average reward rate is reported by tonic levels of dopamine putatively in the nucleus accumbens.Conclusions Our extension of reinforcement learning models to free-operant tasks unites psychologically and computationally inspired ideas about the role of tonic dopamine in striatum, explaining from a normative point of view why higher levels of dopamine might be associated with more vigorous responding.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Tonic DA levels are largely independent of environmental triggers and may index an individual’s level of incentive-related drive (Niv et al, 2007; Willuhn, Wanat, Clark, & Phillips, 2010).”
From Incentive Motivation, Cognitive Control, and the Adolescent Brain: Is It Time for a Paradigm Shift? (2012) · cites this paper as Niv et al, 2007
In the citing paper
“Supportive evidence for this proposed interplay between tonic and phasic modes of DA activity and effects on behavior relies entirely on animal and computational models (Niv et al., 2007; Willuhn, 2010).”
From Incentive Motivation, Cognitive Control, and the Adolescent Brain: Is It Time for a Paradigm Shift? (2012) · cites this paper as Niv et al., 2007
In the citing paper
“These systems also interact as tonic DA activity regulates phasic signaling in an inhibitory fashion and phasic DA has been shown to enhance tonic activity (Niv, Daw et al. 2007).”
From Developmental imaging genetics: Linking dopamine function to adolescent behavior (2014) · cites this paper as Niv, Daw et al. 2007
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 2×
“One possible explanation for these effects is that phasic signals transiently affect dopamine tone (Phillips and Wightman 2004; Roitman et al. 2004; Wise 2004), influencing vigor selection.”
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citation
Cited by
Sorted by citations
Items 801–900 of 1,000
The cognitive effects of a promised bonus do not depend on dopamine synthesis capacity
Hofmans, L., van den Bosch, R., Määttä, J. I., Verkes, R., Aarts, E., & Cools, R. (2020) · Scientific Reports · doi:10.1038/s41598-020-72329-4 · Cited by 6
Dopamine Related Genes Differentially Affect Declarative Long-Term Memory in Healthy Humans
Leukel, C., Schümann, D., Kalisch, R., Sommer, T., & Bunzeck, N. (2020) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.539725 · Cited by 8
Evolution of in vivo dopamine monitoring techniques
Yocky, A. G., & Covey, D. P. (2020) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2020.173078 · Cited by 8
Neuronal Correlates of Decision Making
Platt, M. L., Dayan, P., Dehaene, S., McCabe, K., Menzel, R., Phelps, E. A., Plaßmann, H., Ratcliff, R., Shadlen, M. N., & Singer, W. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/9780262195805.003.0006 · Cited by 6
Self-citationEmergence of reward expectation signals in identified dopamine neuronsPreprint
Coddington, L. T., & Dudman, J. T. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/238881 · Cited by 6
Models and Methods for Reinforcement Learning
Dayan, P., & Nakahara, H. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn513 · Cited by 6
Self-citationRaio, C. M., Biernacki, K., Kapoor, A., Wengler, K., Bonagura, D., Xue, J., Constantino, S. M., Horga, G., & Konova, A. B. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.03.24.485654 · Cited by 6
Webb, J., Steffan, P., Hayden, B. Y., Lee, D., Kemere, C. T., & McGinley, M. J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.30.587253 · Cited by 6
Synthetic exendin-4 disrupts responding to reward predictive incentive cues in male rats
Wakabayashi, K. T., Baindur, A. N., Feja, M., Suarez, M., Chen, K., Bernosky‐Smith, K. A., & Bass, C. E. (2024) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2024.1363497 · Cited by 5
Webb, J., Steffan, P., Hayden, B. Y., Lee, D., Kemere, C. T., & McGinley, M. J. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012989 · Cited by 10
Cognitive modeling of real-world behavior for understanding mental health
Mirea, D.-M., Nook, E. C., & Niv, Y. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.07.009 · Cited by 11
Self-citationHarlé, K. M., Ho, T. C., Connolly, C. G., Simmons, A. N., & Yang, T. T. (2021) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-021-00975-w · Cited by 5
Au‐Yeung, S. K., Halahakoon, D. C., Kaltenboeck, A., Cowen, P. J., Browning, M. D., & Manohar, S. (2024) · Psychopharmacology · doi:10.1007/s00213-024-06567-z · Cited by 5
Schuster, B. A., Sowden, S., Rybicki, A. J., Fraser, D. S., Press, C., Hickman, L., Holland, P. W. H., & Cook, J. L. (2024) · PLoS Biology · doi:10.1371/journal.pbio.3002652 · Cited by 7
Mesolimbic dopamine ramps reflect environmental timescales
Floeder, J. R., Jeong, H., Mohebi, A., & Namboodiri, V. M. K. (2024) · eLife · doi:10.7554/elife.98666.3 · Cited by 15
Dynamic decision making and value computations in medial frontal cortex
Bari, B. A., & Cohen, J. Y. (2021) · International review of neurobiology · doi:10.1016/bs.irn.2020.12.001 · Cited by 6
Reducing behavioral dimensions to study brain–environment interactions
Thura, D. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000169 · Cited by 3
Toschi, C., Hervig, M. E.-S., Burghi, T. B., Sell, T., Lycas, M. D., Moazen, P., Huang, L., Gether, U., Robbins, T. W., & Dalley, J. W. (2022) · Brain and Neuroscience Advances · doi:10.1177/23982128221102256 · Cited by 5
Hickman, L., Sowden-Carvalho, S., Fraser, D. S., Schuster, B. A., Rybicki, A. J., Galea, J. M., & Cook, J. L. (2024) · Behavioural Brain Research · doi:10.1016/j.bbr.2024.115213 · Cited by 6
Ursino, M., Pelle, S., Nekka, F., Robaey, P., & Schirru, M. (2024) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2024.107985 · Cited by 5
Moustafa, A. A., Herzallah, M. M., & Gluck, M. A. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.08.003 · Cited by 5
The copyist model and the shaping view of reinforcement
Tanno, T., Silberberg, A. M., & Sakagami, T. (2015) · Behavioural Processes · doi:10.1016/j.beproc.2015.02.009 · Cited by 5
Intellectual Investment, Dopaminergic Gene Variation, and Life Events: A Critical Examination
Strobel, A., Strobel, A., Enge, S., Fleischhauer, M., Reif, A., Lesch, K., & Anacker, K. (2018) · Personality Neuroscience · doi:10.1017/pen.2018.2 · Cited by 5
Perez, O. D. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01830-8 · Cited by 5
Clark, K. B. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000078 · Cited by 5
Keramati, M., Dezfouli, A., & Piray, P. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0751-5_8 · Cited by 5
How the value of the environment controls persistence in visual search
Traner, M., Bromberg-Martin, E. S., & Monosov, I. E. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009662 · Cited by 6
Spontaneous eye blinks in horses (Equus caballus) are modulated by attention
Tomberg, C., Petagna, M., & de Moranville, L.-A. D. S. (2024) · Scientific Reports · doi:10.1038/s41598-024-70141-y · Cited by 5
Sexual Selection: Placentation, Superfetation, and Coercive Copulation
Haig, D. (2014) · Current Biology · doi:10.1016/j.cub.2014.07.039 · Cited by 5
Schiffler, B. C., Almeida, R., Granqvist, M., & Bengtsson, S. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00987 · Cited by 5
RETRACTED ARTICLE: Local and global effects of motivation on cognitive control
Savine, A. C., & Braver, T. S. (2012) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-012-0113-y · Cited by 7
RetractedA Computational Model of Attention Control in Multi-Attribute, Context-Dependent Decision Making
Jung, K., Jeong, J., & Kralik, J. D. (2019) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2019.00040 · Cited by 6
A Neuroeconomic Framework for Creative CognitionPreprint
Lin, H., & Vartanian, O. A. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/184754 · Cited by 5
Circuits that encode and predict alcohol associated preferencePreprint
Scaplen, K. M., Talay, M., Salamon, S., Nuñez, K. M., Waterman, A. G., Gang, S., Song, S. L., Barnea, G., & Kaun, K. R. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/578401 · Cited by 5
Methylphenidate boosts choices of mental labor over leisure depending on baseline striatal dopaminePreprint
Hofmans, L., Papadopetraki, D., van den Bosch, R., Määttä, J. I., Froböse, M. I., Zandbelt, B. B., Westbrook, A., Verkes, R., & Cools, R. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/859637 · Cited by 5
Context-dependent multiplexing by individual VTA dopamine neuronsPreprint
Kremer, Y., Flakowski, J., Rohner, C., & Lüscher, C. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/408062 · Cited by 5
Striatal dopamine encodes the relationship between actions and rewardPreprint
Hart, G., Burton, T. J., Nolan, C. R., & Balleine, B. W. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.01.31.478585 · Cited by 5
Estrogenic control of reward prediction errors and reinforcement learningPreprint
Golden, C. E. M., Martin, A. C., Kaur, D., Mah, A., Levy, D. H., Yamaguchi, T., Lasek, A. W., Lin, D., Aoki, C. J., & Constantinople, C. M. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.12.09.570945 · Cited by 5
The effects of haloperidol on motor vigour and movement fusion during sequential reaching
Sporn, S., & Galea, J. M. (2025) · PLoS ONE · doi:10.1371/journal.pone.0316894 · Cited by 4
Bogdanov, M., & Pizzagalli, D. A. (2025) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-025-01353-6 · Cited by 7
Dopamine Supports Reward Prediction to Shape Reward-Pursuit Strategy
Malvaez, M., Suarez, A., Griffin, N. K., Ramírez-Armenta, K., Ostlund, S. B., & Wassum, K. M. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.1636-25.2026 · Cited by 7
Local and distributed cortical markers of effort expenditure during sustained goal pursuit
Patrick, L. M., Anderson, K. M., & Holmes, A. J. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118602 · Cited by 4
Shikano, Y., Yagishita, S., Tanaka, K. F., & Takata, N. (2023) · European Journal of Neuroscience · doi:10.1111/ejn.15945 · Cited by 5
Skałbania, J., Tanajewski, Ł., Furtak, M., Hare, T. A., & Wypych, M. (2024) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-024-01231-7 · Cited by 4
A Step-by-Step Guide to Dopamine
Dayan, P., & Walton, M. E. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.03.008 · Cited by 4
Self-citationSmith, R. S., Alkozei, A., & Killgore, W. D. S. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00848 · Cited by 4
Neuromodulation of Foraging Decisions: The Role of Dopamine
Marzecová, A., Kaiser, L. F., & Maddah, A. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.660667 · Cited by 4
Contributions of transient and sustained reward to memory formation
Gholston, A. S., Thurmann, K. E., & Chiew, K. S. (2023) · Psychological Research · doi:10.1007/s00426-023-01829-5 · Cited by 6
When Artificial Intelligence and Computational Neuroscience Meet
Alexandre, F., Dominey, P. F., Gaussier, P., Girard, B., Khamassi, M., & Rougier, N. P. (2020) · Springer eBooks · doi:10.1007/978-3-030-06170-8_9 · Cited by 4
Subjective decision threshold for accurate visual detection performance in rats
Osako, Y., Sakurai, Y., & Hirokawa, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-27696-4 · Cited by 4
Are Public Financial Managers Wired for Risk-Aversion?
Fennimore, A. K., & McCue, C. P. (2021) · Public Finance and Management · doi:10.1177/152397212102000104 · Cited by 4
Linking addictions to everyday habits and plans
Neal, D. T., & Wood, W. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x08004913 · Cited by 4
Navigation via Pavlovian conditioning: a robotic bio-constrained model of autoshaping in rats.
Mannella, F., Koene, A. R., & Baldassarre, G. (2009) · Cited by 4
Dopamine regulates the exploration-exploitation trade-off in ratsPreprint
Cinotti, F., Fresno, V., Aklil, N., Coutureau, É., Girard, B., Marchand, A. R., & Khamassi, M. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/482802 · Cited by 4
Firing patterns of serotonin neurons underlying cognitive flexibilityPreprint
Matias, S., Lottem, E., Dugué, G. P., & Mainen, Z. F. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/059758 · Cited by 5
VTA Dopamine Neurons Multiplex External with Internal Representations of Goal-Directed ActionPreprint
Kremer, Y., Flakowski, J., Rohner, C., & Lüscher, C. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3249465 · Cited by 4
Rodman, A. M., Powers, K. E., Kastman, E. K., Kabotyanski, K. E., Stark, A. M., Mair, P., & Somerville, L. H. (2020) · doi:10.31234/osf.io/2gz6d · Cited by 4
'Liking' as a First Draft of the Affective FuturePreprint
Dayan, P. (2021) · doi:10.31234/osf.io/g7zfq · Cited by 4
Self-citationCuttoli, R. D.-D., Martínez-Rivera, F. J., Li, L., Minier-Toribio, A. M., Russo, S. J., Nestler, E. J., & Sweis, B. M. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.01.17.476514 · Cited by 4
Dopamine regulates decision thresholds in human reinforcement learningPreprint
Chakroun, K., Wiehler, A., Wagner, B., Mathar, D., Ganzer, F., van Eimeren, T., Sommer, T., & Peters, J. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.09.29.509499 · Cited by 4
Old strategies, new environments: Reinforcement Learning on social mediaPreprint
Turner, G., Ferguson, A. M., Katiyar, T., Palminteri, S., & Orben, A. C. (2024) · doi:10.31234/osf.io/f5cjv · Cited by 4
Depression is associated with higher sensitivity to social media rewardsPreprint
Mirea, D.-M., Mildner, J. N., Kelley, S., Gillan, C. M., Nook, E. C., & Niv, Y. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4ynbc · Cited by 7
Self-citationMesolimbic dopamine ramps reflect environmental timescalesPreprint
Floeder, J. R., Jeong, H., Mohebi, A., & Namboodiri, V. M. K. (2024) · eLife · doi:10.7554/elife.98666.1 · Cited by 4
Wideband ratiometric measurement of tonic and phasic dopamine release in the striatumPreprint
Gottschalk, A. C., Menees, H., Bogner, C., Zewde, S., Jibin, J., Gamam, A., Flink, D., Mosissa, M., Bonneson, F., Wehelie, H., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.17.618918 · Cited by 4
Hamilton, A. R., Vishwanath, A., Weintraub, N. C., Cowen, S. L., & Heien, M. L. (2024) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.4c00115 · Cited by 4
Feeding-induced olfactory cortex suppression reduces satiation
Lo, H., Riedel, W. C., Tantirigama, M. L. S., Schoenherr, A., Velasquez, L. M., Faiss, L., Kumar, A., Hakus, A., Rost, B. R., Larkum, M. E., et al. (2025) · Neuron · doi:10.1016/j.neuron.2025.07.020 · Cited by 3
Non-linear stochastic model for dopamine cycle
Ðorđević, J., Milošević, M., & Šuvak, N. (2023) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2023.114220 · Cited by 3
Differential effects of prior outcomes and pauses on the speed and quality of risky choices
Chen, Z., Eben, C., & Verbruggen, F. (2024) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2370 · Cited by 3
Lange, F., & Rieger, A. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02769-1 · Cited by 3
Timescales of dopamine release in the striatum as a window into hierarchical control
Gottschalk, A. C., Faturos, N., & Hamid, A. (2025) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2025.101589 · Cited by 3
Neural representation of the decisional reference point in monkeys
Nguyen, D., Rich, E. L., Wallis, J. D., Louie, K., & Glimcher, P. W. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2514110122 · Cited by 2
Zeuner, K. E., Knutzen, A., Granert, O., Trampenau, L., Baumann, A., Wolff, S., Jansen, O., van Eimeren, T., & Kuhtz-Buschbeck, J. P. (2021) · Clinical Neurophysiology · doi:10.1016/j.clinph.2021.09.010 · Cited by 3
Task-level value affects trial-level reward processing
Hassall, C. D., Hunt, L. T., & Holroyd, C. B. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119456 · Cited by 3
Simonsson, E., Jonasson, L. S., Lundquist, A., Rosendahl, E., Hedlund, M., Lindelöf, N., & Boraxbekk, C. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.997131 · Cited by 3
How generalization relates to the exploration-exploitation tradeoff
Houser, T. M. (2023) · Frontiers in Cognition · doi:10.3389/fcogn.2023.1132766 · Cited by 3
A reinforcement learning model with choice traces for a progressive ratio schedule
Ihara, K., Shikano, Y., Kato, S., Yagishita, S., Tanaka, K. F., & Takata, N. (2024) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2023.1302842 · Cited by 2
Understanding How Acute Alcohol Impacts Neural Encoding in the Rodent Brain
Lapish, C. C. (2024) · Current topics in behavioral neurosciences · doi:10.1007/7854_2024_479 · Cited by 3
Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour
Cinotti, F., Coutureau, É., Khamassi, M., Marchand, A. R., & Girard, B. (2024) · European Journal of Neuroscience · doi:10.1111/ejn.16449 · Cited by 4
Mahajan, P., Dayan, P., & Seymour, B. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013538 · Cited by 4
Self-citationSunk costs account for rats’ decisions on an intertemporal foraging task
Wikenheiser, A. M., & Redish, A. D. (2012) · BMC Neuroscience · doi:10.1186/1471-2202-13-s1-p63 · Cited by 3
Salamone, J. D., & Correa, M. (2018) · Advances in motivation science · doi:10.1016/bs.adms.2018.01.001 · Cited by 3
Modulation of motor performance by a monetary incentive: A pilot study
Summa, S., Tamagnone, I., Asprea, G., Capurro, C., & Sanguineti, V. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318344 · Cited by 3
A Catecholamine Precursor Does Not Influence Exercise Performance in Warm Conditions
Cordery, P., James, L. J., Peirce, N., Maughan, R. J., & Watson, P. (2015) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000791 · Cited by 3
Optimal response vigor and choice under non-stationary outcome values
Dezfouli, A., Balleine, B. W., & Nock, R. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1500-3 · Cited by 2
Chadderdon, G. L. (2009) · IUScholarWorks (Indiana University) · Cited by 3
Reward prediction error does not explain movement selectivity in DMS-projecting dopamine neuronsPreprint
Lee, R. S., Mattar, M. G., Parker, N. F., Witten, I. B., & Daw, N. D. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/447532 · Cited by 3
Self-citationNallapu, B. T., & Alexandre, F. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/867515 · Cited by 3
Striatal dopamine synthesis capacity reflects smartphone social activityPreprint
Westbrook, A., Ghosh, A., van den Bosch, R., & Cools, R. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.06.06.137976 · Cited by 3
Control over patch encounters changes foraging behaviourPreprint
Hall-McMaster, S., Dayan, P., & Schuck, N. W. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.01.19.426950 · Cited by 3
Self-citationTonic activity in lateral habenula neurons promotes disengagement from reward-seeking behaviorPreprint
Sleezer, B. J., Post, R. J., Bulkin, D. A., Ebitz, R. B., Lee, V., Han, K. J., & Warden, M. R. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.01.15.426914 · Cited by 3
Opportunity cost determines action initiation latency and predicts apathyPreprint
Nair, A., Niyogi, R. K., Shang, F., Tabrizi, S., Rees, G., & Rutledge, R. (2020) · doi:10.31234/osf.io/d9pgz · Cited by 1
Salamone, J. D., & Correa, M. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.00365-5 · Cited by 3
Neuro-cognitive processes as mediators of psychological treatment effectsPreprint
Reiter, A. M. F., Atiya, N. A. A., Berwian, I. M., & Huys, Q. J. M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wz5rd · Cited by 4
Effects of Affectively Parameterized Music on Mood and AttentionPreprint
Orpella, J., Bowling, D. L., Tomaino, C. M., & Ripollés, P. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/yauxt · Cited by 4
What is mental effort: a clinical perspectivePreprint
Wolpe, N., Holton, R., & Fletcher, P. C. (2023) · doi:10.31234/osf.io/tkbq3 · Cited by 3
A corticostriatal learning mechanism linking excess striatal dopamine and auditory hallucinationsPreprint
Lakshminarasimhan, K. J., Buck, J., Kellendonk, C., & Horga, G. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.03.18.643990 · Cited by 3
Motivation as Neural Context for Adaptive Learning and Memory Formation
Poh, J.-H., & Adcock, R. A. (2025) · Annual Review of Psychology · doi:10.1146/annurev-psych-032525-031744 · Cited by 4
A metabolic framework for reward: Redefining dopamine and opioids as physiological agents
Cohen, M. T., & Atzil, S. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106608 · Cited by 3
Dopamine Bidirectionally Biases Incentive and Aversive Salience in Humans
Herrero, E. M., Ferreri, L., Ripollés, P., Valle, M., Riba, J., & Rodríguez‐Fornells, A. (2026) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2026.03.020 · Cited by 2
Dynamics of a Neuromodulator – II. Dopaminergic Balance and Cognition
Aboitiz, F. (2008) · Springer eBooks · doi:10.1007/978-3-540-70573-4_11 · Cited by 2
Metadata
- Authors
- Niv, Y., Daw, N. D., Joel, D., & Dayan, P.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Gatsby Computational Neuroscience Unit (GB)
- Tel Aviv University (IL)
- Corresponding author
- Niv, Yael
- Venue
- Psychopharmacology
- Published
- 2006-10-10
- Volume
- 191
- Issue
- 3
- Pages
- 507-520
- ISSN
- 0033-3158 (ISSN-L)
- 1432-2072
- OpenAlex
- W2156952192
- Semantic Scholar
- e1625352c7b6e275ec9a63984a5af25a98032671
- Cited by
- 1,133
- References
- 116
- Citations by year
- 2026: 49 · 2025: 65 · 2024: 75 · 2023: 59 · 2022: 76 · 2021: 80 · 2020: 64 · 2019: 63 · 2018: 69 · 2017: 69 · 2016: 84 · 2015: 52 · 2014: 62 · 2013: 61 · 2012: 44
- FWCI
- 9.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Psychopharmacology (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Gatsby Charitable Foundation
- Hebrew University of Jerusalem
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- tonic dopamine, response vigor, opportunity cost, optimal control, average-reward reinforcement learning, response latency, nucleus accumbens, striatum, free-operant behavior, reward rate, motivation, phasic dopamine
- MeSH terms
- Animals, Brain, Choice Behavior, Conditioning, Operant, Dopamine, Models, Psychological, Motivation, Reaction Time, Reinforcement, Psychology, Reinforcement Schedule, Reward, Neurotransmitter Agents, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
