The DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index.
Tonic dopamine: opportunity costs and the control of response vigor
Abstract
Rationale Dopamine neurotransmission has long been known to exert a powerful influence over the vigor, strength, or rate of responding. However, there exists no clear understanding of the computational foundation for this effect; predominant accounts of dopamine's computational function focus on a role for phasic dopamine in controlling the discrete selection between different actions and have nothing to say about response vigor or indeed the free-operant tasks in which it is typically measured.Objectives We seek to accommodate free-operant behavioral tasks within the realm of models of optimal control and thereby capture how dopaminergic and motivational manipulations affect response vigor.Methods We construct an average reward reinforcement learning model in which subjects choose both which action to perform and also the latency with which to perform it. Optimal control balances the costs of acting quickly against the benefits of getting reward earlier and thereby chooses a best response latency.Results In this framework, the long-run average rate of reward plays a key role as an opportunity cost and mediates motivational influences on rates and vigor of responding. We review evidence suggesting that the average reward rate is reported by tonic levels of dopamine putatively in the nucleus accumbens.Conclusions Our extension of reinforcement learning models to free-operant tasks unites psychologically and computationally inspired ideas about the role of tonic dopamine in striatum, explaining from a normative point of view why higher levels of dopamine might be associated with more vigorous responding.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Tonic DA levels are largely independent of environmental triggers and may index an individual’s level of incentive-related drive (Niv et al, 2007; Willuhn, Wanat, Clark, & Phillips, 2010).”
From Incentive Motivation, Cognitive Control, and the Adolescent Brain: Is It Time for a Paradigm Shift? (2012) · cites this paper as Niv et al, 2007
In the citing paper
“Supportive evidence for this proposed interplay between tonic and phasic modes of DA activity and effects on behavior relies entirely on animal and computational models (Niv et al., 2007; Willuhn, 2010).”
From Incentive Motivation, Cognitive Control, and the Adolescent Brain: Is It Time for a Paradigm Shift? (2012) · cites this paper as Niv et al., 2007
In the citing paper
“These systems also interact as tonic DA activity regulates phasic signaling in an inhibitory fashion and phasic DA has been shown to enhance tonic activity (Niv, Daw et al. 2007).”
From Developmental imaging genetics: Linking dopamine function to adolescent behavior (2014) · cites this paper as Niv, Daw et al. 2007
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 2×
“One possible explanation for these effects is that phasic signals transiently affect dopamine tone (Phillips and Wightman 2004; Roitman et al. 2004; Wise 2004), influencing vigor selection.”
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citation
Cited by
Sorted by citations
Items 701–800 of 1,000
Neural Correlates of Impaired Reward–Effort Integration in Remitted Bulimia Nervosa
Mueller, S., Morishima, Y., Schwab, S., Wiest, R., Federspiel, A., & Hasler, G. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.277 · Cited by 12
Pleasure: The missing link in the regulation of sleep
Rial, R. V., Cañellas, F., Gamundí, A., Akaârir, M., & Nicolau, M. C. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.03.012 · Cited by 13
Luo, J. K., Tan, J. M., & Nithianantharajah, J. (2020) · BMC Biology · doi:10.1186/s12915-020-00848-7 · Cited by 14
Tonic dopamine, uncertainty and basal ganglia action selection
Gilbertson, T., & Steele, J. D. (2021) · Neuroscience · doi:10.1016/j.neuroscience.2021.05.010 · Cited by 15
Learning Contextual Reward Expectations for Value Adaptation
Rigoli, F., Chew, B., Dayan, P., & Dolan, R. J. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01191 · Cited by 12
Self-citationThe geometry of domain-general performance monitoring in the human medial frontal cortexPreprint
Fu, Z., Beam, D. E., Chung, J. M., Reed, C. M., Mamelak, A. N., Adolphs, R., & Rutishauser, U. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.08.451594 · Cited by 11
Foraging as an ethological framework for neuroscience
Grima, L. L., Haberkern, H., Mohanta, R., Morimoto, M. M., Rajagopalan, A. E., & Scholey, E. V. (2025) · Trends in Neurosciences · doi:10.1016/j.tins.2025.08.006 · Cited by 15
Common Mechanisms of Learning in Motor and Cognitive Systems
Constantinidis, C., Ahmed, A. A., Wallis, J. D., & Batista, A. P. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.1505-23.2023 · Cited by 11
Kim, M. J., Gibson, D. J., Hu, D., Yoshida, T., Hueske, E., Matsushima, A., Mahar, A., Schofield, C. J., Sompolpong, P., Tran, K. T., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-53176-7 · Cited by 14
Forget-me-some: General versus special purpose models in a hierarchical probabilistic task
Bröker, F., Marshall, L., Bestmann, S., & Dayan, P. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205974 · Cited by 12
Self-citationImpulsivity and risk-seeking as Bayesian inference under dopaminergic control
Mikhael, J. G., & Gershman, S. J. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01125-z · Cited by 11
Verdier, A., Dominique, N., Groussard, D., Aldanondo, A., Bathellier, B., & Bagur, S. (2022) · Cell Reports Methods · doi:10.1016/j.crmeth.2022.100355 · Cited by 15
Dayan, P. (2011) · Elsevier eBooks · doi:10.1016/b978-0-12-381431-9.00002-4 · Cited by 11
Self-citationAdaptive scaling of reward in episodic memory: a replication study
Mason, A., Ludwig, C. J. H., & Farrell, S. (2016) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2016.1233439 · Cited by 11
Focal striatum lesions impair cautiousness in humans
Winkel, J., Hawkins, G. E., Ivry, R. B., Brown, S. D., Cools, R., & Forstmann, B. U. (2016) · Cortex · doi:10.1016/j.cortex.2016.09.023 · Cited by 12
Chiew, K. S., Hashemi, J., Gans, L. K., Lerebours, L., Clement, N. J., Vu, M.-A. T., Sapiro, G., Heller, N. E., & Adcock, R. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0193506 · Cited by 10
Interactions Between Experience, Genotype and Sex in the Development of Individual Coping Strategies
Ventura, R., Cabib, S., Babicola, L., Andolina, D., Segni, M. D., & Orsini, C. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.785739 · Cited by 11
The Average Reward Rate Modulates Behavioral and Neural Indices of Effortful Control Allocation
Lin, H., Ristic, J., Inzlicht, M., & Otto, A. R. (2022) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01905 · Cited by 9
A permissive role for dopamine in the production of vigorous movementsPreprint
Liu, H., Melani, R., Sankaramanchi, A., Zeng, R., Maltese, M., Martin, J. R., & Tritsch, N. X. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.03.514328 · Cited by 10
Motivational Vigor in Parkinson's Disease Requires the Short and Long Duration Response to Levodopa
Brissenden, J. A., Scerbak, T., Albin, R. L., & Lee, T. G. (2023) · Movement Disorders · doi:10.1002/mds.29659 · Cited by 12
Antonov, G. K., & Dayan, P. (2025) · Nature Communications · doi:10.1038/s41467-025-56731-y · Cited by 10
Self-citationIntersection of effort and risk: ethological and neurobiological perspectives
Miller, M. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00208 · Cited by 11
Persistent coding of outcome-predictive cue features in the rat nucleus accumbens
Gmaz, J. M., Carmichael, J. E., & van der Meer, M. A. A. (2018) · eLife · doi:10.7554/elife.37275 · Cited by 15
A re-examination of responding on ratio and regulated-probability interval schedules
Perez, O. D., Aitken, M. R. F., Milton, A. L., & Dickinson, A. (2018) · Learning and Motivation · doi:10.1016/j.lmot.2018.07.003 · Cited by 10
Perosa, V., de Boer, L., Ziegler, G., Apostolova, I. I., Buchert, R., Metzger, C. D., Amthauer, H., Guitart‐Masip, M., Düzel, E., & Betts, M. J. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz313 · Cited by 10
Using metabolic energy to quantify the subjective value of physical effort
Summerside, E. M., & Ahmed, A. A. (2021) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0387 · Cited by 13
The motivational role of the ventral striatum and amygdala in learning from gains and losses.
Taswell, C. A., Janssen, M., Murray, E. A., & Averbeck, B. B. (2023) · Behavioral Neuroscience · doi:10.1037/bne0000558 · Cited by 12
Yang, Y. C., & Stocco, A. (2023) · Topics in Cognitive Science · doi:10.1111/tops.12711 · Cited by 11
Dopamine Increases Accuracy and Lengthens Deliberation Time in Explicit Motor Skill Learning
Leow, L., Bernheine, L., Carroll, T. J., Dux, P. E., & Filmer, H. L. (2024) · eNeuro · doi:10.1523/eneuro.0360-23.2023 · Cited by 10
Out of control: computational dynamic control dysfunction in stress- and anxiety-related disorders
Howlett, J. R., & Paulus, M. P. (2024) · Discover Mental Health · doi:10.1007/s44192-023-00058-x · Cited by 11
Reward Reinforcement Creates Enduring Facilitation of Goal-directed Behavior
Ballard, I. C., Waskom, M., Nix, K. C., & D’Esposito, M. (2024) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_02150 · Cited by 12
Distinguishing Discrete and Continuous Behavioral Variability Using Warped Autoregressive HMMs
Costacurta, J. C., Duncker, L., Sheffer, B., Gillis, W. F., Weinreb, C., Markowitz, J. E., Datta, S. R., Williams, A., & Linderman, S. W. (2022) · neural information processing systems · doi:10.52202/068431-1731 · Cited by 11
Kaplan, F., & Oudeyer, P. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511994838.011 · Cited by 10
The role of DAT1 gene on the rapid detection of task novelty
García-García, M., Barceló, F., Clemente, I. C., & Escera, C. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.10.005 · Cited by 11
Aberg, K. C., Doell, K. C., & Schwartz, S. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.05.023 · Cited by 10
Bayesian Behavioral Systems Theory
Freestone, D. M., & Balcı, F. (2019) · Behavioural Processes · doi:10.1016/j.beproc.2019.103904 · Cited by 12
The Basal Ganglia and the Encoding of Value
Doya, K., & Kimura, M. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00026-9 · Cited by 11
Kregiel, J., Gołębiowska, J., Popik, P., & Ryguła, R. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.10.020 · Cited by 10
RetractedBoedecker, J., Lampe, T., & Riedmiller, M. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00739 · Cited by 14
Decision-Making and Impulse Control Disorders in Parkinson's Disease
Voon, V. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00024-5 · Cited by 10
High monetary reward rates and caloric rewards decrease temporal persistence
Fung, B. J., Bode, S., & Murawski, C. (2017) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.2759 · Cited by 10
Bending time: The role of affective appraisal in time perception.
Uusberg, A., Naar, R., Tamm, M., Kreegipuu, K., & Gross, J. J. (2018) · Emotion · doi:10.1037/emo0000397 · Cited by 10
Pavlovian-instrumental interactions in active avoidance: The bark of neutral trials
Lloyd, K., & Dayan, P. (2018) · Brain Research · doi:10.1016/j.brainres.2018.10.011 · Cited by 9
Self-citationIigaya, K., Ahmadian, Y., Sugrue, L. P., Corrado, G. S., Loewenstein, Y., Newsome, W. T., & Fusi, S. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/141309 · Cited by 11
Dopamine-independent state inference mediates expert reward guided decision makingPreprint
Blanco-Pozo, M., Akam, T. E., & Walton, M. E. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.06.25.449995 · Cited by 10
Effects of reward history on decision-making and movement vigorPreprint
Sukumar, S., Shadmehr, R., & Ahmed, A. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.22.453376 · Cited by 10
Reward-Bases: Dopaminergic Mechanisms for Adaptive Acquisition of Multiple Reward TypesPreprint
Millidge, B., Song, Y.-H., Lak, A., Walton, M., & Bogacz, R. (2023) · bioRxiv · doi:10.1101/2023.05.09.540067 · Cited by 7
Complementary contributions of dorsal and ventral striatum to cost-benefit vigor adaptationsPreprint
Morvan, T., Timmel, Z., Eloy, C., & Robbe, D. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.31.596850 · Cited by 11
Modulation of Dopamine for Adaptive Learning: a Neurocomputational Model
Inglis, J. B., Valentin, V. V., & Ashby, F. G. (2020) · Computational Brain & Behavior · doi:10.1007/s42113-020-00083-x · Cited by 10
Lucchi, F., Lloyd, B., & Nieuwenhuis, S. (2023) · Psychophysiology · doi:10.1111/psyp.14484 · Cited by 9
Vigilance, arousal, and acetylcholine: Optimal control of attention in a simple detection task
Chebolu, S., Dayan, P., & Lloyd, K. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010642 · Cited by 10
Self-citationWakabayashi, K. T., Feja, M., Leigh, M. P. K., Baindur, A. N., Suarez, M., Meyer, P., & Bass, C. E. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.08.017 · Cited by 9
Proximity and Expectancy Modulate Response Vigor After Reward Omission
Chen, Z., Reimer, C. B., & Verbruggen, F. (2020) · Collabra Psychology · doi:10.1525/collabra.18184 · Cited by 8
Changes in saccade kinematics associated with the value and novelty of a stimulus
Reppert, T. R., Choi, J. E. S., Haith, A. M., & Shadmehr, R. (2012) · Conference on Information Sciences and Systems · doi:10.1109/ciss.2012.6310914 · Cited by 9
Rats delay gratification during a time-based diminishing returns task.
Schuweiler, D. R., Rao, M., Pribut, H. J., & Roesch, M. R. (2021) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000305 · Cited by 9
Motor Cortex Encodes A Temporal Difference Reinforcement Learning ProcessPreprint
Tarigoppula, V. S. A., Choi, J. S., Hessburg, J. P., McNiel, D., Marsh, B. T., & Francis, J. T. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/257337 · Cited by 10
DORSAL RAPHE NUCLEUS CONTROLS MOTIVATIONAL STATE TRANSITIONS IN MONKEYSPreprint
Priestley, L., Chiew, M., Shahdloo, M., Mahmoodi, A., Cheng, X., Cleveland, R. O., Rushworth, M. F. S., & Khalighinejad, N. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.02.13.580224 · Cited by 9
Dopamine and reward-related vigor in younger and older adults
Hird, E., Beierholm, U., de Boer, L., Axelsson, J., Riklund, K., Nyberg, L., Beckman, L., & Guitart-Masip, M. (2022) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2022.06.003 · Cited by 11
Rodman, A. M., Powers, K. E., Kastman, E. K., Kabotyanski, K. E., Stark, A. M., Mair, P., & Somerville, L. H. (2022) · Psychological Science · doi:10.1177/09567976221121351 · Cited by 12
Policy abstraction as a predictor of cognitive effort avoidance.
Sayalı, C., Rubin‐McGregor, J., & Badre, D. (2023) · Journal of Experimental Psychology General · doi:10.1037/xge0001449 · Cited by 10
Kaduk, K., Henry, T., Guitton, J., Meunier, M., Thura, D., & Hadj‐Bouziane, F. (2023) · Neuropharmacology · doi:10.1016/j.neuropharm.2023.109736 · Cited by 8
Dopamine builds and reveals reward-associated latent behavioral attractors
Naudé, J., Sarazin, M., Mondoloni, S., Hannesse, B., Vicq, É., Amegandjin, F., Mourot, A., Fauré, P., & Delord, B. (2024) · Nature Communications · doi:10.1038/s41467-024-53976-x · Cited by 11
Song, M. R., & Fellous, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089494 · Cited by 8
Weitemier, A. Z., & McHugh, T. J. (2016) · Brain Research · doi:10.1016/j.brainres.2016.12.002 · Cited by 9
Entrainment for attentional selection in Parkinson's disease
Woerd, E. S. T., Oostenveld, R., de Lange, F. P., & Praamstra, P. (2017) · Cortex · doi:10.1016/j.cortex.2017.11.011 · Cited by 8
Neural Representation of Costs and Rewards in Decision Making
Chen, Y. (2021) · Brain Sciences · doi:10.3390/brainsci11081096 · Cited by 9
Dopaminergic involvement in effort-based but not impulsive reward processing in smokers
Freeman, T. P., Morgan, C. J. A., Brandner, B., Almahdi, B., & Curran, H. V. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2012.10.016 · Cited by 8
McLaughlin, P. J., Winston, K. M., Swezey, L. A., Vemuri, K. V., Makriyannis, A., & Salamone, J. D. (2010) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2010.04.009 · Cited by 8
Rewarding Effects of Operant Dry-Licking Behavior on Neuronal Firing in the Nucleus Accumbens Core
Patrono, E., Matsumoto, J., Nishimaru, H., Takamura, Y., Chinzorig, I. C., Ono, T., & Nishijo, H. (2017) · Frontiers in Pharmacology · doi:10.3389/fphar.2017.00536 · Cited by 8
Vassena, E., Filip Van Opstal, A., Goethals, I., & Verguts, T. (2019) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2019.09.016 · Cited by 8
Perez, O. D., & Dickinson, A. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/807800 · Cited by 8
Roeser, A. C., Gadagkar, V., Das, A., Puzerey, P. A., Kardon, B., & Goldberg, J. H. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/822817 · Cited by 8
Generalized cue reactivity in rat dopamine neurons after opioids
Lehmann, C. M., Miller, N. E., Nair, V. S., Costa, K. M., Schoenbaum, G. M., & Moussawi, K. (2025) · Nature Communications · doi:10.1038/s41467-024-55504-3 · Cited by 7
Striatal Dopamine Actions and Movement: Inferences from Parkinson Disease
Albin, R. L., Brissenden, J. A., Lee, T. G., & Leventhal, D. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.0022-25.2025 · Cited by 7
Feng, Z., Nagase, A. M., & Morita, K. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.660595 · Cited by 9
Reframing dopamine: A controlled controller at the limbic-motor interface
Lloyd, K., & Dayan, P. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011569 · Cited by 8
Self-citationSocial environment-based opportunity costs dictate when people leave social interactions
Gabay, A. S., Pisauro, M. A., O’Nell, K. C., Lynch, R., & Apps, M. A. J. (2024) · Communications Psychology · doi:10.1038/s44271-024-00094-5 · Cited by 10
From work stress to disease: A computational model
de Grave, R. B., Hasselman, F., & Bijleveld, E. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263966 · Cited by 10
Toschi, C., Robbins, T. W., & Dalley, J. W. (2023) · Experimental Brain Research · doi:10.1007/s00221-022-06502-8 · Cited by 7
Kalhan, S., Garrido, M. I., Hester, R., & Redish, A. D. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.09.032 · Cited by 9
Kareken, D. A. (2018) · Brain Imaging and Behavior · doi:10.1007/s11682-017-9822-8 · Cited by 7
Biernacki, K., Myers, C. E., Cole, S. L., Cavanagh, J. F., & Baker, T. E. (2022) · European Journal of Neuroscience · doi:10.1111/ejn.15905 · Cited by 9
Multi-Neuronal Refractory Period Adapts Centrally Generated Behaviour to Reward
Harris, C. A., Buckley, C. L., Nowotny, T., Passaro, P. A., Seth, A. K., Kemenes, G., & O’Shea, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042493 · Cited by 7
Motor Pathways, Basal Ganglia Physiology, and Pathophysiology
Bergman, H., Katabi, S., Slovik, M., Deffains, M., Arkadir, D., Israel, Z. H., & Eitan, R. (2015) · Brain stimulation · doi:10.1002/9781118568323.ch3 · Cited by 7
Khamassi, M. (2007) · HAL · doi:10.13140/rg.2.1.4065.8004 · Cited by 7
A Neuroeconomic Framework for Creative CognitionPreprint
Lin, H., & Vartanian, O. A. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5pqy6 · Cited by 7
Seiler, J. L., Zhuang, X., Nelson, A., & Lerner, T. N. (2024) · Experimental Neurology · doi:10.1016/j.expneurol.2024.114693 · Cited by 6
Impaired reward sensitivity in Parkinson's depression is unresponsive to dopamine treatment
Costello, H., Yamamori, Y., Kieslich, K., Murphy, M., Bobyreva, K., Schrag, A. E., Howard, R. J., & Roiser, J. P. (2025) · Brain · doi:10.1093/brain/awaf098 · Cited by 11
Lubianiker, N., Koren, T., Djerassi, M., Sirotkin, M., Singer, N., Jalon, I., Lerner, A., Sar-El, R., Sharon, H., Shahar, M., et al. (2026) · Nature Medicine · doi:10.1038/s41591-025-04140-5 · Cited by 11
Quang, H., Heron, C. J. L., Balleine, B. W., Nguyen, T.-V., Nguyen, T.-Q., Nguyen, M.-N., Kumfor, F., & McDonald, S. (2023) · Neuroscience · doi:10.1016/j.neuroscience.2023.07.026 · Cited by 6
The successor representation subserves hierarchical abstraction for goal-directed behavior
Wientjes, S., & Holroyd, C. B. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011312 · Cited by 8
Biology of Motivation, Dopamine, and Brain Circuits That Mediate Pleasure
Freed, W. J. (2022) · Springer eBooks · doi:10.1007/978-3-031-10477-0_11 · Cited by 7
Craving money? Evidence from the laboratory and the field
Payzan-LeNestour, É., & Doran, J. S. (2024) · Science Advances · doi:10.1126/sciadv.adi5034 · Cited by 7
Evidence for interacting but decoupled controls of decisions and movements in nonhuman primates
Saleri, C., & Thura, D. (2024) · Journal of Neurophysiology · doi:10.1152/jn.00087.2024 · Cited by 6
A reward self-bias leads to more optimal foraging for ourselves than others
Contreras-Huerta, L. S., Pisauro, M. A., Küchenhoff, S., Gekiere, A., Heron, C. J. L., Lockwood, P. L., & Apps, M. A. J. (2024) · Scientific Reports · doi:10.1038/s41598-024-69452-x · Cited by 6
Deep Brain Stimulation in Schizophrenia
Kuhn, J., Bodatsch, M., Sturm, V., Lenartz, D., Klosterkötter, J., Uhlhaas, P. J., Winter, C., & Gruendler, T. O. J. (2014) · Activitas Nervosa Superior · doi:10.1007/bf03379611 · Cited by 6
Perspectives Emerging From Neuroscience on How People Become Addicted and What to Do About It
Littrell, J. L. (2010) · Journal of Social Work Practice in the Addictions · doi:10.1080/1533256x.2010.498741 · Cited by 6
Learning and Reversal Learning in the Subcortical Limbic System: A Computational Model
Thompson, A. M., Porr, B., & Wörgötter, F. (2010) · Adaptive Behavior · doi:10.1177/1059712309353612 · Cited by 6
Boredom, dopamine, and the thrill of psychosis: psychiatry in a new key.
Branković, S. (2015) · PubMed · Cited by 7
Metadata
- Authors
- Niv, Y., Daw, N. D., Joel, D., & Dayan, P.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Gatsby Computational Neuroscience Unit (GB)
- Tel Aviv University (IL)
- Corresponding author
- Niv, Yael
- Venue
- Psychopharmacology
- Published
- 2006-10-10
- Volume
- 191
- Issue
- 3
- Pages
- 507-520
- ISSN
- 0033-3158 (ISSN-L)
- 1432-2072
- OpenAlex
- W2156952192
- Semantic Scholar
- e1625352c7b6e275ec9a63984a5af25a98032671
- Cited by
- 1,133
- References
- 116
- Citations by year
- 2026: 49 · 2025: 65 · 2024: 75 · 2023: 59 · 2022: 76 · 2021: 80 · 2020: 64 · 2019: 63 · 2018: 69 · 2017: 69 · 2016: 84 · 2015: 52 · 2014: 62 · 2013: 61 · 2012: 44
- FWCI
- 9.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Psychopharmacology (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Gatsby Charitable Foundation
- Hebrew University of Jerusalem
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- tonic dopamine, response vigor, opportunity cost, optimal control, average-reward reinforcement learning, response latency, nucleus accumbens, striatum, free-operant behavior, reward rate, motivation, phasic dopamine
- MeSH terms
- Animals, Brain, Choice Behavior, Conditioning, Operant, Dopamine, Models, Psychological, Motivation, Reaction Time, Reinforcement, Psychology, Reinforcement Schedule, Reward, Neurotransmitter Agents, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review