Tonic dopamine: opportunity costs and the control of response vigor

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268

A neural substrate of prediction and reward

Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388

Predictive reward signal of dopamine neurons

Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564

What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127

Neuro-dynamic Programming

(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601

Dopamine, learning and motivation.

Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 2×

Specious reward: A behavioral theory of impulsiveness and impulse control.

Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708

ON THE LAW OF EFFECT 1

Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533

Risk-taking bias in human decision-making is encoded via a right–left brain push–pull system

Sacré, P., Kerr, M. S. D., Subramanian, S., Fitzgerald, Z. B., Kahn, K., Johnson, M. A., Niebur, E., Eden, U. T., Gonzalez-Martinez, J. A., Gale, J. T., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1811259115 · Cited by 28

The Dopaminergic Midbrain Mediates an Effect of Average Reward on Pavlovian Vigor

Rigoli, F., Chew, B., Dayan, P., & Dolan, R. J. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00972 · Cited by 30

Microstimulation of the Human Substantia Nigra Alters Reinforcement Learning

Ramayya, A. G., Misra, A., Baltuch, G. H., & Kahana, M. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.5445-13.2014 · Cited by 33

Accumbal dopamine and serotonin activity throughout acquisition and expression of place conditioning: correlative relationships with preference and aversion

Weitemier, A. Z., & Murphy, N. P. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06652.x · Cited by 30

Hippocampus and Prefrontal Cortex Predict Distinct Timescales of Activation in the Human Ventral Tegmental Area

Murty, V. P., Ballard, I. C., & Adcock, R. A. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw005 · Cited by 29

Complementary Control over Habits and Behavioral Vigor by Phasic Activity in the Dorsolateral Striatum

Crego, A. C. G., Štoček, F., Marchuk, A. G., Carmichael, J. E., van der Meer, M. A. A., & Smith, K. S. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.1313-19.2019 · Cited by 31

Variability in Action Selection Relates to Striatal Dopamine 2/3 Receptor Availability in Humans: A PET Neuroimaging Study Using Reinforcement Learning and Active Inference Models

Adams, R. A., Moutoussis, M., Nour, M. M., Dahoun, T., Lewis, D. J., Illingworth, B. J. G., Veronese, M., Mathys, C. D., de Boer, L., Guitart‐Masip, M., et al. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz327 · Cited by 29

Dopamine release, diffusion and uptake: A computational model for synaptic and volume transmission

Wiencke, K., Horstmann, A., Mathar, D., Villringer, A., & Neumann, J. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008410 · Cited by 32

Neuromodulation and Neurophysiology on the Timescale of Learning and Decision-Making

Grossman, C. D., & Cohen, J. Y. (2022) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092021-125059 · Cited by 30

Effort Reinforces Learning

Jarvis, H., Stevenson, I., Huynh, A. Q., Babbage, E., Coxon, J. P., & Chong, T. T. ‐. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.2223-21.2022 · Cited by 30

The Role of Value Systems in Decision Making

Dayan, P. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/9780262195805.003.0003 · Cited by 29

Scarce Means with Alternative Uses: Robbins’ Definition of Economics and Its Extension to the Behavioral and Neurobiological Study of Animal Decision Making

Shizgal, P. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00020 · Cited by 30

Longitudinal decline in striatal dopamine transporter binding in Parkinson’s disease: associations with apathy and anhedonia

Costello, H., Yamamori, Y., Reeves, S., Schrag, A., Howard, R., & Roiser, J. (2022) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2022-330790 · Cited by 31

To work or not to work

Kroemer, N. B., Burrasch, C., & Hellrung, L. (2016) · Progress in brain research · doi:10.1016/bs.pbr.2016.06.009 · Cited by 31

Motor Function and Motivation

Salamone, J. D. (2010) · Elsevier eBooks · doi:10.1016/b978-0-08-045396-5.00247-5 · Cited by 28

Striatal dopamine release tracks the relationship between actions and their consequences

Hart, G., Burton, T. J., Nolan, C. R., & Balleine, B. W. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.113828 · Cited by 29

Cognitive representations of intracranial self-stimulation of midbrain dopamine neurons depend on stimulation frequency

Millard, S. J., Hoang, I. B., Sherwood, S., Taira, M., Reyes, V. M., Greer, Z., O’Connor, S. L., Wassum, K. M., James, M. H., Barker, D. J., et al. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01643-1 · Cited by 27

Striatal low-threshold spiking interneurons locally gate dopamine

Holly, E. N., Davatolhagh, M. F., España, R. A., & Fuccillo, M. V. (2021) · Current Biology · doi:10.1016/j.cub.2021.06.081 · Cited by 29

Striatal BOLD and midfrontal theta power express motivation for action

Algermissen, J., Swart, J. C., Scheeringa, R., Cools, R., & den Ouden, H. E. M. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab391 · Cited by 30

Proactive Action Preparation: Seeing Action Preparation as a Continuous and Proactive Process

Pezzulo, G., & Ognibene, D. (2012) · Motor Control · doi:10.1123/mcj.16.3.386 · Cited by 27

Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area

Vitay, J., & Hamker, F. H. (2014) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2014.00004 · Cited by 28

Neuronal calcium sensor-1 deletion in the mouse decreases motivation and dopamine release in the nucleus accumbens

Ng, E., Varaschin, R. K., Su, P., Browne, C. J., Hermainski, J., Foll, B. L., Pongs, O., Liu, F., Trudeau, L., Roder, J., et al. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.12.037 · Cited by 27

Rationalizable Irrationalities of Choice

Dayan, P. (2014) · Topics in Cognitive Science · doi:10.1111/tops.12082 · Cited by 29

Models of neuromodulation for computational psychiatry

Iglesias, S., Tomiello, S., Schneebeli, M., & Stephan, K. E. (2016) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1420 · Cited by 28

Resource‐rational approach to meta‐control problems across the lifespan

Ruel, A., Devine, S., & Eppinger, B. (2021) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1556 · Cited by 26

Learning to maximize reward rate: a model based on semi-Markov decision processes

Khodadadi, A., Fakhari, P., & Busemeyer, J. R. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00101 · Cited by 26

Optimal response rates in humans and rats.

Freestone, D. M., Balcı, F., Simen, P., & Church, R. M. (2014) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000049 · Cited by 26

Neural Correlates of Motor Vigour and Motor Urgency During Exercise

Rauch, L., Schönbächler, G., & Noakes, T. D. (2013) · Sports Medicine · doi:10.1007/s40279-013-0025-1 · Cited by 25

Contributions of the basal ganglia to action sequence learning and performance

Garr, E. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.09.017 · Cited by 30

Motivational state, reward value, and Pavlovian cues differentially affect skilled forelimb grasping in ratsPreprint

Mosberger, A. C., de Clauser, L., Kasper, H., & Schwab, M. E. (2016) · Learning & Memory · doi:10.1101/lm.039537.115 · Cited by 25

Mesoscale cortex-wide neural dynamics predict self-initiated actions in mice several seconds prior to movement

Mitelut, C., Zhang, Y., Sekino, Y., Boyd, J. D., Bollanos, F., Swindale, N. V., Silasi, G., Saxena, S., & Murphy, T. H. (2022) · eLife · doi:10.7554/elife.76506 · Cited by 26

Opposing effects of reward and punishment on human vigor

Griffiths, B., & Beierholm, U. (2017) · Scientific Reports · doi:10.1038/srep42287 · Cited by 25

Social motivation in schizophrenia: The impact of oxytocin on vigor in the context of social and nonsocial reinforcement.

Fulford, D., Treadway, M. T., & Woolley, J. D. (2018) · Journal of Abnormal Psychology · doi:10.1037/abn0000320 · Cited by 26

Cumulative Effects of Social Stress on Reward-Guided Actions and Prefrontal Cortical Activity

Barthas, F., Hu, M. Y., Siniscalchi, M. J., Ali, F., Mineur, Y. S., Picciotto, M. R., & Kwan, A. C. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.02.008 · Cited by 25

Interplay between midbrain and dorsal anterior cingulate regions arbitrates lingering reward effects on memory encoding

Aberg, K. C., Kramer, E. E., & Schwartz, S. (2020) · Nature Communications · doi:10.1038/s41467-020-15542-z · Cited by 25

Learning in anticipation of reward and punishment: perspectives across the human lifespan

Betts, M. J., Richter, A., de Boer, L., Tegelbeckers, J., Perosa, V., Baumann, V., Chowdhury, R., Dolan, R. J., Seidenbecher, C. I., Schott, B. H., et al. (2020) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2020.08.011 · Cited by 24

Distinct value computations support rapid sequential decisions

Mah, A., Schiereck, S. S., Bossio, V., & Constantinople, C. M. (2023) · Nature Communications · doi:10.1038/s41467-023-43250-x · Cited by 25

Appetitive motivational deficits in individuals with Parkinson's Disease

Shore, D. M., Rafal, R. D., & Parkinson, J. A. (2011) · Movement Disorders · doi:10.1002/mds.23736 · Cited by 25

Reducing falls in Parkinson's disease: interactions between donepezil and the 5‐HT6 receptor antagonist idalopirdine on falls in a rat model of impaired cognitive control of complex movements

Kucinski, A. J., de Jong, I. E. M., & Sarter, M. F. (2016) · European Journal of Neuroscience · doi:10.1111/ejn.13354 · Cited by 25

Reward Anticipation Dynamics during Cognitive Control and Episodic Encoding: Implications for Dopamine

Chiew, K. S., Stanek, J. K., & Adcock, R. A. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00555 · Cited by 26

To Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity

Beeler, J. A., & Mourra, D. (2018) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2018.00006 · Cited by 28

A new view of the effect of dopamine receptor antagonism on operant performance for rewarding brain stimulation in the rat

Trujillo‐Pisanty, I., Conover, K. L., & Shizgal, P. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3328-x · Cited by 24

Effort responses to suboptimal reward cues are related to striatal dopaminergic functioning

Pas, P., Custers, R., Bijleveld, E., & Vink, M. (2014) · Motivation and Emotion · doi:10.1007/s11031-014-9434-1 · Cited by 24

The neural basis of delayed gratification

Gao, Z., Wang, H., Lu, C., Lu, T., Froudist‐Walsh, S., Chen, M., Wang, X., Hu, J., & Sun, W. (2021) · Science Advances · doi:10.1126/sciadv.abg6611 · Cited by 25

Synaptic inhibition in the lateral habenula shapes reward anticipation

Lalive, A. L., Congiu, M., Lewis, C., Groos, D., Clerke, J. A., Tchenio, A., Ge, Y., Helmchen, F., & Mameli, M. (2022) · Current Biology · doi:10.1016/j.cub.2022.02.035 · Cited by 22

The Arousal-motor Hypothesis of Dopamine Function: Evidence that Dopamine Facilitates Reward Seeking in Part by Maintaining Arousal

Kaźmierczak, M., & Nicola, S. M. (2022) · Neuroscience · doi:10.1016/j.neuroscience.2022.07.008 · Cited by 26

Impulse control disorder in Parkinson’s disease is associated with abnormal frontal value signalling

Tichelaar, J. G., Sayalı, C., Helmich, R. C. G., & Cools, R. (2023) · Brain · doi:10.1093/brain/awad162 · Cited by 23

Acetylcholine and noradrenaline enhance foraging optimality in humans

Doren, N., Chung, H.-K., Grueschow, M., Quednow, B. B., Hayward-Koennecke, H. K., Jetter, A., & Tobler, P. N. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2305596120 · Cited by 23

Effects of reward and effort history on decision making and movement vigor during foraging

Sukumar, S., Shadmehr, R., & Ahmed, A. A. (2023) · Journal of Neurophysiology · doi:10.1152/jn.00092.2023 · Cited by 24

Valenced action/inhibition learning in humans is modulated by a genetic variant linked to dopamine D2 receptor expression

Richter, A., Guitart‐Masip, M., Barman, A., Libeau, C., Behnisch, G., Czerney, S., Schanze, D., Assmann, A., Klein, M., Düzel, E., et al. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00140 · Cited by 25

Reinforcement learning and higher level cognition: Introduction to special issue

Daw, N. D., & Frank, M. J. (2009) · Cognition · doi:10.1016/j.cognition.2009.09.005 · Cited by 24

Processing of action- but not stimulus-related prediction errors differs between active and observational feedback learning

Kobza, S., & Bellebaum, C. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.10.036 · Cited by 23

Distinct dynamics and intrinsic properties in ventral tegmental area populations mediate reward association and motivation

Elum, J. E., Szelenyi, E. R., Juarez, B., Murry, A. D., Loginov, G. I., Zamorano, C. A., Gao, P., Wu, G., Ng-Evans, S., Yee, J. X., et al. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.114668 · Cited by 26

Control over patch encounters changes foraging behavior

Hall-McMaster, S., Dayan, P., & Schuck, N. W. (2021) · iScience · doi:10.1016/j.isci.2021.103005 · Cited by 23

“Liking” as an early and editable draft of long-run affective value

Dayan, P. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001476 · Cited by 27

Risky business: rhesus monkeys exhibit persistent preferences for risky options

Xu, E. R., & Kralik, J. D. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00258 · Cited by 24

Tiefe Hirnstimulation bei der Schizophrenie

Kuhn, J., Bodatsch, M., Sturm, V., Lenartz, D., Klosterkötter, J., Uhlhaas, P. J., Winter, C., & Gruendler, T. O. J. (2011) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/s-0031-1281733 · Cited by 23

Internal-Time Temporal Difference Model for Neural Value-Based Decision Making

Nakahara, H., & Kaveri, S. R. (2010) · Neural Computation · doi:10.1162/neco_a_00049 · Cited by 25

Remedial effects of motivational incentive on declining cognitive control in healthy aging and Parkinson’s disease

Harsay, H. A. (2010) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2010.00144 · Cited by 25

A spatially nonselective baseline signal in parietal cortex reflects the probability of a monkey’s success on the current trial

Zhang, M., Wang, X., & Goldberg, M. E. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1407540111 · Cited by 21

Catecholaminergic modulation of the cost of cognitive control in healthy older adults

Froböse, M. I., Westbrook, A., Bloemendaal, M., Aarts, E., & Cools, R. (2020) · PLoS ONE · doi:10.1371/journal.pone.0229294 · Cited by 22

Modeling the effects of motivation on choice and learning in the basal ganglia

van Swieten, M. M. H., & Bogacz, R. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007465 · Cited by 23

Dopaminergic challenge dissociates learning from primary versus secondary sources of information

Rybicki, A. J., Sowden, S., Schuster, B. A., & Cook, J. L. (2022) · eLife · doi:10.7554/elife.74893 · Cited by 21

Paradoxical enhancement of choice reaction time performance in patients with major depression

Chase, H. W., Michael, A., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2009) · Journal of Psychopharmacology · doi:10.1177/0269881109104883 · Cited by 25

Dopamine Encodes Retrospective Temporal Information in a Context-Independent Manner

Fonzi, K. M., Lefner, M. J., Phillips, P. E. M., & Wanat, M. J. (2017) · Cell Reports · doi:10.1016/j.celrep.2017.07.076 · Cited by 22

The Hidden Life of the Basal Ganglia

Bergman, H. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/14075.001.0001 · Cited by 23

Dopaminergic Modulation of Dynamic Emotion Perception

Schuster, B. A., Sowden, S., Rybicki, A. J., Fraser, D. S., Press, C., Holland, P. W. H., & Cook, J. L. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.2364-21.2022 · Cited by 27

A Computational View on the Nature of Reward and Value in Anhedonia

Huys, Q. J. M., & Browning, M. D. (2021) · Current topics in behavioral neurosciences · doi:10.1007/7854_2021_290 · Cited by 27

Chronically dysregulated corticosterone impairs dopaminergic transmission in the dorsomedial striatum by sex-divergent mechanisms

Holloway, A. L., Schaid, M. D., & Lerner, T. N. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-023-01551-1 · Cited by 22

The Role of Physical Exercise in Opioid Substitution Therapy: Mechanisms of Sequential Effects

Psarianos, A., Chryssanthopοulos, C., Paparrigopoulos, T. J., & Philippou, Α. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24054763 · Cited by 25

Dopamine neuron activity encodes the length of upcoming contralateral movement sequences

Mendonça, M., da Silva, J. A., Hernández, L. F., Castela, I., Obeso, J. A., & Costa, R. M. (2024) · Current Biology · doi:10.1016/j.cub.2024.01.067 · Cited by 21

Parkinson's Disease: Fighting the Will?: Figure 1.

Niv, Y., & Rivlin‐Etzion, M. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.4010-07.2007 · Cited by 22

Exploring the relationship of reward and punishment in reinforcement learning

Lowe, R. J., & Tom Ziemke, B. (2013) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2013.6615000 · Cited by 22

Activation of Dopamine Receptors in the Nucleus Accumbens Promotes Sucrose-Reinforced Cued Approach Behavior

du Hoffmann, J., & Nicola, S. M. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00144 · Cited by 24

Phasic Stimulation of Midbrain Dopamine Neuron Activity Reduces Salt Consumption

Sandhu, E., Fernando, A. B. P., Irvine, E. E., Tossell, K., Kokkinou, M., Glegola, J. A., Smith, M. A., Howes, O. D., Withers, D. J., & Ungless, M. A. (2018) · eNeuro · doi:10.1523/eneuro.0064-18.2018 · Cited by 22

State-change decisions and dorsomedial prefrontal cortex: the importance of time

Kolling, N., & O’Reilly, J. X. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.06.017 · Cited by 29

Striatal reactivity to reward under threat-of-shock and working memory load in adults at increased familial risk for major depression: A preliminary study

Gaillard, C., Guillod, M., Ernst, M., Federspiel, A., Schoebi, D., Recabarren, R. E., Ouyang, X., Mueller‐Pfeiffer, C., Horsch, A., Homan, P., et al. (2020) · NeuroImage Clinical · doi:10.1016/j.nicl.2020.102193 · Cited by 25

Major depression symptom severity associations with willingness to exert effort and patch foraging strategy

Bustamante, L. A., Barch, D. M., Solis, J., Oshinowo, T., Grahek, I., Konova, A. B., Daw, N. D., & Cohen, J. D. (2024) · Psychological Medicine · doi:10.1017/s0033291724002691 · Cited by 26

Dopamine firing plays a dual role in coding reward prediction errors and signaling motivation in a working memory task

Sarno, S., Beirán, M., Falcó-Roget, J., Diaz-deLeon, G., Rossi-Pool, R., Romo, R., & Parga, N. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2113311119 · Cited by 22

Corticolimbic catecholamines in stress: a computational model of the appraisal of controllability

Fiore, V. G., Mannella, F., Mirolli, M., Latagliata, E. C., Valzania, A., Cabib, S., Dolan, R. J., Puglisi‐Allegra, S., & Baldassarre, G. (2014) · Brain Structure and Function · doi:10.1007/s00429-014-0727-7 · Cited by 21

Involvement of Human Internal Globus Pallidus in the Early Modulation of Cortical Error-Related Activity

Ruiz, M. H., Huebl, J., Schönecker, T., Kupsch, A. R., Yarrow, K., Krauss, J. K., Schneider, G., & Kühn, A. A. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht002 · Cited by 23

The unfolding action model of initiation times, movement times, and movement paths.

Calderon, C. B., Gevers, W., & Verguts, T. (2018) · Psychological Review · doi:10.1037/rev0000110 · Cited by 21

The interplay of Pavlovian and instrumental processes in devaluation experiments: a computational embodied neuroscience model tested with a simulated rat

Mannella, F., Mirolli, M., & Baldassarre, G. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511779145.006 · Cited by 21

Estrogen modulates reward prediction errors and reinforcement learning

Golden, C. E. M., Martin, A. C., Kaur, D., Mah, A., Levy, D. H., Yamaguchi, T., Lasek, A. W., Lin, D., Aoki, C. J., & Constantinople, C. M. (2025) · Nature Neuroscience · doi:10.1038/s41593-025-02104-z · Cited by 26

Robert Rescorla: Time, Information and Contingency.

Gallistel, C. R. (2021) · Revista de historia de la psicología · doi:10.5093/rhp2021a3 · Cited by 19

What Can Reinforcement Learning Models of Dopamine and Serotonin Tell Us about the Action of Antidepressants?

Lan, D. C. L., & Browning, M. D. (2022) · Computational Psychiatry · doi:10.5334/cpsy.83 · Cited by 17

Strategic stabilization of arousal boosts sustained attention

de Gee, J. W., Mridha, Z., Hudson, M., Shi, Y., Ramsaywak, H., Smith, S., Karediya, N., Thompson, M., Jaspe, K., Jiang, H., et al. (2024) · Current Biology · doi:10.1016/j.cub.2024.07.070 · Cited by 27

Different Dopaminergic Dysfunctions Underlying Parkinsonian Akinesia and Tremor

Caligiore, D., Mannella, F., & Baldassarre, G. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00550 · Cited by 20

Beyond the average: The role of variable reward sensitivity in eating disorders

Neuser, M. P., Kühnel, A., Svaldi, J., & Kroemer, N. B. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.112971 · Cited by 21

Optimal indolence: a normative microscopic approach to work and leisure

Niyogi, R. K., Breton, Y.-A., Solomon, R. B., Conover, K. L., Shizgal, P., & Dayan, P. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0969 · Cited by 20

Modafinil increases reward salience in a slot machine game in low and high impulsivity pathological gamblers

Smart, K. A., Desmond, R. C., Poulos, C. X., & Zack, M. H. (2013) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.05.015 · Cited by 22

Integrating Benefits and Costs in Decision Making

Wallis, J. D., & Rushworth, M. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00022-x · Cited by 19

Dopamine Depletion Affects Vocal Acoustics and Disrupts Sensorimotor Adaptation in Songbirds

Saravanan, V., Hoffmann, L. A., Jacob, A., Berman, G. J., & Sober, S. J. (2019) · eNeuro · doi:10.1523/eneuro.0190-19.2019 · Cited by 22

A Neural Mechanism for the Opportunity Cost of TimePreprint

Constantino, S. M., Dalrymple, J., Gilbert, R., Varanese, S., Rocco, A. D., & Daw, N. D. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/173443 · Cited by 27

Reward integration in prefrontal-cortical and ventral-hippocampal nucleus accumbens inputs cooperatively modulates engagement

Iyer, E. S., Vitaro, P., Wu, S. S., Muir, J., Tse, Y. C., Cvetkovska, V., & Bagot, R. C. (2025) · Nature Communications · doi:10.1038/s41467-025-58858-4 · Cited by 20

Maladaptive explore/exploit trade-offs in schizophrenia

Speers, L. J., & Bilkey, D. K. (2023) · Trends in Neurosciences · doi:10.1016/j.tins.2023.02.001 · Cited by 17

Aversive Pavlovian Responses Affect Human Instrumental Motor Performance

Rigoli, F., Pavone, E. F., & Pezzulo, G. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00134 · Cited by 19

Striatal Dopamine, Externalizing Proneness, and Substance Abuse

Byrne, K. A., Patrick, C. J., & Worthy, D. A. (2016) · Clinical Psychological Science · doi:10.1177/2167702615618163 · Cited by 20

Chemical neuromodulation of cognitive control avoidance

Froböse, M. I., & Cools, R. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.01.027 · Cited by 20

The credit assignment problem in cortico‐basal ganglia‐thalamic networks: A review, a problem and a possible solution

Rubin, J. E., Vich, C., Clapp, M., Noneman, K. K., & Verstynen, T. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14745 · Cited by 24

Psychopharmacology DOI 10.1007/s00213-006-0502-4 ORIGINAL INVESTIGATION Tonic dopamine: opportunity costs and the control of response vigor

Niv, Y., Daw, N. D., Joel, D., Dayan, P., Niv, Y., Daw, N. D., Dayan, P., & Joel, D. (2006)

Cost, Benefit, Tonic, Phasic

Niv, Y. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.018 · Cited by 187

How fast to work: Response vigor, motivation and tonic dopamine

Niv, Y., Daw, N. D., & Dayan, P. (2005) · MPG.PuRe (Max Planck Society) · Cited by 103

Vigor in the Face of Fluctuating Rates of Reward: An Experimental Examination

Guitart‐Masip, M., Beierholm, U., Dolan, R. J., Düzel, E., & Dayan, P. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00090 · Cited by 89

P (2006) How fast to work: Response vigor, motivation and tonic dopamine. Advances in neural information processing systems 18

Niv, Y., Daw, N. D., & Dayan, P. (2016)