The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Cost, Benefit, Tonic, Phasic: What Do Response Rates Tell Us about Dopamine and Motivation?
Abstract
The role of dopamine in decision making has received much attention from both the experimental and computational communities. However, because reinforcement learning models concentrate on discrete action selection and on phasic dopamine signals, they are silent as to how animals decide upon the rate of their actions, and they fail to account for the prominent effects of dopamine on response rates. We suggest an extension to reinforcement learning models in which response rates are optimally determined by balancing the tradeoff between the cost of fast responding and the benefit of rapid reward acquisition. The resulting behavior conforms well with numerous characteristics of free‐operant responding. More importantly, this framework highlights a role for a tonic signal corresponding to the net rate of rewards, in determining the optimal rate of responding. We hypothesize that this critical quantity is conveyed by tonic levels of dopamine, explaining why dopaminergic manipulations exert a global affect on response rates. We further suggest that the effects of motivation on instrumental rates of responding are mediated through its influence on the net reward rate, implying a tight coupling between motivational states and tonic dopamine. The relationships between phasic and tonic dopamine signaling, and between directing and energizing effects of motivation, as well as the implications for motivational control of habitual and goal‐directed instrumental action selection, are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Cited by
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381
The Nucleus Accumbens: An Interface Between Cognition, Emotion, and Action
Floresco, S. B. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115159 · Cited by 938
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Inside the brain of an elite athlete: the neural processes that support high achievement in sports
Yarrow, K., Brown, P., & Krakauer, J. W. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2672 · Cited by 637
Motivation of extended behaviors by anterior cingulate cortex
Holroyd, C. B., & Yeung, N. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.008 · Cited by 618
Baliki, M. N., Geha, P. Y., Fields, H. L., & Apkarian, A. V. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.002 · Cited by 555
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501
Student interest generated during an inquiry skills lesson
Palmer, D. H. (2009) · Journal of Research in Science Teaching · doi:10.1002/tea.20263 · Cited by 376
Human Pavlovian–Instrumental Transfer
Talmi, D., Seymour, B., Dayan, P., & Dolan, R. J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4028-07.2008 · Cited by 301
The anatomy of choice: dopamine and decision-making.
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0481 · Cited by 289
Prefrontal cortex mediation of cognitive enhancement in rewarding motivational contexts
Jimura, K., Locke, H. S., & Braver, T. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1002007107 · Cited by 277
Steiger, T. K., & Bunzeck, N. (2017) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2017.00001 · Cited by 268
Valence and salience contribute to nucleus accumbens activation
Cooper, J. C., & Knutson, B. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.08.009 · Cited by 256
A computational reward learning account of social media engagement
Lindström, B., Bellander, M., Schultner, D. T., Chang, A., Tobler, P. N., & Amodio, D. M. (2021) · Nature Communications · doi:10.1038/s41467-020-19607-x · Cited by 185
The role of cognitive effort in subjective reward devaluation and risky decision-making
Apps, M. A. J., Grima, L. L., Manohar, S., & Husain, M. (2015) · Scientific Reports · doi:10.1038/srep16880 · Cited by 145
Role of Dopamine D2 Receptors in Human Reinforcement Learning
Eisenegger, C., Naef, M., Linssen, A., Clark, L., Gandamaneni, P. K., Müller, U., & Robbins, T. W. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.84 · Cited by 134
Dynamic Computation of Incentive Salience: “Wanting” What Was Never “Liked”
Tindell, A. J., Smith, K. S., Berridge, K. C., & Aldridge, J. W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2499-09.2009 · Cited by 124
Human ventromedial prefrontal lesions alter incentivisation by reward
Manohar, S. G., & Husain, M. (2016) · Cortex · doi:10.1016/j.cortex.2016.01.005 · Cited by 62
Eckart, C., Fuentemilla, L., Bauch, E. M., & Bunzeck, N. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.011 · Cited by 43
Goedhoop, J., Arbab, T., & Willuhn, I. (2023) · The Journal of Neuroscience · doi:10.1523/jneurosci.1527-22.2023 · Cited by 24
Fortin, S. M., & Roitman, M. F. (2017) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.11.021 · Cited by 11
Metadata
- Authors
- NIV, Y.
- Venue
- Annals of the New York Academy of Sciences
- Publisher
- Wiley
- Published
- 2007-05
- Volume
- 1104
- Issue
- 1
- Pages
- 357-376
- ISSN
- 0077-8923 (ISSN-L)
- 1749-6632
- OpenAlex
- W2162580191
- Cited by
- 183
- References
- 32
- FWCI
- 3.02
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.