The DOI matches its Crossref record; 76 of the 77 references it cites were found in a registry or an index.
Computational roles for dopamine in behavioural control
Abstract
Neuromodulators such as dopamine have a central role in cognitive disorders. In the past decade, biological findings on dopamine function have been infused with concepts taken from computational theories of reinforcement learning. These more abstract approaches have now been applied to describe the biological algorithms at play in our brains when we form value judgements and make choices. The application of such quantitative models has opened up new fields, ripe for attack by young synthesizers and theoreticians.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These findings are consistent with the different functions associated with distinct regions of the striatum: afferent projections to dorsal striatum are thought to be crucial for learning correct actions so as to maximize reward, whereas projections to ventral striatum, including nucleus accumbens, have a key function in reward prediction and pavlovian learning18-20,23,24.”
From Empathic neural responses are modulated by the perceived fairness of others (2006) · cites this paper as [24]
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Self-citationA neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationReinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/c2009-0-62209-1 · Cited by 6,035
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Di Chiara, G., & Imperato, A. (1988) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.85.14.5274 · Cited by 4,733
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
From Neuropsychology to Mental Structure
Shallice, T. (1988) · doi:10.1017/cbo9780511526817 · Cited by 4,072
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Research works printed but not linked: 2
- Rescorla, R. A. & Wagner A. R. in Classical Conditioning 2: Current Research and Theory (eds Black, A. H. & Prokasy, W. F.) 64–69 (Appleton Century-Crofts, New York, 1972).
- Bayer, H. M. & Glimcher, P. W. Subjective estimates of objective rewards: using economic discounting to link behavior and brain. Soc. Neurosci. Abstr. 28, 358.6 (2002).
Cited by
Sorted by citations
Items 901–964 of 964
Almela, P., Zaragoza, J. N., García-Carmona, J. A., Mora, L., Hidalgo, J. M., Milanés, M. V., & Laorden, M.-L. (2013) · PLoS ONE · doi:10.1371/annotation/3708ead6-a61a-48b4-aca4-c45b3b7dd292
Eureka Team (2010) · Eureka · doi:10.29173/eureka8022
Goodluck, H. (2020) · Edinburgh University Press eBooks · doi:10.1515/9781474458177-005
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0010
Antrieb, Intentionsbildung — Handlungs- und Bewegungsstörungen
(2007) · Springer eBooks · doi:10.1007/978-3-540-37254-7_7
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0024
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0017
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0022
Deng, Z., Zhang, Y., & Cheng, Z. (2012) · Scientia Sinica Informationis · doi:10.1360/zf2012-42-1-83
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0005
Computational Psychiatry and the Bayesian Brain
Friston, K. J., & Dolan, R. J. (2017) · Oxford University Press eBooks · doi:10.1093/med/9780190681425.003.0072
Schultz, W. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.727168688.793565158
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0013
Hsu, M., & Preuschoff, K. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-397025-1.00260-8
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0011
(2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.002.0008
(2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.002.0006
(2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.002.0005
(2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.002.0004
(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.002.0003
(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.002.0006
(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.002.0009
(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.002.0004
(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.002.0007
(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.002.0005
Computation with Serotonergic Modulation
Lewis, M. (2022) · Springer eBooks · doi:10.1007/978-1-0716-1006-0_633
Computation with Serotonergic Modulation
Lewis, M. (2015) · Springer eBooks · doi:10.1007/978-1-4614-6675-8_633
Blocking, Overshadowing and Related Concepts
Cassaday, H. J. (2010) · Springer eBooks · doi:10.1007/978-3-540-68706-1_217
Dopaminergic Control of Actions and Habits
Naneix, F., & Coutureau, É. (2022) · Neuromethods · doi:10.1007/978-1-0716-2799-0_14
Ghafari, T., Mazzetti, C., Garner, K., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.03.547019
Memory-specific encoding activities of the ventral tegmental area dopamine and GABA neuronsPreprint
Glykos, V., & Fujisawa, S. (2023) · eLife · doi:10.7554/elife.89743.1
Liu, Y., Wang, D., Wang, L., Yu, C., Wang, S., Huang, F. L., Wang, T., Jin, S., & Zhou, Q. (2023) · Research Square · doi:10.21203/rs.3.rs-3539931/v1
Memory-specific encoding activities of the ventral tegmental area dopamine and GABA neuronsPreprint
Glykos, V., & Fujisawa, S. (2024) · eLife · doi:10.7554/elife.89743.2
Wahn – inhaltliche Denkstörungen
Reischies, F. M. (2024) · Springer eBooks · doi:10.1007/978-3-662-68299-9_14
Antrieb,Intentionsbildung–Handlungs-und Bewegungsstörungen
Reischies, F. M. (2024) · Springer eBooks · doi:10.1007/978-3-662-68299-9_7
Reduced brain connectivity underlying value-based choices and outcomes in stimulant use disorder
Nestor, L. J., Lim, T. V., Robbins, T. W., & Ersche, K. D. (2024) · NeuroImage Clinical · doi:10.1016/j.nicl.2024.103676
Kopytin, G., Kondratenko, A., Moiseeva, V., et al. (2024) · International Conference Neurotechnologies and Neurointerfaces (CNN) · doi:10.1109/cnn63506.2024.10705830
Walter, M., & Schmidt, A. (2024) · Elsevier eBooks · doi:10.1016/b978-3-437-21074-7.00003-4
Biologically plausible gated recurrent neural networks for working memory and learning-to-learn
van den Berg, A. R., Roelfsema, P. R., & Bohté, S. M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0316453
Drive, Intention Formation—Action and Movement Disorders
Reischies, F. M. (2025) · Psychopathology · doi:10.1007/978-3-662-70293-2_7
Kognitive und neuronale Grundlagen von Motivation, Belohnung und Selbstkontrolle
Goschke, T. (2025) · Springer eBooks · doi:10.1007/978-3-662-69368-1_10
Neural dynamics reveal foraging-like computations in the frontal cortexPreprint
Ungvarszki, Z., Goussi-Denjean, C., Székely, A., Orbán, G., di Volo, M., & Procyk, E. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.09.29.679289
Neural dynamics in ventrolateral prefrontal cortex underlie learning from feedbackPreprint
Lu, R., Kadohisa, M., Kusunoki, M., Mitchell, D. J., Woolgar, A., Buckley, M. J., & Duncan, J. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.11.16.688684
Barney, S. J. (2020) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/4332515
Prediction Errors in Neural Processing: Imaging in Humans
Lohrenz, T. M., & Montague, P. R. (2009) · Elsevier eBooks · doi:10.1016/b978-008045046-9.01556-4
Self-citationCognitive processes and emotion cue processing in introvertive anhedonia
Skillicorn, D. (2010) · Cardiff Metropolitan Research Repository (Cardiff Metropolitan University) · doi:10.25401/cardiffmet.20497068
Wiebe, S. A., Chang, M. Y., Huggenvik, J. I., Jameson, T. L., & Espy, K. A. (2006) · Lincoln (University of Nebraska)
Evolution of Neuromarketing to Unlock Consumer Behavior
Choudhury, D. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-1152-4.ch001
Dopamine et contrôle de l’action : implication et maturation de la voie mésocorticale chez le rat
Naneix, F. (2011) · theses.fr (ABES) · doi:10.70675/001d4221ze950z4b8dz8178z8e2211b1bc4c
Exploration et vérification : études comportementales et neurophysiologiques du cortex préfrontal
Stoll, F. M. (2014) · theses.fr (ABES) · doi:10.70675/460ef294z3e03z40f6zafe4z4b1b927beada
Damasse, J.-B. (2018) · theses.fr (ABES) · doi:10.70675/193e9600zb9f9z4bcazb4c1z4369b97dce0c
Cortex préfrontal et flexibilité comportementale : implication de la noradrénaline
Cerpa, J.-C. (2019) · theses.fr (ABES) · doi:10.70675/d4f665b9z3943z4c88z9b4bzbf11cd7cf8d1
Le choix de la cocaïne, une question de délai
Canchy, L. (2020) · theses.fr (ABES) · doi:10.70675/343233aaz22bez4109za45bz4a1f2c63ee4f
Diversité des effets de la nicotine sur les neurones dopaminergiques de l’aire tegmentale ventrale
Nguyen, C. (2020) · theses.fr (ABES) · doi:10.70675/57dc4740z36f1z4ee7z87e7z960af8c4a43e
Goutaudier, R. (2022) · theses.fr (ABES) · doi:10.70675/6619b466z54bfz41e3z8a90zf0967825d579
Impact of aging on human decision-making in ecological conditions
Aubert, J. D. S. (2023) · theses.fr (ABES) · doi:10.70675/f7143113zd412z4b5fza432z1032ef6ea209
Dynamiques dopaminergiques dans la prise de décision : rôle dans la variabilité et l’exploration
Côme, M. (2023) · theses.fr (ABES) · doi:10.70675/a7b03d10z7e3cz45a1z817bza6c6344893af
Yadav, A., Malhotra, P., & Sharma, V. P. (2026) · Journal of Consumer Behaviour · doi:10.1002/cb.70229
Liu, Y., Wang, D., Wang, L., Wang, S., Chen, Z., Wang, T., Jin, S., Zhou, Q., & Yang, L. (2026) · Brain and Behavior · doi:10.1002/brb3.71630
Evolution of Trust in Economic Systems
Bossomaier, T. R. J., Harré, M., & Thompson, J. (2009) · Springer eBooks · doi:10.1007/978-88-470-1083-3_1
Metadata
- Authors
- Montague, P. R., Hyman, S. E., & Cohen, J. D.
- Affiliations
- Baylor College of Medicine (US)
- Harvard University (US)
- University of Pittsburgh (US)
- Venue
- Nature
- Published
- 2004-10
- Volume
- 431
- Issue
- 7010
- Pages
- 760-767
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2165368112
- Semantic Scholar
- 16cd7a24d117f61da645fba1b4cc31839dff2805
- Cited by
- 966
- References
- 77
- Citations by year
- 2026: 6 · 2025: 13 · 2024: 19 · 2023: 36 · 2022: 21 · 2021: 26 · 2020: 32 · 2019: 31 · 2018: 39 · 2017: 40 · 2016: 42 · 2015: 49 · 2014: 51 · 2013: 56 · 2012: 82
- FWCI
- 4.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- dopamine, neuromodulation, reinforcement learning, computational model, value judgments, decision-making, behavioral control, cognitive disorders
- MeSH terms
- Animals, Choice Behavior, Cognition, Dopamine, Humans, Learning, Models, Neurological, Schizophrenia, Substance-Related Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
