Cited by 966Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesReinforcement Learning in Robotics

The DOI matches its Crossref record; 76 of the 77 references it cites were found in a registry or an index.

Computational roles for dopamine in behavioural control

Montague, P. Read, Hyman, Steven E., Cohen, Jonathan D.·2004·Nature

DOI 10.1038/nature03015

Open this paper in CoChat — free account

Abstract

Neuromodulators such as dopamine have a central role in cognitive disorders. In the past decade, biological findings on dopamine function have been infused with concepts taken from computational theories of reinforcement learning. These more abstract approaches have now been applied to describe the biological algorithms at play in our brains when we form value judgements and make choices. The application of such quantitative models has opened up new fields, ripe for attack by young synthesizers and theoreticians.

Integrity signals

Registry

Crossref · 10.1038/nature03015

Cites

76 of 76 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Self-citation
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citation
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/c2009-0-62209-1 · Cited by 6,035
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats.
Di Chiara, G., & Imperato, A. (1988) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.85.14.5274 · Cited by 4,733
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
From Neuropsychology to Mental Structure
Shallice, T. (1988) · doi:10.1017/cbo9780511526817 · Cited by 4,072
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Implications of Normal Brain Development for the Pathogenesis of Schizophrenia
Weinberger, D. R. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800190080012 · Cited by 3,724
Neuro-dynamic Programming
(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601
A neural system for error detection and compensation
Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00586.x · Cited by 2,862
A psychomotor stimulant theory of addiction.
Wise, R. A., & Bozarth, M. A. (1987) · Psychological Review · doi:10.1037/0033-295x.94.4.469 · Cited by 2,747
Models of Working Memory: Mechanisms of Active Maintenance and Executive Control
Miyake, A., & Shah, P. (1999) · Cited by 2,404
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Reinforcement learning
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Self-citation
10. Reinforcement learning
Zhang, B., Li, C., & Lin, N. (2020) · De Gruyter eBooks · doi:10.1515/9783110595567-011 · Cited by 1,948
The Architecture of Cognitive Control in the Human Prefrontal Cortex
Koechlin, É., Ody, C., & Kouneiher, F. (2003) · Science · doi:10.1126/science.1088545 · Cited by 1,939
The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses
Gehring, W. J., & Willoughby, A. R. (2002) · Science · doi:10.1126/science.1066893 · Cited by 1,884
Principles of Frontal Lobe Function
Stuss, D. T. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195134971.001.0001 · Cited by 1,731
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Neuro-Dynamic Programming
Bertsekas, D. P. (2001) · Springer eBooks · doi:10.1007/0-306-48332-7_333 · Cited by 1,519
Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque
Miller, E. K., Erickson, C. A., & Desimone, R. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-16-05154.1996 · Cited by 1,474
Control of Cognitive Processes: Attention and Performance XVIII
Monsell, S., & Driver, J. (2000) · UCL Discovery (University College London) · Cited by 1,451
The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
FMRI visualization of brain activity during a monetary incentive delay task
Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000) · NeuroImage · doi:10.1006/nimg.2000.0593 · Cited by 1,414
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Addiction and the brain: The neurobiology of compulsion and its persistence
Hyman, S. E., & Malenka, R. C. (2001) · Nature reviews. Neuroscience · doi:10.1038/35094560 · Cited by 1,337
Self-citation
Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Acute effects of cocaine on human brain activity and emotion
Breiter, H. C., Gollub, R. L., Weisskoff, R. M., Kennedy, D. N., Makris, N., Berke, J. D., Goodman, J. M., Kantor, H. L., Gastfriend, D. R., Riorden, J. P., et al. (1997) · Neuron · doi:10.1016/s0896-6273(00)80374-8 · Cited by 1,270
Self-citation
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Addiction, Dopamine, and the Molecular Mechanisms of Memory
Berke, J. D., & Hyman, S. E. (2000) · Neuron · doi:10.1016/s0896-6273(00)81056-9 · Cited by 1,184
Self-citation
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,161
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Theoretical Neuroscience
Chklovskii, D. B. (2002) · Neuron · doi:10.1016/s0896-6273(02)00703-1 · Cited by 1,092
Beautiful Faces Have Variable Reward Value
Aharon, I., Etcoff, N., Ariely, D., Chabris, C. F., O'Connor, E., & Breiter, H. C. (2001) · Neuron · doi:10.1016/s0896-6273(01)00491-3 · Cited by 1,087
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Neural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994
Self-citation
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Self-citation
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine
Salamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817
A Network Model of Catecholamine Effects: Gain, Signal-to-Noise Ratio, and Behavior
Servan‐Schreiber, D., Printz, H., & Cohen, J. D. (1990) · Science · doi:10.1126/science.2392679 · Cited by 783
Self-citation
Dissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740
Predictability modulates human brain response to reward
Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02793.2001 · Cited by 711
Self-citation
Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems
EVERITT, B. J., PARKINSON, J. A., OLMSTEAD, M. C., ARROYO, M., ROBLEDO, P., & ROBBINS, T. W. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09280.x · Cited by 708
A Neural Mechanism for Working and Recognition Memory in Inferior Temporal Cortex
Miller, E. K., Li, L., & Desimone, R. (1991) · Science · doi:10.1126/science.1962197 · Cited by 706
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506
Behaviorism at Fifty
Skinner, B. F. (1963) · Science · doi:10.1126/science.140.3570.951 · Cited by 488
Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals
Holroyd, C. B., Nieuwenhuis, S., Yeung, N., Nystrom, L. E., Mars, R. B., COLES, M. G. H., & Cohen, J. D. (2004) · Nature Neuroscience · doi:10.1038/nn1238 · Cited by 486
Self-citation
Error Monitoring Using External Feedback: Specific Roles of the Habenular Complex, the Reward System, and the Cingulate Motor Area Revealed by Functional Magnetic Resonance Imaging
Ullsperger, M., & von Cramon, D. Y. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-10-04308.2003 · Cited by 484
Disorganisation of behaviour after frontal lobe damage
Duncan, J. (1986) · Cognitive Neuropsychology · doi:10.1080/02643298608253360 · Cited by 452
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451
Self-citation
Errors in reward prediction are reflected in the event-related brain potential
Holroyd, C. B., Nieuwenhuis, S., Yeung, N., & Cohen, J. D. (2003) · Neuroreport · doi:10.1097/00001756-200312190-00037 · Cited by 438
Self-citation
A computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Montague, P. R. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 416
Self-citation
Gambling Urges in Pathological Gambling: A Functional Magnetic Resonance Imaging Study
Potenza, M. N., Steinberg, M. A., Skudlarski, P., Fulbright, R. K., Lacadie, C. M., Wilber, M. K., Rounsaville, B. J., Gore, J. C., & Wexler, B. E. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.8.828 · Cited by 414
Context dependence of the event‐related brain potential associated with reward and punishment
Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2004.00152.x · Cited by 388
Self-citation
Sensitivity of Electrophysiological Activity from Medial Frontal Cortex to Utilitarian and Performance Feedback
Nieuwenhuis, S. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh034 · Cited by 336
Morphological analysis of dendritic spine development in primary cultures of hippocampal neurons
Papa, M., Bundman, M. C., Greenberger, V., & Segal, M. (1995) · Journal of Neuroscience · doi:10.1523/jneurosci.15-01-00001.1995 · Cited by 330
A Biologically Based Computational Model of Working Memory
O’Reilly, R. C., Braver, T. S., & Cohen, J. D. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9781139174909.014 · Cited by 327
Self-citation
Activation of the human brain by monetary reward
Thut, G., Schultz, W., Roelcke, U., Nienhusmeier, M., Missimer, J. H., Maguire, R. P., & Leenders, K. L. (1997) · Neuroreport · doi:10.1097/00001756-199703240-00033 · Cited by 273
Value-dependent selection in the brain: Simulation in a synthetic neural model
Friston, K. J., Tononi, G., Reeke, G. N., Sporns, O., & Edelman, G. M. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90592-4 · Cited by 268
Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control
O'Reilly, R. C. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.3.246 · Cited by 241
Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions.
Ikemoto, S., & Panksepp, J. (1996) · Behavioral Neuroscience · doi:10.1037//0735-7044.110.2.331 · Cited by 219
The effect of lesions of the insular cortex on instrumental conditioning: evidence for a role in incentive memory
Balleine, B. W., & Dickinson, A. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-23-08954.2000 · Cited by 218
Dynamic Gain Control of Dopamine Delivery in Freely Moving Animals
Montague, P. R., McClure, S. M., Baldwin, P. R., Phillips, P. E. M., Budygin, E. A., Stuber, G. D., Kilpatrick, M., & Wightman, R. M. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.4279-03.2004 · Cited by 174
Self-citation
Perspectives of Event-Related Potentials Research
Karmos, G. (1995) · Medical Entomology and Zoology · Cited by 165
A Computational Role for Dopamine Delivery in Human Decision-Making
Egelman, D. M., Person, C., & Montague, P. R. (1998) · Journal of Cognitive Neuroscience · doi:10.1162/089892998563022 · Cited by 96
Self-citation
Learning representations in a gated prefrontal cortex model of dynamic task switching
Rougier, N. P., & O’Reilly, R. C. (2002) · Cognitive Science · doi:10.1207/s15516709cog2604_4 · Cited by 80
Reinforcement Learning
Poole, D. L., & Mackworth, A. K. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009258227.018 · Cited by 24
Dopamine Receptors and Antipsychotic Drugs
Seeman, P. M. (1997) · Nihon shinkei seishin yakurigaku zasshi · Cited by 1

Research works printed but not linked: 2

Rescorla, R. A. & Wagner A. R. in Classical Conditioning 2: Current Research and Theory (eds Black, A. H. & Prokasy, W. F.) 64–69 (Appleton Century-Crofts, New York, 1972).
Bayer, H. M. & Glimcher, P. W. Subjective estimates of objective rewards: using economic discounting to link behavior and brain. Soc. Neurosci. Abstr. 28, 358.6 (2002).

Sorted by citations

An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Self-citation
Autoradiographic localization of dopamine D1 and D2 receptors in rat nucleus accumbens: Resistance to differential rearing conditions
Bardo, M. T., & Hammer, R. P. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90226-e · Cited by 3,229
NEURAL MECHANISMS OF ADDICTION: The Role of Reward-Related Learning and Memory
Hyman, S. E., Malenka, R. C., & Nestler, E. J. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113009 · Cited by 2,647
Self-citation
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Empathic neural responses are modulated by the perceived fairness of others
Singer, T., Seymour, B., O'Doherty, J. P., Stephan, K. E., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature04271 · Cited by 1,726

See all 966

Authors: Montague, P. R., Hyman, S. E., & Cohen, J. D.
Affiliations: Baylor College of Medicine (US)
Harvard University (US)
University of Pittsburgh (US)
ORCID: Montague, P. Read
Hyman, Steven E.
Cohen, Jonathan D.
Venue: Nature
Publisher: Springer Science and Business Media LLC
Published: 2004-10
Volume: 431
Issue: 7010
Pages: 760-767
ISSN: 0028-0836 (ISSN-L)
1476-4687
DOI: 10.1038/nature03015
OpenAlex: W2165368112
Semantic Scholar: 16cd7a24d117f61da645fba1b4cc31839dff2805
Cited by: 966
References: 77
Citations by year: 2026: 6 · 2025: 13 · 2024: 19 · 2023: 36 · 2022: 21 · 2021: 26 · 2020: 32 · 2019: 31 · 2018: 39 · 2017: 40 · 2016: 42 · 2015: 49 · 2014: 51 · 2013: 56 · 2012: 82
FWCI: 4.14
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Nature (publishedVersion)
PubMed (publishedVersion)
RePEc: Research Papers in Economics (submittedVersion)
UCL Discovery (University College London) (submittedVersion)
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords: dopamine, neuromodulation, reinforcement learning, computational model, value judgments, decision-making, behavioral control, cognitive disorders
MeSH terms: Animals, Choice Behavior, Cognition, Dopamine, Humans, Learning, Models, Neurological, Schizophrenia, Substance-Related Disorders

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Computational roles for dopamine in behavioural control

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks