Cited by 966Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesReinforcement Learning in Robotics

The DOI matches its Crossref record; 76 of the 77 references it cites were found in a registry or an index.

Computational roles for dopamine in behavioural control

Montague, P. Read, Hyman, Steven E., Cohen, Jonathan D.·2004·Nature

DOI 10.1038/nature03015

Open this paper in CoChat — free account

Abstract

Neuromodulators such as dopamine have a central role in cognitive disorders. In the past decade, biological findings on dopamine function have been infused with concepts taken from computational theories of reinforcement learning. These more abstract approaches have now been applied to describe the biological algorithms at play in our brains when we form value judgements and make choices. The application of such quantitative models has opened up new fields, ripe for attack by young synthesizers and theoreticians.

Integrity signals

Registry

Crossref · 10.1038/nature03015

Cites

76 of 76 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Self-citation
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citation
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/c2009-0-62209-1 · Cited by 6,035
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats.
Di Chiara, G., & Imperato, A. (1988) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.85.14.5274 · Cited by 4,733
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
From Neuropsychology to Mental Structure
Shallice, T. (1988) · doi:10.1017/cbo9780511526817 · Cited by 4,072
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027

Flagged first, then by citations

Show all 77 references

1 of the 77 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

Rescorla, R. A. & Wagner A. R. in Classical Conditioning 2: Current Research and Theory (eds Black, A. H. & Prokasy, W. F.) 64–69 (Appleton Century-Crofts, New York, 1972).
Bayer, H. M. & Glimcher, P. W. Subjective estimates of objective rewards: using economic discounting to link behavior and brain. Soc. Neurosci. Abstr. 28, 358.6 (2002).

Sorted by citations

Items 501–600 of 964

Methylene blue intercalated aptamer to amplify signals toward sensitively electrochemical detection of dopamine released from living Parkinson's disease model cells
Tang, C., Zou, Z., Liang, T., Yuan, C., Gao, J., Tang, K., & Li, C. M. (2022) · Sensors and Actuators Reports · doi:10.1016/j.snr.2022.100080 · Cited by 19
Trust-Your-Doctor: A Simple Heuristic in Need of a Proper Social Environment
Wegwarth, O., & Gigerenzer, G. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.003.0003 · Cited by 20
Altered sensitization patterns to sweet food stimuli in patients recovered from anorexia and bulimia nervosa
Wagner, A., Simmons, A. N., Oberndorfer, T. A., Frank, G., McCurdy, D., Fudge, J. L., Yang, T. T., Paulus, M. P., & Kaye, W. H. (2015) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2015.10.010 · Cited by 19
A high-resolution fMRI approach to characterize functionally distinct neural pathways within dopaminergic midbrain and nucleus accumbens during reward and salience processing
Richter, A., Reinhard, F., Krämer, B., & Gruber, O. (2020) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2020.05.005 · Cited by 20
New Approaches to Addiction Treatment Based on Learning and Memory
Kiefer, F., & Dinter, C. (2011) · Current topics in behavioral neurosciences · doi:10.1007/978-3-642-28720-6_147 · Cited by 19
Simple Heuristics: The Foundations of Adaptive Social Behavior
Hertwig, R., & Hoffrage, U. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.003.0001 · Cited by 20
The Brain as a Hierarchical OrganizationPreprint
Brocas, I., & Carrillo, J. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.900245 · Cited by 215
A neural algorithm for Drosophila linear and nonlinear decision-making
Zhao, F., Zeng, Y., Guo, A., Su, H., & Xu, B. (2020) · Scientific Reports · doi:10.1038/s41598-020-75628-y · Cited by 17
Task-Specific Neural Representations of Generalizable Metacognitive Control Signals in the Human Dorsal Anterior Cingulate Cortex
Su, J., Jia, W., & Wan, X. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.1283-21.2021 · Cited by 16
Sleep deprivation attenuates neural responses to outcomes from risky decision‐making
Mao, T., Fang, Z., Chai, Y., Deng, Y., Rao, J., Quan, P., Goel, N., Basner, M., Guo, B., Dinges, D. F., et al. (2023) · Psychophysiology · doi:10.1111/psyp.14465 · Cited by 16
Pathogenic Impact of Fatty Acid-Binding Proteins in Parkinson’s Disease—Potential Biomarkers and Therapeutic Targets
Kawahata, K., & Fukunaga, K. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms242317037 · Cited by 17
Eye Movements from Laboratory to Life
Tatler, B. W. (2013) · Springer eBooks · doi:10.1007/978-3-319-02868-2_2 · Cited by 18
5 Dopaminergic Modulation of Cognition in Human Aging
Li, S., Lindenberger, U., Nyberg, L. H., Heekeren, H. R., & Bäckman, L. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195328875.003.0005 · Cited by 20
Detecting contingencies: An infomax approach
Butko, N. J., & Movellan, J. R. (2010) · Neural Networks · doi:10.1016/j.neunet.2010.09.001 · Cited by 18
Quantitative PET Analysis of the Dopamine D2 Receptor Agonist Radioligand 11C-(R)-2-CH3O-N-n-Propylnorapomorphine in the Human Brain
Otsuka, T., Ito, H., Halldin, C., Takahashi, H., Takano, H., Arakawa, R., Okumura, M., Kodaka, F., Miyoshi, M., Sekine, M., et al. (2009) · Journal of Nuclear Medicine · doi:10.2967/jnumed.108.058503 · Cited by 18
What are goals? And if so, how many?
Rolf, M., & Asada, M. (2015) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2015.7346167 · Cited by 18
How do you know you have a drug problem? The role of knowledge of negative consequences in explaining drug choice in humans and rats
Pickard, H., & Ahmed, S. H. (2016) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198727224.003.0002 · Cited by 25
Functionalised carbon nano spheres modified electrode for simultaneous determination of dopamine and uric acid
Dey, M. K., & Satpati, A. K. (2017) · Journal of Electroanalytical Chemistry · doi:10.1016/j.jelechem.2017.01.035 · Cited by 18
Misdeed of the need: towards computational accounts of transition to addiction
Keramati, M., Ahmed, S. H., & Gutkin, B. S. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.014 · Cited by 19
Information and Living Systems: Philosophical and Scientific Perspectives
(2011) · doi:10.7551/mitpress/9780262201742.001.0001 · Cited by 18
Learning from positive and negative rewards in a spiking neural network model of basal ganglia
Jitsev, J., Morrison, A., & Tittgemeyer, M. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252834 · Cited by 17
Beetles, boxes and brain cells: neural mechanisms underlying valuation and learning
Salzman, C. D., Belova, M. A., & Paton, J. J. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.10.016 · Cited by 18
Electrophysiological properties of catecholaminergic neurons in the norepinephrine-deficient mouse
Paladini, C. A., Beckstead, M. J., & Weinshenker, D. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2006.10.032 · Cited by 18
Understanding identification-based trust in the light of affiliative bonding: Meta-analytic neuroimaging evidence
Wu, Y. H., Veerareddy, A., Lee, M. R., Bellucci, G., Camilleri, J. A., Eickhoff, S. B., & Krüeger, F. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.09.053 · Cited by 17
Addiction-induced plasticity in underlying neural circuits
Kourosh‐Arami, M., Komaki‬, A., & Gholami, M. (2022) · Neurological Sciences · doi:10.1007/s10072-021-05778-y · Cited by 20
From genes to behavior: placing cognitive models in the context of biological pathways
Sáez, I., Set, E., & Hsu, M. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00336 · Cited by 17
Selective Determination of Dopamine in Pharmaceuticals and Human Urine Using Carbon Quantum Dots as a Fluorescent Probe
Yang, X., Tian, F., Wen, S., et al. (2021) · Processes · doi:10.3390/pr9010170 · Cited by 17
Psychological and Neuroscientific Connections with Reinforcement Learning
Shah, A. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_16 · Cited by 17
Aging and risk taking: toward an integration of cognitive, emotional, and neurobiological perspectives
Lee, T., & Shao, R. (2014) · Neuroscience and Neuroeconomics · doi:10.2147/nan.s35914 · Cited by 19
Espresso Reward Learning, Hold the Dopamine: Theoretical Comment on Robinson et al. (2005).
Berridge, K. C. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.1.336 · Cited by 17
Prefrontal Markers and Cognitive Performance Are Dissociated during Progressive Dopamine Lesion
Wilson, C. R. E., Vezoli, J., Stoll, F. M., Faraut, M. C. M., Leviel, V., Knoblauch, K., & Procyk, E. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002576 · Cited by 19
A Psychopathological Approach to Safety Engineering in AI and AGI
Behzadan, V., Munir, A., & Yampolskiy, R. V. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99229-7_46 · Cited by 17
Possible contributions of a novel form of synaptic plasticity inAplysiato reward, memory, and their dysfunctions in mammalian brainPreprint
Hawkins, R. D. (2013) · Learning & Memory · doi:10.1101/lm.031237.113 · Cited by 17
Midbrain fMRI: Applications, Limitations and Challenges
Düzel, E., Guitart-Masip, M., Maass, A., Hämmerer, D., Betts, M. J., Speck, O., Weiskopf, N., & Kanowski, M. (2015) · Biological Magnetic Resonance · doi:10.1007/978-1-4899-7591-1_20 · Cited by 16
The Monetary Incentive Delay (MID) Task Induces Changes in Sensory Processing: ERP Evidence
Krugliakova, E., Gorin, A., Fedele, T., Юрьевич, Ш. Ю., Moiseeva, V., Klucharev, V. A., & Шестакова, А. Н. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00382 · Cited by 18
Executive Function
Hughes, C. H. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-397267-5.00062-5 · Cited by 23
A model of behavioral treatments for self-mutilation behavior in Lesch–Nyhan syndrome
Zilli, E. A., & Hasselmo, M. E. (2008) · Neuroreport · doi:10.1097/wnr.0b013e3282f5f76f · Cited by 16
Migraine Mistakes
Borsook, D., Aasted, C. M., Burstein, R., & Becerra, L. R. (2013) · The Neuroscientist · doi:10.1177/1073858413503711 · Cited by 16
Regularization of languages by adults and children: A mathematical framework
Rische, J. L., & Komarova, N. L. (2015) · Cognitive Psychology · doi:10.1016/j.cogpsych.2015.10.001 · Cited by 16
Reversal Learning in Humans and Gerbils: Dynamic Control Network Facilitates Learning
Jarvers, C., Brosch, T., Brechmann, A., Woldeit, M. L., Schulz, A. L., Ohl, F. W., Lommerzheim, M., & Heiko Neumann, B. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00535 · Cited by 17
Lateral prefrontal anodal transcranial direct current stimulation augments resolution of auditory perceptual-attentional conflicts
Adelhöfer, N., Gohil, K., Passow, S., Beste, C., & Li, S. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.05.009 · Cited by 15
Using negative feedback to guide behavior: Impairments on the first 4 cards of the Wisconsin Card Sorting Test predict negative symptoms of schizophrenia
Vogel, S. J., Strauss, G. P., & Allen, D. N. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.07.052 · Cited by 16
Sex hormonal modulation of hyperbolic discount factor in men.
Takahashi, T., Sakaguchi, K., Oki, M., & Hasegawa, T. (2008) · Journal of Neuroscience Psychology and Economics · doi:10.1037/h0091587 · Cited by 16
A model study on the circuit mechanism underlying decision-making in Drosophila
Wu, Z., & Guo, A. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.01.002 · Cited by 15
Neural Dysfunction in Cognitive Control Circuits in Persons at Clinical High-Risk for Psychosis
Colibazzi, T., Horga, G., Wang, Z., Huo, Y., Corcoran, C. M., Klahr, K., Brucato, G., Girgis, R. R., Gill, K. E., Abi‐Dargham, A., et al. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2015.273 · Cited by 16
Rotenone impairs hippocampal neuronal activity in a rat model of Parkinson’s disease
Darbinyan, L., Hambardzumyan, L. E., Սիմոնյան, Կ. Վ., Chavushyan, V. A., Manukyan, L., & Sarkisian, V. H. (2017) · Pathophysiology · doi:10.1016/j.pathophys.2017.01.001 · Cited by 17
Sex and the dopaminergic system: Insights from addiction studies
Woodcock, E. A., Zakiniaeiz, Y., Morris, E. D., & Cosgrove, K. (2020) · Handbook of clinical neurology · doi:10.1016/b978-0-444-64123-6.00011-4 · Cited by 15
Novel composites of nano-metal–organic frameworks (IRMOF-3) and silver nanoparticles for the ultra-sensitive performance of SERS sensing and optical fiber modes
Tran, N. L. N., Hoang, D. V., Phạm, A. T. T., et al. (2023) · Journal of Science Advanced Materials and Devices · doi:10.1016/j.jsamd.2023.100584 · Cited by 15
Evolution of Dopamine-Related Systems: Biosynthesis, Degradation and Receptors
Ma, X., Wang, Z., & Zhang, X. (2010) · Journal of Molecular Evolution · doi:10.1007/s00239-010-9392-5 · Cited by 15
Akt1 deficiency modulates reward learning and reward prediction error in mice
Chen, Y. ‐., Chen, Y., Hsu, Y., Chang, W. ‐., Hsiao, C. K., Min, M., & Lai, W. (2011) · Genes Brain & Behavior · doi:10.1111/j.1601-183x.2011.00759.x · Cited by 15
Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task
Gu, X., Kirk, U., Lohrenz, T. M., & Montague, P. R. (2013) · Human Brain Mapping · doi:10.1002/hbm.22433 · Cited by 15
Self-citation
A Functional 3′UTR Polymorphism (rs2235749) of Prodynorphin Alters microRNA-365 Binding in Ventral Striatonigral Neurons to Influence Novelty Seeking and Positive Reward Traits
Egervári, G., Jutras‐Aswad, D., Landry, J. A., Miller, M. L., Anderson, S. A., Michaelides, M., Jacobs, M. M., Peter, C. J., Yiannoulos, G., Liu, X., et al. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.53 · Cited by 15
Focus on the positive: Computational simulations implicate asymmetrical reward prediction error signals in childhood attention-deficit/hyperactivity disorder
Cockburn, J., & Holroyd, C. B. (2010) · Brain Research · doi:10.1016/j.brainres.2010.09.065 · Cited by 16
Dopaminergic Medication Modulates Learning from Feedback and Error-Related Negativity in Parkinson’s Disease: A Pilot Study
Volpato, C., Schiff, S., Facchini, S., Silvoni, S., Cavinato, M., Piccione, F., Antonini, A., & Birbaumer, N. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00205 · Cited by 15
A novel neurobehavioral framework of the effects of positive early postnatal experience on incentive and consummatory reward sensitivity
Fu, Y., & Depue, R. A. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.09.026 · Cited by 18
Meta-Learning, Cognitive Control, and Physiological Interactions between Medial and Lateral Prefrontal Cortex
Khamassi, M., Wilson, C. R. E., Rothé, M., Quilodran, R., Dominey, P. F., & Procyk, E. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/9780262016438.003.0019 · Cited by 14
Stimulus–outcome learnability differentially activates anterior cingulate and hippocampus at feedback processingPreprint
Rodriguez, P. F. (2009) · Learning & Memory · doi:10.1101/lm.1191609 · Cited by 15
Navigating Motivation: A Semantic and Subjective Atlas of 7 Motives
Chierchia, G., Przyrembel, M., Lesemann, F. H. P., Bosworth, S., Snower, D. J., & Singer, T. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.568064 · Cited by 16
Decoding reward–curiosity conflict in decision-making from irrational behaviors
Konaka, Y., & Naoki, H. (2023) · Nature Computational Science · doi:10.1038/s43588-023-00439-w · Cited by 14
Neural mechanisms of social learning and decision-making
Ni, Y., & Li, J. (2020) · Science China Life Sciences · doi:10.1007/s11427-020-1833-8 · Cited by 16
Mental contrasting with implementation intentions increases study time for university students
Clark, M., Miller, A., Berry, J., & Cheng, K. (2020) · British Journal of Educational Psychology · doi:10.1111/bjep.12396 · Cited by 17
Rapid matching in Drosophila place learning
Zars, M., & Zars, T. D. (2009) · Die Naturwissenschaften · doi:10.1007/s00114-009-0550-9 · Cited by 14
The Simulation of Addiction: Pharmacological and Neurocomputational Models of Drug Self-Administration
Ahmed, S. H., Bobashev, G., & Gutkin, B. S. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2007.01.008 · Cited by 14
Neuroinformatics in clinical practice: are computers going to help neurological patients and their physicians?
Villoslada, P., & Oksenberg, J. R. (2006) · Future Neurology · doi:10.2217/14796708.1.2.159 · Cited by 14
Dopamine activity on the perceptual salience for recognition memory
Osorio‐Gómez, D., Guzmán-Ramos, K. R., & Bermúdez‐Rattoni, F. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.963739 · Cited by 14
SSCC TD: A Serial and Simultaneous Configural-Cue Compound Stimuli Representation for Temporal Difference Learning
Mondragón, E., Gray, J., Alonso, E., Bonardi, C., & Jennings, D. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102469 · Cited by 13
Children’s Greenness Exposure and IQ-Associated DNA Methylation: A Prospective Cohort Study
Lee, K., Choi, Y., Cho, J.-W., Moon, S.-J., Lim, Y., Kim, J. I., Lee, Y. A., Shin, C. H., Kim, B.-N., & Hong, Y. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147429 · Cited by 14
Phasic Dopamine Changes and Hebbian Mechanisms during Probabilistic Reversal Learning in Striatal Circuits: A Computational Study
Schirru, M., Véronneau‐Veilleux, F., Nekka, F., & Ursino, M. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms23073452 · Cited by 13
Mechanistic Classification of Neural Circuit Dysfunctions: Insights from Neuroeconomics Research in Animals
Chang, S. W. C., Barack, D. L., & Platt, M. L. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.02.017 · Cited by 14
A novel role for E2F3b in regulating cocaine action in the prefrontal cortex
Cates, H. M., Bagot, R. C., Heller, E. A., Purushothaman, I., Lardner, C. K., Walker, D. M., Peña, C. J., Neve, R. L., Shen, L., & Nestler, E. J. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0296-1 · Cited by 13
The error in total error reduction
Witnauer, J. E., Urcelay, G. P., & Miller, R. R. (2013) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.07.018 · Cited by 13
Correlates of reward‐predictive value in learning‐related hippocampal neural activity
Okatan, M. (2009) · Hippocampus · doi:10.1002/hipo.20535 · Cited by 14
Impulsivity and the association between the feedback‐related negativity and performance on an inhibitory control task in young at‐risk children
Roos, L. E., Pears, K. C., Bruce, J., Kim, H. K., & Fisher, P. A. (2014) · Psychophysiology · doi:10.1111/psyp.12389 · Cited by 13
Maternal dopamine encodes affective signals of human infants
Zeevi, L., Irani, M., Catana, C., Feldman Barrett, L., & Atzil, S. (2022) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsab116 · Cited by 12
Differentiating between Bayesian parameter learning and structure learning based on behavioural and pupil measures
Rutar, D., Colizoli, O., Selen, L. P. J., Spieß, L., Kwisthout, J., & Hunnius, S. (2023) · PLoS ONE · doi:10.1371/journal.pone.0270619 · Cited by 13
A Computational Model of Cortico-Striato-Thalamic Circuits in Goal-Directed Behaviour
Şengör, N. S., Karabacak, Ö., & Steinmetz, U. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87559-8_34 · Cited by 12
The Role of Dorsal Striatal D2-Like Receptors in Reversal Learning: A Reinforcement Learning Viewpoint: Figure 1.
Piray, P. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3008-11.2011 · Cited by 12
Patients with basal ganglia damage show preserved learning in an economic game
Zhu, L., Jiang, Y., Scabini, D., Knight, R. T., & Hsu, M. (2019) · Nature Communications · doi:10.1038/s41467-019-08766-1 · Cited by 15
When Will We Meet Again? Regularities of Social Connectivity and Their Reflections in Memory and Decision Making
Pachur, T., Schooler, L. J., & Stevens, J. R. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.003.0007 · Cited by 12
Simple Heuristics in a Social Game
Hertwig, R., Fischbacher, U., & Bruhin, A. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.003.0002 · Cited by 12
The Is and Ought of Sharing: The Equality Heuristic Across the Lifespan
Keller, M., Gummerum, M., Canz, T., Gigerenzer, G., & Takezawa, M. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.003.0006 · Cited by 12
Dopamine and Schizophrenia
Abi‐Dargham, A., & Grace, A. A. (2010) · Wiley eBooks · doi:10.1002/9781444327298.ch20 · Cited by 12
Comparing fMRI responses measured at 3 versus 7 Tesla across human cortex, striatum, and brainstemPreprint
Colizoli, O., de Gee, J. W., van der Zwaag, W., & Donner, T. H. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.12.090175 · Cited by 12
Reliability of Decision-Making and Reinforcement Learning Computational ParametersPreprint
Mkrtchian, A., Valton, V., & Roiser, J. P. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.06.30.450026 · Cited by 12
Computational Neuroscience’s Influence on Autism Neuro-Transmission Research: Mapping Serotonin, Dopamine, GABA, and Glutamate
Bamicha, V., Pergantis, P., Skianis, C. A., & Drigas, A. S. (2025) · Biomedicines · doi:10.3390/biomedicines13061420 · Cited by 15
A Dynamic Affective Core to Bind the Contents, Context, and Value of Conscious Experience
Kishida, K. T., & Sands, L. P. (2021) · Springer eBooks · doi:10.1007/978-3-030-82965-0_12 · Cited by 16
The Molecular Mechanisms of Reward
Winstanley, C. A., & Nestler, E. J. (2008) · Elsevier eBooks · doi:10.1016/b978-012370509-9.00004-8 · Cited by 11
Usage of L-type calcium channel blockers to suppress drug reward and memory driving addiction: Past, present, and future
Morikawa, H., Young, C. C., & Smits, J. A. J. (2022) · Neuropharmacology · doi:10.1016/j.neuropharm.2022.109290 · Cited by 10
The weight of being: Psychological perspectives on the existential moment
Hirsh, J. B. (2009) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2009.03.001 · Cited by 11
What is Wrong with Addiction
Summers, J. S. (2015) · Philosophy, psychiatry & psychology · doi:10.1353/ppp.2015.0011 · Cited by 11
An efficiency framework for valence processing systems inspired by soft cross-wiring
Montague, P. R., Kishida, K. T., Moran, R., & Lohrenz, T. M. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.08.002 · Cited by 11
Self-citation
Dopamine and response selection: an Acute Phenylalanine/Tyrosine Depletion study
Ramdani, C., Vidal, F., Dagher, A., Carbonnell, L., & Hasbroucq, T. (2018) · Psychopharmacology · doi:10.1007/s00213-018-4846-3 · Cited by 11
Reward and Neurocomputational Processes
Frank, G. (2010) · Current topics in behavioral neurosciences · doi:10.1007/7854_2010_81 · Cited by 11
ACE (Actor–Critic–Explorer) paradigm for reinforcement learning in basal ganglia: Highlighting the role of subthalamic and pallidal nuclei
Joseph, D., Garipelli, G., & Chakravarthy, V. S. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.03.001 · Cited by 11
Real-Time Accumbal Dopamine Response to Negative Stimuli: Effects of Ethanol
Mikhailova, M. A., Deal, A. L., Grinevich, V. P., Bonin, K., Gainetdinov, R. R., & Budygin, E. A. (2018) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.8b00272 · Cited by 11
The Mind as an Intuitive Pollster: Frugal Search in Social Spaces
Pachur, T., Hertwig, R., & Rieskamp, J. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388435.003.0009 · Cited by 11
THE EFFECTS OF MOTIVATION ON HABITUAL INSTRUMENTAL BEHAVIOR
Niv, Y. (2007) · Cited by 11
Motivational Vigor in Parkinson's Disease Requires the Short and Long Duration Response to Levodopa
Brissenden, J. A., Scerbak, T., Albin, R. L., & Lee, T. G. (2023) · Movement Disorders · doi:10.1002/mds.29659 · Cited by 12
Computational Modeling Differentiates Learning Rate From Reward Sensitivity Deficits Produced by Early-Life Adversity in a Rodent Touchscreen Probabilistic Reward Task
Kangas, B. D., Ang, Y., Short, A. K., Baram, T. Z., & Pizzagalli, D. A. (2024) · Biological Psychiatry Global Open Science · doi:10.1016/j.bpsgos.2024.100362 · Cited by 12
Reinforcing saccadic amplitude variability in a visual search task
Paeye, C., & Madelain, L. (2014) · Journal of Vision · doi:10.1167/14.13.20 · Cited by 10

Authors: Montague, P. R., Hyman, S. E., & Cohen, J. D.
Affiliations: Baylor College of Medicine (US)
Harvard University (US)
University of Pittsburgh (US)
ORCID: Montague, P. Read
Hyman, Steven E.
Cohen, Jonathan D.
Venue: Nature
Publisher: Springer Science and Business Media LLC
Published: 2004-10
Volume: 431
Issue: 7010
Pages: 760-767
ISSN: 0028-0836 (ISSN-L)
1476-4687
DOI: 10.1038/nature03015
OpenAlex: W2165368112
Semantic Scholar: 16cd7a24d117f61da645fba1b4cc31839dff2805
Cited by: 966
References: 77
Citations by year: 2026: 6 · 2025: 13 · 2024: 19 · 2023: 36 · 2022: 21 · 2021: 26 · 2020: 32 · 2019: 31 · 2018: 39 · 2017: 40 · 2016: 42 · 2015: 49 · 2014: 51 · 2013: 56 · 2012: 82
FWCI: 4.14
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Nature (publishedVersion)
PubMed (publishedVersion)
RePEc: Research Papers in Economics (submittedVersion)
UCL Discovery (University College London) (submittedVersion)
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords: dopamine, neuromodulation, reinforcement learning, computational model, value judgments, decision-making, behavioral control, cognitive disorders
MeSH terms: Animals, Choice Behavior, Cognition, Dopamine, Humans, Learning, Models, Neurological, Schizophrenia, Substance-Related Disorders

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Computational roles for dopamine in behavioural control

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks