Cited by 966Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesReinforcement Learning in Robotics

The DOI matches its Crossref record; 76 of the 77 references it cites were found in a registry or an index.

Computational roles for dopamine in behavioural control

Montague, P. Read, Hyman, Steven E., Cohen, Jonathan D.·2004·Nature

DOI 10.1038/nature03015

Open this paper in CoChat — free account

Abstract

Neuromodulators such as dopamine have a central role in cognitive disorders. In the past decade, biological findings on dopamine function have been infused with concepts taken from computational theories of reinforcement learning. These more abstract approaches have now been applied to describe the biological algorithms at play in our brains when we form value judgements and make choices. The application of such quantitative models has opened up new fields, ripe for attack by young synthesizers and theoreticians.

Integrity signals

Registry

Crossref · 10.1038/nature03015

Cites

76 of 76 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Self-citation
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citation
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/c2009-0-62209-1 · Cited by 6,035
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats.
Di Chiara, G., & Imperato, A. (1988) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.85.14.5274 · Cited by 4,733
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
From Neuropsychology to Mental Structure
Shallice, T. (1988) · doi:10.1017/cbo9780511526817 · Cited by 4,072
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027

Flagged first, then by citations

Show all 77 references

1 of the 77 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

Rescorla, R. A. & Wagner A. R. in Classical Conditioning 2: Current Research and Theory (eds Black, A. H. & Prokasy, W. F.) 64–69 (Appleton Century-Crofts, New York, 1972).
Bayer, H. M. & Glimcher, P. W. Subjective estimates of objective rewards: using economic discounting to link behavior and brain. Soc. Neurosci. Abstr. 28, 358.6 (2002).

Sorted by citations

Items 801–900 of 964

Developing translational animal models for decision making: the Iowa Gambling Task case
Mitsogiannis, M. D. (2011) · Utrecht University Repository (Utrecht University)
L’efficacia della pubblicità nella prospettiva delle neuroscienze
Bosio, A. C., & Foffani, L. (2009) · Springer eBooks · doi:10.1007/978-88-470-1374-2_8
Different addictive drug exposure induces selective alterations of the Endogenous Opioid System : modulation of transcription and epigenetic mechanisms
Caputi, F. F. (2012) · AMS Dottorato Institutional Doctoral Theses Repository (University of Bologna) · doi:10.6092/unibo/amsdottorato/4558
A Comparative Analysis of the Neural Basis for Dorsal-Ventral Swimming in the Nudipleura
Lillvis, J. L. (2022) · Digital Archive @ GSU · doi:10.57709/3074014
Molecular Biology of Addiction and Substance Dependence
Schwab, S. G., Scott, A. P., & Wildenauer, D. B. (2008) · Nucleic acids and molecular biology · doi:10.1007/978-3-540-85383-1_6 · Cited by 1
Wiederorientierung in Bats and the Nature of Animal Consciousness
Erwin, H. R. (2005)
The Effect of Injury Severity on Behavioral Tasks Used for the Assessment of Cognitive Functioning Following Traumatic Brain Injury
Martens, K. M. (2013)
Local Cortical Dynamics Related to Mental Illnesses
Loh, M., Rolls, E. T., & Deco, G. (2010) · Wiley eBooks · doi:10.1002/9783527630271.ch15
Complying with norms. a neurocomputational exploration
Colombo, M. (2012) · ERA
A study of attempts at precognition, particularly in dreams, using some of the methods of experimental philosophy.
Yates, J. (n.d.) · PhilPapers (PhilPapers Foundation)
Study of the interaction between 3,4 methylenedioximethamphetamine and the endocannabinoid system
Touriño, C. (2009) · Repositori digital de la UPF (Universitat Pompeu Fabra)
Auswirkungen akuten psychosozialen Stresses auf Feedback-basiertes Lernen
Petzold, A. (2010) · Qucosa (Saxon State and University Library Dresden)
Cognitive regulation effects on neural responses to reward and drug- conditioned cues in healthy participants and current smokers
Staudinger, M. R. (2013) · Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver · doi:10.17169/refubium-11388
Development and application of model selection methodsfor investigating brain function
Rosa, M. J. (2012) · UCL Discovery (University College London)
Genes and behavior in preschool children: The relation between dopamine genotype and latent executive control
Wiebe, S. A., Moehr, M. J., Johnson, A., Chang, M. Y., Huggenvik, J. I., Jameson, T., & Espy, K. A. (2007) · Lincoln (University of Nebraska)
Hypocretin (Orexin), Dopamine, and Goal-Directed Behavior
Muschamp, J. W. (2007)
Functional capacity in schizophrenia: Relationship among effort, reinforcement learning and self-beliefs
Vogel, S. J. (2020) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/7646084 · Cited by 1
Should I Stay or Should I Go? Neural Substrates of Being in the Right Place at the Right Time. Focus on “How Prior Reward Experience Biases Exploratory Movements: A Probabilistic Model”
Beeler, J. A. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01318.2006
Implicações dos mecanismos de recompensa e cognição implícita na formação de expectativas e manutenção do caráter funcional da música tonal
Muniz, M. T. (2013) · doi:10.11606/d.47.2013.tde-30042013-105949
Affective Neuroscience of Reward: Pleasure & Desire
Berridge, K. C. (2007)
PRELIMINARY INVESTIGATIONS OF DOPAMINERGIC CONTRIBUTIONS TO PRESCHOOLERS' THEORY OF MIND DEVELOPMENT
Lackner, C. L. (2009)
The neurophysiology of social decision making
Klein, J. T. (2010) · DukeSpace (Duke University)
Characteristics of abnormal visual processing and recognition memory of affective pictures in PTSD
Borgelt, J. (2006)
Inférence à la meilleure explication, théorie de l’esprit, psychologie normative et rôle de la culture : Autour du livre Human Evolution and the Origins of Hierarchies. Benoît Dubreuil, Human Evolution and the Origins of Hierarchies
Faucher, L. (2012) · Philosophiques · doi:10.7202/1011621ar
Error observation in schizophrenia
Mann-Wrobel, M. C. (2009) · University Libraries (University of Maryland)
Motivation und Sucht
Birbaumer, N., & Schmidt, R. F. (2010) · Springer-Lehrbuch · doi:10.1007/978-3-540-95938-0_26
Expression of dopamine and opioid receptors and its correlation with risk taking behavior in zebrafish
McCarrick, S. (2014)
FEATURE ARTICLE Which Way Do I Go? Neural Activation in Response to Feedback and Spatial Processing in a Virtual T-Maze
Baker, T. E., & Holroyd, C. B. (2009)
HOMO DECEPTUS HOW LANGUAGE CREATES ITS OWN REALITY
Bokor, B. (2015) · PhilPapers (PhilPapers Foundation)
Bayesian Updating in the EEG - Differentiation between Automatic and Controlled Processes of Human Economic Decision Making
Sektion, M.-N., Psychologie, F., & der Naturwissenschaften, D. (2011)
Plastizität, Lernen und Gedächtnis
Birbaumer, N., & Schmidt, R. F. (2010) · Springer-Lehrbuch · doi:10.1007/978-3-540-95938-0_25
Cellular and Chemical Dynamics Within the Nucleus Accumbens During Reward-related Learning and Decision Making
Day, J. J. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/s1tk-dq52
The involvement of matrix metalloproteinases in nicotine conditioned place preference in adolescent female rats
Natarajan, R. (2009) · doi:10.7273/000005935
Studying chemical and electrical neuronal dynamics as a platform for understanding schizophrenia
Das, T. K., Rajakumar, N., & Jog, M. (2013) · Journal of Coupled Systems and Multiscale Dynamics · doi:10.1166/jcsmd.2013.1029
Effects of chronic sleep deprivation on learning and memory abilities, brain dopamine content and D1 receptor expression in rats
Fei, R. O. N. G., Wen, X., & Ma, W. (2013) · Academic Journal of Second Military Medical University · doi:10.3724/sp.j.1008.2012.00959
Dopamin und kognitive Handlungssteuerung: Flexibilität und Stabilität in einem Set-Shifting Paradigma
Brocke, B., Goschke, T., Stemmler, G., & Marburg, P.-U. (2007)
Effects of early isolation on the experiential, hormonal and neural regulation of sexual behavior in male Long-Evans rats.
Akbari, E. M. (2010) · TSpace (University of Toronto)
Conflict monitoring and reinforcement learning
Braem, S. (2013) · Ghent University Academic Bibliography (Ghent University)
The neural correlates of intentional control
Wisniewski, D. (2016) · edoc Publication server (Humboldt University of Berlin) · doi:10.18452/17500
Cocaine-induced synaptic plasticity in the nucleus accumbens and drug-associated behavior - An unexpected dissociation
Shukla, A. (2016) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-5650
The Influence of Placebo Cognitive Enhancing Drugs on Proactive and Reactive Cognitive Control: An EEG-Study
Rore, S. D. (2014)
2 Quantum and Classical Information and Entropy
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0003
Addiction and Responsibility
Hyman, S. E. (2013) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195389784.003.0008
Self-citation
20 Intentionality and Conceptualization
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0021
13 The Brain as an Information‐Control System
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0014
5 Dealing with Target Motion and Our Own Movement
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0006
Decision Making in the Economy of Nature: Value as Information
Hardy‐Vallée, B. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/9780262201742.003.0010
3 The Brain: An Outlook
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0004
Neuronal Mechanisms and Voluntary Agency
Runyan, J. D. (2013) · Palgrave Macmillan eBooks · doi:10.1057/9781137329493_7
19 What Symbols Are
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0020
6 Complexity: A Necessary Condition
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0007
1 Quantum Mechanics as a General Framework
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0002
24 Mind and Brain (Body)
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0025
8 The Organism as a Semiotic and Cybernetic System
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0009
7 General Features of Life
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0008
A New Neural Framework for Adaptive and Maladaptive Behaviors in Changeable and Demanding Environments
Lewandowska, K., Sikora-Wachowicz, B., Beldzik, E., Domagalik, A., Fąfrowicz, M., Mojsa‐Kaja, J., Ogińska, H., & Marek, T. (2012) · Ergonomics design and management · doi:10.1201/b13019-5
14 Decisional, Emotional, and Cognitive Systems
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0015
25 Final Philosophical Remarks
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0026
Neurobiology collides with moral and criminal responsibility: the result is double vision
Hyman, S. E. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781139565820.013
Self-citation
18 The Basic Symbolic Systems
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0019
Premenstrual Syndrome
Alberts, P. S. (1984) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1111/j.1552-6909.1984.tb02195.x
The Neural Mechanism of Cognitive Control as a Function of Individual Differences in Fluid Intelligence
조수현 (2011) · 한국심리학회지: 인지 및 생물 · doi:10.22172/cogbio.2011.23.3.008
Dysfunktionale Belohnungsverarbeitung und der Einfluss von Persönlichkeitsvariablen und Medikation jenseits nosologischer Grenzen
Hägele, C. (2016) · Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver · doi:10.17169/refubium-10061
Alkoholismus-Forschung, aktuelle Befunde, künftige Perspektiven
Kiefer, F., & Schuster, R. (2016) · Springer eBooks · doi:10.1007/978-3-642-45028-0_61-1 · Cited by 1
Role of the ventral subiculum-to-nucleus accumbens circuit in reinforcement and choice of delayed outcomes
Cerri, D. H. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/23gv-ra32
THE INFLUENCE OF RELATIVE EXPECTED SUBJECTIVE VALUE ON PREPARATORY ACTIVITY IN THE SUPERIOR COLLICULUS AS INDEXED BY SACCADIC REACTION TIMES
Milstein, D. (2013)
Adaptations in In Vivo Catecholamine Signaling in Models Of Stress and Addiction
Fox, M. E. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/me6d-mx57
RL mechanisms of short-term plasticity of auditory cortexPreprint
Krugliakova, E., Gorin, A., Шестакова, А. Н., Fedele, T., & Klucharev, V. A. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/093138
The Neural Substrates of Response Inhibition in Attention Deficit Hyperactive Disorder (ADHD)
Bhaijiwala, M. (2016) · TSpace (University of Toronto)
The Effects of Atypical Antipsychotics on Implicit Reward Learning in Schizophrenia
Bradford, L. (2015) · QSpace (Queen's University Library)
Asymmetric Modulation of FRN by the Probability and Value of Outcomes in Auditory Mid TaskPreprint
Krugliakova, E., Gorin, A., Шестакова, А. Н., & Klucharev, V. A. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2884755
Kappa Opioid Regulation of Dopamine in Dysphoria and Addiction
Ehrich, J. M. (2015) · ResearchWorks at the University of Washington (University of Washington)
Psychological and Neuroscientific Connections with Reinforcement Learning (preprint)
Shah, A. (2014)
Reinforcement learning model in probalistically rewarded task
Enel, P., Khamassi, M., Procyk, E., & Dominey, P. F. (2010) · HAL
Drug addiction and alteration of decision making process
Fauré, P. (2017) · European Conference on Artificial Life · doi:10.1162/isal_a_006
Neural mechanisms of affective instability in substance use
Bodkyn, C. N. (2017) · UVic’s Research and Learning Repository (University of Victoria)
Modelling Movement as an Ongoing Decision
Wispinski, N. J. (2017) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3zc7s78h
Cognitive Flexibility in the Context of Stress and Depressive Disorders
Gabrys, R. L. (2017) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2017-11965
Executive control and emotional processing biases in depressive patients
Markela-Lerenc, J. (2008) · heiDOK (Heidelberg University) · doi:10.11588/heidok.00008356
A neural network for uncertainty anticipation and information seeking
White, J. K. (2019) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/5ssn-8447
The Pragmatism of Habit in Preoperative Optimization
McAnally, H. B., & Darnall, B. D. (2019) · doi:10.1093/med/9780190920142.003.0004
Preoperative Management of Chronic Opioid Therapy
McAnally, H. B., & Darnall, B. D. (2019) · Oxford University Press eBooks · doi:10.1093/med/9780190920142.003.0010
The Primacy of Motivation in Preoperative Optimization
McAnally, H. B., & Darnall, B. D. (2019) · Oxford University Press eBooks · doi:10.1093/med/9780190920142.003.0003
Pressure and Perverse Flights to FamiliarityPreprint
Shiv, B., Reich, T., Maymin, S., & Litt, A. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1721813
Progression of anorexia nervosa: An insight into neurological and biological mechanisms influencing the personality patterns of anorexics
Singh, A., Bains, K., & Kaur, H. (2021) · Journal of Applied and Natural Science · doi:10.31018/jans.v13i2.2495
Computation with Serotonergic Modulation
Lewis, M. (2014) · Springer eBooks · doi:10.1007/978-1-4614-7320-6_633-1
Molecular basis for memory storage and addiction
Bhatt, K. (2013)
Persistent Effects of Self-Administered Cocaine on Cognitive Function and Brain Dopamine Receptors: The Consequences of Differential Drug Access.
Briand, L. A. (2007) · Deep Blue (University of Michigan)
Reinforcement Learning Models Then-and-Now: From Single Cells to Modern Neuroimaging
Montague, P. R. (2013) · Springer eBooks · doi:10.1007/978-1-4614-1424-7_13
Self-citation
Wahn — inhaltliche Denkstörungen
(2007) · Springer eBooks · doi:10.1007/978-3-540-37254-7_13
15 Behavior
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0016
Faculty Opinions recommendation of Intense sweetness surpasses cocaine reward.
Berridge, K. C. (2007) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.1089141.542328
11 Epigeny
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0012
Lernen und Gedächtnis
(2005) · Springer eBooks · doi:10.1007/3-540-30350-2_24
17 Memory
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0018
The Fundamentals of Neuroeconomics
Kasemsap, K. (2020) · IGI Global eBooks · doi:10.4018/978-1-7998-2448-0.ch005 · Cited by 1
References
Osman, M. (2010) · Wiley eBooks · doi:10.1002/9781444328226.refs
Motivation
(2005) · Springer eBooks · doi:10.1007/3-540-30350-2_25
Neurobiology of Eating Disorders
Hildebrandt, T., & Heywood, A. A. (2017) · Oxford University Press eBooks · doi:10.1093/med/9780190681425.003.0066
Introduction
Auletta, G. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199608485.003.0001

Authors: Montague, P. R., Hyman, S. E., & Cohen, J. D.
Affiliations: Baylor College of Medicine (US)
Harvard University (US)
University of Pittsburgh (US)
ORCID: Montague, P. Read
Hyman, Steven E.
Cohen, Jonathan D.
Venue: Nature
Publisher: Springer Science and Business Media LLC
Published: 2004-10
Volume: 431
Issue: 7010
Pages: 760-767
ISSN: 0028-0836 (ISSN-L)
1476-4687
DOI: 10.1038/nature03015
OpenAlex: W2165368112
Semantic Scholar: 16cd7a24d117f61da645fba1b4cc31839dff2805
Cited by: 966
References: 77
Citations by year: 2026: 6 · 2025: 13 · 2024: 19 · 2023: 36 · 2022: 21 · 2021: 26 · 2020: 32 · 2019: 31 · 2018: 39 · 2017: 40 · 2016: 42 · 2015: 49 · 2014: 51 · 2013: 56 · 2012: 82
FWCI: 4.14
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Nature (publishedVersion)
PubMed (publishedVersion)
RePEc: Research Papers in Economics (submittedVersion)
UCL Discovery (University College London) (submittedVersion)
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords: dopamine, neuromodulation, reinforcement learning, computational model, value judgments, decision-making, behavioral control, cognitive disorders
MeSH terms: Animals, Choice Behavior, Cognition, Dopamine, Humans, Learning, Models, Neurological, Schizophrenia, Substance-Related Disorders

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Computational roles for dopamine in behavioural control

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks