Computational roles for dopamine in behavioural control

Montague, P. Read, Hyman, Steven E., Cohen, Jonathan D.·2004·Nature

DOI 10.1038/nature03015

Cited by (964)

Items 101–200 of 964

Hierarchical reinforcement learning and decision making
Matthew Botvinick · 2012 · Current Opinion in Neurobiology
Neuromodulation of reward‐based learning and decision making in human aging
Ben Eppinger, Dorothea Hämmerer, Shu Li · 2011 · Annals of the New York Academy of Sciences
Age-related decline in brain resources magnifies genetic effects on cognitive functioning
Ulman Lindenberger · 2008 · Frontiers in Neuroscience
Time-Varying Effects of Chronic Hedonic Goals on Impulsive Behavior
Suresh Ramanathan, Geeta Menon · 2006 · Journal of Marketing Research
Prefrontostriatal Circuitry Regulates Effort-Related Decision Making
Wolfgang Hauber, Susanne Sommer · 2009 · Cerebral Cortex
From prediction error to psychosis: Ketamine as a pharmacological model of delusions
Corlett, P.R., Honey, G.D., Fletcher, P.C. · 2007 · Journal of Psychopharmacology
Pretreatment Brain Activation During Stroop Task Is Associated with Outcomes in Cocaine-Dependent Patients
Judson A. Brewer, Patrick D. Worhunsky, Kathleen M. Carroll, Bruce J. Rounsaville, Marc Nicholas Potenza · 2008 · Biological Psychiatry
Single dose of a dopamine agonist impairs reinforcement learning in humans: Behavioral evidence from a laboratory-based measure of reward responsiveness
Pizzagalli, Diego A., Evins, A. Eden, Schetter, Erika Cowman, Frank, Michael J., Pajtas, Petra E., Santesso, Diane L., Culhane, Melissa · 2008 · Psychopharmacology
In vivo PET study of 5HT2A serotonin and D2 dopamine dysfunction in drug-naive obsessive-compulsive disorder
Perani, Daniela, Garibotto, Valentina, Gorini, Alessandra, Moresco, Rosa Maria, Henin, Marta, Panzacchi, Andrea, Matarrese, Mario, Carpinelli, Assunta, Bellodi, Laura, Fazio, Ferruccio · 2008 · NeuroImage
The Neurobiology of Addiction: Implications for Voluntary Control of Behavior
Steven E. Hyman · 2007 · The American Journal of Bioethics
Gaze following: why (not) learn it?
Jochen Triesch, Christof Teuscher, Gedeon O. Deák, Eric Carlson · 2006 · Developmental Science
Inferring on the intentions of others by hierarchical Bayesian learning
Diaconescu, Andreea O., Mathys, Christoph, Weber, Lilian A. E., Daunizeau, Jean, Kasper, Lars, Lomakina, Ekaterina I., Fehr, Ernst, Stephan, Klaas E. · 2014 · PLoS Computational Biology
Pain and suicidality: Insights from reward and addiction neuroscience
Igor Elman, David Borsook, Nora D. Volkow · 2013 · Progress in Neurobiology
Oscillatory Activity and Phase–Amplitude Coupling in the Human Medial Frontal Cortex during Decision Making
Michael X Cohen, Christian Erich Elger, Juergen Fell · 2008 · Journal of Cognitive Neuroscience
How Humans Integrate the Prospects of Pain and Reward during Choice
Deborah Talmi, Peter Dayan, Stefan J. Kiebel, Chris Frith, Raymond J. Dolan · 2009 · Journal of Neuroscience
What do the basal ganglia do? A modeling perspective
V. Srinivasa Chakravarthy, Denny Joseph, Raju Surampudi Bapi · 2010 · Biological Cybernetics
Intrinsic motivation, neurocognition and psychosocial functioning in schizophrenia: Testing mediator and moderator effects
Eri Nakagami, Bin Xie, Maanse Hoe, John S. Brekke · 2008 · Schizophrenia Research
Subsecond dopamine fluctuations in human striatum encode superposed error signals about actual and counterfactual reward
Kenneth T. Kishida, Ignacio Sáez, Terry M. Lohrenz, Mark R. Witcher, Adrian W. Laxton, Stephen B. Tatter, Jason P. White, Thomas L. Ellis, Paul E. M. Phillips, P. Read Montague · 2015 · Proceedings of the National Academy of Sciences
The role of ventral frontostriatal circuitry in reward-based learning in humans.
Galvan, Adriana, Hare, Todd A., Davidson, Matthew, Spicer, Julie, Glover, Gary, Casey, B. J. · 2005 · The Journal of Neuroscience
Parallel maturation of goal-directed behavior and dopaminergic systems during adolescence
Naneix, Fabien, Marchand, Alain R., Di Scala, Georges, Pape, Jean-Rémi, Coutureau, Etienne · 2012 · The Journal of Neuroscience
Error and Expectation in Language Learning: The Curious Absence of Mouses in Adult Speech
Michael Ramscar, Melody Dye, Stewart M. McCauley · 2013 · Language
Multimodal parent behaviors within joint attention support sustained attention in infants.
Catalina Suárez-Rivera, Linda B. Smith, Chen Yu · 2018 · Developmental Psychology
Are extremes of consumption in eating disorders related to an altered balance between reward and inhibition?
Wierenga, Christina E., Ely, Alice, Bischoff-Grethe, Amanda, Bailer, Ursula F., Simmons, Alan N., Kaye, Walter H. · 2014 · Frontiers in Behavioral Neuroscience
Cognitive Rehabilitation for Schizophrenia and the Putative Role of Motivation and Expectancies
Dawn I. Velligan, Robert S Kern, James M. Gold · 2005 · Schizophrenia Bulletin
Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model.
Clay B. Holroyd, Samuel M. McClure · 2014 · Psychological Review
Neurogenetics and Pharmacology of Learning, Motivation, and Cognition
Michael J. Frank, John Fossella · 2010 · Neuropsychopharmacology
Dimensional psychiatry: reward dysfunction and depressive mood across psychiatric disorders
Claudia Hägele, Florian Schlagenhauf, Michael A. Rapp, Philipp Sterzer, Anne Beck, Felix Bermpohl, Meline Stoy, Andreas Ströhle, Hans‐Ulrich Wïttchen, Raymond J. Dolan et al. · 2014 · Psychopharmacology
Twenty-Five Lessons from Computational Neuromodulation
Dayan, Peter · 2012 · Neuron
Ventral Striatal Neurons Encode the Value of the Chosen Action in Rats Deciding between Differently Delayed or Sized Rewards
Matthew R. Roesch, Teghpal Singh, Paul Leon Brown, Sylvina E. Mullins, Geoffrey M. Schoenbaum · 2009 · Journal of Neuroscience
The research domain criteria framework: The case for anterior cingulate cortex
Holroyd, Clay B., Umemoto, Akina · 2016 · Neuroscience & Biobehavioral Reviews
Patients with Schizophrenia have a Reduced Neural Response to Both Unpredictable and Predictable Primary Reinforcers
Waltz, James A, Schweitzer, Julie B, Gold, James M, Kurup, Pradeep K, Ross, Thomas J, Jo Salmeron, Betty, Rose, Emma Jane, McClure, Samuel M, Stein, Elliot A · 2009 · Neuropsychopharmacology
Kappa Opioid Receptor-Induced Aversion Requires p38 MAPK Activation in VTA Dopamine Neurons
Jonathan M. Ehrich, Daniel I. Messinger, Cerise R Knakal, Jamie Rose Kuhar, Selena S. Schattauer, Michael R. Bruchas, Larry S. Zweifel, Brigitte Lina Kieffer, Paul E. M. Phillips, Charles Chavkin · 2015 · Journal of Neuroscience
Functional properties of the basal ganglia's re-entrant loop architecture: selection and reinforcement
Pete Redgrave, Nicolas Vautrelle, John N. J. Reynolds · 2011 · Neuroscience
When is an error not a prediction error? An electrophysiological investigation
Clay B. Holroyd, Olav E. Krigolson, R. Baker, S. Lee, J. Gibson · 2009 · Cognitive Affective & Behavioral Neuroscience
Adaptive decision making and value in the anterior cingulate cortex
Mark E. Walton, Paula L. Croxson, Timothy E.J. Behrens, Steven Wayne Kennerley, Matthew F. S. Rushworth · 2007 · NeuroImage
Brain correlates of aesthetic expertise: A parametric fMRI study
Kirk, Ulrich, Skov, Martin, Christensen, Mark Schram, Nygaard, Niels · 2009 · Brain and Cognition
Granularity and the acquisition of grammatical gender: How order-of-acquisition affects what gets learned
Inbal Arnon, Michael Ramscar · 2011 · Cognition
Dopamine regulates aversive contextual learning and associated in vivo synaptic plasticity in the Hippocampus
Broussard, John I., Yang, Kechun, Levine, Amber T., Tsetsenis, Theodoros, Jenson, Daniel, Cao, Fei, Garcia, Isabella, Arenkiel, Benjamin R., Zhou, Fu-Ming, De Biasi, Mariella et al. · 2016 · Cell Reports
A robot model of the basal ganglia: Behavior and intrinsic processing
Tony J. Prescott, Fernando Montes-González, KEVIN N. GURNEY, Mark D. Humphries, Peter Redgrave · 2005 · Neural Networks
Neurobehavioral foundation of environmental reactivity.
Sarah R. Moore, Richard A. Depue · 2015 · Psychological Bulletin
Separate brain regions code for salience vs. valence during reward prediction in humans
Jimmy Jensen, Andrew James Smith, Matthäus Willeit, Adrian Philip Crawley, David John Mikulis, Irina Vitcu, Shitij Kapur · 2006 · Human Brain Mapping
Reward prediction error
Schultz, Wolfram · 2017 · Current Biology
Food intake and reward mechanisms in patients with schizophrenia: implications for metabolic disturbances and treatment with second-generation antipsychotic agents
Elman, Igor, Borsook, David, Lukas, Scott E · 2006 · Neuropsychopharmacology
Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behavior
Clay B. Holroyd, MICHAEL G. H. COLES · 2007 · Cortex
Gambling Severity Predicts Midbrain Response to Near-Miss Outcomes
Henry W. Chase, Luke Clark · 2010 · Journal of Neuroscience
The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis
Mannella, Francesco, Gurney, Kevin, Baldassarre, Gianluca · 2013 · Frontiers in Behavioral Neuroscience
Does a Shared Neurobiology for Foods and Drugs of Abuse Contribute to Extremes of Food Ingestion in Anorexia and Bulimia Nervosa?
Walter H. Kaye, Christina E. Wierenga, Ursula F. Bailer, Alan N. Simmons, Angela Wagner, Amanda Bischoff‐Grethe · 2013 · Biological Psychiatry
Computational neuroimaging strategies for single patient predictions
Klaas Enno Stephan, Florian Schlagenhauf, Quentin J. M. Huys, Sudhir Raman, Eduardo A. Aponte, Kay Henning Brodersen, Lionel Rigoux, Rosalyn Moran, Jean Daunizeau A, Raymond J. Dolan et al. · 2016 · NeuroImage
Stimulus representation and the timing of reward-prediction errors in models of the dopamine system
Ludvig, Elliot A., Sutton, Richard S., Kehoe, E. James · 2008 · Neural Computation
Neuromodulation and aging: implications of aging neuronal gain control on cognition
Shu Li, Anna Rieckmann · 2014 · Current Opinion in Neurobiology
Decoding different roles for vmPFC and dlPFC in multi-attribute decision making
Thorsten Kahnt, Jakob Heinzle, Soyoung Q. Park, John–Dylan Haynes · 2010 · NeuroImage
Adolescent development of the reward system
Galvan · 2010 · Frontiers in Human Neuroscience
Dopamine reveals neural circuit mechanisms of fly memory
Scott Waddell · 2010 · Trends in Neurosciences
The dopaminergic basis of human behaviors: A review of molecular imaging studies
Alice Egerton, Mitul Ashok Mehta, Andrew J. Montgomery, Julia Lappin, Oliver David Howes, Suzanne Reeves, Vincent J. Cunningham, Paul M. Grasby · 2009 · Neuroscience & Biobehavioral Reviews
The Neural Basis of Following Advice
Biele, Guido, Rieskamp, Jörg, Krugel, Lea K., Heekeren, Hauke R. · 2011 · PLoS Biology
Cortical Network Dynamics of Perceptual Decision-Making in the Human Brain
Markus Siegel, Andreas Karl Engel, Tobias H. Donner · 2011 · Frontiers in Human Neuroscience
Intrinsic plasticity: an emerging player in addiction
Saïd Kourrich, Donna J. Calu, Antonello Bonci · 2015 · Nature reviews. Neuroscience
Dissociable but inter-related systems of cognitive control and reward during decision making: Evidence from pupillometry and event-related fMRI
Theodore Daniel Satterthwaite, Leonard Green, Joel Myerson, Jamie B. Parker, Mohana Ramaratnam, Randy L. Buckner · 2007 · NeuroImage
Dopamine, uncertainty and TD learning
Niv, Yael, Duff, Michael O, Dayan, Peter · 2005 · Behavioral and Brain Functions
Dynamic regulation of midbrain dopamine neuron activity: intrinsic, synaptic, and plasticity mechanisms
H. Morikawa, Carlos A. Paladini · 2011 · Neuroscience
Aversive stimulus differentially triggers subsecond dopamine release in reward regions
Budygin, E.A., Park, J., Bass, C.E., Grinevich, V.P., Bonin, K.D., Wightman, R.M. · 2012 · Neuroscience
Time and Associative Learning.
Peter D. Balsam, Michael R. Drew, Charles Randy Gallistel · 2010 · Comparative Cognition & Behavior Reviews
The role of experience in adolescent cognitive development: Integration of executive, memory, and mesolimbic systems
Vishnu P. Murty, Finnegan J. Calabro, Beatríz Luna · 2016 · Neuroscience & Biobehavioral Reviews
Segregated cholinergic transmission modulates dopamine neurons integrated in distinct functional circuits
Daniel Dautan, Albert Schiaveto de Souza, Icnelia Huerta-Ocampo, Miguel Valencia, Maxime Assous, Ilana B. Witten, Karl A. Deisseroth, James M. Tepper, J. Paul Bolam, Todor V. Gerdjikov et al. · 2016 · Nature Neuroscience
Early adversity and learning: implications for typical and atypical behavioral development
Hanson, Jamie L., van den Bos, Wouter, Roeber, Barbara J., Rudolph, Karen D., Davidson, Richard J., Pollak, Seth D. · 2017 · Journal of Child Psychology and Psychiatry
Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task
Pearl H. Chiu, Terry M. Lohrenz, P. Read Montague · 2008 · Nature Neuroscience
Modulation of stomatogastric rhythms
Wolfgang Stein · 2009 · Journal of Comparative Physiology A
Ethanol Action on Dopaminergic Neurons in the Ventral Tegmental Area
Hitoshi Morikawa, Richard A. Morrisett · 2010 · International review of neurobiology
Functional implications of dopamine D1 vs. D2 receptors: A ‘prepare and select’ model of the striatal direct vs. indirect pathways
J.F. Keeler, Douglas Ogilvy Pretsell, Trevor William Robbins · 2014 · Neuroscience
Neuroeconomics: A Bridge for Translational Research
Carla Sharp, John R. Monterosso, P. Read Montague · 2012 · Biological Psychiatry
Special Review: Decision Utility, The Brain, and Pursuit of Hedonic Goals
Kent C. Berridge, J. Wayne Aldridge · 2008 · Social Cognition
Neurocircuity of Eating Disorders
Walter H. Kaye, Angela Wagner, Julie L. Fudge, Martin P. Paulus · 2010 · Current topics in behavioral neurosciences
Social learning through prediction error in the brain
Jessica A. Joiner, Matthew Piva, Courtney Turrin, Steve W. C. Chang · 2017 · npj Science of Learning
Neurobiology of addiction versus drug use driven by lack of choice
Serge H. Ahmed, Magalie Lenoir, Karine Guillem · 2013 · Current Opinion in Neurobiology
Should I stay or should I go? Conceptual underpinnings of goal-directed actions
Giovanni Mirabella · 2014 · Frontiers in Systems Neuroscience
Developmental differences in learning and error processing: Evidence from ERPs
Ben Eppinger, Barbara Mock, Jutta Kray · 2009 · Psychophysiology
BOLD responses to negative reward prediction errors in human habenula
Salas · 2010 · Frontiers in Human Neuroscience
Hierarchical prediction errors in midbrain and septum during social learning
Andreea Oliviana Diaconescu, Christoph D. Mathys, Lilian A. E. Weber, Lars Kasper, Jan Mauer, Klaas Enno Stephan · 2016 · Social Cognitive and Affective Neuroscience
Individual differences in reinforcement learning: Behavioral, electrophysiological, and neuroimaging correlates
Diane L. Santesso, Daniel G. Dillon, Jeffrey L. Birk, Avram J. Holmes, Elena Davis, Ryan Bogdan, Diego A. Pizzagalli · 2008 · NeuroImage
Gonadal steroid regulation of mood: The lessons of premenstrual syndrome☆
David R. Rubinow, P SCHMIDT · 2006 · Frontiers in Neuroendocrinology
Adding prediction risk to the theory of reward learning
PREUSCHOFF, KERSTIN, BOSSAERTS, PETER · 2007 · Annals of the New York Academy of Sciences
Circadian clock genes: Effects on dopamine, reward and addiction
Puja K. Parekh, Angela Renee Ozburn, Colleen A. McClung · 2015 · Alcohol
A Role for Phasic Dopamine Release within the Nucleus Accumbens in Encoding Aversion: A Review of the Neurochemical Literature
Wenzel, Jennifer M., Rauscher, Noah A., Cheer, Joseph F., Oleson, Erik B. · 2015 · ACS Chemical Neuroscience
Of goals and habits: age-related and individual differences in goal-directed decision-making
Ben Eppinger, Maik Walter, Hauke R. Heekeren, Shu Li · 2013 · Frontiers in Neuroscience
Optogenetic dissection of neural circuits underlying emotional valence and motivated behaviors
Edward H. Nieh, Sung‐Yon Kim, Praneeth Namburi, Kay M. Tye · 2012 · Brain Research
Dopamine Enhances Expectation of Pleasure in Humans
Tali Sharot, Tamara Shiner, Annemarie C. Brown, Judy Fan, Raymond J. Dolan · 2009 · Current Biology
Personality traits are differentially associated with patterns of reward and novelty processing in the human substantia nigra/ventral tegmental area
Krebs, Ruth M., Schott, Björn H., Düzel, Emrah · 2009 · Biological Psychiatry
Simple Heuristics in a Social World
Ralph Hertwig, Ulrich Hoffrage, the, ABC Research Group · 2012 · Oxford University Press eBooks
Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action
Jennifer C. Swart, Monja I. Froböse, Jennifer Louise Cook, Dirk E. M. Geurts, Michael J. Frank, Roshan Cools, Hanneke E.M. den Ouden · 2017 · eLife
Children Value Informativity Over Logic in Word Learning
Michael Ramscar, Melody Dye, Joseph Klein · 2013 · Psychological Science
Sub-second Dopamine and Serotonin Signaling in Human Striatum during Perceptual Decision-Making
Dan Bang, Kenneth T. Kishida, Terry M. Lohrenz, Jason P. White, Adrian W. Laxton, Stephen B. Tatter, Stephen M. Fleming, P. Read Montague · 2020 · Neuron
Reason, emotion and decision-making: risk and reward computation with feeling
Steven R. Quartz · 2009 · Trends in Cognitive Sciences
Modelling ADHD: A review of ADHD theories through their predictions for computational models of decision-making and reinforcement learning
Ziegler, Sigurd, Pedersen, Mads L., Mowinckel, Athanasia M., Biele, Guido · 2016 · Neuroscience & Biobehavioral Reviews
Role of nicotinic acetylcholine receptors in regulating dopamine neuron activity
Faure, P., Tolu, S., Valverde, S., Naudé, J. · 2014 · Neuroscience
Midcingulate Motor Map and Feedback Detection: Converging Data from Humans and Monkeys
Emmanuel Procyk, Charles R. E. Wilson, Frederic M. Stoll, Maïlys C. M. Faraut, Michael Petrides, Céline Amiez · 2014 · Cerebral Cortex
Sub-Second Dopamine Detection in Human Striatum
Kenneth T. Kishida, Stefan G. Sandberg, Terry M. Lohrenz, Youssef G. Comair, Ignacio Sáez, Paul E. M. Phillips, P. Read Montague · 2011 · PLoS ONE
Connecting the dots of the cerebro‐cerebellar role in cognitive function: Neuronal pathways for cerebellar modulation of dopamine release in the prefrontal cortex
Rogers, Tiffany D., Dickson, Price E., Heck, Detlef H., Goldowitz, Dan, Mittleman, Guy, Blaha, Charles D. · 2011 · Synapse
Amphetamine modulates brain signal variability and working memory in younger and older adults
Garrett, Douglas D., Nagel, Irene E., Preuschhof, Claudia, Burzynska, Agnieszka Z., Marchner, Janina, Wiegert, Steffen, Jungehülsing, Gerhard J., Nyberg, Lars, Villringer, Arno, Li, Shu-Chen et al. · 2015 · Proceedings of the National Academy of Sciences
Medication impairs probabilistic classification learning in Parkinson's disease
Marjan Jahanshahi, Leonora Wilkinson, Harpreet Gahir, Angeline Dharminda, David Albert Lagnado · 2009 · Neuropsychologia
Neuroeconomic Approaches to Mental Disorders
Kenneth T. Kishida, Brooks King‐Casas, P. Read Montague · 2010 · Neuron