A cellular mechanism of reward-related learning

Reynolds, John N. J., Hyland, Brian I., Wickens, Jeffery R.·2001·Nature
DOI 10.1038/35092560

Cited by (862)

Items 101–200 of 862

  1. A hypothesis for basal ganglia-dependent reinforcement learning in the songbird
    Michale S. Fee, Jesse H. Goldberg · 2011 · Neuroscience
  2. Preferential Enhancement of Dopamine Transmission within the Nucleus Accumbens Shell by Cocaine Is Attributable to a Direct Increase in Phasic Dopamine Release Events
    Brandon J. Aragona, Nathan A. Cleaveland, Garret D. Stuber, Jeremy J. Day, Regina M. Carelli, Robert Mark Wightman · 2008 · Journal of Neuroscience
  3. Changes in behavior-related neuronal activity in the striatum during learning
    Wolfram Schultz · 2003 · Trends in Neurosciences
  4. Post‐ versus presynaptic plasticity in L‐DOPA‐induced dyskinesia
    Maria Angela Cenci, Martin Lundblad · 2006 · Journal of Neurochemistry
  5. Single dose of a dopamine agonist impairs reinforcement learning in humans: Behavioral evidence from a laboratory-based measure of reward responsiveness
    Pizzagalli, Diego A., Evins, A. Eden, Schetter, Erika Cowman, Frank, Michael J., Pajtas, Petra E., Santesso, Diane L., Culhane, Melissa · 2008 · Psychopharmacology
  6. Potential Vulnerabilities of Neuronal Reward, Risk, and Decision Mechanisms to Addictive Drugs
    Wolfram Schultz · 2011 · Neuron
  7. A Mechanism for Error Detection in Speeded Response Time Tasks.
    Clay B. Holroyd, Nick Yeung, MICHAEL G. H. COLES, Jonathan D. Cohen · 2005 · Journal of Experimental Psychology General
  8. Neural and psychological mechanisms underlying appetitive learning: links to drug addiction
    Rudolf N. Cardinal, Barry J. Everitt · 2004 · Current Opinion in Neurobiology
  9. Altered plasticity of the human motor cortex in Parkinson's disease
    Yoshino Ueki, Tatsuya Mima, Mamdouh Ali Kotb, Hideyuki Sawada, Hidemoto Saiki, Akio Ikeda, Tahamina Begum, Faruque Reza, Takashi Nagamine, Hidenao Fukuyama · 2005 · Annals of Neurology
  10. Human neural learning depends on reward prediction errors in the blocking paradigm.
    Tobler, Philippe N., O’Doherty, John P., Dolan, Raymond J., Schultz, Wolfram · 2006 · Journal of Neurophysiology
  11. Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons
    Nicolas Frémaux, Henning Sprekeler, Wulfram Gerstner B · 2013 · PLoS Computational Biology
  12. Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia
    Mark D. Humphries · 2012 · Frontiers in Neuroscience
  13. Differential Effect of Reward and Punishment on Procedural Learning
    Tobias Wächter, Ovidiu Lungu, Tao Liu, Daniel T. Willingham, James Ashe · 2009 · Journal of Neuroscience
  14. Regional Differences in Extracellular Dopamine and Serotonin Assessed by In Vivo Microdialysis in Mice Lacking Dopamine and/or Serotonin Transporters
    Haowei Shen, Yoko Hagino, Hideaki Kobayashi, Keiko Shinohara-Tanaka, Kazutaka Ikeda, Hideko Yamamoto, Toshifumi Yamamoto, Klaus‐Peter Lesch, Dennis L. Murphy, Frank Scott Hall et al. · 2004 · Neuropsychopharmacology
  15. Coordinated Accumbal Dopamine Release and Neural Activity Drive Goal-Directed Behavior
    Joseph F. Cheer, Brandon J. Aragona, Michael L. Heien, Andrew T. Seipel, Regina M. Carelli, Robert Mark Wightman · 2007 · Neuron
  16. A dual‐systems perspective on addiction: contributions from neuroimaging and cognitive training
    Samuel M. McClure, Warren Kurt Bickel · 2014 · Annals of the New York Academy of Sciences
  17. A neural circuit model of flexible sensorimotor mapping: learning and forgetting on multiple timescales
    Fusi, Stefano, Asaad, Wael F., Miller, Earl K., Wang, Xiao-Jing · 2007 · Neuron
  18. Distinct Patterns of Striatal Medium Spiny Neuron Activity during the Natural Sleep–Wake Cycle
    Séverine Mahon, Nicolas Vautrelle, Laurent Pézard, Sean Slaght, Jean‐Michel Deniau, Guy Chouvet, Stéphane Charpier · 2006 · Journal of Neuroscience
  19. Associative Learning in Invertebrates
    Hawkins, Robert D., Byrne, John H. · 2015 · Cold Spring Harbor Perspectives in Biology
  20. The thought-translation device (TTD): neurobehavioral mechanisms and clinical outcome
    Niels Birbaumer, Thilo Hinterberger, Andrea Kübler, Nicola Neumann · 2003 · IEEE Transactions on Neural Systems and Rehabilitation Engineering
  21. Shaping action sequences in basal ganglia circuits
    Xin Jin, Rui M. Costa · 2015 · Current Opinion in Neurobiology
  22. A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism
    Moustafa, Ahmed A., Sherman, Scott J., Frank, Michael J. · 2008 · Neuropsychologia
  23. Neurogenetics and Pharmacology of Learning, Motivation, and Cognition
    Michael J. Frank, John Fossella · 2010 · Neuropsychopharmacology
  24. Monitoring and Updating of Action Selection for Goal-Directed Behavior through the Striatal Direct and Indirect Pathways
    Satoshi Nonomura, Kayo Nishizawa, Yutaka Sakai, Yasuo Kawaguchi, Shigeki Kato, Motokazu Uchigashima, Masahiko Watanabe, Ko Yamanaka, Kazuki Enomoto, Satomi Chiken et al. · 2018 · Neuron
  25. A Dopaminergic Axon Lattice in the Striatum and Its Relationship with Cortical and Thalamic Terminals
    Jonathan Moss, J. Paul Bolam · 2008 · Journal of Neuroscience
  26. Dopaminergic Genes Predict Individual Differences in Susceptibility to Confirmation Bias
    Doll, Bradley B., Hutchison, Kent E., Frank, Michael J. · 2011 · The Journal of Neuroscience
  27. Spine dynamics in the brain, mental disorders and artificial neural networks
    Haruo Kasai, Noam E. Ziv, Hitoshi Okazaki, Sho Yagishita, Taro Toyoizumi · 2021 · Nature reviews. Neuroscience
  28. Plasticity and Spontaneous Activity Pulses in Disused Human Brain Circuits
    Dillan J. Newbold, Timothy O. Laumann, Catherine R. Hoyt, Jacqueline M. Hampton, David F. Montez, Ryan V. Raut, Mario Ortega, Anish Mitra, Ashley N. Nielsen, Derek B. Miller et al. · 2020 · Neuron
  29. Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior
    Gruber, Aaron J., McDonald, Robert J. · 2012 · Frontiers in Behavioral Neuroscience
  30. Amygdala Central Nucleus Interacts with Dorsolateral Striatum to Regulate the Acquisition of Habits
    Lingawi, Nura W., Balleine, Bernard W. · 2012 · The Journal of Neuroscience
  31. The Meaning of Behavior: Discriminating Reflex and Volition in the Brain
    Bernard W. Balleine · 2019 · Neuron
  32. Dopamine and effort-based decision making
    Irma Triasih Kurniawan · 2011 · Frontiers in Neuroscience
  33. Endocannabinoids Shape Accumbal Encoding of Cue-Motivated Behavior via CB1 Receptor Activation in the Ventral Tegmentum
    Erik B. Oleson, Michael Beckert, Joshua T. Morra, Carien S. Lansink, Roger Cachope, Rehab A. Abdullah, Amy L. Loriaux, Dustin Schetters, Tommy Pattij, Mitchell F. Roitman et al. · 2012 · Neuron
  34. Nafion-stabilized two-dimensional transition metal carbide (Ti3C2Tx MXene) as a high-performance electrochemical sensor for neurotransmitter
    Faisal Shahzad, Aamir Iqbal, Shabi Abbas Zaidi, Suk‐Won Hwang, Chong Min Koo · 2019 · Journal of Industrial and Engineering Chemistry
  35. Striatal Contributions to Reward and Decision Making: Making Sense of Regional Variations in a Reiterated Processing Matrix
    WICKENS, JEFFERY R., BUDD, CHRISTOPHER S., HYLAND, BRIAN I., ARBUTHNOTT, GORDON W. · 2007 · Annals of the New York Academy of Sciences
  36. Mesolimbic confidence signals guide perceptual learning in the absence of external feedback
    Guggenmos, Matthias, Wilbertz, Gregor, Hebart, Martin N, Sterzer, Philipp · 2016 · eLife
  37. Model-based predictions for dopamine
    Langdon, Angela J, Sharpe, Melissa J, Schoenbaum, Geoffrey, Niv, Yael · 2018 · Current Opinion in Neurobiology
  38. Serotonin modulation of the basal ganglia circuitry: therapeutic implication for Parkinson's disease and other motor disorders
    V DIMATTEO, Massimo Pierucci, Emanuela Esposito, Giuseppe Crescimanno, A Benigno, Giuseppe Di Giovanni · 2008 · Progress in brain research
  39. Striatal synaptic plasticity: Implications for motor learning and Parkinson's disease
    Antonio Pisani, Diego Centonze, Giorgio Bernardi, Paolo Calabresi · 2005 · Movement Disorders
  40. Cerebellar aminergic neuromodulation: towards a functional understanding
    Nicolas Schweighofer, Kenji Doya, Shinya Kuroda · 2004 · Brain Research Reviews
  41. Anatomically segregated basal ganglia pathways allow parallel behavioral modulation
    Jaeeon Lee, Wengang Wang, Bernardo Luis Sabatini · 2020 · Nature Neuroscience
  42. Reward-Predicting Activity of Dopamine and Caudate Neurons—A Possible Mechanism of Motivational Control of Saccadic Eye Movement
    Reiko Kawagoe, Yoriko Takikawa, Okihide Hikosaka · 2004 · Journal of Neurophysiology
  43. Striatal cholinergic dysfunction as a unifying theme in the pathophysiology of dystonia
    Karen L. Eskow Jaunarajs, Paola Bonsi, Marie-Françoise Chesselet, David G. Standaert, Antonio Pisani · 2015 · Progress in Neurobiology
  44. Dopamine and glutamate regulate striatal acetylcholine in decision-making
    Lynne Chantranupong, Celia C. Beron, Joshua A. Zimmer, Michelle J. Wen, Wengang Wang, Bernardo Luis Sabatini · 2023 · Nature
  45. Reinforcement learning: Computational theory and biological mechanisms
    Doya, Kenji · 2007 · HFSP journal
  46. A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism
    Ahmed A. Moustafa, Michael X Cohen, Scott J. Sherman, Michael J. Frank · 2008 · Journal of Neuroscience
  47. Shaping of Motor Responses by Incentive Values through the Basal Ganglia
    Benjamin Pasquereau, Agnès Nadjar, David Arkadir, Erwan Bézard, Michel Goillandeau, Bernard H. Bioulac, Christian E. Gross, Thomas Boraud · 2007 · Journal of Neuroscience
  48. The hippocampus supports deliberation during value-based decisions
    Akram Bakkour, Daniela J. Palombo, Ariel Zylberberg, Yul HR Kang, Allison G. Reid, Mieke H. Verfaellie, Michael Neil Shadlen, Daphna Shohamy · 2019 · eLife
  49. Temporal Difference Modeling of the Blood-Oxygen Level Dependent Response During Aversive Conditioning in Humans: Effects of Dopaminergic Modulation
    Mahesh Menon, Jimmy Jensen, Irina Vitcu, Ariel Graff‐Guerrero, Adrian Philip Crawley, Mark A. Smith, Shitij Kapur · 2007 · Biological Psychiatry
  50. Striatal D1 and D2 signaling differentially predict learning from positive and negative outcomes
    Sylvia M. L. Cox, Michael J. Frank, Kevin Michel-Herve Larcher, Lesley K. Fellows, Crystal A. Clark, Marco Leyton, Alain Dagher · 2015 · NeuroImage
  51. Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation
    Catarina Owesson-White, Joseph F. Cheer, Manna Beyene, Regina M. Carelli, Robert Mark Wightman · 2008 · Proceedings of the National Academy of Sciences
  52. Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity
    Nicolas Frémaux, Henning Sprekeler, Wulfram Gerstner B · 2010 · Journal of Neuroscience
  53. Genetic contributions to avoidance-based decisions: striatal D2 receptor polymorphisms
    Michael J. Frank, Kent E. Hutchison · 2009 · Neuroscience
  54. Single dose of a dopamine agonist impairs reinforcement learning in humans: Evidence from event‐related potentials and computational modeling of striatal‐cortical function
    Diane L. Santesso, Anne Eden Evins, Michael J. Frank, Erika Cowman Schetter, Ryan Bogdan, Diego A. Pizzagalli · 2008 · Human Brain Mapping
  55. TD models of reward predictive responses in dopamine neurons
    Roland E. Suri · 2002 · Neural Networks
  56. Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources
    Beeler, Jeff A., Frazier, Cristianne R. M., Zhuang, Xiaoxi · 2012 · Frontiers in Integrative Neuroscience
  57. Where Do You Think You Are Going? The NMDA-D1 Receptor Trap
    Cepeda, Carlos, Levine, Michael S. · 2006 · Science's STKE
  58. Neurobiology of addiction versus drug use driven by lack of choice
    Serge H. Ahmed, Magalie Lenoir, Karine Guillem · 2013 · Current Opinion in Neurobiology
  59. Emergence of Complex Computational Structures From Chaotic Neural Networks Through Reward-Modulated Hebbian Learning
    Gregor Michael Hörzer, Robert A. Legenstein, Wolfgang Maass · 2012 · Cerebral Cortex
  60. Endocannabinoids in nervous system health and disease: the big picture in a nutshell
    Stephen D. Skaper, Vincenzo Di Marzo · 2012 · Philosophical Transactions of the Royal Society B Biological Sciences
  61. A Basal Ganglia Circuit Sufficient to Guide Birdsong Learning
    Lei Xiao, Gaurav Chattree, Francisco García‐Oscos, Mou Cao, Matthew J. Wanat, Todd F. Roberts · 2018 · Neuron
  62. Meaning and the brain: The neurosemantics of referential, interactive, and combinatorial knowledge
    Friedemann Pulvermüller A · 2011 · Journal of Neurolinguistics
  63. Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit
    Makoto Ito, Kenji Doya · 2011 · Current Opinion in Neurobiology
  64. Neural Basis of Motivational and Cognitive Control
    R. Mars, J. Sallet, Rushworth Mfs., N. Yeung · 2011 · The MIT Press eBooks
  65. A Biophysically Based Neural Model of Matching Law Behavior: Melioration by Stochastic Synapses
    Alireza Soltani, Xiao‐Jing Wang · 2006 · Journal of Neuroscience
  66. The locus coeruleus broadcasts prediction errors across the cortex to promote sensorimotor plasticity
    Rebecca Jordan, Georg B. Keller · 2023 · eLife
  67. Neurofeedback-mediated self-regulation of the dopaminergic midbrain
    James S. Sulzer, Ranganatha Sitaram, Maria Laura Blefari, Spyros Kollias, Niels Birbaumer, Klaas Enno Stephan, Andreas Rüdiger Luft, Roger Gassert · 2013 · NeuroImage
  68. Multiple Representations of Belief States and Action Values in Corticobasal Ganglia Loops
    Kazuyuki Samejima, Kenji Doya · 2007 · Annals of the New York Academy of Sciences
  69. Diminished FoxP2 Levels Affect Dopaminergic Modulation of Corticostriatal Signaling Important to Song Variability
    Malavika Murugan, Stephen C. Harward, Constance Scharff, RICHARD D. MOONEY · 2013 · Neuron
  70. Plastic Corticostriatal Circuits for Action Learning
    Rui M. Costa · 2007 · Annals of the New York Academy of Sciences
  71. A New Framework for Cortico-Striatal Plasticity: Behavioural Theory Meets In Vitro Data at the Reinforcement-Action Interface
    KEVIN N. GURNEY, Mark D. Humphries, Peter Redgrave · 2015 · PLoS Biology
  72. The Acquisition of Goal-Directed Actions Generates Opposing Plasticity in Direct and Indirect Pathways in Dorsomedial Striatum
    Shan, Q., Ge, M., Christie, M. J., Balleine, B. W. · 2014 · Journal of Neuroscience
  73. Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies
    Mehdi Khamassi, Mark D. Humphries · 2012 · Frontiers in Behavioral Neuroscience
  74. Reward facilitates tactile judgments and modulates hemodynamic responses in human primary somatosensory cortex
    Pleger, Burkhard, Blankenburg, Felix, Ruff, Christian C., Driver, Jon, Dolan, Raymond J. · 2008 · The Journal of Neuroscience
  75. Covert skill learning in a cortical-basal ganglia circuit
    Jonathan D. Charlesworth, Timothy L. Warren, Michael S. Brainard · 2012 · Nature
  76. The Presence of Background Dopamine Signal Converts Long-Term Synaptic Depression to Potentiation in Rat Prefrontal Cortex
    Yoshiki Matsuda, Aude Marzo, Satoru Otani · 2006 · Journal of Neuroscience
  77. Synaptic computation underlying probabilistic inference
    Alireza Soltani, Xiao‐Jing Wang · 2009 · Nature Neuroscience
  78. Convergent evidence for abnormal striatal synaptic plasticity in dystonia
    David A. Peterson, Terrence J. Sejnowski A B, Howard Poizner A · 2009 · Neurobiology of Disease
  79. The influence of uric and ascorbic acid on the electrochemical detection of dopamine using graphene-modified electrodes
    Stela Maria Pruneanu, Alexandru Radu Biris, Florina Pogăcean, Crina Socaci, Maria Coroş, Marcela‐Corina Roşu, Fumiya Watanabe, Alexandru Sorin Biris · 2014 · Electrochimica Acta
  80. Alpha-synuclein targets GluN2A NMDA receptor subunit causing striatal synaptic dysfunction and visuospatial memory alteration
    Valentina Durante, Antonio de Iure, Vittorio Loffredo, Nishant N. Vaikath, Maria De Risi, Silvia Paciotti, Ana Quiroga‐Varela, Davide Chiasserini, Manuela Mellone, Petra Mazzocchetti et al. · 2019 · Brain
  81. Habitual versus goal-directed action control in Parkinson disease
    de Wit, Sanne, Barker, Roger A., Dickinson, Anthony D., Cools, Roshan · 2011 · Journal of Cognitive Neuroscience
  82. Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
    Metereau, Elise, Dreher, Jean-Claude · 2013 · Cerebral Cortex
  83. Levodopa-induced plasticity: a double-edged sword in Parkinson's disease?
    Paolo Calabresi, Veronica Ghiglieri, Petra Mazzocchetti, Ilenia Corbelli, Barbara Picconi · 2015 · Philosophical Transactions of the Royal Society B Biological Sciences
  84. Electrophysiological Interactions between Striatal Glutamatergic and Dopaminergic Systems
    A. R. West, S. Floresco, A. Charara, J. Rosenkranz, Anthony A. Grace · 2003 · Annals of the New York Academy of Sciences
  85. A competitive model for striatal action selection
    Sebastiano Bariselli, Wambura C. Fobbs, Meaghan C. Creed, Alexxai V. Kravitz · 2018 · Brain Research
  86. Synaptic plasticity in the basal ganglia
    Jeffery R. Wickens · 2008 · Behavioural Brain Research
  87. Basolateral Amygdala Modulates Terminal Dopamine Release in the Nucleus Accumbens and Conditioned Responding
    Joshua L. Jones, Jeremy J. Day, Brandon J. Aragona, Robert A. Wheeler, Robert Mark Wightman, Regina M. Carelli · 2009 · Biological Psychiatry
  88. Dopamine, reward learning, and active inference
    FitzGerald, Thomas H. B., Dolan, Raymond J., Friston, Karl · 2015 · Frontiers in Computational Neuroscience
  89. Acquisition and Performance of Goal-Directed Instrumental Actions Depends on ERK Signaling in Distinct Regions of Dorsal Striatum in Rats
    Michael W. Shiflett, Robert A. Brown, Bernard W. Balleine · 2010 · Journal of Neuroscience
  90. A Kinetic Model of Dopamine- and Calcium-Dependent Striatal Synaptic Plasticity
    Takashi Nakano, Tomokazu Doi, Junichiro Yoshimoto, Kenji Doya · 2010 · PLoS Computational Biology
  91. Subthalamic, not striatal, activity correlates with basal ganglia downstream activity in normal and parkinsonian monkeys
    Marc Deffains, Liliya Iskhakova, Shiran Katabi, Suzanne N. Haber, Zvi H. Israel, Hagai Bergman · 2016 · eLife
  92. Neurocomputational models of motor and cognitive deficits in Parkinson’s disease
    Thomas V. Wiecki, Michael J. Frank · 2010 · Progress in brain research
  93. Striatal cholinergic interneurons and cortico‐striatal synaptic plasticity in health and disease
    Marc Deffains, Hagai Bergman · 2015 · Movement Disorders
  94. Modulation of an Afterhyperpolarization by the Substantia Nigra Induces Pauses in the Tonic Firing of Striatal Cholinergic Interneurons
    John N. J. Reynolds, Brian I. Hyland, Jeffery R. Wickens · 2004 · Journal of Neuroscience
  95. Molecular substrates of action control in cortico-striatal circuits
    Michael W. Shiflett, Bernard W. Balleine · 2011 · Progress in Neurobiology
  96. Spike-Based Reinforcement Learning in Continuous State and Action Space: When Policy Gradient Methods Fail
    Eleni Vasilaki, Nicolas Frémaux, Robert Urbanczik, Walter Senn, Wulfram Gerstner · 2009 · PLoS Computational Biology
  97. Ethanol reverses the direction of long‐term synaptic plasticity in the dorsomedial striatum
    Henry H. Yin, Brian S. Park, Louise Adermark, David M. Lovinger · 2007 · European Journal of Neuroscience
  98. Cellular Mechanisms Underlying Burst Firing in Substantia Nigra Dopamine Neurons
    Sarah Ganz Blythe, David L. Wokosin, Jeremy F. Atherton, Mark D. Bevan · 2009 · Journal of Neuroscience
  99. Encoding of both positive and negative reward prediction errors by neurons of the primate lateral prefrontal cortex and caudate nucleus
    Asaad, Wael F., Eskandar, Emad N. · 2011 · The Journal of Neuroscience
  100. Reinforcement determines the timing dependence of corticostriatal synaptic plasticity in vivo
    Simon D. Fisher, Paul B. Robertson, Melony J. Black, Peter Redgrave, Mark A. Sagar, Wickliffe C. Abraham, John N. J. Reynolds · 2017 · Nature Communications