A cellular mechanism of reward-related learning

Reynolds, John N. J.; Hyland, Brian I.; Wickens, Jeffery R.

doi:10.1038/35092560

Cited by 879Neurotransmitter Receptor Influence on BehaviorNeuroscience and Neuropharmacology ResearchMemory and Neural Mechanisms

A cellular mechanism of reward-related learning

Reynolds, John N. J., Hyland, Brian I., Wickens, Jeffery R.·2001·Nature

DOI 10.1038/35092560

Open this paper in CoChat — free account

Abstract

Positive reinforcement helps to control the acquisition of learned behaviours. Here we report a cellular mechanism in the brain that may underlie the behavioural effects of positive reinforcement. We used intracranial self-stimulation (ICSS) as a model of reinforcement learning, in which each rat learns to press a lever that applies reinforcing electrical stimulation to its own substantia nigra. The outputs from neurons of the substantia nigra terminate on neurons in the striatum in close proximity to inputs from the cerebral cortex on the same striatal neurons. We measured the effect of substantia nigra stimulation on these inputs from the cortex to striatal neurons and also on how quickly the rats learned to press the lever. We found that stimulation of the substantia nigra (with the optimal parameters for lever-pressing behaviour) induced potentiation of synapses between the cortex and the striatum, which required activation of dopamine receptors. The degree of potentiation within ten minutes of the ICSS trains was correlated with the time taken by the rats to learn ICSS behaviour. We propose that stimulation of the substantia nigra when the lever is pressed induces a similar potentiation of cortical inputs to the striatum, positively reinforcing the learning of the behaviour by the rats.

Integrity signals

Registry

Crossref · 10.1038/35092560

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Gaming increases the release of striatal dopamine, promoting long-term potentiation of neural connections within the striatum, which is suggested to improve motivation and one's ability to learn.
“Gaming increases the release of striatal dopamine [47], [48], promoting long-term potentiation of neural connections within the striatum [49], which is suggested to improve motivation and one’s ability to learn [50] (e.g., during EF training).”
From Improving Executive Functioning in Children with ADHD: Training Multiple Executive Functions within the Context of a Computer Game. A Randomized Double-Blind Placebo Controlled Trial (2015) · cites this paper as [49]
Phasic firing of dopamine neurons has been suggested as reporting the temporal difference prediction error for reward that underpins model-free evaluation and control via its influence over activity and plasticity.
“First, as noted, the phasic firing of dopamine neurons has been suggested as reporting the temporal difference prediction error for reward (Montague et al., 1996; Schultz et al., 1997) that underpins model-free evaluation and control via its influence over activity and plasticity (Reynolds et al., 2001; Frank, 2005).”
From Goals and Habits in the Brain (2013) · cites this paper as Reynolds et al., 2001

The rat brain in stereotaxic coordinates
Palkovits, M. (1983) · Neuropeptides · doi:10.1016/0143-4179(83)90049-5 · Cited by 28,959 · see citing works
The Rat Brain in Stereotaxic Coordinates
Paxinos, G., & Watson, C. (1983) · Elsevier eBooks · doi:10.1016/c2009-0-63235-9 · Cited by 28,585 · see citing works
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527 · see citing works
Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain.
Olds, J., & Milner, P. (1954) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0058775 · Cited by 3,176 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718 · see citing works
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303 · see citing works
The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones
Smith, A. D., & Bolam, J. P. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90106-k · Cited by 1,040 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons
Wilson, C. J., & Kawaguchi, Y. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-07-02397.1996 · Cited by 798 · see citing works
Addictive Drugs and Brain Stimulation Reward
Wise, R. A. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.001535 · Cited by 792 · see citing works
Preparation for movement: neural representations of intended direction in three motor areas of the monkey.
Alexander, G. E., & Crutcher, M. D. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.64.1.133 · Cited by 750 · see citing works
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 544 · see citing works
Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys
Aosaki, T., Graybiel, A. M., & Kimura, M. (1994) · Science · doi:10.1126/science.8023166 · Cited by 427 · see citing works
Spontaneous firing patterns of identified spiny neurons in the rat neostriatum.
Wilson, C., & Groves, P. (1981) · Brain Research · doi:10.1016/0006-8993(81)90211-0 · Cited by 369 · see citing works
Membrane potential synchrony of simultaneously recorded striatal spiny neurons in vivo
Stern, E. A., Jaeger, D., & Wilson, C. J. (1998) · Nature · doi:10.1038/28848 · Cited by 340 · see citing works
A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294 · see citing works
Intracranial self-stimulation in relation to the ascending dopaminergic systems of the midbrain: A moveable electrode mapping study
Corbett, D., & Wise, R. A. (1980) · Brain Research · doi:10.1016/0006-8993(80)90666-6 · Cited by 264 · see citing works
Behaviorally contingent property of movement-related activity of the primate putamen
Kimura, M. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.6.1277 · Cited by 226 · see citing works
In vivo activity-dependent plasticity at cortico-striatal connections: Evidence for physiological long-term potentiation
Charpier, S., & Deniau, J. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.13.7036 · Cited by 222 · see citing works
The role of dopamine in intracranial self-stimulation of the ventral tegmental area
Fibiger, H., LePiane, F., Jakubovic, A., & Phillips, A. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-12-03888.1987 · Cited by 189 · see citing works
Nigrostriatal Dopamine System in Learning to Perform Sequential Motor Tasks in a Predictive Manner
Matsumoto, N., Hanakawa, T., Maki, S., Graybiel, A. M., & Kimura, M. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.82.2.978 · Cited by 181 · see citing works
Evidence implicating descending fibers in self-stimulation of the medial forebrain bundle
Bielajew, C. H., & Shizgal, P. (1986) · Journal of Neuroscience · doi:10.1523/jneurosci.06-04-00919.1986 · Cited by 175 · see citing works
Postsynaptic potentials evoked in spiny neostriatal projection neurons by stimulation of ipsilateral and contralateral neocortex
Wilson, C. J. (1986) · Brain Research · doi:10.1016/0006-8993(86)91593-3 · Cited by 143 · see citing works
Substantia nigra dopamine regulates synaptic plasticity and membrane potential fluctuations in the rat neostriatum, in vivo
Reynolds, J. N. J., & Wickens, J. R. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00273-6 · Cited by 131 · see citing works
Self-citation
An evaluation of response rate as a measure of rewarding intracranial stimulation.
Hodos, W., & Valenstein, E. S. (1962) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0047681 · Cited by 130 · see citing works
Memory facilitation by self-stimulation reinforcement mediated by the nigro-neostriatal bundle☆
Major, R., & White, N. M. (1978) · Physiology & Behavior · doi:10.1016/0031-9384(78)90298-6 · Cited by 84 · see citing works
The relationship between stimulation voltage and rate of hypothalamic self-stimulation in the rat.
Reynolds, R. W. (1958) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0048362 · Cited by 71 · see citing works
Meaning and Purpose in the Intact Brain
Miller, R. A. (1981) · Cited by 48 · see citing works
Schedule Control of Behavior Reinforced by Electrical Stimulation of the Brain
Beninger, R. J., Bellisle, F., & Milner, P. M. (1977) · Science · doi:10.1126/science.850798 · Cited by 40 · see citing works
Role of Nigrostriatal Dopamine System in Learning to Perform Sequential Motor Tasks in a Predictive Manner
松本, 直. (2000) · doi:10.11501/3172774 · Cited by 38 · see citing works
Reward summation and the effects of dopamine D1 and D2 agonists and antagonists on fixed-interval responding for brain stimulation
Hunt, G. E., Atrens, D. M., & Jackson, D. M. (1994) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(94)90192-9 · Cited by 28 · see citing works
Meaning and Purpose
Walker, K. F. (1944) · Medical Entomology and Zoology · Cited by 10 · see citing works

Flagged first, then by citations

Sorted by citations

Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
The role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402 · see citing works
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775 · see citing works
Dichotomous dopaminergic control of striatal synaptic plasticity
Shen, W., Flajolet, M., Greengard, P., & Surmeier, D. J. (2008) · Science · doi:10.1126/science.1160575 · Cited by 1,190 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works
a dynamic developmental theory of attention-deficit/hyperactivity disorder (adhd) predominantly hyperactive/impulsive and combined subtypes
sagvolden, T., johansen, E. B., aase, H., & russell, V. A. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000075 · Cited by 1,035 · see citing works
Behavioral dopamine signals.
Schultz, W. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.007 · Cited by 1,028 · see citing works
Striatal Plasticity and Basal Ganglia Circuit Function
Kreitzer, A. C., & Malenka, R. C. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.005 · Cited by 1,009 · see citing works
Goals and Habits in the Brain
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
A causal link between prediction errors, dopamine neurons and learning
Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K. A., & Janak, P. H. (2013) · Nature Neuroscience · doi:10.1038/nn.3413 · Cited by 879 · see citing works
Dopamine-mediated regulation of corticostriatal synaptic plasticity
Calabresi, P., Picconi, B., Tozzi, A., & Di Filippo, M. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.001 · Cited by 865 · see citing works
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855 · see citing works
Loss of bidirectional striatal synaptic plasticity in L-DOPA-induced dyskinesia
Picconi, B., Centonze, D., Håkansson, K., Bernardi, G., Greengard, P., Fisone, G., Cenci, M. A., & Calabresi, P. (2003) · Nature Neuroscience · doi:10.1038/nn1040 · Cited by 821 · see citing works
Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill
Yin, H. H., Mulcare, S. P., Hilário, M. R. F., Clouse, E., Holloway, T., Davis, M. I., Hansson, A. C., Lovinger, D. M., & Costa, R. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2261 · Cited by 818 · see citing works
Mesolimbic dopamine signals the value of work
Hamid, A., Pettibone, J. R., Mabrouk, O. S., Hetrick, V. L., Schmidt, R., Weele, C. M. V., Kennedy, R. T., Aragona, B. J., & Berke, J. D. (2015) · Nature Neuroscience · doi:10.1038/nn.4173 · Cited by 815 · see citing works
Memory and Addiction
Kelley, A. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.016 · Cited by 773 · see citing works
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 724 · see citing works
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · see citing works
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704 · see citing works
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · see citing works
“…errors (Schultz, 1998) and that long-term potentiation and depression of the cortico-striatal synapses depend on the dopamine signals (Reynolds et al., 2001; Shen et al., 2008), our work suggests that dopamine-dependent plasticity of corticostriatal synapses represents a candidate…”
Background
Neuroeconomics: Decision Making and the Brain
Rushworth, M. F. S., & Walton, M. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.005 · Cited by 669 · see citing works
Updating dopamine reward signals
Schultz, W. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.012 · Cited by 651 · see citing works
Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions
Gremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618 · see citing works
A critical time window for dopamine actions on the structural plasticity of dendritic spines
Yagishita, S., Hayashi-Takagi, A., Ellis-Davies, G. C. R., Urakubo, H., Ishii, S., & Kasai, H. (2014) · Science · doi:10.1126/science.1255514 · Cited by 614 · see citing works
Behavioral functions of the mesolimbic dopaminergic system: An affective neuroethological perspective
Alcaro, A., Huber, R., & Panksepp, J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.07.014 · Cited by 614 · see citing works
Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595 · see citing works
Nicotine amplifies reward-related dopamine signals in striatum
Rice, M. E., & Cragg, S. J. (2004) · Nature Neuroscience · doi:10.1038/nn1244 · Cited by 594 · see citing works
Dopamine and reward: The anhedonia hypothesis 30 years on
Wise, R. A. (2008) · Neurotoxicity Research · doi:10.1007/bf03033808 · Cited by 580 · see citing works
Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.012 · Cited by 574 · see citing works
Stuttering and the basal ganglia circuits: a critical review of possible relations
Alm, P. A. (2004) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2004.03.001 · Cited by 560 · see citing works
Striatal circuits for reward learning and decision-making
Cox, J., & Witten, I. B. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0189-2 · Cited by 554 · see citing works
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 542 · see citing works
Dopamine-dependent plasticity of corticostriatal synapses
Reynolds, J. N. J., & Wickens, J. R. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00045-x · Cited by 528 · see citing works
Self-citation
Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks
Lo, C.-C., & Wang, X.-J. (2006) · Nature Neuroscience · doi:10.1038/nn1722 · Cited by 505 · see citing works
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501 · see citing works
Roles for nigrostriatal—not just mesocorticolimbic—dopamine in reward and addiction
Wise, R. A. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.06.004 · Cited by 500 · see citing works
Neurobiology of ADHD
Tripp, G., & Wickens, J. R. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2009.07.026 · Cited by 492 · see citing works
Self-citation
Neurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum
Lovinger, D. M. (2010) · Neuropharmacology · doi:10.1016/j.neuropharm.2010.01.008 · Cited by 488 · see citing works
Firing modes of midbrain dopamine cells in the freely moving rat
Hyland, B. I., Reynolds, J. N. J., HAY, J. G., Perk, C. G., & Miller, R. (2002) · Neuroscience · doi:10.1016/s0306-4522(02)00267-1 · Cited by 487 · see citing works
Self-citation
It could be habit forming: drugs of abuse and striatal synaptic plasticity
Gerdeman, G. L., Partridge, J. G., Lupica, C. R., & Lovinger, D. M. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00065-1 · Cited by 480 · see citing works
The computational neurobiology of learning and reward
Daw, N. D., & Doya, K. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.006 · Cited by 462 · see citing works
Inflammation Effects on Motivation and Motor Activity: Role of Dopamine
Felger, J. C., & Treadway, M. T. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.143 · Cited by 453 · see citing works
Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain
Kim, H., Shimojo, S., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 447 · see citing works
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445 · see citing works
Addictive and non‐addictive drugs induce distinct and specific patterns of ERK activation in mouse brain
Valjent, E., Pagès, C., Hervé, D., Girault, J., & Caboche, J. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03278.x · Cited by 434 · see citing works
The ins and outs of the striatum: Role in drug addiction
Yager, L. M., Garcia, A. F., Wunsch, A. M., & Ferguson, S. M. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2015.06.033 · Cited by 421 · see citing works
Dopamine and Addiction
Wise, R. A., & Robble, M. A. (2020) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-103337 · Cited by 418 · see citing works
Dopamine Receptor Activation Is Required for Corticostriatal Spike-Timing-Dependent Plasticity
Pawlak, V., & Kerr, J. N. D. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.4402-07.2008 · Cited by 412 · see citing works
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 411 · see citing works
Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.
Collins, A. G. E., & Frank, M. J. (2014) · Psychological Review · doi:10.1037/a0037015 · Cited by 395 · see citing works
Information processing, dimensionality reduction and reinforcement learning in the basal ganglia
Bar‐Gad, I., Morris, G., & Bergman, H. (2003) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2003.12.001 · Cited by 394 · see citing works
Endocannabinoid signaling system and brain reward: emphasis on dopamine
GARDNER, E. (2005) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2005.01.032 · Cited by 387 · see citing works
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377 · see citing works
Context dependence of the event‐related brain potential associated with reward and punishment
Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2004.00152.x · Cited by 376 · see citing works
Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362 · see citing works
The integrative function of the basal ganglia in instrumental conditioning
Balleine, B. W., Liljeholm, M., & Ostlund, S. B. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.034 · Cited by 356 · see citing works
Distinct subclasses of medium spiny neurons differentially regulate striatal motor behaviors
Bateup, H. S., Santini, E., Shen, W., Birnbaum, S. G., Valjent, E., Surmeier, D., Fisone, G., Nestler, E. J., & Greengard, P. (2010) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.1009874107 · Cited by 361 · see citing works
Chronic dopaminergic stimulation in Parkinson's disease: from dyskinesias to impulse control disorders
Voon, V., Fernagut, P., Wickens, J. R., Baunez, C., Rodríguez‐Oroz, M., Pavon, N., Juncos, J. L., Obeso, J. A., & Bézard, E. (2009) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70287-x · Cited by 352 · see citing works
Self-citation
Research Review: Dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD
Tripp, G., & Wickens, J. R. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01851.x · Cited by 346 · see citing works
Self-citation
Corticostriatal neurons in auditory cortex drive decisions during auditory discrimination
Znamenskiy, P., & Zador, A. M. (2013) · Nature · doi:10.1038/nature12077 · Cited by 339 · see citing works
Operant Reward Learning in <i>Aplysia</i> : Neuronal Correlates and Mechanisms
Brembs, B., Lorenzetti, F. D., Reyes, F. D., Baxter, D. A., & Byrne, J. H. (2002) · Science · doi:10.1126/science.1069434 · Cited by 338 · see citing works
An fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 337 · see citing works
Identifying the neurobiology of altered reinforcement sensitivity in ADHD: A review and research agenda
Luman, M., Tripp, G., & Scheres, A. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.11.021 · Cited by 335 · see citing works
Deep Brain Stimulation for Neurologic and Neuropsychiatric Disorders
Wichmann, T., & DeLong, M. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.09.022 · Cited by 331 · see citing works
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
Reward Improves Long-Term Retention of a Motor Memory through Induction of Offline Memory Gains
Abe, M., Schambra, H., Wassermann, E. M., Luckenbaugh, D., Schweighofer, N., & Cohen, L. G. (2011) · Current Biology · doi:10.1016/j.cub.2011.02.030 · Cited by 313 · see citing works
With or without you: predictive coding and Bayesian inference in the brain
Aitchison, L., & Lengyel, M. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.010 · Cited by 308 · see citing works
Inhibitory Interactions Between Spiny Projection Neurons in the Rat Striatum
Tunstall, M. J., Oorschot, D. E., Kean, A., & Wickens, J. R. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.3.1263 · Cited by 311 · see citing works
Self-citation
Neuro-inspired electronic skin for robots
Liu, F., Deswal, S., Christou, A., Sandamirskaya, Y., Kaboli, M., & Dahiya, R. (2022) · Science Robotics · doi:10.1126/scirobotics.abl7344 · Cited by 307 · see citing works
Role of prefrontal cortex and the midbrain dopamine system in working memory updating
D’Ardenne, K., Eshel, N., Luka, J., Lenartowicz, A., Nystrom, L. E., & Cohen, J. D. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116727109 · Cited by 303 · see citing works
Habits, action sequences and reinforcement learning
Dezfouli, A., & Balleine, B. W. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08050.x · Cited by 297 · see citing works
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284 · see citing works
Self-citation
Rapid Alterations in Corticostriatal Ensemble Coordination during Acute Dopamine-Dependent Motor Dysfunction
Costa, R. M., Lin, S., Sotnikova, T. D., Cyr, M., Gainetdinov, R. R., Caron, M. G., & Nicolelis, M. A. L. (2006) · Neuron · doi:10.1016/j.neuron.2006.07.030 · Cited by 280 · see citing works
Monitoring and Control of Action by the Frontal Lobes
Schall, J. D., Stuphorn, V., & Brown, J. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00964-9 · Cited by 280 · see citing works
Dopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 276 · see citing works
Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials
Joshua, M., Adler, A., Mitelman, R., Vaadia, E., & Bergman, H. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3839-08.2008 · Cited by 273 · see citing works
Improving Executive Functioning in Children with ADHD: Training Multiple Executive Functions within the Context of a Computer Game. A Randomized Double-Blind Placebo Controlled Trial
Dovis, S., Van der Oord, S., Wiers, R. W., & Prins, P. J. M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0121651 · Cited by 272 · see citing works
A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback
Legenstein, R. A., Pecevski, D., & Maass, W. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000180 · Cited by 272 · see citing works
The Dopamine Hypothesis of Drug Addiction: Hypodopaminergic State
Melis, M., Spiga, S., & Diana, M. (2005) · International review of neurobiology · doi:10.1016/s0074-7742(05)63005-x · Cited by 271 · see citing works
Dopaminergic Mechanisms in Actions and Habits: Figure 1.
Wickens, J. R., Horvitz, J. C., Costa, R. M., & Killcross, S. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1671-07.2007 · Cited by 271 · see citing works
Self-citation
How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades
Brown, J. W., Bullock, D. H., & Grossberg, S. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.08.006 · Cited by 263 · see citing works
Selective Coupling of T-Type Calcium Channels to SK Potassium Channels Prevents Intrinsic Bursting in Dopaminergic Midbrain Neurons
Wolfart, J., & Roeper, J. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-09-03404.2002 · Cited by 260 · see citing works
Attention-Gated Reinforcement Learning of Internal Representations for Classification
Roelfsema, P. R., & van Ooyen, A. (2005) · Neural Computation · doi:10.1162/0899766054615699 · Cited by 258 · see citing works
Dopamine prediction error responses integrate subjective value from different reward dimensions
Lak, A., Stauffer, W. R., & Schultz, W. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1321596111 · Cited by 257 · see citing works
Prefrontal Cortex Fails to Learn from Reward Prediction Errors in Alcohol Dependence
Park, S. Q., Kahnt, T., Beck, A., Cohen, M. X., Dolan, R. J., Wrase, J., & Heinz, A. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5587-09.2010 · Cited by 257 · see citing works
What is reinforced by phasic dopamine signals?
Redgrave, P., GURNEY, K. N., & Reynolds, J. N. J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.10.007 · Cited by 254 · see citing works
Self-citation
Dopamine gating of forebrain neural ensembles
O’Donnell, P. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02463.x · Cited by 253 · see citing works
Selective corticostriatal plasticity during acquisition of an auditory discrimination task
Xiong, Q., Znamenskiy, P., & Zador, A. M. (2015) · Nature · doi:10.1038/nature14225 · Cited by 249 · see citing works
Distinct Roles of D1and D5Dopamine Receptors in Motor Activity and Striatal Synaptic Plasticity
Centonze, D., Grande, C., Saulle, E., Martín, A. B., Gubellini, P., Fuentes, N. P., Pisani, A., Bernardi, G., Moratalla, R., & Calabresi, P. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-24-08506.2003 · Cited by 250 · see citing works
Presynaptic nicotinic receptors: a dynamic and diverse cholinergic filter of striatal dopamine neurotransmission
Exley, R. A., & Cragg, S. J. (2007) · British Journal of Pharmacology · doi:10.1038/sj.bjp.0707510 · Cited by 249 · see citing works
Meaningful silences: how dopamine listens to the ACh pause
Cragg, S. J. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.01.003 · Cited by 245 · see citing works
The thalamostriatal system in normal and diseased states
Smith, Y., Galván, A., Ellender, T. J., Doig, N. M., Villalba, R. M., Huerta-Ocampo, I., Wichmann, T., & Bolam, J. P. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00005 · Cited by 244 · see citing works
Disrupted motor learning and long-term synaptic plasticity in mice lacking NMDAR1 in the striatum
Dang, M. T., Yokoi, F., Yin, H. H., Lovinger, D. M., Wang, Y., & Li, Y. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601758103 · Cited by 241 · see citing works
Neurocomputational models of basal ganglia function in learning, memory and choice
Cohen, M. X., & Frank, M. J. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.029 · Cited by 238 · see citing works
Selective enhancement of associative learning by microstimulation of the anterior caudate
Williams, Z. M., & Eskandar, E. N. (2006) · Nature Neuroscience · doi:10.1038/nn1662 · Cited by 235 · see citing works
Deficits in Positive Reinforcement Learning and Uncertainty-Driven Exploration Are Associated with Distinct Aspects of Negative Symptoms in Schizophrenia
Strauss, G. P., Frank, M. J., Waltz, J. A., Kasanova, Z., Herbener, E. S., & Gold, J. M. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.10.015 · Cited by 232 · see citing works

Microstimulation of the Human Substantia Nigra Alters Reinforcement Learning
Ramayya, A. G., Misra, A., Baltuch, G. H., & Kahana, M. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.5445-13.2014 · Cited by 33 · see citing works
Positive Reinforcement Mediated by Midbrain Dopamine Neurons Requires D1 and D2 Receptor Activation in the Nucleus Accumbens
Steinberg, E. E., Boivin, J. R., Saunders, B. T., Witten, I. B., Deisseroth, K. A., & Janak, P. H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094771 · Cited by 146 · see citing works
Sensory Reinforced Corticostriatal Plasticity
Vautrelle, N., Coizet, V., Leriche, M., Dahan, L., Schulz, J. M., Zhang, Y.-F., Zeghbib, A., Overton, P. G., Bracci, E., Redgrave, P., et al. (2023) · Current Neuropharmacology · doi:10.2174/1570159x21666230801110359 · Cited by 3 · see citing works
Self-citation
Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation
Owesson-White, C., Cheer, J. F., Beyene, M., Carelli, R. M., & Wightman, R. M. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803896105 · Cited by 144 · see citing works
Behavioral/Cognitive Microstimulation of the Human Substantia Nigra Alters Reinforcement Learning
Ramayya, A. G., Misra, A., Baltuch, G. H., & Kahana, M. J. (2016)

Authors: Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R.
Affiliations: University of Otago (NZ)
Corresponding author: Wickens, Jeffery R.
ORCID: Reynolds, John N. J.
Hyland, Brian I.
Wickens, Jeffery R.
Venue: Nature
Publisher: Springer Science and Business Media LLC
Published: 2001-09
Volume: 413
Issue: 6851
Pages: 67-70
ISSN: 0028-0836 (ISSN-L)
1476-4687
DOI: 10.1038/35092560
OpenAlex: W2055523610
Cited by: 879
References: 33
Citations by year: 2026: 20 · 2025: 36 · 2024: 54 · 2023: 42 · 2022: 36 · 2021: 28 · 2020: 32 · 2019: 35 · 2018: 28 · 2017: 26 · 2016: 33 · 2015: 44 · 2014: 42 · 2013: 35 · 2012: 32
FWCI: 8.10
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Nature (publishedVersion)
PubMed (publishedVersion)
RePEc: Research Papers in Economics (submittedVersion)
Funders: Institut National de la Santé et de la Recherche Médicale
Saint Petersburg State University
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neuropharmacology Research
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords: reward learning, positive reinforcement, intracranial self-stimulation, substantia nigra, striatum, synaptic potentiation, dopamine receptors, learning acquisition
MeSH terms: Animals, Brain, Cerebral Cortex, Corpus Striatum, Dopamine, Learning, Male, Models, Neurological, Neural Pathways, Neurons, Reinforcement, Psychology, Reward, Self Stimulation, Substantia Nigra, Synapses, Rats, Wistar, Rats

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A cellular mechanism of reward-related learning

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks