The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
A cellular mechanism of reward-related learning
Abstract
Positive reinforcement helps to control the acquisition of learned behaviours. Here we report a cellular mechanism in the brain that may underlie the behavioural effects of positive reinforcement. We used intracranial self-stimulation (ICSS) as a model of reinforcement learning, in which each rat learns to press a lever that applies reinforcing electrical stimulation to its own substantia nigra. The outputs from neurons of the substantia nigra terminate on neurons in the striatum in close proximity to inputs from the cerebral cortex on the same striatal neurons. We measured the effect of substantia nigra stimulation on these inputs from the cortex to striatal neurons and also on how quickly the rats learned to press the lever. We found that stimulation of the substantia nigra (with the optimal parameters for lever-pressing behaviour) induced potentiation of synapses between the cortex and the striatum, which required activation of dopamine receptors. The degree of potentiation within ten minutes of the ICSS trains was correlated with the time taken by the rats to learn ICSS behaviour. We propose that stimulation of the substantia nigra when the lever is pressed induces a similar potentiation of cortical inputs to the striatum, positively reinforcing the learning of the behaviour by the rats.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Gaming increases the release of striatal dopamine [47], [48], promoting long-term potentiation of neural connections within the striatum [49], which is suggested to improve motivation and one’s ability to learn [50] (e.g., during EF training).”
In the citing paper
“First, as noted, the phasic firing of dopamine neurons has been suggested as reporting the temporal difference prediction error for reward (Montague et al., 1996; Schultz et al., 1997) that underpins model-free evaluation and control via its influence over activity and plasticity (Reynolds et al., 2001; Frank, 2005).”
From Goals and Habits in the Brain (2013) · cites this paper as Reynolds et al., 2001
Citations
Cites
The rat brain in stereotaxic coordinates
Palkovits, M. (1983) · Neuropeptides · doi:10.1016/0143-4179(83)90049-5 · Cited by 28,959
The Rat Brain in Stereotaxic Coordinates
Paxinos, G., & Watson, C. (1983) · Elsevier eBooks · doi:10.1016/c2009-0-63235-9 · Cited by 28,585
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Olds, J., & Milner, P. (1954) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0058775 · Cited by 3,176
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
Smith, A. D., & Bolam, J. P. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90106-k · Cited by 1,040
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829
The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons
Wilson, C. J., & Kawaguchi, Y. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-07-02397.1996 · Cited by 798
Flagged first, then by citations
Cited by
Sorted by citations
Items 701–800 of 862
Part 4: Reinforcement learning: Machine learning and natural learning
Ishii, S., & Yoshida, W. (2006) · New Generation Computing · doi:10.1007/bf03037338 · Cited by 2
Electrophysiology of the Corticostriatal Network in Vivo
Pidoux, M., Mahon, S., & Charpier, S. (2011) · Frontiers in neuroscience · doi:10.1201/b11284-8 · Cited by 2
Tripp, A. C., Kota, R. S., Lewis, D. A., & Sibille, E. L. (2010) · Cited by 2
The Adenosine Receptor: A Homeostatic Neuromodulator for Fine-Tuning Control of Cognition
Chen, J. (2018) · Springer eBooks · doi:10.1007/978-3-319-90808-3_15 · Cited by 2
Psychological and Neural Evidence for Reinforcement Learning: A Survey.Preprint
Subramanian, A., Chitlangia, S., & Baths, V. (2020) · arXiv (Cornell University) · Cited by 2
Neuronal mechanism of the encoding of socially familiar faces in the striatum tailPreprint
Kunimatsu, J., Amita, H., & Hikosaka, O. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.05.10.540108 · Cited by 2
A dopamine circuit regulates locomotor initiation and persistence in DrosophilaPreprint
Wen, X., Connors, K. E., Snell, C. C., McGrath, R., Mehta, A., & Hattori, D. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.11.18.689052 · Cited by 2
Estrogen, Dopamine, and Learning
Golden, C. E. M., & Constantinople, C. M. (2026) · DNA and Cell Biology · doi:10.1177/10445498261427138 · Cited by 1
Zhang, Y., Liu, L., Qiao, Y., Zhao, W., Li, F., Feng, X., yao, T., Liu, Y., Zhao, X., & Yan, Y. L. (2026) · Nano Letters · doi:10.1021/acs.nanolett.6c00926 · Cited by 1
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0006 · Cited by 1
Zhang, Y.-F., Dufour, J.-P., Zatka-Haas, P., Redgrave, P., Black, M. J., Lak, A., Mann, E., Cragg, S. J., Abraham, W. C., & Reynolds, J. N. J. (2026) · Nature Communications · doi:10.1038/s41467-026-72167-4 · Cited by 1
Self-citationHu, C.-L., Lu, G.-Y., Kang, P.-L., Li, C.-J., Lin, M., Li, G.-L., & Su, F.-Y. (2025) · IEEE Access · doi:10.1109/access.2025.3569186 · Cited by 1
Seeger-Armbruster, S., Wang, P., Campbell, R. E., & Hyland, B. I. (2025) · European Journal of Neuroscience · doi:10.1111/ejn.70168 · Cited by 1
Self-citationRegion-specific weighting of sensory intensity and reward prediction error by dopamine signals
Bouchard, S.-J., Boutin, J., Lévesque, M., & Breton‐Provencher, V. (2026) · iScience · doi:10.1016/j.isci.2026.117130 · Cited by 1
Ondracek, J. M., Willuhn, I., Steiner, H., & West, A. R. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00206 · Cited by 1
Patton, M. S., & Mathur, B. N. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-823453-2.00010-2 · Cited by 1
Conn, K., Alexander, S., Burne, T. H. J., & Kesby, J. P. (2023) · Behavioural Brain Research · doi:10.1016/j.bbr.2023.114649 · Cited by 1
Fundamentals of the septo-hippocampal system
McNaughton, N., & Gray, J. A. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198843313.003.0009 · Cited by 1
Memory and the septo-hippocampal system
McNaughton, N., & Gray, J. A. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198843313.003.0008 · Cited by 1
Doya, K. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15754-7.00088-2 · Cited by 1
Rationale for Surgical Interventions in Movement Disorders
Wichmann, T., & DeLong, M. R. (2011) · Elsevier eBooks · doi:10.1016/b978-1-4160-5316-3.00075-7 · Cited by 1
Regulation of Corticostriatal Synaptic Plasticity in Physiological and Pathological Conditions
Filippo, M. D., & Calabresi, P. (2016) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-802206-1.00023-4 · Cited by 2
Doya, K. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108755610.013 · Cited by 1
The Physiologic Basis of Neuromodulation
Wilson, T. J., & Butala, A. (2024) · Advances in Psychiatry and Behavioral Health · doi:10.1016/j.ypsc.2024.05.001 · Cited by 1
Human reinforcement learning: Insights from intracranial recordings and stimulation
Ramayya, A. G. (2014) · Scholarly Commons (University of Pennsylvania) · Cited by 1
Effects of Learning Communities on Community College Students' Success: A Meta-Analysis
Wurtz, K. (2014) · ProQuest Demo Repository · Cited by 1
Threlfell, S., & West, A. R. (2014) · Wiley eBooks · doi:10.1002/9781118836507.ch11 · Cited by 1
Learning Shapes Bifurcations of Neural Dynamics upon External Stimuli
Kurikawa, T., & Kaneko, K. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-17537-4_20 · Cited by 1
Ponzi, A. P. D. (2007) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/ijcnn.2007.4371440 · Cited by 1
Dopamine neurons encode teaching signals for learning reward-based decision strategy
Satoh, T., Matsumoto, N., Nakai, S., Satoh, T., Minamimoto, T., & Kimura, M. (2003) · International Congress Series · doi:10.1016/s0531-5131(03)01047-1 · Cited by 1
Model of Cue Extraction from Distractors by Active Recall
Ponzi, A. P. D. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69158-7_29 · Cited by 1
Zhang, T. (2005) · Texas ScholarWorks (Texas Digital Library) · Cited by 1
Grytskyy, D., & Jolivet, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06562 · Cited by 2
The role of dopamine in learning, movement & motivation
Shiner, T. (2012) · UCL Discovery (University College London) · Cited by 1
A STUDY ON NEURAL NETWORKS FOR POKER PLAYING AGENTS
COSTA, A. M. (2019) · doi:10.17771/pucrio.acad.48011 · Cited by 1
Abundance of Degrees of Freedom
(2008) · Springer eBooks · doi:10.1007/978-3-540-29678-2_19 · Cited by 1
Basal Ganglia: Habit Formation
Knowlton, B. J. (2022) · Springer eBooks · doi:10.1007/978-1-0716-1006-0_517 · Cited by 1
Tsurumi, T., Kato, A., Kumar, A., & Morita, K. (2025) · eLife · doi:10.1101/2024.08.22.609100 · Cited by 1
A dopaminergic basis of behavioral controlPreprint
Ballard, I. C., Furman, D. J., Berry, A. S., White, R. L., Jagust, W. J., Kayser, A. S., & D’Esposito, M. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.09.17.613524 · Cited by 1
Tsurumi, T., Kato, A., Kumar, A., & Morita, K. (2025) · eLife · doi:10.7554/elife.104101.1 · Cited by 1
Tsurumi, T., Kato, A., Kumar, A., & Morita, K. (2025) · eLife · doi:10.7554/elife.104101.2 · Cited by 1
Striatal ensembles specify and control ongoing actions at fine motor resolutionPreprint
Rodrigues-Vaz, I., Athalye, V. R., Rodrigues, H. F. M., Peterka, D. S., & Costa, R. M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.12.03.692128 · Cited by 1
Neurons in the Human Substantia Nigra Respond to Cognitive Boundaries and Predict MemoryPreprint
Shi, L., Flores, A., Shimelis, L. B., Liu, Y., Jiang, C., Zhang, J., Meng, F., & Zheng, J. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.04.703556 · Cited by 1
Critical period plasticity enables credit assignmentPreprint
Meier, R. J., Muller, S. Z., Wang, B., Mizerska, K., Jain, S., Fothergill, T., Mercer, J., Klapheke, C., DiSano, J., Milicic, N., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.24.734069 · Cited by 1
Tanno, S., Morishima, M., Fujita, K., Kato, S., Kobayashi, K., Kawaguchi, Y., Isomura, Y., & Hira, R. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.02.755501 · Cited by 1
Cellular Mechanism of Obsessive-Compulsive Disorder
Tee, L. Y. (2015) · DukeSpace (Duke University)
Murugan, M. (2013) · DukeSpace (Duke University)
Machon, M. (2009) · DSpace@MIT (Massachusetts Institute of Technology)
Identification of novel target genes for the plasticity-related transcription factor Zif268
McDade, D. M. (2007) · Enlighten: Theses (The University of Glasgow)
Convergenve and Plastocity of Inputs to Striatal Cholinergic Interneurons
Reynolds, J. N. J. (2005) · Springer eBooks · doi:10.1007/0-387-28066-9_7
Self-citationStriatal Function Explored Through a Biophysical Model of a Medium Spiny Neuron
Guthrie, M. (2006) · ERA
Induction Properties of Synaptic Plasticity in Rat Prefrontal Neurons
Otani, S., & Kolomiets, B. P. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/1-4020-7949-4_4
An investigation into the amphetamine model of psychosis in healthy volunteers
Albrecht, M. A. (2012) · UWA Profiles and Research Repository (UWA)
Computational Modeling of the Basal Ganglia : Functional Pathways and Reinforcement Learning
Berthet, P. (2015) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Jones, J. L. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/wjjv-af94
Ilango, A. (2010) · Digitalen Hochschulbibliothek Sachsen-Anhalt (Universitäts- und Landesbibliothek Sachsen-Anhalt) · doi:10.25673/5073
Regulatory Crosstalk Analysis of Biochemical Networks in the Hippocampus and Nucleus Accumbens
Kikuchi, S., & Voit, E. O. (2013) · Springer eBooks · doi:10.1007/978-94-007-6803-1_4
Bock, H. (2009) · Americanae (AECID Library)
Neuron Type Sorting Based on Connection-strength Estimation
Isomura, T., Takeuchi, A., Shimba, K., Kotani, K., & Jimbo, Y. (2013) · IEEJ Transactions on Electronics Information and Systems · doi:10.1541/ieejeiss.133.1806
SELF-STIMULATION AND SYNAPTIC PLASTICITY A novel approach to reward-related learning
John, N., & Wickens, J. R. (2002)
Self-citationConflict monitoring and reinforcement learning
Braem, S. (2013) · Ghent University Academic Bibliography (Ghent University)
MECHANISMS OF AMYGDALA FACILITATED CORTICO
Plasticity, S. (2010)
Self-Stimulation and Synaptic Plasticity
Reynolds, J. N. J., & Wickens, J. R. (2002) · Advances in behavioral biology · doi:10.1007/978-1-4615-0715-4_30
Self-citationStriatal Dopamine and Glutamate in Action
Yin, H. H., & Costa, R. M. (2011) · Frontiers in neuroscience · doi:10.1201/b11284-10
A behavioral investigation of the algorithms underlying reinforcement learning in humans
Ferreira, A. C. S., & Farinha, S. (2014)
Robot Animals Based on Brain-Computer Interface
Xia, Y., Xia, Lei, L., Tiejun, ., L., De-Zhong, & Yao (2009) · Journal of Electronic Science and Technology
Dobrovitsky, V. (2017) · CUNY Academic Works (City University of New York)
MODIFICATION OF APLYSIA FEEDING NETWORK BY L-DOPA AND DOPAMINE-DEPENDENT LEARNING
Neveu, C. L. (2017) · Digital Commons-TMC (Texas Medical Center)
Parker, A. R. (2022) · Digital Archive @ GSU · doi:10.57709/11188576
Phasic dopamine release: its origin and function in reward seeking
Beyene, M. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/jt5q-0n02
Garr, E. (2019) · CUNY Academic Works (City University of New York)
Molochnikov, I., & Cohen, D. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14939
An Analog FSCV Device Combined with a Phase-Locked Loop for in Vivo Detection of DopaminePreprint
Haziq, M., Riaz, R., Kocatürk, S., Ayyaz, A., & Kocatürk, M. (2021) · doi:10.36227/techrxiv.14428133.v4
Encoding Motivation Prediction Errors in the Human Dopaminergic Reward SystemPreprint
Ni, Y., Wang, S., Su, J., Li, J., & Wan, X. (2020) · Research Square · doi:10.21203/rs.3.rs-51287/v1
Synergistic information in the frontal cortex-striatal pathwayPreprint
Alsolami, I., Handa, T., & Fukai, T. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.06.18.449072
Berridge, K. C. (2013) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.718013321.793479942
Fellows, L. K. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.736123949.793571326
Girault, J. (2006) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.1052762.504676
程振波, 邓志东, & 杨博 (2009) · Science in China Series C-Life Sciences (in Chinese) · doi:10.1360/zc2009-39-8-783
An Analog FSCV Device Combined with a Phase-Locked Loop for in Vivo Detection of DopaminePreprint
Haziq, M., Riaz, R., Kocatürk, S., Ayyaz, A., & Kocatürk, M. (2021) · doi:10.36227/techrxiv.14428133.v2
Brembs, B. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.732935382.793567288
Sensorimotor Learning and the Basal Ganglia
Kimura, M., & Ueda, Y. (2008) · Springer eBooks · doi:10.1007/978-3-540-29678-2_5322
Frank, M. J. (2010) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.7340957.7601055
An Analog FSCV Device Combined with a Phase-Locked Loop for in Vivo Detection of DopaminePreprint
Haziq, M., Riaz, R., Ayyaz, A., & Kocatürk, M. (2021) · doi:10.36227/techrxiv.14428133
Goheen, K. (2018) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2018-13451
An Analog FSCV Device Combined with a Phase-Locked Loop for in Vivo Detection of DopaminePreprint
Haziq, M., Riaz, R., Kocatürk, S., Ayyaz, A., & Kocatürk, M. (2021) · doi:10.36227/techrxiv.14428133.v3
An Analog FSCV Device Combined with a Phase-Locked Loop for in Vivo Detection of DopaminePreprint
Haziq, M., Riaz, R., Kocatürk, S., Ayyaz, A., & Kocatürk, M. (2021) · doi:10.36227/techrxiv.14428133.v1
An Analog FSCV Device Combined with a Phase-Locked Loop for in Vivo Detection of DopaminePreprint
Haziq, M., Riaz, R., Kocatürk, S., Ayyaz, A., & Kocatürk, M. (2022) · doi:10.36227/techrxiv.14428133.v5
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0008
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0003
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0007
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0002
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0004
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.002.0003
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.002.0004
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.002.0006
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0005
Metadata
- Authors
- Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R.
- Affiliations
- University of Otago (NZ)
- Corresponding author
- Wickens, Jeffery R.
- Venue
- Nature
- Published
- 2001-09
- Volume
- 413
- Issue
- 6851
- Pages
- 67-70
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2055523610
- Cited by
- 879
- References
- 33
- Citations by year
- 2026: 20 · 2025: 36 · 2024: 54 · 2023: 42 · 2022: 36 · 2021: 28 · 2020: 32 · 2019: 35 · 2018: 28 · 2017: 26 · 2016: 33 · 2015: 44 · 2014: 42 · 2013: 35 · 2012: 32
- FWCI
- 8.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- Institut National de la Santé et de la Recherche Médicale
- Saint Petersburg State University
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neuropharmacology Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- reward learning, positive reinforcement, intracranial self-stimulation, substantia nigra, striatum, synaptic potentiation, dopamine receptors, learning acquisition
- MeSH terms
- Animals, Brain, Cerebral Cortex, Corpus Striatum, Dopamine, Learning, Male, Models, Neurological, Neural Pathways, Neurons, Reinforcement, Psychology, Reward, Self Stimulation, Substantia Nigra, Synapses, Rats, Wistar, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review