Cited by 879Neurotransmitter Receptor Influence on BehaviorNeuroscience and Neuropharmacology ResearchMemory and Neural Mechanisms

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

A cellular mechanism of reward-related learning

Reynolds, John N. J., Hyland, Brian I., Wickens, Jeffery R.·2001·Nature

DOI 10.1038/35092560

Open this paper in CoChat — free account

Abstract

Positive reinforcement helps to control the acquisition of learned behaviours. Here we report a cellular mechanism in the brain that may underlie the behavioural effects of positive reinforcement. We used intracranial self-stimulation (ICSS) as a model of reinforcement learning, in which each rat learns to press a lever that applies reinforcing electrical stimulation to its own substantia nigra. The outputs from neurons of the substantia nigra terminate on neurons in the striatum in close proximity to inputs from the cerebral cortex on the same striatal neurons. We measured the effect of substantia nigra stimulation on these inputs from the cortex to striatal neurons and also on how quickly the rats learned to press the lever. We found that stimulation of the substantia nigra (with the optimal parameters for lever-pressing behaviour) induced potentiation of synapses between the cortex and the striatum, which required activation of dopamine receptors. The degree of potentiation within ten minutes of the ICSS trains was correlated with the time taken by the rats to learn ICSS behaviour. We propose that stimulation of the substantia nigra when the lever is pressed induces a similar potentiation of cortical inputs to the striatum, positively reinforcing the learning of the behaviour by the rats.

Integrity signals

Registry

Crossref · 10.1038/35092560

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The rat brain in stereotaxic coordinates
Palkovits, M. (1983) · Neuropeptides · doi:10.1016/0143-4179(83)90049-5 · Cited by 28,959
The Rat Brain in Stereotaxic Coordinates
Paxinos, G., & Watson, C. (1983) · Elsevier eBooks · doi:10.1016/c2009-0-63235-9 · Cited by 28,585
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain.
Olds, J., & Milner, P. (1954) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0058775 · Cited by 3,176
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones
Smith, A. D., & Bolam, J. P. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90106-k · Cited by 1,040
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829
The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons
Wilson, C. J., & Kawaguchi, Y. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-07-02397.1996 · Cited by 798

Flagged first, then by citations

Show all 33 references

Sorted by citations

Items 301–400 of 862

Behavioral, neuropsychiatric and cognitive disorders in Parkinson's disease patients with and without motor complications
Solla, P., Cannas, A., Floris, G., Orofino, G., Costantino, E., Boi, A., Serra, C., Marrosu, M. G., & Marrosu, F. (2011) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2011.02.002 · Cited by 58
Reinforcement learning and its connections with neuroscience and psychology
Subramanian, A., Chitlangia, S., & Baths, V. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.10.003 · Cited by 66
Dopaminergic Control of Motivation and Reinforcement Learning: A Closed-Circuit Account for Reward-Oriented Behavior
Morita, K., Morishima, M., Sakai, K., & Kawaguchi, Y. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4614-12.2013 · Cited by 58
Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation
Kato, A., & Morita, K. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005145 · Cited by 59
Background Dopamine Concentration Dependently Facilitates Long-term Potentiation in Rat Prefrontal Cortex through Postsynaptic Activation of Extracellular Signal-Regulated Kinases
Kolomiets, B. P., Marzo, A., Caboche, J., Vanhoutte, P., & Otani, S. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp047 · Cited by 56
The α2δ-1–NMDA receptor coupling is essential for corticostriatal long-term potentiation and is involved in learning and memory
Zhou, J., Li, D., Chen, S.-R., Luo, Y., & Pan, H. (2018) · Journal of Biological Chemistry · doi:10.1074/jbc.ra118.003977 · Cited by 56
Changes in function and ultrastructure of striatal dopaminergic terminals that regenerate following partial lesions of the SNpc
Stanić, D., Parish, C. L., Zhu, W. M., Krstew, E., Lawrence, A. J., Drago, J., Finkelstein, D. I., & Horne, M. K. (2003) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.2003.01843.x · Cited by 56
An Imperfect Dopaminergic Error Signal Can Drive Temporal-Difference Learning
Potjans, W., Diesmann, M., & Morrison, A. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001133 · Cited by 56
A Neurocomputational Model of Dopamine and Prefrontal–Striatal Interactions during Multicue Category Learning by Parkinson Patients
Moustafa, A. A., & Gluck, M. A. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21420 · Cited by 57
Medial prefrontal cortex and the adaptive regulation of reinforcement learning parameters
Khamassi, M., Enel, P., Dominey, P. F., & Procyk, E. (2013) · Progress in brain research · doi:10.1016/b978-0-444-62604-2.00022-8 · Cited by 67
The conceptualisation, measurement and scope of reinforcement sensitivity in the context of a neuroscience of personality
Smillie, L. D. (2008) · European Journal of Personality · doi:10.1002/per.687 · Cited by 54
Reward-Predictive Neural Activities in Striatal Striosome Compartments
Yoshizawa, T., Ito, M., & Doya, K. (2018) · eNeuro · doi:10.1523/eneuro.0367-17.2018 · Cited by 53
Abundance Compensates Kinetics: Similar Effect of Dopamine Signals on D1 and D2 Receptor Populations
Hunger, L., Kumar, A., & Schmidt, R. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.1951-19.2019 · Cited by 54
Electrochemical studies of Dopamine at Eperisone and Cetyl Trimethyl Ammonium Bromide Surfactant modified Carbon paste electrode: A Cyclic Voltammetric Study
Manjunatha, J. G., Swamy, B. E. K., Deepa, R., Krishna, V., Mamatha, G. P., Chandra, U., Shankar, S. S., & Sherigara, B. S. (2009) · International Journal of Electrochemical Science · doi:10.1016/s1452-3981(23)15172-8 · Cited by 52
Associative learning in the box jellyfish Tripedalia cystophora
Bielecki, J., Nielsen, S. K. D., Nachman, G., & Garm, A. L. (2023) · Current Biology · doi:10.1016/j.cub.2023.08.056 · Cited by 61
Dopamine-associated cached values are not sufficient as the basis for action selection
Hollon, N. G., Arnold, M. M., Gan, J. O., Walton, M. E., & Phillips, P. E. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1419770111 · Cited by 55
Blinking predicts enhanced cognitive control
van Bochove, M. E., der Haegen, L. V., Notebaert, W., & Verguts, T. (2012) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-012-0138-2 · Cited by 57
Impact of dopamine–glutamate interactions on striatal neuronal nitric oxide synthase activity
Hoque, K. E., Indorkar, R. P., Sammut, S., & West, A. R. (2009) · Psychopharmacology · doi:10.1007/s00213-009-1687-0 · Cited by 51
A neural model of hippocampal–striatal interactions in associative learning and transfer generalization in various neurological and psychiatric patients
Moustafa, A. A., Kéri, S., Herzallah, M. M., Myers, C. E., & Gluck, M. A. (2010) · Brain and Cognition · doi:10.1016/j.bandc.2010.07.013 · Cited by 51
Frontostriatal and Dopamine Markers of Individual Differences in Reinforcement Learning: A Multi-modal Investigation
Kaiser, R. H., Treadway, M. T., Wooten, D., Kumar, P., Goer, F., Murray, L., Beltzer, M., Pechtel, P., Whitton, A. E., Cohen, A. L., et al. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx281 · Cited by 52
Sequential administration enhances the effect of apomorphine SL in men with erectile dysfunction
Heaton, J., Dean, J. W., & Sleep, D. J. (2002) · International Journal of Impotence Research · doi:10.1038/sj.ijir.3900831 · Cited by 50
Striatal dopamine ramping may indicate flexible reinforcement learning with forgetting in the cortico-basal ganglia circuits
Morita, K., & Kato, A. (2014) · Frontiers in Neural Circuits · doi:10.3389/fncir.2014.00036 · Cited by 55
Sensitivity to theta-burst timing permits LTP in dorsal striatal adult brain slice
Hawes, S., Gillani, F., Evans, R. C., Benkert, E. A., & Blackwell, K. T. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00115.2013 · Cited by 49
Reinforcement learning with Marr
Niv, Y., & Langdon, A. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.04.005 · Cited by 52
A Local Learning Rule for Independent Component Analysis
Isomura, T., & Toyoizumi, T. (2016) · Scientific Reports · doi:10.1038/srep28073 · Cited by 49
Changes in Striatal Dopamine Release Associated with Human Motor-Skill Acquisition
Kawashima, S., Ueki, Y., Kato, T., Matsukawa, N., Mima, T., Hallett, M., Ito, K., & Ojika, K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031728 · Cited by 48
Identifying Cognitive Remediation Change Through Computational Modelling—Effects on Reinforcement Learning in Schizophrenia
Cella, M., Bishara, A. J., Medin, E., Swan, S., Reeder, C., & Wykes, T. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt152 · Cited by 49
Dopamine Axons in Dorsal Striatum Encode Contralateral Visual Stimuli and Choices
Moss, M. M., Zatka-Haas, P., Harris, K. D., Carandini, M., & Lak, A. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.0490-21.2021 · Cited by 47
Phasic Dopamine Modifies Sensory-Driven Output of Striatal Neurons through Synaptic Plasticity
Wieland, S., Schindler, S., Huber, C., Köhr, G., Oswald, M. J., & Kelsch, W. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0127-15.2015 · Cited by 47
A neurocomputational model of tonic and phasic dopamine in action selection: A comparison with cognitive deficits in Parkinson's disease
Guthrie, M., Myers, C. E., & Gluck, M. A. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.036 · Cited by 47
Task-Related Interaction between Basal Ganglia and Cortical Dopamine Release
Garraux, G., Peigneux, P., Carson, R. E., & Hallett, M. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1595-07.2007 · Cited by 47
Central Theories of Motivation and Emotion
McNaughton, N., & Corr, P. J. (2009) · Wiley eBooks · doi:10.1002/9780470478509.neubb002036 · Cited by 47
Nigrostriatal dopamine pathway regulates auditory discrimination behavior
Chen, A. P. F., Malgady, J. M., Chen, L., Shi, K. W., Cheng, E., Plotkin, J. L., Ge, S., & Xiong, Q. (2022) · Nature Communications · doi:10.1038/s41467-022-33747-2 · Cited by 46
Temporal components of cholinergic terminal to dopaminergic terminal transmission in dorsal striatum slices of mice
Wang, L., Zhang, X., Xu, H., Zhou, L., Jiao, R., Liu, W., Zhu, F., Kang, X., Liu, B., Teng, S., et al. (2014) · The Journal of Physiology · doi:10.1113/jphysiol.2014.271825 · Cited by 46
A neurocomputational account of catalepsy sensitization induced by D2 receptor blockade in rats: context dependency, extinction, and renewal
Wiecki, T. V., Riedinger, K., von Ameln-Mayerhofer, A., Schmidt, W., & Frank, M. J. (2009) · Psychopharmacology · doi:10.1007/s00213-008-1457-4 · Cited by 46
Reinforcement Learning
Du, K.-L., & Swamy, M. N. S. (2019) · Springer eBooks · doi:10.1007/978-1-4471-7452-3_17 · Cited by 46
Functional differences between macaque prefrontal cortex and caudate nucleus during eye movements with and without reward
Kobayashi, S., Kawagoe, R., Takikawa, Y., Koizumi, M., Sakagami, M., & Hikosaka, O. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0622-4 · Cited by 47
From Progenitors to Progeny: Shaping Striatal Circuit Development and Function
Knowles, R., Dehorter, N., & Ellender, T. J. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.0620-21.2021 · Cited by 49
Mechanisms of Neuroplasticity and Ethanol's Effects on Plasticity in the Striatum and Bed Nucleus of the Stria Terminalis
Lovinger, D. M. (2015) · Alcohol research · doi:10.35946/arcr.v37.1.08 · Cited by 45
Chronic Cocaine Prevents Depotentiation at Corticostriatal Synapses
Centonze, D., Costa, C., Rossi, S., Prosperetti, C., Pisani, A., Usiello, A., Bernardi, G., Mercuri, N. B., & Calabresi, P. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.11.018 · Cited by 45
A dopamine mechanism for reward maximization
Schultz, W. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2316658121 · Cited by 47
The Basal Ganglia Optimize Decision Making over General Perceptual Hypotheses
Lepora, N. F., & GURNEY, K. N. (2012) · Neural Computation · doi:10.1162/neco_a_00360 · Cited by 45
Facilitation of Saccadic Eye Movements by Postsaccadic Electrical Stimulation in the Primate Caudate
Nakamura, K., & Hikosaka, O. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.3688-06.2006 · Cited by 44
Visual Cue-Guided Rat Cyborg for Automatic Navigation [Research Frontier]
Wang, Y., Lu, M., Wu, Z., Tian, L., Xu, K., Zheng, X., & Pan, G. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2405318 · Cited by 42
Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales
Baudonnat, M., Huber, A., David, V., & Walton, M. E. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00175 · Cited by 43
Lesions of dorsal striatum eliminate lose‐switch responding but not mixed‐response strategies in rats
Skelin, I., Hakstol, R., VanOyen, J., Mudiayi, D., Molina, L. A., Holec, V., Hong, N. S., Euston, D. R., McDonald, R. J., & Gruber, A. J. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12518 · Cited by 44
Properties of Dopamine Release and Uptake in the Songbird Basal Ganglia
Gale, S. D., & Perkel, D. J. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01053.2004 · Cited by 43
Bayesian Filtering with Multiple Internal Models: Toward a Theory of Social Intelligence
Isomura, T., Parr, T., & Friston, K. J. (2019) · Neural Computation · doi:10.1162/neco_a_01239 · Cited by 43
Excitatory, Inhibitory, and Structural Plasticity Produce Correlated Connectivity in Random Networks Trained to Solve Paired-Stimulus Tasks
Bourjaily, M. A., & Miller, P. C. (2011) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2011.00037 · Cited by 41
Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions
Fee, M. S. (2012) · Frontiers in Neural Circuits · doi:10.3389/fncir.2012.00038 · Cited by 41
Enabling Functional Neural Circuit Simulations with Distributed Computing of Neuromodulated Plasticity
Potjans, W., Morrison, A., & Diesmann, M. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00141 · Cited by 40
Nicotinic alteration of decision-making
Naudé, J., Dongelmans, M., & Faure, P. (2015) · Neuropharmacology · doi:10.1016/j.neuropharm.2014.11.021 · Cited by 39
A Computational Model of Dual Competition between the Basal Ganglia and the Cortex
Topalidou, M., Kase, D., Boraud, T., & Rougier, N. P. (2018) · eNeuro · doi:10.1523/eneuro.0339-17.2018 · Cited by 43
Navigating complex decision spaces: Problems and paradigms in sequential choice.
Walsh, M. M., & Anderson, J. R. (2013) · Psychological Bulletin · doi:10.1037/a0033455 · Cited by 41
Computational cognitive models of prefrontal-striatal-hippocampal interactions in Parkinson’s disease and schizophrenia
Moustafa, A. A., & Gluck, M. A. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.02.006 · Cited by 41
Transcriptomic analysis provides insights into candidate genes and molecular pathways involved in growth of Manila clam Ruditapes philippinarum
Nie, H., Zheng, M., Wang, Z., Xu, Q., Yin, Z., Zhang, Y., & Yan, X. (2021) · Functional & Integrative Genomics · doi:10.1007/s10142-021-00780-1 · Cited by 39
Thalamocortical integration of instrumental learning and performance and their disintegration in addiction
Balleine, B. W., Morris, R. W., & Leung, B. K. (2014) · Brain Research · doi:10.1016/j.brainres.2014.12.023 · Cited by 41
The rotational model and microdialysis: Significance for dopamine signalling, clinical studies, and beyond
Herrera‐Marschitz, M., Arbuthnott, G. W., & Ungerstedt, U. (2009) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2009.01.005 · Cited by 38
A whole brain probabilistic generative model: Toward realizing cognitive architectures for developmental robots
Taniguchi, T., Yamakawa, H., Nagai, T., Doya, K., Sakagami, M., Suzuki, M., Nakamura, T., & Taniguchi, A. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.02.026 · Cited by 39
Basketball training increases striatum volume
Park, I. S., Lee, K. J., Han, J. W., Lee, N. J., Lee, W. T., Park, K. A., & Rhyu, I. J. (2010) · Human Movement Science · doi:10.1016/j.humov.2010.09.001 · Cited by 38
Dissociating the Cognitive Effects of Levodopa versus Dopamine Agonists in a Neurocomputational Model of Learning in Parkinson’s Disease
Moustafa, A. A., Herzallah, M. M., & Gluck, M. A. (2012) · Neurodegenerative Diseases · doi:10.1159/000341999 · Cited by 39
Striatal dopamine signals reflect perceived cue–action–outcome associations in mice
Bernklau, T. W., Righetti, B., Mehrke, L. S., & Jacob, S. N. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01567-2 · Cited by 41
Neuroimaging studies of striatum in cognition part II: Parkinson's disease
Hanganu, A., Provost, J.-S., & Monchi, O. (2015) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2015.00138 · Cited by 37
Dopamine ramps up
Niv, Y. (2013) · Nature · doi:10.1038/500533a · Cited by 38
Dexamphetamine effects on separate constructs in the rubber hand illusion test
Albrecht, M. A., Martin-Iverson, M. T., Price, G. W., Lee, J. J., Iyyalol, R., & Waters, F. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2255-y · Cited by 39
Dopaminergic Balance between Reward Maximization and Policy Complexity
Parush, N., Tishby, N., & Bergman, H. (2011) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2011.00022 · Cited by 39
Anatomical funneling, sparse connectivity and redundancy reduction in the neural networks of the basal ganglia
Morris, G., Nevet, A., & Bergman, H. (2003) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.01.015 · Cited by 38
Phasic dopamine as a prediction error of intrinsic and extrinsic reinforcements driving both action acquisition and reward maximization: A simulated robotic study
Mirolli, M., Santucci, V. G., & Baldassarre, G. (2013) · Neural Networks · doi:10.1016/j.neunet.2012.12.012 · Cited by 40
Blockade of NMDA receptors 2A subunit in the dorsal striatum impairs the learning of a complex motor skill.
Lemay-Clermont, J., Robitaille, C., Auberson, Y. P., Bureau, G., & Cyr, M. (2011) · Behavioral Neuroscience · doi:10.1037/a0025213 · Cited by 36
Neuro-Immune Cross-Talk in the Striatum: From Basal Ganglia Physiology to Circuit Dysfunction
Mancini, A., Ghiglieri, V., Parnetti, L., Calabresi, P., & Filippo, M. D. (2021) · Frontiers in Immunology · doi:10.3389/fimmu.2021.644294 · Cited by 38
Active inference leads to Bayesian neurophysiology
Isomura, T. (2021) · Neuroscience Research · doi:10.1016/j.neures.2021.12.003 · Cited by 40
Motor-Skill Learning-Associated Gene Regulation in the Striatum: Effects of Cocaine
Willuhn, I., & Steiner, H. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300995 · Cited by 36
Learning and Memory Mechanisms Involved in Compulsive Drug Use and Relapse
Berke, J. D. (2003) · Humana Press eBooks · doi:10.1385/1-59259-358-5:75 · Cited by 36
Calcium modulates dopamine potentiation of N‐methyl‐D‐aspartate Responses: Electrophysiological and imaging evidence
Liu, J. C., DeFazio, R. A., Monteros, A. E. D. L., Cepeda, C., de Vellis, J., & Levine, M. S. (2004) · Journal of Neuroscience Research · doi:10.1002/jnr.20079 · Cited by 36
Neuromodulated Synaptic Plasticity on the SpiNNaker Neuromorphic System
Mikaitis, M., García, G. P., Knight, J. C., & Furber, S. B. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00105 · Cited by 35
Role of DARPP-32 and ARPP-21 in the Emergence of Temporal Constraints on Striatal Calcium and Dopamine Integration
Nair, A. G., Bhalla, U. S., & Kotaleski, J. H. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005080 · Cited by 35
A Neurochemical Pattern Generator SoC With Switched-Electrode Management for Single-Chip Electrical Stimulation and 9.3 µW, 78 pA rms , 400 V/s FSCV Sensing
Bozorgzadeh, B., Covey, D. P., Howard, C. D., Garris, P. A., & Mohseni, P. (2014) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2299434 · Cited by 34
Reward-Modulated Hebbian Learning of Decision Making
Pfeiffer, M., Nessler, B., Douglas, R. J., & Maass, W. (2010) · Neural Computation · doi:10.1162/neco.2010.03-09-980 · Cited by 35
A Comparison of the Subsecond Dynamics of Neurotransmission of Dopamine and Serotonin
Jennings, K. A. (2013) · ACS Chemical Neuroscience · doi:10.1021/cn4000605 · Cited by 35
From biophysics to cognition: reward-dependent adaptive choice behavior
Soltani, A., & Wang, X. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.07.003 · Cited by 34
Individual differences in dopamine efflux in nucleus accumbens shell and core during instrumental learningPreprint
Cheng, J., & Feenstra, M. G. P. (2006) · Learning & Memory · doi:10.1101/lm.1806 · Cited by 34
Utility of intracerebral theta burst electrical stimulation to attenuate interhemispheric inhibition and to promote motor recovery after cortical injury in an animal model
Barry, M., Boddington, L. J., Igelström, K. M., Gray, J. P., Shemmell, J. B. H., Tseng, K. Y., Oorschot, D. E., & Reynolds, J. N. J. (2014) · Experimental Neurology · doi:10.1016/j.expneurol.2014.05.023 · Cited by 34
Self-citation
Differences in Motor Evoked Potentials Induced in Rats by Transcranial Magnetic Stimulation under Two Separate Anesthetics: Implications for Plasticity Studies
Sykes, M., Matheson, N. A., Brownjohn, P. W., Tang, A. D., Rodger, J., Shemmell, J. B. H., & Reynolds, J. N. J. (2016) · Frontiers in Neural Circuits · doi:10.3389/fncir.2016.00080 · Cited by 33
Self-citation
Behavior analysis and neuroscience: Complementary disciplines
Donahoe, J. W. (2017) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.251 · Cited by 34
Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning
Ballard, I. C., Miller, E. M., Piantadosi, S. T., Goodman, N. D., & McClure, S. M. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx259 · Cited by 34
Microstimulation of the Human Substantia Nigra Alters Reinforcement Learning
Ramayya, A. G., Misra, A., Baltuch, G. H., & Kahana, M. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.5445-13.2014 · Cited by 33
Reward determines the context-sensitivity of cognitive control.
Braem, S., Hickey, C., Duthoo, W., & Notebaert, W. (2014) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0037554 · Cited by 36
Nitric Oxide Modulation of the Basal Ganglia Circuitry: Therapeutic Implication for Parkinson's Disease and Other Motor Disorders
Pierucci, M., Galati, S., Valentino, M., Matteo, V. D., Benigno, A., Pitruzzella, A., Muscat, R., & Giovanni, G. D. (2011) · CNS & Neurological Disorders - Drug Targets · doi:10.2174/187152711798072329 · Cited by 33
Dual synaptic sites of D1‐dopaminergic regulation of ethanol sensitivity of NMDA receptors in nucleus accumbens
Zhang, T. A., Hendricson, A. W., & Morrisett, R. A. (2005) · Synapse · doi:10.1002/syn.20181 · Cited by 33
The Basal Ganglia
Haber, S. N., & Gdowski, M. (2004) · Elsevier eBooks · doi:10.1016/b978-012547626-3/50022-3 · Cited by 33
Neural control of dopamine neurotransmission: implications for reinforcement learning
Aggarwal, M., Hyland, B. I., & Wickens, J. R. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08055.x · Cited by 32
Self-citation
Dead rats, dopamine, performance metrics, and peacock tails: Proxy failure is an inherent risk in goal-oriented systems
John, Y. J., Caldwell, L., McCoy, D. E., & Braganza, O. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23002753 · Cited by 39
Nigrostriatal dopamine modulates the striatal-amygdala pathway in auditory fear conditioning
Chen, A. P. F., Chen, L., Shi, K. W., Cheng, E., Ge, S., & Xiong, Q. (2023) · Nature Communications · doi:10.1038/s41467-023-43066-9 · Cited by 34
Dynamic behaviour restructuring mediates dopamine-dependent credit assignment
Tang, J. C. Y., Paixão, V., Carvalho, F., Silva, A., Klaus, A., da Silva, J. A., & Costa, R. M. (2023) · Nature · doi:10.1038/s41586-023-06941-5 · Cited by 35
Synaptic plasticity in the basal ganglia: A similar code for physiological and pathological conditions
Berretta, N., Nisticò, R., Bernardi, G., & Mercuri, N. B. (2007) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2007.12.004 · Cited by 32
The neural mechanisms of learning from competitors
Howard‐Jones, P. A., Bogacz, R., Yoo, J. H., Leonards, U., & Demetriou, S. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.027 · Cited by 32
Striatal action-learning based on dopamine concentration
Morris, G., Schmidt, R., & Bergman, H. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-2060-6 · Cited by 32
A cAMP Pathway Underlying Reward Prediction in Associative Learning
Kheirbek, M. A., Beeler, J. A., Ishikawa, Y., & Zhuang, X. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.4115-08.2008 · Cited by 33
Behavioral flexibility is increased by optogenetic inhibition of neurons in the nucleus accumbens shell during specific time segmentsPreprint
Aquili, L., Liu, A. W., Shindou, M., Shindou, T., & Wickens, J. R. (2014) · Learning & Memory · doi:10.1101/lm.034199.113 · Cited by 35
Self-citation
Reinforcement Learning, Conflict Monitoring, and Cognitive Control: An Integrative Model of Cingulate-Striatal Interactions and the ERN
Cockburn, J., & Frank, M. J. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/9780262016438.003.0017 · Cited by 31

Authors: Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R.
Affiliations: University of Otago (NZ)
Corresponding author: Wickens, Jeffery R.
ORCID: Reynolds, John N. J.
Hyland, Brian I.
Wickens, Jeffery R.
Venue: Nature
Publisher: Springer Science and Business Media LLC
Published: 2001-09
Volume: 413
Issue: 6851
Pages: 67-70
ISSN: 0028-0836 (ISSN-L)
1476-4687
DOI: 10.1038/35092560
OpenAlex: W2055523610
Cited by: 879
References: 33
Citations by year: 2026: 20 · 2025: 36 · 2024: 54 · 2023: 42 · 2022: 36 · 2021: 28 · 2020: 32 · 2019: 35 · 2018: 28 · 2017: 26 · 2016: 33 · 2015: 44 · 2014: 42 · 2013: 35 · 2012: 32
FWCI: 8.10
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Nature (publishedVersion)
PubMed (publishedVersion)
RePEc: Research Papers in Economics (submittedVersion)
Funders: Institut National de la Santé et de la Recherche Médicale
Saint Petersburg State University
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neuropharmacology Research
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords: reward learning, positive reinforcement, intracranial self-stimulation, substantia nigra, striatum, synaptic potentiation, dopamine receptors, learning acquisition
MeSH terms: Animals, Brain, Cerebral Cortex, Corpus Striatum, Dopamine, Learning, Male, Models, Neurological, Neural Pathways, Neurons, Reinforcement, Psychology, Reward, Self Stimulation, Substantia Nigra, Synapses, Rats, Wistar, Rats

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A cellular mechanism of reward-related learning

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks