The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
A cellular mechanism of reward-related learning
Abstract
Positive reinforcement helps to control the acquisition of learned behaviours. Here we report a cellular mechanism in the brain that may underlie the behavioural effects of positive reinforcement. We used intracranial self-stimulation (ICSS) as a model of reinforcement learning, in which each rat learns to press a lever that applies reinforcing electrical stimulation to its own substantia nigra. The outputs from neurons of the substantia nigra terminate on neurons in the striatum in close proximity to inputs from the cerebral cortex on the same striatal neurons. We measured the effect of substantia nigra stimulation on these inputs from the cortex to striatal neurons and also on how quickly the rats learned to press the lever. We found that stimulation of the substantia nigra (with the optimal parameters for lever-pressing behaviour) induced potentiation of synapses between the cortex and the striatum, which required activation of dopamine receptors. The degree of potentiation within ten minutes of the ICSS trains was correlated with the time taken by the rats to learn ICSS behaviour. We propose that stimulation of the substantia nigra when the lever is pressed induces a similar potentiation of cortical inputs to the striatum, positively reinforcing the learning of the behaviour by the rats.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Gaming increases the release of striatal dopamine [47], [48], promoting long-term potentiation of neural connections within the striatum [49], which is suggested to improve motivation and one’s ability to learn [50] (e.g., during EF training).”
In the citing paper
“First, as noted, the phasic firing of dopamine neurons has been suggested as reporting the temporal difference prediction error for reward (Montague et al., 1996; Schultz et al., 1997) that underpins model-free evaluation and control via its influence over activity and plasticity (Reynolds et al., 2001; Frank, 2005).”
From Goals and Habits in the Brain (2013) · cites this paper as Reynolds et al., 2001
Citations
Cites
The rat brain in stereotaxic coordinates
Palkovits, M. (1983) · Neuropeptides · doi:10.1016/0143-4179(83)90049-5 · Cited by 28,959
The Rat Brain in Stereotaxic Coordinates
Paxinos, G., & Watson, C. (1983) · Elsevier eBooks · doi:10.1016/c2009-0-63235-9 · Cited by 28,585
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Olds, J., & Milner, P. (1954) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0058775 · Cited by 3,176
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
Smith, A. D., & Bolam, J. P. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90106-k · Cited by 1,040
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829
The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons
Wilson, C. J., & Kawaguchi, Y. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-07-02397.1996 · Cited by 798
Flagged first, then by citations
Cited by
Sorted by citations
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
The role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
Dichotomous dopaminergic control of striatal synaptic plasticity
Shen, W., Flajolet, M., Greengard, P., & Surmeier, D. J. (2008) · Science · doi:10.1126/science.1160575 · Cited by 1,190
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036
sagvolden, T., johansen, E. B., aase, H., & russell, V. A. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000075 · Cited by 1,035
Schultz, W. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.007 · Cited by 1,028
Striatal Plasticity and Basal Ganglia Circuit Function
Kreitzer, A. C., & Malenka, R. C. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.005 · Cited by 1,071
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
A causal link between prediction errors, dopamine neurons and learning
Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K. A., & Janak, P. H. (2013) · Nature Neuroscience · doi:10.1038/nn.3413 · Cited by 932
Dopamine-mediated regulation of corticostriatal synaptic plasticity
Calabresi, P., Picconi, B., Tozzi, A., & Di Filippo, M. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.001 · Cited by 865
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Loss of bidirectional striatal synaptic plasticity in L-DOPA-induced dyskinesia
Picconi, B., Centonze, D., Håkansson, K., Bernardi, G., Greengard, P., Fisone, G., Cenci, M. A., & Calabresi, P. (2003) · Nature Neuroscience · doi:10.1038/nn1040 · Cited by 821
Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill
Yin, H. H., Mulcare, S. P., Hilário, M. R. F., Clouse, E., Holloway, T., Davis, M. I., Hansson, A. C., Lovinger, D. M., & Costa, R. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2261 · Cited by 818
Mesolimbic dopamine signals the value of work
Hamid, A., Pettibone, J. R., Mabrouk, O. S., Hetrick, V. L., Schmidt, R., Weele, C. M. V., Kennedy, R. T., Aragona, B. J., & Berke, J. D. (2015) · Nature Neuroscience · doi:10.1038/nn.4173 · Cited by 848
Kelley, A. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.016 · Cited by 788
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 775
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679
“…errors (Schultz, 1998) and that long-term potentiation and depression of the cortico-striatal synapses depend on the dopamine signals (Reynolds et al., 2001; Shen et al., 2008), our work suggests that dopamine-dependent plasticity of corticostriatal synapses represents a candidate…”
BackgroundNeuroeconomics: Decision Making and the Brain
Rushworth, M. F. S., & Walton, M. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.005 · Cited by 669
Updating dopamine reward signals
Schultz, W. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.012 · Cited by 651
Gremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618
A critical time window for dopamine actions on the structural plasticity of dendritic spines
Yagishita, S., Hayashi-Takagi, A., Ellis-Davies, G. C. R., Urakubo, H., Ishii, S., & Kasai, H. (2014) · Science · doi:10.1126/science.1255514 · Cited by 614
Alcaro, A., Huber, R., & Panksepp, J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.07.014 · Cited by 661
Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595
Nicotine amplifies reward-related dopamine signals in striatum
Rice, M. E., & Cragg, S. J. (2004) · Nature Neuroscience · doi:10.1038/nn1244 · Cited by 594
Dopamine and reward: The anhedonia hypothesis 30 years on
Wise, R. A. (2008) · Neurotoxicity Research · doi:10.1007/bf03033808 · Cited by 580
Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.012 · Cited by 574
Stuttering and the basal ganglia circuits: a critical review of possible relations
Alm, P. A. (2004) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2004.03.001 · Cited by 587
Striatal circuits for reward learning and decision-making
Cox, J., & Witten, I. B. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0189-2 · Cited by 584
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 581
Dopamine-dependent plasticity of corticostriatal synapses
Reynolds, J. N. J., & Wickens, J. R. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00045-x · Cited by 528
Self-citationCortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks
Lo, C.-C., & Wang, X.-J. (2006) · Nature Neuroscience · doi:10.1038/nn1722 · Cited by 505
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501
Roles for nigrostriatal—not just mesocorticolimbic—dopamine in reward and addiction
Wise, R. A. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.06.004 · Cited by 500
Tripp, G., & Wickens, J. R. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2009.07.026 · Cited by 492
Self-citationNeurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum
Lovinger, D. M. (2010) · Neuropharmacology · doi:10.1016/j.neuropharm.2010.01.008 · Cited by 488
“There is some experimental evidence for this idea from in vivo studies (Reynolds and Wickens, 2000; Reynolds et al., 2001).”
Firing modes of midbrain dopamine cells in the freely moving rat
Hyland, B. I., Reynolds, J. N. J., HAY, J. G., Perk, C. G., & Miller, R. (2002) · Neuroscience · doi:10.1016/s0306-4522(02)00267-1 · Cited by 487
Self-citationIt could be habit forming: drugs of abuse and striatal synaptic plasticity
Gerdeman, G. L., Partridge, J. G., Lupica, C. R., & Lovinger, D. M. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00065-1 · Cited by 480
The computational neurobiology of learning and reward
Daw, N. D., & Doya, K. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.006 · Cited by 492
Inflammation Effects on Motivation and Motor Activity: Role of Dopamine
Felger, J. C., & Treadway, M. T. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.143 · Cited by 474
Kim, H., Shimojo, S., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 470
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445
Valjent, E., Pagès, C., Hervé, D., Girault, J., & Caboche, J. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03278.x · Cited by 453
The ins and outs of the striatum: Role in drug addiction
Yager, L. M., Garcia, A. F., Wunsch, A. M., & Ferguson, S. M. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2015.06.033 · Cited by 467
Wise, R. A., & Robble, M. A. (2020) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-103337 · Cited by 446
Dopamine Receptor Activation Is Required for Corticostriatal Spike-Timing-Dependent Plasticity
Pawlak, V., & Kerr, J. N. D. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.4402-07.2008 · Cited by 430
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 419
Collins, A. G. E., & Frank, M. J. (2014) · Psychological Review · doi:10.1037/a0037015 · Cited by 403
Information processing, dimensionality reduction and reinforcement learning in the basal ganglia
Bar‐Gad, I., Morris, G., & Bergman, H. (2003) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2003.12.001 · Cited by 413
Endocannabinoid signaling system and brain reward: emphasis on dopamine
GARDNER, E. (2005) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2005.01.032 · Cited by 387
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377
Context dependence of the event‐related brain potential associated with reward and punishment
Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2004.00152.x · Cited by 388
Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362
The integrative function of the basal ganglia in instrumental conditioning
Balleine, B. W., Liljeholm, M., & Ostlund, S. B. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.034 · Cited by 356
Distinct subclasses of medium spiny neurons differentially regulate striatal motor behaviors
Bateup, H. S., Santini, E., Shen, W., Birnbaum, S. G., Valjent, E., Surmeier, D., Fisone, G., Nestler, E. J., & Greengard, P. (2010) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.1009874107 · Cited by 361
Voon, V., Fernagut, P., Wickens, J. R., Baunez, C., Rodríguez-Oroz, M. C., Pavon, N., Juncos, J. L., Obeso, J. A., & Bézard, E. (2009) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70287-x · Cited by 365
Self-citationTripp, G., & Wickens, J. R. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01851.x · Cited by 368
Self-citationCorticostriatal neurons in auditory cortex drive decisions during auditory discrimination
Znamenskiy, P., & Zador, A. M. (2013) · Nature · doi:10.1038/nature12077 · Cited by 351
Operant Reward Learning in Aplysia : Neuronal Correlates and Mechanisms
Brembs, B., Lorenzetti, F. D., Reyes, F. D., Baxter, D. A., & Byrne, J. H. (2002) · Science · doi:10.1126/science.1069434 · Cited by 338
An fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 337
Luman, M., Tripp, G., & Scheres, A. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.11.021 · Cited by 335
Deep Brain Stimulation for Neurologic and Neuropsychiatric Disorders
Wichmann, T., & DeLong, M. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.09.022 · Cited by 331
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326
Reward Improves Long-Term Retention of a Motor Memory through Induction of Offline Memory Gains
Abe, M., Schambra, H., Wassermann, E. M., Luckenbaugh, D., Schweighofer, N., & Cohen, L. G. (2011) · Current Biology · doi:10.1016/j.cub.2011.02.030 · Cited by 313
With or without you: predictive coding and Bayesian inference in the brain
Aitchison, L., & Lengyel, M. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.010 · Cited by 308
Inhibitory Interactions Between Spiny Projection Neurons in the Rat Striatum
Tunstall, M. J., Oorschot, D. E., Kean, A., & Wickens, J. R. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.3.1263 · Cited by 311
Self-citationNeuro-inspired electronic skin for robots
Liu, F., Deswal, S., Christou, A., Sandamirskaya, Y., Kaboli, M., & Dahiya, R. (2022) · Science Robotics · doi:10.1126/scirobotics.abl7344 · Cited by 312
Role of prefrontal cortex and the midbrain dopamine system in working memory updating
D’Ardenne, K., Eshel, N., Luka, J., Lenartowicz, A., Nystrom, L. E., & Cohen, J. D. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116727109 · Cited by 323
Habits, action sequences and reinforcement learning
Dezfouli, A., & Balleine, B. W. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08050.x · Cited by 297
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284
Self-citationCosta, R. M., Lin, S., Sotnikova, T. D., Cyr, M., Gainetdinov, R. R., Caron, M. G., & Nicolelis, M. A. L. (2006) · Neuron · doi:10.1016/j.neuron.2006.07.030 · Cited by 280
Monitoring and Control of Action by the Frontal Lobes
Schall, J. D., Stuphorn, V., & Brown, J. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00964-9 · Cited by 286
Dopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 276
Joshua, M., Adler, A., Mitelman, R., Vaadia, E., & Bergman, H. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3839-08.2008 · Cited by 273
Dovis, S., Van der Oord, S., Wiers, R. W., & Prins, P. J. M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0121651 · Cited by 272
Legenstein, R. A., Pecevski, D., & Maass, W. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000180 · Cited by 272
The Dopamine Hypothesis of Drug Addiction: Hypodopaminergic State
Melis, M., Spiga, S., & Diana, M. (2005) · International review of neurobiology · doi:10.1016/s0074-7742(05)63005-x · Cited by 282
Dopaminergic Mechanisms in Actions and Habits: Figure 1.
Wickens, J. R., Horvitz, J. C., Costa, R. M., & Killcross, S. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1671-07.2007 · Cited by 271
Self-citationBrown, J. W., Bullock, D. H., & Grossberg, S. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.08.006 · Cited by 268
Wolfart, J., & Roeper, J. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-09-03404.2002 · Cited by 260
Attention-Gated Reinforcement Learning of Internal Representations for Classification
Roelfsema, P. R., & van Ooyen, A. (2005) · Neural Computation · doi:10.1162/0899766054615699 · Cited by 263
Dopamine prediction error responses integrate subjective value from different reward dimensions
Lak, A., Stauffer, W. R., & Schultz, W. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1321596111 · Cited by 257
Prefrontal Cortex Fails to Learn from Reward Prediction Errors in Alcohol Dependence
Park, S. Q., Kahnt, T., Beck, A., Cohen, M. X., Dolan, R. J., Wrase, J., & Heinz, A. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5587-09.2010 · Cited by 263
What is reinforced by phasic dopamine signals?
Redgrave, P., GURNEY, K. N., & Reynolds, J. N. J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.10.007 · Cited by 261
Self-citationDopamine gating of forebrain neural ensembles
O’Donnell, P. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02463.x · Cited by 253
Selective corticostriatal plasticity during acquisition of an auditory discrimination task
Xiong, Q., Znamenskiy, P., & Zador, A. M. (2015) · Nature · doi:10.1038/nature14225 · Cited by 262
Distinct Roles of D1and D5Dopamine Receptors in Motor Activity and Striatal Synaptic Plasticity
Centonze, D., Grande, C., Saulle, E., Martín, A. B., Gubellini, P., Fuentes, N. P., Pisani, A., Bernardi, G., Moratalla, R., & Calabresi, P. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-24-08506.2003 · Cited by 250
Exley, R. A., & Cragg, S. J. (2007) · British Journal of Pharmacology · doi:10.1038/sj.bjp.0707510 · Cited by 271
Meaningful silences: how dopamine listens to the ACh pause
Cragg, S. J. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.01.003 · Cited by 245
The thalamostriatal system in normal and diseased states
Smith, Y., Galván, A., Ellender, T. J., Doig, N. M., Villalba, R. M., Huerta-Ocampo, I., Wichmann, T., & Bolam, J. P. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00005 · Cited by 259
Disrupted motor learning and long-term synaptic plasticity in mice lacking NMDAR1 in the striatum
Dang, M. T., Yokoi, F., Yin, H. H., Lovinger, D. M., Wang, Y., & Li, Y. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601758103 · Cited by 241
Neurocomputational models of basal ganglia function in learning, memory and choice
Cohen, M. X., & Frank, M. J. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.029 · Cited by 248
Selective enhancement of associative learning by microstimulation of the anterior caudate
Williams, Z. M., & Eskandar, E. N. (2006) · Nature Neuroscience · doi:10.1038/nn1662 · Cited by 235
Strauss, G. P., Frank, M. J., Waltz, J. A., Kasanova, Z., Herbener, E. S., & Gold, J. M. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.10.015 · Cited by 242
Metadata
- Authors
- Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R.
- Affiliations
- University of Otago (NZ)
- Corresponding author
- Wickens, Jeffery R.
- Venue
- Nature
- Published
- 2001-09
- Volume
- 413
- Issue
- 6851
- Pages
- 67-70
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2055523610
- Cited by
- 879
- References
- 33
- Citations by year
- 2026: 20 · 2025: 36 · 2024: 54 · 2023: 42 · 2022: 36 · 2021: 28 · 2020: 32 · 2019: 35 · 2018: 28 · 2017: 26 · 2016: 33 · 2015: 44 · 2014: 42 · 2013: 35 · 2012: 32
- FWCI
- 8.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- Institut National de la Santé et de la Recherche Médicale
- Saint Petersburg State University
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neuropharmacology Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- reward learning, positive reinforcement, intracranial self-stimulation, substantia nigra, striatum, synaptic potentiation, dopamine receptors, learning acquisition
- MeSH terms
- Animals, Brain, Cerebral Cortex, Corpus Striatum, Dopamine, Learning, Male, Models, Neurological, Neural Pathways, Neurons, Reinforcement, Psychology, Reward, Self Stimulation, Substantia Nigra, Synapses, Rats, Wistar, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review