Neural mechanisms of reward-related motor learning
Abstract
The analysis of the neural mechanisms responsible for reward-related learning has benefited from recent studies of the effects of dopamine on synaptic plasticity. Dopamine-dependent synaptic plasticity may lead to strengthening of selected inputs on the basis of an activity-dependent conjunction of sensory afferent activity, motor output activity, and temporally related firing of dopamine cells. Such plasticity may provide a link between the reward-related firing of dopamine cells and the acquisition of changes in striatal cell activity during learning. This learning mechanism may play a special role in the translation of reward signals into context-dependent response probability or directional bias in movement responses.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Cortical high-frequency stimulation has most frequently been observed to produce long-term depression at cortico-striatal synapses.
“Cortical high-frequency stimulation has most frequently been observed to produce LTD at cortico-striatal synapses.”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [33]
Cortico-striatal synapses can undergo both long-term potentiation and long-term depression.
“Cortico-striatal synapses can undergo both strengthening (long-term potentiation, or LTP), and weakening (long-term depression, or LTD; [32–33]).”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [33]
When dopamine is applied in brief pulses coinciding with the time of pre-synaptic stimulation and post-synaptic depolarization of the striatal cell, cortico-striatal synapses show potentiation rather than depression.
“However, when dopamine is applied in brief pulses coinciding with the time of pre-synaptic stimulation and post-synaptic depolarization of the striatal cell, cortico-striatal synapses show potentiation rather than depression [33].”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [33]
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · see citing works
Dissociation of reward anticipation and outcome with event-related fMRI
Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300 · see citing works
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291 · see citing works
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116 · see citing works
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113 · see citing works
A triple dissociation of memory systems: Hippocampus, amygdala, and dorsal striatum.
McDonald, R. J., & White, N. M. (1993) · Behavioral Neuroscience · doi:10.1037/0735-7044.107.1.3 · Cited by 885 · see citing works
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · see citing works
Self-citationBuilding neural representations of habits.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834 · see citing works
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 632 · see citing works
Aosaki, T., Tsubokawa, H., Ishida, A., Watanabe, K., Graybiel, A. M., & Kimura, M. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-06-03969.1994 · Cited by 600 · see citing works
Dopamine-dependent plasticity of corticostriatal synapses
Reynolds, J. N. J., & Wickens, J. R. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00045-x · Cited by 528 · see citing works
Self-citationElliott, R., Newman, J. L., Longe, O. A., & Deakin, J. F. W. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-01-00303.2003 · Cited by 515 · see citing works
Firing modes of midbrain dopamine cells in the freely moving rat
Hyland, B. I., Reynolds, J. N. J., HAY, J. G., Perk, C. G., & Miller, R. (2002) · Neuroscience · doi:10.1016/s0306-4522(02)00267-1 · Cited by 487 · see citing works
Self-citationSwainson, R., Rogers, R. D., Sahakian, B. J., Summers, B. A., Polkey, C. E., & Robbins, T. W. (2000) · Neuropsychologia · doi:10.1016/s0028-3932(99)00103-7 · Cited by 486 · see citing works
The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia
Calabresi, P., Pisani, A., Mercuri, N. B., & Bernardi, G. (1996) · Trends in Neurosciences · doi:10.1016/0166-2236(96)81862-5 · Cited by 462 · see citing works
Aosaki, T., Graybiel, A. M., & Kimura, M. (1994) · Science · doi:10.1126/science.8023166 · Cited by 427 · see citing works
Calabresi, P., Pisani, A., Mercuri, N. B., & Bernardi, G. (1992) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1992.tb00119.x · Cited by 418 · see citing works
A neural correlate of response bias in monkey caudate nucleus
Lauwereyns, J., Watanabe, K., Coe, B. C., & Hikosaka, O. (2002) · Nature · doi:10.1038/nature00892 · Cited by 415 · see citing works
Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey
Schultz, W. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.56.5.1439 · Cited by 390 · cited 1× · see citing works
“However, it is consistent with the paucity of movement-related activity in dopamine cells in monkeys [15–19], rats [20 ,21,22], or cats [23], and imaging studies in humans that indicate responses to reward in the striatum [24–26].”
ResultKerr, J. N. D., & Wickens, J. R. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.1.117 · Cited by 384 · see citing works
Self-citationRomo, R., & Schultz, W. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.592 · Cited by 353 · cited 1× · see citing works
“However, it is consistent with the paucity of movement-related activity in dopamine cells in monkeys [15–19], rats [20 ,21,22], or cats [23], and imaging studies in humans that indicate responses to reward in the striatum [24–26].”
ResultOperant Reward Learning in <i>Aplysia</i> : Neuronal Correlates and Mechanisms
Brembs, B., Lorenzetti, F. D., Reyes, F. D., Baxter, D. A., & Byrne, J. H. (2002) · Science · doi:10.1126/science.1069434 · Cited by 338 · see citing works
Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation
Garris, P. A., Kilpatrick, M., Bunin, M. A., Michael, D., Walker, Q. D., & Wightman, R. M. (1999) · Nature · doi:10.1038/18019 · Cited by 327 · see citing works
Inhibitory Interactions Between Spiny Projection Neurons in the Rat Striatum
Tunstall, M. J., Oorschot, D. E., Kean, A., & Wickens, J. R. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.3.1263 · Cited by 311 · see citing works
Self-citationWickens, J. R., Begg, A., & Arbuthnott, G. W. (1996) · Neuroscience · doi:10.1016/0306-4522(95)00436-m · Cited by 294 · see citing works
Self-citationTonically discharging putamen neurons exhibit set-dependent responses.
Kimura, M., Rajkowski, J., & Evarts, E. V. (1984) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.81.15.4998 · Cited by 276 · see citing works
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 267 · see citing works
Corbett, D., & Wise, R. A. (1980) · Brain Research · doi:10.1016/0006-8993(80)90666-6 · Cited by 264 · see citing works
Miyachi, S., Hikosaka, O., & Lu, X. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1213-7 · Cited by 262 · see citing works
Behavioral correlates of dopaminergic unit activity in freely moving cats
Steinfels, G. F., Heym, J., Strecker, R. E., & Jacobs, B. L. (1983) · Brain Research · doi:10.1016/0006-8993(83)91145-9 · Cited by 261 · see citing works
Relations between movement and single cell discharge in the substantia nigra of the behaving monkey
DeLong, M., Crutcher, M., & Georgopoulos, A. (1983) · The Journal of Neuroscience · doi:10.1523/jneurosci.03-08-01599.1983 · Cited by 247 · see citing works
Floresco, S., Blaha, C. D., Yang, C. R., & Phillips, A. G. (2001) · Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02851.2001 · Cited by 242 · see citing works
Behaviorally contingent property of movement-related activity of the primate putamen
Kimura, M. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.6.1277 · Cited by 226 · see citing works
Changes in behavior-related neuronal activity in the striatum during learning
Schultz, W. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00122-x · Cited by 225 · see citing works
Partridge, J. G., Tang, K., & Lovinger, D. M. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.3.1422 · Cited by 213 · see citing works
Freeman, A. S., & Bunney, B. S. (1987) · Brain Research · doi:10.1016/0006-8993(87)90988-7 · Cited by 162 · see citing works
Dopamine-Dependent Synaptic Plasticity in the Striatal Cholinergic Interneurons
Suzuki, T., Miura, M., Nishimura, K., & Aosaki, T. (2001) · Journal of Neuroscience · doi:10.1523/jneurosci.21-17-06492.2001 · Cited by 151 · see citing works
A triple dissociation of memory systems: Hippocampus, amygdala, and dorsal striatum.
McDonald, R., & White, N. (1993) · Behavioral Neuroscience · doi:10.1037/a0034883 · Cited by 146 · see citing works
The activity of pars compacta neurons of the monkey substantia nigra in relation to motor activation
Schultz, W., Ruffieux, A., & Aebischer, P. (1983) · Experimental Brain Research · doi:10.1007/bf00237874 · Cited by 136 · see citing works
Reynolds, J. N. J., & Wickens, J. R. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00273-6 · Cited by 131 · see citing works
Self-citationResponses of monkey midbrain dopamine neurons during delayed alternation performance
Ljungberg, T., Apicella, P., & Schultz, W. (1991) · Brain Research · doi:10.1016/0006-8993(91)90816-e · Cited by 128 · see citing works
Feature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus
Lauwereyns, J., Takikawa, Y., Kawagoe, R., Kobayashi, S., Koizumi, M., Coe, B. C., Sakagami, M., & Hikosaka, O. (2002) · Neuron · doi:10.1016/s0896-6273(02)00571-8 · Cited by 123 · see citing works
Disfacilitation and long-lasting inhibition of neostriatal neurons in the rat
Wilson, C. J., Chang, H. T., & Kitai, S. T. (1983) · Experimental Brain Research · doi:10.1007/bf00237198 · Cited by 121 · see citing works
Effects of US devaluation on win-stay and win-shift radial maze performance in rats.
Sage, J. R., & Knowlton, B. J. (2000) · Behavioral Neuroscience · doi:10.1037//0735-7044.114.2.295 · Cited by 90 · see citing works
Reduced reward processing in the brains of Parkinsonian patients
Künig, G., Leenders, K. L., Martin-Söelch, C., Missimer, J. H., Magyar‐Lehmann, S., & Schultz, W. (2000) · Neuroreport · doi:10.1097/00001756-200011270-00019 · Cited by 85 · see citing works
Dendritic Calcium Encodes Striatal Neuron Output during Up-States
Kerr, J. N. D., & Plenz, D. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-05-01499.2002 · Cited by 83 · see citing works
Kilpatrick, M., Rooney, M. B., MICHAEL, D., & Wightman, R. M. (2000) · Neuroscience · doi:10.1016/s0306-4522(99)00578-3 · Cited by 80 · see citing works
Effects of US devaluation on win–stay and win–shift radial maze performance in rats.
Sage, J. R., & Knowlton, B. J. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.2.295 · Cited by 74 · see citing works
Impulse activity of ventral tegmental area neurons during heroin self-administration in rats
Kiyatkin, E. A., & Rebec, G. V. (2001) · Neuroscience · doi:10.1016/s0306-4522(00)00492-9 · Cited by 66 · see citing works
A theory of the action of the after-effects of a connection upon it.
Thorndike, E. L. (1933) · Psychological Review · doi:10.1037/h0071025 · Cited by 61 · see citing works
Regional differences in the expression of corticostriatal synaptic plasticity
Smith, R. B., Musleh, W., Akopian, G. K., Buckwalter, J. G., & Walsh, J. P. (2001) · Neuroscience · doi:10.1016/s0306-4522(01)00260-3 · Cited by 44 · see citing works
Honrubia, M., Vilar�, M. T., Palacios, J. M., & Mengod, G. (2000) · Synapse · doi:10.1002/1098-2396(20001201)38:3 · Cited by 36 · see citing works
Impaired Incentive Learning in Treated Parkinson’s Disease
Charbonneau, D., Riopelle, R. J., & Beninger, R. J. (1996) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/s031716710003821x · Cited by 28 · see citing works
Stimulus frequency, calcium levels and striatal synaptic plasticity
Bonsi, P., Pisani, A., Bernardi, G., & Calabresi, P. (2003) · Neuroreport · doi:10.1097/00001756-200303030-00024 · Cited by 24 · see citing works
Beninger, R. J., & Freedman, N. L. (1982) · Physiological Psychology · doi:10.3758/bf03332973 · Cited by 21 · see citing works
Brain Dynamics and the Striatal Complex
Wickens, J. R. (2000) · Taylor & Francis eBooks · doi:10.4324/9780203304914 · Cited by 19 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347 · see citing works
Surmeier, D. J., Ding, J., Day, M., Wang, Z., & Shen, W. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.008 · Cited by 1,203 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
Dopamine-mediated regulation of corticostriatal synaptic plasticity
Calabresi, P., Picconi, B., Tozzi, A., & Di Filippo, M. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.001 · Cited by 865 · see citing works
Kelley, A. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.016 · Cited by 773 · see citing works
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · see citing works
Corticostriatal-hypothalamic circuitry and food motivation: Integration of energy, action and reward
Kelley, A. E., Baldo, B. A., Pratt, W. E., & Will, M. J. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.066 · Cited by 752 · see citing works
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · see citing works
“In addition, it is assumed that synaptic learning depends on reward signals, based on the observation that dopamine signal is known to gate synaptic plasticity in the striatum (Wickens et al., 2003; Shen et al., 2008) and prefrontal cortex (Otani et al.”
BackgroundAlcaro, A., Huber, R., & Panksepp, J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.07.014 · Cited by 614 · see citing works
Hikida, T., Kimura, K., Wada, N., Funabiki, K., & Nakanishi, S. (2010) · Neuron · doi:10.1016/j.neuron.2010.05.011 · Cited by 592 · see citing works
Dopaminergic neurons inhibit striatal output through non-canonical release of GABA
Tritsch, N. X., Ding, J. B., & Sabatini, B. L. (2012) · Nature · doi:10.1038/nature11466 · Cited by 576 · see citing works
Maier, M., Ballester, B. R., & Verschure, P. F. M. J. (2019) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2019.00074 · Cited by 528 · see citing works
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501 · see citing works
Cortical and basal ganglia contributions to habit learning and automaticity
Ashby, F. G., Turner, B. O., & Horvitz, J. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.02.001 · Cited by 481 · see citing works
Learning from Sensory and Reward Prediction Errors during Motor Adaptation
Izawa, J., & Shadmehr, R. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002012 · Cited by 474 · see citing works
Wise, R. A., & Robble, M. A. (2020) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-103337 · Cited by 418 · see citing works
Adenosine A2A receptors and basal ganglia physiology
Schiffmann, S. N., Fisone, G., Moresco, R. M., Cunha, R. A., & Ferré, S. (2007) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2007.05.001 · Cited by 393 · see citing works
Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362 · see citing works
Kreitzer, A. C., & Malenka, R. C. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.2959-05.2005 · Cited by 358 · see citing works
Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
Niv, Y., Edlund, J. A., Dayan, P., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5498-10.2012 · Cited by 356 · see citing works
Kelley, A. E., Baldo, B. A., & Pratt, W. E. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20769 · Cited by 352 · see citing works
Tripp, G., & Wickens, J. R. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01851.x · Cited by 346 · see citing works
Self-citationAn fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 337 · see citing works
Ashby, F. G., & Maddox, W. T. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2010.05874.x · Cited by 319 · see citing works
Baldo, B. A., & Kelley, A. E. (2007) · Psychopharmacology · doi:10.1007/s00213-007-0741-z · Cited by 312 · see citing works
Reward Improves Long-Term Retention of a Motor Memory through Induction of Offline Memory Gains
Abe, M., Schambra, H., Wassermann, E. M., Luckenbaugh, D., Schweighofer, N., & Cohen, L. G. (2011) · Current Biology · doi:10.1016/j.cub.2011.02.030 · Cited by 313 · see citing works
Switching from automatic to controlled behavior: cortico-basal ganglia mechanisms
Hikosaka, O., & Isoda, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.006 · Cited by 304 · see citing works
What is reinforced by phasic dopamine signals?
Redgrave, P., GURNEY, K. N., & Reynolds, J. N. J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.10.007 · Cited by 254 · see citing works
Self-citationBasal Ganglia Circuits for Reward Value–Guided Behavior
Hikosaka, O., Kim, H. F., Yasuda, M., & Yamamoto, S. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071013-013924 · Cited by 259 · see citing works
Exley, R. A., & Cragg, S. J. (2007) · British Journal of Pharmacology · doi:10.1038/sj.bjp.0707510 · Cited by 249 · see citing works
Shen, W., Plotkin, J. L., Francardo, V., Ko, W. K. D., Xie, Z., Li, Q., Fieblinger, T., Wess, J., Neubig, R. R., Lindsley, C. W., et al. (2015) · Neuron · doi:10.1016/j.neuron.2015.10.039 · Cited by 713 · see citing works
Meaningful silences: how dopamine listens to the ACh pause
Cragg, S. J. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.01.003 · Cited by 245 · see citing works
Selective enhancement of associative learning by microstimulation of the anterior caudate
Williams, Z. M., & Eskandar, E. N. (2006) · Nature Neuroscience · doi:10.1038/nn1662 · Cited by 235 · see citing works
Dopamine Signaling in Dorsal Versus Ventral Striatum: The Dynamic Role of Cholinergic Interneurons
Threlfell, S., & Cragg, S. J. (2011) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2011.00011 · Cited by 195 · see citing works
Neurogenetics and Pharmacology of Learning, Motivation, and Cognition
Frank, M. J., & Fossella, J. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.96 · Cited by 191 · see citing works
Ungless, M. A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.001 · Cited by 190 · see citing works
Redgrave, P., Vautrelle, N., & Reynolds, J. N. J. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.07.060 · Cited by 183 · see citing works
Self-citationInfluence of reward motivation on human declarative memory
Lombard, E., Bavelier, D., & Schwartz, S. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.11.015 · Cited by 174 · see citing works
WICKENS, J. R., BUDD, C. S., HYLAND, B. I., & ARBUTHNOTT, G. W. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.016 · Cited by 165 · see citing works
Self-citationSubcortical contributions to large-scale network communication
Bell, P. T., & Shine, J. M. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.036 · Cited by 163 · see citing works
Hosking, J. G., Floresco, S., & Winstanley, C. A. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.285 · Cited by 154 · see citing works
A psychological and neuroanatomical model of obsessive-compulsive disorder
Huey, E. D., Zahn, R., Krueger, F., Moll, J., Kapogiannis, D., Wassermann, E. M., & Grafman, J. (2008) · The Journal of Neuropsychiatry and Clinical Neurosciences · doi:10.1176/jnp.2008.20.4.390 · Cited by 152 · see citing works
Extrastriatal dopaminergic circuits of the basal ganglia
Rommelfanger, K. S. (2010) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2010.00139 · Cited by 150 · see citing works
Ethanol Action on Dopaminergic Neurons in the Ventral Tegmental Area
Morikawa, H., & Morrisett, R. A. (2010) · International review of neurobiology · doi:10.1016/s0074-7742(10)91008-8 · Cited by 139 · see citing works
Vagus nerve stimulation drives selective circuit modulation through cholinergic reinforcement
Bowles, S. G., Hickman, J. L., Peng, X., Williamson, W. R., Huang, R., Washington, K. A., Donegan, D., & Welle, C. G. (2022) · Neuron · doi:10.1016/j.neuron.2022.06.017 · Cited by 137 · see citing works
Where Do You Think You Are Going? The NMDA-D1 Receptor Trap
Cepeda, C., & Levine, M. S. (2006) · Science's STKE · doi:10.1126/stke.3332006pe20 · Cited by 136 · see citing works
Meaning and the brain: The neurosemantics of referential, interactive, and combinatorial knowledge
Friedemann Pulvermüller, A. (2011) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2011.03.004 · Cited by 131 · see citing works
Devan, B. D., Hong, N. S., & McDonald, R. J. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.06.002 · Cited by 130 · see citing works
Miller, B., Walker, A. G., Shah, A. S., Barton, S. J., & Rebec, G. V. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90606.2008 · Cited by 122 · see citing works
Transient Calcium and Dopamine Increase PKA Activity and DARPP-32 Phosphorylation
Lindskog, M., Kim, M., Wikström, M. A., Blackwell, K. T., & Kotaleski, J. H. (2006) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0020119 · Cited by 119 · see citing works
Yamamoto, S., Kim, H. F., & Hikosaka, O. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0318-13.2013 · Cited by 118 · see citing works
Corbit, L. H., Nie, H., & Janak, P. H. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00301 · Cited by 115 · see citing works
Convergent evidence for abnormal striatal synaptic plasticity in dystonia
Peterson, D. A., B, T. J. S. A., & Howard Poizner, A. (2009) · Neurobiology of Disease · doi:10.1016/j.nbd.2009.12.003 · Cited by 118 · see citing works
Takahashi, Y. K. (2008) · Frontiers in Neuroscience · doi:10.3389/neuro.01.014.2008 · Cited by 115 · see citing works
Yawata, S., Yamaguchi, T., Danjo, T., Hikida, T., & Nakanishi, S. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1210797109 · Cited by 112 · see citing works
Afonso, V. M., King, S., Chatterjee, D., & Fleming, A. S. (2009) · Hormones and Behavior · doi:10.1016/j.yhbeh.2009.02.003 · Cited by 112 · see citing works
Semaphorin 3E–Plexin-D1 signaling controls pathway-specific synapse formation in the striatum
Ding, J., Oh, W., Sabatini, B. L., & Gu, C. (2011) · Nature Neuroscience · doi:10.1038/nn.3003 · Cited by 110 · see citing works
Dopamine, Prediction Error and Beyond
Diederen, K. M. J., & Fletcher, P. C. (2021) · The Neuroscientist · doi:10.1177/1073858420907591 · Cited by 106 · see citing works
Robust Representation of Stable Object Values in the Oculomotor Basal Ganglia
Yasuda, M., Yamamoto, S., & Hikosaka, O. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.3438-12.2012 · Cited by 103 · see citing works
An integrative framework for perceptual disturbances in psychosis
Horga, G., & Abi-Dargham, A. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0234-1 · Cited by 103 · see citing works
Basal ganglia output to the thalamus: still a paradox
Goldberg, J. H., Farries, M. A., & Fee, M. S. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2013.09.001 · Cited by 93 · see citing works
The Neuropsychology of Anxiety
McNaughton, N., & Gray, J. A. (2024) · doi:10.1093/oso/9780198843313.001.0001 · Cited by 98 · see citing works
Science-Based Neurorehabilitation: Recommendations for Neurorehabilitation From Basic Science
Nielsen, J. B., Willerslev‐Olsen, M., Christiansen, L., Lundbye‐Jensen, J., & Lorentzen, J. (2015) · Journal of Motor Behavior · doi:10.1080/00222895.2014.931273 · Cited by 96 · see citing works
Massart, R., Guilloux, J., Mignon, V., Sokoloff, P., & Díaz, J. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06842.x · Cited by 96 · see citing works
Zhang, Z., Liu, Q., Wen, P., Zhang, J., Rao, X., Zhou, Z., Zhang, H., He, X., Li, J., Zhou, Z., et al. (2017) · eLife · doi:10.7554/elife.25423 · Cited by 89 · see citing works
Corticostriatal plasticity: life after the depression
Mahon, S., Deniau, J., & Charpier, S. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.06.010 · Cited by 90 · see citing works
Jeremic, D., Sanchez-Rodriguez, I., Jimenez-Diaz, L., & Navarro-Lopez, J. D. (2021) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2021.107808 · Cited by 89 · see citing works
Potential benefits of music playing in stroke upper limb motor rehabilitation
Grau‐Sánchez, J., Münte, T. F., ALTENMÜLLER, E. O., Duarte, E., & Rodríguez‐Fornells, A. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.02.027 · Cited by 88 · see citing works
Dyskinesia in Parkinson's disease: mechanisms and current non‐pharmacological interventions
Heumann, R., Moratalla, R., Herrero, M. T., Chakrabarty, K., Drucker-Colı́n, R., García-Montes, J. R., Simola, N., & Morelli, M. (2014) · Journal of Neurochemistry · doi:10.1111/jnc.12751 · Cited by 86 · see citing works
Cell-Type-Specific Outcome Representation in the Primary Motor Cortex
Levy, S., Lavzin, M., Benisty, H., Ghanayim, A., Dubin, U., Achvat, S., Brosh, Z., Aeed, F., Mensh, B. D., Schiller, Y., et al. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.006 · Cited by 88 · see citing works
Interpreting the role of the striatum during multiple phases of motor learning
Cataldi, S., Stanley, A. T., Miniaci, M. C., & Sulzer, D. L. (2021) · FEBS Journal · doi:10.1111/febs.15908 · Cited by 83 · see citing works
Efficient reinforcement learning: computational theories, neuroscience and robotics
Kawato, M., & Samejima, K. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.03.004 · Cited by 80 · see citing works
Instrumental learning in hyperdopaminergic mice
Yin, H. H., Zhuang, X., & Balleine, B. W. (2006) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2005.12.001 · Cited by 77 · see citing works
How may the basal ganglia contribute to auditory categorization and speech perception?
Lim, S.-J., Fiez, J. A., & Holt, L. L. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00230 · Cited by 75 · see citing works
Cortico‐basal ganglia mechanisms for overcoming innate, habitual and motivational behaviors
Isoda, M., & Hikosaka, O. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07698.x · Cited by 76 · see citing works
Reward Prediction Error Computation in the Pedunculopontine Tegmental Nucleus Neurons
Kobayashi, Y., & Okada, K. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.003 · Cited by 75 · see citing works
Bradberry, C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0561-6 · Cited by 76 · see citing works
Short-term memory traces for action bias in human reinforcement learning
Bogacz, R., McClure, S. M., Li, J., Cohen, J. D., & Montague, P. R. (2007) · Brain Research · doi:10.1016/j.brainres.2007.03.057 · Cited by 74 · see citing works
Dual Role of Medial A10 Dopamine Neurons in Affective Encoding
Liu, Z., Shin, R. S., & Ikemoto, S. (2008) · Neuropsychopharmacology · doi:10.1038/npp.2008.4 · Cited by 73 · see citing works
rTMS with motor training modulates cortico-basal ganglia-thalamocortical circuits in stroke patients
Chang, W. H., Kim, Y., Yoo, W., Goo, K.-H., Park, C.-H., Kim, S. T., & Pascual‐Leone, Á. (2012) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-2012-110162 · Cited by 72 · see citing works
Short-Latency Activation of Striatal Spiny Neurons via Subcortical Visual Pathways
Schulz, J. M., Redgrave, P., Mehring, C., Aertsen, A., Clements, K. M., Wickens, J. R., & Reynolds, J. N. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4815-08.2009 · Cited by 68 · see citing works
Self-citationKung, V., Hassam, R., Morton, A. J., & Jones, S. (2007) · Neuroscience · doi:10.1016/j.neuroscience.2007.03.036 · Cited by 72 · see citing works
Wolpe, N., Ingram, J. N., Tsvetanov, K. A., Henson, R. N., Wolpert, D. M., TYLER, L. K., Brayne, C., Bullmore, E. T., Calder, A. C., Cusack, R., et al. (2020) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2020.02.016 · Cited by 69 · see citing works
Afonso‐Oramas, D., Cruz‐Muros, I., de la Rosa, D. Á., Abreu, P. M., Giráldez, T., Castro‐Hernández, J., Salas-Hernández, J., Lanciego, J. L., Rodrı́guez, M., & González‐Hernández, T. (2009) · Neurobiology of Disease · doi:10.1016/j.nbd.2009.09.002 · Cited by 70 · see citing works
Vulnerability of mesostriatal dopaminergic neurons in Parkinson’s disease
González-Hernández, T. (2010) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2010.00140 · Cited by 65 · see citing works
Biever, A., Puighermanal, E., Nishi, A., David, A., Panciatici, C., Longueville, S., Xirodimas, D. P., Gangarossa, G., Meyuhas, O., Hervé, D., et al. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3288-14.2015 · Cited by 63 · see citing works
Momentary reward induce changes in excitability of primary motor cortex
Thabit, M. N., Nakatsuka, M., Koganemaru, S., Fawi, G., Fukuyama, H., & Mima, T. (2011) · Clinical Neurophysiology · doi:10.1016/j.clinph.2011.02.021 · Cited by 59 · see citing works
Instrumental learning, but not performance, requires dopamine D1-receptor activation in the amygdala
Andrzejewski, M. E., Spencer, R. C., & Kelley, A. E. (2005) · Neuroscience · doi:10.1016/j.neuroscience.2005.06.038 · Cited by 59 · see citing works
The impact of music interventions on motor rehabilitation following stroke in elderly
ALTENMÜLLER, E. O., & James, C. E. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-817422-7.00016-x · Cited by 60 · see citing works
Learning processing in the basal ganglia: A mosaic of broken mirrors
Cunha, C. D., Lovato, E. C. W., Dombrowski, P. A., Bortolanza, M., dos Santos, L. M., Boschen, S. L., & Miyoshi, E. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.001 · Cited by 59 · see citing works
Meyer, E. L., Yoshikami, D., & McIntosh, J. M. (2008) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.2008.05266.x · Cited by 58 · see citing works
Stimulus-response and response-outcome learning mechanisms in the striatum
Horvitz, J. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.014 · Cited by 58 · see citing works
A subcortical circuit linking the cerebellum to the basal ganglia engaged in vocal learning
Pidoux, L., Leblanc-Veyrac, P., Lévénès, C., & Leblois, A. (2018) · eLife · doi:10.7554/elife.32167 · Cited by 57 · see citing works
Simonyan, K., Herscovitch, P., & Horwitz, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.12.042 · Cited by 57 · see citing works
Uehara, S., Mawase, F., & Celnik, P. A. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx214 · Cited by 52 · see citing works
Ponvert, N. D., & Jaramillo, S. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.1188-18.2018 · Cited by 53 · see citing works
Baldassarre, G., Mannella, F., Fiore, V. G., Redgrave, P., GURNEY, K. N., & Mirolli, M. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.09.015 · Cited by 52 · see citing works
Establishing causality for dopamine in neural function and behavior with optogenetics
Steinberg, E. E., & Janak, P. H. (2012) · Brain Research · doi:10.1016/j.brainres.2012.09.036 · Cited by 52 · see citing works
Tozzi, A., de Iure, A., Tantucci, M., Durante, V., Quiroga‐Varela, A., Giampà, C., Mauro, M. D., Mazzocchetti, P., Costa, C., Filippo, M. D., et al. (2015) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2015.00192 · Cited by 49 · see citing works
Prescott, I. A., Liu, L. D., Dostrovsky, J. O., Hodaie, M., Lozano, A. M., & Hutchison, W. D. (2014) · Neurobiology of Disease · doi:10.1016/j.nbd.2014.08.002 · Cited by 49 · see citing works
- Authors
- Wickens, J. R., Reynolds, J. N., & Hyland, B. I.
- Affiliations
- University of Otago (NZ)
- Corresponding author
- Wickens, Jeffery R
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2003-12
- Volume
- 13
- Issue
- 6
- Pages
- 685-690
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W2105511691
- Cited by
- 284
- References
- 56
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 25 · 2023: 9 · 2022: 11 · 2021: 11 · 2020: 16 · 2019: 11 · 2018: 5 · 2017: 7 · 2016: 7 · 2015: 14 · 2014: 18 · 2013: 8 · 2012: 16
- FWCI
- 0.87
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Current Opinion in Neurobiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Royal Society
- Health Research Council of New Zealand
- Marsden Fund
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- dopamine, synaptic plasticity, striatum, activity-dependent plasticity, response probability, neural mechanisms of learning
- MeSH terms
- Animals, Brain, Cognition, Conditioning, Psychological, Humans, Movement, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review