Dopamine-dependent reinforcement of motor skill learning: evidence from Gilles de la Tourette syndrome
Abstract
Reinforcement learning theory has been extensively used to understand the neural underpinnings of instrumental behaviour. A central assumption surrounds dopamine signalling reward prediction errors, so as to update action values and ensure better choices in the future. However, educators may share the intuitive idea that reinforcements not only affect choices but also motor skills such as typing. Here, we employed a novel paradigm to demonstrate that monetary rewards can improve motor skill learning in humans. Indeed, healthy participants progressively got faster in executing sequences of key presses that were repeatedly rewarded with 10 euro compared with 1 cent. Control tests revealed that the effect of reinforcement on motor skill learning was independent of subjects being aware of sequence-reward associations. To account for this implicit effect, we developed an actor-critic model, in which reward prediction errors are used by the critic to update state values and by the actor to facilitate action execution. To assess the role of dopamine in such computations, we applied the same paradigm in patients with Gilles de la Tourette syndrome, who were either unmedicated or treated with neuroleptics. We also included patients with focal dystonia, as an example of hyperkinetic motor disorder unrelated to dopamine. Model fit showed the following dissociation: while motor skills were affected in all patient groups, reinforcement learning was selectively enhanced in unmedicated patients with Gilles de la Tourette syndrome and impaired by neuroleptics. These results support the hypothesis that overactive dopamine transmission leads to excessive reinforcement of motor sequences, which might explain the formation of tics in Gilles de la Tourette syndrome.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Reward learning is enhanced in people with TS who are not on medication, and impaired in people with TS taking DA receptor antagonists.
“Supporting this framework, reward learning is enhanced in people with TS who are not on medication, and impaired in people with TS taking DA receptor antagonists [621].”
From Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings (2012) · cites this paper as [621]
Cites
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
The mini international neuropsychiatric interview
Lecrubier, Y., Sheehan, D. V., Hergueta, T., & Weiller, E. (1998) · European Psychiatry · doi:10.1016/s0924-9338(99)80239-9 · Cited by 5,882 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964 · see citing works
Zhang, B., Li, C., & Lin, N. (2020) · De Gruyter eBooks · doi:10.1515/9783110595567-011 · Cited by 1,939 · see citing works
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · see citing works
Self-citationMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Central mechanisms of motor skill learning
Hikosaka, O., Nakamura, K., Sakai, K., & Nakahara, H. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00307-0 · Cited by 1,023 · see citing works
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964 · see citing works
A neuropsychological theory of motor skill learning.
Willingham, D. B. (1998) · Psychological Review · doi:10.1037/0033-295x.105.3.558 · Cited by 798 · see citing works
Contributions of the basal ganglia and functionally related brain structures to motor learning
Doyon, J., Bellec, P., Amsel, R., Penhune, V., Monchi, O., Carrier, J., Lehéricy, S., & Benali, H. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.11.012 · Cited by 783 · see citing works
Self-citationThe power law repealed: The case for an exponential law of practice
Heathcote, A., Brown, S. D., & Mewhort, D. J. K. (2000) · Psychonomic Bulletin & Review · doi:10.3758/bf03212979 · Cited by 735 · see citing works
From reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 715 · see citing works
Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making
Frank, M. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.006 · Cited by 706 · see citing works
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704 · see citing works
Leckman, J. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11526-1 · Cited by 683 · see citing works
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · see citing works
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0020 · Cited by 555 · see citing works
The Basal Ganglia and Involuntary Movements
Mink, J. W. (2003) · Archives of Neurology · doi:10.1001/archneur.60.10.1365 · Cited by 552 · see citing works
Actor–critic models of the basal ganglia: new anatomical and computational perspectives
Joel, D., Niv, Y., & Ruppin, E. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00047-3 · Cited by 500 · see citing works
(1997) · The MIT Press eBooks · doi:10.7551/mitpress/3917.003.0017 · Cited by 497 · see citing works
Recent advances in Tourette syndrome research
Albin, R. L., & Mink, J. W. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.01.001 · Cited by 478 · see citing works
Cools, R., Frank, M. J., Gibbs, S. E. B., Miyakawa, A., Jagust, W. J., & D’Esposito, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4467-08.2009 · Cited by 365 · see citing works
Bódi, N., Kéri, S., Nagy, H., Moustafa, A. A., Myers, C. E., Daw, N. D., Dibó, G., Takáts, A., Bereczki, D., & Gluck, M. A. (2009) · Brain · doi:10.1093/brain/awp094 · Cited by 356 · see citing works
Jankovic, J. J. (2006) · The Lancet Neurology · doi:10.1016/s1474-4422(06)70574-9 · Cited by 332 · see citing works
Tourette's syndrome: from behaviour to biology
Singer, H. S. (2005) · The Lancet Neurology · doi:10.1016/s1474-4422(05)01012-4 · Cited by 309 · see citing works
Human substantia nigra neurons encode unexpected financial rewards
Zaghloul, K. A., Blanco, J. A., Weidemann, C. T., McGill, K., Jaggi, J. L., Baltuch, G. H., & Kahana, M. J. (2009) · Science · doi:10.1126/science.1167342 · Cited by 264 · see citing works
Rutledge, R. B., Lazzaro, S. C., Lau, B., Myers, C. E., Gluck, M. A., & Glimcher, P. W. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.3524-09.2009 · Cited by 255 · see citing works
Wong, D. F., Brašić, J. R., Singer, H. S., Schretlen, D. J., Kuwabara, H., Zhou, Y., Nandi, A., Maris, M. A., Alexander, M., Ye, W., et al. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301528 · Cited by 253 · see citing works
SEQUENTIAL ARM MOVEMENTS IN PATIENTS WITH PARKINSON'S DISEASE, HUNTINGTON'S DISEASE AND DYSTONIA
Agostino, R., Berardelli, A., Formica, A., Accornero, N., & Manfredi, M. (1992) · Brain · doi:10.1093/brain/115.5.1481 · Cited by 252 · see citing works
Models of information processing in the basal Ganglia
Hikosaka, O. (1995) · Trends in Neurosciences · doi:10.1016/0166-2236(95)90004-7 · Cited by 248 · see citing works
A Computational Model of How the Basal Ganglia Produce Sequences
Berns, G. S., & B, T. J. S. A. (1998) · Journal of Cognitive Neuroscience · doi:10.1162/089892998563815 · Cited by 231 · see citing works
[123I]beta-CIT SPECT imaging of striatal dopamine transporter binding in Tourette's disorder
Malison, R. T., McDougle, C. J., van Dyck, C. H., Scahill, L. D., Baldwin, R. M., Seibyl, J. P., Price, L. H., Leckman, J. F., & Innis, R. B. (1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.9.1359 · Cited by 223 · see citing works
Rhodes, B. J., Bullock, D. H., Verwey, W. B., Averbeck, B. B., & Page, M. P. A. (2004) · Human Movement Science · doi:10.1016/j.humov.2004.10.008 · Cited by 219 · see citing works
Stepping out of the box: information processing in the neural networks of the basal ganglia
Bar‐Gad, I., & Bergman, H. (2001) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(01)00270-7 · Cited by 209 · see citing works
Differential Effect of Reward and Punishment on Procedural Learning
Wächter, T., Lungu, O., Liu, T., Willingham, D. T., & Ashe, J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4132-08.2009 · Cited by 204 · see citing works
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 198 · see citing works
Tourette's syndrome: from behaviour to biology
Singer, H. S. (2005) · The Lancet Neurology · doi:10.1016/s1474-4422(05)70018-1 · Cited by 198 · see citing works
Motor sequence learning and movement disorders
Doyon, J. (2008) · Current Opinion in Neurology · doi:10.1097/wco.0b013e328304b6a3 · Cited by 194 · see citing works
Cortical control of motor sequences
Ashe, J., Lungu, O. V., Basford, A. T., & Lu, X. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.008 · Cited by 185 · see citing works
Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes
Palminteri, S., Lebreton, M. P., Worbe, Y., Grabli, D., Hartmann, A., & Pessiglione, M. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0904035106 · Cited by 147 · see citing works
Self-citationMenon, M., Jensen, J., Vitcu, I., Graff‐Guerrero, A., Crawley, A. P., Smith, M. A., & Kapur, S. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.10.020 · Cited by 145 · see citing works
Two-factor theory, the actor--critic model, and conditioned avoidance
Maia, T. V. (2010) · Learning & Behavior · doi:10.3758/lb.38.1.50 · Cited by 130 · see citing works
Minzer, K., Lee, O., Hong, J. J., & Singer, H. S. (2004) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2003.12.006 · Cited by 130 · see citing works
Abler, B., Erk, S., & Walter, H. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0690-y · Cited by 118 · see citing works
Frontal dopaminergic abnormality in Tourette syndrome: A postmortem analysis
Yoon, D. Y., Gause, C. D., Leckman, J. F., & Singer, H. S. (2007) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2007.01.069 · Cited by 112 · see citing works
Striatal dopamine release in sequential learning
Badgaiyan, R. D., Fischman, A. J., & Alpert, N. M. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.052 · Cited by 100 · see citing works
Pathophysiology of Tourette's syndrome: striatal pathways revisited
Saka, E., & Graybiel, A. M. (2003) · Brain and Development · doi:10.1016/s0387-7604(03)90002-7 · Cited by 92 · see citing works
Groenewegen, H. J., van den Heuvel, O. A., Cath, D. C., Voorn, P., & Veltman, D. J. (2003) · Brain and Development · doi:10.1016/s0387-7604(03)90001-5 · Cited by 88 · see citing works
Kwak, Y., Müller, M. L. T. M., Bohnen, N. I., Dayalu, P., & Seidler, R. D. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00197.2009 · Cited by 87 · see citing works
The neurobiology of repetitive behaviors: clues to the neurobiology of Tourette syndrome.
Graybiel, A. M., & Canales, J. J. (2001) · PubMed · Cited by 84 · see citing works
Altered mesolimbocortical and thalamic dopamine in Tourette syndrome
Gilbert, D. L., Christian, B. T., Gelfand, M. J., Shi, B., Mantil, J., & Sallee, F. R. (2006) · Neurology · doi:10.1212/01.wnl.0000242733.18534.2c · Cited by 84 · see citing works
Probabilistic classification learning in Tourette syndrome
Kéri, S., Szlobodnyik, C., Benedek, G., Janka, Z., & Gádoros, J. (2002) · Neuropsychologia · doi:10.1016/s0028-3932(01)00210-x · Cited by 76 · see citing works
Dopaminergic Suppression of Brain Deactivation Responses during Sequence Learning
Árgyelán, M., Carbon, M., Ghilardi, M. F., Feigin, A., Mattis, P. J., Tang, C., DHAWAN, V. M., & Eidelberg, D. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.2933-08.2008 · Cited by 70 · see citing works
Vidailhet, M., Grabli, D., & Roze, E. F. (2009) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32832d9ef3 · Cited by 67 · see citing works
Self-citationEffects of acute administration of d-amphetamine and haloperidol on procedural learning in man
Kumari, V., Gray, J. A., Corr, P. J., Mulligan, O. F., Cotter, P. A., & Checkley, S. A. (1997) · Psychopharmacology · doi:10.1007/s002130050190 · Cited by 61 · see citing works
Karabanov, A. N., Červenka, S., de Manzano, Ö., Forssberg, H., Farde, L., & Ullén, F. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0911805107 · Cited by 54 · see citing works
Task-Related Interaction between Basal Ganglia and Cortical Dopamine Release
Garraux, G., Peigneux, P., Carson, R. E., & Hallett, M. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1595-07.2007 · Cited by 47 · see citing works
Functional imaging of sequence learning in Parkinson's disease
Carbon, M., & Eidelberg, D. (2006) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2006.05.005 · Cited by 47 · see citing works
Neuroimaging study on brain asymmetries in situs inversus totalis
Ihara, A. S., Hirata, M., Fujimaki, N., Goto, T., Umekawa, Y., Fujita, N., Terazono, Y., Matani, A., Wei, Q., Yoshimine, T., et al. (2009) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2009.10.002 · Cited by 42 · see citing works
MARSH, R., Alexander, G. M., Packard, M. G., Hongtu Zhu, B., & PETERSON, B. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.12.012 · Cited by 40 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634 · see citing works
Dichter, G. S., Damiano, C. A., & Allen, J. A. (2012) · Journal of Neurodevelopmental Disorders · doi:10.1186/1866-1955-4-19 · Cited by 299 · see citing works
The functional anatomy of Gilles de la Tourette syndrome
Ganos, C., Roessner, V., & Münchau, A. M. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.11.004 · Cited by 242 · see citing works
Enhanced habit formation in Gilles de la Tourette syndrome
Delorme, C., Salvador, A., Valabrègue, R., Roze, E., Palminteri, S., Vidailhet, M., de Wit, S., Robbins, T., Hartmann, A., & Worbe, Y. (2016) · Brain · doi:10.1093/brain/awv307 · Cited by 154 · see citing works
Self-citationReward feedback accelerates motor learning
Nikooyan, A. A., & Ahmed, A. A. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00032.2014 · Cited by 155 · see citing works
The Computational Development of Reinforcement Learning during Adolescence
Palminteri, S., Kilford, E. J., Coricelli, G., & Blakemore, S. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004953 · Cited by 143 · see citing works
Self-citationPathological glutamatergic neurotransmission in Gilles de la Tourette syndrome
Kanaan, A. S., Gerasch, S., García‐García, I., Lampe, L., Pampel, A., Anwander, A., Near, J., Möller, H. E., & Müller‐Vahl, K. (2016) · Brain · doi:10.1093/brain/aww285 · Cited by 91 · see citing works
The Roles of Phasic and Tonic Dopamine in Tic Learning and Expression
Maia, T. V., & Conceição, V. A. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.05.025 · Cited by 79 · see citing works
Premonitory urges and tics in Tourette syndrome: computational mechanisms and neural correlates
Conceição, V. A., Dias, Â. J. B., Farinha, A. C., & Maia, T. V. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.009 · Cited by 78 · see citing works
Tics and Tourette syndrome — surplus of actions rather than disorder?
Beste, C., & Münchau, A. M. (2017) · Movement Disorders · doi:10.1002/mds.27244 · Cited by 62 · see citing works
Reward boosts reinforcement-based motor learning
Vassiliadis, P., Derosière, G., Dubuc, C., Lété, A., Crevecoeur, F., Hummel, F. C., & Duqué, J. (2021) · iScience · doi:10.1016/j.isci.2021.102821 · Cited by 62 · see citing works
Is procedural memory enhanced in Tourette syndrome? Evidence from a sequence learning task
Takács, Á., Kóbor, A., Chezan, J., Éltető, N., Tárnok, Z., Németh, D., Ullman, M. T., & Janacsek, K. (2017) · Cortex · doi:10.1016/j.cortex.2017.08.037 · Cited by 56 · see citing works
Neuroendocrine Aspects of Tourette Syndrome
Martino, D., Macerollo, A., & Leckman, J. F. (2013) · International review of neurobiology · doi:10.1016/b978-0-12-411546-0.00009-3 · Cited by 55 · see citing works
Pediatric indications for deep brain stimulation
DiFrancesco, M. F., Halpern, C. H., Hurtig, H. H., Baltuch, G. H., & Heuer, G. G. (2012) · Child s Nervous System · doi:10.1007/s00381-012-1861-2 · Cited by 53 · see citing works
Mechanisms Underlying Behavior Therapy for Tourette’s Disorder
Essoe, J. K.-Y., Ramsey, K. A., Singer, H. S., Grados, M. A., & Mcguire, J. F. (2021) · Current Developmental Disorders Reports · doi:10.1007/s40474-021-00225-1 · Cited by 48 · see citing works
The effect of P arkinson's disease and H untington's disease on human visuomotor learning
Gutiérrez-Garralda, J. M., Moreno‐Briseño, P., Boll, M., Morgado‐Valle, C., Campos‐Romo, A., Díaz, R., & Fernández-Ruíz, J. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12288 · Cited by 47 · see citing works
Reinforcement Learning and Tourette Syndrome
Palminteri, S., & Pessiglione, M. (2013) · International review of neurobiology · doi:10.1016/b978-0-12-411546-0.00005-6 · Cited by 46 · see citing works
Self-citationCompetitive and cooperative interactions between medial temporal and striatal learning systems
Freedberg, M., Toader, A. C., Wassermann, E. M., & Voss, J. L. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107257 · Cited by 40 · see citing works
Tics as a model of over‐learned behavior—imitation and inhibition of facial tics
Brandt, V. C., Patalay, P., Bäumer, T., Braß, M., & Münchau, A. M. (2016) · Movement Disorders · doi:10.1002/mds.26607 · Cited by 34 · see citing works
Non-invasive Brain Stimulation for the Treatment of Gilles de la Tourette Syndrome
Kleimaker, M., Kleimaker, A., Weissbach, A., Colzato, L., Beste, C., Bäumer, T., & Münchau, A. (2020) · Frontiers in Neurology · doi:10.3389/fneur.2020.592258 · Cited by 25 · see citing works
Bortolato, M., Frau, R., Godar, S. C., Mosher, L. J., Paba, S., Marrosu, F., & Devoto, P. (2013) · Journal of Neuroendocrinology · doi:10.1111/jne.12066 · Cited by 31 · see citing works
Gilles de la Tourette Syndrome—A Disorder of Action-Perception Integration
Kleimaker, A., Kleimaker, M., Bäumer, T., Beste, C., & Münchau, A. M. (2020) · Frontiers in Neurology · doi:10.3389/fneur.2020.597898 · Cited by 31 · see citing works
Shephard, E., Jackson, G. M., & Groom, M. J. (2016) · International Journal of Developmental Neuroscience · doi:10.1016/j.ijdevneu.2016.04.005 · Cited by 29 · see citing works
The dissociable effects of reward on sequential motor behavior
Sporn, S., Chen, X., & Galea, J. M. (2022) · Journal of Neurophysiology · doi:10.1152/jn.00467.2021 · Cited by 34 · see citing works
Mosberger, A. C., de Clauser, L., Kasper, H., & Schwab, M. (2016) · Learning & memory (Cold Spring Harbor, N.Y.) · doi:10.1101/lm.039537.115 · Cited by 23 · see citing works
A verbal strength in children with Tourette syndrome? Evidence from a non-word repetition task
Dye, C. D., Walenski, M., Mostofsky, S. H., & Ullman, M. T. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.07.005 · Cited by 26 · see citing works
Shephard, E., Groom, M. J., & Jackson, G. M. (2018) · Journal of Neuropsychology · doi:10.1111/jnp.12167 · Cited by 22 · see citing works
Associative plasticity in supplementary motor area - motor cortex pathways in Tourette syndrome
Tübing, J., Gigla, B., Brandt, V. C., Verrel, J., Weißbach, A., Beste, C., Münchau, A. M., & Bäumer, T. (2018) · Scientific Reports · doi:10.1038/s41598-018-30504-8 · Cited by 22 · see citing works
Nasello, C., Poppi, L. A., Wu, J., Kowalski, T. F., Thackray, J. K., Wang, R., Persaud, A., Mahboob, M., Lin, S., Spaseska, R., et al. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2307156121 · Cited by 21 · see citing works
Hamel, R., Savoie, F.-A., Lacroix, A., Whittingstall, K., Trempe, M., & Bernier, P. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.06.032 · Cited by 20 · see citing works
Altered Interoceptive Sensibility in Adults With Chronic Tic Disorder
Narapareddy, A., Eckland, M. R., Riordan, H., Cascio, C. J., & Isaacs, D. A. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.914897 · Cited by 19 · see citing works
Timing recalibration in childhood Tourette syndrome associated with persistent pimozide treatment
Vicario, C. M., Gulisano, M., Martino, D., & Rizzo, R. (2015) · Journal of Neuropsychology · doi:10.1111/jnp.12064 · Cited by 19 · see citing works
Steinke, A., Lange, F., Seer, C., & Kopp, B. (2018) · Computational Brain & Behavior · doi:10.1007/s42113-018-0009-1 · Cited by 19 · see citing works
Left-shifting prism adaptation boosts reward-based learning
Schintu, S., Freedberg, M., Alam, Z. M., Shomstein, S., & Wassermann, E. M. (2018) · Cortex · doi:10.1016/j.cortex.2018.09.021 · Cited by 19 · see citing works
Toward a Computational Neuropsychology of Cognitive Flexibility
Steinke, A., & Kopp, B. (2020) · Brain Sciences · doi:10.3390/brainsci10121000 · Cited by 20 · see citing works
Behavioral Interventions for Children and Adults with Tic Disorder
Woods, D. W., Himle, M. B., Stiede, J. T., & Pitts, B. X. (2023) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080921-074307 · Cited by 20 · see citing works
Tóth-Fáber, E., Tárnok, Z., Janacsek, K., Kóbor, A., Nagy, P., Farkas, B. C., Oláh, S., Merkl, D., Hegedűs, O., Németh, D., et al. (2021) · Child Neuropsychology · doi:10.1080/09297049.2021.1894110 · Cited by 17 · see citing works
Reward and decision processes in the brains of humans and nonhuman primates
Angela Sirigu, B., & Duhamel, J. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/asirigu · Cited by 16 · see citing works
Scholl, C., Baladron, J., Vitay, J., & Hamker, F. H. (2022) · Brain Structure and Function · doi:10.1007/s00429-021-02446-x · Cited by 16 · see citing works
Salvador, A., Worbe, Y., Delorme, C., Coricelli, G., Raphaël Gaillard, B., Robbins, T. W., Hartmann, A., & Palminteri, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-06547-8 · Cited by 14 · see citing works
Self-citationHeym, N., Kantini, E., Checkley, H. L. R., & Cassaday, H. J. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.01.012 · Cited by 13 · see citing works
The Phenomenon of Exquisite Motor Control in Tic Disorders and its Pathophysiological Implications
Ganos, C., Neumann, W., Müller‐Vahl, K., Bhatia, K. P., Hallett, M., Haggard, P., & Rothwell, J. C. (2021) · Movement Disorders · doi:10.1002/mds.28557 · Cited by 13 · see citing works
Galléa, C., Balas, M., Bertasi, E., Valabrègue, R., García-Lorenzo, D., Coynel, D., Bonnet, C., Grabli, D., Pélégrini‐Issac, M., Doyon, J., et al. (2015) · NeuroImage Clinical · doi:10.1016/j.nicl.2015.04.013 · Cited by 13 · see citing works
Self-citationImpairment of visually guided associative learning in children with Tourette syndrome
Eördegh, G., Pertich, Á., Tárnok, Z., Nagy, P., Bodosi, B., Giricz, Z., Hegedűs, O., Merkl, D., Nyujtó, D., Oláh, S., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234724 · Cited by 11 · see citing works
Reward and plasticity: Implications for neurorehabilitation
Johnson, B. P., & Cohen, L. G. (2022) · Handbook of clinical neurology · doi:10.1016/b978-0-12-819410-2.00018-7 · Cited by 10 · see citing works
Takács, Á., Münchau, A. M., Németh, D., Roessner, V., & Beste, C. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15366 · Cited by 10 · see citing works
Rapid Presentation of Emotional Expressions Reveals New Emotional Impairments in Tourette’s Syndrome
Mermillod, M., Devaux, D., Derost, P., Rieu, I., Chambres, P., Auxiette, C., Legrand, G., Galland, F., Dalens, H., Coulangeon, L. M., et al. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00149 · Cited by 10 · see citing works
Maigaard, K., Nejad, A. B., Andersen, K. W., Herz, D. M., Hagstrøm, J., Pagsberg, A. K., Skov, L., Siebner, H. R., & Plessen, K. J. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.05.012 · Cited by 9 · see citing works
Martino, D., & Mink, J. W. (2013) · CONTINUUM Lifelong Learning in Neurology · doi:10.1212/01.con.0000436157.31662.af · Cited by 9 · see citing works
Freedberg, M., Schacherer, J., Chen, K., Uc, E. Y., Narayanan, N. S., & Hazeltine, E. (2017) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-017-0505-0 · Cited by 9 · see citing works
Visuomotor learning and unlearning in children and adolescents with tourette syndrome
Kim, S., Jackson, S. R., Groom, M. J., & Jackson, G. M. (2018) · Cortex · doi:10.1016/j.cortex.2018.08.007 · Cited by 9 · see citing works
Takács, Á., Tóth-Fáber, E., Schubert, L., Tárnok, Z., Ghorbani, F., Trelenberg, M., Németh, D., Münchau, A. M., & Beste, C. (2024) · Brain Communications · doi:10.1093/braincomms/fcae092 · Cited by 8 · see citing works
Emotion and reward are dissociable from error during motor learning
Festini, S. B., Preston, S. D., Reuter‐Lorenz, P. A., & Seidler, R. D. (2016) · Experimental Brain Research · doi:10.1007/s00221-015-4542-z · Cited by 7 · see citing works
Doppler, C. E. J., Meyer, L., Dovern, A., Stühmer-Beckh, J., Weiss, P. H., & Fink, G. R. (2019) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2019.00188 · Cited by 10 · see citing works
Pedroarena‐Leal, N., & Ruge, D. (2015) · Journal of Neuropsychology · doi:10.1111/jnp.12091 · Cited by 7 · see citing works
Akkermans, S. E. A., van Rooij, D., Naaijen, J., Forde, N. J., Boecker-Schlier, R., Openneer, T. J. C., Dietrich, A., Hoekstra, P. J., & Buitelaar, J. K. (2019) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2019.08.004 · Cited by 7 · see citing works
Incidental learning of rewarded associations bolsters learning on an associative task.
Freedberg, M., Schacherer, J., & Hazeltine, E. (2015) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000201 · Cited by 7 · see citing works
Genetic advances and translational phenotypes in rodent models for Tourette disorder
Kowalski, T. F., Wang, R., & Tischfield, M. A. (2025) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2024.102967 · Cited by 5 · see citing works
Gilles de la Tourette Syndrome
Kleimaker, M., Kleimaker, A., Beste, C., Park, S. Q., & Münchau, A. M. (2019) · Zeitschrift für Neuropsychologie · doi:10.1024/1016-264x/a000274 · Cited by 6 · see citing works
A Process-Oriented View of Procedural Memory Can Help Better Understand Tourette’s Syndrome
Farkas, B. C., Tóth-Fáber, E., Janacsek, K., & Németh, D. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.683885 · Cited by 5 · see citing works
The effects of haloperidol on motor vigour and movement fusion during sequential reaching
Sporn, S., & Galea, J. M. (2025) · PLoS ONE · doi:10.1371/journal.pone.0316894 · Cited by 4 · see citing works
Palminteri, S. (2025) · Mind & Society · doi:10.1007/s11299-025-00329-w · Cited by 4 · see citing works
Self-citationThe sooner the better: clinical and neural correlates of impulsive choice in Tourette disorder
Atkinson-Clément, C., de Liege, A., Klein-Koerkamp, Y., Béranger, B., Valabrègue, R., Delorme, C., Roze, E. F., Fernández-Egea, E., Hartmann, A., Robbins, T. W., et al. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01691-2 · Cited by 4 · see citing works
Self-citationDecision-making under risk and ambiguity in adults with Tourette syndrome
Atkinson-Clément, C., Lebreton, M. P., Patsalides, L., de Liege, A., Klein-Koerkamp, Y., Roze, E. F., Deniau, E., Hartmann, A., Palminteri, S., & Worbe, Y. (2022) · Psychological Medicine · doi:10.1017/s0033291722002318 · Cited by 4 · see citing works
Self-citationScholl, C., Baladron, J., Vitay, J., & Hamker, F. H. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.08.430235 · Cited by 3 · see citing works
Liu, L., Zhou, L.-A., & Sun, Y.-L. (2021) · PubMed Central · doi:10.1097/md.0000000000028190 · Cited by 2 · see citing works
Liu, X., Wang, X., Li, L., Wang, H., & Jiao, X. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062198 · Cited by 2 · see citing works
Shephard, E. (2014) · Nottingham ePrints (University of Nottingham) · Cited by 2 · see citing works
Reward-based improvements in motor sequence learning are differentially affected by dopaminePreprint
Sporn, S., & Galea, J. M. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.03.02.530811 · Cited by 2 · see citing works
The effect of dopamine D2 receptor blockade on human motor skill learningPreprint
Taylor, E. M., Curtin, D., Chong, T. T. ‐., Bellgrove, M. A., & Coxon, J. P. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.09.01.556003 · Cited by 2 · see citing works
The effect of reward and voluntary choice on the motor learning of serial reaction time task
Quan, Y., Wang, J., Wang, Y., & Kang, G. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1493434 · Cited by 1 · see citing works
The effect of dopamine D2-like receptor blockade on human motor performance and skill acquisition
Taylor, E. M., Curtin, D., Chong, T. T. ‐., Bellgrove, M. A., & Coxon, J. P. (2026) · Scientific Reports · doi:10.1038/s41598-026-36241-7 · Cited by 1 · see citing works
IRM dans les dystonies et dans le syndrome de Gilles de la Tourette
Vidailhet, M., & Lehéricy, S. (2013) · Bulletin de l Académie Nationale de Médecine · doi:10.1016/s0001-4079(19)31527-4 · Cited by 1 · see citing works
Self-citationTics und Tourette-Störung für die Praxis
Ganos, C., & Djodari-Irani, A. (2020) · Nervenheilkunde · doi:10.1055/a-1133-6915
Iansek, R., & Morris, M. E. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139012942.002
The Neuroanatomical Functions of Tourette Syndrome and a Treatment Analysis
Curd, K. L. (2012) · Scholarship @ Claremont (The Claremont Colleges)
Pathophysiology of basal ganglia disorders: neurophysiological investigations
Berardelli, A., & Suppa, A. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139012942.003
Examining the effects of reward and punishment on incidental learning
Freedberg, M., Hazeltine, E., Duff, M., McMurray, B., Voss, M., & Darling, W. (2016) · doi:10.17077/etd.b4zjzeio
Leren van motorische vaardigheden
van Cranenburgh, B. (2016) · Bohn Stafleu van Loghum eBooks · doi:10.1007/978-90-368-1372-3_7
The Basal Ganglia and Decision-Making in Neuropsychiatric Disorders
Tinaz, S., & Stern, C. E. (2016) · Innovations in cognitive neuroscience · doi:10.1007/978-3-319-42743-0_15
Specific effect of dopamine partial agonist on counterfactual learning: evidence
Salvador, A., Worbe, Y., Delorme, C., Coricelli, G., Robbins, T. W., Hartmann, A., & Palminteri, S. (2016)
Self-citationNeuropharmacological Interventions and Event File Coding in Gilles de la Tourette Syndrome
Takács, Á., Bluschke, A., Münchau, A. M., & Beste, C. (2019) · Zeitschrift für Neuropsychologie · doi:10.1024/1016-264x/a000270
Pathophysiologie des Gilles-de-la-Tourette-Syndroms
Kleimaker, M., Beste, C., Münchau, A. M., & Kleimaker, A. (2020) · Nervenheilkunde · doi:10.1055/a-1095-5146
Shephard, E., Jackson, G. M., & Groom, M. J. (2016) · International Journal of Developmental Neuroscience · doi:10.1016/j.ijdevneu.2016.04.006
Leren van motorische vaardigheden
van Cranenburgh, B. (2019) · Bohn Stafleu van Loghum eBooks · doi:10.1007/978-90-368-2318-0_6
Neuropsychological Assessment in Tourette Syndrome
Murphy, T. L., Czernecki, V., Tárnok, Z., & Stark, D. L. (2022) · Oxford University Press eBooks · doi:10.1093/med/9780197543214.003.0022
Bootes, K. R., & Himle, M. B. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91497-0.00222-8
Leren van motorische vaardigheden
van Cranenburgh, B. (2025) · doi:10.1007/978-90-368-3154-3_6
Sartoris, T.-M., Atkinson-Clément, C., Béranger, B., Tarrano, C., Jegatheesan, P., Lejeune, F., Valabrègue, R., Hartmann, A., Czernecki, V., Roze, E. F., et al. (2026) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2026.03.017
Self-citation
- Authors
- Palminteri, S., Lebreton, M., Worbe, Y., Hartmann, A., Lehéricy, S., Vidailhet, M., Grabli, D., & Pessiglione, M.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- ORCID
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-07-04
- Volume
- 134
- Issue
- 8
- Pages
- 2287-2301
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2007524113
- Cited by
- 90
- References
- 66
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 2 · 2023: 3 · 2022: 7 · 2021: 10 · 2020: 6 · 2019: 7 · 2018: 6 · 2017: 6 · 2016: 13 · 2015: 6 · 2014: 3 · 2013: 10 · 2012: 4
- FWCI
- 5.86
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Yale University
- Topics
- Social Sciences › Psychology › Clinical Psychology › Obsessive-Compulsive Spectrum Disorders
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- motor skill learning, reinforcement learning, dopamine, Tourette syndrome, reward prediction error, monetary rewards, actor-critic, antipsychotic drugs, focal dystonia, tics
- MeSH terms
- Adult, Analysis of Variance, Choice Behavior, Computer Simulation, Dopamine, Female, Tourette Syndrome, Humans, Learning, Male, Models, Psychological, Reaction Time, Reinforcement, Psychology, Motor Skills Disorders, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
