Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Theories of instrumental learning aim to elucidate the mechanisms that integrate success and failure to improve future decisions. One computational solution consists of updating the value of choices in proportion to reward prediction errors, which are potentially encoded in dopamine signals. Accordingly, drugs that modulate dopamine transmission were shown to impact instrumental learning performance. However, whether these drugs act on conscious or subconscious learning processes remains unclear. To address this issue, we examined the effects of dopamine-related medications in a subliminal instrumental learning paradigm. To assess generality of dopamine implication, we tested both dopamine enhancers in Parkinson's disease (PD) and dopamine blockers in Tourette's syndrome (TS). During the task, patients had to learn from monetary outcomes the expected value of a risky choice. The different outcomes (rewards and punishments) were announced by visual cues, which were masked such that patients could not consciously perceive them. Boosting dopamine transmission in PD patients improved reward learning but worsened punishment avoidance. Conversely, blocking dopamine transmission in TS patients favored punishment avoidance but impaired reward seeking. These results thus extend previous findings in PD to subliminal situations and to another pathological condition, TS. More generally, they suggest that pharmacological manipulation of dopamine transmission can subconsciously drive us to either get more rewards or avoid more punishments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conscious, preconscious, and subliminal processing: a testable taxonomy
Dehaene, S., Changeux, J.-P., Naccache, L., Sackur, J., & Sergent, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.03.007 · Cited by 2,067
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Conscious and unconscious emotional learning in the human amygdala
Morris, J. S., Öhman, A., & Dolan, R. J. (1998) · Nature · doi:10.1038/30976 · Cited by 1,665
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Self-citationDopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · cited 2×
“Neuropsychopharmacology 33(6):1239–1251.”
BackgroundFrank, M. J. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929052880093 · Cited by 925
Levels of processing during non-conscious perception: a critical review of visual masking
Kouider, S., & Dehaene, S. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2093 · Cited by 835
Recent advances in Tourette syndrome research
Albin, R. L., & Mink, J. W. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.01.001 · Cited by 478
Rewards evoke learning of unconsciously processed visual stimuli in adult humans
Seitz, A. R., Kim, D., & Watanabe, T. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.016 · Cited by 337
Cited by
From reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 722
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
How prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512
“Systemic manipulations of dopamine levels in patients and healthy subjects show opposite effects on rewardand punishment-based learning (Frank et al., 2004; Moustafa et al., 2008; Cools et al., 2009; Palminteri et al., 2009).”
BackgroundA computational model of inhibitory control in frontal cortex and basal ganglia.
Wiecki, T. V., & Frank, M. J. (2013) · Psychological Review · doi:10.1037/a0031542 · Cited by 404
Frank, M. J., & Badre, D. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr114 · Cited by 337
An integrative perspective on the role of dopamine in schizophrenia
Maia, T. V., & Frank, M. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.05.021 · Cited by 293
Computational psychiatry: towards a mathematically informed understanding of mental illness
Adams, R. A., Huys, Q. J. M., & Roiser, J. P. (2015) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2015-310737 · Cited by 285
Cognitive deficits in Parkinson's disease: A cognitive neuroscience perspective
Robbins, T. W., & Cools, R. (2014) · Movement Disorders · doi:10.1002/mds.25853 · Cited by 235
The functional anatomy of Gilles de la Tourette syndrome
Ganos, C., Roessner, V., & Münchau, A. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.11.004 · Cited by 240
“In addition, both habit- and tic-formation involve reinforcement learning through phasic dopamine transmission (Palminteri et al., 2009; Yin and Knowlton, 2006).”
BackgroundStrauss, G. P., Frank, M. J., Waltz, J. A., Kasanova, Z., Herbener, E. S., & Gold, J. M. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.10.015 · Cited by 233
“[27]) and recent demonstration that D2 blockade enhances NoGo learning in Tourette’s syndrome patients (16).”
BackgroundDopaminergic Genes Predict Individual Differences in Susceptibility to Confirmation Bias
Doll, B. B., Hutchison, K. E., & Frank, M. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6486-10.2011 · Cited by 184
Enhanced habit formation in Gilles de la Tourette syndrome
Delorme, C., Salvador, A., Valabrègue, R., Roze, E., Palminteri, S., Vidailhet, M., de Wit, S., Robbins, T., Hartmann, A., & Worbe, Y. (2016) · Brain · doi:10.1093/brain/awv307 · Cited by 154
Self-citationRole of Dopamine D2 Receptors in Human Reinforcement Learning
Eisenegger, C., Naef, M., Linssen, A., Clark, L., Gandamaneni, P. K., Müller, U., & Robbins, T. W. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.84 · Cited by 134
van der Schaaf, M. E., van Schouwenburg, M. R., Geurts, D. E. M., Schellekens, A. F. A., Buitelaar, J. K., Verkes, R. J., & Cools, R. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs344 · Cited by 102
Palminteri, S., Lebreton, M., Worbe, Y., Hartmann, A., Lehéricy, S., Vidailhet, M., Grabli, D., & Pessiglione, M. (2011) · Brain · doi:10.1093/brain/awr147 · Cited by 90
Self-citationMind matters: placebo enhances reward learning in Parkinson's disease
Schmidt, L., Braun, E. K., Wager, T. D., & Shohamy, D. (2014) · Nature Neuroscience · doi:10.1038/nn.3842 · Cited by 84
Valence-dependent influence of serotonin depletion on model-based choice strategy
Worbe, Y., Palminteri, S., Savulich, G., Daw, N. D., Fernandez-Egea, E., Robbins, T. W., & Voon, V (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.46 · Cited by 75
Self-citationPalminteri, S., Clair, A.-H., Mallet, L., & Pessiglione, M. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.12.028 · Cited by 60
Self-citationSerotonin modulates asymmetric learning from reward and punishment in healthy human volunteers
Michely, J., Eldar, E., Erdman, A., Martin, I. M., & Dolan, R. J. (2022) · Communications Biology · doi:10.1038/s42003-022-03690-5 · Cited by 43
Heym, N., Kantini, E., Checkley, H. L. R., & Cassaday, H. J. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.01.012 · Cited by 13
Metadata
- Authors
- Palminteri, S., Lebreton, M., Worbe, Y., Grabli, D., Hartmann, A., & Pessiglione, M.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2009-11-10
- Volume
- 106
- Issue
- 45
- Pages
- 19179-19184
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2008565771
- Cited by
- 154
- References
- 12
- FWCI
- 3.64
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.