Decomposing effects of dopaminergic medication in Parkinson’s disease on probabilistic action selection – learning or performance?
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Dopamine has long been implicated in reward‐based learning and the expression of such learned associations on performance. Robust evidence supports its effects on learning and performance, but teasing these apart has proved challenging. Here we have adapted a classic test of value‐based learning, the probabilistic selection task, to disentangle effects of dopamine on value‐based performance from effects on value‐based learning. Valence‐specific effects of dopamine on this specific task cannot be accounted for by modulation of learning, and therefore must reflect modulation of performance. We found that dopaminergic medication, consisting of levodopa and/or dopamine agonists taken at own dose, in 18 patients with mild Parkinson’s disease (Hoehn and Yahr < 2.5) potentiated reward‐based approach in terms of both accuracy and reaction times, while leaving punishment‐based avoidance unaffected. These data demonstrate that the effects of dopamine on probabilistic action selection are at least partly mediated by effects on the expression of learned associations rather than on learning itself, and help refine current models of dopamine’s role in reward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
The FAB: A frontal assessment battery at bedside
Dubois, B., Slachevsky, A., Litvan, I., & Pillon, B. (2000) · Neurology · doi:10.1212/wnl.55.11.1621 · Cited by 3,913
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 1×
“This hypothesis concurs with a general behavioral activational account that assigns both a performance-based energetic component as well as reinforcement-related functions to dopamine (Robbins & Everitt, 1982, 1992, 2007; Wise, 2004).”
BackgroundDaw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 3×
“The predominant view in computational and systems neuroscience is that dopamine serves to promote reinforcement learning, i.e. trial-anderror instrumental learning to choose rewarding actions (Houk & Wise, 1995; Montague et al., 1996; Schultz et al., 1997; Samejima et al., 2005; Paton et al., 2006).”
BackgroundBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 2×
“…of primates quantitatively resembles a ‘reward prediction error’ signal used in computational algorithms for reinforcement learning (Ljungberg et al., 1992; Montague et al., 1996, 2004; Hollerman & Schultz, 1998; Sutton & Barto, 1998; Waelti et al., 2001; Bayer & Glimcher, 2005; Frank, 2005).”
BackgroundPhasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Tsai, H.-C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., & Deisseroth, K. (2009) · Science · doi:10.1126/science.1168878 · Cited by 1,266 · cited 1×
“Indeed, extensive evidence from controlled manipulations of dopamine implicate it in learning (e.g. Tsai et al., 2009; for a review see Maia & Frank, 2011).”
BackgroundTonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 1×
“…speeding and choice concurs with renewed interest in the last decade in dopamine’s role in motivation, vigor and effort, and more generally behavioral activation (Berridge & Robinson, 1998; Satoh et al., 2003; Robinson et al., 2005; Salamone et al., 2005; Niv et al., 2006, 2007; Berridge, 2007).”
BackgroundDopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · cited 1×
“…of primates quantitatively resembles a ‘reward prediction error’ signal used in computational algorithms for reinforcement learning (Ljungberg et al., 1992; Montague et al., 1996, 2004; Hollerman & Schultz, 1998; Sutton & Barto, 1998; Waelti et al., 2001; Bayer & Glimcher, 2005; Frank, 2005).”
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917 · cited 2×
“The predominant view in computational and systems neuroscience is that dopamine serves to promote reinforcement learning, i.e. trial-anderror instrumental learning to choose rewarding actions (Houk & Wise, 1995; Montague et al., 1996; Schultz et al., 1997; Samejima et al., 2005; Paton et al., 2006).”
BackgroundCools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906 · cited 2×
“…that the nucleus accumbens mediates this effect of medication on reward-based performance also concurs with the dopamine overdose hypothesis (Cools et al., 2001; Cools, 2006), which predicts that the medication-induced potentiation of control by reward is beyond normal; indeed, patients…”
ResultSelf-citationCools, R. (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.024 · Cited by 903
Self-citationWyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764
Serotonin and dopamine: unifying affective, activational, and decision functions.
Cools, R., Nakamura, K., & Daw, N. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.121 · Cited by 464
Self-citationLimbic-striatal interactions in reward-related processes
Robbins, T. W., Cador, M., Taylor, J. R., & Everitt, B. J. (1989) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(89)80025-9 · Cited by 458
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298
Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors
Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez, H. H., Dolan, R. J., & Hallett, M. (2010) · Neuron · doi:10.1016/j.neuron.2009.12.027 · Cited by 280
Jocham, G., Klein, T. A., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3904-10.2011 · Cited by 278
A normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251
Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards
Robinson, S., Sandstrom, S. M., Denenberg, V. H., & Palmiter, R. D. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.1.5 · Cited by 247
Cited by
Berridge, K. C., & Kringelbach, M. L. (2015) · Neuron · doi:10.1016/j.neuron.2015.02.018 · Cited by 1,730
“…evidence that stimulation of dopamine does not reliably act as a causal teaching signal to establish new memories (Berridge and Robinson, 1998; Eisenegger et al., 2014; Flagel et al., 2011; Robinson et al., 2005; Saunders and Robinson, 2012; Shiner et al., 2012; Smittenaar et al., 2012).”
BackgroundNeurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
Decision Making and Sequential Sampling from Memory
Shadlen, M. N., & Shohamy, D. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.036 · Cited by 418
Collins, A. G. E., & Frank, M. J. (2014) · Psychological Review · doi:10.1037/a0037015 · Cited by 403
An integrative perspective on the role of dopamine in schizophrenia
Maia, T. V., & Frank, M. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.05.021 · Cited by 293
“Dopaminergic manipulations during choice, in ways that could not have affected learning, show that increasing dopamine increases the weighting of positive relative to negative values, confirming an effect on performance (43,44).”
Metadata
- Authors
- Smittenaar, P., Chase, H. W., Aarts, E., Nusselein, B., Bloem, B. R., & Cools, R.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2012-04
- Volume
- 35
- Issue
- 7
- Pages
- 1144-1151
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2109043410
- Cited by
- 73
- References
- 27
- FWCI
- 3.00
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.