Single dose of a dopamine agonist impairs reinforcement learning in humans: Evidence from event‐related potentials and computational modeling of striatal‐cortical function
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Animal findings have highlighted the modulatory role of phasic dopamine (DA) signaling in incentive learning, particularly in the acquisition of reward‐related behavior. In humans, these processes remain largely unknown. In a recent study, we demonstrated that a single low dose of a D2/D3 agonist (pramipexole)—assumed to activate DA autoreceptors and thus reduce phasic DA bursts—impaired reward learning in healthy subjects performing a probabilistic reward task. The purpose of this study was to extend these behavioral findings using event‐related potentials and computational modeling. Compared with the placebo group, participants receiving pramipexole showed increased feedback‐related negativity to probabilistic rewards and decreased activation in dorsal anterior cingulate regions previously implicated in integrating reinforcement history over time. Additionally, findings of blunted reward learning in participants receiving pramipexole were simulated by reduced presynaptic DA signaling in response to reward in a neural network model of striatal‐cortical function. These preliminary findings offer important insights on the role of phasic DA signals on reinforcement learning in humans and provide initial evidence regarding the spatiotemporal dynamics of brain mechanisms underlying these processes. Hum Brain Mapp, 2009. © 2008 Wiley‐Liss, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 2×
“…studies, medial PFC regions spanning into the rostral ACC (i.e., Brodmann areas 10/32) have been implicated in response to immediate, but not delayed, reward [Knutson et al., 2003; McClure et al., 2004] and has been found to track the value of reward [Daw et al., 2006; Marsh et al., 2007].”
BackgroundGetting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 6×
“Taken together, results from recent ERP studies indicate that positive prediction errors can affect the FRN (specifically, reduce its negativity); more generally, these findings are consistent with the account that unpredicted rewards, supported by phasic DA increases [Fiorillo et al., 2003; Schultz, 2007], also serve…”
BackgroundResultInfluentialA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 4×
“Accordingly, when a positiveprediction error occurs, learning about the consequences of the behavior that led to reward takes place; when a negative prediction error occurs, behaviors that led to lack of reward is extinguished ([Bayer and Glimacher, 2005; Garris et al., 1999; Montague et al., 1996; Schultz et al., 199…”
BackgroundInfluentialBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Self-citationThe neural basis of error detection: Conflict monitoring and the error-related negativity
Yeung, N., Botvinick, M. M., & Cohen, J. D. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.931 · Cited by 1,924
The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses
Gehring, W. J., & Willoughby, A. R. (2002) · Science · doi:10.1126/science.1066893 · Cited by 1,884 · cited 3×
“Initial observations that the FRN is increased by negative feedback or when outcomes are worse than expected led to the assumption that the FRN reflects a reward prediction error signal [Gehring and Willoughby, 2002; Holroyd and Coles, 2002; Miltner et al., 1997].”
BackgroundMiltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.6.788 · Cited by 1,530
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Schultz, W. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.007 · Cited by 1,028
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · cited 6×
“VC 2008 Wiley-Liss, Inc.”
BackgroundResultInfluentialIndependent Coding of Reward Magnitude and Valence in the Human Brain
Yeung, N., & Sanfey, A. G. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.4537-03.2004 · Cited by 933 · cited 2×
“, 2005], gambling [Yeung and Sanfey, 2004; Donkers et al., 2005], and time estimation [Nieuwenhuis et al.”
BackgroundA cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · cited 2×
“A large body of animal data has emphasized the modulatory role of reward-related DA signaling in incentive learning, particularly in the acquisition of reward-related behavior [Garris et al., 1999; Reynolds et al., 2001] and expectation of reward [Fiorillo et al.”
BackgroundToward an objective characterization of an anhedonic phenotype: A signal-detection approach
Pizzagalli, D. A., Jahn, A. L., & O’Shea, J. P. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.11.026 · Cited by 738
Self-citationEndocannabinoid-mediated rescue of striatal LTD and motor deficits in Parkinson's disease models
Kreitzer, A. C., & Malenka, R. C. (2007) · Nature · doi:10.1038/nature05506 · Cited by 735 · cited 2×
“A total adverse effect score was obtained by subtracting the preadministration score from the maximal adverse effect score (see [Pizzagalli et al., 2008] for more detail).”
MethodResultHold your horses: a dynamic computational role for the subthalamic nucleus in decision making
Frank, M. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.006 · Cited by 706 · cited 1×
“The core network parameters were left unchanged to maintain consistency with prior work, but simulations were conducted with a more recent model that includes the subthalamic nucleus [Frank, 2006].”
MethodSelf-citationPizzagalli, D., Pascual-Marqui, R. D., Nitschke, J. B., Oakes, T. R., Larson, C. L., Abercrombie, H. C., Schaefer, S. M., Koger, J. V., Benca, R. M., & Davidson, R. J. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.3.405 · Cited by 630 · cited 2×
“005 and displayed on a standard MRI template [Pizzagalli et al., 2001].”
MethodInfluentialSelf-citationNieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. H. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.05.003 · Cited by 557 · cited 1×
“Third, according to Nieuwenhuis et al. [2005], activity from regions associated with positive and negative feedback create a baseline negativity (or ERP deflection).”
Choice selection and reward anticipation: an fMRI study
Ernst, M., Nelson, E. E., McClure, E. B., Monk, C. S., Munson, S., Eshel, N., Zarahn, E., Leibenluft, E., Zametkin, A., Towbin, K., et al. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.05.011 · Cited by 377
Functional organization of the medial frontal cortex
Rushworth, M. F., Buckley, M. J., Behrens, T. E., Walton, M. E., & Bannerman, D. M. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.03.001 · Cited by 353
Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation
Garris, P. A., Kilpatrick, M., Bunin, M. A., Michael, D., Walker, Q. D., & Wightman, R. M. (1999) · Nature · doi:10.1038/18019 · Cited by 327 · cited 3×
“Accordingly, when a positiveprediction error occurs, learning about the consequences of the behavior that led to reward takes place; when a negative prediction error occurs, behaviors that led to lack of reward is extinguished ([Bayer and Glimacher, 2005; Garris et al., 1999; Montague et al., 1996; Schultz et al., 199…”
BackgroundDrug-induced stimulation and suppression of action monitoring in healthy volunteers
de Bruijn, E. R. A., Hulstijn, W., Verkes, R. J., Ruigt, G. S. F., & Sabbe, B. G. C. (2004) · Psychopharmacology · doi:10.1007/s00213-004-1915-6 · Cited by 282 · cited 2×
“Follow-up t-tests indicated that the pramipexole group had larger (i.e., more negative) FRNs compared with the placebo group at Fz (t18 5 3.37, P 5 0.003) and FCz (t18 5 2.19, P 5 0.042) only (see Table I).”
BackgroundResultInfluentialPizzagalli, D. A., Evins, A. E., Schetter, E. C., Frank, M. J., Pajtas, P. E., Santesso, D. L., & Culhane, M. (2008) · Psychopharmacology · doi:10.1007/s00213-007-0957-y · Cited by 219
Self-citationAbler, B., Erk, S., & Walter, H. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0690-y · Cited by 118 · cited 2×
“…findings showing that (1) administration of a DA antagonist decreased BOLD signal in the dACC during the anticipation of a potential reward [Abler et al., 2007] and increased mPFC activation compared with both amphetamine and placebo administration [Menon et al., 2007]; and (2)…”
BackgroundResultSteady‐State Pharmacokinetic Properties of Pramipexole in Healthy Volunteers
Wright, C. E., Sisson, T. L., Ichhpurani, A. K., & Peters, G. R. (1997) · The Journal of Clinical Pharmacology · doi:10.1002/j.1552-4604.1997.tb04330.x · Cited by 117
Vollenweider, F. X., Maguire, R. P., Leenders, K. L., Mathys, K., & Angst, J. (1998) · Psychiatry Research: Neuroimaging · doi:10.1016/s0925-4927(98)00033-x · Cited by 83 · cited 2×
“…with both amphetamine and placebo administration [Menon et al., 2007]; and (2) administration of DA-enhancing drugs (amphetamine, cocaine) increased cerebral blood flow [Jenkins et al., 2004], glucose metabolism [Vollenweider et al., 1998] and BOLD signal [Breiter et al., 1997] in the dACC.”
BackgroundAkitsuki, Y., Sugiura, M., Watanabe, J., Yamashita, K., Sassa, Y., Awata, S., Matsuoka, H., Maeda, Y., Matsue, Y., Fukuda, H., et al. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00250-7 · Cited by 70
Cited by
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
Walsh, M. M., & Anderson, J. R. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.05.008 · Cited by 544
Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480
“With both drugs, it has been postulated that this may be due to activation of inhibitory [76] presynaptic D2 receptors, which have a higher affinity for DA [77] and reduce phasic DA release ( [78–82]; see also [56]) and DA cell firing [83].”
BackgroundSelf-citationFrank, M. J., Doll, B. B., Oas-Terpstra, J., & Moreno, F. (2009) · Nature Neuroscience · doi:10.1038/nn.2342 · Cited by 471
Self-citationReduced Reward Learning Predicts Outcome in Major Depressive Disorder
Vrieze, E., Pizzagalli, D. A., Demyttenaere, K., Hompes, T., Sienaert, P., de Boer, P., Schmidt, M., & Claes, S. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.10.014 · Cited by 441
Self-citation
Metadata
- Authors
- Santesso, D. L., Evins, A. E., Frank, M. J., Schetter, E. C., Bogdan, R., & Pizzagalli, D. A.
- Venue
- Human Brain Mapping
- Publisher
- Wiley
- Published
- 2008-08-22
- Volume
- 30
- Issue
- 7
- Pages
- 1963-1976
- ISSN
- 1065-9471 (ISSN-L)
- 1097-0193
- OpenAlex
- W2126311844
- Cited by
- 141
- References
- 28
- FWCI
- 3.50
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.