Establishing the Dopamine Dependency of Human Striatal Signals During Reward and Punishment Reversal Learning
The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
Drugs that alter dopamine transmission have opposite effects on reward and punishment learning. These opposite effects have been suggested to depend on dopamine in the striatum. Here, we establish for the first time the neurochemical specificity of such drug effects, during reward and punishment learning in humans, by adopting a coadministration design. Participants (N = 22) were scanned on 4 occasions using functional magnetic resonance imaging, following intake of placebo, bromocriptine (dopamine-receptor agonist), sulpiride (dopamine-receptor antagonist), or a combination of both drugs. A reversal-learning task was employed, in which both unexpected rewards and punishments signaled reversals. Drug effects were stratified with baseline working memory to take into account individual variations in drug response. Sulpiride induced parallel span-dependent changes on striatal blood oxygen level-dependent (BOLD) signal during unexpected rewards and punishments. These drug effects were found to be partially dopamine-dependent, as they were blocked by coadministration with bromocriptine. In contrast, sulpiride elicited opposite effects on behavioral measures of reward and punishment learning. Moreover, sulpiride-induced increases in striatal BOLD signal during both outcomes were associated with behavioral improvement in reward versus punishment learning. These results provide a strong support for current theories, suggesting that drug effects on reward and punishment learning are mediated via striatal dopamine.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In healthy humans, the D2 receptor antagonist sulpiride enhances reward-based reversal learning (van der Schaaf et al 2014), whereas a D2 receptor agonist bromocriptine impairs probabilistic reversal learning (Mehta et al 2001).”
From Prefrontal cortex executive processes affected by stress in health and disease (2018) · cites this paper as van der Schaaf et al 2014
Citations
Cites
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., Mazoyer, B., & Joliot, M. (2002) · NeuroImage · doi:10.1006/nimg.2001.0978 · Cited by 16,319
Statistical Methods for Psychology.
Gudgeon, A. C., & Howell, D. C. (1994) · The Statistician · doi:10.2307/2348956 · Cited by 8,278
Generalized autocalibrating partially parallel acquisitions (GRAPPA)
Griswold, M. A., Jakob, P. M., Heidemann, R. M., Nittka, M., Jellus, V., Wang, J., Kiefer, B., & Haase, A. (2002) · Magnetic Resonance in Medicine · doi:10.1002/mrm.10171 · Cited by 5,303
Region of interest analysis using an SPM toolbox
Brett, M. (2002) · NeuroImage · Cited by 2,273
The use of analogue scales in rating subjective feelings
BOND, A., & LADER, M. (1974) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1974.tb02285.x · Cited by 1,972
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Inverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive Control
Cools, R., & D'Esposito, M. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.03.028 · Cited by 1,673 · cited 2×
“Accordingly, given this baseline-dependency principle of drug efficacy (Cools and D’Esposito 2011), we stratified our drug effects with baseline working memory capacity to take into account putative individual differences in drug response.”
BackgroundMethodSelf-citationDopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
Handbook of Psychological Assessment
(2019) · Elsevier eBooks · doi:10.1016/c2014-0-01970-3 · Cited by 1,247
Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism
Frank, M. J., Samanta, J., Moustafa, A. A., & Sherman, S. J. (2007) · Science · doi:10.1126/science.1146157 · Cited by 1,120
A selective role for dopamine in stimulus-reward learning
Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., Akers, C. A., Clinton, S. M., Phillips, P. E. M., & Akil, H. (2011) · Nature · doi:10.1038/nature09588 · Cited by 1,026 · cited 1×
“Indeed, accumulating evidence indicates the sensitivity of Pavlovian control to dopamine manipulation (Dickinson et al. 2000; Wyvell and Berridge 2000; Flagel et al. 2011).”
BackgroundFrank, M. J. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929052880093 · Cited by 925
Handbook of Psychological Assessment
Groth‐Marnat, G., & Wright, A. J. (2016) · Wiley eBooks · doi:10.1002/9781394258918 · Cited by 769
Wyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764
Cognition in schizophrenia: core psychological and neural mechanisms
Barch, D. M., & Ceaser, A. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.015 · Cited by 747
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 683
From dopamine to salience to psychosis—Linking biology, pharmacology and phenomenology of psychosis
Kapur, S., Mizrahi, R., & Li, M. (2005) · Schizophrenia Research · doi:10.1016/j.schres.2005.01.003 · Cited by 512
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506
Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., Seidenbecher, C. I., Coenen, H. H., Heinze, H.-J., Zilles, K., et al. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2058-08.2008 · Cited by 496
Frank, M. J., & O'Reilly, R. C. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.3.497 · Cited by 472
Differential Encoding of Losses and Gains in the Human Striatum
Seymour, B., Daw, N., Dayan, P., Singer, T., & Dolan, R. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0400-07.2007 · Cited by 462
Principles of Neuropsychopharmacology
Feldman, R. S., Meyer, J. S., & Quenzer, L. F. (1997) · Cited by 444
Opponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439
Effects of bromocriptine on human subjects depend on working memory capacity
Kimberg, D. Y., DʼEsposito, M., & Farah, M. J. (1997) · Neuroreport · doi:10.1097/00001756-199711100-00032 · Cited by 413
Prolactin and dopamine: What is the connection? A Review Article
Fitzgerald, P., & Dinan, T. G. (2008) · Journal of Psychopharmacology · doi:10.1177/0269216307087148 · Cited by 383
Cools, R., Frank, M. J., Gibbs, S. E., Miyakawa, A., Jagust, W., & D'Esposito, M. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4467-08.2009 · Cited by 364
Self-citationBodi, N., Keri, S., Nagy, H., Moustafa, A., Myers, C. E., Daw, N., Dibo, G., Takats, A., Bereczki, D., & Gluck, M. A. (2009) · Brain · doi:10.1093/brain/awp094 · Cited by 363
Deleu, D., Northway, M. G., & Hanssens, Y. (2002) · Clinical Pharmacokinetics · doi:10.2165/00003088-200241040-00003 · Cited by 349
Linking nucleus accumbens dopamine and blood oxygenation
Knutson, B., & Gibbs, S. E. B. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0686-7 · Cited by 337
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
Dickinson, A., Smith, J., & Mirenowicz, J. (2000) · Behavioral Neuroscience · doi:10.1037//0735-7044.114.3.468 · Cited by 314
Human striatal response to salient nonrewarding stimuli
Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M., & Berns, G. S. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-22-08092.2003 · Cited by 312
Working Memory Capacity Predicts Dopamine Synthesis Capacity in the Human Striatum
Cools, R., Gibbs, S. E., Miyakawa, A., Jagust, W., & D'Esposito, M. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4475-07.2008 · Cited by 302 · cited 3×
“depend on working memory capacity (Frank and O’Reilly 2006; Cools 2011), presumably reflecting baseline dopamine synthesis capacity (Cools et al. 2008; Landau et al. 2009).”
BackgroundSelf-citationStriatal Dopamine and Working Memory
Landau, S. M., Lal, R., O'Neil, J. P., Baker, S., & Jagust, W. J. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn095 · Cited by 290
Reversal learning in Parkinson's disease depends on medication status and outcome valence
Cools, R., Altamirano, L., & D’Esposito, M. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.030 · Cited by 289
Self-citationL-DOPA Disrupts Activity in the Nucleus Accumbens during Reversal Learning in Parkinson's Disease
Cools, R., Lewis, S. J. G., Clark, L., Barker, R. A., & Robbins, T. W. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301153 · Cited by 289
Self-citationEffects of adult age on structural and operational capacities in working memory.
Salthouse, T. A., Babcock, R. L., & Shaw, R. J. (1991) · Psychology and Aging · doi:10.1037//0882-7974.6.1.118 · Cited by 285
Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors
Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez, H. H., Dolan, R. J., & Hallett, M. (2010) · Neuron · doi:10.1016/j.neuron.2009.12.027 · Cited by 280
Jocham, G., Klein, T. A., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3904-10.2011 · Cited by 278
Frank, M. J., Santamaria, A., O'Reilly, R. C., & Willcutt, E. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301278 · Cited by 227
Dopaminergic control of the striatum for high-level cognition
Cools, R. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.04.002 · Cited by 221
Self-citationFunctional imaging of the human dopaminergic midbrain
Düzel, E., Bunzeck, N., Guitart-Masip, M., Wittmann, B., Schott, B. H., & Tobler, P. N. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.02.005 · Cited by 216
Impulsive choice and response in dopamine agonist-related impulse control behaviors
Voon, V., Reynolds, B., Brezing, C., Gallea, C., Skaljic, M., Ekanayake, V., Fernandez, H., Potenza, M. N., Dolan, R. J., & Hallett, M. (2010) · Psychopharmacology · doi:10.1007/s00213-009-1697-y · Cited by 208
Mehta, M. A., Manes, F. F., Magnolfi, G., Sahakian, B. J., & Robbins, T. W. (2004) · Psychopharmacology · doi:10.1007/s00213-004-1899-2 · Cited by 196
Neurogenetics and Pharmacology of Learning, Motivation, and Cognition
Frank, M. J., & Fossella, J. A. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.96 · Cited by 192
Separate brain regions code for salience vs. valence during reward prediction in humans
Jensen, J., Smith, A. J., Willeit, M., Crawley, A. P., Mikulis, D. J., Vitcu, I., & Kapur, S. (2007) · Human Brain Mapping · doi:10.1002/hbm.20274 · Cited by 178
A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism
Moustafa, A. A., Cohen, M. X., Sherman, S. J., & Frank, M. J. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.3116-08.2008 · Cited by 170
Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes
Palminteri, S., Lebreton, M. P., Worbe, Y., Grabli, D., Hartmann, A., & Pessiglione, M. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0904035106 · Cited by 164
Genetic contributions to avoidance-based decisions: striatal D2 receptor polymorphisms
Frank, M. J., & Hutchison, K. E. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.04.048 · Cited by 164
Santesso, D. L., Evins, A. E., Frank, M. J., Schetter, E. C., Bogdan, R., & Pizzagalli, D. A. (2008) · Human Brain Mapping · doi:10.1002/hbm.20642 · Cited by 158
Human cognitive flexibility depends on dopamine D2 receptor signaling
van Holstein, M., Aarts, E., van der Schaaf, M. E., Geurts, D. E. M., Verkes, R. J., Franke, B., van Schouwenburg, M. R., & Cools, R. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2340-2 · Cited by 151
Self-citationPerceptuo-Motor Interactions during Prehension Movements
Verhagen, L., Dijkerman, H. C., Grol, M. J., & Toni, I. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.0057-08.2008 · Cited by 129
Human Medial Orbitofrontal Cortex Is Recruited During Experience of Imagined and Real Rewards
Bray, S., Shimojo, S., & O’Doherty, J. P. (2010) · Journal of Neurophysiology · doi:10.1152/jn.01030.2009 · Cited by 113
Dodds, C. M., Muller, U., Clark, L., van Loon, A., Cools, R., & Robbins, T. W. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1153-08.2008 · Cited by 113
Self-citationDissociable responses to punishment in distinct striatal regions during reversal learning
Robinson, O. J., Frank, M. J., Sahakian, B. J., & Cools, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.03.036 · Cited by 88
Self-citationDodds, C., Clark, L., Dove, A., Regenthal, R., Baumann, F., Bullmore, E. T., Robbins, T. W., & Müller, U. (2009) · Psychopharmacology · doi:10.1007/s00213-009-1634-0 · Cited by 73
Mehta, M. A., Montgomery, A. J., Kitamura, Y., & Grasby, P. M. (2007) · Psychopharmacology · doi:10.1007/s00213-007-0947-0 · Cited by 71
van der Schaaf, M. E., Warmerdam, E., Crone, E. A., & Cools, R. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.06.007 · Cited by 70
Self-citationThe Wechsler intelligence scales
Groth‐Marnat, G. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511526794.003 · Cited by 65
Mehta, M. A., McGowan, S., Lawrence, A. D., Aitken, M. R. F., Montgomery, A. J., & Grasby, P. M. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.08.007 · Cited by 65
Ott, D. V. M., Ullsperger, M., Jocham, G., Neumann, J., & Klein, T. A. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.04.038 · Cited by 57
From Real-World Events to Psychosis: The Emerging Neuropharmacology of Delusions
Morrison, P. D., & Murray, R. M. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp049 · Cited by 57
BOLD responses in reward regions to hypothetical and imaginary monetary rewards
Miyapuram, K. P., Tobler, P. N., Gregorios-Pippas, L., & Schultz, W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.029 · Cited by 49
Cited by
Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development?
Eckstein, M. K., Guerra-Carrillo, B., Miller Singley, A. T., & Bunge, S. A. (2017) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2016.11.001 · Cited by 686
Ashok, A. H., Marques, T. R., Jauhar, S., Nour, M. M., Goodwin, G. M., Young, A. H., & Howes, O. D. (2017) · Molecular Psychiatry · doi:10.1038/mp.2017.16 · Cited by 546
Dopamine promotes cognitive effort by biasing the benefits versus costs of cognitive work
Westbrook, A., van den Bosch, R., Määttä, J. I., Hofmans, L., Papadopetraki, D., Cools, R., & Frank, M. J. (2020) · Science · doi:10.1126/science.aaz5891 · Cited by 356
Self-citationDopaminergic control of cognitive flexibility in humans and animals
Klanker, M., Feenstra, M., & Denys, D. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00201 · Cited by 209
A universal role of the ventral striatum in reward-based learning: Evidence from human studies
Daniel, R., & Pollmann, S. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.002 · Cited by 208
Metadata
- Authors
- van der Schaaf, M. E., van Schouwenburg, M. R., Geurts, D. E. M., Schellekens, A. F. A., Buitelaar, J. K., Verkes, R. J., & Cools, R.
- Affiliations
- Radboud University Nijmegen (NL)
- Radboud University Medical Center (NL)
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-11-25
- Volume
- 24
- Issue
- 3
- Pages
- 633-642
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2114983327
- Cited by
- 102
- References
- 64
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 6 · 2023: 4 · 2022: 9 · 2021: 6 · 2020: 7 · 2019: 10 · 2018: 6 · 2017: 13 · 2016: 10 · 2015: 8 · 2014: 6 · 2013: 6
- FWCI
- 2.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Keywords
- dopamine, striatum, reward learning, punishment learning, reversal learning, sulpiride, bromocriptine, dopamine antagonists, dopamine agonists, working memory, drug effects on learning
- MeSH terms
- Adult, Blood Pressure, Bromocriptine, Corpus Striatum, Double-Blind Method, Female, Humans, Image Processing, Computer-Assisted, Male, Memory, Short-Term, Neuropsychological Tests, Oxygen, Photic Stimulation, Punishment, Reversal Learning, Reward, Sulpiride, Dopamine Agents, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.