Striatal Dopamine Predicts Outcome-Specific Reversal Learning and Its Sensitivity to Dopaminergic Drug Administration
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Individual variability in reward-based learning has been ascribed to quantitative variation in baseline levels of striatal dopamine. However, direct evidence for this pervasive hypothesis has hitherto been unavailable. We demonstrate that individual differences in reward-based reversal learning reflect variation in baseline striatal dopamine synthesis capacity, as measured with neurochemical positron emission tomography. Subjects with high baseline dopamine synthesis in the striatum showed relatively better reversal learning from unexpected rewards than from unexpected punishments, whereas subjects with low baseline dopamine synthesis in the striatum showed the reverse pattern. In addition, baseline dopamine synthesis predicted the direction of dopaminergic drug effects. The D 2 receptor agonist bromocriptine improved reward-based relative to punishment-based reversal learning in subjects with low baseline dopamine synthesis capacity, while impairing it in subjects with high baseline dopamine synthesis capacity in the striatum. Finally, this pattern of drug effects was outcome-specific, and driven primarily by drug effects on punishment-, but not reward-based reversal learning. These data demonstrate that the effects of D 2 receptor stimulation on reversal learning in humans depend on task demands and baseline striatal dopamine synthesis capacity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“A putative mechanism of the prediction error signal for reward is the phasic firing of dopamine neurons in the midbrain (Montague et al., 1996; Schultz et al., 1997).”
BackgroundTalairach, J., Tournoux, P., & Rayport, M. (1988) · Thieme eBooks · Cited by 5,058
Graphical Evaluation of Blood-to-Brain Transfer Constants from Multiple-Time Uptake Data
Patlak, C. S., Blasberg, R. G., & Fenstermacher, J. D. (1983) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1983.1 · Cited by 3,567
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 1×
“A putative mechanism of the prediction error signal for reward is the phasic firing of dopamine neurons in the midbrain (Montague et al., 1996; Schultz et al., 1997).”
BackgroundSimplified Reference Tissue Model for PET Receptor Studies
Lammertsma, A. A., & Hume, S. P. (1996) · NeuroImage · doi:10.1006/nimg.1996.0066 · Cited by 2,021
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Self-citationPatlak, C. S., & Blasberg, R. G. (1985) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1985.87 · Cited by 1,673
Modulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593 · cited 1×
“Evidence from studies with experimental animals (Williams and Goldman-Rakic, 1995; Zahrt et al., 1997; Arnsten, 1998) has revealed an “inverted U”-shaped relationship between D1 receptor stimulation in the prefrontal cortex and cognitive performance.”
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,117
Frank, M. J. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929052880093 · Cited by 925
Self-citationCools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906 · cited 1×
“Although the rapid updating required in the current task, on which subjects expressed high learning rates, is different from the slower types of incremental probabilistic learning (Cools et al., 2001; Frank et al., 2004), which require the integration of outcomes across more distant histories, we hypothesize that simi…”
BackgroundSelf-citationZahrt, J., Taylor, J. R., Mathew, R. G., & Arnsten, A. F. T. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-21-08528.1997 · Cited by 796 · cited 1×
“Evidence from studies with experimental animals (Williams and Goldman-Rakic, 1995; Zahrt et al., 1997; Arnsten, 1998) has revealed an “inverted U”-shaped relationship between D1 receptor stimulation in the prefrontal cortex and cognitive performance.”
(1998) · PubMed · doi:10.1176/ajp.155.3.344 · Cited by 784
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 683
Self-citationCatecholamine modulation of prefrontal cortical cognitive function
Arnsten, A. F. T. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01240-6 · Cited by 604
Skirboll, L. R., Grace, A. A., & Bunney, B. S. (1979) · Science · doi:10.1126/science.482929 · Cited by 501
Frank, M. J., & O'Reilly, R. C. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.3.497 · Cited by 472
Self-citationEffects of bromocriptine on human subjects depend on working memory capacity
Kimberg, D. Y., DʼEsposito, M., & Farah, M. J. (1997) · Neuroreport · doi:10.1097/00001756-199711100-00032 · Cited by 413
Self-citationSchönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Working Memory Capacity Predicts Dopamine Synthesis Capacity in the Human Striatum
Cools, R., Gibbs, S. E., Miyakawa, A., Jagust, W., & D'Esposito, M. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4475-07.2008 · Cited by 302 · cited 6×
“However, there was no relationship between dopamine synthesis capacity and trait impulsivity, as reported in our previous report on the PET data from these subjects (Cools et al., 2008b) (all Pearson correlations 0.1).”
BackgroundMethodResultInfluentialSelf-citationReversal learning in Parkinson's disease depends on medication status and outcome valence
Cools, R., Altamirano, L., & D’Esposito, M. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.030 · Cited by 289
Self-citationCools, R., Sheridan, M., Jacobs, E., & D'Esposito, M. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0601-07.2007 · Cited by 277
Self-citationFacilitation of Working Memory in Humans by a D2 Dopamine Receptor Agonist
Luciana, M., Depue, R. A., Arbisi, P., & Leon, A. (1992) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1992.4.1.58 · Cited by 271
Chemistry of the adaptive mind
Cools, R., & Robbins, T. W. (2004) · Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2004.1468 · Cited by 257
Self-citationPhillips, A. G., Ahn, S., & Floresco, S. B. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.4653-03.2004 · Cited by 231
Frank, M. J., Santamaria, A., O'Reilly, R. C., & Willcutt, E. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301278 · Cited by 227 · cited 2×
“Specifically, to establish whether the here described effects reflect a modulation of learning or switching, we applied computational reinforcement learning algorithms to fit individual subjects’ trialby-trial sequence of choices (Sutton and Barto, 1998; Frank et al., 2007b).”
BackgroundMethodPizzagalli, D. A., Evins, A. E., Schetter, E. C., Frank, M. J., Pajtas, P. E., Santesso, D. L., & Culhane, M. (2008) · Psychopharmacology · doi:10.1007/s00213-007-0957-y · Cited by 219 · cited 2×
“, 2007) and rewardbased learning is modulated by agonists of D2/D3 receptors that are abundant in the striatum (Frank and O’Reilly, 2006; Pizzagalli et al., 2008).”
BackgroundSelf-citationCools, R., Robinson, O. J., & Sahakian, B. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301598 · Cited by 172 · cited 6×
“However, there was no relationship between dopamine synthesis capacity and trait impulsivity, as reported in our previous report on the PET data from these subjects (Cools et al., 2008b) (all Pearson correlations 0.1).”
BackgroundMethodResultInfluentialSelf-citationDopaminergic Modulation of Working Memory for Spatial but Not Object Cues in Normal Humans
Luciana, M., & Collins, P. F. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.3.330 · Cited by 168
Gibbs, S. E. B., & D'Esposito, M. (2005) · Psychopharmacology · doi:10.1007/s00213-005-0077-5 · Cited by 88
Self-citationDopamine gene predicts the brain's response to dopaminergic drug
Cohen, M. X., Krohn‐Grimberghe, A., Elger, C. E., & Weber, B. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05947.x · Cited by 83
Reproducibility of fluorine-18-6-fluorodopa positron emission tomography in normal human subjects.
Vingerhoets, F. J. G., Snow, B. J., Schulzer, M., Morrison, S., Ruth, T. J., Holden, J. E., Cooper, S. D., & Calne, D. B. (1994) · PubMed · Cited by 73
Synthesis of 6-[18F] and 4-[18F]fluoro-l-m-tyrosines via regioselective radiofluorodestannylation
Namavari, M., Satyamurthy, N., Phelps, M. E., & Barrio, J. R. (1993) · Applied Radiation and Isotopes · doi:10.1016/0969-8043(93)90165-7 · Cited by 47
Effect of apomorphine infusion on dopamine synthesis rate relates to dopaminergic tone
Torstenson, R., Hartvig, P., Långström, B., Bastami, S., Antoni, G., & Tedroff, J. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00085-9 · Cited by 36
MR-PET Image Coregistration for Quantitation of Striatal Dopamine D2 Receptors
Wang, G.-J., Volkow, N. D., Levy, A. V., Fowler, J. S., Logan, J., Alexoff, D., Hitzemann, R. J., & Schyler, D. J. (1996) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199605000-00020 · Cited by 33
A methodology for specifying PET VOIs using multimodality techniques
Klein, G. J., Teng, X., Jagust, W. J., Eberling, J. L., Acharya, A., Reutter, B. W., & Huesman, R. H. (1997) · IEEE Transactions on Medical Imaging · doi:10.1109/42.611350 · Cited by 32
Self-citationDrewe, J., Mazer, N. A., Abisch, E., Krummen, K., & Keck, M. (1988) · European Journal of Clinical Pharmacology · doi:10.1007/bf00558250 · Cited by 28
PET 6-[18F]fluoro-L-m-tyrosine studies of dopaminergic function in human and nonhuman primates
Eberling, J. L., Bankiewicz, K. S., O’Neil, J. P., & Jagust, W. J. (2008) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.009.2007 · Cited by 18
Self-citation
Cited by
Inverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive Control
Cools, R., & D'Esposito, M. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.03.028 · Cited by 1,673
Self-citationShohamy, D., & Adcock, R. A. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.08.002 · Cited by 707
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
“25 mg) improved reward-based reversal learning in subjects with low baseline synthesis capacity, but impaired it in subjects with high baseline synthesis (106).”
BackgroundHow prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512
“Systemic manipulations of dopamine levels in patients and healthy subjects show opposite effects on rewardand punishment-based learning (Frank et al., 2004; Moustafa et al., 2008; Cools et al., 2009; Palminteri et al., 2009).”
BackgroundSerotonin and dopamine: unifying affective, activational, and decision functions.
Cools, R., Nakamura, K., & Daw, N. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.121 · Cited by 464
Self-citation
Metadata
- Authors
- Cools, R., Frank, M. J., Gibbs, S. E., Miyakawa, A., Jagust, W., & D'Esposito, M.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2009-02-04
- Volume
- 29
- Issue
- 5
- Pages
- 1538-1543
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2048396168
- Cited by
- 364
- References
- 40
- FWCI
- 10.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.