The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Open accessAbstract
What are the genetic and neural components that support adaptive learning from positive and negative outcomes? Here, we show with genetic analyses that three independent dopaminergic mechanisms contribute to reward and avoidance learning in humans. A polymorphism in the DARPP-32 gene, associated with striatal dopamine function, predicted relatively better probabilistic reward learning. Conversely, the C957T polymorphism of the DRD2 gene, associated with striatal D2 receptor function, predicted the degree to which participants learned to avoid choices that had been probabilistically associated with negative outcomes. The Val/Met polymorphism of the COMT gene, associated with prefrontal cortical dopamine function, predicted participants' ability to rapidly adapt behavior on a trial-to-trial basis. These findings support a neurocomputational dissociation between striatal and prefrontal dopaminergic mechanisms in reinforcement learning. Computational maximum likelihood analyses reveal independent gene effects on three reinforcement learning parameters that can explain the observed dissociations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“individual differences in learning rates have previously been linked to both genetic40 and developmental differences41 between individuals”
From A computational reward learning account of social media engagement (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Effect of COMT Val 108/158 Met genotype on frontal lobe function and risk for schizophrenia
Egan, M. F., Goldberg, T. E., Kolachana, B. S., Callicott, J. H., Mazzanti, C. M., Straub, R. E., Goldman, D., & Weinberger, D. R. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.111134598 · Cited by 2,381
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Self-citation(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
Duan, J. (2003) · Human Molecular Genetics · doi:10.1093/hmg/12.3.205 · Cited by 930
Frank, M. J. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929052880093 · Cited by 925
Self-citationGogos, J. A., Morgan, M., Luine, V., Santha, M., Ogawa, S., Pfaff, D., & Karayiorgou, M. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.17.9991 · Cited by 864
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Building neural representations of habits.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782
Endocannabinoid-mediated rescue of striatal LTD and motor deficits in Parkinson's disease models
Kreitzer, A. C., & Malenka, R. C. (2007) · Nature · doi:10.1038/nature05506 · Cited by 735
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712
Ouimet, C., Miller, P., Hemmings, H., Walaas, S., & Greengard, P. (1984) · The Journal of Neuroscience · doi:10.1523/jneurosci.04-01-00111.1984 · Cited by 656
Dopamine-Mediated Stabilization of Delay-Period Activity in a Network Model of Prefrontal Cortex
Durstewitz, D., Seamans, J. K., & Sejnowski, T. J. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.3.1733 · Cited by 619
Frank, M. J., & Claus, E. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.300 · Cited by 585
Self-citationFrank, M. J., & O'Reilly, R. C. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.3.497 · Cited by 472
Self-citationError-Related Negativity Predicts Reinforcement Learning and Conflict Biases
Frank, M. J., Woroch, B. S., & Curran, T. (2005) · Neuron · doi:10.1016/j.neuron.2005.06.020 · Cited by 426
Self-citationTunbridge, E. M. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.1124-04.2004 · Cited by 418
Prefrontal cortex and flexible cognitive control: Rules without symbols
Rougier, N. P., Noelle, D. C., Braver, T. S., Cohen, J. D., & O'Reilly, R. C. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502455102 · Cited by 398
The Classification of Dopamine Receptors: Relationship to Radioligand Binding
Creese, I., Sibley, D. R., Hamblin, M. W., & Leff, S. E. (1983) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.06.030183.000355 · Cited by 389
Computational perspectives on dopamine function in prefrontal cortex
Cohen, J. D., Braver, T. S., & Brown, J. W. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00314-8 · Cited by 384
Calabresi, P., Gubellini, P., Centonze, D., Picconi, B., Bernardi, G., Chergui, K., Svenningsson, P., Fienberg, A. A., & Greengard, P. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-22-08443.2000 · Cited by 380
A dopamine- and cyclic AMP-regulated phosphoprotein enriched in dopamine-innervated brain regions
Ivar Walaas, S., Aswad, D. W., & Greengard, P. (1983) · Nature · doi:10.1038/301069a0 · Cited by 345
Yechiam, E., Busemeyer, J. R., Stout, J. C., & Bechara, A. (2005) · Psychological Science · doi:10.1111/j.1467-9280.2005.01646.x · Cited by 330
Robertson, G. S., Vincent, S. R., & Fibiger, H. C. (1992) · Neuroscience · doi:10.1016/0306-4522(92)90096-k · Cited by 328
Waltz, J. A., Frank, M. J., Robinson, B. M., & Gold, J. M. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.09.042 · Cited by 327
Self-citationCorrelated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298
Reversal learning in Parkinson's disease depends on medication status and outcome valence
Cools, R., Altamirano, L., & D’Esposito, M. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.030 · Cited by 289
Individual differences in extraversion and dopamine genetics predict neural reward responses
Cohen, M. X., Young, J., Baek, J.-M., Kessler, C., & Ranganath, C. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.09.018 · Cited by 272
Brown, J. W., Bullock, D., & Grossberg, S. (2004) · Neural Networks · doi:10.1016/j.neunet.2003.08.006 · Cited by 265
Di Chiara, G., Loddo, P., & Tanda, G. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(99)00236-x · Cited by 258
Hirvonen, M., Laakso, A., Någren, K., Rinne, J. O., Pohjalainen, T., & Hietala, J. (2004) · Molecular Psychiatry · doi:10.1038/sj.mp.4001561 · Cited by 248
Genetic evidence implicating DARPP-32 in human frontostriatal structure, function, and cognition
Meyer-Lindenberg, A., Straub, R. E., Lipska, B. K., Verchinski, B. A., Goldberg, T., Callicott, J. H., Egan, M. F., Huffaker, S. S., Mattay, V. S., Kolachana, B., et al. (2007) · Journal of Clinical Investigation · doi:10.1172/jci30413 · Cited by 226
Role of Dopamine in the Primate Caudate Nucleus in Reward Modulation of Saccades
Nakamura, K., & Hikosaka, O. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4853-05.2006 · Cited by 178
Stefani, M. R., & Moghaddam, B. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1656-06.2006 · Cited by 169
Parasuraman, R., Greenwood, P. M., Kumar, R., & Fossella, J. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.00804.x · Cited by 160
Laakso, A., Pohjalainen, T., Bergman, J., Kajander, J., Haaparanta‐Solin, M., Solin, O. H., Syvälahti, E. K. G., & Hietala, J. A. (2005) · Pharmacogenetics and Genomics · doi:10.1097/01213011-200506000-00003 · Cited by 157
Collection of Genomic DNA by Buccal Swabs for Polymerase Chain Reaction-Based Biomarker Assays
Walker, A. H., Najarian, D., White, D. L., Jaffe, J. F., Kanetsky, P. A., & Rebbeck, T. R. (1999) · Environmental Health Perspectives · doi:10.1289/ehp.99107517 · Cited by 145
Transient Calcium and Dopamine Increase PKA Activity and DARPP-32 Phosphorylation
Lindskog, M., Kim, M., Wikström, M. A., Blackwell, K. T., & Kotaleski, J. H. (2006) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0020119 · Cited by 128
Centonze, D., Usiello, A., Costa, C., Picconi, B., Erbs, E., Bernardi, G., Borrelli, E., & Calabresi, P. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.1274-04.2004 · Cited by 100
Stimulus‐specific plasticity of prefrontal cortex dopamine neurotransmission
Jackson, M., & Moghaddam, B. (2004) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.2003.02205.x · Cited by 58
Hirvonen, M., Laakso, A., Någren, K., Rinne, J. O., Pohjalainen, T., & Hietala, J. A. (2005) · Molecular Psychiatry · doi:10.1038/sj.mp.4001707 · Cited by 51
Cited by
Model-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779
Inverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive Control
Cools, R., & D'Esposito, M. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.03.028 · Cited by 1,673
Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism
Frank, M. J., Samanta, J., Moustafa, A. A., & Sherman, S. J. (2007) · Science · doi:10.1126/science.1146157 · Cited by 1,120
Self-citationThe Neuropsychopharmacology of Fronto-Executive Function: Monoaminergic Modulation
Robbins, T. W., & Arnsten, A. F. T. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135535 · Cited by 957
Ten simple rules for the computational modeling of behavioral data
Wilson, R. C., & Collins, A. G. (2019) · eLife · doi:10.7554/elife.49547 · Cited by 710
Metadata
- Authors
- Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2007-10-09
- Volume
- 104
- Issue
- 41
- Pages
- 16311-16316
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2014979870
- Cited by
- 683
- References
- 51
- FWCI
- 12.57
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.