By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To what extent do we learn from the positive versus negative outcomes of our decisions? The neuromodulator dopamine plays a key role in these reinforcement learning processes. Patients with Parkinson's disease, who have depleted dopamine in the basal ganglia, are impaired in tasks that require learning from trial and error. Here, we show, using two cognitive procedural learning tasks, that Parkinson's patients off medication are better at learning to avoid choices that lead to negative outcomes than they are at learning from positive outcomes. Dopamine medication reverses this bias, making patients more sensitive to positive than negative outcomes. This pattern was predicted by our biologically based computational model of basal ganglia–dopamine interactions in cognition, which has separate pathways for “Go” and “NoGo” responses that are differentially modulated by positive and negative reinforcement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neural mechanisms underlying decision making and learning involve fronto-striatal networks generating reward prediction errors which are highly sensitive to dopaminergic modulation (Frank et al. 2004; Kehagia et al. 2010; Schultz and Dickinson 2000).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Frank et al. 2004
In the citing paper
“Operant learning is, however, known to be impaired in PD (Avila et al., 2009; Frank et al., 2004; Rushworth et al., 1998; Rutledge et al., 2009; Shohamy et al., 2005).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Frank et al., 2004
In the citing paper
“Substantial work in conditions such as Parkinson’s disease, in which dopamine is reduced, shows that manipulations favoring D1 and D2 dopamine receptors result in effects that are most readily interpretable in a model-free manner (Frank et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as Frank et al., 2004
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
Uneven Pattern of Dopamine Loss in the Striatum of Patients with Idiopathic Parkinson's Disease
Kish, S. J., Shannak, K., & Hornykiewicz, O. (1988) · New England Journal of Medicine · doi:10.1056/nejm198804073181402 · Cited by 1,953
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
A neuropsychological theory of multiple systems in category learning.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998) · Psychological Review · doi:10.1037//0033-295x.105.3.442 · Cited by 1,223
The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia
Gerfen, C. R. (1992) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.15.030192.001441 · Cited by 1,004
Cools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906
Research works printed but not linked: 6
- 10.1037/0033-295x.105.3.442 · doi:10.1037/0033-295x.105.3.442 · Paper page
- M. Frank J. Cognit. Neurosci. in press.
- R. C. O'Reilly M. J. Frank ICS Tech. Rep. University of Colorado Institute of Cognitive Science (2004).
- 10.1088/0954-898x_8_4_001 · doi:10.1088/0954-898x_8_4_001 · Paper page
- M. Frank J. Rudy W. Levy R. O'Reilly Mem. Cognit. in press.
- 10.1037/0097-7403.17.3.334 · doi:10.1037/0097-7403.17.3.334 · Paper page
Cited by
Items 701–800 of 1,007
Language statistical learning responds to reinforcement learning principles rooted in the striatum
Orpella, J., Herrero, E. M., Ripollés, P., Marco‐Pallarés, J., & de Diego‐Balaguer, R. (2021) · PLoS Biology · doi:10.1371/journal.pbio.3001119 · Cited by 43
Preservation of Eye Movements in Parkinson's Disease Is Stimulus- and Task-Specific
Fooken, J., Patel, P., Jones, C. B., McKeown, M. J., & Spering, M. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.1690-21.2021 · Cited by 43
Deep brain stimulation alleviates tics in Tourette syndrome via striatal dopamine transmission
Rusheen, A. E., Cabrera, J. M. R., Goyal, A., Shin, H., Yuen, J., Jang, D., Bennet, K. E., Blaha, C. D., Lee, K. H., & Oh, Y. (2023) · Brain · doi:10.1093/brain/awad142 · Cited by 43
Atypical valuation of monetary and cigarette rewards in substance dependent smokers
Baker, T. E., Wood, J., & Holroyd, C. B. (2015) · Clinical Neurophysiology · doi:10.1016/j.clinph.2015.11.002 · Cited by 43
Dove, A., Brett, M., Cusack, R., & Owen, A. M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.02.035 · Cited by 43
The Effect of Dopamine Agonists on Adaptive and Aberrant Salience in Parkinson's Disease
Nagy, H., Levy-Gigi, E., Somlai, Z., Takáts, A., Bereczki, D., & Kéri, S. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.278 · Cited by 42
Patients with Parkinson’s Disease Show Impaired Use of Priors in Conditions of Sensory Uncertainty
Perugini, A., Ditterich, J., & Basso, M. A. (2016) · Current Biology · doi:10.1016/j.cub.2016.05.039 · Cited by 42
The Michelin red guide of the brain: role of dopamine in goal-oriented navigation
Retailleau, A., & Boraud, T. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00032 · Cited by 42
Understanding the development of reward learning through the lens of meta-learning
Nussenbaum, K., & Hartley, C. A. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00304-1 · Cited by 42
Dopamine Receptor-Specific Contributions to the Computation of Value
Burke, C. J., Soutschek, A., Weber, S. C., Beharelle, A. R., Fehr, E., Haker, H., & Tobler, P. N. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.302 · Cited by 42
Dopamine-Dependent Loss Aversion during Effort-Based Decision-Making
Chen, X., Voets, S. H. E. M., Jenkinson, N., & Galea, J. M. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.1760-19.2019 · Cited by 42
Enkavi, A. Z., & Poldrack, R. A. (2020) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2020.06.010 · Cited by 42
How initial confirmatory experience potentiates the detrimental influence of bad advice
Staudinger, M. R., & Büchel, C. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.074 · Cited by 42
Reinforcement Learning of Two-Joint Virtual Arm Reaching in a Computer Model of Sensorimotor Cortex
Neymotin, S. A., Chadderdon, G. L., Kerr, C. C., Francis, J. T., & Lytton, W. W. (2013) · Neural Computation · doi:10.1162/neco_a_00521 · Cited by 42
Moustafa, A. A., & Gluck, M. A. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.02.006 · Cited by 42
Evidence of Dopaminergic Processing of Executive Inhibition
Badgaiyan, R. D., & Wack, D. S. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028075 · Cited by 42
Barch, D. M. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn092 · Cited by 42
Involvement of Human Basal Ganglia In Offline Feedback Control of Voluntary Movement
Brown, P., Chen, C. C., Wang, S., Kühn, A. A., Gaynor, L. D., Yarrow, K., Nuttin, B., Stein, J. F., & Aziz, T. Z. (2006) · Current Biology · doi:10.1016/j.cub.2006.08.088 · Cited by 42
Feedback-based versus observational classification learning in healthy aging and Parkinson's disease
Schmitt-Eliassen, J., Ferstl, R., Wiesner, C. D., Deuschl, G., & Witt, K. (2007) · Brain Research · doi:10.1016/j.brainres.2007.01.042 · Cited by 42
Decision-making and action selection in insects: inspiration from vertebrate-based theories
Barron, A. B., Gurney, K. N., Meah, L. F. S., Vasilaki, E., & Marshall, J. A. R. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00216 · Cited by 41
Cheung, T. H. C., Ding, Y., Zhuang, X., & Kang, U. J. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2213093120 · Cited by 41
Dercon, Q., Mehrhof, S. Z., Sandhu, T., Hitchcock, C., Lawson, R. P., Pizzagalli, D. A., Dalgleish, T., & Nord, C. L. (2023) · Psychological Medicine · doi:10.1017/s0033291723001587 · Cited by 41
Levodopa impairs probabilistic reversal learning in healthy young adults
Vo, A., Seergobin, K. N., Morrow, S. A., & MacDonald, P. A. (2016) · Psychopharmacology · doi:10.1007/s00213-016-4322-x · Cited by 41
Suryanarayana, S. M., Kotaleski, J. H., Grillner, S. E., & GURNEY, K. N. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.10.003 · Cited by 41
Punishment insensitivity in humans is due to failures in instrumental contingency learning
Jean-Richard-dit-Bressel, P., Lee, J. C., Liew, S. X., Weidemann, G., Lovibond, P. F., & McNally, G. P. (2021) · eLife · doi:10.7554/elife.69594 · Cited by 41
Reinforcement learning deficits in people with schizophrenia persist after extended trials
Cicero, D. C., Martin, E. A., Becker, T. M., & Kerns, J. G. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.08.013 · Cited by 41
Reinforcement Learning of Targeted Movement in a Spiking Neuronal Model of Motor Cortex
Chadderdon, G. L., Neymotin, S. A., Kerr, C. C., & Lytton, W. W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047251 · Cited by 41
Mouse Models of Neurodevelopmental Disease of the Basal Ganglia and Associated Circuits
Pappas, S. S., Leventhal, D., Albin, R. L., & Dauer, W. T. (2014) · Current topics in developmental biology/Current Topics in Developmental Biology · doi:10.1016/b978-0-12-397920-9.00001-9 · Cited by 41
Hampshire, A., Gruszka, A., Fallon, S. J., & Owen, A. M. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20115 · Cited by 40
Depressive symptoms are associated with blunted reward learning in social contexts
Safra, L., Chevallier, C., & Palminteri, S. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007224 · Cited by 40
Piray, P., Keramati, M. M., Dezfouli, A., Lucas, C., & Mokri, A. (2010) · Neural Computation · doi:10.1162/neco_a_00009 · Cited by 40
The roots of polarization in the individual reward system
Lefebvre, G., Deroy, O. D., & Bahrami, B. (2024) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2023.2011 · Cited by 40
Transmission of social bias through observational learning
Schultner, D. T., Lindström, B., Cikara, M., & Amodio, D. M. (2024) · Science Advances · doi:10.1126/sciadv.adk2030 · Cited by 40
Effects of dopamine medication on sequence learning with stochastic feedback in Parkinson’s disease
Seo (2010) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2010.00036 · Cited by 40
Constraints on decision making: Implications from genetics, personality, and addiction
Baker, T. E., Stockwell, T. R., & Holroyd, C. B. (2013) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-013-0164-8 · Cited by 40
Cognitive impulsivity in Parkinson's disease patients: Assessment and pathophysiology
Robert, G. H., Drapier, D., Vérin, M., Millet, B., Azulay, J., & Blin, O. (2009) · Movement Disorders · doi:10.1002/mds.22836 · Cited by 40
From apathy to addiction: Insights from neurology and psychiatry
Kirschner, M., Rabinowitz, A. G., Singer, N., & Dagher, A. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.109926 · Cited by 40
Vancraeyenest, P., Arsenault, J. T., Li, X., Zhu, Q., Kobayashi, K., Isa, K., Isa, T., & Vanduffel, W. (2020) · Neuron · doi:10.1016/j.neuron.2020.07.013 · Cited by 40
Hartmann, H., Pauli, L., Janssen, L. K., Hühn, S., Ceglarek, U., & Horstmann, A. (2020) · Journal of Neuroendocrinology · doi:10.1111/jne.12917 · Cited by 40
Dopamine regulates decision thresholds in human reinforcement learning in males
Chakroun, K., Wiehler, A., Wagner, B., Mathar, D., Ganzer, F., van Eimeren, T., Sommer, T., & Peters, J. (2023) · Nature Communications · doi:10.1038/s41467-023-41130-y · Cited by 40
Foerde, K., Braun, E. K., & Shohamy, D. (2012) · Neurodegenerative Diseases · doi:10.1159/000342000 · Cited by 40
α-Synuclein gene duplication impairs reward learning
Kéri, S., Moustafa, A. A., Myers, C. E., Benedek, G., & Gluck, M. A. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1006068107 · Cited by 40
Culture in Mind – An Enactivist Account: Not Cognitive Penetration but Cultural Permeation
Hutto, D. D., Gallagher, S., Ilundáin‐Agurruza, J., & Hipólito, I. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108695374.009 · Cited by 40
Millman, Z. B., Gallagher, K., Demro, C., Schiffman, J., Reeves, G. M., Gold, J. M., Rakhshan Rouhakhtar, P. J., Fitzgerald, J., Andorko, N. D., Redman, S., et al. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2019.03.017 · Cited by 39
Slooten, J. C. V., Jahfari, S., & Theeuwes, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-53805-y · Cited by 39
The Power of Smiling: The Adult Brain Networks Underlying Learned Infant Emotionality
Stark, E. A., Cabral, J., Riem, M. M. E., van IJzendoorn, M. H., Stein, A. L., & Kringelbach, M. L. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz219 · Cited by 39
Rational inattention and tonic dopamine
Mikhael, J. G., Lai, L., & Gershman, S. J. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008659 · Cited by 39
Neuromolecular Underpinnings of Negative Cognitive Bias in Depression
Noworyta, K., Cieslik-Starkiewicz, A., & Ryguła, R. (2021) · Cells · doi:10.3390/cells10113157 · Cited by 40
Probabilistic Reinforcement Learning and Anhedonia
Kangas, B. D., Der‐Avakian, A., & Pizzagalli, D. A. (2022) · Current topics in behavioral neurosciences · doi:10.1007/7854_2022_349 · Cited by 40
Implicit emotional biases in decision making: The case of the Iowa Gambling Task
Stocco, A., & Fum, D. (2007) · Brain and Cognition · doi:10.1016/j.bandc.2007.09.002 · Cited by 39
Recreational use of cocaine eliminates inhibition of return.
Colzato, L. S., & Hommel, B. (2009) · Neuropsychology · doi:10.1037/a0013821 · Cited by 39
Multi-facetted impulsivity following nigral degeneration and dopamine replacement therapy
Engeln, M., Ansquer, S., Dugast, E., Bézard, E., Belin, D., & Fernagut, P. (2016) · Neuropharmacology · doi:10.1016/j.neuropharm.2016.05.013 · Cited by 39
Dopamine Modulates the Neural Representation of Subjective Value of Food in Hungry Subjects
Medic, N., Ziauddeen, H., Vestergaard, M. D., Henning, E., Schultz, W., Farooqi, I. S., & Fletcher, P. C. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2051-14.2014 · Cited by 38
How Basal Ganglia Outputs Generate Behavior
Yin, H. H. (2014) · Advances in Neuroscience · doi:10.1155/2014/768313 · Cited by 38
Parallel model-based and model-free reinforcement learning for card sorting performance
Steinke, A., Lange, F., & Kopp, B. (2020) · Scientific Reports · doi:10.1038/s41598-020-72407-7 · Cited by 38
He, Y., Tian, Y., Han, H., Cui, J., Ge, X., Qin, Y., Luo, Y., Bai, W., & Yu, H. (2021) · Health and Quality of Life Outcomes · doi:10.1186/s12955-021-01740-w · Cited by 38
Effects of methylphenidate on reinforcement learning depend on working memory capacity
Kandroodi, M. R., Cook, J. L., Swart, J. C., Froböse, M. I., Geurts, D. E. M., Vahabie, A., Ahmadabadi, M. N., Cools, R., & den Ouden, H. E. M. (2021) · Psychopharmacology · doi:10.1007/s00213-021-05974-w · Cited by 38
Howard, C. D., Keefe, K. A., Garris, P. A., & Daberkow, D. P. (2011) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.2011.07342.x · Cited by 38
Campbell-Meiklejohn, D. K., Simonsen, A., Scheel‐Krüger, J., Wohlert, V., Gjerløff, T., Frith, C., Rogers, R. D., Roepstorff, A., & Møller, A. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0151-12.2012 · Cited by 38
Gill, K. M., Bernstein, I. L., & Mizumori, S. J. Y. (2007) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2006.12.011 · Cited by 38
Rossiter, S., Thompson, J., & Hester, R. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2012.03.017 · Cited by 38
A neurocomputational account of cognitive deficits in Parkinson's disease
Hélie, S., Paul, E. J., & Ashby, F. G. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.05.033 · Cited by 38
Reward Sensitivity of ACC as an Intermediate Phenotype between DRD4-521T and Substance Misuse
Baker, T. E., Stockwell, T. R., Barnes, G. E., Haesevoets, R. J. C., & Holroyd, C. B. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00905 · Cited by 38
Stocco, A. (2017) · Cognitive Science · doi:10.1111/cogs.12506 · Cited by 38
A Real-Time Phase-Locking System for Non-invasive Brain Stimulation
Mansouri, F., Fettes, P., Schulze, L., Giacobbe, P., Zariffa, J., & Downar, J. H. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00877 · Cited by 38
Transverse Patterning and Human Amnesia
Rickard, T. C., Verfaellie, M. H., & Grafman, J. H. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.10.1723 · Cited by 38
Munte, T. F. (2008) · Frontiers in Neuroscience · doi:10.3389/neuro.01.006.2008 · Cited by 38
Klanker, M., Sandberg, T., Joosten, R., Willuhn, I., Feenstra, M., & Denys, D. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2015.08.011 · Cited by 37
Fiore, V. G., Sperati, V., Mannella, F., Mirolli, M., Gurney, K., Friston, K., Dolan, R. J., & Baldassarre, G. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00124 · Cited by 37
Schizophrenia: A Computational Reinforcement Learning Perspective
Frank, M. J. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn123 · Cited by 37
Self-citationExpecting the unexpected: a review of learning under uncertainty across development
Topel, S., Ma, I., Sleutels, J. J. M., van Steenbergen, H., de Bruijn, E. R. A., & van Duijvenvoorde, A. C. K. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01098-0 · Cited by 37
Carbone, F., & Djamshidian, A. (2024) · CNS Drugs · doi:10.1007/s40263-024-01087-y · Cited by 37
Placebo Intervention Enhances Reward Learning in Healthy Individuals
Turi, Z., Mittner, M., Paulus, W., & Antal, A. (2017) · Scientific Reports · doi:10.1038/srep41028 · Cited by 37
Estradiol and the reward system in humans
Diekhof, E. K. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.03.010 · Cited by 37
Illuminating subcortical GABAergic and glutamatergic circuits for reward and aversion
Gordon-Fennell, A., & Stuber, G. D. (2021) · Neuropharmacology · doi:10.1016/j.neuropharm.2021.108725 · Cited by 37
Sugiyama, T., Schweighofer, N., & Izawa, J. (2023) · Nature Communications · doi:10.1038/s41467-023-39536-9 · Cited by 37
Thoma, P., Norra, C., Juckel, G., Suchan, B., & Bellebaum, C. (2015) · Biological Psychology · doi:10.1016/j.biopsycho.2015.06.002 · Cited by 37
The role of prediction and outcomes in adaptive cognitive control
Schiffer, A., Waszak, F., & Yeung, N. (2015) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2015.02.001 · Cited by 37
Ludwiczak, A., Jahanshahi, M., & Osman, M. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.10.005 · Cited by 37
Hélie, S., Paul, E. J., & Ashby, F. G. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.033 · Cited by 37
Implicit sequence learning in people with Parkinson’s disease
Gamble, K. R., Cummings, T. J., Jr., Lo, S. E., Ghosh, P., Howard, J. H., & Howard, D. V. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00563 · Cited by 37
Mild Reinforcement Learning Deficits in Patients With First-Episode Psychosis
Chang, W. C., Waltz, J. A., Gold, J. M., Chan, T. C. W., & Chen, E. Y. H. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw060 · Cited by 37
Impulse control disorders in Parkinson’s disease: clinical characteristics and implications
Leeman, R. F., & Potenza, M. N. (2011) · Neuropsychiatry · doi:10.2217/npy.11.11 · Cited by 37
Meisel, K., & Nuissl, E. (2006) · doi:10.3278/81/0098w · Cited by 37
Swainson, R., SENGUPTA, D., Shetty, T., Watkins, L. D., Summers, B. L., Sahakian, B. J., Polkey, C. E., Barker, R., & Robbins, T. W. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.01.028 · Cited by 37
Translational Assessments of Reward and Anhedonia: A Tribute to Athina Markou
Der-Avakian, A., & Pizzagalli, D. A. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.02.008 · Cited by 36
“The probabilistic learning task (PLT) is an assessment of learning associated with both positive and negative feedback (23,24).”
Disordered Decision Making: A Cognitive Framework for Apathy and Impulsivity in Huntington’s Disease
Morris, L., O'Callaghan, C., & Le Heron, C. (2022) · Movement Disorders · doi:10.1002/mds.29013 · Cited by 36
Phillips, B. U., Dewan, S., Nilsson, S. R. O., Robbins, T. W., Heath, C. J., Saksida, L. M., Bussey, T. J., & Alsiö, J. (2018) · Psychopharmacology · doi:10.1007/s00213-018-4907-7 · Cited by 36
Flexibility in valenced reinforcement learning computations across development
Nussenbaum, K., Velez, J. A., Washington, B. T., Hamling, H. E., & Hartley, C. A. (2022) · Child Development · doi:10.1111/cdev.13791 · Cited by 36
Microstimulation of the Human Substantia Nigra Alters Reinforcement Learning
Ramayya, A. G., Misra, A., Baltuch, G. H., & Kahana, M. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.5445-13.2014 · Cited by 36
Ravizza, S. M., Goudreau, J. L., Delgado, M. R., & Ruiz, S. (2011) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-011-0066-6 · Cited by 36
Hadj‐Bouziane, F., Bénatru, I., Brovelli, A., Klinger, H., Thobois, S., Broussolle, E., Boussaoud, D., & Meunier, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00351 · Cited by 36
Matsumoto, M., & Hikosaka, O. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026701 · Cited by 36
Dopamine D2-Receptor Blockade Enhances Decoding of Prefrontal Signals in Humans
Kahnt, T., Weber, S. C., Haker, H., Robbins, T. W., & Tobler, P. N. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4182-14.2015 · Cited by 36
Prefrontal cortex, dopamine, and jealousy endophenotype
Marazziti, D., Poletti, M., Dell’Osso, L., Baroni, S., & Bonuccelli, U. (2012) · CNS Spectrums · doi:10.1017/s1092852912000740 · Cited by 36
Insel, C., Reinen, J., Weber, J., Wager, T. D., Jarskog, L. F., Shohamy, D., & Smith, E. E. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0261-3 · Cited by 36
Rule-based categorization deficits in focal basal ganglia lesion and Parkinson's disease patients
Ell, S. W., Weinstein, A. M., & Ivry, R. B. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.06.006 · Cited by 36
Properties of Neurons in External Globus Pallidus Can Support Optimal Action Selection
Bogacz, R., Moraud, E. M., Abdi, A., Magill, P. J., & Baufreton, J. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005004 · Cited by 36
Ricciardi, L., Haggard, P., de Boer, L., Sorbera, C., Stenner, M., Morgante, F., & Edwards, M. J. (2017) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2017.04.011 · Cited by 36
Prat, C. S., Yamasaki, B. L., & Peterson, E. R. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01337 · Cited by 36
Metadata
- Authors
- Frank, M. J., Seeberger, L. C., & O'Reilly, R. C.
- Affiliations
- University of Colorado Boulder (US)
- Department of Psychology and Center for Neuroscience, University of Colorado Boulder, Boulder, CO 80309–0345, USA.
- Corresponding author
- Frank, Michael J.
- Venue
- Science
- Published
- 2004-12-10
- Volume
- 306
- Issue
- 5703
- Pages
- 1940-1943
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2163647009
- Cited by
- 1,964
- References
- 33
- Citations by year
- 2026: 57 · 2025: 73 · 2024: 83 · 2023: 79 · 2022: 91 · 2021: 99 · 2020: 134 · 2019: 104 · 2018: 125 · 2017: 111 · 2016: 115 · 2015: 111 · 2014: 134 · 2013: 111 · 2012: 108
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH069597, MH 069597-01)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Clinical Neurology › Parkinson's Disease Mechanisms and Treatments
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- Parkinson's disease, parkinsonism, dopamine, basal ganglia, positive reinforcement, negative reinforcement, avoidance learning, procedural learning, computational model, trial-and-error learning
- MeSH terms
- Aged, Antiparkinson Agents, Basal Ganglia, Cognition, Computer Simulation, Dopamine, Female, Frontal Lobe, Humans, Learning, Male, Middle Aged, Models, Neurological, Parkinson Disease, Probability, Reinforcement, Psychology, Matched-Pair Analysis, Feedback, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.