By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To what extent do we learn from the positive versus negative outcomes of our decisions? The neuromodulator dopamine plays a key role in these reinforcement learning processes. Patients with Parkinson's disease, who have depleted dopamine in the basal ganglia, are impaired in tasks that require learning from trial and error. Here, we show, using two cognitive procedural learning tasks, that Parkinson's patients off medication are better at learning to avoid choices that lead to negative outcomes than they are at learning from positive outcomes. Dopamine medication reverses this bias, making patients more sensitive to positive than negative outcomes. This pattern was predicted by our biologically based computational model of basal ganglia–dopamine interactions in cognition, which has separate pathways for “Go” and “NoGo” responses that are differentially modulated by positive and negative reinforcement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neural mechanisms underlying decision making and learning involve fronto-striatal networks generating reward prediction errors which are highly sensitive to dopaminergic modulation (Frank et al. 2004; Kehagia et al. 2010; Schultz and Dickinson 2000).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Frank et al. 2004
In the citing paper
“Operant learning is, however, known to be impaired in PD (Avila et al., 2009; Frank et al., 2004; Rushworth et al., 1998; Rutledge et al., 2009; Shohamy et al., 2005).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Frank et al., 2004
In the citing paper
“Substantial work in conditions such as Parkinson’s disease, in which dopamine is reduced, shows that manipulations favoring D1 and D2 dopamine receptors result in effects that are most readily interpretable in a model-free manner (Frank et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as Frank et al., 2004
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
Uneven Pattern of Dopamine Loss in the Striatum of Patients with Idiopathic Parkinson's Disease
Kish, S. J., Shannak, K., & Hornykiewicz, O. (1988) · New England Journal of Medicine · doi:10.1056/nejm198804073181402 · Cited by 1,953
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
A neuropsychological theory of multiple systems in category learning.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998) · Psychological Review · doi:10.1037//0033-295x.105.3.442 · Cited by 1,223
The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia
Gerfen, C. R. (1992) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.15.030192.001441 · Cited by 1,004
Cools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906
Research works printed but not linked: 6
- 10.1037/0033-295x.105.3.442 · doi:10.1037/0033-295x.105.3.442 · Paper page
- M. Frank J. Cognit. Neurosci. in press.
- R. C. O'Reilly M. J. Frank ICS Tech. Rep. University of Colorado Institute of Cognitive Science (2004).
- 10.1088/0954-898x_8_4_001 · doi:10.1088/0954-898x_8_4_001 · Paper page
- M. Frank J. Rudy W. Levy R. O'Reilly Mem. Cognit. in press.
- 10.1037/0097-7403.17.3.334 · doi:10.1037/0097-7403.17.3.334 · Paper page
Cited by
Items 601–700 of 1,007
Ferdinand, N. K., & Kray, J. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2014.01.029 · Cited by 53
Lovato, E. C. W., Boschen, S. L., Miyoshi, E., Bortolanza, M., dos Santos, L. M., Frank, M. J., Brandão, M. L., Winn, P., & Cunha, C. D. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2384-3 · Cited by 53
Self-citationGenetics of impulse control disorders in Parkinson’s disease
Cormier‐Dequaire, F., Muellner, J., & Corvol, J. (2012) · Journal of Neural Transmission · doi:10.1007/s00702-012-0934-4 · Cited by 53
Young, J. W., & Markou, A. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv093 · Cited by 53
Catecholaminergic modulation of the avoidance of cognitive control.
Froböse, M. I., Swart, J. C., Cook, J. L., Geurts, D. E. M., den Ouden, H. E. M., & Cools, R. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000523 · Cited by 53
Decision and dopaminergic system: an ERPs study of Iowa gambling task in Parkinson’s disease
Mapelli, D., Rosa, E. D., Cavalletti, M., Schiff, S., & Tamburin, S. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00684 · Cited by 53
Sex-dependent effects on tasks assessing reinforcement learning and interference inhibition
Evans, K. L., & Hampson, E. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01044 · Cited by 52
“…shown performance on the PST is sensitive to dopamine manipulation Frontiers in Psychology | www.frontiersin.org 7 July 2015 | Volume 6 | Article 1044 (Frank et al., 2004), future research should examine whether the sex difference on the PST is also influenced by changes in the dopaminergic system.”
BackgroundMethodValence, Arousal, and Cognitive Control: A Voluntary Task-Switching Study
Demanet, J., Liefooghe, B., & Verbruggen, F. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00336 · Cited by 52
Qi, L., Thomas, E., White, S. H., Smith, S. K., Lee, C. A., Wilson, L. R., & Sombers, L. A. (2016) · Analytical Chemistry · doi:10.1021/acs.analchem.6b01871 · Cited by 52
Vriend, C. (2018) · Cell and Tissue Research · doi:10.1007/s00441-017-2771-0 · Cited by 52
Ngetich, R. K., Zhou, J. A., Zhang, J., Jin, Z., & Li, L. (2020) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2020.00035 · Cited by 52
Schaefer, L. M., & STEINGLASS, J. E. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-020-01213-9 · Cited by 52
Heightened effort discounting is a common feature of both apathy and fatigue
Jurgelis, M., Chong, W. B., Atkins, K. J., Cooper, P. S., Coxon, J. P., & Chong, T. T. ‐. (2021) · Scientific Reports · doi:10.1038/s41598-021-01287-2 · Cited by 52
Agency attribution: event-related potentials and outcome monitoring
Bednark, J. G., & Franz, E. A. (2014) · Experimental Brain Research · doi:10.1007/s00221-014-3821-4 · Cited by 52
Li, S., Hämmerer, D., Müller, V., Hommel, B., & Lindenberger, U. (2008) · Psychological Research · doi:10.1007/s00426-008-0190-2 · Cited by 52
Processing of emotional information in the human subthalamic nucleus
Buot, A., Welter, M., Karachi, C., Pochon, J.-B. F., Bardinet, É., Yelnik, J., & Mallet, L. (2012) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2011-302158 · Cited by 52
Dopaminergic Circuitry and Risk/Reward Decision Making: Implications for Schizophrenia
Stopper, C. M., & Floresco, S. B. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu165 · Cited by 51
Compulsive use of dopaminergic drug therapy in Parkinson's disease: Reward and anti‐reward
Evans, A. H., Lawrence, A. D., Cresswell, S. A., Katzenschlager, R., & Lees, A. J. (2010) · Movement Disorders · doi:10.1002/mds.22898 · Cited by 51
“Dopaminergic medication has been shown to alter PD patients’ relative tendency to learn from positive versus negative outcomes.(37) The finding in this study that DDS patients have higher”
ResultTransdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty
Sandhu, T. R., Xiao, B., & Lawson, R. P. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105123 · Cited by 51
Reinforcement Learning and Tourette Syndrome
Palminteri, S., & Pessiglione, M. (2013) · International review of neurobiology · doi:10.1016/b978-0-12-411546-0.00005-6 · Cited by 51
Nagano-Saito, A., Cisek, P., Perna, A. S., Shirdel, F. Z., Benkelfat, C., Leyton, M., & Dagher, A. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00592.2011 · Cited by 47
Galea, J. M., Ruge, D., Buijink, A. W. G., Bestmann, S., & Rothwell, J. C. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1294-12.2013 · Cited by 51
Ferdinand, N. K., & Kray, J. (2013) · Biological Psychology · doi:10.1016/j.biopsycho.2013.07.006 · Cited by 51
Source memory and frontal functioning in Parkinson’s disease
Drag, L. L., Bieliauskas, L. A., Kaszniak, A. W., Bohnen, N. I., & Glisky, E. L. (2009) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617709090572 · Cited by 51
Electrophysiological biomarkers of behavioral dimensions from cross-species paradigms
Cavanagh, J. F., Gregg, D., Light, G. A., Olguin, S. L., Sharp, R. F., Bismark, A. W., Bhakta, S. G., Swerdlow, N. R., Brigman, J. L., & Young, J. W. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01562-w · Cited by 51
Decision making in ambiguous and risky situations after unilateral temporal lobe epilepsy surgery
Bonatti, E., Kuchukhidze, G., Zamarian, L., Trinka, E., Bodner, T., Benke, T., & Delazer, M. (2009) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2009.02.015 · Cited by 51
Mechanisms of cerebellar involvement in associative learning
Bellebaum, C., & Daum, I. (2009) · Cortex · doi:10.1016/j.cortex.2009.07.016 · Cited by 51
Balasubramani, P. P., Chakravarthy, V. S., Ravindran, B., & Moustafa, A. A. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00076 · Cited by 50
Levodopa and executive performance in Parkinson's disease: A randomized study
Pascual‐Sedano, B., Kulisevsky, J., Barbanoj, M. J., García‐Sánchez, C., Campolongo, A., Gironell, A., Pagonabarraga, J., & Gich, I. J. (2008) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617708081010 · Cited by 50
Effects of dopamine on reinforcement learning in Parkinson’s disease depend on motor phenotype
van Nuland, A. J. M., Helmich, R. C. G., Dirkx, M. F., Zach, H., Toni, I., Cools, R., & den Ouden, H. E. M. (2020) · Brain · doi:10.1093/brain/awaa335 · Cited by 50
Childhood adversity and impaired reward processing: A meta-analysis
Oltean, L.-E., Șoflău, R., Miu, A. C., & Szentágotai-Tătar, A. (2023) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2022.105596 · Cited by 49
Bellebaum, C., Jokisch, D., Gizewski, E. R., Forsting, M., & Daum, I. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.10.042 · Cited by 49
Improvements in interval time tracking and effects on reading achievement
Taub, G. E., McGrew, K. S., & Keith, T. Z. (2007) · Psychology in the Schools · doi:10.1002/pits.20270 · Cited by 49
Nonhuman gamblers: lessons from rodents, primates, and robots
Paglieri, F., Addessi, E., Petrillo, F. D., Laviola, G., Mirolli, M., Parisi, D., Petrosino, G., Ventricelli, M., Zoratto, F., & Adriani, W. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00033 · Cited by 49
Iowa Gambling Task in Parkinson's Disease
Poletti, M., Cavedini, P., & Bonuccelli, U. (2011) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2010.524150 · Cited by 48
“Whereas other accounts of the medication-induced impairment do not require the NAcc to be intact (Frank et al., 2004), it is predictable that the impairment could be abolished with progression of the disease.”
BackgroundInfluentialAverbeck, B. B., Djamshidian, A., O'Sullivan, S. S., Housden, C. R., Roiser, J. P., & Lees, A. J. (2013) · Behavioral Neuroscience · doi:10.1037/a0032079 · Cited by 48
The costs and benefits of psychedelics on cognition and mood
Sayalı, C., & Barrett, F. S. (2023) · Neuron · doi:10.1016/j.neuron.2022.12.031 · Cited by 48
Neuroimaging studies of striatum in cognition part II: Parkinson's disease
Hanganu, A., Provost, J.-S., & Monchi, O. (2015) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2015.00138 · Cited by 48
Boller, J. K., Barbe, M. T., Pauls, K. A. M., Reck, C., Brand, M., Maier, F., Fink, G. R., Timmermann, L., & Kalbe, E. (2014) · Experimental Neurology · doi:10.1016/j.expneurol.2014.01.005 · Cited by 48
The feedback-related negativity is modulated by feedback probability in observational learning
Kobza, S., Thoma, P., Daum, I., & Bellebaum, C. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.07.059 · Cited by 48
l-DOPA changes ventral striatum recruitment during motor sequence learning in Parkinson's disease
Kwak, Y., Müller, M. L. T. M., Bohnen, N. I., Dayalu, P., & Seidler, R. D. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2012.02.006 · Cited by 48
Attenuated neural response to gamble outcomes in drug-naive patients with Parkinson’s disease
van der Vegt, J. P. M., Hulme, O. J., Zittel, S., Madsen, K. H., Weiß, M., Buhmann, C., Bloem, B. R., Münchau, A. M., & Siebner, H. R. (2013) · Brain · doi:10.1093/brain/awt027 · Cited by 48
Chang, F., Kwan, V., van der Poorten, D., Mahant, N., Wolfe, N., Ha, A. D., Griffith, J. M., Tsui, D. S., Kim, S. D., & Fung, V. S. C. (2016) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2015.05.059 · Cited by 48
Ferrazzoli, D., Ortelli, P., Cucca, A., Bakdounes, L., Canesi, M., & Volpe, D. (2020) · Neurodegenerative Disease Management · doi:10.2217/nmt-2019-0025 · Cited by 48
Superiority illusion arises from resting-state brain networks modulated by dopamine
Yamada, M., Uddin, L. Q., Takahashi, H., Kimura, Y., Takahata, K., Kousa, R., Ikoma, Y., Eguchi, Y., Takano, H., Ito, H., et al. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1221681110 · Cited by 48
The effect of feedback on non-motor probabilistic classification learning in Parkinson's disease
Wilkinson, L., Lagnado, D. A., Quallo, M. M., & Jahanshahi, M. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.05.008 · Cited by 48
On a basal ganglia role in learning and rehearsing visual–motor associations
Bédard, P., & Sanes, J. N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.050 · Cited by 48
Huang, Y., Georgiev, D., Foltynie, T., Limousin, P. D., Speekenbrink, M., & Jahanshahi, M. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.07.012 · Cited by 48
Distorted learning from local metacognition supports transdiagnostic underconfidence
Katyal, S., Huys, Q. J., Dolan, R. J., & Fleming, S. M. (2025) · Nature Communications · doi:10.1038/s41467-025-57040-0 · Cited by 47
Robinson, O. J., Standing, H. R., DeVito, E. E., Cools, R., & Sahakian, B. J. (2010) · Psychopharmacology · doi:10.1007/s00213-010-1880-1 · Cited by 47
Parsons, C. E., Young, K. S., Bhandari, R., van Ijzendoorn, M. H., Bakermans‐Kranenburg, M. J., Stein, A., & Kringelbach, M. L. (2014) · Developmental Science · doi:10.1111/desc.12112 · Cited by 47
Wiecki, T. V., Riedinger, K., von Ameln-Mayerhofer, A., Schmidt, W. J., & Frank, M. J. (2009) · Psychopharmacology · doi:10.1007/s00213-008-1457-4 · Cited by 47
Self-citationCulture, Mind, and Brain: Emerging Concepts, Models, and Applications
Kirmayer, L. J., Worthman, C. M., Kitayama, S., Lemelson, R., & Cummings, C. A. (2020) · Cited by 47
Chowdhury, R., Guitart‐Masip, M., Lambert, C., Dolan, R. J., & Düzel, E. (2013) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2013.03.030 · Cited by 47
Reinforcing properties of Pramipexole in normal and parkinsonian rats
Engeln, M., Ahmed, S. H., Vouillac‐Mendoza, C., Tison, F., Bézard, E., & Fernagut, P. (2012) · Neurobiology of Disease · doi:10.1016/j.nbd.2012.08.005 · Cited by 47
High Reward Makes Items Easier to Remember, but Harder to Bind to a New Temporal Context
Madan, C. R., Fujiwara, E., Gerson, B. C., & Caplan, J. B. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00061 · Cited by 47
Ventral striatal activity links adversity and reward processing in children
Hosseini‐Kamkar, N., Lewis, D. J., van den Bos, W., & Morton, J. B. (2017) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2017.04.002 · Cited by 47
Martini, A., Lago, D. D., Edelstyn, N. M. J., Salgarello, M., Lugoboni, F., & Tamburin, S. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.01018 · Cited by 47
Competitive and cooperative interactions between medial temporal and striatal learning systems
Freedberg, M., Toader, A. C., Wassermann, E. M., & Voss, J. L. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107257 · Cited by 47
Modeling changes in probabilistic reinforcement learning during adolescence
Xia, L., Master, S. L., Eckstein, M. K., Baribault, B., Dahl, R. E., Wilbrecht, L., & Collins, A. G. E. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008524 · Cited by 47
Labudda, K., Brand, M., Mertens, M., Ollech, I., Markowitsch, H. J., & Woermann, F. G. (2010) · Behavioural Neurology · doi:10.1155/2010/743141 · Cited by 47
5.4 Dopaminergic Modulation of Flexible Cognitive Control in Humans
Cools, R., & D’Esposito, M. (2009) · Dopamine Handbook · doi:10.1093/acprof:oso/9780195373035.003.0017 · Cited by 46
Dopamine modulation of spatial navigation memory in Parkinson's disease
Thurm, F., Schuck, N. W., Fauser, M., Doeller, C. F., Stankevich, Y., Evens, R., Riedel, O., Storch, A., Lueken, U., & Li, S. (2015) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2015.10.019 · Cited by 46
Nassar, M. R., & Gold, J. I. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003015 · Cited by 46
MacDonald, A. A., Seergobin, K. N., Owen, A. M., Tamjeedi, R., Monchi, O., Ganjavi, H., & MacDonald, P. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0074044 · Cited by 46
Dopaminergic medication reduces striatal sensitivity to negative outcomes in Parkinson’s disease
McCoy, B., Jahfari, S., Engels, G., Knapen, T. H. J., & Theeuwes, J. (2019) · Brain · doi:10.1093/brain/awz276 · Cited by 46
Mosley, P. E., Paliwal, S., Robinson, K., Coyne, T. J., Silburn, P. A., Tittgemeyer, M., Stephan, K. E., Breakspear, M. J., & Perry, A. (2019) · Brain · doi:10.1093/brain/awz327 · Cited by 46
Stimulation of the vagus nerve reduces learning in a go/no-go reinforcement learning task
Kühnel, A., Teckentrup, V., Neuser, M. P., Huys, Q. J. M., Burrasch, C., Walter, M., & Kroemer, N. B. (2020) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2020.03.023 · Cited by 46
The Effect of Motivation on Movement: A Study of Bradykinesia in Parkinson’s Disease
Shiner, T., Seymour, B., Symmonds, M., Dayan, P., Bhatia, K. P., & Dolan, R. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047138 · Cited by 46
Ullsperger, M. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.06.009 · Cited by 46
Aberg, K. C., Doell, K. C., & Schwartz, S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.1859-15.2015 · Cited by 46
Skelin, I., Hakstol, R., VanOyen, J., Mudiayi, D., Molina, L. A., Holec, V., Hong, N. S., Euston, D. R., McDonald, R. J., & Gruber, A. J. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12518 · Cited by 45
How Reward and Aversion Shape Motivation and Decision Making: A Computational Account
Verharen, J. P. H., Adan, R. A. H., & Vanderschuren, L. J. M. J. (2019) · The Neuroscientist · doi:10.1177/1073858419834517 · Cited by 45
Adaptive Learning Recommendation Strategy Based on Deep Q-learning
Tan, C., Han, R., Ye, R., & Chen, K. (2019) · Applied Psychological Measurement · doi:10.1177/0146621619858674 · Cited by 45
Context-sensitive valuation and learning
Hunter, L. E., & Daw, N. D. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.05.001 · Cited by 45
Nackaerts, E., Vervoort, G., Heremans, E., Smits-Engelsman, B. C. M., Swinnen, S. P., & Nieuwboer, A. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.01.015 · Cited by 45
Is apathy a valid and meaningful symptom or syndrome in Parkinson's disease? A critical review.
Bogart, K. R. (2011) · Health Psychology · doi:10.1037/a0022851 · Cited by 45
Nagy, H., Kéri, S., Myers, C. E., Benedek, G., Shohamy, D., & Gluck, M. A. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.10.017 · Cited by 45
Approach and avoidance learning in obsessive-compulsive disorder
Endrass, T., Kloft, L., Kaufmann, C., & Kathmann, N. (2011) · Depression and Anxiety · doi:10.1002/da.20772 · Cited by 44
Decision-making impairments in breast cancer patients treated with tamoxifen
Chen, X., Li, J., Chen, J., Li, D., Ye, R., Zhang, J., Zhu, C., Tian, Y., & Wang, K. (2014) · Hormones and Behavior · doi:10.1016/j.yhbeh.2014.07.005 · Cited by 44
“These focal basal ganglia lesions have distinct roles in decision-making (Frank et al., 2004, 2007) that affects reward-based learning (Bellebaum et al., 2008).”
Approach–withdrawal and the role of the striatum in the temperament of behavioral inhibition.
Helfinstein, S. M., Fox, N. A., & Pine, D. S. (2012) · Developmental Psychology · doi:10.1037/a0026402 · Cited by 44
Dopamine levels modulate the updating of tastant values
Costa, R. M., Gutierrez, R., De Araujo, I. E., Coelho, M. R. P., Kloth, A. D., Gainetdinov, R. R., Caron, M. G., Nicolelis, M. A. L., & Simon, S. A. (2007) · Genes, Brain and Behavior · doi:10.1111/j.1601-183x.2006.00257.x · Cited by 44
A Computational Model of Dual Competition between the Basal Ganglia and the Cortex
Topalidou, M., Kase, D., Boraud, T., & Rougier, N. P. (2018) · eNeuro · doi:10.1523/eneuro.0339-17.2018 · Cited by 44
Comparing the effects of positive and negative feedback in information-integration category learning
Freedberg, M., Glass, B. D., Filoteo, J. V., Hazeltine, E., & Maddox, W. T. (2016) · Memory & Cognition · doi:10.3758/s13421-016-0638-3 · Cited by 44
Clinical Applications of Stochastic Dynamic Models of the Brain, Part I: A Primer
Roberts, J. A., Friston, K. J., & Breakspear, M. J. (2017) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2017.01.010 · Cited by 44
Kovaleski, R. F., Callahan, J. W., Chazalon, M., Wokosin, D. L., Baufreton, J., & Bevan, M. D. (2020) · The Journal of Physiology · doi:10.1113/jp279232 · Cited by 44
Impulsivity and Compulsivity After Subthalamic Deep Brain Stimulation for Parkinson’s Disease
Scherrer, S., Smith, A. H., Gowatsky, J., Palmese, C. A., Shahed, J. J., Kopell, B. H., Mayberg, H. S., & Figee, M. (2020) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.00047 · Cited by 44
A Story of Two Streams: Reinforcement Learning Models from Human Behavior and Neuropsychiatry
Lin, B., Cecchi, G., Bouneffouf, D., Reinen, J., & Rish, I. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/hbij1736 · Cited by 44
Role of dopamine and clinical heterogeneity in cognitive dysfunction in Parkinson's disease
Cools, R., Tichelaar, J. G., Helmich, R. C. G., Bloem, B. R., Esselink, R. A. J., Smulders, K., & Timmer, M. H. M. (2022) · Progress in brain research · doi:10.1016/bs.pbr.2022.01.012 · Cited by 44
Adaptive control of synaptic plasticity integrates micro- and macroscopic network function
Scott, D. N., & Frank, M. J. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-022-01374-6 · Cited by 44
Self-citationde Vries, M. H., Ulte, C., Zwitserlood, P., Szymanski, B., & Knecht, S. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.06.024 · Cited by 44
Poletti, M., & Bonuccelli, U. (2012) · Brain and Cognition · doi:10.1016/j.bandc.2012.02.002 · Cited by 44
Serotonin modulates asymmetric learning from reward and punishment in healthy human volunteers
Michely, J., Eldar, E., Erdman, A., Martin, I. M., & Dolan, R. J. (2022) · Communications Biology · doi:10.1038/s42003-022-03690-5 · Cited by 43
Motivational Context Modulates Prediction Error Response in Schizophrenia
Reinen, J. M., Van Snellenberg, J. X., Horga, G., Abi-Dargham, A., Daw, N. D., & Shohamy, D. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw045 · Cited by 43
Umemoto, A., Lukie, C. N., Kerns, K. A., Müller, U., & Holroyd, C. B. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0298-3 · Cited by 43
Jessup, R. K., & O’Doherty, J. P. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6421-10.2011 · Cited by 43
Ferrazzoli, D., Carter, A., Üstün, F. S., Palamara, G., Ortelli, P., Maestri, R., Yücel, M., & Frazzitta, G. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00121 · Cited by 43
The Neural Basis of Always Looking on the Bright Side
O’Sullivan, O. P. (2015) · Dialogues in philosophy mental and neuro sciences · Cited by 43
Distinct roles of striatal direct and indirect pathways in value-based decision making
Kwak, S., & Jung, M. W. (2019) · eLife · doi:10.7554/elife.46050 · Cited by 43
Acute stress enhances tolerance of uncertainty during decision-making
Byrne, K. A., Peters, C., Willis, H. C., Phan, D., Cornwall, A. C., & Worthy, D. A. (2020) · Cognition · doi:10.1016/j.cognition.2020.104448 · Cited by 43
Metadata
- Authors
- Frank, M. J., Seeberger, L. C., & O'Reilly, R. C.
- Affiliations
- University of Colorado Boulder (US)
- Department of Psychology and Center for Neuroscience, University of Colorado Boulder, Boulder, CO 80309–0345, USA.
- Corresponding author
- Frank, Michael J.
- Venue
- Science
- Published
- 2004-12-10
- Volume
- 306
- Issue
- 5703
- Pages
- 1940-1943
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2163647009
- Cited by
- 1,964
- References
- 33
- Citations by year
- 2026: 57 · 2025: 73 · 2024: 83 · 2023: 79 · 2022: 91 · 2021: 99 · 2020: 134 · 2019: 104 · 2018: 125 · 2017: 111 · 2016: 115 · 2015: 111 · 2014: 134 · 2013: 111 · 2012: 108
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH069597, MH 069597-01)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Clinical Neurology › Parkinson's Disease Mechanisms and Treatments
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- Parkinson's disease, parkinsonism, dopamine, basal ganglia, positive reinforcement, negative reinforcement, avoidance learning, procedural learning, computational model, trial-and-error learning
- MeSH terms
- Aged, Antiparkinson Agents, Basal Ganglia, Cognition, Computer Simulation, Dopamine, Female, Frontal Lobe, Humans, Learning, Male, Middle Aged, Models, Neurological, Parkinson Disease, Probability, Reinforcement, Psychology, Matched-Pair Analysis, Feedback, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.