By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To what extent do we learn from the positive versus negative outcomes of our decisions? The neuromodulator dopamine plays a key role in these reinforcement learning processes. Patients with Parkinson's disease, who have depleted dopamine in the basal ganglia, are impaired in tasks that require learning from trial and error. Here, we show, using two cognitive procedural learning tasks, that Parkinson's patients off medication are better at learning to avoid choices that lead to negative outcomes than they are at learning from positive outcomes. Dopamine medication reverses this bias, making patients more sensitive to positive than negative outcomes. This pattern was predicted by our biologically based computational model of basal ganglia–dopamine interactions in cognition, which has separate pathways for “Go” and “NoGo” responses that are differentially modulated by positive and negative reinforcement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neural mechanisms underlying decision making and learning involve fronto-striatal networks generating reward prediction errors which are highly sensitive to dopaminergic modulation (Frank et al. 2004; Kehagia et al. 2010; Schultz and Dickinson 2000).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Frank et al. 2004
In the citing paper
“Operant learning is, however, known to be impaired in PD (Avila et al., 2009; Frank et al., 2004; Rushworth et al., 1998; Rutledge et al., 2009; Shohamy et al., 2005).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Frank et al., 2004
In the citing paper
“Substantial work in conditions such as Parkinson’s disease, in which dopamine is reduced, shows that manipulations favoring D1 and D2 dopamine receptors result in effects that are most readily interpretable in a model-free manner (Frank et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as Frank et al., 2004
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
Uneven Pattern of Dopamine Loss in the Striatum of Patients with Idiopathic Parkinson's Disease
Kish, S. J., Shannak, K., & Hornykiewicz, O. (1988) · New England Journal of Medicine · doi:10.1056/nejm198804073181402 · Cited by 1,953
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
A neuropsychological theory of multiple systems in category learning.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998) · Psychological Review · doi:10.1037//0033-295x.105.3.442 · Cited by 1,223
The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia
Gerfen, C. R. (1992) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.15.030192.001441 · Cited by 1,004
Cools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906
Research works printed but not linked: 6
- 10.1037/0033-295x.105.3.442 · doi:10.1037/0033-295x.105.3.442 · Paper page
- M. Frank J. Cognit. Neurosci. in press.
- R. C. O'Reilly M. J. Frank ICS Tech. Rep. University of Colorado Institute of Cognitive Science (2004).
- 10.1088/0954-898x_8_4_001 · doi:10.1088/0954-898x_8_4_001 · Paper page
- M. Frank J. Rudy W. Levy R. O'Reilly Mem. Cognit. in press.
- 10.1037/0097-7403.17.3.334 · doi:10.1037/0097-7403.17.3.334 · Paper page
Cited by
Items 401–500 of 1,007
Palminteri, S., Lebreton, M., Worbe, Y., Hartmann, A., Lehéricy, S., Vidailhet, M., Grabli, D., & Pessiglione, M. (2011) · Brain · doi:10.1093/brain/awr147 · Cited by 90
Social stress reactivity alters reward and punishment learning
Cavanagh, J. F., Frank, M. J., & Allen, J. J. B. (2011) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq041 · Cited by 90
Self-citationRecreational cocaine polydrug use impairs cognitive flexibility but not working memory
Colzato, L. S., Huizinga, M., & Hommel, B. (2009) · Psychopharmacology · doi:10.1007/s00213-009-1650-0 · Cited by 90
Risk and learning in impulsive and nonimpulsive patients with Parkinson's disease
Djamshidian, A., Jha, A., O'Sullivan, S. S., Silveira‐Moriyama, L., Jacobson, C., Brown, P., Lees, A., & Averbeck, B. B. (2010) · Movement Disorders · doi:10.1002/mds.23247 · Cited by 90
Motivational Deficits in Schizophrenia and the Representation of Expected Value
Waltz, J. A., & Gold, J. M. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_385 · Cited by 76
Tamburin, S., Maier, A., Schiff, S., Lauriola, M. F., Rosa, E. D., Zanette, G., & Mapelli, D. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01350 · Cited by 90
A tutorial on joint models of neural and behavioral measures of cognition
Palestro, J. J., Bahg, G., Sederberg, P. B., Lu, Z., Steyvers, M., & Turner, B. M. (2018) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2018.03.003 · Cited by 90
van den Bos, W. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.052.2009 · Cited by 89
Focal basal ganglia lesions are associated with impairments in reward-based reversal learning
Bellebaum, C., Koch, B., Schwarz, M., & Daum, I. (2008) · Brain · doi:10.1093/brain/awn011 · Cited by 89
The striatum and probabilistic implicit sequence learning
Wilkinson, L., & Jahanshahi, M. (2006) · Brain Research · doi:10.1016/j.brainres.2006.12.051 · Cited by 89
Deserno, L., Boehme, R., Heinz, A., & Schlagenhauf, F. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00172 · Cited by 88
An Obesity-Predisposing Variant of the FTO Gene Regulates D2R-Dependent Reward Learning
Sevgi, M., Rigoux, L., Kuhn, A. B., Mauer, J., Schilbach, L., Hess, M. E., Gruendler, T. O. J., Ullsperger, M., Stephan, K. E., Bruning, J. C., et al. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.1589-15.2015 · Cited by 88
Nasrallah, N. A., Clark, J. J., Collins, A. L., Akers, C. A., Phillips, P. E., & Bernstein, I. L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017732108 · Cited by 87
Groman, S. M., Lee, B., London, E. D., Mandelkern, M. A., James, A. S., Feiler, K., Rivera, R., Dahlbom, M., Sossi, V., Vandervoort, E., et al. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.0363-11.2011 · Cited by 87
San Martín, R., Appelbaum, L. G., Pearson, J. M., Huettel, S. A., & Woldorff, M. G. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4242-12.2013 · Cited by 87
Kwak, Y., Müller, M. L. T. M., Bohnen, N. I., Dayalu, P., & Seidler, R. D. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00197.2009 · Cited by 87
A new model of decision processing in instrumental learning tasks
Miletić, S., Boag, R. J., Trutti, A. C., Stevenson, N., Forstmann, B. U., & Heathcote, A. (2021) · eLife · doi:10.7554/elife.63055 · Cited by 87
Gueguen, M. C. M., Lopez‐Persem, A., Billeke, P. B., Lachaux, J.-P., Rheims, S., Kahane, P., Minotti, L., David, O., Pessiglione, M., & Bastin, J. (2021) · Nature Communications · doi:10.1038/s41467-021-23704-w · Cited by 86
Frank, M. J., D’Lauro, C. J., & Curran, T. (2007) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.7.4.297 · Cited by 86
Self-citationDecision making under risk and under ambiguity in Parkinson's disease
Delazer, M., Sinz, H., Zamarian, L., Stockner, H., Seppi, K., Wenning, G. K., Benke, T., & Poewe, W. H. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.02.034 · Cited by 85
Haines, N., Vassileva, J., & Ahn, W. (2018) · Cognitive Science · doi:10.1111/cogs.12688 · Cited by 85
Mind matters: placebo enhances reward learning in Parkinson's disease
Schmidt, L., Braun, E. K., Wager, T. D., & Shohamy, D. (2014) · Nature Neuroscience · doi:10.1038/nn.3842 · Cited by 84
Integration of Reinforcement Learning and Optimal Decision-Making Theories of the Basal Ganglia
Bogacz, R., & Larsen, T. (2011) · Neural Computation · doi:10.1162/neco_a_00103 · Cited by 84
Stress attenuates the flexible updating of aversive value
Raio, C. M., Hartley, C. A., Orederu, T. A., Li, J., & Phelps, E. A. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1702565114 · Cited by 84
Hämmerer, D., & Eppinger, B. (2012) · Developmental Psychology · doi:10.1037/a0027342 · Cited by 84
The Role of Feedback in Learning and Motivation
Tricomi, E. M., & DePasque, S. (2016) · Advances in motivation and achievement · doi:10.1108/s0749-742320160000019015 · Cited by 84
Dieterich, A., Srivastava, P., Sharif, A., Stech, K., Floeder, J. R., Yohn, S. E., & Samuels, B. A. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0674-4 · Cited by 84
The Challenge of Understanding the Brain: Where We Stand in 2015
Lisman, J. (2015) · Neuron · doi:10.1016/j.neuron.2015.03.032 · Cited by 83
Hong, S., & Hikosaka, O. (2011) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2011.00015 · Cited by 83
Probabilistic reversal learning is impaired in Parkinson's disease
Peterson, D. A., Elliott, C., Song, D. D., Makeig, S., Sejnowski, T. J., & Poizner, H. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.07.033 · Cited by 83
Insights into Parkinson’s disease from computational models of the basal ganglia
Humphries, M. D., Obeso, J. A., & Dreyer, J. K. (2018) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2017-315922 · Cited by 83
Eckstein, M. K., Master, S. L., Dahl, R. E., Wilbrecht, L., & Collins, A. G. E. (2022) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2022.101106 · Cited by 83
Computational models of reinforcement learning: the role of dopamine as a reward signal
Samson, R. D., Frank, M. J., & Fellous, J. (2010) · Cognitive Neurodynamics · doi:10.1007/s11571-010-9109-x · Cited by 83
Self-citationLearning relative values in the striatum induces violations of normative decision making
Klein, T. A., Ullsperger, M., & Jocham, G. (2017) · Nature Communications · doi:10.1038/ncomms16033 · Cited by 83
Dopamine Modulates Dynamic Decision-Making during Foraging
Le Heron, C., Kolling, N., Plant, O., Kienast, A., Janska, R., Ang, Y.-S., Fallon, S., Husain, M., & Apps, M. A. J. (2020) · The Journal of Neuroscience · doi:10.1523/jneurosci.2586-19.2020 · Cited by 82
Reiter, A. M. F., Deserno, L., Kallert, T., Heinze, H.-J., Heinz, A., & Schlagenhauf, F. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.4322-15.2016 · Cited by 82
Amyloid cross-seeding raises new dimensions to understanding of amyloidogenesis mechanism
Chaudhuri, P., Prajapati, K. P., Anand, B. G., Dubey, K., & Kar, K. (2019) · Ageing Research Reviews · doi:10.1016/j.arr.2019.100937 · Cited by 82
Contextual influence on confidence judgments in human reinforcement learning
Lebreton, M., Bacily, K., Palminteri, S., & Engelmann, J. B. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006973 · Cited by 81
Apathy in Parkinson's Disease: Neurophysiological Evidence of Impaired Incentive Processing
Martínez-Horta, S., Riba, J., de Bobadilla, R. F., Pagonabarraga, J., Pascual-Sedano, B., Antonijoan, R. M., Romero, S., Mañanas, M. À., García-Sanchez, C., & Kulisevsky, J. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0251-14.2014 · Cited by 81
Distinct Hippocampal and Basal Ganglia Contributions to Probabilistic Learning and Reversal
Shohamy, D., Myers, C. E., Hopkins, R. O., Sage, J., & Gluck, M. A. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21138 · Cited by 81
Novelty seeking behaviour in Parkinson's disease
Djamshidian, A., O'Sullivan, S. S., Wittmann, B. C., Lees, A. J., & Averbeck, B. B. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.04.026 · Cited by 81
Active Inference, Evidence Accumulation, and the Urn Task
FitzGerald, T. H. B., Schwartenbeck, P., Moutoussis, M., Dolan, R. J., & Friston, K. (2015) · Neural Computation · doi:10.1162/neco_a_00699 · Cited by 81
Millard, S. J., Bearden, C. E., Karlsgodt, K. H., & Sharpe, M. J. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01188-y · Cited by 81
Amunts, K., Axer, M., Banerjee, S., Bitsch, L., Bjaalie, J. G., Brauner, P., Brovelli, A., Calarco, N., Carrère, M., Caspers, S., et al. (2024) · Imaging Neuroscience · doi:10.1162/imag_a_00137 · Cited by 81
Spontaneous eye blink rate predicts learning from negative, but not positive, outcomes
Slagter, H. A., Georgopoulou, K., & Frank, M. J. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.03.028 · Cited by 81
Self-citationOpponent Brain Systems for Reward and Punishment Learning
Palminteri, S., & Pessiglione, M. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00023-3 · Cited by 81
Liu, W.-H., Valton, V., Wang, L.-Z., Zhu, Y.-H., & Roiser, J. P. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsx074 · Cited by 80
Striatal structure and function predict individual biases in learning to avoid pain
Eldar, E., Hauser, T. U., Dayan, P., & Dolan, R. J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1519829113 · Cited by 79
Larger Error Signals in Major Depression are Associated with Better Avoidance Learning
Cavanagh, J. F., Bismark, A. J., Frank, M. J., & Allen, J. J. B. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00331 · Cited by 79
Self-citationKasanova, Z., Ceccarini, J., Frank, M. J., van Amelsvoort, T., Booij, J., Heinzel, A., Mottaghy, F. M., & Myin‐Germeys, I. (2017) · Biological Psychology · doi:10.1016/j.biopsycho.2017.04.014 · Cited by 79
Self-citationTan, H., Zavala, B., Pogosyan, A. H., Ashkan, K., Zrinzo, L. U., Foltynie, T., Limousin, P. D., & Brown, P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.3414-14.2014 · Cited by 79
The role of dopamine in risk taking: a specific look at Parkinson’s disease and gambling
Clark, C. A., & Dagher, A. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00196 · Cited by 79
Pleasurable music affects reinforcement learning according to the listener
Gold, B. P., Frank, M. J., Bogert, B., & Brattico, E. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00541 · Cited by 79
Self-citationFatigue in inflammatory rheumatic disorders: pathophysiological mechanisms
Korte, S. M., & Straub, R. H. (2019) · Rheumatology · doi:10.1093/rheumatology/kez413 · Cited by 78
Apathy in Parkinson’s Disease: Clinical Patterns and Neurobiological Basis
Béreau, M., Waes, V. V., Servant, M., Magnin, É., Tatu, L., & Anheim, M. (2023) · Cells · doi:10.3390/cells12121599 · Cited by 78
Morita, K., Morishima, M., Sakai, K., & Kawaguchi, Y. (2012) · Trends in Neurosciences · doi:10.1016/j.tins.2012.04.009 · Cited by 78
Jocham, G., Klein, T. A., & Ullsperger, M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0757-14.2014 · Cited by 78
The Functional Anatomy of Impulse Control Disorders
Probst, C. C., & van Eimeren, T. (2013) · Current Neurology and Neuroscience Reports · doi:10.1007/s11910-013-0386-8 · Cited by 77
The effects of reward and punishment on motor skill learning
Chen, X., Holland, P. J., & Galea, J. M. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.11.011 · Cited by 77
Motivational Tuning of Fronto-Subthalamic Connectivity Facilitates Control of Action Impulses
Herz, D. M., Christensen, M. S., Bruggemann, N., Hulme, O. J., Ridderinkhof, K. R., Madsen, K. H., & Siebner, H. R. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.4081-13.2014 · Cited by 76
What would my avatar do? Gaming, pathology, and risky decision making
Bailey, K., West, R., & Kuffel, J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00609 · Cited by 75
Valence-dependent influence of serotonin depletion on model-based choice strategy
Worbe, Y., Palminteri, S., Savulich, G., Daw, N. D., Fernandez-Egea, E., Robbins, T. W., & Voon, V (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.46 · Cited by 75
Kim, H. F., Ghazizadeh, A., & Hikosaka, O. (2014) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2014.00120 · Cited by 75
Thalamocingulate Interactions In Performance Monitoring
Seifert, S., von Cramon, D. Y., Imperati, D., Tittgemeyer, M., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6242-10.2011 · Cited by 75
Changes in statistical learning across development
Forest, T. A., Schlichting, M. L., Duncan, K. D., & Finn, A. S. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00157-0 · Cited by 75
Impulsive and Compulsive Behaviors in Parkinson's Disease
Averbeck, B. B., O'Sullivan, S. S., & Djamshidian, A. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153705 · Cited by 66
Mutual benefits: Combining reinforcement learning with sequential sampling models
Miletić, S., Boag, R. J., & Forstmann, B. U. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107261 · Cited by 75
The error negativity in nonmedicated and medicated patients with Parkinson’s disease
Stemmer, B., Segalowitz, S. J., Dywan, J., Panisset, M., & Melmed, C. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.02.019 · Cited by 75
Dissociable responses to punishment in distinct striatal regions during reversal learning
Robinson, O. J., Frank, M. J., Sahakian, B. J., & Cools, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.03.036 · Cited by 74
Self-citationPechtel, P., & Pizzagalli, D. A. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.728 · Cited by 74
Reduced model-based decision-making in gambling disorder
Wyckmans, F., Otto, A. R., Sebold, M., Daw, N., Bechara, A., Saeremans, M., Kornreich, C., Chatard, A., Jaafari, N., & Noël, X. (2019) · Scientific Reports · doi:10.1038/s41598-019-56161-z · Cited by 74
Cognitive and neurobiological mechanisms of the Law of General Intelligence
(2008) · Integrating the Mind · doi:10.4324/9780203926697-27 · Cited by 74
Diekhof, E. K., & Ratnayake, M. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.10.016 · Cited by 74
Disrupted iron regulation in the brain and periphery in cocaine addiction
Ersche, K. D., Acosta‐Cabronero, J., Jones, P. S., Ziauddeen, H., van Swelm, R. P. L., Laarakkers, C. M., Raha‐Chowdhury, R., & Williams, G. B. (2017) · Translational Psychiatry · doi:10.1038/tp.2016.271 · Cited by 74
Asymmetric right/left encoding of emotions in the human subthalamic nucleus
Eitan, R., Shamir, R. R., Linetsky, E., Rosenbluh, O., Moshel, S., Ben-Hur, T., Bergman, H., & Israel, Z. (2013) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2013.00069 · Cited by 73
Fuel not fun: Reinterpreting attenuated brain responses to reward in obesity
Kroemer, N. B., & Small, D. M. (2016) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.04.020 · Cited by 73
Smittenaar, P., Chase, H. W., Aarts, E., Nusselein, B., Bloem, B. R., & Cools, R. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08043.x · Cited by 73
Pedersen, M. L., & Frank, M. J. (2020) · Computational Brain & Behavior · doi:10.1007/s42113-020-00084-w · Cited by 73
Self-citation“Don't [ruminate], be happy”: A cognitive perspective linking depression and anhedonia
Rutherford, A. V., McDougle, S. D., & Joormann, J. (2023) · Clinical Psychology Review · doi:10.1016/j.cpr.2023.102255 · Cited by 75
The Neurobiology of Motivational Deficits in Depression—An Update on Candidate Pathomechanisms
Treadway, M. T. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_400 · Cited by 73
Rochat, L., Billieux, J., Gagnon, J., & Van der Linden, M. (2018) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2017.1313393 · Cited by 72
Instrumental vigour in punishment and reward
Dayan, P. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08026.x · Cited by 72
Dysfunctional and compensatory synaptic plasticity in P arkinson's disease
Schroll, H., Vitay, J., & Hamker, F. H. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12434 · Cited by 72
Intrinsic brain connectivity predicts impulse control disorders in patients with Parkinson's disease
Tessitore, A., Micco, R. D., Giordano, A., Nardo, F. D., Caiazzo, G., Siciliano, M., Stefano, M. D., Russo, A., Esposito, F., & Tedeschi, G. (2017) · Movement Disorders · doi:10.1002/mds.27139 · Cited by 72
Valence biases in reinforcement learning shift across adolescence and modulate subsequent memory
Rosenbaum, G. M., Grassie, H. L., & Hartley, C. A. (2022) · eLife · doi:10.7554/elife.64620 · Cited by 72
Aberrant reward processing in Parkinson's disease is associated with dopamine cell loss
Aarts, E., Helmich, R. C. G., Janssen, M. J. R., Oyen, W. J. G., Bloem, B. R., & Cools, R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.073 · Cited by 71
Approach, avoidance, and the detection of conflict in the development of behavioral inhibition
Barker, T. V., Buzzell, G. A., & Fox, N. A. (2018) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2018.07.001 · Cited by 71
Baker, T. E., Stockwell, T. R., Barnes, G. E., & Holroyd, C. B. (2010) · Addiction Biology · doi:10.1111/j.1369-1600.2010.00243.x · Cited by 70
Modeling the organization of the basal ganglia
Yelnik, J. (2008) · Revue Neurologique · doi:10.1016/j.neurol.2008.04.019 · Cited by 70
Aging and the neuroeconomics of decision making: A review
Brown, S. B. R. E., & Ridderinkhof, K. R. (2009) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.9.4.365 · Cited by 70
Effects of dopamine on reinforcement learning and consolidation in Parkinson’s disease
Grogan, J. P., Tsivos, D., Smith, L., Knight, B. E., Bogacz, R., Whone, A. L., & Coulthard, E. J. (2017) · eLife · doi:10.7554/elife.26801 · Cited by 70
Chronic Exposure to Methamphetamine Disrupts Reinforcement-Based Decision Making in Rats
Groman, S. M., Rich, K. M., Smith, N. J., Lee, D., & Taylor, J. R. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.159 · Cited by 70
Asl, M. M., Vahabie, A., & Valizadeh, A. (2018) · Basic and Clinical Neuroscience Journal · doi:10.32598/bcn.9.10.125 · Cited by 70
Proteomic Analysis of the Silkworm (Bombyx mori L.) Hemolymph during Developmental Stage
Li, X., Wu, X., Yue, W., Liu, J., Li, & Miao, Y. (2006) · Journal of Proteome Research · doi:10.1021/pr0603093 · Cited by 70
Human Medial Frontal Cortex Activity Predicts Learning from Errors
Hester, R., Barre, N., Murphy, K., Silk, T. J., & Mattingley, J. B. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm219 · Cited by 69
Reward processing in neurodegenerative disease
Perry, D. C., & Kramer, J. H. (2015) · Neurocase · doi:10.1080/13554794.2013.873063 · Cited by 69
Dunovan, K., & Verstynen, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00106 · Cited by 69
Garcia, B., Cerrotti, F., & Palminteri, S. (2021) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2019.0665 · Cited by 69
The effects of positive versus negative feedback on information-integration category learning
Ashby, F. G., & O’Brien, J. B. (2007) · Perception & Psychophysics · doi:10.3758/bf03193923 · Cited by 69
Adaptive learning is structure learning in time
Yu, L. Q., Wilson, R. C., & Nassar, M. R. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.024 · Cited by 68
Metadata
- Authors
- Frank, M. J., Seeberger, L. C., & O'Reilly, R. C.
- Affiliations
- University of Colorado Boulder (US)
- Department of Psychology and Center for Neuroscience, University of Colorado Boulder, Boulder, CO 80309–0345, USA.
- Corresponding author
- Frank, Michael J.
- Venue
- Science
- Published
- 2004-12-10
- Volume
- 306
- Issue
- 5703
- Pages
- 1940-1943
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2163647009
- Cited by
- 1,964
- References
- 33
- Citations by year
- 2026: 57 · 2025: 73 · 2024: 83 · 2023: 79 · 2022: 91 · 2021: 99 · 2020: 134 · 2019: 104 · 2018: 125 · 2017: 111 · 2016: 115 · 2015: 111 · 2014: 134 · 2013: 111 · 2012: 108
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH069597, MH 069597-01)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Clinical Neurology › Parkinson's Disease Mechanisms and Treatments
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- Parkinson's disease, parkinsonism, dopamine, basal ganglia, positive reinforcement, negative reinforcement, avoidance learning, procedural learning, computational model, trial-and-error learning
- MeSH terms
- Aged, Antiparkinson Agents, Basal Ganglia, Cognition, Computer Simulation, Dopamine, Female, Frontal Lobe, Humans, Learning, Male, Middle Aged, Models, Neurological, Parkinson Disease, Probability, Reinforcement, Psychology, Matched-Pair Analysis, Feedback, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.