By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To what extent do we learn from the positive versus negative outcomes of our decisions? The neuromodulator dopamine plays a key role in these reinforcement learning processes. Patients with Parkinson's disease, who have depleted dopamine in the basal ganglia, are impaired in tasks that require learning from trial and error. Here, we show, using two cognitive procedural learning tasks, that Parkinson's patients off medication are better at learning to avoid choices that lead to negative outcomes than they are at learning from positive outcomes. Dopamine medication reverses this bias, making patients more sensitive to positive than negative outcomes. This pattern was predicted by our biologically based computational model of basal ganglia–dopamine interactions in cognition, which has separate pathways for “Go” and “NoGo” responses that are differentially modulated by positive and negative reinforcement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neural mechanisms underlying decision making and learning involve fronto-striatal networks generating reward prediction errors which are highly sensitive to dopaminergic modulation (Frank et al. 2004; Kehagia et al. 2010; Schultz and Dickinson 2000).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Frank et al. 2004
In the citing paper
“Operant learning is, however, known to be impaired in PD (Avila et al., 2009; Frank et al., 2004; Rushworth et al., 1998; Rutledge et al., 2009; Shohamy et al., 2005).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Frank et al., 2004
In the citing paper
“Substantial work in conditions such as Parkinson’s disease, in which dopamine is reduced, shows that manipulations favoring D1 and D2 dopamine receptors result in effects that are most readily interpretable in a model-free manner (Frank et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as Frank et al., 2004
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
Uneven Pattern of Dopamine Loss in the Striatum of Patients with Idiopathic Parkinson's Disease
Kish, S. J., Shannak, K., & Hornykiewicz, O. (1988) · New England Journal of Medicine · doi:10.1056/nejm198804073181402 · Cited by 1,953
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
A neuropsychological theory of multiple systems in category learning.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998) · Psychological Review · doi:10.1037//0033-295x.105.3.442 · Cited by 1,223
The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia
Gerfen, C. R. (1992) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.15.030192.001441 · Cited by 1,004
Cools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906
Research works printed but not linked: 6
- 10.1037/0033-295x.105.3.442 · doi:10.1037/0033-295x.105.3.442 · Paper page
- M. Frank J. Cognit. Neurosci. in press.
- R. C. O'Reilly M. J. Frank ICS Tech. Rep. University of Colorado Institute of Cognitive Science (2004).
- 10.1088/0954-898x_8_4_001 · doi:10.1088/0954-898x_8_4_001 · Paper page
- M. Frank J. Rudy W. Levy R. O'Reilly Mem. Cognit. in press.
- 10.1037/0097-7403.17.3.334 · doi:10.1037/0097-7403.17.3.334 · Paper page
Cited by
Items 901–1,000 of 1,007
A Neural Mechanism for the Opportunity Cost of TimePreprint
Constantino, S. M., Dalrymple, J., Gilbert, R., Varanese, S., Rocco, A. D., & Daw, N. D. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/173443 · Cited by 29
Sensitivity to value-driven attention is predicted by how we learn from value
Jahfari, S., & Theeuwes, J. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1106-6 · Cited by 28
Linking confidence biases to reinforcement-learning processes.
Salem-Garcia, N., Palminteri, S., & Lebreton, M. (2023) · Psychological Review · doi:10.1037/rev0000424 · Cited by 28
Valence precedes value in neural encoding of prediction error
Stewardson, H. J., & Sambrook, T. D. (2023) · Psychophysiology · doi:10.1111/psyp.14266 · Cited by 28
Sojitra, R. B., Lerner, I., Petok, J. R., & Gluck, M. A. (2018) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2018.04.006 · Cited by 28
Girard, B., Liénard, J., Gutierrez, C. E., Delord, B., & Doya, K. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14869 · Cited by 28
Neural interactions in the human frontal cortex dissociate reward and punishment learning
Combrisson, E., Basanisi, R., Gueguen, M. C. M., Rheims, S., Kahane, P., Bastin, J., & Brovelli, A. (2024) · eLife · doi:10.7554/elife.92938 · Cited by 28
Šabanović, M., Lazari, A., Blanco-Pozo, M., Tisca, C., Tachrount, M., Martins-Bach, A. B., Lerch, J. P., Walton, M. E., & Bannerman, D. M. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02439-2 · Cited by 28
A delta-rule model of numerical and non-numerical order processing.
Verguts, T., & Opstal, F. V. (2014) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0035114 · Cited by 28
Wagenbreth, C., Zaehle, T., Galazky, I., Voges, J., Guitart‐Masip, M., Heinze, H., & Düzel, E. (2015) · Journal of Neurology · doi:10.1007/s00415-015-7749-9 · Cited by 28
Dopamine, Salience, and Response Set Shifting in Prefrontal Cortex
Shiner, T., Symmonds, M., Guitart‐Masip, M., Fleming, S. M., Friston, K. J., & Dolan, R. J. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu210 · Cited by 28
Hyperbilirubinemia: Subcortical Mechanisms of Cognitive and Behavioral Dysfunction
Koziol, L. F., Budding, D. E., & Chidekel, D. (2013) · Pediatric Neurology · doi:10.1016/j.pediatrneurol.2012.06.019 · Cited by 28
Ruiz, M. H., Huebl, J., Schönecker, T., Kupsch, A. R., Yarrow, K., Krauss, J. K., Schneider, G., & Kühn, A. A. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht002 · Cited by 28
Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment
Kwak, S., Huh, N., Seo, J.-S., Lee, J.-E., Han, P., & Jung, M. W. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00368 · Cited by 28
Reinforcement Learning Performance and Risk for Psychosis in Youth
Waltz, J. A., Demro, C., Schiffman, J. E., Thompson, E., Kline, E. R., Reeves, G. M., Xu, Z., & Gold, J. M. (2015) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000420 · Cited by 28
Reducing failures of working memory with performance feedback
Adam, K. C. S., & Vogel, E. K. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1019-4 · Cited by 28
Striatal prediction errors support dynamic control of declarative memory decisions
Scimeca, J. M., Katzman, P. L., & Badre, D. (2016) · Nature Communications · doi:10.1038/ncomms13061 · Cited by 28
Nakamura, T., Nagata, M., Yagi, T., Graybiel, A. M., Yamamori, T., & Kitsukawa, T. (2017) · European Journal of Neuroscience · doi:10.1111/ejn.13537 · Cited by 28
The Neuroscience of Human Decision-Making Through the Lens of Learning and Memory
Fellows, L. K. (2016) · Current topics in behavioral neurosciences · doi:10.1007/7854_2016_468 · Cited by 28
Dopaminergic Drug Effects on Probability Weighting during Risky Decision Making
Ojala, K. E., Janssen, L. K., Hashemi, M. M., Timmer, M. H. M., Geurts, D. E. M., ter Huurne, N. P., Cools, R., & Sescousse, G. (2018) · eNeuro · doi:10.1523/eneuro.0330-18.2018 · Cited by 28
Complex Dynamics in the Basal Ganglia: Health and Disease Beyond the Motor System
Andrés, D. S., & Darbin, O. (2017) · Journal of Neuropsychiatry · doi:10.1176/appi.neuropsych.17020039 · Cited by 28
Smoking Decisions: Altered Reinforcement Learning Signals Induced by Nicotine State
Baker, T. E., Zeighami, Y., Dagher, A., & Holroyd, C. B. (2018) · Nicotine & Tobacco Research · doi:10.1093/ntr/nty136 · Cited by 28
Dopaminergic contribution to cognitive sequence learning
Nagy, O., Kelemen, O., Benedek, G., Myers, C. E., Shohamy, D., Gluck, M. A., & Kéri, S. (2007) · Journal of Neural Transmission · doi:10.1007/s00702-007-0654-3 · Cited by 28
Richter, A., Guitart‐Masip, M., Barman, A., Libeau, C., Behnisch, G., Czerney, S., Schanze, D., Assmann, A., Klein, M., Düzel, E., et al. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00140 · Cited by 28
Mathar, D., Wilkinson, L., Holl, A. K., Neumann, J., Deserno, L., Villringer, A., Jahanshahi, M., & Horstmann, A. (2016) · Cortex · doi:10.1016/j.cortex.2016.09.004 · Cited by 27
Porter‐Stransky, K. A., Seiler, J. L., Day, J. J., & Aragona, B. J. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12253 · Cited by 27
C957T polymorphism of the dopamine D2 receptor gene is associated with motor learning and heart rate
Huertas, E., Bühler, K., Echeverry-Alzate, V., Giménez, T., & López-Moreno, J. (2012) · Genes, Brain and Behavior · doi:10.1111/j.1601-183x.2012.00793.x · Cited by 30
Linking Across Levels of Computation in Model-Based Cognitive Neuroscience
Frank, M. J. (2015) · Springer eBooks · doi:10.1007/978-1-4939-2236-9_8 · Cited by 27
Self-citationCocker, P. J., Tremblay, M., Kaur, S., & Winstanley, C. A. (2016) · Psychopharmacology · doi:10.1007/s00213-016-4447-y · Cited by 27
Cardiac Concomitants of Feedback and Prediction Error Processing in Reinforcement Learning
Kastner, L., Kube, J., Villringer, A., & Neumann, J. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00598 · Cited by 27
When decisions talk: computational phenotyping of motivation disorders
Pessiglione, M., Bouc, R. L., & Vinckier, F. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.12.014 · Cited by 27
Using rodents to model abnormal sensitivity to feedback in depression
Ryguła, R., Noworyta, K., Drozd, R., & Kozub, A. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.10.008 · Cited by 27
Filip, P., Linhartová, P., Hlavatá, P., Šumec, R., Baláž, M., Bareš, M., & Kašpárek, T. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00462 · Cited by 27
Reduced striatal activation in response to rewarding motor performance feedback after stroke
Widmer, M., Lutz, K., & Luft, A. R. (2019) · NeuroImage Clinical · doi:10.1016/j.nicl.2019.102036 · Cited by 27
Experience‐related enhancements in striatal temporal encoding
Bruce, R. A., Weber, M. A., Volkman, R. A., Oya, M., Emmons, E. B., Kim, Y.-C., & Narayanan, N. S. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15344 · Cited by 27
Abouzari, M., Oberg, S., Gruber, A. J., & Tata, M. S. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.05.041 · Cited by 27
Reward learning deficits in Parkinson's disease depend on depression
Timmer, M. H. M., Sescousse, G., van der Schaaf, M. E., Esselink, R. A. J., & Cools, R. (2017) · Psychological Medicine · doi:10.1017/s0033291717000769 · Cited by 27
Adaptive Cost-Benefit Control Fueled by Striatal Dopamine
Frank, M. J. (2025) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-112723-025228 · Cited by 26
Self-citationHuman variation in error-based and reinforcement motor learning is associated with entorhinal volume
de Brouwer, A. J., Areshenkoff, C. N., Rashid, M. R., Flanagan, J. R., Poppenk, J., & Gallivan, J. P. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab424 · Cited by 26
Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders
Liebenow, B., Jones, R., DiMarco, E. K., Trattner, J. D., Humphries, J. B., Sands, L. P., Spry, K. P., Johnson, C. K., Farkas, E. B., Jiang, A., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.886297 · Cited by 26
Effects of cholinesterase inhibition on attention and working memory in Lewy body dementias
Fallon, S. J., Plant, O., Tabi, Y. A., Manohar, S., & Husain, M. (2023) · Brain Communications · doi:10.1093/braincomms/fcad207 · Cited by 26
Changes of procedural learning in Chinese patients with non-demented Parkinson disease
Wang, X., Sun, B., & Ding, H. (2008) · Neuroscience Letters · doi:10.1016/j.neulet.2008.10.086 · Cited by 26
Split Q Learning: Reinforcement Learning with Two-Stream Rewards
Lin, B., Bouneffouf, D., & Cecchi, G. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/913 · Cited by 26
Mansouri, F., Shanbour, A., Mazza, F., Fettes, P., Zariffa, J., & Downar, J. H. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01181 · Cited by 26
From the Reward Circuit to the Valuation System: How the Brain Motivates Behavior
Pessiglione, M., & Lebreton, M. P. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1236-0_11 · Cited by 26
Fluchère, F., Deveaux, M., Burle, B., Vidal, F., van den Wildenberg, W. P. M., Witjas, T., Eusébio, A., Azulay, J., & Hasbroucq, T. (2014) · Psychopharmacology · doi:10.1007/s00213-014-3805-x · Cited by 26
Apathy and noradrenaline: silent partners to mild cognitive impairment in Parkinson's disease?
Loued‐Khenissi, L., & Preuschoff, K. (2015) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000218 · Cited by 26
Tinnitus dopaminergic pathway. Ear noises treatment by dopamine modulation
López-González, M. A., & Esteban‐Ortega, F. (2005) · Medical Hypotheses · doi:10.1016/j.mehy.2005.02.016 · Cited by 26
Do Artificial Reinforcement-Learning Agents Matter Morally?Preprint
Tomasik, B. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.8233 · Cited by 26
Distinct value encoding in striatal direct and indirect pathways during adaptive learningPreprint
Donahue, C. H., Liu, M. B., & Kreitzer, A. C. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/277855 · Cited by 26
Unified Models of Human Behavioral Agents in Bandits, Contextual Bandits and RLPreprint
Lin, B., Cecchi, G., Bouneffouf, D., Reinen, J., & Rish, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.04544 · Cited by 26
Mesocorticolimbic Connectivity and Volumetric Alterations in DCC Mutation Carriers
Vosberg, D. E., Zhang, Y., Menegaux, A., Chalupa, A., Manitt, C., Zehntner, S., Eng, C., DeDuck, K., Allard, D., Durand, F., et al. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.3251-17.2018 · Cited by 25
Monfardini, E., Gaveau, V., Boussaoud, D., Hadj‐Bouziane, F., & Meunier, M. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00127 · Cited by 25
Computational Modeling for Neuropsychological Assessment of Bradyphrenia in Parkinson’s Disease
Steinke, A., Lange, F., Seer, C., Hendel, M. K., & Kopp, B. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9041158 · Cited by 25
The elusive effects of incidental anxiety on reinforcement-learning.
Ting, C.-C., Palminteri, S., Lebreton, M. P., & Engelmann, J. B. (2021) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001033 · Cited by 25
Untested assumptions perpetuate stereotyping: Learning in the absence of evidence
Cox, W. T. L., Xie, X., & Devine, P. G. (2022) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2022.104380 · Cited by 25
Impulse control disorder in Parkinson’s disease is associated with abnormal frontal value signalling
Tichelaar, J. G., Sayalı, C., Helmich, R. C. G., & Cools, R. (2023) · Brain · doi:10.1093/brain/awad162 · Cited by 25
Vrizzi, S., Najar, A., Lemogne, C., Palminteri, S., & Lebreton, M. P. (2025) · Nature Mental Health · doi:10.1038/s44220-025-00427-1 · Cited by 25
Pinto, S. R., & Uchida, N. (2025) · Nature Communications · doi:10.1038/s41467-025-62280-1 · Cited by 25
Vo, A., Hiebert, N. M., Seergobin, K. N., Solcz, S., Partridge, A., & MacDonald, P. A. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00784 · Cited by 25
Maroteaux, M. J., Valjent, E., Longueville, S., Topilko, P., Girault, J., & Hervé, D. (2014) · PLoS ONE · doi:10.1371/journal.pone.0081868 · Cited by 25
Preparing for (valenced) action: The role of differential effort in the orthogonalized go/no‐go task
Schevernels, H., Bombeke, K., Krebs, R. M., & Boehler, C. N. (2015) · Psychophysiology · doi:10.1111/psyp.12558 · Cited by 25
Time on timing: Dissociating premature responding from interval sensitivity in Parkinson's disease
Zhang, J., Nombela, C., Wolpe, N., Barker, R. A., & Rowe, J. B. (2016) · Movement Disorders · doi:10.1002/mds.26631 · Cited by 25
Probabilistic Category Learning and Striatal Functional Activation in Psychosis Risk
Karcher, N. R., Hua, J. P. Y., & Kerns, J. G. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby033 · Cited by 25
Exploring the Neurophysiological Effects of Self-Controlled Practice in Motor Skill Learning
Leiker, A. M., Pathania, A., Miller, M. W., & Lohse, K. R. (2018) · Journal of Motor Learning and Development · doi:10.1123/jmld.2017-0051 · Cited by 25
Reinforcement Learning during Adolescence in Rats
Afshar, N. M., Keip, A. J., Taylor, J. R., Lee, D., & Groman, S. M. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0910-20.2020 · Cited by 25
Episodic memory governs choices: An RNN-based reinforcement learning model for decision-making task
Zhang, X., Liu, L., Long, G., Jiang, J. B., & Liu, S. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.11.003 · Cited by 25
Different depression: motivational anhedonia governs antidepressant efficacy in Huntington’s disease
McLauchlan, D. J., Lancaster, T. M., Craufurd, D., Linden, D. E. J., & Rosser, A. (2022) · Brain Communications · doi:10.1093/braincomms/fcac278 · Cited by 25
Piccart, E., Gantois, I., Laeremans, A., Hoogt, R. D., Meert, T. F., Vanhoof, G., Arckens, L., & D’Hooge, R. (2010) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2010.11.018 · Cited by 25
Beste, C., Humphries, M. D., & Saft, C. (2014) · NeuroImage Clinical · doi:10.1016/j.nicl.2014.04.003 · Cited by 25
Neuroscience: Impaired Decision-Making in Parkinson’s Disease
Herz, D. M., Bogacz, R., & Brown, P. (2016) · Current Biology · doi:10.1016/j.cub.2016.05.075 · Cited by 25
Slooten, J. C. V., Jahfari, S., Knapen, T. H. J., & Theeuwes, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0185665 · Cited by 25
Reckless generosity in Parkinson's disease
O’Sullivan, S. S., Evans, A. H., Quinn, N. P., Lawrence, A. D., & Lees, A. J. (2010) · Movement Disorders · doi:10.1002/mds.22687 · Cited by 25
Reinforcement learning and higher level cognition: Introduction to special issue
Daw, N. D., & Frank, M. J. (2009) · Cognition · doi:10.1016/j.cognition.2009.09.005 · Cited by 25
Self-citationThe neuroscience of mental illness: Building toward the future
Gordon, J. A., Dzirasa, K., & Petzschner, F. H. (2024) · Cell · doi:10.1016/j.cell.2024.09.028 · Cited by 24
Acquisition learning is stronger for aversive than appetitive events
van der Schaaf, M. E., Schmidt, K., Kaur, J., Gamer, M., Wiech, K., Forkmann, K., & Bingel, U. (2022) · Communications Biology · doi:10.1038/s42003-022-03234-x · Cited by 24
Performance of a motor task learned on levodopa deteriorates when subsequently practiced off
Anderson, E., Horak, F. B., Lasarev, M. R., & Nutt, J. G. (2013) · Movement Disorders · doi:10.1002/mds.25702 · Cited by 24
Ilango, A., Wetzel, W., Scheich, H., & Ohl, F. W. (2010) · Neuroscience · doi:10.1016/j.neuroscience.2010.01.010 · Cited by 24
Kobza, S., & Bellebaum, C. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.10.036 · Cited by 24
Reward and punishment learning in daily life: A replication study
Heininga, V. E., van Roekel, E., Wichers, M., & Oldehinkel, A. J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180753 · Cited by 24
Voegler, R., Peterburs, J., Bellebaum, C., & Straube, T. (2019) · Scientific Reports · doi:10.1038/s41598-019-41268-0 · Cited by 24
Modeling the effects of motivation on choice and learning in the basal ganglia
van Swieten, M. M. H., & Bogacz, R. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007465 · Cited by 24
Biernacki, K., Lin, M., & Baker, T. E. (2020) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2020.08.008 · Cited by 24
Wiehler, A., & Peters, J. (2024) · Computational Psychiatry · doi:10.5334/cpsy.104 · Cited by 24
Motivation modulates motor-related feedback activity in the human basal ganglia
Kühn, A. A., Brücke, C., Hübl, J., Schneider, G., Kupsch, A. R., Eusébio, A., Ashkan, K., Holland, P. W. H., Aziz, T. Z., Vandenberghe, W., et al. (2008) · Current Biology · doi:10.1016/j.cub.2008.06.003 · Cited by 24
The impact of stress on feedback and error processing during behavioral adaptation
Glienke, K., Wolf, O. T., & Bellebaum, C. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.04.004 · Cited by 24
Patients with schizophrenia show increased aversion to angry faces in an associative learning task
Evans, S., Shergill, S. S., Chouhan, V., Bristow, E., Collier, T., & Averbeck, B. B. (2010) · Psychological Medicine · doi:10.1017/s0033291710001960 · Cited by 24
Combrisson, E., Basanisi, R., Neri, M., Auzias, G., Petri, G., Marinazzo, D., Panzeri, S., & Brovelli, A. (2025) · Nature Communications · doi:10.1038/s41467-025-62507-1 · Cited by 23
Trust your gut: vagal nerve stimulation in humans improves reinforcement learning
Weber, I., Niehaus, H., Krause, K., Molitor, L., Peper, M., Schmidt, L., Hakel, L., Timmermann, L., Menzler, K., Knake, S., et al. (2021) · Brain Communications · doi:10.1093/braincomms/fcab039 · Cited by 23
Waltmann, M., Herzog, N., Reiter, A. M. F., Villringer, A., Horstmann, A., & Deserno, L. (2023) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2023.101226 · Cited by 23
NSF DARE—transforming modeling in neurorehabilitation: a patient-in-the-loop framework
Cashaback, J. G. A., Allen, J. L., Chou, A. H. Y., Lin, D. J., Price, M. A., Katic, N., Song, S., Zhang, H., & Miller, H. L. (2024) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-024-01318-9 · Cited by 23
Encoding of sequence boundaries in the subthalamic nucleus of patients with Parkinson’s disease
Ruiz, M. H., Rusconi, M., Brücke, C., Haynes, J., Schönecker, T., & Kühn, A. A. (2014) · Brain · doi:10.1093/brain/awu191 · Cited by 23
Ridderinkhof, K. R., van Wouwe, N. C., Band, G. P. H., Wylie, S. A., der Stigchel, S. V., van Hees, P., Buitenweg, J. I. V., van de Vijver, I., & van den Wildenberg, W. P. M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00185 · Cited by 23
The striatum and beyond: contributions of the hippocampus to decision making
Wimmer, G. E., & Shohamy, D. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199600434.003.0013 · Cited by 23
Slagter, H. A., van Wouwe, N. C., Kanoff, K. E., Grasman, R. P. P. P., Claassen, D. O., van den Wildenberg, W. P. M., & Wylie, S. A. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.09.006 · Cited by 23
Knowlton, B. J., & Moody, T. D. (2008) · Elsevier eBooks · doi:10.1016/b978-012370509-9.00123-6 · Cited by 23
O'Connor, D. A., Rossiter, S., Yücel, M., Lubman, D. I., & Hester, R. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.05.040 · Cited by 22
“…the reduction in prepotency offered by limiting the amount of attentional resources allocated to the processing of alluring No-go targets, this effect may also influence the relative potentiation of Go and No-go pathways such that the detection of Go targets is more efficient (Frank et al., 2004).”
Gendron, M., Mesquita, B., & Barrett, L. F. (2020) · Culture, Mind, and Brain · doi:10.1017/9781108695374.010 · Cited by 20
Strategic cognitive sequencing: a computational cognitive neuroscience approach
Herd, S. A., Krueger, K. A., Kriete, T. E., Huang, T.-R., Hazy, T. E., & O'Reilly, R. C. (2013) · Computational Intelligence and Neuroscience · doi:10.1155/2013/149329 · Cited by 20
“…higher levels, so that sequences of cognitive actions can be triggered by a distributed representation that loosely encodes that whole sequence and those higher-level representations can then unfold as sequences themselves using identically structured brain machinery, possibly in slightly…”
BackgroundSelf-citationMueller, K. L., & Tomblin, J. B. (2012) · Topics in Language Disorders · doi:10.1097/tld.0b013e318261ffdd · Cited by 17
Metadata
- Authors
- Frank, M. J., Seeberger, L. C., & O'Reilly, R. C.
- Affiliations
- University of Colorado Boulder (US)
- Department of Psychology and Center for Neuroscience, University of Colorado Boulder, Boulder, CO 80309–0345, USA.
- Corresponding author
- Frank, Michael J.
- Venue
- Science
- Published
- 2004-12-10
- Volume
- 306
- Issue
- 5703
- Pages
- 1940-1943
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2163647009
- Cited by
- 1,964
- References
- 33
- Citations by year
- 2026: 57 · 2025: 73 · 2024: 83 · 2023: 79 · 2022: 91 · 2021: 99 · 2020: 134 · 2019: 104 · 2018: 125 · 2017: 111 · 2016: 115 · 2015: 111 · 2014: 134 · 2013: 111 · 2012: 108
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH069597, MH 069597-01)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Clinical Neurology › Parkinson's Disease Mechanisms and Treatments
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- Parkinson's disease, parkinsonism, dopamine, basal ganglia, positive reinforcement, negative reinforcement, avoidance learning, procedural learning, computational model, trial-and-error learning
- MeSH terms
- Aged, Antiparkinson Agents, Basal Ganglia, Cognition, Computer Simulation, Dopamine, Female, Frontal Lobe, Humans, Learning, Male, Middle Aged, Models, Neurological, Parkinson Disease, Probability, Reinforcement, Psychology, Matched-Pair Analysis, Feedback, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.