By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To what extent do we learn from the positive versus negative outcomes of our decisions? The neuromodulator dopamine plays a key role in these reinforcement learning processes. Patients with Parkinson's disease, who have depleted dopamine in the basal ganglia, are impaired in tasks that require learning from trial and error. Here, we show, using two cognitive procedural learning tasks, that Parkinson's patients off medication are better at learning to avoid choices that lead to negative outcomes than they are at learning from positive outcomes. Dopamine medication reverses this bias, making patients more sensitive to positive than negative outcomes. This pattern was predicted by our biologically based computational model of basal ganglia–dopamine interactions in cognition, which has separate pathways for “Go” and “NoGo” responses that are differentially modulated by positive and negative reinforcement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neural mechanisms underlying decision making and learning involve fronto-striatal networks generating reward prediction errors which are highly sensitive to dopaminergic modulation (Frank et al. 2004; Kehagia et al. 2010; Schultz and Dickinson 2000).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Frank et al. 2004
In the citing paper
“Operant learning is, however, known to be impaired in PD (Avila et al., 2009; Frank et al., 2004; Rushworth et al., 1998; Rutledge et al., 2009; Shohamy et al., 2005).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Frank et al., 2004
In the citing paper
“Substantial work in conditions such as Parkinson’s disease, in which dopamine is reduced, shows that manipulations favoring D1 and D2 dopamine receptors result in effects that are most readily interpretable in a model-free manner (Frank et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as Frank et al., 2004
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
Uneven Pattern of Dopamine Loss in the Striatum of Patients with Idiopathic Parkinson's Disease
Kish, S. J., Shannak, K., & Hornykiewicz, O. (1988) · New England Journal of Medicine · doi:10.1056/nejm198804073181402 · Cited by 1,953
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
A neuropsychological theory of multiple systems in category learning.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998) · Psychological Review · doi:10.1037//0033-295x.105.3.442 · Cited by 1,223
The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia
Gerfen, C. R. (1992) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.15.030192.001441 · Cited by 1,004
Cools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906
Research works printed but not linked: 6
- 10.1037/0033-295x.105.3.442 · doi:10.1037/0033-295x.105.3.442 · Paper page
- M. Frank J. Cognit. Neurosci. in press.
- R. C. O'Reilly M. J. Frank ICS Tech. Rep. University of Colorado Institute of Cognitive Science (2004).
- 10.1088/0954-898x_8_4_001 · doi:10.1088/0954-898x_8_4_001 · Paper page
- M. Frank J. Rudy W. Levy R. O'Reilly Mem. Cognit. in press.
- 10.1037/0097-7403.17.3.334 · doi:10.1037/0097-7403.17.3.334 · Paper page
Cited by
Items 201–300 of 1,007
Losing the rose tinted glasses: neural substrates of unbiased belief updating in depression
Garrett, N., Sharot, T., Faulkner, P., Korn, C. W., Roiser, J. P., & Dolan, R. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00639 · Cited by 174
“Indeed, we have previously shown that increasing dopamine function (via administration of L-DOPA) enhances an update bias in healthy individuals by impairing updating from negative information even further (Sharot et al., 2012a; see also Frank et al., 2004).”
BackgroundMotivational influences on response inhibition measures.
Leotti, L. A., & Wager, T. D. (2010) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0016802 · Cited by 174
Chase, H. W., Frank, M. J., Michael, A., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2010) · Psychological Medicine · doi:10.1017/s0033291709990468 · Cited by 174
Self-citationDopamine imbalance in Huntington's disease: a mechanism for the lack of behavioral flexibility
Chen, J. Y., Wang, E. A., Cepeda, C., & Levine, M. S. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00114 · Cited by 174
Gruber, A. J., & McDonald, R. J. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00050 · Cited by 173
Reward modulates adaptations to conflict
Braem, S., Verguts, T., Roggeman, C., & Notebaert, W. (2012) · Cognition · doi:10.1016/j.cognition.2012.07.015 · Cited by 173
Neuropharmacology of performance monitoring
Jocham, G., & Ullsperger, M. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2008.08.011 · Cited by 172
Keeler, J. F., Pretsell, D. O., & Robbins, T. W. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.07.021 · Cited by 172
Transitive inference in non-human animals: An empirical and theoretical analysis
Vasconcelos, M. (2008) · Behavioural Processes · doi:10.1016/j.beproc.2008.02.017 · Cited by 172
Category learning and the memory systems debate
Poldrack, R. A., & Foerde, K. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.07.007 · Cited by 170
Striatal D1 and D2 signaling differentially predict learning from positive and negative outcomes
Cox, S. M. L., Frank, M. J., Larcher, K. M.-H., Fellows, L. K., Clark, C. A., Leyton, M., & Dagher, A. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.12.070 · Cited by 169
Self-citationDopamine and effort-based decision making
Kurniawan, I. T. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00081 · Cited by 168
Summerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167
Decision Making: From Neuroscience to Psychiatry
Lee, D. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.008 · Cited by 166
Frank, M. J., Scheres, A., & Sherman, S. J. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2058 · Cited by 166
Self-citationCavanagh, J. F., Bismark, A. W., Frank, M. J., & Allen, J. J. B. (2019) · Computational Psychiatry · doi:10.1162/cpsy_a_00024 · Cited by 166
Self-citationEuteneuer, F., Schaefer, F., Stuermer, R., Boucsein, W., Timmermann, L., Barbe, M. T., Ebersbach, G., Otto, J., Kessler, J., & Kalbe, E. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.06.014 · Cited by 164
l-dopa impairs learning, but spares generalization, in Parkinson's disease
Shohamy, D., Myers, C. E., Geghman, K. D., Sage, J., & Gluck, M. A. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.07.013 · Cited by 164
Medication-related impulse control and repetitive behaviors in Parkinson??s disease
Voon, V., Potenza, M. N., & Thomsen, T. (2007) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32826fbc8f · Cited by 163
van Eimeren, T., Ballanger, B., Pellecchia, G., Miyasaki, J. M., Lang, A. E., & Strafella, A. P. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2009.124 · Cited by 163
The computational roots of positivity and confirmation biases in reinforcement learning
Palminteri, S., & Lebreton, M. P. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.04.005 · Cited by 162
Action Selection and Action Value in Frontal-Striatal Circuits
Seo, M., Lee, E., & Averbeck, B. B. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.037 · Cited by 161
Hippocampal Contributions to Model-Based Planning and Spatial Memory
Vikbladh, O. M., Meager, M. R., King, J., Blackmon, K., Devinsky, O., Shohamy, D., Burgess, N., & Daw, N. D. (2019) · Neuron · doi:10.1016/j.neuron.2019.02.014 · Cited by 161
Lawrence, A. D., Goerendt, I. K., & Brooks, D. J. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.04.016 · Cited by 159
Gubellini, P., Salin, P., Kerkerian-Le Goff, L., & Baunez, C. (2009) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2009.06.003 · Cited by 159
What’s in a word? How instructions, suggestions, and social information change pain and emotion
Koban, L., Jepma, M., Geuter, S., & Wager, T. D. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.014 · Cited by 159
Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task
Chiu, P. H., Lohrenz, T. M., & Montague, P. R. (2008) · Nature Neuroscience · doi:10.1038/nn2067 · Cited by 159
Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner
Silvetti, M., Vassena, E., Abrahamse, E. L., & Verguts, T. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006370 · Cited by 158
Do learning rates adapt to the distribution of rewards?
Gershman, S. J. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0790-3 · Cited by 156
Distorted expectancy coding in problem gambling: is the addictive in the anticipation?
van Holst, R. J., Veltman, D. J., Büchel, C., van den Brink, W., & Goudriaan, A. E. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.12.030 · Cited by 155
Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes
Palminteri, S., Lebreton, M., Worbe, Y., Grabli, D., Hartmann, A., & Pessiglione, M. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0904035106 · Cited by 154
A psychological and neuroanatomical model of obsessive-compulsive disorder
Huey, E. D., Zahn, R., Krueger, F., Moll, J., Kapogiannis, D., Wassermann, E. M., & Grafman, J. (2008) · The Journal of Neuropsychiatry and Clinical Neurosciences · doi:10.1176/jnp.2008.20.4.390 · Cited by 152
Swart, J. C., Froböse, M. I., Cook, J. L., Geurts, D. E. M., Frank, M. J., Cools, R., & den Ouden, H. E. M. (2017) · eLife · doi:10.7554/elife.22169 · Cited by 152
Self-citationA Basal Ganglia Circuit Sufficient to Guide Birdsong Learning
Xiao, L., Chattree, G., García‐Oscos, F., Cao, M., Wanat, M. J., & Roberts, T. F. (2018) · Neuron · doi:10.1016/j.neuron.2018.02.020 · Cited by 152
Machine Learning Advances in Microbiology: A Review of Methods and Applications
Jiang, Y., Luo, J., Huang, D., Liu, Y., & Li, D.-D. (2022) · Frontiers in Microbiology · doi:10.3389/fmicb.2022.925454 · Cited by 151
Computational Neuropsychology and Bayesian Inference
Parr, T., Rees, G., & Friston, K. J. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00061 · Cited by 149
Dopamine and performance in a reinforcement learning task: evidence from Parkinson’s disease
Shiner, T., Seymour, B., Wunderlich, K., Hill, C., Bhatia, K. P., Dayan, P., & Dolan, R. J. (2012) · Brain · doi:10.1093/brain/aws083 · Cited by 149
Stimulus representation and the timing of reward-prediction errors in models of the dopamine system
Ludvig, E. A., Sutton, R. S., & Kehoe, E. J. (2008) · Neural Computation · doi:10.1162/neco.2008.11-07-654 · Cited by 148
Acute effects of cocaine on the neurobiology of cognitive control
Garavan, H., Kaufman, J. N., & Hester, R. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0106 · Cited by 148
Classification and treatment of antisocial individuals: From behavior to biocognition
Brazil, I. A., van Dongen, J. D. M., Maes, J. H. R., Mars, R. B., & Baskin-sommers, A. R. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.10.010 · Cited by 148
Lévy, R. (2012) · Revue Neurologique · doi:10.1016/j.neurol.2012.05.003 · Cited by 148
Unmasking levodopa resistance in Parkinson's disease
Nonnekes, J. H., Timmer, M. H. M., de Vries, N. M., Rascol, O., Helmich, R. C. G., & Bloem, B. R. (2016) · Movement Disorders · doi:10.1002/mds.26712 · Cited by 146
Positive reward prediction errors during decision-making strengthen memory encoding
Jang, A. I., Nassar, M. R., Dillon, D. G., & Frank, M. J. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0597-3 · Cited by 146
Self-citationSocial Cognition 2.0: An Interactive Memory Systems Account
Amodio, D. M. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.10.002 · Cited by 145
A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism
Moustafa, A. A., Cohen, M. X., Sherman, S. J., & Frank, M. J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3116-08.2008 · Cited by 144
Self-citationGroman, S. M., James, A. S., Seu, E., Tran, S., Clark, T. A., Harpster, S. N., Crawford, M., Burtner, J. L., Feiler, K., Roth, R. H., et al. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3037-14.2014 · Cited by 143
Genetic contributions to avoidance-based decisions: striatal D2 receptor polymorphisms
Frank, M. J., & Hutchison, K. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.04.048 · Cited by 142
Self-citationFunctional connectivity of reward processing in the brain
Camara, E. (2008) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.019.2008 · Cited by 141
“For example, modeling work of Frank et al. (2004) distinguishes between two excitatory/inhibitory pathways in the basal ganglia, which show differential modulation during positive and negative reinforcement processing.”
BackgroundSantesso, D. L., Evins, A. E., Frank, M. J., Schetter, E. C., Bogdan, R., & Pizzagalli, D. A. (2009) · Human Brain Mapping · doi:10.1002/hbm.20642 · Cited by 141
Self-citationHierarchical Bayesian inference for concurrent model fitting and comparison for group studies
Piray, P., Dezfouli, A., Heskes, T., Frank, M. J., & Daw, N. D. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007043 · Cited by 138
Self-citationReward sensitivity deficits modulated by dopamine are associated with apathy in Parkinson’s disease
Muhammed, K., Manohar, S., Ben Yehuda, M., Chong, T. T.-J., Tofaris, G., Lennox, G., Bogdanovic, M., Hu, M., & Husain, M. (2016) · Brain · doi:10.1093/brain/aww188 · Cited by 137
Direct and indirect dorsolateral striatum pathways reinforce different action strategies
Vicente, A. M., Galvão-Ferreira, P., Tecuapetla, F., & Costa, R. M. (2016) · Current Biology · doi:10.1016/j.cub.2016.02.036 · Cited by 137
When Beliefs Face Reality: An Integrative Review of Belief Updating in Mental Health and Illness
Kube, T., & Rozenkrantz, L. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620931496 · Cited by 136
Dragicevic, E., Schiemann, J., & Liss, B. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2014.10.037 · Cited by 136
Dopaminergic Enhancement of Striatal Response to Reward in Major Depression
Admon, R., Kaiser, R. H., Dillon, D. G., Beltzer, M., Goer, F., Olson, D. P., Vitaliano, G., & Pizzagalli, D. A. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16010111 · Cited by 136
Dopaminergic medication boosts action–effect binding in Parkinson's disease
Moore, J. W., Schneider, S. A., Schwingenschuh, P., Moretto, G., Bhatia, K. P., & Haggard, P. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.12.014 · Cited by 135
Role of Dopamine D2 Receptors in Human Reinforcement Learning
Eisenegger, C., Naef, M., Linssen, A., Clark, L., Gandamaneni, P. K., Müller, U., & Robbins, T. W. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.84 · Cited by 134
Computational models of basal-ganglia pathway functions: focus on functional neuroanatomy
Schroll, H., & Hamker, F. H. (2013) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2013.00122 · Cited by 134
Kunisato, Y., Okamoto, Y., Ueda, K., Onoda, K., Okada, G., Yoshimura, S., Suzuki, S.-I., Samejima, K., & Yamawaki, S. (2012) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2012.05.007 · Cited by 134
The Role of Orbitofrontal Cortex in Decision Making: A Component Process Account
FELLOWS, L. K. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.023 · Cited by 133
Development and function of the midbrain dopamine system: what we know and what we need to
Bissonette, G. B., & Roesch, M. R. (2016) · Genes, Brain and Behavior · doi:10.1111/gbb.12257 · Cited by 133
Waltz, J. A., Frank, M. J., Wiecki, T. V., & Gold, J. M. (2011) · Neuropsychology · doi:10.1037/a0020882 · Cited by 132
Self-citationThe Neuromodulatory System: A Framework for Survival and Adaptive Behavior in a Challenging World
Krichmar, J. L. (2008) · Adaptive Behavior · doi:10.1177/1059712308095775 · Cited by 132
Resting-state qEEG predicts rate of second language learning in adults
Prat, C. S., Yamasaki, B. L., Kluender, R. A., & Stocco, A. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.04.007 · Cited by 132
Problematic Use of the Internet and Self-Regulation: A Review of the Initial Studies
Billieux, J. (2012) · The Open Addiction Journal · doi:10.2174/1874941001205010024 · Cited by 106
Computational Psychiatry Needs Time and Context
Hitchcock, P. F., Fried, E. I., & Frank, M. J. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-021621-124910 · Cited by 131
Self-citationAcute stress selectively reduces reward sensitivity
Berghorst, L. H., Bogdan, R., Frank, M. J., & Pizzagalli, D. A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00133 · Cited by 131
Self-citationStaudinger, M. R., Erk, S., & Walter, H. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr041 · Cited by 131
Value Learning through Reinforcement
Daw, N. D., & Tobler, P. N. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00015-2 · Cited by 131
Optogenetic dissection of neural circuits underlying emotional valence and motivated behaviors
Nieh, E. H., Kim, S.-Y., Namburi, P., & Tye, K. M. (2013) · Brain Research · doi:10.1016/j.brainres.2012.11.001 · Cited by 130
A neural network for information seeking
White, J. K., Bromberg-Martin, E. S., Heilbronner, S. R., Zhang, K., Pai, J., Haber, S. N., & Monosov, I. E. (2019) · Nature Communications · doi:10.1038/s41467-019-13135-z · Cited by 129
Turning it Upside Down: Areas of Preserved Cognitive Function in Schizophrenia
Gold, J. M., Hahn, B., Strauss, G. P., & Waltz, J. A. (2009) · Neuropsychology Review · doi:10.1007/s11065-009-9098-x · Cited by 129
Working Memory Load Strengthens Reward Prediction Errors
Collins, A. G. E., Ciullo, B., Frank, M. J., & Badre, D. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.2700-16.2017 · Cited by 129
Self-citationLearning to avoid in older age.
Frank, M. J., & Kong, L. (2008) · Psychology and Aging · doi:10.1037/0882-7974.23.2.392 · Cited by 129
Self-citationSocial cognition and schizophrenia.
(2001) · American Psychological Association eBooks · doi:10.1037/10407-000 · Cited by 129
A neural network model of individual differences in task switching abilities
Herd, S. A., O׳Reilly, R. C., Hazy, T. E., Chatham, C. H., Brant, A. M., & Friedman, N. P. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.04.014 · Cited by 128
Self-citationDopaminergic modulation of the exploration/exploitation trade-off in human decision-making
Chakroun, K., Mathar, D., Wiehler, A., Ganzer, F., & Peters, J. (2020) · eLife · doi:10.7554/elife.51260 · Cited by 128
Dopamine selectively remediates ‘model-based’ reward learning: a computational approach
Sharp, M. E., Foerde, K., Daw, N. D., & Shohamy, D. (2016) · Brain · doi:10.1093/brain/awv347 · Cited by 128
Episodic Memory Encoding Interferes with Reward Learning and Decreases Striatal Prediction Errors
Wimmer, G. E., Braun, E. K., Daw, N. D., & Shohamy, D. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0204-14.2014 · Cited by 128
Dopamine ups and downs in vulnerability to addictions: a neurodevelopmental model
Leyton, M., & Vezina, P. (2014) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2014.04.002 · Cited by 127
“These neurophysiological effects are associated with a decreased behavioral tendency to preferentially respond to rewards [65-67], and a decreased willingness to sustain effort to obtain rewards, including alcohol [68], tobacco [69] and money [70].”
BackgroundMild cognitive impairment and cognitive reserve in Parkinson’s disease
Poletti, M., Emre, M., & Bonuccelli, U. (2011) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2011.03.013 · Cited by 127
MacDonald, P. A., & Monchi, O. (2011) · Parkinson's Disease · doi:10.4061/2011/572743 · Cited by 126
Medication impairs probabilistic classification learning in Parkinson's disease
Jahanshahi, M., Wilkinson, L., Gahir, H., Dharminda, A., & Lagnado, D. A. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.12.010 · Cited by 126
Computational models of cognitive control
O’Reilly, R. C., Herd, S. A., & Pauli, W. M. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.01.008 · Cited by 114
Self-citationConvergent evidence for abnormal striatal synaptic plasticity in dystonia
Peterson, D. A., B, T. J. S. A., & Poizner, H. (2009) · Neurobiology of Disease · doi:10.1016/j.nbd.2009.12.003 · Cited by 126
Beyond dichotomies in reinforcement learning
Collins, A. G. E., & Cockburn, J. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0355-6 · Cited by 125
Plastic Corticostriatal Circuits for Action Learning: What's Dopamine Got to Do with It?
COSTA, R. M. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.015 · Cited by 125
Advances in modeling learning and decision-making in neuroscience
Collins, A. G. E., & Shenhav, A. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01126-y · Cited by 125
Action controls dopaminergic enhancement of reward representations
Guitart-Masip, M., Chowdhury, R., Sharot, T., Dayan, P., Duzel, E., & Dolan, R. J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1202229109 · Cited by 124
Poletti, M., & Bonuccelli, U. (2012) · Therapeutic Advances in Psychopharmacology · doi:10.1177/2045125312470130 · Cited by 123
Translational assessment of reward and motivational deficits in psychiatric disorders
Der-Avakian, A., Barnes, S. A., Markou, A., & Pizzagalli, D. A. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_5004 · Cited by 122
When Memory Fails, Intuition Reigns: Midazolam Enhances Implicit Inference in Humans
Frank, M. J., O'Reilly, R. C., & Curran, T. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01769.x · Cited by 122
Self-citationPrefrontal Cortex Predicts State Switches during Reversal Learning
Bartolo, R., & Averbeck, B. B. (2020) · Neuron · doi:10.1016/j.neuron.2020.03.024 · Cited by 122
Neuronal Activity in the Human Subthalamic Nucleus Encodes Decision Conflict during Action Selection
Zaghloul, K. A., Weidemann, C. T., Lega, B. C., Jaggi, J. L., Baltuch, G. H., & Kahana, M. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5815-11.2012 · Cited by 122
Cilia, R., Cho, S. S., van Eimeren, T., Marotta, G., Siri, C., Ko, J. H., Pellecchia, G., Pezzoli, G., Antonini, A., & Strafella, A. P. (2011) · Movement Disorders · doi:10.1002/mds.23480 · Cited by 121
Impulse Control and Related Disorders in Parkinson’s Disease
Weintraub, D. A., & Nirenberg, M. J. (2012) · Neurodegenerative Diseases · doi:10.1159/000341996 · Cited by 121
Dopamine restores cognitive motivation in Parkinson’s disease
McGuigan, S., Zhou, S.-H., Brosnan, M. B., Thyagarajan, D. E., Bellgrove, M. A., & Chong, T. T. ‐. (2019) · Brain · doi:10.1093/brain/awy341 · Cited by 121
The costs and benefits of brain dopamine for cognitive control
Cools, R. (2016) · WIREs Cognitive Science · doi:10.1002/wcs.1401 · Cited by 120
A specific role for serotonin in overcoming effort cost
Meyniel, F., Goodwin, G. M., Deakin, J. W., Klinge, C., MacFadyen, C., Milligan, H., Mullings, E., Pessiglione, M., & Gaillard, R. (2016) · eLife · doi:10.7554/elife.17282 · Cited by 120
Neurocomputational models of motor and cognitive deficits in Parkinson’s disease
Wiecki, T. V., & Frank, M. J. (2010) · Progress in brain research · doi:10.1016/s0079-6123(10)83014-6 · Cited by 120
Self-citation
Metadata
- Authors
- Frank, M. J., Seeberger, L. C., & O'Reilly, R. C.
- Affiliations
- University of Colorado Boulder (US)
- Department of Psychology and Center for Neuroscience, University of Colorado Boulder, Boulder, CO 80309–0345, USA.
- Corresponding author
- Frank, Michael J.
- Venue
- Science
- Published
- 2004-12-10
- Volume
- 306
- Issue
- 5703
- Pages
- 1940-1943
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2163647009
- Cited by
- 1,964
- References
- 33
- Citations by year
- 2026: 57 · 2025: 73 · 2024: 83 · 2023: 79 · 2022: 91 · 2021: 99 · 2020: 134 · 2019: 104 · 2018: 125 · 2017: 111 · 2016: 115 · 2015: 111 · 2014: 134 · 2013: 111 · 2012: 108
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH069597, MH 069597-01)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Clinical Neurology › Parkinson's Disease Mechanisms and Treatments
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- Parkinson's disease, parkinsonism, dopamine, basal ganglia, positive reinforcement, negative reinforcement, avoidance learning, procedural learning, computational model, trial-and-error learning
- MeSH terms
- Aged, Antiparkinson Agents, Basal Ganglia, Cognition, Computer Simulation, Dopamine, Female, Frontal Lobe, Humans, Learning, Male, Middle Aged, Models, Neurological, Parkinson Disease, Probability, Reinforcement, Psychology, Matched-Pair Analysis, Feedback, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.