By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To what extent do we learn from the positive versus negative outcomes of our decisions? The neuromodulator dopamine plays a key role in these reinforcement learning processes. Patients with Parkinson's disease, who have depleted dopamine in the basal ganglia, are impaired in tasks that require learning from trial and error. Here, we show, using two cognitive procedural learning tasks, that Parkinson's patients off medication are better at learning to avoid choices that lead to negative outcomes than they are at learning from positive outcomes. Dopamine medication reverses this bias, making patients more sensitive to positive than negative outcomes. This pattern was predicted by our biologically based computational model of basal ganglia–dopamine interactions in cognition, which has separate pathways for “Go” and “NoGo” responses that are differentially modulated by positive and negative reinforcement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neural mechanisms underlying decision making and learning involve fronto-striatal networks generating reward prediction errors which are highly sensitive to dopaminergic modulation (Frank et al. 2004; Kehagia et al. 2010; Schultz and Dickinson 2000).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Frank et al. 2004
In the citing paper
“Operant learning is, however, known to be impaired in PD (Avila et al., 2009; Frank et al., 2004; Rushworth et al., 1998; Rutledge et al., 2009; Shohamy et al., 2005).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Frank et al., 2004
In the citing paper
“Substantial work in conditions such as Parkinson’s disease, in which dopamine is reduced, shows that manipulations favoring D1 and D2 dopamine receptors result in effects that are most readily interpretable in a model-free manner (Frank et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as Frank et al., 2004
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
Uneven Pattern of Dopamine Loss in the Striatum of Patients with Idiopathic Parkinson's Disease
Kish, S. J., Shannak, K., & Hornykiewicz, O. (1988) · New England Journal of Medicine · doi:10.1056/nejm198804073181402 · Cited by 1,953
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
A neuropsychological theory of multiple systems in category learning.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998) · Psychological Review · doi:10.1037//0033-295x.105.3.442 · Cited by 1,223
The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia
Gerfen, C. R. (1992) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.15.030192.001441 · Cited by 1,004
Cools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906
Research works printed but not linked: 6
- 10.1037/0033-295x.105.3.442 · doi:10.1037/0033-295x.105.3.442 · Paper page
- M. Frank J. Cognit. Neurosci. in press.
- R. C. O'Reilly M. J. Frank ICS Tech. Rep. University of Colorado Institute of Cognitive Science (2004).
- 10.1088/0954-898x_8_4_001 · doi:10.1088/0954-898x_8_4_001 · Paper page
- M. Frank J. Rudy W. Levy R. O'Reilly Mem. Cognit. in press.
- 10.1037/0097-7403.17.3.334 · doi:10.1037/0097-7403.17.3.334 · Paper page
Cited by
Items 501–600 of 1,007
Impact of aging on frontostriatal reward processing
Vink, M., Kleerekooper, I., van den Wildenberg, W. P. M., & Kahn, R. S. (2015) · Human Brain Mapping · doi:10.1002/hbm.22771 · Cited by 68
Affective symptoms and cognitive functions in Parkinson's disease
Poletti, M., Rosa, A. D., & Bonuccelli, U. (2012) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2012.02.022 · Cited by 68
Koziol, L. F., Budding, D. E., & Chidekel, D. (2010) · The Cerebellum · doi:10.1007/s12311-010-0192-7 · Cited by 68
The rat's not for turning: Dissociating the psychological components of cognitive inflexibility
Nilsson, S. R. O., Alsiö, J., Somerville, E. M., & Clifton, P. G. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.06.015 · Cited by 68
Linking neurogenetics and individual differences in language learning: the dopamine hypothesis.
Wong, P. C. M., Morgan-Short, K., Ettlinger, M., & Zheng, J. (2012) · Cortex · doi:10.1016/j.cortex.2012.03.017 · Cited by 67
Rochat, L., Maurage, P., Heeren, A., & Billieux, J. (2018) · Neuropsychology Review · doi:10.1007/s11065-018-9387-3 · Cited by 67
L-DOPA reduces model-free control of behavior by attenuating the transfer of value to action
Kroemer, N. B., Lee, Y., Pooseh, S., Eppinger, B., Goschke, T., & Smolka, M. N. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.10.075 · Cited by 67
Redundant dopaminergic activity may enable compensatory axonal sprouting in Parkinson disease
Arkadir, D., Bergman, H., & Fahn, S. (2014) · Neurology · doi:10.1212/wnl.0000000000000243 · Cited by 66
Dopamine Increases a Value-Independent Gambling Propensity
Rigoli, F., Rutledge, R. B., Chew, B., Ousdal, O. T., Dayan, P., & Dolan, R. J. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.68 · Cited by 66
Predicting explorative motor learning using decision-making and motor noise
Chen, X., Mohr, K. S., & Galea, J. M. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005503 · Cited by 66
Bilinearity, rules, and prefrontal cortex
Dayan, P. (2007) · Frontiers in Computational Neuroscience · doi:10.3389/neuro.10.001.2007 · Cited by 65
Frontostriatal Cognitive Staging in Parkinson's Disease
de la Fuente‐Fernández, R. (2011) · Parkinson s Disease · doi:10.1155/2012/561046 · Cited by 65
Morita, K., Morishima, M., Sakai, K., & Kawaguchi, Y. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4614-12.2013 · Cited by 65
Taddei, R. N., Çankaya, Ş., Dhaliwal, S., & Chaudhuri, К. R. (2017) · Parkinson s Disease · doi:10.1155/2017/3256542 · Cited by 65
Bavard, S., Rustichini, A., & Palminteri, S. (2021) · Science Advances · doi:10.1126/sciadv.abe0340 · Cited by 65
Tricomi, E., & Fiez, J. A. (2012) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-011-0077-3 · Cited by 64
The Human Ventromedial Prefrontal Cortex Is Critical for Transitive Inference
Koscik, T. R., & Tranel, D. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00203 · Cited by 64
Learning by doing: an fMRI study of feedback-related brain activations
Marco-Pallarés, J., Müller, S. V., & Münte, T. F. (2007) · NeuroReport · doi:10.1097/wnr.0b013e3282e9a58c · Cited by 64
Myers, C. E., Sheynin, J., Balsdon, T., Luzardo, A., Beck, K. D., Hogarth, L., Haber, P., & Moustafa, A. A. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.09.018 · Cited by 64
Impaired savings despite intact initial learning of motor adaptation in Parkinson’s disease
Leow, L., Loftus, A. M., & Hammond, G. R. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3060-5 · Cited by 64
Reinforcement learning with Marr
Niv, Y., & Langdon, A. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.04.005 · Cited by 64
Policy Adjustment in a Dynamic Economic Game
Li, J., McClure, S. M., King-Casas, B., & Read Montague, P. (2006) · PLoS ONE · doi:10.1371/journal.pone.0000103 · Cited by 63
Adapting the flow of time with dopamine
Mikhael, J. G., & Gershman, S. J. (2019) · Journal of Neurophysiology · doi:10.1152/jn.00817.2018 · Cited by 63
Siegert, S., Ruiz, M. H., Brücke, C., Huebl, J., Schneider, G., Ullsperger, M., & Kühn, A. A. (2014) · Cortex · doi:10.1016/j.cortex.2013.12.008 · Cited by 63
Chersi, F., Mirolli, M., Pezzulo, G., & Baldassarre, G. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.11.009 · Cited by 63
Reduced pupillary reward sensitivity in Parkinson’s disease
Manohar, S., & Husain, M. (2015) · npj Parkinson s Disease · doi:10.1038/npjparkd.2015.26 · Cited by 63
Effect of reinforcement history on hand choice in an unconstrained reaching task
Stoloff, R. H., Taylor, J. A., Xu, J., Ridderikhoff, A., & Ivry, R. B. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00041 · Cited by 63
Aging, probabilistic learning and performance monitoring
Pietschmann, M., Endraß, T., Czerwon, B., & Kathmann, N. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.10.009 · Cited by 63
Diekhof, E. K. (2015) · Hormones and Behavior · doi:10.1016/j.yhbeh.2015.06.001 · Cited by 62
A neuronal mechanism underlying decision-making deficits during hyperdopaminergic states
Verharen, J. P. H., de Jong, J. W., Roelofs, T. J. M., Huffels, C. F. M., van Zessen, R., Luijendijk, M. C. M., Hamelink, R., Willuhn, I., den Ouden, H. E. M., van der Plasse, G., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-03087-1 · Cited by 62
Adult age differences in learning from positive and negative probabilistic feedback.
Simon, J. R., Howard, J. H., & Howard, D. V. (2010) · Neuropsychology · doi:10.1037/a0018652 · Cited by 62
Existence and Control of Go/No-Go Decision Transition Threshold in the Striatum
Bahuguna, J., Aertsen, A., & Kumar, A. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004233 · Cited by 62
Rule-based category learning in patients with Parkinson's disease
Price, A. L., Filoteo, J. V., & Maddox, W. T. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.01.031 · Cited by 62
The influence of emotions on cognitive control: feelings and beliefs—where do they meet?
Harlé, K. M., Shenoy, P., & Paulus, M. P. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00508 · Cited by 62
Drug addiction: An affective-cognitive disorder in need of a cure
Fattore, L., & Diana, M. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.04.006 · Cited by 62
Rewarding feedback promotes motor skill consolidation via striatal activity
Widmer, M., Ziegler, N., Held, J. P. O., Luft, A. R., & Lutz, K. (2016) · Progress in brain research · doi:10.1016/bs.pbr.2016.05.006 · Cited by 62
Reward prediction error does not explain movement selectivity in DMS-projecting dopamine neurons
Lee, R. S., Mattar, M. G., Parker, N. F., Witten, I. B., & Daw, N. D. (2019) · eLife · doi:10.7554/elife.42992 · Cited by 62
Wimmer, G. E., Li, J. K., Gorgolewski, K. J., & Poldrack, R. A. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.0075-18.2018 · Cited by 62
Similarities and Differences in the Supramolecular Organization of Silkworm and Spider Silk
Pérez‐Rigueiro, J., Elices, M., Plaza, G. R., & Guinea, G. V. (2007) · Macromolecules · doi:10.1021/ma070478o · Cited by 62
Applying novel technologies and methods to inform the ontology of self-regulation
Eisenberg, I. W., Bissett, P. G., Canning, J. R., Dallery, J., Enkavi, A. Z., Whitfield-Gabrieli, S., Gonzalez, O., Green, A. I., Greene, M. A., Kiernan, M., et al. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.09.014 · Cited by 61
Tomer, R., Slagter, H. A., Christian, B. T., Fox, A. S., King, C. R., Murali, D., Gluck, M. A., & Davidson, R. J. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00544 · Cited by 61
Impaired conscious and preserved unconscious inhibitory processing in recent onset schizophrenia
Huddy, V. C., Aron, A. R., Harrison, M., Barnes, T. R. E., Robbins, T. W., & Joyce, E. M. (2009) · Psychological Medicine · doi:10.1017/s0033291708004340 · Cited by 61
Piray, P., Ly, V., Roelofs, K., Cools, R., & Toni, I. (2019) · The Journal of Neuroscience · doi:10.1523/jneurosci.1394-18.2018 · Cited by 61
de Boer, L., Axelsson, J., Riklund, K., Nyberg, L. H., Dayan, P., Bäckman, L., & Guitart‐Masip, M. (2017) · eLife · doi:10.7554/elife.26424 · Cited by 61
Asymmetric dopamine loss differentially affects effort to maximize gain or minimize loss
Porat, O., Hassin‐Baer, S., Cohen, O. S., Markus, A., & Tomer, R. (2013) · Cortex · doi:10.1016/j.cortex.2013.10.004 · Cited by 61
Palminteri, S., Clair, A.-H., Mallet, L., & Pessiglione, M. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.12.028 · Cited by 60
Yu, R., Zhou, W., & Zhou, X. (2011) · PLoS ONE · doi:10.1371/journal.pone.0029633 · Cited by 60
Test–retest reliability of reinforcement learning parameters
Schaaf, J. V., Weidinger, L., Molleman, L., & van den Bos, W. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02203-4 · Cited by 60
Hämmerer, D., Li, S., Voelkle, M. C., Müller, V., & Lindenberger, U. (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01476.x · Cited by 60
Engeln, M., Deurwaerdère, P. D., Li, Q., Bézard, E., & Fernagut, P. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu076 · Cited by 60
Evidence for Cognitive Placebo and Nocebo Effects in Healthy Individuals
Turi, Z., Bjørkedal, E., Gunkel, L., Antal, A., Paulus, W., & Mittner, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-35124-w · Cited by 60
Myers, C. E., Moustafa, A. A., Sheynin, J., VanMeenen, K. M., Gilbertson, M. W., Orr, S. P., Beck, K. D., Pang, K. C. H., & Servatius, R. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072508 · Cited by 60
The effect of P arkinson's disease and H untington's disease on human visuomotor learning
Gutiérrez-Garralda, J. M., Moreno‐Briseño, P., Boll, M., Morgado‐Valle, C., Campos‐Romo, A., Díaz, R., & Fernández-Ruíz, J. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12288 · Cited by 59
Apathy in Parkinson's Disease: More Than Just Executive Dysfunction
Martínez‐Horta, S., Pagonabarraga, J., de Bobadilla, R. F., García‐Sánchez, C., & Kulisevsky, J. (2013) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617713000131 · Cited by 59
From Feedback- to Response-based Performance Monitoring in Active and Observational Learning
Bellebaum, C., & Colosio, M. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00612 · Cited by 59
Weismüller, B., & Bellebaum, C. (2016) · Psychophysiology · doi:10.1111/psyp.12738 · Cited by 59
Hulme, H., Fridjonsdottir, E., Gunnarsdóttir, H., Vallianatou, T., Zhang, X., Wadensten, H., Shariatgorji, M., Nilsson, A., Bézard, E., Svenningsson, P., et al. (2020) · Neurobiology of Disease · doi:10.1016/j.nbd.2020.104738 · Cited by 59
Derivative-free reinforcement learning: a review
Qian, H., & Yu, Y. (2021) · Frontiers of Computer Science · doi:10.1007/s11704-020-0241-4 · Cited by 59
Mueller, E. M., Pechtel, P., Cohen, A. L., Douglas, S. R., & Pizzagalli, D. A. (2015) · Depression and Anxiety · doi:10.1002/da.22338 · Cited by 58
Rygula, R., Papciak, J., & Popik, P. (2014) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2014.01.012 · Cited by 58
Cortical Signals for Rewarded Actions and Strategic Exploration
Donahue, C. H., Seo, H., & Lee, D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.040 · Cited by 58
Spectrum of impulse control behaviours in Parkinson’s disease: pathophysiology and management
Kelly, M. J., Baig, F., Hu, M. T.-M., & Okai, D. (2020) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2019-322453 · Cited by 58
Impulsivity and Parkinson's disease: More than just disinhibition
Antonelli, F., Ray, N. J., & Strafella, A. P. (2011) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2011.06.006 · Cited by 58
Feedback-Driven Trial-by-Trial Learning in Autism Spectrum Disorders
Solomon, M., Frank, M. J., Ragland, J. D., Smith, A. C., Niendam, T. A., Lesh, T. A., Grayson, D. S., Beck, J. S., Matter, J. C., & Carter, C. S. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14010036 · Cited by 57
Self-citationCNTRICS Final Task Selection: Long-Term Memory
Ragland, J. D., Cools, R., Frank, M., Pizzagalli, D. A., Preston, A., Ranganath, C., & Wagner, A. D. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn134 · Cited by 57
Self-citationOn the normative advantages of dopamine and striatal opponency for learning and choice
Jaskir, A., & Frank, M. J. (2023) · eLife · doi:10.7554/elife.85107 · Cited by 57
Self-citationParkinson's disease duration determines effect of dopaminergic therapy on ventral striatum function
MacDonald, A. A., Monchi, O., Seergobin, K. N., Ganjavi, H., Tamjeedi, R., & MacDonald, P. A. (2012) · Movement Disorders · doi:10.1002/mds.25152 · Cited by 57
Zambrano‐Vazquez, L., & Allen, J. J. B. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.06.023 · Cited by 57
Towards a neuro-computational account of prism adaptation
Petitet, P., O’Reilly, J. X., & O’Shea, J. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.12.021 · Cited by 57
Ott, D. V. M., Ullsperger, M., Jocham, G., Neumann, J., & Klein, T. A. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.04.038 · Cited by 57
Whitmer, A. J., Frank, M. J., & Gotlib, I. H. (2012) · Cognition & Emotion · doi:10.1080/02699931.2012.682973 · Cited by 56
“The Probabilistic Selection Task (Frank et al., 2004) begins with a forced-choice training phase followed by a test phase (see Figure 1).”
Self-citationA neuro-cognitive process model of emotional intelligence
Smith, R., Killgore, W. D. S., Alkozei, A., & Lane, R. D. (2018) · Biological Psychology · doi:10.1016/j.biopsycho.2018.10.012 · Cited by 56
Reward-Related Learning via Multiple Memory Systems
Delgado, M. R., & Dickerson, K. C. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.01.023 · Cited by 56
Primate anterior insular cortex represents economic decision variables proposed by prospect theory
Yang, Y.-P., Li, X., & Stuphorn, V. (2022) · Nature Communications · doi:10.1038/s41467-022-28278-9 · Cited by 56
Moses, S. N., Villate, C., & RYAN, J. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.01.004 · Cited by 56
Common Neural Mechanisms Underlying Reversal Learning by Reward and Punishment
Xue, G., Xue, F., Droutman, V., Lu, Z., Bechara, A., & Read, S. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082169 · Cited by 56
Biased belief updating and suboptimal choice in foraging decisions
Garrett, N., & Daw, N. D. (2020) · Nature Communications · doi:10.1038/s41467-020-16964-5 · Cited by 55
Beylergil, S. B., Beck, A., Deserno, L., Lorenz, R. C., Rapp, M. A., Schlagenhauf, F., Heinz, A., & Obermayer, K. (2017) · NeuroImage: Clinical · doi:10.1016/j.nicl.2017.04.010 · Cited by 55
Guthrie, M., Myers, C. E., & Gluck, M. A. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.036 · Cited by 55
Decision Making and Executive Functions in REM Sleep Behavior Disorder
Delazer, M., Högl, B., Zamarian, L., Wenter, J., Ehrmann, L., Gschliesser, V., Brandauer, E., Poewe, W. H., & Frauscher, B. (2012) · SLEEP · doi:10.5665/sleep.1828 · Cited by 55
Gerrits, N. J. H. M., van der Werf, Y. D., Verhoef, K. M. W., Veltman, D. J., Groenewegen, H. J., Berendse, H. W., & van den Heuvel, O. A. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.12.022 · Cited by 55
Wittfoth, M., Schardt, D. M., Fahle, M. W., & Herrmann, M. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.026 · Cited by 55
Moustafa, A. A., Kéri, S., Herzallah, M. M., Myers, C. E., & Gluck, M. A. (2010) · Brain and Cognition · doi:10.1016/j.bandc.2010.07.013 · Cited by 55
Neuropsychiatry of Parkinson's disease
Kümmer, A., & Teixeira, A. L. (2009) · Arquivos de Neuro-Psiquiatria · doi:10.1590/s0004-282x2009000500033 · Cited by 55
Procedural Learning in Humans ☆
Knowlton, B. J., Siegel, A. L. M., & Moody, T. D. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21085-7 · Cited by 55
Kaiser, R. H., Treadway, M. T., Wooten, D., Kumar, P., Goer, F., Murray, L., Beltzer, M., Pechtel, P., Whitton, A. E., Cohen, A. L., et al. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx281 · Cited by 55
Sala‐Bayo, J., Fiddian, L., Nilsson, S. R. O., Hervig, M. E.-S., McKenzie, C., Mareschi, A., Boulos, M., Zhukovsky, P., Nicholson, J. R., Dalley, J. W., et al. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0612-4 · Cited by 55
Neurocomputational mechanisms of reinforcement-guided learning in humans: A review
Cohen, M. X. (2008) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.8.2.113 · Cited by 55
Pennington, B. F. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.03.010 · Cited by 54
Cavanagh, J. F., Gründler, T. O. J., Frank, M. J., & Allen, J. J. B. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.03.031 · Cited by 54
Self-citationDifferential Influence of Levodopa on Reward-Based Learning in Parkinson's Disease
Graef, S., Biele, G., Krugel, L. K., Marzinzik, F., Wahl, M., Wotka, J., Klostermann, F., & Heekeren, H. R. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00169 · Cited by 54
Dopamine disruption increases negotiation for cooperative interactions in a fish
Messias, J. P. M., Paula, J. R., Grutter, A. S., Bshary, R., & Soares, M. C. (2016) · Scientific Reports · doi:10.1038/srep20817 · Cited by 54
Advanced Reinforcement Learning
Daw, N. D. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00016-4 · Cited by 54
Skvortsova, V., Degos, B., Welter, M., Vidailhet, M., & Pessiglione, M. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.2081-16.2017 · Cited by 54
Dorsal striatal dopamine D1 receptor availability predicts an instrumental bias in action learning
de Boer, L., Axelsson, J., Chowdhury, R., Riklund, K., Dolan, R. J., Nyberg, L. H., Bäckman, L., & Guitart‐Masip, M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1816704116 · Cited by 54
Reward processing abnormalities in Parkinson's disease
Kapogiannis, D., Mooshagian, E., Campion, P., Grafman, J. H., Zimmermann, T. J., Ladt, K. C., & Wassermann, E. M. (2011) · Movement Disorders · doi:10.1002/mds.23701 · Cited by 54
Huebl, J., Spitzer, B., Brücke, C., Schönecker, T., Kupsch, A. R., Alesch, F., Schneider, G., & Kühn, A. A. (2014) · Cortex · doi:10.1016/j.cortex.2014.02.019 · Cited by 54
Murray, G. K., Knolle, F., Ersche, K. D., Craig, K. J., Abbott, S., Shabbir, S. S., Fineberg, N. A., Suckling, J., Sahakian, B. J., Bullmore, E. T., et al. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05292-2 · Cited by 53
Boggs, D. L., Kelly, D. L., McMahon, R. P., Gold, J. M., Gorelick, D. A., Linthicum, J., Conley, R. R., Liu, F., Waltz, J., Huestis, M. A., et al. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2011.11.009 · Cited by 53
Cognitive differences in horses performing locomotor versus oral stereotypic behaviour
Roberts, K., Hemmings, A., Moore-Colyer, M. J. S., & Hale, C. (2015) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2015.04.015 · Cited by 53
Metadata
- Authors
- Frank, M. J., Seeberger, L. C., & O'Reilly, R. C.
- Affiliations
- University of Colorado Boulder (US)
- Department of Psychology and Center for Neuroscience, University of Colorado Boulder, Boulder, CO 80309–0345, USA.
- Corresponding author
- Frank, Michael J.
- Venue
- Science
- Published
- 2004-12-10
- Volume
- 306
- Issue
- 5703
- Pages
- 1940-1943
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2163647009
- Cited by
- 1,964
- References
- 33
- Citations by year
- 2026: 57 · 2025: 73 · 2024: 83 · 2023: 79 · 2022: 91 · 2021: 99 · 2020: 134 · 2019: 104 · 2018: 125 · 2017: 111 · 2016: 115 · 2015: 111 · 2014: 134 · 2013: 111 · 2012: 108
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH069597, MH 069597-01)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Clinical Neurology › Parkinson's Disease Mechanisms and Treatments
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- Parkinson's disease, parkinsonism, dopamine, basal ganglia, positive reinforcement, negative reinforcement, avoidance learning, procedural learning, computational model, trial-and-error learning
- MeSH terms
- Aged, Antiparkinson Agents, Basal Ganglia, Cognition, Computer Simulation, Dopamine, Female, Frontal Lobe, Humans, Learning, Male, Middle Aged, Models, Neurological, Parkinson Disease, Probability, Reinforcement, Psychology, Matched-Pair Analysis, Feedback, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.