Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning
Open accessAbstract
A prominent theory in neuroscience suggests reward learning is driven by the discrepancy between a subject's expectation of an outcome and the actual outcome itself. Furthermore, it is postulated that midbrain dopamine neurons relay this mismatch to target regions including the ventral striatum. Using functional MRI (fMRI), we tested striatal responses to prediction errors for probabilistic classification learning with purely cognitive feedback. We used a version of the Rescorla‐Wagner model to generate prediction errors for each subject and then entered these in a parametric analysis of fMRI activity. Activation in ventral striatum/nucleus‐accumbens (Nacc) increased parametrically with prediction error for negative feedback. This result extends recent neuroimaging findings in reward learning by showing that learning with cognitive feedback also depends on the same circuitry and dopaminergic signaling mechanisms. Hum Brain Mapp, 2005. © 2005 Wiley‐Liss, Inc.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Learning signals in the striatum are present even when feedback is informative but not explicitly rewarding.
“Interestingly, learning signals in the striatum are present even when feedback is informative but not explicitly rewarding (e.g. feedback that a choice was correct or incorrect) 26, 27.”
From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777 · see citing works
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404 · see citing works
Dissociation of reward anticipation and outcome with event-related fMRI
Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300 · see citing works
Interactive memory systems in the human brain
Poldrack, R. A., Clark, J., Paré-Blagoev, E. J., Shohamy, D., Creso Moyano, J., Myers, C., & Gluck, M. A. (2001) · Nature · doi:10.1038/35107080 · Cited by 1,132 · see citing works
Self-citationTracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
The Underpinnings of the BOLD Functional Magnetic Resonance Imaging Signal
Logothetis, N. K. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-10-03963.2003 · Cited by 1,024 · see citing works
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · see citing works
Impulsive choice induced in rats by lesions of the nucleus accumbens core
Cardinal, R. N., Pennicott, D. R., Lakmali, C., Sugathapala, Robbins, T. W., & Everitt, B. J. (2001) · Science · doi:10.1126/science.1060818 · Cited by 923 · see citing works
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · see citing works
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782 · see citing works
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · see citing works
Duvernoy, H. M. (1999) · Springer eBooks · doi:10.1007/978-3-7091-6792-2 · Cited by 759 · see citing works
Neuronal activity in monkey ventral striatum related to the expectation of reward
Schultz, W., Apicella, P., Scarnati, E., & Ljungberg, T. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04595.1992 · Cited by 744 · see citing works
Dissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740 · see citing works
Predictability modulates human brain response to reward
Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02793.2001 · Cited by 711 · see citing works
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · see citing works
Probabilistic classification learning in amnesia.Preprint
Knowlton, B. J., Squire, L. R., & Gluck, M. A. (1994) · Learning & Memory · doi:10.1101/lm.1.2.106 · Cited by 595 · see citing works
Modulation of Caudate Activity by Action Contingency
Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004) · Neuron · doi:10.1016/s0896-6273(03)00848-1 · Cited by 575 · see citing works
Reward Circuitry Activation by Noxious Thermal Stimuli
Becerra, L. R., Breiter, H. C., Wise, R. A., González, R., & Borsook, D. (2001) · Neuron · doi:10.1016/s0896-6273(01)00533-5 · Cited by 489 · see citing works
Ullsperger, M., & von Cramon, D. Y. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-10-04308.2003 · Cited by 484 · see citing works
Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455 · see citing works
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451 · see citing works
Human Striatal Responses to Monetary Reward Depend On Saliency
Zink, C. F., Pagnoni, G., Martin-Skurski, M. E., Chappelow, J., & Berns, G. S. (2004) · Neuron · doi:10.1016/s0896-6273(04)00183-7 · Cited by 432 · see citing works
Daphna Shohamy, A. (2004) · Brain · doi:10.1093/brain/awh100 · Cited by 355 · see citing works
Human striatal response to salient nonrewarding stimuli
Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M., & Berns, G. S. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-22-08092.2003 · Cited by 312 · see citing works
The Human Brain: Surface, Blood Supply, and Three-Dimensional Sectional Anatomy
Preul, M. C. (2001) · Neurosurgery · doi:10.1097/00006123-200104000-00067 · Cited by 308 · see citing works
Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3417-03.2004 · Cited by 300 · see citing works
Human Midbrain Sensitivity to Cognitive Feedback and Uncertainty During Classification Learning
Aron, A. R., Daphna Shohamy, A., Clark, J. A., Myers, C. E., Gluck, M. A., & Poldrack, R. A. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01209.2003 · Cited by 265 · see citing works
Self-citationEvaluating an adaptive network model of human learning
Gluck, M. A., & Bower, G. H. (1988) · Journal of Memory and Language · doi:10.1016/0749-596x(88)90072-1 · Cited by 256 · see citing works
Fletcher, P. C., Anderson, J. M., Shanks, D. R., Honey, R., Carpenter, T. A., Donovan, T., Papadakis, N., & Bullmore, E. T. (2001) · Nature Neuroscience · doi:10.1038/nn733 · Cited by 238 · see citing works
Neural Encoding in Ventral Striatum during Olfactory Discrimination Learning
Setlow, B., Schoenbaum, G. M., & Gallagher, M. (2003) · Neuron · doi:10.1016/s0896-6273(03)00264-2 · Cited by 220 · see citing works
Predicting events of varying probability: uncertainty investigated by fMRI
Volz, K. G., Schubotz, R. I., & von Cramon, D. Y. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00122-8 · Cited by 214 · see citing works
Lesions of Nucleus Accumbens Disrupt Learning about Aversive Outcomes
Schoenbaum, G. M., & Setlow, B. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09833.2003 · Cited by 137 · see citing works
Beninger, R. J., Wasserman, J., Zanibbi, K., Charbonneau, D., Mangels, J. A., & Beninger, B. V. (2003) · Schizophrenia Research · doi:10.1016/s0920-9964(02)00315-8 · Cited by 121 · see citing works
Stimulus Generalization and Representation in Adaptive Network Models of Category Learning
Gluck, M. A. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00096.x · Cited by 116 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792 · see citing works
The basal ganglia and the cerebellum: nodes in an integrated network
Bostan, A. C., & Strick, P. L. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0002-7 · Cited by 786 · see citing works
Masten, C. L., Eisenberger, N. I., Borofsky, L. A., Pfeifer, J. H., McNealy, K., Mazziotta, J. C., & Dapretto, M. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp007 · Cited by 529 · see citing works
How prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512 · see citing works
Modalities, Modes, and Models in Functional Neuroimaging
Friston, K. J. (2009) · Science · doi:10.1126/science.1174521 · Cited by 489 · see citing works
Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J. R., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 430 · see citing works
Genetically Determined Differences in Learning from Errors
Klein, T. A., Neumann, J., Reuter, M., Hennig, J., von Cramon, D. Y., & Ullsperger, M. (2007) · Science · doi:10.1126/science.1145044 · Cited by 424 · see citing works
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390 · see citing works
Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362 · see citing works
Neural mechanisms of observational learning
Burke, C. J., Tobler, P. N., Baddeley, M. C., & Schultz, W. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1003111107 · Cited by 356 · see citing works
Nucleus accumbens and impulsivity
Başar, K., Sesia, T., Groenewegen, H. J., Steinbusch, H. W. M., Visser-Vandewalle, V. E. R. M., & Temel, Y. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.08.007 · Cited by 276 · see citing works
Striatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277 · see citing works
Seger, C. A. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.07.010 · Cited by 272 · see citing works
The social brain and reward: Social information processing in the human striatum
Bhanji, J. P., & Delgado, M. R. (2014) · WIREs Cognitive Science · doi:10.1002/wcs.1266 · Cited by 256 · see citing works
Durston, S., van Belle, J., & de Zeeuw, P. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.07.037 · Cited by 248 · see citing works
Separate neural substrates for skill learning and performance in the ventral and dorsal striatum
Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241 · see citing works
Chase, H. W., Kumar, P., Eickhoff, S. B., & Dombrovski, A. Y. (2015) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-015-0338-7 · Cited by 225 · see citing works
Krugel, L. K., Biele, G., Mohr, P. N. C., Li, S.-C., & Heekeren, H. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905191106 · Cited by 229 · see citing works
From prediction error to psychosis: Ketamine as a pharmacological model of delusions
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2007) · Journal of Psychopharmacology · doi:10.1177/0269881107077716 · Cited by 227 · see citing works
Jarbo, K., & Verstynen, T. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2636-14.2015 · Cited by 221 · see citing works
The role of the basal ganglia in learning and memory: Insight from Parkinson’s disease
Foerde, K., & Daphna Shohamy, A. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.08.006 · Cited by 206 · see citing works
Reinforcement learning, conditioning, and the brain: Successes and challenges
Maia, T. V. (2009) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.9.4.343 · Cited by 184 · see citing works
Corlett, P. R., Honey, G. D., Aitken, M. R. F., Dickinson, A., Shanks, D. R., Absalom, A. R., Lee, M., Pomarol-Clotet, E., Murray, G. K., McKenna, P. J., et al. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.6.611 · Cited by 182 · see citing works
Disambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia
Morris, R. W., Vercammen, A., Lenroot, R., Moore, L., Langton, J. M., Short, B., Kulkarni, J., Curtis, J., O'Donnell, M., Weickert, C. S., et al. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.75 · Cited by 149 · see citing works
Neural correlates of developmental differences in risk estimation and feedback processing
van Leijenhorst, L., Crone, E. A., & Bunge, S. A. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.02.002 · Cited by 146 · see citing works
Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes
Groman, S. M., Keistler, C., Keip, A. J., Hammarlund, E., Dileone, R., Pittenger, C., Lee, D., & Taylor, J. R. (2019) · Neuron · doi:10.1016/j.neuron.2019.05.042 · Cited by 142 · see citing works
Computational and dynamic models in neuroimaging
Friston, K. J., & Dolan, R. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.068 · Cited by 131 · see citing works
MacDonald, P. A., & Monchi, O. (2011) · Parkinson s Disease · doi:10.4061/2011/572743 · Cited by 126 · see citing works
MacDonald, P. A., MacDonald, A. A., Seergobin, K. N., Tamjeedi, R., Ganjavi, H., Provost, J.-S., & Monchi, O. (2011) · Brain · doi:10.1093/brain/awr075 · Cited by 122 · see citing works
Medication impairs probabilistic classification learning in Parkinson's disease
Jahanshahi, M., Wilkinson, L., Gahir, H., Dharminda, A., & Lagnado, D. A. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.12.010 · Cited by 118 · see citing works
Predicting danger: The nature, consequences, and neural mechanisms of predictive fear learningPreprint
McNally, G. P., & Westbrook, R. F. (2006) · Learning & Memory · doi:10.1101/lm.196606 · Cited by 117 · see citing works
Durston, S., Davidson, M. C., Mulder, M., Spicer, J., Galván, A., Tottenham, N., Scheres, A., Castellanos, F. X., van Engeland, H., & Casey, B. J. (2007) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01754.x · Cited by 112 · see citing works
Schlagenhauf, F., Rapp, M. A., Huys, Q. J. M., Beck, A., Wüstenberg, T., Deserno, L., Buchholz, H., Kalbitzer, J., Buchert, R., Bauer, M., et al. (2012) · Human Brain Mapping · doi:10.1002/hbm.22000 · Cited by 103 · see citing works
Experiential reward learning outweighs instruction prior to adulthood
Decker, J. H., Lourenco, F. S., Doll, B. B., & Hartley, C. A. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0332-5 · Cited by 96 · see citing works
Seger, C. A., Peterson, E. J., Cincotta, C. M., Lopez‐Paniagua, D., & Anderson, C. W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.11.083 · Cited by 101 · see citing works
Striatal activations signal prediction errors on confidence in the absence of external feedback
Daniel, R., & Pollmann, S. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.058 · Cited by 91 · see citing works
Striatal Function in Generalized Social Phobia: A Functional Magnetic Resonance Imaging Study
Sareen, J., Campbell, D. W., Leslie, W. D., Malisza, K. L., Stein, M. B., Paulus, M. P., Kravetsky, L. B., Kjernisted, K. D., Walker, J. R., & Reiss, J. P. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.05.043 · Cited by 92 · see citing works
Daniel, R., & Pollmann, S. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.2205-09.2010 · Cited by 91 · see citing works
The surprising role of the default mode network in naturalistic perception
Brandman, T., Malach, R., & Simony, E. (2021) · Communications Biology · doi:10.1038/s42003-020-01602-z · Cited by 88 · see citing works
Schönberg, T., O’Doherty, J. P., Joel, D., Inzelberg, R., Segev, Y., & Daw, N. D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.011 · Cited by 81 · see citing works
Increased striatal activity in adolescence benefits learning
Peters, S., & Crone, E. A. (2017) · Nature Communications · doi:10.1038/s41467-017-02174-z · Cited by 75 · see citing works
Cohen, M. X. (2007) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsl021 · Cited by 84 · see citing works
Competing basal ganglia pathways determine the difference between stopping and deciding not to go
Dunovan, K., Lynch, B., Molesworth, T., & Verstynen, T. (2015) · eLife · doi:10.7554/elife.08723 · Cited by 72 · see citing works
Neuroelectric Signatures of Reward Learning and Decision-Making in the Human Nucleus Accumbens
Cohen, M. X., Axmacher, N., Lenartz, D., Elger, C. E., Sturm, V., & Schlaepfer, T. E. (2008) · Neuropsychopharmacology · doi:10.1038/npp.2008.222 · Cited by 75 · see citing works
Reward‐related activity in the human motor cortex
Kapogiannis, D., Campion, P., Grafman, J. H., & Wassermann, E. M. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06147.x · Cited by 69 · see citing works
Apicella, P., Deffains, M., Ravel, S., & Legallet, E. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06872.x · Cited by 68 · see citing works
Mitchell, M. R., Balodis, I. M., DeVito, E. E., Lacadie, C., Yeston, J., Scheinost, D., Constable, R. T., Carroll, K. M., & Potenza, M. N. (2013) · The American Journal of Drug and Alcohol Abuse · doi:10.3109/00952990.2013.841711 · Cited by 66 · see citing works
Role of ventral striatum in reward-based decision making
Heekeren, H. R., Wartenburger, I., Marschner, A., Mell, T., Villringer, A., & Reischies, F. M. (2007) · Neuroreport · doi:10.1097/wnr.0b013e3281532bd7 · Cited by 65 · see citing works
Learning by doing: an fMRI study of feedback-related brain activations
Marco‐Pallarés, J., Müller, S., & Münte, T. F. (2007) · Neuroreport · doi:10.1097/wnr.0b013e3282e9a58c · Cited by 66 · see citing works
Strategies in probabilistic categorization: Results from a new way of analyzing performancePreprint
Meeter, M., Myers, C. E., Daphna Shohamy, A., Hopkins, R. O., & Gluck, M. A. (2006) · Learning & Memory · doi:10.1101/lm.43006 · Cited by 59 · see citing works
Deserno, L., Beck, A., Huys, Q. J. M., Lorenz, R. C., Buchert, R., Buchholz, H., Plotkin, M., Kumakara, Y., Cumming, P. D., Heinze, H., et al. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12802 · Cited by 57 · see citing works
Murray, G. K., Knolle, F., Ersche, K. D., Craig, K. J., Abbott, S., Shabbir, S. S., Fineberg, N. A., Suckling, J., Sahakian, B. J., Bullmore, E. T., et al. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05292-2 · Cited by 53 · see citing works
Rule-based category learning in patients with Parkinson's disease
Price, A. L., Filoteo, J. V., & Maddox, W. T. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.01.031 · Cited by 54 · see citing works
Imaging-genetics of sex differences in ASD: distinct effects of OXTR variants on brain connectivity
Hernandez, L. M., Lawrence, K. E., Padgaonkar, N. T., Inada, M., Hoekstra, J. N., Lowe, J. K., Eilbott, J., Jack, A., Aylward, E., Gaab, N., et al. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0750-9 · Cited by 54 · see citing works
Differential Influence of Levodopa on Reward-Based Learning in Parkinson's Disease
Graef, S., Biele, G., Krugel, L. K., Marzinzik, F., Wahl, M., Wotka, J., Klostermann, F., & Heekeren, H. R. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00169 · Cited by 54 · see citing works
Myers, C. E., Moustafa, A. A., Sheynin, J., VanMeenen, K. M., Gilbertson, M. W., Orr, S. P., Beck, K. D., Pang, K. C. H., & Servatius, R. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072508 · Cited by 55 · see citing works
Impairment of probabilistic reward-based learning in schizophrenia.
Weiler, J. A., Bellebaum, C., Brüne, M., Juckel, G., & Daum, I. (2009) · Neuropsychology · doi:10.1037/a0016166 · Cited by 55 · see citing works
Neurocomputational mechanisms of reinforcement-guided learning in humans: A review
Cohen, M. X. (2008) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.8.2.113 · Cited by 50 · see citing works
Frontostriatal development and probabilistic reinforcement learning during adolescence
DePasque, S., & Galván, A. (2017) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2017.04.009 · Cited by 45 · see citing works
Striatal dopamine supports reward expectation and learning: A simultaneous PET/fMRI study
Calabro, F. J., Montez, D. F., Larsen, B., Laymon, C. M., Foran, W., Hallquist, M. N., Price, J. C., & Luna, B. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119831 · Cited by 50 · see citing works
Ott, D. V. M., Ullsperger, M., Jocham, G., Neumann, J., & Klein, T. A. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.04.038 · Cited by 50 · see citing works
Striatal and Medial Temporal Lobe Functional Interactions during Visuomotor Associative Learning
Mattfeld, A. T., & Stark, C. E. L. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhq144 · Cited by 49 · see citing works
Mathar, D., Neumann, J., Villringer, A., & Horstmann, A. (2017) · Cortex · doi:10.1016/j.cortex.2017.08.022 · Cited by 49 · see citing works
D’Astolfo, L., & Rief, W. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01253 · Cited by 46 · see citing works
Associative learning in deficit and nondeficit schizophrenia
Farkas, M., Polgár, P., Kelemen, O., Réthelyi, J., Bitter, I., Myers, C. E., Gluck, M. A., & Kéri, S. (2008) · Neuroreport · doi:10.1097/wnr.0b013e3282f2dff6 · Cited by 39 · see citing works
Abnormal prediction error is associated with negative and depressive symptoms in schizophrenia
Moran, P. M., Owen, L. H., Crookes, A. E., Al-Uzri, M. M., & Reveley, M. A. (2007) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2007.07.021 · Cited by 39 · see citing works
Feedback-based versus observational classification learning in healthy aging and Parkinson's disease
Schmitt-Eliassen, J., Ferstl, R., Wiesner, C. D., Deuschl, G., & Witt, K. (2007) · Brain Research · doi:10.1016/j.brainres.2007.01.042 · Cited by 36 · see citing works
The Involvement of Corticostriatal Loops in Learning Across Tasks, Species, and Methodologies
Seger, C. A. (2009) · Advances in behavioral biology · doi:10.1007/978-1-4419-0340-2_2 · Cited by 36 · see citing works
Sankar, A., Yttredahl, A. A., Fourcade, E. W., Mickey, B. J., Love, T., Langenecker, S. A., & Hsu, D. T. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2019.00149 · Cited by 35 · see citing works
Dissociable roles of left and right temporoparietal junction in strategic competitive interaction
Ogawa, A., & Kameda, T. (2019) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsz082 · Cited by 32 · see citing works
Kahn, L. E., Peake, S. J., Dishion, T. J., Stormshak, E. A., & Pfeifer, J. H. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00694 · Cited by 27 · see citing works
Temporal dissociation of salience and prediction error responses to appetitive and aversive taste
Hird, E., El‐Deredy, W., Jones, A. K. P., & Talmi, D. (2017) · Psychophysiology · doi:10.1111/psyp.12976 · Cited by 28 · see citing works
Wolf, D. H. (2011) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2011.00081 · Cited by 25 · see citing works
Wilkinson, L., Tai, Y., Lin, C., Lagnado, D. A., Brooks, D. J., Piccini, P. P., & Jahanshahi, M. (2014) · Human Brain Mapping · doi:10.1002/hbm.22536 · Cited by 25 · see citing works
Many hats: intratrial and reward level-dependent BOLD activity in the striatum and premotor cortex
Peterson, E. J., & Seger, C. A. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00164.2012 · Cited by 24 · see citing works
Dopaminergic contribution to cognitive sequence learning
Nagy, O., Kelemen, O., Benedek, G., Myers, C. E., Daphna Shohamy, A., Gluck, M. A., & Kéri, S. (2007) · Journal of Neural Transmission · doi:10.1007/s00702-007-0654-3 · Cited by 23 · see citing works
fMRI of the brain’s response to stimuli experimentally paired with alcohol intoxication
Kareken, D. A., Grahame, N. J., Džemidžić, M., Walker, M. J., Lehigh, C. A., & O’Connor, S. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2526-7 · Cited by 23 · see citing works
Interactive memory systems and category learning in schizophrenia
Kéri, S. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.07.003 · Cited by 22 · see citing works
Mathar, D., Wilkinson, L., Holl, A. K., Neumann, J., Deserno, L., Villringer, A., Jahanshahi, M., & Horstmann, A. (2016) · Cortex · doi:10.1016/j.cortex.2016.09.004 · Cited by 20 · see citing works
Tam, D. C. (2011) · Cognitive Computation · doi:10.1007/s12559-011-9095-2 · Cited by 21 · see citing works
Cardiac Concomitants of Feedback and Prediction Error Processing in Reinforcement Learning
Kastner, L., Kube, J., Villringer, A., & Neumann, J. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00598 · Cited by 21 · see citing works
Oscillatory brain activity links experience to expectancy during associative learning
Riels, K. M., Campagnoli, R. R., Thigpen, N., & Keil, A. (2021) · Psychophysiology · doi:10.1111/psyp.13946 · Cited by 19 · see citing works
Norman, L. R., & Basso, M. R. (2015) · Current Drug Abuse Reviews · doi:10.2174/1874473708666150309124820 · Cited by 19 · see citing works
The benefits of negative yet informative feedback
Kim, S., Hwang, S.-Y., & Lee, M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205183 · Cited by 18 · see citing works
Baseline Frontostriatal-Limbic Connectivity Predicts Reward-Based Memory Formation
Hamann, J. M., Dayan, E., Hummel, F., & Cohen, L. (2014) · Human Brain Mapping · doi:10.1002/hbm.22594 · Cited by 20 · see citing works
Independent circuits in basal ganglia and cortex for the processing of reward and precision feedback
Pascucci, D., Hickey, C., Jovicich, J., & Turatto, M. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.067 · Cited by 18 · see citing works
The effects of life stress and neural learning signals on fluid intelligence
Friedel, E., Schlagenhauf, F., Beck, A., Dolan, R. J., Huys, Q. J. M., Rapp, M. A., & Heinz, A. (2014) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-014-0519-3 · Cited by 17 · see citing works
Cognitive correlates of psychosis in patients with Parkinson's disease
Moustafa, A. A., Krishna, R., Frank, M. J., Eissa, A. M., & Hewedi, D. H. (2014) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2013.877385 · Cited by 16 · see citing works
Kéri, S., Nagy, H., Myers, C. E., Benedek, G., Daphna Shohamy, A., & Gluck, M. A. (2007) · Genes Brain & Behavior · doi:10.1111/j.1601-183x.2007.00315.x · Cited by 16 · see citing works
Neural Correlates of Effective Learning in Experienced Medical Decision-Makers
Downar, J. H., Bhatt, M. A., & Montague, P. R. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027768 · Cited by 16 · see citing works
Deep Brain Stimulation for Treatment-Resistant Depression
Kaur, N., Chou, T., Corse, A. K., Arulpragasam, A. R., Deckersbach, T., & Evans, K. C. (2013) · Psychiatric Annals · doi:10.3928/00485713-20130806-04 · Cited by 15 · see citing works
Stimulus-Dependent Adjustment of Reward Prediction Error in the Midbrain
Takemura, H., Samejima, K., Vogels, R., Sakagami, M., & Okuda, J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028337 · Cited by 15 · see citing works
“Virus and Epidemic”: Causal Knowledge Activates Prediction Error Circuitry
Fenker, D. B., Schoenfeld, M. A., Waldmann, M. R., Schuetze, H., Heinze, H., & Düzel, E. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21387 · Cited by 18 · see citing works
Rodriguez, P. F. (2009) · Learning & Memory · doi:10.1101/lm.1191609 · Cited by 15 · see citing works
Self-citationNonmotor Symptoms of Parkinson's Disease
Rektorová, I., Aarsland, D., Chaudhuri, К. R., & Strafella, A. P. (2011) · Parkinson s Disease · doi:10.4061/2011/351461 · Cited by 13 · see citing works
The Neural Mechanisms of Behavioral Inhibition
Jarcho, J. M., & Guyer, A. E. (2018) · Springer eBooks · doi:10.1007/978-3-319-98077-5_4 · Cited by 14 · see citing works
Wolff, S., Kohrs, C., Angenstein, N., & Brechmann, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-68300-y · Cited by 12 · see citing works
Enhancing the Detection of BOLD Signal in fMRI by Reducing the Partial Volume Effect
Du, Y. P., Chu, R., & Tregellas, J. R. (2014) · Computational and Mathematical Methods in Medicine · doi:10.1155/2014/973972 · Cited by 11 · see citing works
Moran, P. M., Rouse, J. L., Cross, B., Corcoran, R., & Schürmann, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0043905 · Cited by 10 · see citing works
Learning under social versus nonsocial uncertainty: A meta‐analytic approach
Martinez‐Saito, M., & Gorina, E. (2022) · Human Brain Mapping · doi:10.1002/hbm.25948 · Cited by 6 · see citing works
- Authors
- Rodriguez, P. F., Aron, A. R., & Poldrack, R. A.
- Affiliations
- University of California, Irvine (US)
- University of California, Los Angeles (US)
- Venue
- Human Brain Mapping
- Publisher
- Wiley
- Published
- 2005-08-09
- Volume
- 27
- Issue
- 4
- Pages
- 306-313
- ISSN
- 1065-9471 (ISSN-L)
- 1097-0193
- PMC
- PMC6871483
- OpenAlex
- W1997450499
- Cited by
- 122
- References
- 43
- Citations by year
- 2026: 4 · 2025: 2 · 2022: 3 · 2021: 4 · 2020: 5 · 2019: 5 · 2018: 3 · 2017: 7 · 2016: 1 · 2015: 7 · 2014: 7 · 2013: 6 · 2012: 3
- FWCI
- 4.61
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Human Brain Mapping (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (0223843)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- prediction error, ventral striatum, nucleus accumbens, reward learning, classification learning, cognitive feedback, Rescorla-Wagner model, dopaminergic signaling, negative feedback
- MeSH terms
- Basal Ganglia, Brain Mapping, Cognition, Dopamine, Feedback, Humans, Learning, Magnetic Resonance Imaging, Models, Neurological, Nucleus Accumbens, Pattern Recognition, Visual, Photic Stimulation, Predictive Value of Tests, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
