The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Human Midbrain Sensitivity to Cognitive Feedback and Uncertainty During Classification Learning
Abstract
Mesencephalic dopaminergic system (MDS) neurons may participate in learning by providing a prediction error signal to their targets, which include ventral striatal, orbital, and medial frontal regions, as well as by showing sensitivity to the degree of uncertainty associated with individual stimuli. We investigated the mechanisms of probabilistic classification learning in humans using functional magnetic resonance imaging to examine the effects of feedback and uncertainty. The design was optimized for separating neural responses to stimulus, delay, and negative and positive feedback components. Compared with fixation, stimulus and feedback activated brain regions consistent with the MDS, whereas the delay period did not. Midbrain activity was significantly different for negative versus positive feedback (consistent with coding of the “prediction error”) and was reliably correlated with the degree of uncertainty as well as with activity in MDS target regions. Purely cognitive feedback apparently engages the same regions as rewarding stimuli, consistent with a broader characterization of this network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,462
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 7×
“One additional subject was excluded due to extensive signal dropout, leaving 15 subjects in the analyzed dataset.”
BackgroundResultInfluentialThe Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses
Gehring, W. J., & Willoughby, A. R. (2002) · Science · doi:10.1126/science.1066893 · Cited by 1,884
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Cited by
Kober, H., Barrett, L. F., Joseph, J., Bliss-Moreau, E., Lindquist, K., & Wager, T. D. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.059 · Cited by 1,144
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T.-Y., & Camerer, C. F. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02402.x · Cited by 882
“Previous studies have found that the expectation of feedback is sufficient for activation of the caudate (Aron et al., 2004).”
Bilder, R. M., Volavka, J., Lachman, H. M., & Grace, A. A. (2004) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300542 · Cited by 769
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692
Figner, B., Mackinlay, R. J., Wilkening, F., & Weber, E. U. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0014983 · Cited by 625
Reinforcement Learning Signal Predicts Social Conformity
Klucharev, V., Hytönen, K., Rijpkema, M., Smidts, A., & Fernández, G. (2009) · Neuron · doi:10.1016/j.neuron.2008.11.027 · Cited by 594
Modulation of competing memory systems by distraction
Foerde, K., Knowlton, B. J., & Poldrack, R. A. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0602659103 · Cited by 599
Self-citationComputational psychiatry: the brain as a phantastic organ
Friston, K. J., Stephan, K. E., Montague, R., & Dolan, R. J. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70275-5 · Cited by 531
Substantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532
Integrating Memories in the Human Brain: Hippocampal-Midbrain Encoding of Overlapping Events
Shohamy, D., & Wagner, A. D. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.023 · Cited by 539
Self-citationReward Processing in Schizophrenia: A Deficit in the Representation of Value
Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., & Heerey, E. A. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn068 · Cited by 521
Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems
Tobler, P. N., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00745.2006 · Cited by 472
The Roles of the Caudate Nucleus in Human Classification Learning
Seger, C. A., & Cincotta, C. M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3401-04.2005 · Cited by 407
Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk
Trepel, C., Fox, C. R., & Poldrack, R. A. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.01.016 · Cited by 404
Self-citationPrediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376
Knowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339
Neural basis of the undermining effect of monetary reward on intrinsic motivation
Murayama, K., Matsumoto, M., Izuma, K., & Matsumoto, K. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1013305107 · Cited by 365
The good, the bad and the neutral: Electrophysiological responses to feedback stimuli
Holroyd, C. B., Hajcak, G., & Larsen, J. T. (2006) · Brain Research · doi:10.1016/j.brainres.2005.12.015 · Cited by 350
An fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 346
Attention and associative learning in humans: An integrative review.
Le Pelley, M. E., Mitchell, C. J., Beesley, T., George, D. N., & Wills, A. J. (2016) · Psychological Bulletin · doi:10.1037/bul0000064 · Cited by 329
Nieuwenhuis, S., Slagter, H. A., Von Geusau, N. J. A., Heslenfeld, D. J., & Holroyd, C. B. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04152.x · Cited by 317
A Dual Role for Prediction Error in Associative Learning
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn161 · Cited by 306
“Cerebral Cortex May 2009;19:1175--1185 doi:10.1093/cercor/bhn161 Advance Access publication September 26, 2008”
InfluentialStriatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277
Seger, C. A. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.07.010 · Cited by 274
The Cognitive Neuroscience of Human Decision Making: A Review and Conceptual Framework
Fellows, L. K. (2004) · Behavioral and Cognitive Neuroscience Reviews · doi:10.1177/1534582304273251 · Cited by 265
Neural systems implicated in delayed and probabilistic reinforcement
Cardinal, R. N. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.004 · Cited by 248
From prediction error to psychosis: Ketamine as a pharmacological model of delusions
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2007) · Journal of Psychopharmacology · doi:10.1177/0269881107077716 · Cited by 227
Impaired reward prediction error encoding and striatal-midbrain connectivity in depression
Kumar, P., Goer, F., Murray, L., Dillon, D. G., Beltzer, M. L., Cohen, A. L., Brooks, N. H., & Pizzagalli, D. A. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0032-x · Cited by 219
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Prediction error associated with the perceptual segmentation of naturalistic events
Zacks, J. M., Kurby, C. A., Eisenberg, M. L., & Haroutunian, N. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00078 · Cited by 202
A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism
Moustafa, A. A., Sherman, S. J., & Frank, M. J. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.07.011 · Cited by 192
Neural correlates of tic severity and cognitive control in children with Tourette syndrome
Baym, C. L., Corbett, B. A., Wright, S. B., & Bunge, S. A. (2008) · Brain · doi:10.1093/brain/awm278 · Cited by 186
Waltz, J. A., Schweitzer, J. B., Gold, J. M., Kurup, P. K., Ross, T. J., Jo Salmeron, B., Rose, E. J., McClure, S. M., & Stein, E. A. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.214 · Cited by 186
Corlett, P. R., Honey, G. D., Aitken, M. R. F., Dickinson, A., Shanks, D. R., Absalom, A. R., Lee, M., Pomarol-Clotet, E., Murray, G. K., McKenna, P. J., et al. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.6.611 · Cited by 182
Neural coding of distinct statistical properties of reward information in humans
Dreher, J.-C., Kohn, P., & Berman, K. F. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj004 · Cited by 180
Neural correlates of developmental differences in risk estimation and feedback processing
van Leijenhorst, L., Crone, E. A., & Bunge, S. A. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.02.002 · Cited by 146
Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning
Rodriguez, P. F., Aron, A. R., & Poldrack, R. A. (2006) · Human Brain Mapping · doi:10.1002/hbm.20186 · Cited by 122
Self-citationSleep enhances category learning.
Djonlagic, I., Rosenfeld, A., Shohamy, D., Myers, C., Gluck, M., & Stickgold, R. (2009) · Learning & Memory · doi:10.1101/lm.1634509 · Cited by 111
“…supported by the MTL and prefrontal cortex are activated during observational learning and early stages of feedback learning (using 100 trials), while the striatum is activated as feedback training continues (Poldrack et al. 2001; Aron et al. 2004; Hopkins et al. 2004; Shohamy et al. 2004a,b).”
MethodResultSelf-citationRizk-Jackson, A., Stoffers, D., Sheldon, S., Kuperman, J., Dale, A., Goldstein, J., Corey-Bloom, J., Poldrack, R. A., & Aron, A. R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.04.273 · Cited by 107
Self-citationContextual novelty changes reward representations in the striatum
Guitart-Masip, M., Bunzeck, N., Stephan, K. E., Dolan, R. J., & Düzel, E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5331-09.2010 · Cited by 104
Foerde, K., Poldrack, R. A., Knowlton, B. J., Sabb, F. W., Bookheimer, S. Y., Bilder, R. M., Guthrie, D., Granholm, E., Nuechterlein, K. H., Marder, S. R., et al. (2008) · Neuropsychology · doi:10.1037/0894-4105.22.1.100 · Cited by 67
Self-citationToward a dual-learning systems model of speech category learning.
Chandrasekaran, B., Koslov, S. R., & Maddox, W. T. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00825 · Cited by 55
General functioning predicts reward and punishment learning in schizophrenia
Somlai, Z., Moustafa, A. A., Kéri, S., Myers, C. E., & Gluck, M. A. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2010.07.028 · Cited by 45
Self-citationThe rewarding value of good motor performance in the context of monetary incentives
Lutz, K., Pedroni, A., Nadig, K., Luechinger, R., & Jäncke, L. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.03.030 · Cited by 40
Koch, K., Wagner, G., Schachtzabel, C., Schultz, C. C., Güllmar, D., Reichenbach, J. R., Sauer, H., Zimmer, C., & Schlösser, R. G. M. (2014) · Human Brain Mapping · doi:10.1002/hbm.22284 · Cited by 42
Modulation of corticospinal excitability by reward depends on task framing
Mooshagian, E., Keisler, A., Zimmermann, T., Schweickert, J. M., & Wassermann, E. M. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.12.021 · Cited by 24
Buchy, L., Hawco, C., Bodnar, M., Izadi, S., Dell'Elce, J., Messina, K., & Lepage, M. (2014) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12177 · Cited by 17
Metadata
- Authors
- Aron, A. R., Shohamy, D., Clark, J., Myers, C., Gluck, M. A., & Poldrack, R. A.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2004-08
- Volume
- 92
- Issue
- 2
- Pages
- 1144-1152
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2167277914
- Cited by
- 269
- References
- 40
- FWCI
- 10.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.