The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Human Midbrain Sensitivity to Cognitive Feedback and Uncertainty During Classification Learning
Abstract
Mesencephalic dopaminergic system (MDS) neurons may participate in learning by providing a prediction error signal to their targets, which include ventral striatal, orbital, and medial frontal regions, as well as by showing sensitivity to the degree of uncertainty associated with individual stimuli. We investigated the mechanisms of probabilistic classification learning in humans using functional magnetic resonance imaging to examine the effects of feedback and uncertainty. The design was optimized for separating neural responses to stimulus, delay, and negative and positive feedback components. Compared with fixation, stimulus and feedback activated brain regions consistent with the MDS, whereas the delay period did not. Midbrain activity was significantly different for negative versus positive feedback (consistent with coding of the “prediction error”) and was reliably correlated with the degree of uncertainty as well as with activity in MDS target regions. Purely cognitive feedback apparently engages the same regions as rewarding stimuli, consistent with a broader characterization of this network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,464
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses
Gehring, W. J., & Willoughby, A. R. (2002) · Science · doi:10.1126/science.1066893 · Cited by 1,884
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Dissociation of reward anticipation and outcome with event-related fMRI
Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300
Acute effects of cocaine on human brain activity and emotion
Breiter, H. C., Gollub, R. L., Weisskoff, R. M., Kennedy, D. N., Makris, N., Berke, J. D., Goodman, J. M., Kantor, H. L., Gastfriend, D. R., Riorden, J. P., et al. (1997) · Neuron · doi:10.1016/s0896-6273(00)80374-8 · Cited by 1,270
Interactive memory systems in the human brain
Poldrack, R. A., Clark, J., Paré-Blagoev, E. J., Shohamy, D., Creso Moyano, J., Myers, C., & Gluck, M. A. (2001) · Nature · doi:10.1038/35107080 · Cited by 1,132
Self-citationDopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,117
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Beautiful Faces Have Variable Reward Value
Aharon, I., Etcoff, N., Ariely, D., Chabris, C. F., O'Connor, E., & Breiter, H. C. (2001) · Neuron · doi:10.1016/s0896-6273(01)00491-3 · Cited by 1,087
The Underpinnings of the BOLD Functional Magnetic Resonance Imaging Signal
Logothetis, N. K. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-10-03963.2003 · Cited by 1,039
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Predictability modulates human brain response to reward
Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02793.2001 · Cited by 711
Martinez, D., Slifstein, M., Broft, A., Mawlawi, O., Hwang, D.-R., Huang, Y., Cooper, T., Kegeles, L., Zarahn, E., Abi-Dargham, A., et al. (2003) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1097/01.wcb.0000048520.34839.1a · Cited by 569
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 569
Elliott, R., Newman, J. L., Longe, O. A., & Deakin, J. F. W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-01-00303.2003 · Cited by 514
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506
Learning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451
(1994) · Choice Reviews Online · doi:10.5860/choice.32-1815 · Cited by 414
Shohamy, D. (2004) · Brain · doi:10.1093/brain/awh100 · Cited by 356
Self-citationGABA-containing neurons in the rat ventral tegmental area project to the prefrontal cortex
Carr, D. B., & Sesack, S. R. (2000) · Synapse · doi:10.1002/1098-2396(200011)38:2<114::aid-syn2>3.0.co;2-r · Cited by 352
Cerebral energetics and spiking frequency: The neurophysiological basis of fMRI
Smith, A. J., Blumenfeld, H., Behar, K. L., Rothman, D. L., Shulman, R. G., & Hyder, F. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.132272199 · Cited by 349
The GABA and substance P input to dopaminergic neurones in the substantia nigra of the rat
Bolam, J. P., & Smith, Y. (1990) · Brain Research · doi:10.1016/0006-8993(90)90811-o · Cited by 260
Chen, Y. C. I., Galpern, W. R., Brownell, A., Matthews, R. T., Bogdanov, M., Isacson, O., Keltner, J. R., Beal, M. F., Rosen, B. R., & Jenkins, B. G. (1997) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910380306 · Cited by 257
Relationship of spikes, synaptic activity, and local changes of cerebral blood flow
Lauritzen, M. (2001) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1097/00004647-200112000-00001 · Cited by 253
Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior
Hollerman, J. R., Tremblay, L., & Schultz, W. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26015-9 · Cited by 221
Predicting events of varying probability: uncertainty investigated by fMRI
Volz, K. G., Schubotz, R. I., & von Cramon, D. Y. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00122-8 · Cited by 214 · cited 2×
“…of this focus (0, 30, 48; for the comparison of negative and positive feedback) were very close to those identified in a study of uncertain versus certain predictions (Volz et al. 2003) (coordinates: 4, 30, 46), as well as a further fMRI study of hypothesis testing (Elliott and Dolan 1998).”
BackgroundResultElliott, R., & Dolan, R. J. (1998) · NeuroImage · doi:10.1006/nimg.1998.0344 · Cited by 170
In Vivo Atlas of Deep Brain Structures
Lucerna, S., Salpietro, F. M., Alafaci, C., & Tomasello, F. F. (2002) · Springer eBooks · doi:10.1007/978-3-642-56381-2 · Cited by 25
Xiong (1999) · doi:10.1002/(sici)1097-0193(1999)8:2/3
Cited by
Kober, H., Barrett, L. F., Joseph, J., Bliss-Moreau, E., Lindquist, K., & Wager, T. D. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.059 · Cited by 1,144
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T.-Y., & Camerer, C. F. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02402.x · Cited by 882
“Previous studies have found that the expectation of feedback is sufficient for activation of the caudate (Aron et al., 2004).”
Bilder, R. M., Volavka, J., Lachman, H. M., & Grace, A. A. (2004) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300542 · Cited by 769
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692
Figner, B., Mackinlay, R. J., Wilkening, F., & Weber, E. U. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0014983 · Cited by 625
Metadata
- Authors
- Aron, A. R., Shohamy, D., Clark, J., Myers, C., Gluck, M. A., & Poldrack, R. A.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2004-08
- Volume
- 92
- Issue
- 2
- Pages
- 1144-1152
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2167277914
- Cited by
- 269
- References
- 40
- FWCI
- 10.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.