Modulation of the feedback-related negativity by instruction and experience
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
A great deal of research focuses on how humans and animals learn from trial-and-error interactions with the environment. This research has established the viability of reinforcement learning as a model of behavioral adaptation and neural reward valuation. Error-driven learning is inefficient and dangerous, however. Fortunately, humans learn from nonexperiential sources of information as well. In the present study, we focused on one such form of information, instruction. We recorded event-related potentials as participants performed a probabilistic learning task. In one experiment condition, participants received feedback only about whether their responses were rewarded. In the other condition, they also received instruction about reward probabilities before performing the task. We found that instruction eliminated participants’ reliance on feedback as evidenced by their immediate asymptotic performance in the instruction condition. In striking contrast, the feedback-related negativity, an event-related potential component thought to reflect neural reward prediction error, continued to adapt with experience in both conditions. These results show that, whereas instruction may immediately control behavior, certain neural responses must be learned from experience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027 · cited 6×
“Although midbrain dopamine neurons target both structures, and although reward learning engages each (19, 33), the ACC and nucleus accumbens may respond differently to instruction.”
BackgroundInfluentialSeparate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 4×
“According to one proposal, the cognitive system arbitrates between model-free and model-based controllers on the basis of the relative uncertainty of their estimates (12).”
BackgroundResultInfluentialBalleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.6.788 · Cited by 1,530
Reward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · cited 3×
“According to still other accounts, learning systems operate independently until a response is required (6, 12, 13).”
BackgroundInteractive memory systems in the human brain
Poldrack, R. A., Clark, J., Paré-Blagoev, E. J., Shohamy, D., Creso Moyano, J., Myers, C., & Gluck, M. A. (2001) · Nature · doi:10.1038/35107080 · Cited by 1,132
Animal intelligence; experimental studies
Thorndike, E. L. (1911) · doi:10.5962/bhl.title.55072 · Cited by 1,100
Action sets and decisions in the medial frontal cortex
RUSHWORTH, M., WALTON, M., KENNERLEY, S., & BANNERMAN, D. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.07.009 · Cited by 1,004 · cited 2×
“To the extent that the ACC is responsible for ongoing performance monitoring (21), participants may have paid less attention to feedback when exogenous signals provided information about reward contingencies on every trial.”
BackgroundJohnson, R. (1986) · Psychophysiology · doi:10.1111/j.1469-8986.1986.tb00649.x · Cited by 960
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · cited 1×
“This result is also consistent with the finding that neurons in the PFC and BG adapt at different rates during reversal learning (31).”
ResultNieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. H. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.05.003 · Cited by 557
ERP Correlates of Feedback and Reward Processing in the Presence and Absence of Response Choice
Yeung, N., Holroyd, C. B., & Cohen, J. D. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh153 · Cited by 520 · cited 2×
“In a related study (25), the P300 was larger when participants viewed outcomes in a choice task than when they passively viewed identical outcomes.”
BackgroundDopaminergic Genes Predict Individual Differences in Susceptibility to Confirmation Bias
Doll, B. B., Hutchison, K. E., & Frank, M. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6486-10.2011 · Cited by 184
Cited by
Walsh, M. M., & Anderson, J. R. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.05.008 · Cited by 544
Self-citationNeural mechanisms and temporal dynamics of performance monitoring
Ullsperger, M., Fischer, A. G., Nigbur, R., & Endrass, T. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.009 · Cited by 435
Hauser, T. U., Iannaccone, R., Stämpfli, P., Drechsler, R., Brandeis, D., Walitza, S., & Brem, S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.028 · Cited by 428
A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages
Sambrook, T. D., & Goslin, J. (2015) · Psychological Bulletin · doi:10.1037/bul0000006 · Cited by 411
Event-related potential studies of outcome processing and feedback-guided learning
San Martín, R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00304 · Cited by 354
Metadata
- Authors
- Walsh, M. M., & Anderson, J. R.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2011-11-07
- Volume
- 108
- Issue
- 47
- Pages
- 19048-19053
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W1985000262
- Cited by
- 102
- References
- 16
- FWCI
- 4.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.