The DOI matches its Crossref record; 205 of the 205 references it cites were found in a registry or an index.
Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice
Open accessAbstract
To behave adaptively, we must learn from the consequences of our actions. Studies using event-related potentials (ERPs) have been informative with respect to the question of how such learning occurs. These studies have revealed a frontocentral negativity termed the feedback-related negativity (FRN) that appears after negative feedback. According to one prominent theory, the FRN tracks the difference between the values of actual and expected outcomes, or reward prediction errors. As such, the FRN provides a tool for studying reward valuation and decision making. We begin this review by examining the neural significance of the FRN. We then examine its functional significance. To understand the cognitive processes that occur when the FRN is generated, we explore variables that influence its appearance and amplitude. Specifically, we evaluate four hypotheses: (1) the FRN encodes a quantitative reward prediction error; (2) the FRN is evoked by outcomes and by stimuli that predict outcomes; (3) the FRN and behavior change with experience; and (4) the system that produces the FRN is maximally engaged by volitional actions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497 · cited 1×
“For instance, participants may adopt a on-linear value function (Tversky and Kahneman, 1981).”
BackgroundA BEHAVIORAL MODEL OF RATIONAL CHOICE
Simon, H. A. (1955) · The Quarterly Journal of Economics · doi:10.2307/1884852 · Cited by 15,877
Conflict monitoring and cognitive control
Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.624 · Cited by 7,351
Cognitive and emotional influences in anterior cingulate cortex
Bush, G., Luu, P., & Posner, M. I. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01483-2 · Cited by 6,259 · cited 3×
“The proosal that the ERN and FRN originate from the anterior cingulate oincides with this region’s role in planning and executing behavior Bush et al., 2000; Kennerley et al., 2006; Ridderinkhof et al., 2004).”
BackgroundHolroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
Empathy for Pain Involves the Affective but not Sensory Components of Pain
Singer, T., Seymour, B., O'Doherty, J., Kaube, H., Dolan, R. J., & Frith, C. D. (2004) · Science · doi:10.1126/science.1093535 · Cited by 3,929
The role of the medial frontal cortex in cognitive control
Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004) · Science · doi:10.1126/science.1100301 · Cited by 2,974
A neural system for error detection and compensation
Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00586.x · Cited by 2,862
Cited by
Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
Frontal midline theta reflects anxiety and cognitive control: Meta-analytic evidence
Cavanagh, J. F., & Shackman, A. J. (2015) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2014.04.003 · Cited by 623
A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages
Sambrook, T. D., & Goslin, J. (2015) · Psychological Bulletin · doi:10.1037/bul0000006 · Cited by 411
Neural mechanisms and temporal dynamics of performance monitoring
Ullsperger, M., Fischer, A. G., Nigbur, R., & Endrass, T. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.009 · Cited by 435
Hauser, T. U., Iannaccone, R., Stämpfli, P., Drechsler, R., Brandeis, D., Walitza, S., & Brem, S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.028 · Cited by 428
Beyond the FRN: Broadening the time-course of EEG and ERP components implicated in reward processing
Glazer, J. E., Kelley, N. J., Pornpattananangkul, N., Mittal, V. A., & Nusslock, R. (2018) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2018.02.002 · Cited by 361
Using EEG to Predict Consumers’ Future Choices
Telpaz, A., Webb, R., & Levy, D. J. (2015) · Journal of Marketing Research · doi:10.1509/jmr.13.0564 · Cited by 267
Becker, M. P. I., Nitsch, A. M., Miltner, W. H. R., & Straube, T. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3684-13.2014 · Cited by 266
Reinforcement learning in depression: a review of computational research
Chen, C., Takahashi, T., Nakagawa, S., Inoue, T., & Kusumi, I. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.05.005 · Cited by 233
The research domain criteria framework: The case for anterior cingulate cortex
Holroyd, C. B., & Umemoto, A. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.021 · Cited by 187
Hauser, T. U., Iannaccone, R., Ball, J., Mathys, C., Brandeis, D., Walitza, S., & Brem, S. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1093 · Cited by 168
Specificity of performance monitoring changes in obsessive-compulsive disorder
Endrass, T., & Ullsperger, M. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.03.024 · Cited by 141
A psychoengineering paradigm for the neurocognitive mechanisms of biofeedback and neurofeedback
Gaume, A., Vialatte, A., Mora-Sánchez, A., Ramdani, C., & Vialatte, F. B. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.012 · Cited by 133
Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140
The functional role of cardiac activity in perception and action
Skora, L. I., Livermore, J. J. A., & Roelofs, K. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104655 · Cited by 125
Hauser, T. U., Iannaccone, R., Dolan, R. J., Ball, J., Hättenschwiler, J., Drechsler, R., Rufer, M., Brandeis, D., Walitza, S., & Brem, S. (2017) · Psychological Medicine · doi:10.1017/s0033291716003305 · Cited by 86
Boecker-Schlier, R., Holz, N. E., Buchmann, A. F., Blomeyer, D., Plichta, M. M., Jennen-Steinmetz, C., Wolf, I., Baumeister, S., Treutlein, J., Rietschel, M., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.006 · Cited by 42
Narcissism and risky decisions: a neurophysiological approach
Yang, Z., Sedikides, C., Gu, R., Luo, Y. L. L., Wang, Y., & Cai, H. (2018) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsy053 · Cited by 35
Liu, H.-H., Hsieh, M. H., Hsu, Y.-F., & Lai, W.-S. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00592 · Cited by 11
Zanolie, K., & Crone, E. A. (2021) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2021.108020 · Cited by 4
Vahedi, J., Bahic, A., Chaliani, I., Schilbach, L., Ciupka‐Schön, B., Bellebaum, C., Pietrowsky, R., & Peterburs, J. (2025) · Psychophysiology · doi:10.1111/psyp.70142 · Cited by 3
“…is consistent with prior evidence showing learning-related increases in ERN amplitude (e.g., Bellebaum and Colosio 2014; Gawlowska et al. 2018), thus supporting the notion that the ERN reflects predictive action evaluation (Holroyd and Coles 2002; Maurer et al. 2021; Walsh and Anderson 2012).”
Metadata
- Authors
- Walsh, M. M., & Anderson, J. R.
- Venue
- Neuroscience & Biobehavioral Reviews
- Publisher
- Elsevier BV
- Published
- 2012-09
- Volume
- 36
- Issue
- 8
- Pages
- 1870-1884
- ISSN
- 0149-7634 (ISSN-L)
- OpenAlex
- W2132073746
- Cited by
- 544
- References
- 205
- FWCI
- 15.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.