The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning
Open accessAbstract
We assessed electrophysiological activity over the medial frontal cortex (MFC) during outcome-based behavioral adjustment using a probabilistic reversal learning task. During recording, participants were presented two abstract visual patterns on each trial and had to select the stimulus rewarded on 80% of trials and to avoid the stimulus rewarded on 20% of trials. These contingencies were reversed frequently during the experiment. Previous EEG work has revealed feedback-locked electrophysiological responses over the MFC (feedback-related negativity; FRN), which correlate with the negative prediction error [Holroyd, C. B., & Coles, M. G. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679–709, 2002] and which predict outcome-based adjustment of decision values [Cohen, M. X., & Ranganath, C. Reinforcement learning signals predict future decisions. Journal of Neuroscience, 27, 371–378, 2007]. Unlike previous paradigms, our paradigm enabled us to disentangle, on the one hand, mechanisms related to the reward prediction error, derived from reinforcement learning (RL) modeling, and on the other hand, mechanisms related to explicit rule-based adjustment of actual behavior. Our results demonstrate greater FRN amplitudes with greater RL model-derived prediction errors. Conversely expected negative outcomes that preceded rule-based behavioral reversal were not accompanied by an FRN. This pattern contrasted remarkably with that of the P3 amplitude, which was significantly greater for expected negative outcomes that preceded rule-based behavioral reversal than for unexpected negative outcomes that did not precede behavioral reversal. These data suggest that the FRN reflects prediction error and associated RL-based adjustment of decision values, whereas the P3 reflects adjustment of behavior on the basis of explicit rules.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
MacDonald, A. W., Cohen, J. D., Stenger, V. A., & Carter, C. S. (2000) · Science · doi:10.1126/science.288.5472.1835 · Cited by 3,666
Is the P300 component a manifestation of context updating?
Donchin, E., & Coles, M. G. H. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00058027 · Cited by 3,585
Contributions of anterior cingulate cortex to behaviour
Devinsky, O., Morrell, M. J., & Vogt, B. A. (1995) · Brain · doi:10.1093/brain/118.1.279 · Cited by 3,377
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses
Gehring, W. J., & Willoughby, A. R. (2002) · Science · doi:10.1126/science.1066893 · Cited by 1,884 · cited 2×
“…one of its electrophysiological signatures, the feedback-related negativity (FRN), to further elucidate the role of the MFC (Holroyd & Coles, 2008; Gehring & Willoughby, 2002, but see Nieuwenhuis, Slagter, von Geusau, Heslenfeld, & Holroyd, 2005; van Veen, Holroyd, Cohen, Stenger, & Carter,…”
Decision making, the P3, and the locus coeruleus–norepinephrine system
Nieuwenhuis, S., Aston-Jones, G., & Cohen, J. D. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.4.510 · Cited by 1,678 · cited 1×
“In addition, noradrenergic mechanisms might also influence the amplitude of the P3 (Nieuwenhuis, Aston-Jones, & Cohen, 2005 ) and FRN (Riba, Rodriguez-Fornells, Morte, Munte, & Barbanoj, 2005 ).”
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
Independent Coding of Reward Magnitude and Valence in the Human Brain
Yeung, N., & Sanfey, A. G. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.4537-03.2004 · Cited by 933 · cited 3×
“Hence, we used a method similar to that used by Yeung and Sanfey (2004) to obtain independent estimates of FRN and P3 amplitude and applied the trial-by-trial linear regression method to the P3 as well as the FRN. Critically, we performed supplementary analyses to disentangle the estimates of these…”
Cools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906
Self-citationSerotoninergic regulation of emotional and behavioural control processes
Cools, R., Roberts, A. C., & Robbins, T. W. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.10.011 · Cited by 656 · cited 1×
“Conversely, serotoninergic manipulation by the dietary tryptophan depletion procedure modulated activity in the MFC, and this effect was not restricted to the final reversal errors but extended to the spurious negative feedback events (Cools, Roberts, & Robbins, 2008; Evers et al., 2005).”
Self-citationOn the ERN and the significance of errors
Hajcak, G., Moser, J. S., Yeung, N., & Simons, R. F. (2005) · Psychophysiology · doi:10.1111/j.1469-8986.2005.00270.x · Cited by 608 · cited 1×
“…detection of changes in task contingency (Barcelo, Escera, Corral, & Perianez, 2006; Johnson & Donchin, 1982) as well as by unpredicted (rewarding) events (Bellebaum & Daum, 2008; Hajcak, Moser, Holroyd, & Simons, 2007; Hajcak, Holroyd, Moser, & Simons, 2005; Hajcak, Moser, Yeung, & Simons, 2005).”
Neurochemical Modulation of Response Inhibition and Probabilistic Learning in Humans
Chamberlain, S. R., Müller, U., Blackwell, A. D., Clark, L., Robbins, T. W., & Sahakian, B. J. (2006) · Science · doi:10.1126/science.1121218 · Cited by 573 · cited 2×
“…that dopaminergic and serotoninergic manipulations influence human probabilistic reversal learning, in terms of both behavioral performance (Chamberlain et al., 2006; Cools, Barker, Sahakian, & Robbins, 2001; Mehta, Swainson, Ogilvie, Sahakian, & Robbins, 2001) and neural correlates (Cools…”
ERP Correlates of Feedback and Reward Processing in the Presence and Absence of Response Choice
Yeung, N., Holroyd, C. B., & Cohen, J. D. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh153 · Cited by 520
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498
Functional organization of the medial frontal cortex
Rushworth, M. F., Buckley, M. J., Behrens, T. E., Walton, M. E., & Bannerman, D. M. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.03.001 · Cited by 353
Learning-related changes in reward expectancy are reflected in the feedback-related negativity
Bellebaum, C., & Daum, I. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06138.x · Cited by 299
Mehta, M. A., Swainson, R., Ogilvie, A. D., Sahakian, B., & Robbins, T. W. (2001) · Psychopharmacology · doi:10.1007/s002130100851 · Cited by 235
Self-citationDodds, C. M., Muller, U., Clark, L., van Loon, A., Cools, R., & Robbins, T. W. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1153-08.2008 · Cited by 113
Self-citationAdaptive coding of action values in the human rostral cingulate zone
Jocham, G., Neumann, J., Klein, T. A., Danielmeier, C., & Ullsperger, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0349-09.2009 · Cited by 106
Cited by
Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
Frontal midline theta reflects anxiety and cognitive control: Meta-analytic evidence
Cavanagh, J. F., & Shackman, A. J. (2015) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2014.04.003 · Cited by 623
Walsh, M. M., & Anderson, J. R. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.05.008 · Cited by 544
A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages
Sambrook, T. D., & Goslin, J. (2015) · Psychological Bulletin · doi:10.1037/bul0000006 · Cited by 411
Metadata
- Authors
- Chase, H. W., Swainson, R., Durham, L., Benham, L., & Cools, R.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 2011-04-01
- Volume
- 23
- Issue
- 4
- Pages
- 936-946
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2159371292
- Cited by
- 223
- References
- 21
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.