The influence of feedback valence in associative learning
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
The neural systems engaged by intrinsic positive or negative feedback were defined in an associative learning task. Through trial and error, participants learned the arbitrary assignments of a set of stimuli to one of two response categories. Informative feedback was provided on less than 25% of the trials. During positive feedback blocks, half of the trials were eligible for informative feedback; of these, informative feedback was only provided when the response was correct. A similar procedure was used on negative feedback blocks, but here informative feedback was only provided when the response was incorrect. In this manner, we sought to identify regions that were differentially responsive to positive and negative feedback as well as areas that were responsive to both types of informative feedback. Several regions of interest, including the bilateral nucleus accumbens, caudate nucleus, anterior insula, right cerebellar lobule VI, and left putamen, were sensitive to informative feedback regardless of valence. In contrast, several regions were more selective to positive feedback compared to negative feedback. These included the insula, amygdala, putamen, and supplementary motor area. No regions were more strongly activated by negative feedback compared to positive feedback. These results indicate that the neural areas supporting associative learning vary as a function of how that information is learned. In addition, areas linked to intrinsic reinforcement showed considerable overlap with those identified in studies using extrinsic reinforcers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Does Rejection Hurt? An fMRI Study of Social Exclusion
Eisenberger, N. I., Lieberman, M. D., & Williams, K. D. (2003) · Science · doi:10.1126/science.1089134 · Cited by 3,849 · cited 1×
“While activation in the insula has been associated with negative events including pain (Craig, 2003), rejection within a social context (Eisenberger et al., 2003), and punishment in reward paradigms (Abler et al., 2005; O'Doherty et al., 2003; Ullsperger and von Cramon, 2003), it has also been…”
Marr, D. (1969) · The Journal of Physiology · doi:10.1113/jphysiol.1969.sp008820 · Cited by 3,253
Ongur, D. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.206 · Cited by 2,627
Interoception: the sense of the physiological condition of the body
(Bud) Craig, A. (2003) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(03)00090-4 · Cited by 2,556
A theory of cerebellar function
Albus, J. S. (1971) · Mathematical Biosciences · doi:10.1016/0025-5564(71)90051-4 · Cited by 2,539 · cited 1×
“Basal ganglia learning models focus upon the reward signaling properties of dopamine (e.g., McClure et al., 2003b), whereas cerebellar learning models focus upon error signals generated by climbing fiber input (e.g., Albus, 1971; Marr, 1969).”
KRINGELBACH, M. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.03.006 · Cited by 1,977 · cited 1×
“It has strong connections with orbitofrontal and prefrontal cortices; these areas are associated with sensory rewards (Alexander et al., 1990; Kringelbach and Rolls, 2004; Rolls, 2000).”
Basal ganglia and cerebellar loops: motor and cognitive circuits
Middleton, F. (2000) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00040-5 · Cited by 1,940 · cited 1×
“Unlike the caudate nucleus, which receives prefrontal inputs and is associated with high level cognition, the putamen receives a mixture of prefrontal, premotor and motor inputs and is more closely associated with the motoric aspect of S-R learning (Middleton and Strick, 2000, 2001).”
The Orbitofrontal Cortex and Reward
Rolls, E. T. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.284 · Cited by 1,595 · cited 1×
“It has strong connections with orbitofrontal and prefrontal cortices; these areas are associated with sensory rewards (Alexander et al., 1990; Kringelbach and Rolls, 2004; Rolls, 2000).”
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Right hemispheric dominance of inhibitory control: An event-related functional MRI study
Garavan, H., Ross, T. J., & Stein, E. A. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.14.8301 · Cited by 1,394
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303 · cited 2×
“The nucleus accumbens, for example, has traditionally been associated with anticipation of impending reward, such that only positive or more favorable cues produce an increased response, whereas negative or undesirable cues have no effect (Breiter et al., 2001; Schultz, 2000).”
Acute effects of cocaine on human brain activity and emotion
Breiter, H. C., Gollub, R. L., Weisskoff, R. M., Kennedy, D. N., Makris, N., Berke, J. D., Goodman, J. M., Kantor, H. L., Gastfriend, D. R., Riorden, J. P., et al. (1997) · Neuron · doi:10.1016/s0896-6273(00)80374-8 · Cited by 1,270
Baxter, M. G., & Murray, E. A. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn875 · Cited by 1,200
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116 · cited 5×
“In studies showing transient changes within the caudate nucleus (Delgado et al., 2000; Elliott et al., 2000), a positive reward of some kind was always possible within each trial.”
InfluentialInsula of the old world monkey. III: Efferent cortical output and comments on function
Mesulam, M. ‐., & Mufson, E. J. (1982) · Journal of Comparative Neurology · doi:10.1002/cne.902120104 · Cited by 1,013 · cited 2×
“, 2004), and the insula, which assesses sensory input (Mesulam and Mufson, 1982) and is engaged during uncertainty in decision-making (Casey et al.”
Time Discounting for Primary Rewards
McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4246-06.2007 · Cited by 971
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917 · cited 1×
“In the amygdala, neurons can rapidly adjust their activity to reflect both positive and negative value of an external stimulus, which is predictive of how fast monkeys learn to respond to a stimulus (Paton et al., 2006).”
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · cited 2×
“…e l s ev i e r. c o m / l o c a t e / y n i m g striatum responds to numerous rewarding stimuli, including cocaine (Breiter et al., 1997), money (Breiter et al., 2001; Delgado et al., 2000; Elliott et al., 2003; Thut et al., 1997), and pleasurable tastes (Berns et al., 2001; McClure et al., 2003a).”
How Many Subjects Constitute a Study?
Friston, K. J., Holmes, A. P., & Worsley, K. J. (1999) · NeuroImage · doi:10.1006/nimg.1999.0439 · Cited by 814 · cited 2×
“Next, a random effects model was performed to make group statistical inferences (Friston et al., 1999a), and contrasts (described below) were applied using a false detection rate correction (Genovese et al., 2002) at p b 0.05.”
InfluentialDissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740 · cited 1×
“In studies showing transient changes within the caudate nucleus (Delgado et al., 2000; Elliott et al., 2000), a positive reward of some kind was always possible within each trial.”
Functional magnetic resonance imaging of reward prediction
Knutson, B., & Cooper, J. C. (2005) · Current Opinion in Neurology · doi:10.1097/01.wco.0000173463.24758.f6 · Cited by 736 · cited 1×
“The caudate nucleus is known for its involvement in action contingency (Knutson and Cooper, 2005; Tricomi et al., 2004).”
Predictability modulates human brain response to reward
Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02793.2001 · Cited by 711
O'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 4×
“However, growing evidence suggests that salience may also invoke a response (Cooper and Knutson, 2008; Tricomi et al., 2004; Zink et al., 2004), such that negative events, if motivationally salient, will also induce a response in the same region (Seymour et al., 2004).”
InfluentialCasey, B. J., Thomas, K. M., Welsh, T. F., Badgaiyan, R. D., Eccard, C. H., Jennings, J. R., & Crone, E. A. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.15.8728 · Cited by 389 · cited 4×
“…context (Eisenberger et al., 2003), and punishment in reward paradigms (Abler et al., 2005; O'Doherty et al., 2003; Ullsperger and von Cramon, 2003), it has also been implicated in decision-making and behavioral monitoring (Casey et al., 2000; Huettel et al., 2005; Paulus et al., 2003, 2005).”
InfluentialActivity in human reward-sensitive brain areas is strongly context dependent
Nieuwenhuis, S., Heslenfeld, D. J., Alting von Geusau, N. J., Mars, R. B., Holroyd, C. B., & Yeung, N. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.043 · Cited by 289 · cited 2×
“Reward processing systems determine whether an outcome is favorable based upon the range of possible outcomes (Breiter et al., 2001; Nieuwenhuis et al., 2005); an outcome of $0 is undesirable when other outcomes provide a monetary reward, but is desirable when only negative outcomes are possible.”
Valence and salience contribute to nucleus accumbens activation
Cooper, J. C., & Knutson, B. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.08.009 · Cited by 256 · cited 2×
“However, growing evidence suggests that salience may also invoke a response (Cooper and Knutson, 2008; Tricomi et al., 2004; Zink et al., 2004), such that negative events, if motivationally salient, will also induce a response in the same region (Seymour et al., 2004).”
Motivation-dependent responses in the human caudate nucleus.
Delgado, M. R. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh062 · Cited by 246 · cited 4×
“This differs from prior studies which show increased activation within the caudate nucleus for positive feedback and little change in response to negative feedback (Delgado et al., 2004; Seger and Cincotta, 2005).”
InfluentialReynolds, S. M., & Zahm, D. S. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3432-05.2005 · Cited by 239 · cited 1×
“The insula has bidirectional connections to both the amygdala and to the nucleus accumbens (Reynolds and Zahm, 2005) as well as the orbitofrontal cortex (Ongur and Price, 2000).”
Learning arbitrary visuomotor associations: temporal dynamic of brain activity
Toni, I., Ramnani, N., Josephs, O., Ashburner, J., & Passingham, R. E. (2001) · NeuroImage · doi:10.1006/nimg.2001.0894 · Cited by 210 · cited 1×
“Most studies of associative learning use a trial and error approach (Toni and Passingham, 1999; Toni et al., 2001) in which feedback is provided on every trial.”
Predictability modulates the affective and sensory-discriminative neural processing of pain
Carlsson, K., Andersson, J., Petrovic, P., Petersson, K. M., Öhman, A., & Ingvar, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.05.027 · Cited by 208 · cited 1×
“This region responds to predictable aversive events, in contrast to the anterior insula, which responds to unpredictable aversive events (Carlsson et al., 2006).”
Paulus, M. P., Feinstein, J. S., Leland, D., & Simmons, A. N. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.055 · Cited by 141 · cited 2×
“…context (Eisenberger et al., 2003), and punishment in reward paradigms (Abler et al., 2005; O'Doherty et al., 2003; Ullsperger and von Cramon, 2003), it has also been implicated in decision-making and behavioral monitoring (Casey et al., 2000; Huettel et al., 2005; Paulus et al., 2003, 2005).”
Cited by
Koch, K., Schachtzabel, C., Wagner, G., Schikora, J., Schultz, C., Reichenbach, J. R., Sauer, H., & Schlösser, R. G. M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.031 · Cited by 101
Unique brain areas associated with abstinence control are damaged in multiply detoxified alcoholics
Duka, T., Trick, L., Nikolaou, K., Gray, M. A., Kempton, M. J., Williams, H., Williams, S. C. R., Critchley, H. D., & Stephens, D. N. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.04.006 · Cited by 84
Tricomi, E., & Fiez, J. A. (2012) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-011-0077-3 · Cited by 64
Intelligence mindset shapes neural learning signals and memory
Bejjani, C., DePasque, S., & Tricomi, E. (2019) · Biological Psychology · doi:10.1016/j.biopsycho.2019.06.003 · Cited by 19
Metadata
- Authors
- BISCHOFFGRETHE, A., HAZELTINE, E., BERGREN, L., IVRY, R., & GRAFTON, S.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2009-01-01
- Volume
- 44
- Issue
- 1
- Pages
- 243-251
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2116485481
- Cited by
- 62
- References
- 33
- FWCI
- 2.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.