Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Socially-conveyed rules and instructions strongly shape expectations and emotions. Yet most neuroscientific studies of learning consider reinforcement history alone, irrespective of knowledge acquired through other means. We examined fear conditioning and reversal in humans to test whether instructed knowledge modulates the neural mechanisms of feedback-driven learning. One group was informed about contingencies and reversals. A second group learned only from reinforcement. We combined quantitative models with functional magnetic resonance imaging and found that instructions induced dissociations in the neural systems of aversive learning. Responses in striatum and orbitofrontal cortex updated with instructions and correlated with prefrontal responses to instructions. Amygdala responses were influenced by reinforcement similarly in both groups and did not update with instructions. Results extend work on instructed reward learning and reveal novel dissociations that have not been observed with punishments or rewards. Findings support theories of specialized threat-detection and may have implications for fear maintenance in anxiety.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033 · cited 1×
“Anatomical labels were based on the SPM anatomy toolbox (Eickhoff et al., 2005) and verified using the Mai Atlas (Mai et al., 2016).”
MethodThe reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
Fears, phobias, and preparedness: toward an evolved module of fear and fear learning
Öhman, A., & Mineka, S. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.483 · Cited by 3,147 · cited 4×
“The aim of this experiment was to determine how instructions modulate the neural mechanisms and dynamics of aversive learning, and to assess whether potentially specialized threat-detection mechanisms may be impervious to instructions, as previously hypothesized (Ohman and Mineka, 2001).”
BackgroundResultInfluentialPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 4×
“The role of associability in models is to monitor the reliability of outcomes in the world so as, in turn, to control the learning rate for separate experiential updating about predictions of those outcomes (Pearce and Hall, 1980; Behrens et al., 2007; Li et al., 2011a).”
BackgroundInfluentialStorage and Executive Processes in the Frontal Lobes
Smith, E. E., & Jonides, J. (1999) · Science · doi:10.1126/science.283.5408.1657 · Cited by 2,834
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Phelps, E. A., Delgado, M. R., Nearing, K. I., & LeDoux, J. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.08.042 · Cited by 1,753
Self-citationNeurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · cited 1×
“DOI: 10.7554/eLife.15192.001”
InfluentialMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 1×
“However, correlates of EV in amygdala and striatum may actually reflect two closely related quantities: associability (Pearce and Hall, 1980; Behrens et al., 2007; Li et al., 2011a; Zhang et al., 2016) and PE (Bayer and Glimcher, 2005; Li et al., 2011a; Zhang et al., 2016), respectively.”
BackgroundNeural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994
Activation of the left amygdala to a cognitive representation of fear
Phelps, E. A., O'Connor, K. J., Gatenby, J. C., Gore, J. C., Grillon, C., & Davis, M. (2001) · Nature Neuroscience · doi:10.1038/86110 · Cited by 895 · cited 3×
“…and threat-related anxiety have examined the effects of instructions without reinforcement, and have shown that the amygdala can be activated by instructed knowledge (Phelps et al., 2001) and that left amygdala damage impairs the physiological expression of instructed fear (Funayama et al., 2001).”
BackgroundMethodSelf-citationOrbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Optimized EPI for fMRI studies of the orbitofrontal cortex
Deichmann, R., Gottfried, J. A., Hutton, C., & Turner, R. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00073-9 · Cited by 821
Value, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766
The role of the amygdala in human fear: automatic detection of threat
Öhman, A. (2005) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2005.03.019 · Cited by 691
Haber, S. N., Kim, K.-S., Mailly, P., & Calzavara, R. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0271-06.2006 · Cited by 686
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 3×
“, 2011b), although we note that we found a mixture of appetitive and aversive signals here, consistent with previous work (Seymour et al., 2005).”
BackgroundResultNeural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Kalisch, R., Korenfeld, E., Stephan, K. E., Weiskopf, N., Seymour, B., & Dolan, R. J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2021-06.2006 · Cited by 493 · cited 1×
“…same effects on dynamic aversive learning, which is known to depend on the amygdala (Maren, 2001) but also involves the striatum (Seymour et al., 2004; 2005; Delgado et al., 2008b) and ventromedial/orbitofrontal cortex (VMPFC/OFC) (Phelps et al., 2004; Kalisch et al., 2006; Schiller et al., 2008).”
BackgroundDirect Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455 · cited 1×
“Other studies (Jensen et al., 2003; Tabbert et al., 2006) paired instructions about contingencies with actual reinforcement, as we did here.”
ResultOpponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439
From Fear to Safety and Back: Reversal of Fear in the Human Brain
Schiller, D., Levy, I., Niv, Y., LeDoux, J. E., & Phelps, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2265-08.2008 · Cited by 429 · cited 6×
“The VMPFC/mOFC showed negative correlations with EV, consistent with prior work showing increased VMPFC/OFC responses to conditioned stimuli predicting safe, relative to aversive, outcomes (Schiller et al., 2008).”
BackgroundMethodResultInfluentialSelf-citationBrain mediators of predictive cue effects on perceived pain
Atlas, L. Y., Bolger, N., Lindquist, M. A., & Wager, T. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0057-10.2010 · Cited by 389
Self-citationPrefrontal mechanisms of behavioral flexibility, emotion regulation and value updating
Rudebeck, P. H., Saunders, R. C., Prescott, A. T., Chau, L. S., & Murray, E. A. (2013) · Nature Neuroscience · doi:10.1038/nn.3440 · Cited by 383
Plassmann, H., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0788-10.2010 · Cited by 356 · cited 1×
“…reward magnitude or the strength of appetitive outcomes (Montague and Berns, 2002; Rangel and Hare, 2010; Grabenhorst and Rolls, 2011; Clithero and Rangel, 2013), and correlates negatively with the magnitude of aversive outcomes (Schiller et al., 2008; Plassmann et al., 2010; Atlas et al., 2014).”
BackgroundKeltner, J. R., Furst, A., Fan, C., Redfern, R., Inglis, B., & Fields, H. L. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4463-05.2006 · Cited by 346 · cited 2×
“…suggest that instructions can influence physiological arousal and responses in regions involved in pain and threat, consistent with previous work (Keltner et al., 2006; Atlas et al., 2010), but the amygdala seems to hold a specialized role in learning and responding as a function of aversive…”
ResultOverlapping neural systems mediating extinction, reversal and regulation of fear
Schiller, D., & Delgado, M. R. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.04.002 · Cited by 294 · cited 1×
“We chose to functionally define the VMPFC/OFC because we optimized imaging parameters to recover signal in this region, and thus the center of activation lied inferior to masks based on previous data (Schiller and Delgado, 2010).”
MethodMurray, E. A., O'Doherty, J. P., & Schoenbaum, G. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1556-07.2007 · Cited by 238
Funayama, E. S., Grillon, C., Davis, M., & Phelps, E. A. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/08989290152541395 · Cited by 225 · cited 1×
“, 2001) and that left amygdala damage impairs the physiological expression of instructed fear (Funayama et al., 2001).”
BackgroundSelf-citationRegulating the expectation of reward via cognitive strategies
Delgado, M. R., Gillis, M. M., & Phelps, E. A. (2008) · Nature Neuroscience · doi:10.1038/nn.2141 · Cited by 215 · cited 3×
“The VMPFC/OFC has been linked with expected value and reversal learning (Murray et al., 2007; Schiller et al., 2008; Rudebeck et al., 2013), and the striatum is known to play a critical role in error-based learning (Delgado et al., 2008b; Haber and Knutson, 2010).”
BackgroundResultSelf-citation
Cited by
Lonsdorf, T. B., Menz, M. M., Andreatta, M., Fullana, M. A., Golkar, A., Haaker, J., Heitland, I., Hermann, A., Kuhn, M., Kruse, O., et al. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.026 · Cited by 837
“More precisely, if explicit information about CS-US contingencies are provided, fear responses are typically observed instantaneously, while fear responses evolve over time in uninstructed paradigms (Atlas et al., 2016 although this may not be true for all read-out measures).”
The neural and computational systems of social learning
Olsson, A., Knapska, E., & Lindström, B. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0276-4 · Cited by 272
Knowing Ourselves Together: The Cultural Origins of Metacognition
Heyes, C., Bang, D., Shea, N., Frith, C. D., & Fleming, S. M. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.02.007 · Cited by 232
“More generally, instructions (such as ‘When it’s easy, it’s often wrong’) may change interpretation of metacognitive feelings directly, or indirectly by altering priors in subsequent feedback-based reinforcement learning (Figure 2) [57,66,67].”
BackgroundSocial Fear Learning: from Animal Models to Human Function
Debiec, J., & Olsson, A. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.04.010 · Cited by 186
“The major advantages of instructed paradigms are their ecological validity (mimicking every-day life situations), easiness to manipulate in the experimental setting, and the opportunity to study complex emotions [21, 22].”
BackgroundFunctional dissociation of stimulus intensity encoding and predictive coding of pain in the insula
Geuter, S., Boll, S., Eippert, F., & Büchel, C. (2017) · eLife · doi:10.7554/elife.24770 · Cited by 184
Metadata
- Authors
- Atlas, L. Y., Doll, B. B., Li, J., Daw, N. D., & Phelps, E. A.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2016-05-12
- Volume
- 5
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W2389372669
- Cited by
- 93
- References
- 30
- FWCI
- 6.66
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.