Aversive Pavlovian Control of Instrumental Behavior in Humans
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Adaptive behavior involves interactions between systems regulating Pavlovian and instrumental control of actions. Here, we present the first investigation of the neural mechanisms underlying aversive Pavlovian–instrumental transfer using fMRI in humans. Recent evidence indicates that these Pavlovian influences on instrumental actions are action-specific: Instrumental approach is invigorated by appetitive Pavlovian cues but inhibited by aversive Pavlovian cues. Conversely, instrumental withdrawal is inhibited by appetitive Pavlovian cues but invigorated by aversive Pavlovian cues. We show that BOLD responses in the amygdala and the nucleus accumbens were associated with behavioral inhibition by aversive Pavlovian cues, irrespective of action context. Furthermore, BOLD responses in the ventromedial prefrontal cortex differed between approach and withdrawal actions. Aversive Pavlovian conditioned stimuli modulated connectivity between the ventromedial prefrontal cortex and the caudate nucleus. These results show that action-specific aversive control of instrumental behavior involves the modulation of fronto-striatal interactions by Pavlovian conditioned stimuli.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497 · cited 1×
“Many decision-making phenomena that appear irrational, such as the framing effect (Tversky & Kahneman, 1981) and the optimism bias (Sharot, Riccardi, Raio, & Phelps, 2007; Weinstein, 1980), may reflect Pavlovian impact of affective cues on instrumental behavior (Dayan & Huys, 2008; Dayan, Niv,…”
Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition
Evans, J. S. B. T. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093629 · Cited by 5,137
Unrealistic optimism about future life events
Weinstein, N. D. (1980) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.39.5.806 · Cited by 4,999 · cited 2×
“Many decision-making phenomena that appear irrational, such as the framing effect (Tversky & Kahneman, 1981) and the optimism bias (Sharot, Riccardi, Raio, & Phelps, 2007;Weinstein, 1980),may reflect Pavlovian impact of affective cues on instrumental behavior (Dayan & Huys, 2008; Dayan, Niv, Seymour, & Daw, 2006).”
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
The somatic marker hypothesis and the possible functions of the prefrontal cortex
Damasio, A. R. (1996) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1996.0125 · Cited by 2,847
Ongur, D. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.206 · Cited by 2,627
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“Adaptive behavior depends on interactions between systems regulating affective versus rational, instrumental control (Huys et al., 2011; Evans, 2008; Daw, Niv, & Dayan, 2005).”
Mayberg, H. S., Liotti, M., Brannan, S. K., McGinnis, S., Mahurin, R. K., Jerabek, P. A., Silva, J. A., Tekell, J. L., Martin, C. C., Lancaster, J. L., et al. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.5.675 · Cited by 2,416 · cited 2×
“Indeed, this region receives abundant input from regions that process affective information including the amygdala and the nucleus accumbens (Haber &Knutson, 2010; Haber, 2003; Ongür & Price, 2000; Mayberg et al., 1999), and it is critical for the instrumental guidance of behavior by representations of current goals (…”
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Self-Control in Decision-Making Involves Modulation of the vmPFC Valuation System
Hare, T. A., Camerer, C. F., & Rangel, A. (2009) · Science · doi:10.1126/science.1168450 · Cited by 1,928
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479 · cited 3×
“However, the pFC is well known not to act alone in guiding decision-making but interacts with a set of strongly connected subcortical structures via fronto-striatal circuits (Haber & Knutson, 2010; Haber, 2003; Alexander, DeLong, & Strick, 1986).”
Frontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111
The role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099
A selective role for dopamine in stimulus-reward learning
Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., Akers, C. A., Clinton, S. M., Phillips, P. E. M., & Akil, H. (2011) · Nature · doi:10.1038/nature09588 · Cited by 1,026
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
Neural mechanisms mediating optimism bias
Sharot, T., Riccardi, A. M., Raio, C. M., & Phelps, E. A. (2007) · Nature · doi:10.1038/nature06280 · Cited by 659
Corbit, L. H., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4507-04.2005 · Cited by 589 · cited 3×
“Although animal work does suggest that both these regions are involved in outcome-general as well as outcome-selective PIT (Corbit & Balleine, 2005, 2011), the only extant study in humans on appetitive outcome-specific PIT did not find significant involvement of either the nucleus accumbens or…”
Bijttebier, P., Beck, I., Claes, L., & Vandereycken, W. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.04.002 · Cited by 566
Determining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529
Hare, T. A., Camerer, C. F., Knoepfle, D. T., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4089-09.2010 · Cited by 527
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · cited 1×
“Indeed, the rodent homologue of the caudate nucleus, that is, the dorsomedial striatum, has also been shown to be sensitive to changes in outcome devaluation (Yin, Knowlton, & Balleine, 2005; Yin, Ostlund, Knowlton, & Balleine, 2005).”
Huys, Q. J. M., Eshel, N., O'Nions, E., Sheridan, L., Dayan, P., & Roiser, J. P. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002410 · Cited by 439
Self-citationRelations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388
Lim, S.-L., O'Doherty, J. P., & Rangel, A. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1246-11.2011 · Cited by 329 · cited 1×
“Indeed, Lim, O ʼ Doherty, and Rangel (2011) have recently shown that the vmPFC encodes (relative) value signals as a function of visual attention.”
Exploring the roles of approach and avoidance in depression: An integrative model
Trew, J. L. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.07.007 · Cited by 316 · cited 2×
“This finding resonates with the fact that many neuropsychiatric disorders prominently involve abnormal control not only of appetitive behaviors (e.g., approach) but also of aversive behaviors (e.g., withdrawal; Trew, 2011).”
Corbit, L. H., & Balleine, B. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2711-11.2011 · Cited by 309 · cited 3×
“Although animal work does suggest that both these regions are involved in outcome-general as well as outcome-selective PIT (Corbit & Balleine, 2005, 2011), the only extant study in humans on appetitive outcome-specific PIT did not find significant involvement of either the nucleus accumbens or…”
Action versus valence in decision making
Guitart-Masip, M., Duzel, E., Dolan, R., & Dayan, P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.003 · Cited by 270
Serotonin, inhibition, and negative mood
Dayan, P., & Huys, Q. J. M. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040004 · Cited by 263
Self-citationde Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., & Fletcher, P. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1639-09.2009 · Cited by 200
Cited by
Appetitive Pavlovian-instrumental Transfer: A review
Cartoni, E., Balleine, B., & Baldassarre, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.020 · Cited by 317
Action versus valence in decision making
Guitart-Masip, M., Duzel, E., Dolan, R., & Dayan, P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.003 · Cited by 270
Modeling Trait Anxiety: From Computational Processes to Personality
Raymond, J. G., Steele, J. D., & Seriès, P. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00001 · Cited by 203
Scholl, J., Kolling, N., Nelissen, N., Wittmann, M. K., Harmer, C. J., & Rushworth, M. F. S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0396-15.2015 · Cited by 85
Taking Action in the Face of Threat: Neural Synchronization Predicts Adaptive Coping
Collins, K. A., Mendelsohn, A., Cain, C. K., & Schiller, D. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2152-14.2014 · Cited by 61
Metadata
- Authors
- Geurts, D. E. M., Huys, Q. J. M., den Ouden, H. E. M., & Cools, R.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press
- Published
- 2013-09-01
- Volume
- 25
- Issue
- 9
- Pages
- 1428-1441
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2114370113
- Cited by
- 105
- References
- 30
- FWCI
- 3.70
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.