The DOI matches its Crossref record; 57 of the 58 references it cites were found in a registry or an index.
Neural Systems Underlying Aversive Conditioning in Humans with Primary and Secondary Reinforcers
Open accessAbstract
Money is a secondary reinforcer commonly used across a range of disciplines in experimental paradigms investigating reward learning and decision-making. The effectiveness of monetary reinforcers during aversive learning and associated neural basis, however, remains a topic of debate. Specifically, it is unclear if the initial acquisition of aversive representations of monetary losses depends on similar neural systems as more traditional aversive conditioning that involves primary reinforcers. This study contrasts the efficacy of a biologically defined primary reinforcer (shock) and a socially defined secondary reinforcer (money) during aversive learning and its associated neural circuitry. During a two-part experiment, participants first played a gambling game where wins and losses were based on performance to gain an experimental bank. Participants were then exposed to two separate aversive conditioning sessions. In one session, a primary reinforcer (mild shock) served as an unconditioned stimulus (US) and was paired with one of two colored squares, the conditioned stimuli (CS+ and CS-, respectively). In another session, a secondary reinforcer (loss of money) served as the US and was paired with one of two different CS. Skin conductance responses were greater for CS+ compared to CS- trials irrespective of type of reinforcer. Neuroimaging results revealed that the striatum, a region typically linked with reward-related processing, was found to be involved in the acquisition of aversive conditioned response irrespective of reinforcer type. In contrast, the amygdala was involved during aversive conditioning with primary reinforcers, as suggested by both an exploratory fMRI analysis and a follow-up case study with a patient with bilateral amygdala damage. Taken together, these results suggest that learning about potential monetary losses may depend on reinforcement learning related systems, rather than on typical structures involved in more biologically based fears.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although the amygdala has many of the same connections as the OFC (Fig. 2), it is an evolutionarily old brain region, and appears to be overshadowed by the OFC in humans, in that the effects of damage to the human amygdala on emotion and emotional experience are much more subtle (Whalen and Phelps, 2009; Delgado et al., 2011; LeDoux and Pine, 2016; LeDoux et al., 2018) than that of damage to the”
From The orbitofrontal cortex: reward, emotion and depression (2020) · cites this paper as Delgado et al., 2011
In the citing paper
“the neuroimaging literature is profoundly inconsistent on this point, with some studies reporting increased VS activity in aversive contexts (Figure 2c) [62–64] and others reporting decreasing activity in this area during the prediction, learning, and receipt of aversive outcomes [65,66].”
From Contributions of the striatum to learning, motivation, and performance: an associative account (2012) · cites this paper as [62]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D. J., & Tversky, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609220.014 · Cited by 32,720
Co-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798
Co-planar stereotaxic atlas of the human brain
Laitinen, L. (1989) · Clinical Neurology and Neurosurgery · doi:10.1016/0303-8467(89)90128-5 · Cited by 7,565
Risk Aversion and Incentive Effects
Holt, C. A., & Laury, S. K. (2002) · American Economic Review · doi:10.1257/000282802762024700 · Cited by 5,893
Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior
Phelps, E. A., & LeDoux, J. E. (2005) · Neuron · doi:10.1016/j.neuron.2005.09.025 · Cited by 3,203 · cited 2×
“Aversive conditioning studies in humans typically use primary reinforcers and depend on the integrity of the amygdala (for review see Phelps and LeDoux, 2005).”
BackgroundSelf-citationForman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910330508 · Cited by 3,202
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making
Bechara, A., Damasio, H., Damasio, A. R., & Lee, G. P. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05473.1999 · Cited by 2,001
Phelps, E. A., Delgado, M. R., Nearing, K. I., & LeDoux, J. E. (2004) · Neuron · doi:10.1016/j.neuron.2004.08.042 · Cited by 1,753
Self-citationThe neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Reward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
LaBar, K. S., Gatenby, J. C., Gore, J. C., LeDoux, J. E., & Phelps, E. A. (1998) · Neuron · doi:10.1016/s0896-6273(00)80475-4 · Cited by 1,402
Self-citationBechara, A., Tranel, D., Damasio, H., Adolphs, R., Rockland, C., & Damasio, A. R. (1995) · Science · doi:10.1126/science.7652558 · Cited by 1,400
The psychological consequences of money
Vohs, K. D., Mead, N. L., & Goode, M. R. (2006) · Science · doi:10.1126/science.1132491 · Cited by 1,337
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Self-citationGoebel, R., Esposito, F., & Formisano, E. (2006) · Human Brain Mapping · doi:10.1002/hbm.20249 · Cited by 1,053
Neural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Knutson, B. D., Fong, G., Bennett, S. M., Adams, C. M., & Hommer, D. W. (2003) · NeuroImage · doi:10.1016/s1053-8119(02)00057-5 · Cited by 868
Reward‐Related Responses in the Human Striatum
DELGADO, M. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.002 · Cited by 736
Self-citationFunctional magnetic resonance imaging of reward prediction
Knutson, B., & Cooper, J. C. (2005) · Current Opinion in Neurology · doi:10.1097/01.wco.0000173463.24758.f6 · Cited by 736
Impaired fear conditioning following unilateral temporal lobectomy in humans
LaBar, K., LeDoux, J., Spencer, D., & Phelps, E. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-10-06846.1995 · Cited by 631
Self-citationTemporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605
Modulation of Caudate Activity by Action Contingency
Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004) · Neuron · doi:10.1016/s0896-6273(03)00848-1 · Cited by 592
Self-citationHatfield, T., Han, J.-S., Conley, M., Gallagher, M., & Holland, P. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-16-05256.1996 · Cited by 555
Yacubian, J., Gläscher, J., Schroeder, K., Sommer, T., Braus, D. F., & Büchel, C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2915-06.2006 · Cited by 537
Changing Fear: The Neurocircuitry of Emotion Regulation
Hartley, C. A., & Phelps, E. A. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2009.121 · Cited by 528
Self-citationDifferential Encoding of Losses and Gains in the Human Striatum
Seymour, B., Daw, N. D., Dayan, P., Singer, T., & Dolan, R. J. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0400-07.2007 · Cited by 479
Kim, H., Shimojo, S., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 470
Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455
Amygdala damage eliminates monetary loss aversion
De Martino, B., Camerer, C. F., & Adolphs, R. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0910230107 · Cited by 444 · cited 2×
“The experiments were approved by the University Committee on Activities Involving Human Subjects.”
BackgroundMethodHuman Striatal Responses to Monetary Reward Depend On Saliency
Zink, C. F., Pagnoni, G., Martin-Skurski, M. E., Chappelow, J., & Berns, G. S. (2004) · Neuron · doi:10.1016/s0896-6273(04)00183-7 · Cited by 432
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328
Self-citationOverlapping neural systems mediating extinction, reversal and regulation of fear
Schiller, D., & Delgado, M. R. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.04.002 · Cited by 294
Self-citationKirsch, P., Schienle, A., Stark, R. M., Sammer, G., Blecker, C. R., Walter, B., Ott, U., Burkart, J., & Vaitl, D. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00381-1 · Cited by 252
Second-order fear conditioning prevented by blocking NMDA receptors in amygdala
Gewirtz, J. C., & Davis, M. (1997) · Nature · doi:10.1038/41325 · Cited by 250
How Humans Integrate the Prospects of Pain and Reward during Choice
Talmi, D., Dayan, P., Kiebel, S. J., Frith, C., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2026-09.2009 · Cited by 239
The Neural Basis of Loss Aversion in Decision-Making Under Risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2008) · ACR North American Advances · Cited by 239
A call to action: overcoming anxiety through active coping.
LeDoux, J. E., & Gorman, J. M. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.12.1953 · Cited by 238
Anderson, A. K., & Phelps, E. A. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/08989290260138618 · Cited by 231
Self-citationBrand, M., Fabian Grabenhorst, B., Starcke, K., Vandekerckhove, M. M. P., & Markowitsch, H. J. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.09.021 · Cited by 192
Second-order conditioning with food unconditioned stimulus.
Holland, P. C., & Rescorla, R. A. (1975) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0076219 · Cited by 187
The Neurobiology of Reference-Dependent Value Computation
De Martino, B., Kumaran, D., Holt, B., & Dolan, R. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4832-08.2009 · Cited by 174
Smith, B. W., Mitchell, D. G. V., Hardin, M. G., Jazbec, S., Fridberg, D. J., Blair, J., & Ernst, M. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.08.016 · Cited by 171
Specifying the Contributions of the Human Amygdala to Emotional Memory: A Case Study
Phelps, E. A., LaBar, K. S., Anderson, A. K., O’Connor, K., Fulbright, R. K., & Spencer, D. D. (1998) · Neurocase · doi:10.1080/13554799808410645 · Cited by 165
Self-citationSetlow, B., Holland, P. C., & Gallagher, M. (2002) · Behavioral Neuroscience · doi:10.1037//0735-7044.116.2.267 · Cited by 160
Setlow, B., Holland, P. C., & Gallagher, M. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.2.267 · Cited by 160
Valentin, V. V., & O’Doherty, J. P. (2009) · Journal of Neurophysiology · doi:10.1152/jn.91195.2008 · Cited by 127
Fear of losing money? Aversive conditioning with secondary reinforcers
Delgado, M. R., Labouliere, C. D., & Phelps, E. A. (2006) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsl025 · Cited by 112
Self-citationBechara, A. (1997) · Neurocase · doi:10.1093/neucas/3.4.267-c · Cited by 109
Regional Response Differences Across the Human Amygdaloid Complex during Social Conditioning
Davis, F. C., Johnstone, T., Mazzulla, E. C., Oler, J. A., & Whalen, P. J. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp126 · Cited by 106
[Functional magnetic resonance].
Sell, E. (2007) · PubMed · Cited by 83
Amygdala involvement in human avoidance, escape and approach behavior
Schlund, M. W., & Cataldo, M. F. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.058 · Cited by 81
Release from Proactive Interference: Insufficiency of an Attentional Account
MacLeod, C. M. (1975) · The American Journal of Psychology · doi:10.2307/1421776 · Cited by 11
Cited by
Sorted by citations
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418
A Neural Circuit Mechanism for Encoding Aversive Stimuli in the Mesolimbic Dopamine System
de Jong, J. W., Afjei, S. A., Dorocic, I. P., Peck, J. R., Liu, C. J., Kim, C. K., Tian, L., Deisseroth, K. A., & Lammel, S. (2018) · Neuron · doi:10.1016/j.neuron.2018.11.005 · Cited by 525
Cushman, F. A. (2013) · Personality and Social Psychology Review · doi:10.1177/1088868313495594 · Cited by 507
The orbitofrontal cortex: reward, emotion and depression
Rolls, E. T., Cheng, W., & Feng, J. (2020) · Brain Communications · doi:10.1093/braincomms/fcaa196 · Cited by 474
Metadata
- Authors
- Delgado, M. R., Jou, R. L., & Phelps, E. A.
- Affiliations
- Rutgers, The State University of New Jersey (US)
- New York University (US)
- Corresponding author
- Phelps, Elizabeth A.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2011
- Volume
- 5
- Pages
- 71-71
- ISSN
- 1662-453X (ISSN-L)
- 1662-4548
- PMC
- PMC3101377
- OpenAlex
- W2136145111
- Cited by
- 141
- References
- 55
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 8 · 2023: 2 · 2022: 11 · 2021: 21 · 2020: 8 · 2019: 16 · 2018: 15 · 2017: 7 · 2016: 8 · 2015: 6 · 2014: 5 · 2013: 10 · 2012: 10
- FWCI
- 4.71
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Frontiers in Neuroscience (publishedVersion, cc-by)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- James S. McDonnell Foundation
- National Institute of Mental Health (R01MH080756)
- National Institute on Drug Abuse (R01DA027764)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- aversive conditioning, primary reinforcers, secondary reinforcers, financial losses, shock, fear conditioning, striatum, amygdala, amygdala damage, reinforcement learning, skin conductance, gambling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
