Distinct Contributions of Ventromedial and Dorsolateral Subregions of the Human Substantia Nigra to Appetitive and Aversive Learning
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
The role of neurons in the substantia nigra (SN) and ventral tegmental area (VTA) of the midbrain in contributing to the elicitation of reward prediction errors during appetitive learning has been well established. Less is known about the differential contribution of these midbrain regions to appetitive versus aversive learning, especially in humans. Here we scanned human participants with high-resolution fMRI focused on the SN and VTA while they participated in a sequential Pavlovian conditioning paradigm involving an appetitive outcome (a pleasant juice), as well as an aversive outcome (an unpleasant bitter and salty flavor). We found a degree of regional specialization within the SN: Whereas a region of ventromedial SN correlated with a temporal difference reward prediction error during appetitive Pavlovian learning, a dorsolateral area correlated instead with an aversive expected value signal in response to the most distal cue, and to a reward prediction error in response to the most proximal cue to the aversive outcome. Furthermore, participants' affective reactions to both the appetitive and aversive conditioned stimuli more than 1 year after the fMRI experiment was conducted correlated with activation in the ventromedial and dorsolateral SN obtained during the experiment, respectively. These findings suggest that, whereas the human ventromedial SN contributes to long-term learning about rewards, the dorsolateral SN may be particularly important for long-term learning in aversive contexts. SIGNIFICANCE STATEMENT The role of the substantia nigra (SN) and ventral tegmental area (VTA) in appetitive learning is well established, but less is known about their contribution to aversive compared with appetitive learning, especially in humans. We used high-resolution fMRI to measure activity in the SN and VTA while participants underwent higher-order Pavlovian learning. We found a regional specialization within the SN: a ventromedial area was selectively engaged during appetitive learning, and a dorsolateral area during aversive learning. Activity in these areas predicted affective reactions to appetitive and aversive conditioned stimuli over 1 year later. These findings suggest that, whereas the human ventromedial SN contributes to long-term learning about rewards, the dorsolateral SN may be particularly important for long-term learning in aversive contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
XV.—The Correlation between Relatives on the Supposition of Mendelian Inheritance.
Fisher, R. A. (1919) · Transactions of the Royal Society of Edinburgh · doi:10.1017/s0080456800012163 · Cited by 4,387 · cited 1×
“Linear mixed-effects models were chosen because they allow specification of random effects (Fisher, 1919) in addition to fixed (experimental) effects to account for repeated measurements made on the same participants.”
MethodAn Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696 · cited 2×
“To avoid double dipping (Kriegeskorte et al., 2009), we defined participant ROIs using a leave-one-participant-out cross-validation procedure.”
MethodResultDopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 2×
“Reward TD prediction errors in the ventral striatum and amygdala Previous research has found BOLD responses consistent with a TD RPE in the ventral striatum (O’Doherty et al., 2002, 2004; Schönberg et al., 2007) and the amygdala (Prévost et al., 2013).”
BackgroundSelf-citationA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“It is well established that the substantia nigra (SN) and ventral tegmental area (VTA) of the midbrain play an important role in facilitating learning and updating of stimulus–reward associations, especially via the phasic activity of dopamine neurons that have been found to encode a reward prediction error (RPE) sign…”
BackgroundHaber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610 · cited 5×
“…frontal cortex (Porrino and Goldman-Rakic, 1982), dopaminergic projections from the dorsolateral SN, on the other hand, have been found to largely target the putamen (Haber et al., 2000) as well as the dorsolateral prefrontal cortex (Williams and Goldman-Rakic, 1998; Haber and Knutson, 2010).”
BackgroundInfluentialTemporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Self-citationTwo types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Input-specific control of reward and aversion in the ventral tegmental area
Lammel, S., Lim, B. K., Ran, C., Huang, K. W., Betley, M. J., Tye, K. M., Deisseroth, K., & Malenka, R. C. (2012) · Nature · doi:10.1038/nature11527 · Cited by 1,300
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · cited 1×
“Flexible range adaptation has been reported in midbrain dopamine neurons for encoding of RPE signals (Tobler et al., 2005), so it is possible that such an adaptive coding mechanism is present more extensively within the SN.”
BackgroundPhasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Tsai, H.-C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., & Deisseroth, K. (2009) · Science · doi:10.1126/science.1168878 · Cited by 1,266 · cited 2×
“It is well established that the substantia nigra (SN) and ventral tegmental area (VTA) of the midbrain play an important role in facilitating learning and updating of stimulus–reward associations, especially via the phasic activity of dopamine neurons that have been found to encode a reward prediction error (RPE) sign…”
BackgroundNeural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Self-citationA selective role for dopamine in stimulus-reward learning
Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., Akers, C. A., Clinton, S. M., Phillips, P. E. M., & Akil, H. (2011) · Nature · doi:10.1038/nature09588 · Cited by 1,026 · cited 1×
“…activity of dopamine neurons that have been found to encode a reward prediction error (RPE) signal (Mirenowicz and Schultz, 1996; Montague et al., 1996; Schultz et al., 1997; Schultz, 1998; Day et al., 2007; Tsai et al., 2009; Flagel et al., 2011; Takahashi et al., 2011; Lammel et al., 2012).”
BackgroundPreferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · cited 5×
“It is well established that the substantia nigra (SN) and ventral tegmental area (VTA) of the midbrain play an important role in facilitating learning and updating of stimulus–reward associations, especially via the phasic activity of dopamine neurons that have been found to encode a reward prediction error (RPE) sign…”
BackgroundInfluentialReward‐Related Responses in the Human Striatum
DELGADO, M. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.002 · Cited by 736 · cited 1×
“Neuroimaging methods have widely reported prediction error activity in the brain, although typically in target areas of dopamine neurons, such as the striatum as opposed to directly in the midbrain structures (O’Doherty et al., 2003; Delgado, 2007).”
MethodAssociative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710 · cited 2×
“It is well established that the substantia nigra (SN) and ventral tegmental area (VTA) of the midbrain play an important role in facilitating learning and updating of stimulus–reward associations, especially via the phasic activity of dopamine neurons that have been found to encode a reward prediction error (RPE) sign…”
BackgroundWittmann, B. C., Schott, B. H., Guderian, S., Frey, J. U., Heinze, H.-J., & Düzel, E. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.010 · Cited by 698 · cited 4×
“Nevertheless, some studies have reported activity in SN and/or VTA in response to prediction errors during reward presentation or omission (O’Doherty et al., 2002; Wittmann et al., 2005; D’Ardenne et al., 2008).”
BackgroundResultInfluentialBOLD responses reflecting dopaminergic signals in the human ventral tegmental area
D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D. (2008) · Science · doi:10.1126/science.1150605 · Cited by 661
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653
The optimal template effect in hippocampus studies of diseased populations
Avants, B. B., Yushkevich, P., Pluta, J., Minkoff, D., Korczykowski, M., Detre, J., & Gee, J. C. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.062 · Cited by 640 · cited 1×
“Before the second-level analysis, participants’ zoomed EPIs were coregistered to a multimodal T1/T2 optimal template, created iteratively using the Advanced Normalization Toolbox (Avants et al., 2010).”
MethodTemporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 1×
“1B), and capturing the core feature of the temporal difference algorithm: learning via prediction errors induced by sequential predictors (Seymour et al., 2004).”
BackgroundSelf-citationRoesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
Opponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · cited 3×
“The rationale for including the appetitive and aversive conditioning procedures in separate sessions as opposed to including both conditions intermixed within the same sessions was to avoid contrast effects observed in a prior study (Seymour et al., 2005), which reported that cues signaling the aversive liquid tended…”
BackgroundResultSelf-citationSchönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Self-citationO'Doherty, J. P., Buchanan, T. W., Seymour, B., & Dolan, R. J. (2006) · Neuron · doi:10.1016/j.neuron.2005.11.014 · Cited by 322
Self-citationExpectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex
Takahashi, Y. K., Roesch, M. R., Wilson, R. C., Toreson, K., O'Donnell, P., Niv, Y., & Schoenbaum, G. (2011) · Nature Neuroscience · doi:10.1038/nn.2957 · Cited by 280 · cited 2×
“It is well established that the substantia nigra (SN) and ventral tegmental area (VTA) of the midbrain play an important role in facilitating learning and updating of stimulus–reward associations, especially via the phasic activity of dopamine neurons that have been found to encode a reward prediction error (RPE) sign…”
BackgroundHuman neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209 · cited 1×
“It is also important to note that randomization of spatial position is a very pervasive experimental manipulation in human learning studies, for the reasons described above (O’Doherty et al., 2004; Seymour et al., 2005; Tobler et al., 2006).”
BackgroundSelf-citationTwo Dimensions of Value: Dopamine Neurons Represent Reward But Not Aversiveness
Fiorillo, C. D. (2013) · Science · doi:10.1126/science.1238699 · Cited by 203
Kim, H., Shimojo, S., & O'Doherty, J. P. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq145 · Cited by 176 · cited 1×
“With an intermixed paradigm, contrast effects between the cues may have resulted in the aversive cue dominating (see also Kim et al., 2011).”
BackgroundSelf-citationDiversity and Homogeneity in Responses of Midbrain Dopamine Neurons
Fiorillo, C. D., Yun, S. R., & Song, M. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3886-12.2013 · Cited by 99 · cited 2×
“…does not reflect prediction error coding per se but rather the effects of generalization (Schultz, 2010), initial sensory-driven responses, and/or overshadowing arising from the presence of overlapping neutral cues for appetitive and aversive learning (Fiorillo et al., 2013; Fiorillo, 2013).”
BackgroundEvidence for model-based computations in the human amygdala during Pavlovian conditioning
Prévost, C., McNamee, D., Jessup, R. K., Bossaerts, P., & O'Doherty, J. P. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002918 · Cited by 79 · cited 13×
“Indeed, recently we have found that, whereas pupil dilation is a good indication of learning with appetitive juice rewards, eyeblink responses are a more robust indicator for learning about aversive events (Prévost et al., 2013).”
BackgroundMethodResultInfluential
Cited by
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475
“Studies have revealed activity correlating with expected uncertainty in a number of cortical and subcortical brain regions, including the insular cortex, inferior frontal gyrus, and dorsal striatum (Critchley et al. 2001, Huettel et al. 2006, Paulus et al. 2003, Yanike & Ferrera 2014).”
BackgroundSelf-citationModeling Trait Anxiety: From Computational Processes to Personality
Raymond, J. G., Steele, J. D., & Seriès, P. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00001 · Cited by 203
Goldstein, D. S. (2019) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00396.2018 · Cited by 96
Pool, E. R., Munoz Tord, D., Delplanque, S., Stussi, Y., Cereghetti, D., Vuilleumier, P., & Sander, D. (2022) · The Journal of Neuroscience · doi:10.1523/jneurosci.1124-21.2022 · Cited by 33
Neural Representation of Valenced and Generic Probability and Uncertainty
Kim, J.-C., Hellrung, L., Grueschow, M., Nebe, S., Nagy, Z., & Tobler, P. N. (2024) · The Journal of Neuroscience · doi:10.1523/jneurosci.0195-24.2024 · Cited by 5
“…signals have been identi fi ed not only in rodents and nonhuman primates (Esber et al., 2012; Roesch et al., 2012; Sharpe and Killcross, 2014, 2015; Pauli et al., 2015) but also in humans (Litt et al., 2011; Rothkirch et al., 2012; Kahnt et al., 2014; Metereau and Dreher, 2015; Uddin, 2015;…”
Background
Metadata
- Authors
- Pauli, W. M., Larsen, T., Collette, S., Tyszka, J. M., Seymour, B., & O'Doherty, J. P.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2015-10-21
- Volume
- 35
- Issue
- 42
- Pages
- 14220-14233
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1819315688
- Cited by
- 87
- References
- 34
- FWCI
- 3.02
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.