Dissociable Learning Processes Underlie Human Pain Conditioning
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Pavlovian conditioning underlies many aspects of pain behavior, including fear and threat detection [1], escape and avoidance learning [2], and endogenous analgesia [3]. Although a central role for the amygdala is well established [4], both human and animal studies implicate other brain regions in learning, notably ventral striatum and cerebellum [5]. It remains unclear whether these regions make different contributions to a single aversive learning process or represent independent learning mechanisms that interact to generate the expression of pain-related behavior. We designed a human parallel aversive conditioning paradigm in which different Pavlovian visual cues probabilistically predicted thermal pain primarily to either the left or right arm and studied the acquisition of conditioned Pavlovian responses using combined physiological recordings and fMRI. Using computational modeling based on reinforcement learning theory, we found that conditioning involves two distinct types of learning process. First, a non-specific "preparatory" system learns aversive facial expressions and autonomic responses such as skin conductance. The associated learning signals-the learned associability and prediction error-were correlated with fMRI brain responses in amygdala-striatal regions, corresponding to the classic aversive (fear) learning circuit. Second, a specific lateralized system learns "consummatory" limb-withdrawal responses, detectable with electromyography of the arm to which pain is predicted. Its related learned associability was correlated with responses in ipsilateral cerebellar cortex, suggesting a novel computational role for the cerebellum in pain. In conclusion, our results show that the overall phenotype of conditioned pain behavior depends on two dissociable reinforcement learning circuits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Empathy for Pain Involves the Affective but not Sensory Components of Pain
Singer, T., Seymour, B., O'Doherty, J., Kaube, H., Dolan, R. J., & Frith, C. D. (2004) · Science · doi:10.1126/science.1093535 · Cited by 3,929 · cited 1×
“Evidence from human studies indicates cerebellum may be activated by other processes related to, but not exclusive to, pain sensory processing, for example, motor withdrawal [23], anticipation to pain [24], and negative emotions [25].”
BackgroundSelf-citationContributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior
Phelps, E. A., & LeDoux, J. E. (2005) · Neuron · doi:10.1016/j.neuron.2005.09.025 · Cited by 3,203 · cited 1×
“Although a central role for the amygdala is well established [4], both human and animal studies implicate other brain regions in learning, notably ventral striatum and cerebellum [5].”
BackgroundPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Functional topography in the human cerebellum: A meta-analysis of neuroimaging studies
STOODLEY, C., & SCHMAHMANN, J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.08.039 · Cited by 2,183 · cited 1×
“Anatomically, the major activation was localized in the anterior lobe, bordering lobule V and VI, which concurs with the sensorimotor area of previous functional topographic studies [26].”
BackgroundComputational principles of movement neuroscience
Wolpert, D. M., & Ghahramani, Z. (2000) · Nature Neuroscience · doi:10.1038/81497 · Cited by 2,122
Cerebellar loops with motor cortex and prefrontal cortex of a nonhuman primate
Kelly, R. M., & Strick, P. L. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-23-08432.2003 · Cited by 1,595 · cited 1×
“Stimulation of the cerebellum can alter nociceptive thresholds and reflexes in animals [21], suggesting it may engage in pain modulation along with various brainstem structures involved in the cerebrocerebellar loop [20, 22].”
BackgroundTemporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“Computationally, cerebellar climbing fiber activity has been shown to represent prediction error magnitude [30], from which associability might be calculated.”
BackgroundNatural selective attention: Orienting and emotion
Bradley, M. M. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2008.00702.x · Cited by 976
LeDoux, J. E. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1400335111 · Cited by 891 · cited 2×
“Pavlovian conditioning underlies many aspects of pain behavior, including fear and threat detection [1], escape and avoidance learning [2], and endogenous analgesia [3].”
BackgroundReward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
The neuroscience of placebo effects: connecting context, learning and health
Wager, T. D., & Atlas, L. Y. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3976 · Cited by 844
Parallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622 · cited 2×
“ROI analysis of cerebellum using SUIT probabilistic atlas template shows (top) left anterior cerebellum activations in the border between lobule V and VI (SUIT space coordinates: [24, 52, 15]) and in lobule VIII ([ 22, 50, 41]; p < 0.”
BackgroundMethodTemporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 2×
“C two keymeasures: a prediction error term that records the difference between pain expectations and outcomes [5] and an ‘‘associability’’ term that keeps track of the uncertainty of predictions [7, 8].”
BackgroundSelf-citationOpponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439
Self-citationFrom Fear to Safety and Back: Reversal of Fear in the Human Brain
Schiller, D., Levy, I., Niv, Y., LeDoux, J. E., & Phelps, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2265-08.2008 · Cited by 429 · cited 2×
“56 Current Biology 26, 52–58, January 11, 2016 a2016 The Authors Computational Model Analysis We constructed reinforcement learning models, fitted trial-by-trial model value/associability to SCR data for parameter estimation and model comparison, and then used obtained learning signals to probe brain activity [7, 8, 3…”
BackgroundMethodNeural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray
Johansen, J. P., Tarpley, J. W., LeDoux, J. E., & Blair, H. T. (2010) · Nature Neuroscience · doi:10.1038/nn.2594 · Cited by 312 · cited 1×
“It is important to note, however, that aversive prediction errors have been identified at a neuronal level in rodents [11, 12].”
BackgroundPlacing prediction into the fear circuit
McNally, G. P., Johansen, J. P., & Blair, H. T. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.03.005 · Cited by 298
Representation of aversive prediction errors in the human periaqueductal gray
Roy, M., Shohamy, D., Daw, N., Jepma, M., Wimmer, G. E., & Wager, T. D. (2014) · Nature Neuroscience · doi:10.1038/nn.3832 · Cited by 246 · cited 1×
“Because the putamen receives cortical somatotopic pain projections [17], it is possible that it might have carried a consummatory or sensory-specific error signal [18, 19].”
BackgroundAutomatic coding of facial expressions displayed during posed and genuine pain
Littlewort, G. C., Bartlett, M. S., & Lee, K. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.12.010 · Cited by 216
Evidence for model-based computations in the human amygdala during Pavlovian conditioning
Prévost, C., McNamee, D., Jessup, R. K., Bossaerts, P., & O'Doherty, J. P. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002918 · Cited by 79
Aversive Prediction Error Signals in the Amygdala
McHugh, S. B., Barkus, C., Huber, A., Capitao, L., Lima, J., Lowry, J. P., & Bannerman, D. M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4465-13.2014 · Cited by 68 · cited 1×
“It is important to note, however, that aversive prediction errors have been identified at a neuronal level in rodents [11, 12].”
Background
Cited by
Deconstructing the sensation of pain: The influence of cognitive processes on pain perception
Wiech, K. (2016) · Science · doi:10.1126/science.aaf8934 · Cited by 482
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Functional dissociation of stimulus intensity encoding and predictive coding of pain in the insula
Geuter, S., Boll, S., Eippert, F., & Büchel, C. (2017) · eLife · doi:10.7554/elife.24770 · Cited by 184
Moretta, T., Buodo, G., Demetrovics, Z., & Potenza, M. N. (2022) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2021.152286 · Cited by 125
Levy, I., & Schiller, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.11.007 · Cited by 95
Metadata
- Authors
- Zhang, S., Mano, H., Ganesh, G., Robbins, T., & Seymour, B.
- Venue
- Current Biology
- Publisher
- Elsevier BV
- Published
- 2016-01
- Volume
- 26
- Issue
- 1
- Pages
- 52-58
- ISSN
- 0960-9822 (ISSN-L)
- OpenAlex
- W2203521791
- Cited by
- 87
- References
- 22
- FWCI
- 3.69
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.