Incongruence effects in crossmodal emotional integration
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Emotions are often encountered in a multimodal fashion. Consequently, contextual framing by other modalities can alter the way that an emotional facial expression is perceived and lead to emotional conflict. Whole brain fMRI data was collected when 35 healthy subjects judged emotional expressions in faces while concurrently being exposed to emotional (scream, laughter) or neutral (yawning) sounds. The behavioral results showed that subjects rated fearful and neutral faces as being more fearful when accompanied by screams than compared to yawns (and laughs for fearful faces). Moreover, the imaging data revealed that incongruence of emotional valence between faces and sounds led to increased activation in the middle cingulate cortex, right superior frontal cortex, right supplementary motor area as well as the right temporoparietal junction. Against expectations no incongruence effects could be found in the amygdala. Further analyses revealed that, independent of emotional valence congruency, the left amygdala was consistently activated when the information from both modalities was emotional. If a neutral stimulus was present in one modality and emotional in the other, activation in the left amygdala was significantly attenuated. These results indicate that incongruence of emotional valence in audiovisual integration activates a cingulate-fronto-parietal network involved in conflict monitoring and resolution. Furthermore in audiovisual pairing amygdala responses seem to signal also the absence of any neutral feature rather than only the presence of an emotionally charged one.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ashburner, J., & Friston, K. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.018 · Cited by 7,507 · cited 1×
“After realignment, the mean EPI image for each subject was spatially normalized to the MNI single subject template using the " unified segmentation " approach (Ashburner and Friston, 2005).”
The distributed human neural system for face perception
Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01482-0 · Cited by 4,891 · cited 2×
“Correlation with BDI BDI scores were negatively correlated with activation in left and right occipital gyrus as well as right FFG and STS, i.e., regions contributing to the neural system for facial perception (Haxby et al., 2000).”
BackgroundMethodA new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033 · cited 2×
“Nevertheless, the applied histological atlas allows anatomical allocation in a probabilistic fashion, hereby accommodating some of the uncertainty in establishment of structure– function relationships (cf. Amunts et al., 2005; Eickhoff et al., 2005).”
BackgroundSelf-citationThe reorienting system of the human brain: from environment to theory of mind
Corbetta, M., Patel, G., & Shulman, G. L. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.017 · Cited by 3,889 · cited 3×
“, 2009), attentional reorienting, theory of mind and perspective taking tasks (Corbetta et al., 2008; Derntl et al., 2010; Mitchell, 2008).”
BackgroundMacDonald, A. W., Cohen, J. D., Stenger, V. A., & Carter, C. S. (2000) · Science · doi:10.1126/science.288.5472.1835 · Cited by 3,666
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 4×
“In summary, audiovisual emotional incongruence leads to activation of a cingulate-fronto-parietal network previously shown to be involved in conflict monitoring and resolution (Botvinick et al., 2004; Carter et al., 1998; Ochsner et al., 2009; Weissman et al., 2004; Wittfoth et al., 2010).”
BackgroundMethodInfluentialAnterior Cingulate Conflict Monitoring and Adjustments in Control
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004) · Science · doi:10.1126/science.1089910 · Cited by 2,891 · cited 6×
“The results of these studies have led to the conflict monitoring hypothesis, which suggests that conflict is detected by the dorsal anterior cingulate cortex (ACC), which in turn recruits prefrontal regions to increase cognitive control (Botvinick et al., 2004; Carter and van Veen, 2007; Kerns et al., 2004).”
BackgroundResultInfluentialDrevets, W. C., Price, J. L., & Furey, M. L. (2008) · Brain Structure and Function · doi:10.1007/s00429-008-0189-x · Cited by 2,241 · cited 2×
“Finally, clinical studies in patients with depression show that this disorder goes along with a negativity bias (Drevets et al., 2008) and problems inhibiting negative information (Goeleven et al., 2006; Joormann, 2010).”
BackgroundFunctional role of the supplementary and pre-supplementary motor areas
Nachev, P., Kennard, C., & Husain, M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2478 · Cited by 1,928
Eickhoff, S. B., Laird, A. R., Grefkes, C., Wang, L. E., Zilles, K., & Fox, P. T. (2009) · Human Brain Mapping · doi:10.1002/hbm.20718 · Cited by 1,924 · cited 1×
“Rather spatial uncertainty in neuroimaging results mainly derives from inter-individual variability and imprecision in spatial normalisation (Eickhoff et al., 2009; Grachev et al., 1999; Hellier et al., 2003).”
Self-citationCortical pathways to the mammalian amygdala
McDonald, A. J. (1998) · Progress in Neurobiology · doi:10.1016/s0301-0082(98)00003-3 · Cited by 1,303
Amunts, K., Kedo, O., Kindler, M., Pieperhoff, P., Mohlberg, H., Shah, N. J., Habel, U., Schneider, F., & Zilles, K. (2005) · Anatomy and Embryology · doi:10.1007/s00429-005-0025-5 · Cited by 1,264 · cited 4×
“SF superficial, CM centromedial nucleus of the amygdala (Amunts et al., 2005).”
BackgroundInfluentialSelf-citationAnterior cingulate cortex and conflict detection: an update of theory and data
Carter, C. S., & van Veen, V. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.367 · Cited by 1,056 · cited 1×
“…of these studies have led to the conflict monitoring hypothesis, which suggests that conflict is detected by the dorsal anterior cingulate cortex (ACC), which in turn recruits prefrontal regions to increase cognitive control (Botvinick et al., 2004; Carter and van Veen, 2007; Kerns et al., 2004).”
ResultPrefrontal cortical function and anxiety: Controlling attention to threat-related stimuli
Bishop, S., Duncan, J., Brett, M., & Lawrence, A. D. (2004) · Nature Neuroscience · doi:10.1038/nn1173 · Cited by 940
Neuropsychology of fear and loathing
Calder, A. J., Lawrence, A. D., & Young, A. W. (2001) · Nature reviews. Neuroscience · doi:10.1038/35072584 · Cited by 927
Functional connectivity of the human amygdala using resting state fMRI
Roy, A. K., Shehzad, Z., Margulies, D. S., Kelly, A. M. C., Uddin, L. Q., Gotimer, K., Biswal, B. B., Castellanos, F. X., & Milham, M. P. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.030 · Cited by 749
Functional anatomical abnormalities in limbic and prefrontal cortical structures in major depression
Drevets, W. C. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26027-5 · Cited by 659 · cited 3×
“These problems have repeatedly been linked to dysregulation in ACC, dorsolateral prefrontal cortex and the amygdala (Abler et al., 2007; Drevets, 2000; Fales et al., 2008).”
BackgroundResultThe human inferior parietal cortex: Cytoarchitectonic parcellation and interindividual variability
Caspers, S., Geyer, S., Schleicher, A., Mohlberg, H., Amunts, K., & Zilles, K. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.06.054 · Cited by 634 · cited 4×
“Coordinates are in MNI space; mapping of cytoarchitectonic areas: 17,18—(Amunts et al., 2000 ); PFm, PFt—(Caspers et al., 2006); 4a—(Geyer et al., 1996; Geyer, 2004 ). fearful compared to neutral faces at the corrected level.”
BackgroundInfluentialSelf-citationEmotional information processing in mood disorders: a review of behavioral and neuroimaging findings
Leppänen, J. M. (2006) · Current Opinion in Psychiatry · doi:10.1097/01.yco.0000191500.46411.00 · Cited by 632
Fales, C. L., Barch, D. M., Rundle, M. M., Mintun, M. A., Snyder, A. Z., Cohen, J. D., Mathews, J., & Sheline, Y. I. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.06.012 · Cited by 517
Activity in Right Temporo-Parietal Junction is Not Selective for Theory-of-Mind
Mitchell, J. P. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm051 · Cited by 469 · cited 2×
“, 2009), attentional reorienting, theory of mind and perspective taking tasks (Corbetta et al., 2008; Derntl et al., 2010; Mitchell, 2008).”
BackgroundMultidimensional assessment of empathic abilities: Neural correlates and gender differences
Derntl, B., Finkelmeyer, A., Eickhoff, S., Kellermann, T., Falkenberg, D. I., Schneider, F., & Habel, U. (2010) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2009.10.006 · Cited by 377 · cited 2×
“, 2009), attentional reorienting, theory of mind and perspective taking tasks (Corbetta et al., 2008; Derntl et al., 2010; Mitchell, 2008).”
BackgroundSelf-citationSocial threat perception and the evolution of paranoia
Green, M. J., & Phillips, M. L. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.03.006 · Cited by 369 · cited 2×
“This higher saliency fits well with the biological perspective that screams, as threat signals, are far more important for survival than laughs (Calder et al., 2001; Green and Phillips, 2004) and is furthermore reflected by the more widespread activation evoked by these (as described above).”
BackgroundPessoa, L., Padmala, S., & Morland, T. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.05.048 · Cited by 363
Cognitive Inhibition and Emotion Regulation in Depression
Joormann, J. (2010) · Current Directions in Psychological Science · doi:10.1177/0963721410370293 · Cited by 345
Deficient inhibition of emotional information in depression
Goeleven, E., De Raedt, R., Baert, S., & Koster, E. H. W. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.03.007 · Cited by 308
Anticipation of aversive stimuli activates extended amygdala in unipolar depression
Abler, B., Erk, S., Herwig, U., & Walter, H. (2007) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2006.07.020 · Cited by 201 · cited 5×
“Given previous reports in depressed patients (Abler et al., 2007; Drevets, 2000; Fales et al., 2008), we would hypothesize that activity in the amygdala, ACC and DLPFC over all task conditions relative to baseline correlates with BDI scores.”
BackgroundResultInfluentialNeural Systems Supporting the Control of Affective and Cognitive Conflicts
Ochsner, K. N., Hughes, B., Robertson, E. R., Cooper, J. C., & Gabrieli, J. D. E. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21129 · Cited by 185 · cited 12×
“SMA activation was also found for emotional conflict in the study of Ochsner et al. (2009) in an affective flanker task.”
BackgroundInfluentialBall, T., Rahm, B., Eickhoff, S. B., Schulze-Bonhage, A., Speck, O., & Mutschler, I. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000307 · Cited by 176 · cited 3×
“It should also be taken into account thatwe used a somewhat larger smoothing kernel as previous studies which targeted particularly at amygdala responses (Ball et al., 2007; Goossens et al., 2009; Roy et al., 2009).”
BackgroundMethodSelf-citationDistinct fMRI responses to laughter, speech, and sounds along the human peri-sylvian cortex
Meyer, M., Zysset, S., von Cramon, D. Y., & Alter, K. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.02.008 · Cited by 120
Cited by
CREMA-D: Crowd-Sourced Emotional Multimodal Actors Dataset
Cao, H., Cooper, D. G., Keutmann, M. K., Gur, R. C., Nenkova, A., & Verma, R. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2336244 · Cited by 914
Bzdok, D., Schilbach, L., Vogeley, K., Schneider, K., Laird, A. R., Langner, R., & Eickhoff, S. B. (2012) · Brain Structure and Function · doi:10.1007/s00429-012-0380-y · Cited by 653
“In particular, AM activity typically increases in the left hemisphere in elaborate social-cognitive processes and in the right hemisphere in automatic, basic emotional processes (Phelps et al. 2001; Bzdok et al. 2012; Markowitsch 1998; Gläscher and Adolphs 2003).”
BackgroundSelf-citationBzdok, D., Laird, A. R., Zilles, K., Fox, P. T., & Eickhoff, S. B. (2013) · Human Brain Mapping · doi:10.1002/hbm.22138 · Cited by 431
Self-citationFaces in Context: A Review and Systematization of Contextual Influences on Affective Face Processing
Wieser, M. J., & Brosch, T. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00471 · Cited by 402
Neural Systems Supporting the Control of Affective and Cognitive Conflicts
Ochsner, K. N., Hughes, B., Robertson, E. R., Cooper, J. C., & Gabrieli, J. D. E. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21129 · Cited by 185
Metadata
- Authors
- Müller, V. I., Habel, U., Derntl, B., Schneider, F., Zilles, K., Turetsky, B. I., & Eickhoff, S. B.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2011-02
- Volume
- 54
- Issue
- 3
- Pages
- 2257-2266
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2088456207
- Cited by
- 113
- References
- 31
- FWCI
- 9.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.