Impact of voice on emotional judgment of faces: An event‐related fMRI study
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Emotional information can be conveyed by various means of communication, such as propositional content, speech intonation, facial expression, and gestures. Prior studies have demonstrated that inputs from one modality can alter perception in another modality. To evaluate the impact of emotional intonation on ratings of emotional faces, a behavioral study first was carried out. Second, functional magnetic resonance (fMRI) was used to identify brain regions that mediate crossmodal effects of emotional prosody on judgments of facial expressions. In the behavioral study, subjects rated fearful and neutral facial expressions as being more fearful when accompanied by a fearful voice as compared to the same facial expressions without concomitant auditory stimulus, whereas no such influence on rating of faces was found for happy voices. In the fMRI experiment, this shift in rating of facial expressions in presence of a fearfully spoken sentence was correlated with the hemodynamic response in the left amygdala extending into the periamygdaloid cortex, which suggests that crossmodal effects on cognitive judgments of emotional information are mediated via these neuronal structures. Furthermore, significantly stronger activations were found in the mid‐portion of the right fusiform gyrus during judgment of facial expressions in presence of fearful as compared to happy intonations, indicating that enhanced processing of faces within this region can be induced by the presence of threat‐related information perceived via the auditory modality. Presumably, these increased extrastriate activations correspond to enhanced alertness, whereas responses within the left amygdala modulate cognitive evaluation of emotional facial expressions. Hum Brain Mapp, 2006. © 2006 Wiley‐Liss, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · cited 4×
“To determine whether such shifts in interpretation of visually presented affective information can be introduced by nonverbal emotional information perceived via the auditory modality, we conducted a behavioral experiment in which subjects were to rate the valence of facial expressions in the presence and absence of a…”
InfluentialThe fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · cited 2×
“Both lesion studies in prosopagnosic patients [Barton et al., 2002] and neuroimaging studies in normal subjects [Kanwisher et al., 1997; Puce et al., 1995] suggest that the midsection of the right fusiform gyrus is crucial for processing of faces.”
Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space
Collins, D. L., Neelin, P., Peters, T. M., & Evans, A. C. (1994) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199403000-00005 · Cited by 3,431 · cited 2×
“The transformation matrix for normalization to Montreal Neurological Institute (MNI) space [Collins et al., 1994] was calculated based on the structural T1-weighted 3-D data set of each subject and subsequently applied to the functional images.”
MethodA revised version of the Psychoticism scale
Eysenck, S. B. G., Eysenck, H. J., & Barrett, P. (1985) · Personality and Individual Differences · doi:10.1016/0191-8869(85)90026-1 · Cited by 3,094
The amygdala: vigilance and emotion
Davis, M., & Whalen, P. J. (2001) · Molecular Psychiatry · doi:10.1038/sj.mp.4000812 · Cited by 2,882
Adolphs, R., Tranel, D., Damasio, H., & Damasio, A. (1994) · Nature · doi:10.1038/372669a0 · Cited by 2,360 · cited 2×
“Although there is converging evidence from both lesion [Adolphs et al., 1994; Calder et al., 1996] and neuroimaging studies [Breiter et al., 1996; Morris et al., 1996] arguing for a specific contribution of the amygdalae in perception of fearful facial expressions, their role in processing of…”
A differential neural response in the human amygdala to fearful and happy facial expressions
Morris, J. S., Frith, C. D., Perrett, D. I., Rowland, D., Young, A. W., Calder, A. J., & Dolan, R. J. (1996) · Nature · doi:10.1038/383812a0 · Cited by 2,013
Effects of Attention and Emotion on Face Processing in the Human Brain
Vuilleumier, P., Armony, J. L., Driver, J., & Dolan, R. J. (2001) · Neuron · doi:10.1016/s0896-6273(01)00328-2 · Cited by 1,664 · cited 2×
“Previous neuroimaging studies demonstrated enhanced responses within the fusiform gyrus to emotional as compared to neutral facial expressions [Morris et al., 1998; Vuilleumier et al., 2001], which are especially pronounced if the displayed emotion signals fear [Surguladze et al., 2003].”
Cortical pathways to the mammalian amygdala
McDonald, A. J. (1998) · Progress in Neurobiology · doi:10.1016/s0301-0082(98)00003-3 · Cited by 1,303
A neuromodulatory role for the human amygdala in processing emotional facial expressions
Morris, J. (1998) · Brain · doi:10.1093/brain/121.1.47 · Cited by 1,291 · cited 8×
“Furthermore, this extrastriate cortical region shows stronger responses to emotional as compared to neutral faces [Morris et al., 1998] and a preferential increase of neuronal activity to signals of danger has been demonstrated [Surguladze et al.”
Influential
Cited by
Integrating face and voice in person perception
Campanella, S., & Belin, P. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.10.001 · Cited by 527
The Oxford Handbook of Cognitive Psychology
(2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195376746.001.0001 · Cited by 372
Audio-visual integration of emotion expression
Collignon, O., Girard, S., Gosselin, F., Roy, S., Saint-Amour, D., Lassonde, M., & Lepore, F. (2008) · Brain Research · doi:10.1016/j.brainres.2008.04.023 · Cited by 353
Understanding Voice Perception
Belin, P., Bestelmeyer, P. E. G., Latinus, M., & Watson, R. (2011) · British Journal of Psychology · doi:10.1111/j.2044-8295.2011.02041.x · Cited by 342
Cerebral processing of linguistic and emotional prosody: fMRI studies
Wildgruber, D., Ackermann, H., Kreifelts, B., & Ethofer, T. (2006) · Progress in Brain Research · doi:10.1016/s0079-6123(06)56013-3 · Cited by 297
“Similar response patterns were found both for explicit and implicit processing of emotional prosody (Ethofer et al., 2006).”
BackgroundResultInfluentialSelf-citationAudiovisual integration of emotional signals in voice and face: An event-related fMRI study
Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., & Wildgruber, D. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.020 · Cited by 303
Self-citationA review of brain oscillations in perception of faces and emotional pictures
Güntekin, B., & Başar, E. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.03.014 · Cited by 258
Choi, J., Jeong, B., Polcari, A., Rohan, M. L., & Teicher, M. H. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.033 · Cited by 215
“Similarly, Ethofer et al. (2006) reported that subjects rated fearful and neutral facial expressions as more fearful when accompanied by a fearful voice, and that this shift in ratings of facial expression by a fearful voice correlated with hemodynamic response in the left amygdala and…”
InfluentialBrandwein, A. B., Foxe, J. J., Butler, J. S., Frey, H.-P., Bates, J. C., Shulman, L. H., & Molholm, S. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2212-9 · Cited by 187
Kreifelts, B., Ethofer, T., Huberle, E., Grodd, W., & Wildgruber, D. (2010) · Human Brain Mapping · doi:10.1002/hbm.20913 · Cited by 132
Self-citationDricu, M., & Frühholz, S. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.10.020 · Cited by 102
Canbeyli, R. (2022) · European Journal of Neuroscience · doi:10.1111/ejn.15507 · Cited by 48
Waldie (2013) · doi:10.3389/fnhum.2014.00757 · Cited by 46
Hearing, touching, and multisensory integration during mate choice
Lenschow, C., Mendes, A. R. P., & Lima, S. Q. (2022) · Frontiers in Neural Circuits · doi:10.3389/fncir.2022.943888 · Cited by 17
Metadata
- Authors
- Ethofer, T., Anders, S., Erb, M., Droll, C., Royen, L., Saur, R., Reiterer, S., Grodd, W., & Wildgruber, D.
- Venue
- Human Brain Mapping
- Publisher
- Wiley
- Published
- 2006-01-12
- Volume
- 27
- Issue
- 9
- Pages
- 707-714
- ISSN
- 1065-9471 (ISSN-L)
- 1097-0193
- OpenAlex
- W2053653065
- Cited by
- 157
- References
- 18
- FWCI
- 3.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.