Vocal Expression Of Emotion
Abstract
This chapter reviews theoretical models and empirical evidence on the effects of emotion on vocalization, in particular on human speech. Of all expressive manifestations of emotional arousal, vocalization represents the most phylogenetically continuous modality. The neural control structures, the voice production mechanisms, and the characteristics of vocal emotion signals are comparable across many species of mammals, including humans (Hauser, 1996; Marler & Tenaza, 1977; Morton, 1977; Scherer, 1985; see chapter 24, this volume). In consequence, the study of emotional vocalization constitutes a prime tool to investigate the relationships between the physiological production of affect vocalization and its use as a signal in social interaction and communication. The basis for the following discussion is a modified version of the Brunswikian lens model (Figure 23.1; see also Kappas, Hess, & Scherer, 1991; Scherer, 1978, 1982). This model allows one to clearly distinguish between the expression (or encoding) of emotion on the sender side, the transmission of the sound, and the impression (or decoding) on the receiver side, resulting in emotion inference or attribution. Consequently, the model encourages research on the complete process of emotion communication by (1) determining which distal characteristics of the sound wave emerging from the mouth of an affectively aroused speaker (i.e., the acoustic parameters) are produced by the underlying emotion, (2) determining how these cues are transmitted from sender to receiver through the vocal-acousticauditory channel, and (3) determining how these proximal cues (the representation of the distal voice characteristics in the sensorium and the central nervous system) are used by the receiver to infer the emotion of the sender. As will be shown, most research in this area has focused either on encoding or decoding. Our aim in organizing the chapter by a model that charts the entire process is to encourage future research to attend to all of these aspects and their interrelationships.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486 · see citing works
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · see citing works
Lazarus, R. S. (1991) · doi:10.1093/oso/9780195069945.001.0001 · Cited by 12,691 · see citing works
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646 · see citing works
LeDoux, J. E. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.155 · Cited by 8,444 · see citing works
Functional neuroanatomy of emotion: A meta-analysis of emotion activation studies in PET and fMRI
Phan, K. L., Wager, T., Taylor, S. F., & Liberzon, I. (2002) · NeuroImage · doi:10.1006/nimg.2002.1087 · Cited by 3,502 · see citing works
Fears, phobias, and preparedness: toward an evolved module of fear and fear learning
Öhman, A., & Mineka, S. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.483 · Cited by 3,147 · see citing works
Perception and the Representative Design of Psychological Experiments
Brunswik, E. (1956) · doi:10.1525/9780520350519 · Cited by 2,974 · see citing works
Evidence for a three-factor theory of emotions
Russell, J. A., & Mehrabian, A. (1977) · Journal of Research in Personality · doi:10.1016/0092-6566(77)90037-x · Cited by 1,940 · see citing works
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · see citing works
Evolutionary Psychology: A New Paradigm for Psychological Science
Buss, D. M. (1995) · Psychological Inquiry · doi:10.1207/s15327965pli0601_1 · Cited by 1,198 · see citing works
Functional neuroanatomy of emotions: A meta-analysis
MURPHY, F. C., NIMMO-SMITH, I., & LAWRENCE, A. D. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.3.207 · Cited by 1,135 · see citing works
Emotion, motivation, and anxiety: brain mechanisms and psychophysiology
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1998) · Biological Psychiatry · doi:10.1016/s0006-3223(98)00275-3 · Cited by 1,043 · see citing works
Basic emotions, relations among emotions, and emotion-cognition relations.
Izard, C. E. (1992) · Psychological Review · doi:10.1037/0033-295x.99.3.561 · Cited by 972 · see citing works
Emotion, Social Function, and Psychopathology
Keltner, D., & Kring, A. M. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.3.320 · Cited by 773 · see citing works
Emotions and speech: some acoustical correlates.
Williams, C. E., & Stevens, K. N. (1972) · The Journal of the Acoustical Society of America · doi:10.1121/1.1913238 · Cited by 735 · see citing works
Pollak, S. D., & Kistler, D. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.142165999 · Cited by 475 · see citing works
The structure of subjective emotional intensity.
Sonnemans, J., & Frijda, N. H. (1994) · Cognition & Emotion · doi:10.1080/02699939408408945 · Cited by 186 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Vocal communication of emotion: A review of research paradigms
Scherer, K. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00084-5 · Cited by 2,044 · see citing works
Self-citationBasic Emotions, Natural Kinds, Emotion Schemas, and a New Paradigm
Izard, C. E. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00044.x · Cited by 1,110 · see citing works
The science of interpersonal touch: An overview
Gallace, A., & Spence, C. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2008.10.004 · Cited by 879 · see citing works
Touch communicates distinct emotions.
Hertenstein, M. J., Keltner, D., App, B., Bulleit, B. A., & Jaskolka, A. R. (2006) · Emotion · doi:10.1037/1528-3542.6.3.528 · Cited by 770 · see citing works
The communication of emotion via touch
Hertenstein, M. J., Holmes, R., McCullough, M., & Keltner, D. (2009) · Emotion · doi:10.1037/a0016108 · Cited by 563 · see citing works
Synchrony in Psychotherapy: A Review and an Integrative Framework for the Therapeutic Alliance
Koole, S. L., & Tschacher, W. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00862 · Cited by 456 · see citing works
The contribution of source–filter theory to mammal vocal communication research
Taylor, A. M., & Reby, D. (2010) · Journal of Zoology · doi:10.1111/j.1469-7998.2009.00661.x · Cited by 407 · see citing works
Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues
Mittal, T., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413570 · Cited by 319 · see citing works
Cerebral processing of linguistic and emotional prosody: fMRI studies
Wildgruber, D., Ackermann, H., Kreifelts, B., & Ethofer, T. (2006) · Progress in Brain Research · doi:10.1016/s0079-6123(06)56013-3 · Cited by 297 · see citing works
Mapping emotions into acoustic space: the role of voice production.
Patel, S., Scherer, K. R., Björkner, E., & Sundberg, J. (2011) · Biological Psychology · doi:10.1016/j.biopsycho.2011.02.010 · Cited by 177 · see citing works
Self-citationA socio-relational framework of sex differences in the expression of emotion
Vigil, J. M. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09991075 · Cited by 173 · see citing works
Tell me more! assessing interactions with social robots from speech
Laban, G., George, J.-N., Morrison, V., & Cross, E. S. (2020) · Paladyn, Journal of Behavioral Robotics · doi:10.1515/pjbr-2021-0011 · Cited by 81 · see citing works
Persuasive Synthetic Speech: Voice Perception and User Behaviour
Dubiel, M., Halvey, M., Gallegos, P. O., & King, S. (2020) · Proceedings of the 2nd Conference on Conversational User Interfaces · doi:10.1145/3405755.3406120 · Cited by 28 · see citing works
Arruti, A., Cearreta, I., Álvarez, A., Lazkano, E., & Sierra, B. (2014) · PLoS ONE · doi:10.1371/journal.pone.0108975 · Cited by 21 · see citing works
Vacher, M., Aman, F., Rossato, S., Portet, F., & Lecouteux, B. (2019) · ACM Transactions on Accessible Computing · doi:10.1145/3310132 · Cited by 10 · see citing works
- Authors
- Scherer, K. R., Johnstone, & Klasmeyer, G.
- Affiliations
- University of Geneva (CH)
- University of Reading (GB)
- Venue
- Handbook of Affective Sciences
- Publisher
- Oxford University PressNew York, NY
- Published
- 2002-12-19
- Pages
- 433-456
- OpenAlex
- W2774090594
- Cited by
- 426
- References
- 18
- Citations by year
- 2026: 3 · 2025: 15 · 2024: 12 · 2023: 12 · 2022: 16 · 2021: 16 · 2020: 30 · 2019: 23 · 2018: 12 · 2017: 9 · 2016: 39 · 2015: 26 · 2014: 45 · 2013: 21 · 2012: 13
- FWCI
- 20.25
- Type
- book chapter
- Language
- en
- Open access
- closed
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Keywords
- vocal emotion expression, emotional communication, emotion encoding, emotion decoding, acoustic cues, phonation, emotion inference, emotion attribution, social communication, mammalian vocalizations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
