Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion.

Abstract

Actors vocally portrayed happiness, sadness, anger, fear, and disgust with weak and strong emotion intensity while reading brief verbal phrases aloud. The portrayals were recorded and analyzed according to 20 acoustic cues. Listeners decoded each portrayal by using forced-choice or quantitative ratings. The results showed that (a) portrayals with strong emotion intensity yielded higher decoding accuracy than portrayals with weak intensity, (b) listeners were able to decode the intensity of portrayals, (c) portrayals of the same emotion with different intensity yielded different patterns of acoustic cues, and (d) certain acoustic cues (e.g., fundamental frequency, high-frequency energy) were highly predictive of listeners' ratings of emotion intensity. It is argued that lack of control for emotion intensity may account for some of the inconsistencies in cue utilization reported in the literature.

Cites (91)

1. Statistical Power Analysis for the Behavioral Sciences
   Muller, Keith · 1989 · Technometrics
2. Statistical power analysis for the behavioral sciences
   1990 · Computers, Environment and Urban Systems
3. A Mathematical Theory of Communication
   Shannon, C. E. · 1948 · Bell System Technical Journal
4. Multivariate Data Analysis.
   Herne, H., Cooley, William W., Lohnes, Paul R. · 1973 · Journal of the Royal Statistical Society. Series A (General)
5. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
   Cohen, Patricia, Cohen, Patricia, West, Stephen G., Aiken, Leona S. · 2014 · Psychology Press eBooks
6. Multivariate Data Analysis
   1997 · Chemometrics in Environmental Analysis
7. An argument for basic emotions
   Ekman, Paul · 1992 · Cognition and Emotion
8. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
   Kemp, Freda · 2003 · Journal of the Royal Statistical Society: Series D (The Statistician)
9. Affective Computing
   Picard, Rosalind W. · 1997 · MIT Press
10. The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding
    EKMAN, PAUL, FRIESEN, WALLACE V. · 1969 · Semiotica

Show all 91 references

Cited by (18)

1. Vocal communication of emotion: A review of research paradigms
   Scherer, K · 2003 · Speech Communication
2. The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English
   Livingstone, Steven R., Russo, Frank A. · 2018 · PLOS ONE
3. The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing
   Eyben, Florian, Scherer, Klaus R., Schuller, Bjorn W., Sundberg, Johan, Andre, Elisabeth, Busso, Carlos, Devillers, Laurence Y., Epps, Julien, Laukka, Petri, Narayanan, Shrikanth S. et al. · 2016 · IEEE Transactions on Affective Computing
4. Communication of emotions in vocal expression and music performance: different channels, same code?
   Juslin, Patrik N., Laukka, Petri · 2003 · Psychological Bulletin
5. When Doors of Perception Close: Bottom-up Models of Disrupted Cognition in Schizophrenia
   Javitt, Daniel C. · 2009 · Annual Review of Clinical Psychology

See all 301