CoChat
Sign Up
PreprintCited by 52Speech Recognition and SynthesisEmotion and Mood RecognitionSpeech and Audio Processing

The Emotional Voices Database: Towards Controlling the Emotion Dimension in Voice Generation Systems

Open access
Adigwe, Adaeze, Tits, Noé, Haddad, Kevin El, Ostadabbas, Sarah, Dutoit, Thierry·2018·arXiv
DOI 10.48550/arxiv.1806.09514arXiv 1806.09514
Open this paper in CoChat — free accountOpen PDF

Abstract

In this paper, we present a database of emotional speech intended to be open-sourced and used for synthesis and generation purpose. It contains data for male and female actors in English and a male actor in French. The database covers 5 emotion classes so it could be suitable to build synthesis and voice transformation systems with the potential to control the emotional dimension in a continuous way. We show the data's efficiency by building a simple MLP system converting neutral to angry speech style and evaluate it via a CMOS perception test. Even though the system is a very simple one, the test show the efficiency of the data which is promising for future work.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1806.09514

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • VALL-E is able to keep the same emotion of the prompt in speech synthesis, even if the model is not fine-tuned on an emotional TTS dataset.

    “VALL-E is able to keep the same emotion of the prompt in speech synthesis, even if the model is not fine-tuned on an emotional TTS dataset.”

    From Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers (2023) · cites this paper as Adigwe et al., 2018

    The introduction (p. 1) discusses emotional control in speech synthesis, and §5.1 (p. 5) describes the paper’s own neutral-to-angry voice transformation system. Searches for VALL-E, preservation of a prompt’s emotion, and synthesis without fine-tuning found no passage addressing the claim. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 22

  1. [1]1. B¨ anziger, T., Mortillaro, M., Scherer, K.R.: Introducing the geneva multimodal expression corpus for experimental research on emotion perception. Emotion 12 (5), 1161 (2012)
  2. [2]2. Brognaux, S., Roekhaut, S., Drugman, T., Beaufort, R.: Train&Align: A new online tool for automatic phonetic alignment. In: Spoken Language Technology Workshop (SLT), 2012 IEEE. pp. 416-421. IEEE (2012)
  3. [3]3. Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W.F., Weiss, B.: A database of german emotional speech. In: Ninth European Conference on Speech Communication and Technology (2005)
  4. [4]4. Busso, C., Bulut, M., Lee, C.C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J.N., Lee, S., Narayanan, S.S.: Iemocap: Interactive emotional dyadic motion capture database. Language resources and evaluation 42 (4), 335 (2008)
  5. [6]6. Cao, H., Cooper, D.G., Keutmann, M.K., Gur, R.C., Nenkova, A., Verma, R.: Crema-d: Crowd-sourced emotional multimodal actors dataset. IEEE transactions on affective computing 5 (4), 377-390 (2014)
  6. [7]7. Ekman, P.: Basic emotions. In: Dalgleish, T., Powers, M.J. (eds.) Handbook of Cognition and Emotion, pp. 4-5. Wiley (1999)
  7. [8]8. El Haddad, K., Cakmak, H., Dupont, S., , Dutoit, T.: Breath and repeat: An attempt at enhancing speech-laugh synthesis quality. In: European Signal Processing Conference (EUSIPCO 2015). Nice, France (31 August-4 September 2015)
  8. [9]9. El Haddad, K., Cakmak, H., Dupont, S., Dutoit, T.: An HMM Approach for Synthesizing Amused Speech with a Controllable Intensity of Smile. In: IEEE International Symposium on Signal Processing and Information Technology (ISSPIT). Abu Dhabi, UAE (7-10 December 2015)
  9. [10]10. El Haddad, K., Dupont, S., d'Alessandro, N., Dutoit, T.: An HMM-based speechsmile synthesis system: An approach for amusement synthesis. In: International Workshop on Emotion Representation, Analysis and Synthesis in Continuous Time and Space (EmoSPACE). Ljubljana, Slovenia (4-8 May 2015)
  10. [11]11. El Haddad, K., Dupont, S., Urbain, J., Dutoit, T.: Speech-laughs: An HMM-based Approach for Amused Speech Synthesis. In: Internation Conference on Acoustics, Speech and Signal Processing (ICASSP 2015). pp. 4939-4943. Brisbane, Australia (19-24 April 2015)
  11. [12]12. El Haddad, K., Torre, I., Gilmartin, E., C ¸akmak, H., Dupont, S., Dutoit, T., Campbell, N.: Introducing amus: The amused speech database. In: Camelin, N., Est` eve, Y., Mart´ ın-Vide, C. (eds.) Statistical Language and Speech Processing. pp. 229240. Springer International Publishing, Cham (2017)
  12. [14]14. Kawanami, H., Iwami, Y., Toda, T., Saruwatari, H., Shikano, K.: Gmm-based voice conversion applied to emotional speech synthesis. In: Eighth European Conference on Speech Communication and Technology (2003)
  13. [15]15. Kominek, J., Black, A.W.: The cmu arctic speech databases. In: Fifth ISCA Workshop on Speech Synthesis (2004)
  14. [16]16. Livingstone, S.R., Russo, F.A.: The ryerson audio-visual database of emotional speech and song (ravdess): A dynamic, multimodal set of facial and vocal expressions in north american english. PLOS ONE 13 (5), 1-35 (05 2018). https://doi.org/10.1371/journal.pone.0196391 · DOI
  15. [17]17. Luo, Z., Takiguchi, T., Ariki, Y.: Emotional voice conversion using deep neural networks with mcc and f0 features. In: Computer and Information Science (ICIS), 2016 IEEE/ACIS 15th International Conference on. pp. 1-5. IEEE (2016)
  16. [18]18. Morise, M., Yokomori, F., Ozawa, K.: World: a vocoder-based high-quality speech synthesis system for real-time applications. IEICE TRANSACTIONS on Information and Systems 99 (7), 1877-1884 (2016)
  17. [21]21. Shen, J., Pang, R., Weiss, R.J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerry-Ryan, R.J., Saurous, R.A., Agiomyrgiannakis, Y., Wu, Y.: Natural tts synthesis by conditioning wavenet on mel spectrogram predictions. CoRR abs/1712.05884 (2017) · arXiv
  18. [22]22. Trouvain, J.: Phonetic aspects of speech-laughs. In: Oralit´ e et Gestualit´ e: Actes du colloque ORAGE, Aix-en-Provence. Paris: LHarmattan. pp. 634-639 (2001)
  19. [23]23. Wang, Y., Skerry-Ryan, R.J., Stanton, D., Wu, Y., Weiss, R.J., Jaitly, N., Yang, Z., Xiao, Y., Chen, Z., Bengio, S., Le, Q.V., Agiomyrgiannakis, Y., Clark, R., Saurous, R.A.: Tacotron: Towards end-to-end speech synthesis. In: INTERSPEECH (2017)
  20. [24]24. Wu, Z., Watts, O., King, S.: Merlin: An open source neural network speech synthesis system. Proc. SSW, Sunnyvale, USA (2016)
  21. [25]25. Yannakakis, G.N., Cowie, R., Busso, C.: The ordinal nature of emotions. In: 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII). vol. 00, pp. 248-255 (Oct 2017). https://doi.org/10.1109/ACII.2017.8273608, · DOI
  22. [14]14. [doi.ieeecomputersociety.org/10.1109/ACII.2017.8273608](doi.ieeecomputersociety.org/10.1109/ACII.2017.8273608) · DOI

Cited by

Sorted by citations

Authors
Adigwe, A., Tits, N., Haddad, K. E., Ostadabbas, S., & Dutoit, T.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2018
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1806.09514
arXiv
1806.09514
OpenAlex
W2810914326
Cited by
52
References
2
Citations by year
2025: 6 · 2024: 6 · 2023: 10 · 2022: 12 · 2021: 11 · 2020: 4 · 2019: 3
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
emotional speech, speech synthesis, voice conversion, emotion control, speech corpus, multilayer perceptron

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review