WORLD: A Vocoder-Based High-Quality Speech Synthesis System for Real-Time Applications
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
A vocoder-based speech synthesis system, named WORLD, was developed in an effort to improve the sound quality of real-time applications using speech. Speech analysis, manipulation, and synthesis on the basis of vocoders are used in various kinds of speech research. Although several high-quality speech synthesis systems have been developed, real-time processing has been difficult with them because of their high computational costs. This new speech synthesis system has not only sound quality but also quick processing. It consists of three analysis algorithms and one synthesis algorithm proposed in our previous research. The effectiveness of the system was evaluated by comparing its output with against natural speech including consonants. Its processing speed was also compared with those of conventional systems. The results showed that WORLD was superior to the other systems in terms of both sound quality and processing speed. In particular, it was over ten times faster than the conventional systems, and the real time factor (RTF) indicated that it was fast enough for real-time processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
YIN, a fundamental frequency estimator for speech and music
de Cheveigné, A., & Kawahara, H. (2002) · The Journal of the Acoustical Society of America · doi:10.1121/1.1458024 · Cited by 1,920
Kawahara, H., Masuda-Katsuse, I., & de Cheveigné, A. (1999) · Speech Communication · doi:10.1016/s0167-6393(98)00085-5 · Cited by 1,831
Speech analysis/Synthesis based on a sinusoidal representation
McAulay, R., & Quatieri, T. (1986) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1986.1164910 · Cited by 1,609
Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones
Moulines, E., & Charpentier, F. (1990) · Speech Communication · doi:10.1016/0167-6393(90)90021-z · Cited by 1,244
Speech Analysis and Synthesis by Linear Prediction of the Speech Wave
Atal, B. S., & Hanauer, S. L. (1971) · The Journal of the Acoustical Society of America · doi:10.1121/1.1912679 · Cited by 1,209
Statistical parametric speech synthesis
Zen, H., Tokuda, K., & Black, A. W. (2009) · Speech Communication · doi:10.1016/j.specom.2009.04.004 · Cited by 1,195
A sawtooth waveform inspired pitch estimator for speech and music
Camacho, A., & Harris, J. G. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.2951592 · Cited by 426
Kawahara, H., Morise, M., Takahashi, T., Nisimura, R., Irino, T., & Banno, H. (2008) · 2008 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2008.4518514 · Cited by 363
Self-citationFlanagan, J. L., & Golden, R. M. (1966) · Bell System Technical Journal · Cited by 348
A mixed excitation LPC vocoder model for low bit rate speech coding
McCree, A. V., & Barnwell, T. P. (1995) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.397089 · Cited by 310
Cited by
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
“…a number of attempts to address these issues individually, such as developing high-quality vocoders (Kawahara et al., 1999; Agiomyrgiannakis, 2015; Morise et al., 2016), improving the accuracy of generative models (Zen et al., 2007; 2013; Fan et al., 2014; Uria et al., 2015), and compensating the…”
BackgroundASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T., & Lee, K. A. (2019) · arXiv · doi:10.48550/arxiv.1904.05441 · Cited by 688
“TTS systems use either waveform concatenation or neural-network-based speech synthesis using a conventional source-filter vocoder [7] or a WaveNet-based vocoder [8].”
MethodASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T. H., & Lee, K. A. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2249 · Cited by 687
MelGAN: generative adversarial networks for conditional waveform synthesis
Kumar, K., Kumar, R., de Boissiere, T., Gestin, L., Teoh, W. Z., Sotelo, J., de Brebisson, A., Bengio, Y., & Courville, A. (2019) · arXiv · doi:10.48550/arxiv.1910.06711 · Cited by 722
“For instance, the WORLD vocoder (MORISE et al., 2016) introduces an intermediate representation tailored to speech modelling based on mel-spectrogram-like features.”
MethodFastSpeech: Fast, Robust and Controllable Text to Speech
Ren, Y., Ruan, Y., Tan, X., Qin, T., Zhao, S., Zhao, Z. L., & Liu, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09263 · Cited by 559
ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech
Wang, X., Yamagishi, J., Todisco, M., Delgado, H., Nautsch, A., Evans, N., Sahidullah, M., Vestman, V., Kinnunen, T., Lee, K. A., et al. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101114 · Cited by 505
“60-dimensional MCCs, 25-dimensional BAPs and logarithmic F0 were extracted at 5 ms frame intervals using the WORLD vocoder [20].”
MethodDeep Voice: Real-time Neural Text-to-Speech
Arık, S. Ö., Chrzanowski, M., Coates, A., Diamos, G., Gibiansky, A., Kang, Y., Li, X., Miller, J. J., Ng, A. Y., Raiman, J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07825 · Cited by 381
“StarGAN-VC: non-parallel many-to-many voice conversion using star generative adversarial networks,”
Kameoka, H., Kaneko, T., Tanaka, K., & Hojo, N. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639535 · Cited by 371
CycleGAN-VC: Non-parallel Voice Conversion Using Cycle-Consistent Adversarial Networks
Kaneko, T., & Kameoka, H. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553236 · Cited by 358
“The speech data were downsampled to 16 kHz, and 24 Mel-cepstral coefficients (MCEPs), logarithmic fundamental frequency (logF0), and aperiodicities (APs) were then extracted every 5 ms using the WORLD analysis system [45].”
MethodAn Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation
Michelsanti, D., Tan, Z.-H., Zhang, S.-X., Xu, Y., Yu, M., Yu, D., & Jensen, J. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3066303 · Cited by 316
(2017) · International Conference on Learning Representations · Cited by 314
The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
Lorenzo-Trueba, J., Yamagishi, J., Toda, T., Saito, D., Villavicencio, F., Kinnunen, T., & Ling, Z. (2018) · The Speaker and Language Recognition Workshop (Odyssey 2018) · doi:10.21437/odyssey.2018-28 · Cited by 305
Merlin: An Open Source Neural Network Speech Synthesis System
Wu, Z., Watts, O., & King, S. (2016) · 9th ISCA Workshop on Speech Synthesis Workshop (SSW 9) · doi:10.21437/ssw.2016-33 · Cited by 299
CycleGAN-VC2: improved CycleGAN-based non-parallel voice conversion.
Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682897 · Cited by 272
Speaker-Dependent WaveNet Vocoder
Tamamori, A., Hayashi, T., Kobayashi, K., Takeda, K., & Toda, T. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-314 · Cited by 269
An overview of voice conversion systems
Mohammadi, S. H., & Kain, A. (2017) · Speech Communication · doi:10.1016/j.specom.2017.01.008 · Cited by 264
Towards reconstructing intelligible speech from the human auditory cortex
Akbari, H., Khalighinejad, B., Herrero, J. L., Mehta, A. D., & Mesgarani, N. (2019) · Scientific Reports · doi:10.1038/s41598-018-37359-z · Cited by 221
A survey on neural speech synthesis
Tan, X., Qin, T., Soong, F., & Liu, T.-Y. (2021) · arXiv · doi:10.48550/arxiv.2106.15561 · Cited by 216
“In statistical parametric speech synthesis [409, 350, 408, 418, 351], LSP (line spectral pairs) [132], MCC (mel-cepstral coefficients) [79], MGC (mel-generalized coefficients) [349], F0 and BAP (band aperiodicities) [153, 154] are used as acoustic features, which can be easily converted into waveform through vocoders…”
MethodInfluentialJoint Audio-Visual Deepfake Detection
Zhou, Y., & Lim, S.-N. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01453 · Cited by 217
“By running these spectrograms through different vocoders [38, 52, 23, 33, 19, 28, 60] that are commonly used in TTS and VC tasks to mimic synthesized speech, we eventually curated a dataset similar in size to existing video deepfake datasets, but with manipulated audio channels.”
MethodVoice Conversion Challenge 2020 –- Intra-lingual semi-parallel and cross-lingual voice conversion –-
Yi, Z., Huang, W.-C., Tian, X., Yamagishi, J., Das, R. K., Kinnunen, T., Ling, Z.-H., & Toda, T. (2020) · Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020 · doi:10.21437/vcc_bc.2020-14 · Cited by 126
“High-quality nonparallel voice conversion based on cycle-consistent adversarial network,”
Fang, F., Yamagishi, J., Echizen, I., & Lorenzo-Trueba, J. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462342 · Cited by 128
Deep voice 3: scaling text-to-speech with convolutional sequence learning
Ping, W., Peng, K., Gibiansky, A., Arik, S. O., Kannan, A., Narang, S., Raiman, J., & Miller, J. (2017) · arXiv · doi:10.48550/arxiv.1710.07654 · Cited by 313
Synthetic speech detection through short-term and long-term prediction traces
Borrelli, C., Bestagini, P., Antonacci, F., Sarti, A., & Tubaro, S. (2021) · EURASIP Journal on Information Security · doi:10.1186/s13635-021-00116-3 · Cited by 80
“Nonetheless, in the last years, more sophisticated and high-quality vocoders have been proposed [11, 26, 27].”
BackgroundMethodGroup sparse representation with wavenet vocoder adaptation for spectrum and prosody conversion
Sisman, B., Zhang, M., & Li, H. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2910637 · Cited by 52
The Emotional Voices Database: Towards Controlling the Emotion Dimension in Voice Generation Systems
Adigwe, A., Tits, N., Haddad, K. E., Ostadabbas, S., & Dutoit, T. (2018) · arXiv · doi:10.48550/arxiv.1806.09514 · Cited by 52
SafeEar: Content Privacy-Preserving Audio Deepfake Detection
Li, X., Li, K., Zheng, Y., Yan, C., Ji, X., & Xu, W. (2024) · Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3658644.3670285 · Cited by 39
“• WORLD [58]: WORLD is a statistical parameter-based voice synthesis system that offers fine control over the spectral and prosodic features of the synthesized audio.”
Emotionless: Privacy-Preserving Speech Analysis for Voice Assistants
Aloufi, R., Haddadi, H., & Boyle, D. (2019) · arXiv · Cited by 39
An Initial Investigation for Detecting Vocoder Fingerprints of Fake Audio
Yan, X., Yi, J., Tao, J., Wang, C., Ma, H., Wang, T., Wang, S., & Fu, R. (2022) · Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia · doi:10.1145/3552466.3556525 · Cited by 30
Li, J., Wang, H., He, P., Abdullahi, S. M., & Li, B. (2022) · Digital Signal Processing · doi:10.1016/j.dsp.2021.103256 · Cited by 20
Robust Spoof Speech Detection Based on Multi-Scale Feature Aggregation and Dynamic Convolution
Wu, H., Zhang, J., Zhang, Z., Zhao, W., Gu, B., & Guo, W. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10446612 · Cited by 14
Creating New Language and Voice Components for the Updated MaryTTS Text-to-Speech Synthesis Platform
Steiner, I., & Le Maguer, S. (2018) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/2s9w7jk4ompu · Cited by 11
Kawamura, M., Shirahata, Y., Mitsui, K., & Shimizu, R. (2026) · arXiv · doi:10.48550/arxiv.2606.20137
“To evaluate the effectiveness of SSL-based representations, we compare against a model trained on features extracted using WORLD [32], referred to as ACC-WORLD-MOS.”
Metadata
- Authors
- MORISE, M., YOKOMORI, F., & OZAWA, K.
- Venue
- IEICE Transactions on Information and Systems
- Published
- 2016
- Volume
- E99.D
- Issue
- 7
- Pages
- 1877-1884
- ISSN
- 0916-8532 (ISSN-L)
- 1745-1361
- OpenAlex
- W2471520273
- Cited by
- 1,092
- References
- 19
- FWCI
- 82.16
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.