Statistical parametric speech synthesis using deep neural networks
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Conventional approaches to statistical parametric speech synthesis typically use decision tree-clustered context-dependent hidden Markov models (HMMs) to represent probability densities of speech parameters given texts. Speech parameters are generated from the probability densities to maximize their output probabilities, then a speech waveform is reconstructed from the generated parameters. This approach is reasonably effective but has a couple of limitations, e.g. decision trees are inefficient to model complex context dependencies. This paper examines an alternative scheme that is based on a deep neural network (DNN). The relationship between input texts and their acoustic realizations is modeled by a DNN. The use of the DNN can address some limitations of the conventional approach. Experimental results show that the DNN-based systems outperformed the HMM-based systems with similar numbers of parameters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Self-citationDeep Neural Networks for Acoustic Modeling in Speech Recognition
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · IEEE Signal Processing Magazine · Cited by 2,114
Self-citationStatistical parametric speech synthesis
Zen, H., Tokuda, K., & Black, A. W. (2009) · Speech Communication · doi:10.1016/j.specom.2009.04.004 · Cited by 1,195
Self-citationUnit selection in a concatenative speech synthesis system using a large speech database
Hunt, A. J., & Black, A. W. (2002) · 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings · doi:10.1109/icassp.1996.541110 · Cited by 1,190
Speech parameter generation algorithms for HMM-based speech synthesis
Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., & Kitamura, T. (2002) · 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100) · doi:10.1109/icassp.2000.861820 · Cited by 999
Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter Trajectory
Toda, T., Black, A. W., & Tokuda, K. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.907344 · Cited by 937
Speaker-independent isolated word recognition using dynamic features of speech spectrum
Furui, S. (1986) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1986.1164788 · Cited by 748
A robust parser for spoken language understanding
Wang, Y.-Y. (1999) · 6th European Conference on Speech Communication and Technology · doi:10.21437/eurospeech.1999-513 · Cited by 653
Deep Learning and Its Applications to Signal and Information Processing [Exploratory DSP
Yu, D., & Deng, L. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.939038 · Cited by 455
A Speech Parameter Generation Algorithm Considering Global Variance for HMM-Based Speech Synthesis
TODA, T., & TOKUDA, K. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-d.5.816 · Cited by 358
An adaptive algorithm for mel-cepstral analysis of speech
Fukada, T., Tokuda, K., Kobayashi, T., & Imai, S. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225953 · Cited by 328
An HMM-based speech synthesis system applied to English
(2002) · Proceedings of 2002 IEEE Workshop on Speech Synthesis 2002 WSS-02 · doi:10.1109/wss.2002.1224415 · Cited by 319
Details of the Nitech HMM-Based Speech Synthesis System for the Blizzard Challenge 2005
ZEN, H., TODA, T., NAKAMURA, M., & TOKUDA, K. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-1.1.325 · Cited by 222
Self-citationA Hidden Semi-Markov Model-Based Speech Synthesis System
ZEN, H., TOKUDA, K., MASUKO, T., KOBAYASIH, T., & KITAMURA, T. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-d.5.825 · Cited by 209
Self-citationRobust Speaker-Adaptive HMM-Based Text-to-Speech Synthesis
Yamagishi, J., Nose, T., Zen, H., Ling, Z.-H., Toda, T., Tokuda, K., King, S., & Renals, S. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2009.2016394 · Cited by 178
Self-citationSimultaneous Modeling Of Spectrum, Pitch And Duration In HMM-Based Speech Synthesis
Yoshimura, T., Tokuda, K., Kobayashi, T., Masuko, T., & Kitamura, T. (1999) · Cited by 166
Deep Learning and Its Applications to Signal and Information Processing
Yu, D., & Deng, L. (2011) · IEEE Signal Processing Magazine · Cited by 159
Anytime Learning of Decision Trees
Esmeir, S., & Markovitch, S. (2007) · Journal of Machine Learning Research · doi:10.5555/1248659.1248692 · Cited by 72
Deep architectures for articulatory inversion
Uría, B., Murray, I., Renals, S. J., & Richmond, K. (2012) · Interspeech (USB) · doi:10.21437/interspeech.2012-263 · Cited by 72
Speaker interpolation for HMM-based speech synthesis system.
Yoshimura, T., Tokuda, K., Masuko, T., et al. (2000) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.21.199 · Cited by 67
HMM-based Korean speech synthesis system for hand-held devices
Kim, S.-J., Kim, J.-J., & Hahn, M. (2006) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2006.273160 · Cited by 51
Product of Experts for Statistical Parametric Speech Synthesis
Zen, H., Gales, M., Nankaku, Y., & Tokuda, K. (2011) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2165280 · Cited by 50
Self-citationIncorporating a mixed excitation model and postfilter into HMM-based text-to-speech synthesis
Yoshimura, T., Tokuda, K., Masuko, T., Kobayashi, T., & Kitamura, T. (2005) · Systems and Computers in Japan · doi:10.1002/scj.20354 · Cited by 50
Speech Synthesis with Neural NetworksPreprint
Karaali, O., Corrigan, G., & Gerson, I. A. (1998) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/9811031 · Cited by 37
Research works printed but not linked: 17
- 10.1016/j.specom.2011.03.003 · doi:10.1016/j.specom.2011.03.003
- 10.1109/ICASSP.2011.5947369 · doi:10.1109/icassp.2011.5947369
- tokuda, 2002, Multi-space probability distribution HMM, IEICE Trans Inf Syst, e85 d, 455
- 10.1109/ICASSP.1999.758133 · doi:10.1109/icassp.1999.758133
- 10.1109/ICASSP.2006.1660231 · doi:10.1109/icassp.2006.1660231
- odell, 1995, The use of context in large vocabulary speech recognition
- shinoda, 1997, Acoustic modeling based on the MDL criterion for speech recognition, Proc EUROSPEECH, 99, 10.21437/Eurospeech.1997-52 · doi:10.21437/eurospeech.1997-52
- 10.1109/TASL.2010.2076805 · doi:10.1109/tasl.2010.2076805
- qian, 2008, Generating natural F0 trajectory with additive trees, Proc INTERSPEECH, 2126, 10.21437/Interspeech.2008-551 · doi:10.21437/interspeech.2008-551
- nankaku, 2008, Acoustic modeling with contextual additive structure for HMM-based speech recognition, Proc ICASSP, 4469
- saino, 2008, A Clustering Technique for Factor Analysis-based Eigenvoice Models
- 10.1109/ICASSP.2010.5495690 · doi:10.1109/icassp.2010.5495690
- 10.1109/ICASSP.2001.941037 · doi:10.1109/icassp.2001.941037
- morioka, 2004, Miniaturization of HMM-based speech synthesis, Procs ASJ Autumn Meeting, 325
- 10.1093/ietisy/e90-d.9.1406 · doi:10.1093/ietisy/e90-d.9.1406
- shichiri, 2002, Eigenvoices for HMM-based speech synthesis, Proc ICSLP, 1269
- gutkin, 2010, Quantized HMMs for low footprint text-to-speech synthesis, Proc INTERSPEECH, 837, 10.21437/Interspeech.2010-186 · doi:10.21437/interspeech.2010-186
Cited by
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Self-citationNatural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
Self-citationDeep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
Yamamoto, R., Song, E., & Kim, J.-M. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053795 · Cited by 827
Neural Speech Synthesis with Transformer Network
Li, N., Liu, S., Liu, Y., Zhao, S., & Liu, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016706 · Cited by 754
“Parametric TTS systems (Tokuda et al. 2000; Zen, Tokuda, and Black 2009; Ze, Senior, and Schuster 2013; Tokuda et al. 2013) convert speech waves into spectrograms, and acoustic parameters, such as fundamental frequency and duration, are used to synthesize new audio results.”
Method
Metadata
- Authors
- Zen, H., Senior, A., & Schuster, M.
- Venue
- 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
- Publisher
- IEEE
- Published
- 2013-05
- Pages
- 7962-7966
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2102003408
- Cited by
- 809
- References
- 27
- FWCI
- 39.24
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.