The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Unidirectional long short-term memory recurrent neural network with recurrent output layer for low-latency speech synthesis
Abstract
Long short-term memory recurrent neural networks (LSTM-RNNs) have been applied to various speech applications including acoustic modeling for statistical parametric speech synthesis. One of the concerns for applying them to text-to-speech applications is its effect on latency. To address this concern, this paper proposes a low-latency, streaming speech synthesis architecture using unidirectional LSTM-RNNs with a recurrent output layer. The use of unidirectional RNN architecture allows frame-synchronous streaming inference of output acoustic features given input linguistic features. The recurrent output layer further encourages smooth transition between acoustic features at consecutive frames. Experimental results in subjective listening tests show that the proposed architecture can synthesize natural sounding speech without requiring utterance-level batch processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“It has been successfully applied to various applications, such as speech recognition [26] [27], handwriting recognition [28], and speech synthesis [19] [20] [21] [22].”
MethodLong short-term memory recurrent neural network architectures for large scale acoustic modeling
Sak, H., Senior, A., & Beaufays, F. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-80 · Cited by 2,973
Self-citationParallel & distributed processing
Slusallek, P., Shirley, P., Mark, W., Stoll, G., & Wald, I. (2005) · ACM SIGGRAPH 2005 Courses on - SIGGRAPH '05 · doi:10.1145/1198555.1198750 · Cited by 2,568
Deep Neural Networks for Acoustic Modeling in Speech Recognition
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · IEEE Signal Processing Magazine · Cited by 2,115
Statistical parametric speech synthesis
Zen, H., Tokuda, K., & Black, A. W. (2009) · Speech Communication · doi:10.1016/j.specom.2009.04.004 · Cited by 1,195
Self-citationUnit selection in a concatenative speech synthesis system using a large speech database
Hunt, A. J., & Black, A. W. (2002) · 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings · doi:10.1109/icassp.1996.541110 · Cited by 1,190
Speech parameter generation algorithms for HMM-based speech synthesis
Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., & Kitamura, T. (2002) · 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100) · doi:10.1109/icassp.2000.861820 · Cited by 999
Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter Trajectory
Toda, T., Black, A. W., & Tokuda, K. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.907344 · Cited by 937
Statistical parametric speech synthesis using deep neural networks
Zen, H., Senior, A., & Schuster, M. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639215 · Cited by 809
Self-citationSeide, F., Li, G., Chen, X., & Yu, D. (2011) · 2011 IEEE Workshop on Automatic Speech Recognition & Understanding · doi:10.1109/asru.2011.6163899 · Cited by 632
An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories
Williams, R. J., & Peng, J. (1990) · Neural Computation · doi:10.1162/neco.1990.2.4.490 · Cited by 577
TTS synthesis with bidirectional LSTM based recurrent neural networks
Fan, Y., Qian, Y., Xie, F.-L., & Soong, F. K. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-443 · Cited by 426
On rectified linear units for speech processing
Zeiler, M. D., Ranzato, M., Monga, R., Mao, M., Yang, K., Le, Q. V., Nguyen, P., Senior, A., Vanhoucke, V., Dean, J., et al. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638312 · Cited by 420
A Speech Parameter Generation Algorithm Considering Global Variance for HMM-Based Speech Synthesis
TODA, T., & TOKUDA, K. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-d.5.816 · Cited by 358
An adaptive algorithm for mel-cepstral analysis of speech
Fukada, T., Tokuda, K., Kobayashi, T., & Imai, S. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225953 · Cited by 328
An HMM-based speech synthesis system applied to English
(2002) · Proceedings of 2002 IEEE Workshop on Speech Synthesis 2002 WSS-02 · doi:10.1109/wss.2002.1224415 · Cited by 319
Statistical Parametric Speech Synthesis
Black, A. W., Zen, H., & Tokuda, K. (2007) · 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07 · doi:10.1109/icassp.2007.367298 · Cited by 272
Self-citationDetails of the Nitech HMM-Based Speech Synthesis System for the Blizzard Challenge 2005
ZEN, H., TODA, T., NAKAMURA, M., & TOKUDA, K. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-1.1.325 · Cited by 222
Self-citationOn the training aspects of Deep Neural Network (DNN) for parametric TTS synthesis
Qian, Y., Fan, Y., Hu, W., & Soong, F. K. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854318 · Cited by 216
Deep mixture density networks for acoustic modeling in statistical parametric speech synthesis
Zen, H., & Senior, A. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854321 · Cited by 187
Self-citationLiwicki, M., Graves, A., Horst Bunke, A., & Schmidhuber, J. (2007) · BORIS (University Library Bern) · Cited by 183
An empirical study of learning rates in deep neural networks for speech recognition
Senior, A., Heigold, G., Ranzato, M., & Yang, K. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638963 · Cited by 169
Static and Dynamic Error Propagation Networks with Application to Speech Coding
Robinson, A. J., & Fallside, F. (1987) · Cited by 79
Vocaine the vocoder and applications in speech synthesis
Agiomyrgiannakis, Y. (2015) · IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.2015.7178768 · Cited by 76
Fernandez, R., Rendel, A., Ramabhadran, B., & Hoory, R. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-445 · Cited by 76
Autoregressive Models for Statistical Parametric Speech Synthesis
Shannon, M., Zen, H., & Byrne, B. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2012.2227740 · Cited by 61
Self-citationLu, H., King, S., & Watts, O. (2013) · Cited by 56
Incorporating a mixed excitation model and postfilter into HMM-based text-to-speech synthesis
Yoshimura, T., Tokuda, K., Masuko, T., Kobayashi, T., & Kitamura, T. (2005) · Systems and Computers in Japan · doi:10.1002/scj.20354 · Cited by 50
On supervised learning from sequential data with applications for speech regognition
Schuster, M. (1999) · Institutional Repositories DataBase (IRDB) · doi:10.11501/3153839 · Cited by 37
Cited by
Recent Advances in Recurrent Neural Networks
Salehinejad, H., Sankar, S., Barfett, J., Colak, E., & Valaee, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01078 · Cited by 562
Investigating RNN-based speech enhancement methods for noise-robust Text-to-Speech
Valentini-Botinhao, C., Wang, X., Takaki, S., & Yamagishi, J. (2016) · 9th ISCA Workshop on Speech Synthesis Workshop (SSW 9) · doi:10.21437/ssw.2016-24 · Cited by 463
Deep Voice: Real-time Neural Text-to-Speech
Arık, S. Ö., Chrzanowski, M., Coates, A., Diamos, G., Gibiansky, A., Kang, Y., Li, X., Miller, J. J., Ng, A. Y., Raiman, J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07825 · Cited by 381
Wang, S., Wang, X., Wang, S., & Wang, D. (2019) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2019.02.022 · Cited by 356
HESS Opinions: Incubating deep-learning-powered hydrologic science advances as a community
Shen, C., Laloy, E., Elshorbagy, A., Albert, A., Bales, J., Chang, F.-J., Ganguly, S., Hsu, K.-L., Kifer, D., Fang, Z., et al. (2018) · Hydrology and Earth System Sciences · doi:10.5194/hess-22-5639-2018 · Cited by 335
Metadata
- Authors
- Zen, H., & Sak, H.
- Venue
- 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2015-04
- Pages
- 4470-4474
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W1576227399
- Cited by
- 262
- References
- 32
- FWCI
- 22.35
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.