The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Neural Speech Synthesis with Transformer Network
Open accessAbstract
Although end-to-end neural text-to-speech (TTS) methods (such as Tacotron2) are proposed and achieve state-of-theart performance, they still suffer from two problems: 1) low efficiency during training and inference; 2) hard to model long dependency using current recurrent neural networks (RNNs). Inspired by the success of Transformer network in neural machine translation (NMT), in this paper, we introduce and adapt the multi-head attention mechanism to replace the RNN structures and also the original attention mechanism in Tacotron2. With the help of multi-head self-attention, the hidden states in the encoder and decoder are constructed in parallel, which improves training efficiency. Meanwhile, any two inputs at different times are connected directly by a self-attention mechanism, which solves the long range dependency problem effectively. Using phoneme sequences as input, our Transformer TTS network generates mel spectrograms, followed by a WaveNet vocoder to output the final audio results. Experiments are conducted to test the efficiency and performance of our new network. For the efficiency, our Transformer TTS network can speed up the training about 4.25 times faster compared with Tacotron2. For the performance, rigorous human tests show that our proposed model achieves state-of-the-art performance (outperforms Tacotron2 with a gap of 0.048) and is very close to human quality (4.39 vs 4.44 in MOS).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Med-BERT [184] is a contextualized embedding model pretrained on a structured electronic health record dataset of two million patients.”
From Multimodal learning with transformers: A survey (2023) · cites this paper as [184]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Error bounds for convolutional codes and an asymptotically optimum decoding algorithm
Viterbi, A. J. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1054010 · Cited by 6,954
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
Convolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850 · cited 1×
“Previous NMT models are dominated by RNN-based (Bahdanau, Cho, and Bengio 2014) or CNN-based (e.g. ConvS2S (Gehring et al. 2017), ByteNet (Kalchbrenner et al. 2016)) neural networks.”
Method
Cited by
Sorted by citations
Items 201–300 of 753
ParaTTS: Learning Linguistic and Prosodic Cross-Sentence Information in Paragraph-Based TTS
Xue, L., Soong, F. K., Zhang, S., & Xie, L. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3202126 · Cited by 16
MM-TTS: Multi-Modal Prompt Based Style Transfer for Expressive Text-to-Speech Synthesis
Guan, W., Li, Y., Li, T., Huang, H., Wang, F., Lin, J., Huang, L., Li, L., & Hong, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29769 · Cited by 21
DCST: Dual Cross-Supervision for Transformer-based Unsupervised Domain Adaptation
Cheng, Y., Yao, P., Xu, L., Chen, M., Liu, P., Shao, P., Shen, S., & Xu, R. X. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106749 · Cited by 17
LLM-mediated domain-specific voice agents: the case of TextileBot
Zhong, S., Gatti, E., Hardwick, J., Ribul, M., Cho, Y., & Obrist, M. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2456667 · Cited by 19
LVCNet: Efficient Condition-Dependent Modeling Network for Waveform Generation
Zeng, Z., Wang, J., Cheng, N., & Xiao, J. Z. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414710 · Cited by 20
Video Geo-Localization Employing Geo-Temporal Feature Learning and GPS Trajectory Smoothing
Regmi, K., & Shah, M. A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01191 · Cited by 18
Multi-Stream HiFi-GAN with Data-Driven Waveform Decomposition
Okamoto, T., Toda, T., & Kawai, H. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688194 · Cited by 16
LRSpeech: Extremely Low-Resource Speech Synthesis and RecognitionPreprint
Xu, J., Tan, X., Ren, Y., Qin, T., Li, J., Zhao, S., & Liu, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.03687 · Cited by 16
Self-citationFluentNet: End-to-End Detection of Speech Disfluency with Deep LearningPreprint
Kourkounakis, T., Hajavi, A., & Etemad, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.11394 · Cited by 16
VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual AttentionPreprint
Liu, P., Cao, Y., Liu, S., Hu, N., Li, G., Weng, C., & Su, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06431 · Cited by 16
Self-citationHierarchical Diffusion Models for Singing Voice Neural Vocoder
Takahashi, N., Kumar, M., Singh, & Mitsufuji, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095749 · Cited by 17
Audio Anti-Spoofing Based on Audio Feature Fusion
Zhang, J., Tu, G., Liu, S., & Cai, Z. (2023) · Algorithms · doi:10.3390/a16070317 · Cited by 19
Self-citationGokulkannan, K., Mohanaprakash, T. A., DafniRose, J., & Sriman, B. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105847 · Cited by 15
A Residual U-Net Neural Network for Seismocardiogram Denoising and Analysis During Physical Activity
Nikbakht, M. R., Chan, M., Lin, D. J., Gazi, A. H., & Inan, O. T. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3392532 · Cited by 15
Wu, J., Polyak, A., Taigman, Y., Fong, J., Agrawal, P., & He, Q. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746282 · Cited by 15
Gaussian Lpcnet for Multisample Speech Synthesis
Popov, V., Kudinov, M., & Sadekova, T. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053337 · Cited by 15
FastTalker: A neural text-to-speech architecture with shallow and group autoregression
Liu, R., Şişman, B., Lin, Y.-X., & Li, H. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.04.016 · Cited by 15
Multilingual Byte2Speech Models for Scalable Low-resource Speech SynthesisPreprint
He, M., Yang, J., He, L., & Soong, F. K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03541 · Cited by 24
AraSpell: A Deep Learning Approach for Arabic Spelling CorrectionPreprint
Salhab, M., & Abu-Khzam, F. N. (2023) · Research Square · doi:10.21203/rs.3.rs-2974359/v1 · Cited by 18
Prosodic Representation Learning and Contextual Sampling for Neural Text-to-Speech
Karlapati, S., Abbas, A., Hodari, Z., Moinet, A., Joly, A., Karanasou, P., & Drugman, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413696 · Cited by 15
CampNet: Context-Aware Mask Prediction for End-to-End Text-Based Speech Editing
Wang, T., Yi, J., Fu, R., Tao, J., & Wen, Z. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3190717 · Cited by 14
A deep learning algorithm for joint direct tracking and classification of manoeuvring sources
Yu, W., Yu, H., Du, J., Zhang, M., & Wang, D. (2022) · IET Radar Sonar & Navigation · doi:10.1049/rsn2.12254 · Cited by 14
LightGrad: Lightweight Diffusion Probabilistic Model for Text-to-Speech
Chen, J., Song, X., Peng, Z., Zhang, B., Pan, F., & Wu, Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096710 · Cited by 17
Saeki, T., Maiti, S., Li, X., Watanabe, S., Takamichi, S., & Saruwatari, H. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/575 · Cited by 20
DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Dataset
Du, J., Lin, I.-M., Chiu, I.-H., Chen, X., Wu, H., Ren, W., Tsao, Y., Lee, H.-Y., & Jang, J. R. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832250 · Cited by 16
Oh, H.-S., Lee, S.-H., Cho, D., & Lee, S. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3530920 · Cited by 17
EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech Via Emotion-Adaptive Spherical Vector
Cho, D., Oh, H.-S., Kim, S.-B., & Lee, S. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3561267 · Cited by 14
Security and Privacy Challenges of AIGC in Metaverse: A Comprehensive Survey
Zhang, S., Li, H., Sun, K., Chen, H., Wang, Y., & Li, S. (2025) · ACM Computing Surveys · doi:10.1145/3729419 · Cited by 17
Yang, S., Wang, Y., & Xie, L. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3025410 · Cited by 14
MixGAN-TTS: Efficient and Stable Speech Synthesis Based on Diffusion Model
Deng, Y., Wu, N., Qiu, C., Luo, Y., & Chen, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3283772 · Cited by 14
Improved Parallel Wavegan Vocoder with Perceptually Weighted Spectrogram Loss
Song, E., Yamamoto, R., Hwang, M.-J., Kim, J., Kwon, O., & Kim, J.-M. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383549 · Cited by 14
Edge-augmented Graph Transformers: Global Self-attention is Enough for Graphs.Preprint
Hussain, M. S., Zaki, M. J., & Subramanian, D. (2021) · arXiv (Cornell University) · Cited by 14
Okamoto, T., Ohtani, Y., Toda, T., & Kawai, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446890 · Cited by 14
Qiang, C., Li, H., Ni, H., Qu, H., Fu, R., Wang, T., Wang, L., & Dang, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446203 · Cited by 16
Yang, H., Chang, J., He, W., Wee, C. F., Soong, J. T. Y., & Feng, M. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3430226 · Cited by 14
Vocbench: A Neural Vocoder Benchmark for Speech Synthesis
AlBadawy, E. A., Gibiansky, A., He, Q., Wu, J., Chang, M., & Lyu, S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746698 · Cited by 15
Kim, J., Wang, J., Kim, S., & Lee, Y. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1233 · Cited by 13
TalkNet: Fully-Convolutional Non-Autoregressive Speech Synthesis ModelPreprint
Beliaev, S., Rebryk, Y., & Ginsburg, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.05514 · Cited by 13
Graphspeech: Syntax-Aware Graph Attention Network for Neural Speech SynthesisPreprint
Liu, R., Şişman, B., & Li, H.-Z. (2020) · IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.48550/arxiv.2010.12423 · Cited by 28
E3 TTS: Easy End-to-End Diffusion-Based Text To Speech
Gao, Y., Morioka, N., Zhang, Y., & Chen, N. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389766 · Cited by 18
Text-Inductive Graphone-Based Language Adaptation for Low-Resource Speech Synthesis
Saeki, T., Maiti, S., Li, X., Watanabe, S., Takamichi, S., & Saruwatari, H. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3369537 · Cited by 12
SR-TTS: a rhyme-based end-to-end speech synthesis system
Yao, Y., Tao, L., Feng, R., Shi, K., Yu, J., Wang, W., & Li, J. (2024) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2024.1322312 · Cited by 13
Optimizing the Structures of Transformer Neural Networks Using Parallel Simulated Annealing
Trzciński, M., Łukasik, S., & Gandomi, A. H. (2024) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2024-0015 · Cited by 12
FlashSpeech: Efficient Zero-Shot Speech Synthesis
Ye, Z., Ju, Z., Liu, H., Tan, X., Chen, J., Lu, Y., Sun, P., Pan, J., Bian, W., He, S., et al. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681044 · Cited by 14
Neural HMMS Are All You Need (For High-Quality Attention-Free TTS)
Mehta, S., Székely, É., Beskow, J., & Henter, G. E. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746686 · Cited by 12
On Prosody Modeling for ASR+TTS Based Voice Conversion
Huang, W.-C., Hayashi, T., Li, X., Watanabe, S., & Toda, T. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688010 · Cited by 12
Learning to Maximize Speech Quality Directly Using MOS Prediction for Neural Text-to-Speech
Choi, Y., Jung, Y., Suh, Y.-J., & Kim, H. (2022) · IEEE Access · doi:10.1109/access.2022.3175810 · Cited by 11
MSMC-TTS: Multi-Stage Multi-Codebook VQ-VAE Based Neural TTS
Guo, H., Xie, F., Wu, X., Soong, F. K., & Meng, H. M. L. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3272470 · Cited by 12
Modularity in Deep Learning: A Survey
Sun, H., & Guyon, I. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-37963-5_40 · Cited by 15
End-to-End Text-to-Speech Using Latent Duration Based on VQ-VAE
Yasuda, Y., Wang, X., & Yamagishd, J. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414499 · Cited by 12
Novitasari, S., Sakti, S., & Nakamura, S. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3196879 · Cited by 12
Federated Learning with Dynamic Transformer for Text to Speech
Hong, Z., Wang, J., Qu, X., Liu, J., Zhao, C., & Xiao, J. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-2039 · Cited by 11
“Model Architecture: The transformer model is following [9].”
BackgroundMethodInfluentialSimple and Effective Unsupervised Speech Synthesis
Liu, A. H., Lai, C.-I., Hsu, W.-N., Auli, M., Baevski, A., & Glass, J. R. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11071 · Cited by 11
Transduce and Speak: Neural Transducer for Text-To-Speech with Semantic Token Prediction
Kim, M., Jeong, M., Choi, B. J., Lee, D., & Kim, N. S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389791 · Cited by 11
Transformers in speech processing: Overcoming challenges and paving the future
Latif, S., Zaidi, S. A. M., Cuayáhuitl, H., Shamshad, F., Shoukat, M., Usama, M., & Qadir, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100768 · Cited by 116
Prosody Learning Mechanism for Speech Synthesis System Without Text Length Limit
Zeng, Z., Wang, J., Cheng, N., & Xiao, J. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2053 · Cited by 11
Reinforce-Aligner: Reinforcement Alignment Search for Robust End-to-End Text-to-Speech
Chung, H., Lee, S., & Lee, S. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-831 · Cited by 11
Data Augmentation Methods for End-to-End Speech Recognition on Distant-Talk Scenarios
Tsunoo, E., Shibata, K., Narisetty, C. P., Kashiwagi, Y., & Watanabe, S. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-958 · Cited by 11
TEXT-TO-SPEECH SYNTHESIS FROM DARK DATA WITH EVALUATION-IN-THE-LOOP DATA SELECTION
Seki, K., Takamichi, S., Saeki, T., & Saruwatari, H. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095161 · Cited by 13
MASS: Multi-task anthropomorphic speech synthesis framework
Chen, J., Ye, L., & Ming, Z. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2021.101243 · Cited by 11
Simple and Effective Unsupervised Speech Translation
Wang, C., Inaguma, H., Chen, P., Kulikov, I., Tang, Y., Hsu, W.-N., Auli, M., & Pino, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.602 · Cited by 19
Transformer-XL Based Music Generation with Multiple Sequences of Time-valued NotesPreprint
Wu, X., Wang, C., & Lei, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07244 · Cited by 21
Stripe-Transformer: deep stripe feature learning for music source separation
Qian, J., Liu, X., Yu, Y., & Li, W. (2023) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-022-00268-1 · Cited by 12
An Overview Study of Deep Learning in Geophysics: Cross-Cutting Research to Advance Geoscience
Wenxue, Z., Shikun, D., Hongjun, T., Dexiang, Z., Ying, Z., & Jiang, F. (2025) · IEEE Access · doi:10.1109/access.2025.3586693 · Cited by 12
WG-WaveNet: Real-Time High-Fidelity Speech Synthesis Without GPU
Hsu, P.-C., & Lee, H.-Y. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1736 · Cited by 10
Reformer-TTS: Neural Speech Synthesis with Reformer Network
Ihm, H. R., Lee, J. Y., Choi, B. J., Cheon, S. J., & Kim, N. S. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2189 · Cited by 10
Fcl-Taco2: Towards Fast, Controllable and Lightweight Text-to-Speech Synthesis
Wang, D., Deng, L., Zhang, Y., Zheng, N., Yeung, Y. T., Chen, X. D., Liu, X., & Meng, H. M. L. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414870 · Cited by 11
Silent Speech Interface With Vocal Speaker Assistance Based on Convolution-Augmented Transformer
Li, H., Liang, Y., Gao, H., Liu, L., Wang, Y., Chen, D., Luo, Z., & Li, G. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3273660 · Cited by 11
SC-CNN: Effective Speaker Conditioning Method for Zero-Shot Multi-Speaker Text-to-Speech Systems
Yoon, H., Kim, C., Um, S., Yoon, H.-W., & Kang, H.-G. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3277786 · Cited by 11
Qu, X., Liu, H., Sun, Z., Yin, X., Ong, Y.-S., Lu, L., & Ma, Z. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591876 · Cited by 11
Uncovering the Deceptions: An Analysis on Audio Spoofing Detection and Future Prospects
Ranjan, R., Mayank Vatsa, A., & Singh, R. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/756 · Cited by 11
Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion
Ye, Z., Mao, T., Dong, L., & Yan, D. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-733 · Cited by 19
TalkNet: Non-Autoregressive Depth-Wise Separable Convolutional Model for Speech Synthesis
Beliaev, S., & Ginsburg, B. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1770 · Cited by 10
Fine-Grained Prosody Modeling in Neural Speech Synthesis Using ToBI Representation
Zou, Y., Liu, S., Yin, X., Lin, H., Wang, C., Zhang, H., & Ma, Z. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-883 · Cited by 10
Self-citationPhone-Informed Refinement of Synthesized Mel Spectrogram for Data Augmentation in Speech Recognition
Ueno, S., & Kawahara, T. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746582 · Cited by 10
Synthetic seismocardiogram generation using a transformer-based neural network
Nikbakht, M. R., Gazi, A. H., Zia, J. S., An, S., Lin, D. J., Inan, O. T., & Kamaleswaran, R. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad067 · Cited by 10
Multilevel Transformer for Multimodal Emotion Recognition
He, J., Wu, M., Li, M., Zhu, X., & Ye, F. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097110 · Cited by 11
NatiQ: An End-to-end Text-to-Speech System for Arabic
Abdelalí, A., Durrani, N., Demiroğlu, C., Dalvi, F., Mubarak, H., & Darwish, K. M. (2022) · Arabic Natural Language Processing Workshop (WANLP) · doi:10.18653/v1/2022.wanlp-1.38 · Cited by 10
J, M. S. M. N., Katta, S. V., & Umesh, S. (2020) · arXiv (Cornell University) · Cited by 10
Attention is All You Need in Speech SeparationPreprint
Subakan, C., Ravanelli, M., Cornell, S., Bronzi, M., & Zhong, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13154 · Cited by 10
Reflow-TTS: A Rectified Flow Model for High-Fidelity Text-to-Speech
Guan, W., Su, Q., Zhou, H., Miao, S., Xie, X., Li, L., & Hong, Q. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447822 · Cited by 13
HybridFlow: Infusing Continuity into Masked Codebook for Extreme Low-Bitrate Image Compression
Lü, L., Xie, Y., Jiang, W., Wang, W., Lin, X., & Wang, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681008 · Cited by 9
Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS
Deng, Y., Zhao, R., Meng, Z., Chen, X., Liu, B., Li, J., Gong, Y., & He, L. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1017 · Cited by 9
NIOT: A Novel Inference Optimization of Transformers on Modern CPUs
Zhang, Z., Chen, Y., He, B., & Zhang, Z. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3269530 · Cited by 11
Qiang, C., Yang, P., Che, H., Zhang, Y., Wang, X., & Wang, Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095840 · Cited by 9
Structured State Space Decoder for Speech Recognition and Synthesis
Miyazaki, K., Murata, M., & Koriyama, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096135 · Cited by 9
Temporal Shift Module with Pretrained Representations for Speech Emotion Recognition
Shen, S., Liu, F., Wang, H., Wang, Y., & Zhou, A. (2024) · Intelligent Computing · doi:10.34133/icomputing.0073 · Cited by 10
Chen, X., Wang, X., Zhang, S., He, L., Wu, Z., Wu, X., & Meng, H. M. L. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446352 · Cited by 12
Deep Gaussian process based multi-speaker speech synthesis with latent speaker representation
Mitsui, K., Koriyama, T., & Saruwatari, H. (2021) · Speech Communication · doi:10.1016/j.specom.2021.07.001 · Cited by 9
SVSNet: An End-to-End Speaker Voice Similarity Assessment Model
Hu, C.-H., Peng, Y., Yamagishi, J., Tsao, Y., & Wang, H. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3152672 · Cited by 9
Text-to-Speech Synthesis Techniques for MIDI-to-Audio Synthesis
Cooper, E., Wang, X., & Yamagishi, J. (2021) · ISCA Speech Synthesis Workshop (SSW) · doi:10.21437/ssw.2021-23 · Cited by 9
VAENAR-TTS: Variational Auto-Encoder Based Non-AutoRegressive Text-to-Speech Synthesis
Lu, H., Wu, Z., Wu, X., Li, X., Kang, S., Liu, X., & Meng, H. M. L. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-2121 · Cited by 9
Transformer-Based Acoustic Modeling for Streaming Speech Synthesis
Wu, C., Xiu, Z., Shi, Y., Kalinli, O., Fuegen, C., Koehler, T., & He, Q. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1655 · Cited by 10
Violeta, L. P., Ma, D., Huang, W.-C., & Toda, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095931 · Cited by 9
Modeling of Rakugo Speech and Its Limitations: Toward Speech Synthesis That Entertains Audiences
Kato, S., Yasuda, Y., Wang, X., Cooper, E., Takaki, S., & Yamagishi, J. (2020) · IEEE Access · doi:10.1109/access.2020.3011975 · Cited by 10
Effective Low-Cost Time-Domain Audio Separation Using Globally Attentive Locally Recurrent NetworksPreprint
Lam, M. W. Y., Wang, J., Su, D., & Yu, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05014 · Cited by 9
ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer
Liu, H., Huang, R., Lin, X., Xu, W., Zheng, M., Chen, H., He, J., & Zhao, Z. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.990 · Cited by 35
Kurdish end-to-end speech synthesis using deep neural networks
Muhamad, S. S., Veisi, H., Mahmudi, A., Abdullah, A. A., & Rahimi, F. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100096 · Cited by 8
Joint Speech-Text Embeddings for Multitask Speech Processing
Gonzales, M. G., Corcoran, P., Harte, N., & Schukat, M. (2024) · IEEE Access · doi:10.1109/access.2024.3473743 · Cited by 17
From One Stolen Utterance: Assessing the Risks of Voice Cloning in the AIGC Era
Wang, K., Chen, M., Lü, L., Feng, J., Chen, Q., Ba, Z., Ren, K., & Chen, C. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00238 · Cited by 8
Metadata
- Authors
- Li, N., Liu, S., Liu, Y., Zhao, S., & Liu, M.
- Affiliations
- University of Electronic Science and Technology of China (CN)
- Microsoft Research Asia (China) (CN)
- Microsoft (United States) (US)
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2019-07-17
- Volume
- 33
- Issue
- 01
- Pages
- 6706-6713
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2903739847
- Cited by
- 754
- References
- 31
- Citations by year
- 2026: 28 · 2025: 88 · 2024: 103 · 2023: 131 · 2022: 138 · 2021: 165 · 2020: 89 · 2019: 11
- FWCI
- 38.55
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- www.aaai.org/ (unspecified)
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61572113)
- Fundamental Research Funds for the Central Universities (ZYGX2016J084, ZYGX2016J195, ZYGX2015J155, 61572113)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- neural text-to-speech, transformer models, multi-head self-attention, Tacotron2, long-range dependencies, mel-spectrogram generation, training efficiency, phoneme sequences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
