The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Neural Speech Synthesis with Transformer Network
Open accessAbstract
Although end-to-end neural text-to-speech (TTS) methods (such as Tacotron2) are proposed and achieve state-of-theart performance, they still suffer from two problems: 1) low efficiency during training and inference; 2) hard to model long dependency using current recurrent neural networks (RNNs). Inspired by the success of Transformer network in neural machine translation (NMT), in this paper, we introduce and adapt the multi-head attention mechanism to replace the RNN structures and also the original attention mechanism in Tacotron2. With the help of multi-head self-attention, the hidden states in the encoder and decoder are constructed in parallel, which improves training efficiency. Meanwhile, any two inputs at different times are connected directly by a self-attention mechanism, which solves the long range dependency problem effectively. Using phoneme sequences as input, our Transformer TTS network generates mel spectrograms, followed by a WaveNet vocoder to output the final audio results. Experiments are conducted to test the efficiency and performance of our new network. For the efficiency, our Transformer TTS network can speed up the training about 4.25 times faster compared with Tacotron2. For the performance, rigorous human tests show that our proposed model achieves state-of-the-art performance (outperforms Tacotron2 with a gap of 0.048) and is very close to human quality (4.39 vs 4.44 in MOS).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Med-BERT [184] is a contextualized embedding model pretrained on a structured electronic health record dataset of two million patients.”
From Multimodal learning with transformers: A survey (2023) · cites this paper as [184]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Error bounds for convolutional codes and an asymptotically optimum decoding algorithm
Viterbi, A. J. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1054010 · Cited by 6,954
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
Convolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850 · cited 1×
“Previous NMT models are dominated by RNN-based (Bahdanau, Cho, and Bengio 2014) or CNN-based (e.g. ConvS2S (Gehring et al. 2017), ByteNet (Kalchbrenner et al. 2016)) neural networks.”
Method
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–200 of 753
Audio representations for deep learning in sound synthesis: A review
Natsiou, A., & O’Leary, S. (2021) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa53542.2021.9686838 · Cited by 35
Evaluating Gesture Generation in a Large-scale Open Challenge: The GENEA Challenge 2022
Kucherenko, T., Wolfert, P., Yoon, Y., Viegas, C., Nikolov, T., Tsakov, M., & Henter, G. E. (2024) · ACM Transactions on Graphics · doi:10.1145/3656374 · Cited by 49
RobuTrans: A Robust Transformer-Based Text-to-Speech Model
Li, N., Liu, Y., Wu, Y., Liu, S., Zhao, S., & Liu, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6337 · Cited by 34
Self-citationPartila, P., Továrek, J., İlk, H. G., Rozhon, J., & Vozn̆ák, M. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900396 · Cited by 34
S-Vectors and TESA: Speaker Embeddings and a Speaker Authenticator Based on Transformer Encoder
Mary, N. J. M. S., Umesh, S., & Katta, S. V. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3134566 · Cited by 35
Text-conditioned Transformer for automatic pronunciation error detection
Zhang, Z., Wang, Y., & Yang, J. (2021) · Speech Communication · doi:10.1016/j.specom.2021.04.004 · Cited by 35
Liu, R., Şişman, B., Bao, F., Yang, J., Gao, G., & Li, H. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3040523 · Cited by 34
UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units
Inaguma, H., Popuri, S., Kulikov, I., Chen, P., Wang, C., Chung, Y.-A., Tang, Y., Lee, A., Watanabe, S., & Pino, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.872 · Cited by 43
Recent Developments on ESPnet Toolkit Boosted by ConformerPreprint
Guo, P., Boyer, F., Chang, X., Hayashi, T., Higuchi, Y., Inaguma, H., Kamo, N., Li, C., Garcia-Romero, D., Shi, J., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13956 · Cited by 33
The Sequence-to-Sequence Baseline for the Voice Conversion Challenge 2020: Cascading ASR and TTS
Huang, W.-C., Hayashi, T., Watanabe, S., & Toda, T. (2020) · doi:10.21437/vcc_bc.2020-24 · Cited by 32
Chen, Q., Tan, M., Qi, Y., Zhou, J., Li, Y., & Wu, Q. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02056 · Cited by 32
Cheng, G., Wang, X., Cooper, E., Wells, D., Wang, L., Dang, J., Richmond, K., & Yamagishi, J. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3451951 · Cited by 34
Cycle consistent network for end-to-end style transfer TTS training
Xue, L., Pan, S., He, L., Xie, L., & Soong, F. K. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.03.005 · Cited by 31
Effective Low-Cost Time-Domain Audio Separation Using Globally Attentive Locally Recurrent Networks
Lam, M. W. Y., Wang, J., Su, D., & Yu, D. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383464 · Cited by 33
KazakhTTS: An Open-Source Kazakh Text-to-Speech Synthesis Dataset
Mussakhojayeva, S., Janaliyeva, A., Mirzakhmetov, A., Khassanov, Y., & Varol, H. A. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-2124 · Cited by 29
Huang, W.-C., Wu, Y.-C., & Hayashi, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9415079 · Cited by 30
Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Features
Lux, F., & Vu, T. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.472 · Cited by 29
Deng, F., Chen, Z., Liu, Y., Yang, S., Hao, R., & Lyu, L. (2022) · Machines · doi:10.3390/machines10121226 · Cited by 32
Self-citationAvocodo: Generative Adversarial Network for Artifact-Free Vocoder
Bak, T., Lee, J., Bae, H., Yang, J., Bae, J.-S., & Joo, Y.-S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26479 · Cited by 29
Ji, Y., Luo, Y., Lu, A., Xia, D., Yang, L., & Liew, A. W. (2024) · Scientific Reports · doi:10.1038/s41598-024-72045-3 · Cited by 29
Rong, R., Ma, S., Ren, N., Lin, Q., & Jia, N. (2025) · Frontiers of Engineering Management · doi:10.1007/s42524-025-4241-9 · Cited by 39
Group Communication With Context Codec for Lightweight Source Separation
Luo, Y., Han, C., & Mesgarani, N. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3078640 · Cited by 30
SYNT++: Utilizing Imperfect Synthetic Data to Improve Speech Recognition
Hu, T.-Y., Armandpour, M., Shrivastava, A., Chang, J.-H. R., Koppula, H. S., & Tuzel, O. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746217 · Cited by 28
ESPnet2-TTS: Extending the Edge of TTS ResearchPreprint
Hayashi, T., Yamamoto, R., Yoshimura, T., Wu, P., Shi, J., Saeki, T., Ju, Y., Yasuda, Y., Takamichi, S., & Watanabe, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07840 · Cited by 35
Borjigin, A., Kokkinakis, K., Bharadwaj, H., & Stohl, J. S. (2024) · Scientific Reports · doi:10.1038/s41598-024-63675-8 · Cited by 28
Choi, Y., Jung, Y., & Kim, H. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383533 · Cited by 26
Graphspeech: Syntax-Aware Graph Attention Network for Neural Speech Synthesis
Liu, R., Şişman, B., & Li, H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413513 · Cited by 27
MVE-FLK: A multi-task legal judgment prediction via multi-view encoder fusing legal keywords
Yang, S., Tong, S., Zhu, G., Cao, J., Wang, Y., Xue, Z., Sun, H., & Wen, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107960 · Cited by 30
A Vector Quantized Approach for Text to Speech Synthesis on Real-World Spontaneous Speech
Chen, L., Watanabe, S., & Rudnicky, A. I. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26488 · Cited by 41
Deep MOS Predictor for Synthetic Speech Using Cluster-Based Modeling
Choi, Y., Jung, Y., & Kim, H. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2111 · Cited by 24
High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latency
Ellinas, N., Vamvoukakis, G., Μαρκόπουλος, Κ., Chalamandaris, A., Maniati, G., Kakoulidis, P., Raptis, S., Sung, J. S., Park, H.-M., & Tsiakoulis, P. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2464 · Cited by 26
Self-attention Mechanism at the Token Level: Gradient Analysis and Algorithm Optimization
Liu, L., & Xu, X. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110784 · Cited by 28
Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos
Su, K., Qian, K., Shlizerman, E., Torralba, A. B., & Gan, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00940 · Cited by 29
Speech Semantic Communication Based on Swin Transformer
Zhou, Z., Zheng, S., Chen, J., Zhao, Z., & Yang, X. (2023) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2023.3345858 · Cited by 26
Tacotron-Based Acoustic Model Using Phoneme Alignment for Practical Neural Text-to-Speech Systems
Okamoto, T., Toda, T., Shiga, Y., & Kawai, H. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003956 · Cited by 25
EditSpeech: A Text Based Speech Editing System Using Partial Inference and Bidirectional Fusion
Tan, D., Deng, L., Yeung, Y. T., Jiang, X., Chen, X. D., & Lee, T. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688051 · Cited by 25
Duration Controllable Voice Conversion via Phoneme-Based Information Bottleneck
Lee, S.-H., Noh, H.-R., Nam, W.-J., & Lee, S. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3156757 · Cited by 25
Memristor-Based Light-Weight Transformer Circuit Implementation for Speech Recognizing
Xiao, H., Zhou, Y., Gao, T., Duan, S., Chen, G., & Hu, X. (2023) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2023.3237582 · Cited by 25
Liu, R., Zhang, J., & Gao, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102257 · Cited by 26
Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language ModelsPreprint
Fang, W., Chung, Y.-A., & Glass, J. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.07307 · Cited by 27
VioLA: Conditional Language Models for Speech Recognition, Synthesis, and Translation
Wang, T., Zhou, L., Zhang, Z., Wu, Y., Liu, S., Gaur, Y., Chen, Z., Li, J., & Wei, F. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3434425 · Cited by 135
Self-citationBidirectional Variational Inference for Non-Autoregressive Text-to-Speech
Lee, Y., Shin, J., & Jung, K. (2021) · International Conference on Learning Representations · Cited by 24
GANSpeech: Adversarial Training for High-Fidelity Multi-Speaker Speech Synthesis
Yang, J., Bae, J.-S., Bak, T., Kim, Y.-I., & Cho, H. Y. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-971 · Cited by 27
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit
Zhang, H., Tian, Y., Chen, J., Li, X., Zheng, R., Huang, Y., Chen, X., Gong, E., Chen, Z., Hu, X., et al. (2022) · doi:10.18653/v1/2022.naacl-demo.12 · Cited by 24
An Emotion Speech Synthesis Method Based on VITS
Zhao, W., & Yang, Z. (2023) · Applied Sciences · doi:10.3390/app13042225 · Cited by 26
Tan, D., & Lee, T. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1129 · Cited by 24
Towards Universal Text-to-Speech
Yang, J., & He, L. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1590 · Cited by 23
WavThruVec: Latent speech representation as intermediate features for neural speech synthesis
Siuzdak, H., Dura, P., van Rijn, P., & Jacoby, N. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10797 · Cited by 23
Jain, R., Yiwere, M. Y., Bigioi, D., Corcoran, P., & Cucu, H. (2022) · IEEE Access · doi:10.1109/access.2022.3170836 · Cited by 26
Learning to Dub Movies via Hierarchical Prosody Models
Cong, G., Li, L., Qi, Y., Zha, Z.-J., Wu, Q., Wang, W., Jiang, B., Yang, M., & Huang, Q. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01411 · Cited by 23
Accented Text-to-Speech Synthesis With Limited Data
Zhou, X., Zhang, M., Zhou, Y., Wu, Z., & Li, H. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3363414 · Cited by 28
Yasuda, Y., Wang, X., & Yamagishi, J. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101183 · Cited by 23
Neural Architecture Search with GBDT.Preprint
Luo, R., Tan, X., Wang, R., Qin, T., Chen, E., & Liu, T. (2020) · arXiv (Cornell University) · Cited by 23
FMRFT: Fusion Mamba and DETR for Query Time Sequence Intersection Fish Tracking
Yao, M., Huo, Y., Tian, Q., Zhao, J., Liu, X., Wang, R.-F., Xue, L., & Wang, H. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110742 · Cited by 23
Li, X., Ma, D., & Yin, B. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105908 · Cited by 22
Daft-Exprt: Cross-Speaker Prosody Transfer on Any Text for Expressive Speech Synthesis
Zaïdi, J., Seuté, H., van Niekerk, B., & Carbonneau, M. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10761 · Cited by 22
Cover Reproducible Steganography via Deep Generative Models
Chen, K., Zhou, H., Wang, Y., Li, M., Zhang, W., & Yu, N. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3217569 · Cited by 22
Zhu, Y., Li, M., Ma, X., Wang, Y., Li, G., Zhang, Y., Liu, Y., & Hassanien, R. H. E. (2024) · Energy Conversion and Management · doi:10.1016/j.enconman.2024.118758 · Cited by 23
Self-citationVoice Conversion with Transformer Network
Liu, R., Chen, X., & Wen, X. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054523 · Cited by 22
Incremental Text-to-Speech Synthesis with Prefix-to-Prefix Framework
Ma, M., Zheng, B., Liu, K., Zheng, R., Liu, H., Peng, K., Church, K., & Huang, L. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.346 · Cited by 22
Learning pronunciation from a foreign language in speech synthesis networksPreprint
Lee, Y., Shon, S., & Kim, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09364 · Cited by 22
Review of end-to-end speech synthesis technology based on deep learningPreprint
Mu, Z., Yang, X., & Dong, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.09995 · Cited by 34
Planning the development of text-to-speech synthesis models and datasets with dynamic deep learning
Ahmad, H. A., & Rashid, T. A. (2024) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2024.102131 · Cited by 23
SpoofCeleb: Speech Deepfake Detection and SASV in the Wild
Jung, J.-W., Wu, Y., Wang, X., Kim, J.-H., Maiti, S., Matsunaga, Y., Shim, H.-J., Tian, J., Evans, N., Chung, J. S., et al. (2025) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2025.3529377 · Cited by 26
Machine learning applications in designing cementitious materials
Dang, S., Fang, H., & Yao, Y. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106125 · Cited by 23
Camp: A Two-Stage Approach to Modelling Prosody in Context
Hodari, Z., Moinet, A., Karlapati, S., Lorenzo-Trueba, J., Merritt, T., Joly, A., Abbas, A., Karanasou, P., & Drugman, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414413 · Cited by 22
Matsubara, K., Okamoto, T., Takashima, R., Takiguchi, T., Toda, T., Shiga, Y., & Kawai, H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414136 · Cited by 21
Predicting skeleton trajectories using a Skeleton-Transformer for video anomaly detection
Pang, W., He, Q., & Li, Y. (2022) · Multimedia Systems · doi:10.1007/s00530-022-00915-9 · Cited by 25
Yu, H., Yang, F., Huang, H. M., Yuan, S., Rangan, S., Rizzo, J., Wang, Y., & Fang, Y. (2024) · Journal of Imaging · doi:10.3390/jimaging10050103 · Cited by 21
Kurihara, K., Seiyama, N., & Kumano, T. (2021) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2020edp7104 · Cited by 21
DiscreTalk: Text-to-Speech as a Machine Translation ProblemPreprint
Hayashi, T., & Watanabe, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.05525 · Cited by 21
Eat: Enhanced ASR-TTS for Self-Supervised Speech Recognition
Baskar, M. K., Burget, L., Watanabe, S., Astudillo, R. F., & Černocký, J. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413375 · Cited by 20
Extracting and Predicting Word-Level Style Variations for Speech Synthesis
Zhang, Y., & Ling, Z.-H. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3074757 · Cited by 21
Translating Melody to Chord: Structured and Flexible Harmonization of Melody With Transformer
Rhyu, S., Choi, H., Kim, S., & Lee, K. (2022) · IEEE Access · doi:10.1109/access.2022.3155467 · Cited by 20
MIST-Tacotron: End-to-End Emotional Speech Synthesis Using Mel-Spectrogram Image Style Transfer
Moon, S., Kim, S., & Choi, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3156093 · Cited by 21
Controllable Accented Text-to-Speech Synthesis With Fine and Coarse-Grained Intensity Rendering
Liu, R., Şişman, B., Gao, G., & Li, H. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3378110 · Cited by 25
Zhang, J., Liu, L., Chen, Y., Hu, Y.-J., Jiang, Y., Ling, Z.-H., & Dai, L.-R. (2020) · doi:10.21437/vcc_bc.2020-16 · Cited by 20
Zhang, J., Richmond, K., Ling, Z.-H., & Dai, L.-R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17693 · Cited by 20
Deepfakes in digital media forensics: Generation, AI-based detection and challenges
Bendiab, G., Haiouni, H., Moulas, I., & Shiaeles, S. N. (2024) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2024.103935 · Cited by 24
Ai, Y., & Ling, Z.-H. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3277276 · Cited by 19
Lee, S.-H., Choi, H.-Y., Kim, S.-B., & Lee, S. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3584944 · Cited by 57
Incremental Text-to-Speech Synthesis Using Pseudo Lookahead With Large Pretrained Language Model
Saeki, T., Takamichi, S., & Saruwatari, H. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3073869 · Cited by 22
Speech Bert Embedding for Improving Prosody in Neural TTS
Chen, L., Deng, Y., Wang, X., Soong, F. K., & He, L. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413864 · Cited by 20
Transformer-Based Text-to-Speech with Weighted Forced Attention
Okamoto, T., Toda, T., Shiga, Y., & Kawai, H. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053915 · Cited by 19
STATNet: Spectral and Temporal features based Multi-Task Network for Audio Spoofing Detection
Ranjan, R., Vatsa, M., & Singh, R. (2022) · 2022 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb54206.2022.10007949 · Cited by 18
Where are We in Audio Deepfake Detection? A Systematic Analysis over Generative and Detection Models
Li, X., Chen, P., & Wei, W. (2025) · ACM Transactions on Internet Technology · doi:10.1145/3736765 · Cited by 24
Visualtts: TTS with Accurate Lip-Speech Synchronization for Automatic Voice Over
Lu, J., Şişman, B., Liu, R., Zhang, M., & Li, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746421 · Cited by 18
Data Augmentation for ASR Using TTS Via a Discrete Representation
Ueno, S., Mimura, M., Sakai, S., & Kawahara, T. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688218 · Cited by 18
Yamamoto, R., Song, E., Hwang, M.-J., & Kim, J.-M. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413369 · Cited by 18
Parallel Tacotron: Non-Autoregressive and Controllable TTSPreprint
Elias, I., Zen, H., Shen, J., Zhang, Y., Ye, J., Weiss, R. J., & Wu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11439 · Cited by 18
DiffSinger: Diffusion Acoustic Model for Singing Voice Synthesis.Preprint
Liu, J., Li, C., Ren, Y. C., Chen, F., Liu, P., & Zhao, Z. (2021) · arXiv (Cornell University) · Cited by 17
Acupuncture State Detection at Zusanli (ST-36) Based on Scalp EEG and Transformer
Rao, W., Xu, M., Wang, H., Hua, W., Guo, J., Zhang, Y., Zhu, H., Zhou, Z., Xiong, J., Zhang, J., et al. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3540924 · Cited by 17
Fu, C., Liu, C., Ishi, C. T., & Ishiguro, H. (2022) · Speech Communication · doi:10.1016/j.specom.2022.09.002 · Cited by 17
Automated Seizure Detection using Transformer Models on Multi-Channel EEGs
Zhu, Y.-D., & Wang, M. D. (2023) · 2023 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI) · doi:10.1109/bhi58575.2023.10313440 · Cited by 26
Min, J. H., Gao, Z., Wang, L., & Zhang, A. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3397344 · Cited by 17
Enhancing Hybrid Self-attention Structure with Relative-position-aware Bias for Speech Synthesis
Yang, S., Lu, H., Shi-ying, K., Xie, L., & Yu, D. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682861 · Cited by 18
Fast Query-by-example Speech Search using Attention-based Deep Binary Embeddings
Yuan, Y., Xie, L., Leung, C.-C., Chen, H., & Ma, B. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.2998277 · Cited by 17
Joint Intent Detection and Slot Filling Based on Continual Learning Model
Hui, Y., Wang, J., Cheng, N., Yu, F., Wu, T., & Xiao, J. Z. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413360 · Cited by 17
Cross-Modal Mutual Learning for Audio-Visual Speech Recognition and Manipulation
Yang, C.-C., Fan, W.-C., Yang, C.-F., & Wang, Y.-C. F. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20210 · Cited by 16
fairseq Sˆ2: A Scalable and Integrable Speech Synthesis Toolkit
Wang, C., Hsu, W.-N., Adi, Y., Polyak, A., Lee, A., Chen, P., Gu, J., & Pino, J. (2021) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2021.emnlp-demo.17 · Cited by 19
Metadata
- Authors
- Li, N., Liu, S., Liu, Y., Zhao, S., & Liu, M.
- Affiliations
- University of Electronic Science and Technology of China (CN)
- Microsoft Research Asia (China) (CN)
- Microsoft (United States) (US)
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2019-07-17
- Volume
- 33
- Issue
- 01
- Pages
- 6706-6713
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2903739847
- Cited by
- 754
- References
- 31
- Citations by year
- 2026: 28 · 2025: 88 · 2024: 103 · 2023: 131 · 2022: 138 · 2021: 165 · 2020: 89 · 2019: 11
- FWCI
- 38.55
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- www.aaai.org/ (unspecified)
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61572113)
- Fundamental Research Funds for the Central Universities (ZYGX2016J084, ZYGX2016J195, ZYGX2015J155, 61572113)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- neural text-to-speech, transformer models, multi-head self-attention, Tacotron2, long-range dependencies, mel-spectrogram generation, training efficiency, phoneme sequences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
