The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
A Unified Sequence-to-Sequence Front-End Model for Mandarin Text-to-Speech Synthesis
Abstract
In Mandarin text-to-speech (TTS) system, the front-end text processing module significantly influences the intelligibility and naturalness of synthesized speech. Building a typical pipeline-based front-end which consists of multiple individual components requires extensive efforts. In this paper, we proposed a unified sequence-to-sequence front-end model for Mandarin TTS that converts raw texts to linguistic features directly. Compared to the pipeline-based front-end, our unified front-end can achieve comparable performance in polyphone disambiguation and prosody word prediction, and improve intonation phrase prediction by 0.0738 in F1 score. We also implemented the unified front-end with Tacotron and WaveRNN to build a Mandarin TTS system. The synthesized speech by that got a comparable MOS (4.38) with the pipeline-based front-end (4.37) and close to human recordings (4.49).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
Self-citationTacotron: towards end-to-end speech synthesis
Wang, Y., Skerry-Ryan, R. J., Stanton, D., Wu, Y., Weiss, R. J., Jaitly, N., Yang, Z., Xiao, Y., Chen, Z., Bengio, S., et al. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1452 · Cited by 1,746
Self-citationEfficient Neural Audio SynthesisPreprint
Kalchbrenner, N., Elsen, E., Simonyan, K., Noury, S., Casagrande, N., Lockhart, E., Stimberg, F., van den Oord, A., Dieleman, S., & Kavukcuoglu, K. (2018) · International Conference on Machine Learning · doi:10.48550/arxiv.1802.08435 · Cited by 948
Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech SynthesisPreprint
Wang, Y., Stanton, D., Zhang, Y., Skerry-Ryan, R., Battenberg, E., Shor, J., Xiao, Y., Ren, F., Ye, J., & Saurous, R. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09017 · Cited by 628
Self-citationTowards End-to-End Prosody Transfer for Expressive Speech Synthesis with TacotronPreprint
Skerry-Ryan, R., Battenberg, E., Xiao, Y., Wang, Y., Stanton, D., Shor, J., Weiss, R. J., Clark, R., & Saurous, R. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09047 · Cited by 348
Self-citationImpact of Automatic Feature Extraction in Deep Learning Architecture
Shaheen, F., Verma, B., & Asafuddoula, M. (2016) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2016.7797053 · Cited by 160
A Compression-based Algorithm for Chinese Word Segmentation
Teahan, W. J., Wen, Y., McNab, R. J., & Witten, I. H. (2000) · Computational Linguistics · doi:10.1162/089120100561746 · Cited by 157
Effective Use of Variational Embedding Capacity in Expressive End-to-End Speech SynthesisPreprint
Battenberg, E., Mariooryad, S., Stanton, D., Skerry-Ryan, R., Shannon, M., Kao, D., & Bagby, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03402 · Cited by 42
Automatic prosody prediction and detection with Conditional Random Field (CRF) models
Qian, Y., Wu, Z., Ma, X., & Soong, F. K. (2010) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp.2010.5684835 · Cited by 37
Implementing Prosodic Phrasing in Chinese End-to-end Speech Synthesis
Lu, Y., Dong, M., & Chen, Y. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682368 · Cited by 34
An RNN-based algorithm to detect prosodic phrase for Chinese TTS
Ying, Z., & Shi, X. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2001.941038 · Cited by 27
A Mandarin Prosodic Boundary Prediction Model Based on Multi-Task Learning
Pan, H., Li, X., & Huang, Z. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1400 · Cited by 21
A Hybrid Text Normalization System Using Multi-Head Self-Attention For Mandarin
Zhang, J., Pan, J., Yin, X., Li, C., Liu, S., Zhang, Y., Wang, Y., & Ma, Z. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054695 · Cited by 20
Self-citationMao, X., Dong, Y., Han, J., Huang, D., & Wang, H. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367010 · Cited by 19
Disambiguating effectively Chinese polyphonic ambiguity based on unify approach
Huang, F.-L. (2008) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2008.4620965 · Cited by 16
Grapheme-to-phoneme conversion for Chinese text-to-speech
Xu, J., Fu, G., & Li, H. (2004) · Interspeech 2004 · doi:10.21437/interspeech.2004-466
Flagged first, then by citations
Research works printed but not linked: 1
- uszkoreit, 2017, Transformer: A novel neural network architecture for language understanding, Google Research Blog
Cited by
Sorted by citations
A survey on neural speech synthesis
Tan, X., Qin, T., Soong, F., & Liu, T.-Y. (2021) · arXiv · doi:10.48550/arxiv.2106.15561 · Cited by 216
Metadata
- Authors
- Pan, J., Yin, X., Zhang, Z., Liu, S., Zhang, Y., Ma, Z., & Wang, Y.
- Affiliations
- ByteDance (China) (CN)
- Shanghai Jiao Tong University (CN)
- Venue
- ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2020-05
- Pages
- 6689-6693
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W3015680182
- Semantic Scholar
- d4ebd29136a8e2d0ca98bb8945581e99559758ce
- Cited by
- 21
- References
- 20
- Citations by year
- 2025: 1 · 2024: 3 · 2023: 6 · 2022: 4 · 2021: 6 · 2020: 1
- FWCI
- 1.62
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- text processing, Tacotron, synthetic speech quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
