The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Speech Synthesis Based on Hidden Markov Models
Open accessAbstract
This paper gives a general overview of hidden Markov model (HMM)-based speech synthesis, which has recently been demonstrated to be very effective in synthesizing speech. The main advantage of this approach is its flexibility in changing speaker identities, emotions, and speaking styles. This paper also discusses the relation between the HMM-based approach and the more conventional unit-selection approach that has dominated over the last decades. Finally, advanced techniques for future developments are described.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Fundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
Fant, G. (1971) · De Gruyter eBooks · doi:10.1515/9783110873429 · Cited by 2,945
Leggetter, C. J., & Woodland, P. C. (1995) · Computer Speech & Language · doi:10.1006/csla.1995.0010 · Cited by 2,192
Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains
Gauvain, J.-L., & Lee, C.-H. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.279278 · Cited by 2,108
Kawahara, H., Masuda-Katsuse, I., & de Cheveigné, A. (1999) · Speech Communication · doi:10.1016/s0167-6393(98)00085-5 · Cited by 1,831
(2003) · Cited by 1,680
Minimum prediction residual principle applied to speech recognition
Itakura, F. (1975) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1975.1162641 · Cited by 1,627
Software for a cascade/parallel formant synthesizer
Klatt, D. H. (1980) · The Journal of the Acoustical Society of America · doi:10.1121/1.383940 · Cited by 1,583
Maximum likelihood linear transformations for HMM-based speech recognition
Gales, M. J. F. (1998) · Computer Speech & Language · doi:10.1006/csla.1998.0043 · Cited by 1,482
Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones
Moulines, E., & Charpentier, F. (1990) · Speech Communication · doi:10.1016/0167-6393(90)90021-z · Cited by 1,244
Unit selection in a concatenative speech synthesis system using a large speech database
Hunt, A. J., & Black, A. W. (2002) · 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings · doi:10.1109/icassp.1996.541110 · Cited by 1,190
Speech parameter generation algorithms for HMM-based speech synthesis
Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., & Kitamura, T. (2002) · 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100) · doi:10.1109/icassp.2000.861820 · Cited by 999
Self-citationA robust parser for spoken language understanding
Wang, Y.-Y. (1999) · 6th European Conference on Speech Communication and Technology · doi:10.21437/eurospeech.1999-513 · Cited by 653
The Application of Hidden Markov Models in Speech Recognition
Gales, M., & Young, S. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981219 · Cited by 557
Taylor, P. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816338 · Cited by 529
Line spectrum representation of linear predictor coefficients of speech signals
Itakura, F. (1975) · The Journal of the Acoustical Society of America · doi:10.1121/1.1995189 · Cited by 524
The Application of Hidden Markov Models in Speech Recognition
Gales, M., & Young, S. (2007) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000004 · Cited by 496
Rapid speaker adaptation in eigenvoice space
Kuhn, R., Junqua, J.-C., Nguyen, P., & Niedzielski, N. (2000) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.876308 · Cited by 488
A compact model for speaker-adaptive training
Anastasakos, T., McDonough, J., Schwartz, R., & Makhoul, J. (2002) · Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96 · doi:10.1109/icslp.1996.607807 · Cited by 476
Analysis of voice fundamental frequency contours for declarative sentences of Japanese.
Fujisaki, H., & Hirose, K. (1984) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.5.233 · Cited by 440
Emotional speech synthesis: a review
Schröder, M. (2001) · 7th European Conference on Speech Communication and Technology (Eurospeech 2001) · doi:10.21437/eurospeech.2001-150 · Cited by 415
A Speech Parameter Generation Algorithm Considering Global Variance for HMM-Based Speech Synthesis
TODA, T., & TOKUDA, K. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-d.5.816 · Cited by 358
Self-citationAn adaptive algorithm for mel-cepstral analysis of speech
Fukada, T., Tokuda, K., Kobayashi, T., & Imai, S. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225953 · Cited by 328
Self-citationYamagishi, J., Kobayashi, T., Nakano, Y., Ogata, K., & Isogai, J. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2008.2006647 · Cited by 324
Self-citationAn HMM-based speech synthesis system applied to English
(2002) · Proceedings of 2002 IEEE Workshop on Speech Synthesis 2002 WSS-02 · doi:10.1109/wss.2002.1224415 · Cited by 319
MDL-based context-dependent subword modeling for speech recognition.
Shinoda, K., & Watanabe, T. (2000) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.21.79 · Cited by 244
Mel-generalized cepstral analysis - a unified approach to speech spectral estimation
Tokuda, K., Kobayashi, T., Masuko, T., & Imai, S. (1994) · 3rd International Conference on Spoken Language Processing (ICSLP 1994) · doi:10.21437/icslp.1994-275 · Cited by 237
Self-citationDetails of the Nitech HMM-Based Speech Synthesis System for the Blizzard Challenge 2005
ZEN, H., TODA, T., NAKAMURA, M., & TOKUDA, K. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-1.1.325 · Cited by 222
Self-citationA Hidden Semi-Markov Model-Based Speech Synthesis System
ZEN, H., TOKUDA, K., MASUKO, T., KOBAYASIH, T., & KITAMURA, T. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-d.5.825 · Cited by 209
Self-citationSchönle, P. W., Gräbe, K., Wenig, P., Höhne, J., Schrader, J., & Conrad, B. (1987) · Brain and Language · doi:10.1016/0093-934x(87)90058-7 · Cited by 203
HMM-Based Speech Synthesis Utilizing Glottal Inverse Filtering
Raitio, T., Suni, A., Yamagishi, J., Pulakka, H., Nurminen, J., Vainio, M., & Alku, P. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2045239 · Cited by 202
Self-citationKing, S., & Karaiskos, V. (2009) · The Blizzard Challenge 2009 · doi:10.21437/blizzard.2009-1 · Cited by 176
Beutnagel, M. C., Conkie, A. D., Schroeter, J., Stylianou, Y., & Syrdal, A. K. (1999) · The Journal of the Acoustical Society of America · doi:10.1121/1.424924 · Cited by 175
The blizzard challenge - 2005: evaluating corpus-based speech synthesis on common datasets
Black, A. W., & Tokuda, K. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-72 · Cited by 157
Self-citationMixed excitation for HMM-based speech synthesis
Yoshimura, T., Tokuda, K., Masuko, T., Kobayashi, T., & Kitamura, T. (2001) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2001-539 · Cited by 157
Self-citationZen, H., Tokuda, K., & Kitamura, T. (2006) · Computer Speech & Language · doi:10.1016/j.csl.2006.01.002 · Cited by 148
Self-citationSpeaker adaptation for continuous density HMMs: a review
Woodland, P. (2001) · Cambridge University Engineering Department Publications Database · Cited by 126
XIMERA : A new TTS from ATR based on corpus-based technologies
Kawai, H., Toda, T., Ni, J., Tsuzaki, M., & Tokuda, K. (2004) · Cited by 119
Self-citationCLUSTERGEN: a statistical parametric synthesizer using trajectory modeling
Black, A. W. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-488 · Cited by 115
Integrating Articulatory Features Into HMM-Based Parametric Speech Synthesis
Ling, Z.-H., Richmond, K., Yamagishi, J., & Wang, R.-H. (2009) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2009.2014796 · Cited by 106
Self-citationUSTC System for Blizzard Challenge 2006 an Improved HMM-based Speech Synthesis Method
Ling, Z.-H., Wu, Y.-J., Wang, Y., et al. (2006) · The Blizzard Challenge · doi:10.21437/blizzard.2006-6 · Cited by 105
Yamagishi, J., Veaux, C., King, S., & Renals, S. J. (2012) · Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi · doi:10.1250/ast.33.1 · Cited by 93
Self-citationStatistical Parametric Speech Synthesis Based on Speaker and Language Factorization
Zen, H., Braunschweiler, N., Buchholz, S., Gales, M., Knill, K. M., Krstulović, S., & Latorre, J. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2012.2187195 · Cited by 89
Self-citationVoice characteristics conversion for HMM-based speech synthesis system
Masuko, T., Tokuda, K., Kobayashi, T., et al. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1997.598807 · Cited by 79
Self-citationYamagishi, J., Usabaev, B., King, S., Watts, O., Dines, J., Tian, J., Guan, Y., Hu, R., Oura, K., Wu, Y.-J., et al. (2010) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2045237 · Cited by 78 · cited 1×
“Speaker-adaptive HMMbased synthesis requires as little as 5–7 min of recorded speech from a target speaker to generate a personalized synthetic voice [24]; hence, the average voice model can be easily transformed into a synthetic voice for any number of speakers [25].”
BackgroundSelf-citationThe IBM trainable speech synthesis system
Donovan, R. E., & Eide, E. M. (1998) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1998-10 · Cited by 78
An Excitation Model for HMM-Based Speech Synthesis Based on Residual Modeling
Maia, R., Toda, T., Zen, H., Nankaku, Y., & Tokuda, K. (2007) · Institutional Repositories DataBase (IRDB) · Cited by 73
Self-citationSpeaker interpolation for HMM-based speech synthesis system.
Yoshimura, T., Tokuda, K., Masuko, T., et al. (2000) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.21.199 · Cited by 67
Self-citationWhistler: a trainable text-to-speech system
Huang, X., Acero, A., Adcock, J. E., Hon, H.-W., Goldsmith, J., Liu, J., & Plumpe, M. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.1109/icslp.1996.607289 · Cited by 65
Multiple-regression hidden Markov model
Fujinaga, K., Nakai, M., Shimodaira, H., & Sagayama, S. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2001.940880 · Cited by 58
Automatic generation of synthesis units for trainable text-to-speech systems
Hon, H.-W., Acero, A., Huang, X., Liu, J., & Plumpe, M. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1998.674425 · Cited by 52
HMM-based Korean speech synthesis system for hand-held devices
Kim, S.-J., Kim, J.-J., & Hahn, M. (2006) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2006.273160 · Cited by 51
Product of Experts for Statistical Parametric Speech Synthesis
Zen, H., Gales, M., Nankaku, Y., & Tokuda, K. (2011) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2165280 · Cited by 50
Self-citationSegment selection in the L&h Realspeak laboratory TTS system.
Coorman, G., Fackrell, J., Rutten, P., & Coile, B. V. (2000) · Cited by 48
A style control technique for HMM-based speech synthesis
Masuko, T., Kobayashi, T., & 宮永, 圭. (2004) · Interspeech (USB) · doi:10.21437/interspeech.2004-551 · Cited by 43
Fraser, M., & King, S. (2007) · Cited by 41
HMM-based Finnish text-to-speech system utilizing glottal inverse filtering
Raitio, T., Suni, A., Pulakka, H., et al. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-189 · Cited by 39
Modeling and interpolation of Austrian German and Viennese dialect in HMM-based speech synthesis
Pucher, M., Schabus, D., Yamagishi, J., Neubarth, F., & Strom, V. (2009) · Speech Communication · doi:10.1016/j.specom.2009.09.004 · Cited by 39
Self-citationData-driven phrasing for speech synthesis in low-resource languages
Parlikar, A., & Black, A. W. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6288798 · Cited by 26
Hemptinne, C. (2006) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 22
Identification of contrast and its emphatic realization in HMM based speech synthesis
Badino, L., Andersson, J. S., Yamagishi, J., & Clark, R. A. J. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-190 · Cited by 22
Self-citationOura, K., Yamagishi, J., Wester, M., King, S., & Tokuda, K. (2012) · Speech Communication · doi:10.1016/j.specom.2011.12.004 · Cited by 17
Self-citationA dynamical system model for generating F0 for synthesis.
Ross, K. N., & Mari Ostendorf, E. (1994) · SSW · Cited by 16
Reactive Speech Synthesis: Actively Managing Phonetic Contrast along an H&H Continuum.
Moore, R. K., & Nicolao, M. (2011) · Cited by 15
Unifying unit selection and hidden Markov model speech synthesis
Taylor, P. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-487 · Cited by 13
A phonologically motivated method of selecting non-uniform units
Breen, A., & Jackson, P. E. (1998) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1998-48 · Cited by 13
A Data-Driven Affective Analysis Framework Toward Naturally Expressive Speech Synthesis
Bellegarda, J. R. (2010) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2010.2078808 · Cited by 12
Speech Synthesis, Perception and Comprehension of
Winters, S. J., & Pisoni, D. B. (2006) · Elsevier eBooks · doi:10.1016/b0-08-044854-2/00918-4 · Cited by 9
A style control technique for HMM-based speech synthesis
宮永, 圭., Masuko, T., & Kobayashi, T. (2006) · Tokyo Tech Research Repository (Tokyo Institute of Technology) · Cited by 7
Cited by
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
Neural Speech Synthesis with Transformer Network
Li, N., Liu, S., Liu, Y., Zhao, S., & Liu, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016706 · Cited by 754
A Recurrent Latent Variable Model for Sequential Data
Chung, J., Kastner, K., Dinh, L., Goel, K., Courville, A. C., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02216 · Cited by 635
Metadata
- Authors
- Tokuda, K., Nankaku, Y., Toda, T., Zen, H., Yamagishi, J., & Oura, K.
- Venue
- Proceedings of the IEEE
- Published
- 2013-05
- Volume
- 101
- Issue
- 5
- Pages
- 1234-1252
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2111284386
- Cited by
- 404
- References
- 71
- FWCI
- 44.54
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.