The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Analysis of Speaker Adaptation Algorithms for HMM-Based Speech Synthesis and a Constrained SMAPLR Adaptation Algorithm
Open accessAbstract
In this paper, we analyze the effects of several factors and configuration choices encountered during training and model construction when we want to obtain better and more stable adaptation in HMM-based speech synthesis. We then propose a new adaptation algorithm called constrained structural maximumaposteriorilinear regression (CSMAPLR) whose derivation is based on the knowledge obtained in this analysis and on the results of comparing several conventional adaptation algorithms. Here, we investigate six major aspects of the speaker adaptation: initial models; the amount of the training data for the initial models; the transform functions, estimation criteria, and sensitivity of several linear regression adaptation algorithms; and combination algorithms. Analyzing the effect of the initial model, we compare speaker-dependent models, gender-independent models, and the simultaneous use of the gender-dependent models to single use of the gender-dependent models. Analyzing the effect of the transform functions, we compare the transform function for only mean vectors with that for mean vectors and covariance matrices. Analyzing the effect of the estimation criteria, we compare the ML criterion with a robust estimation criterion called structural MAP. We evaluate the sensitivity of several thresholds for the piecewise linear regression algorithms and take up methods combining MAP adaptation with the linear regression algorithms. We incorporate these adaptation algorithms into our speech synthesis system and present several subjective and objective evaluation results showing the utility and effectiveness of these algorithms in speaker adaptation for HMM-based speech synthesis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Leggetter, C. J., & Woodland, P. C. (1995) · Computer Speech & Language · doi:10.1006/csla.1995.0010 · Cited by 2,192
Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains
Gauvain, J.-L., & Lee, C.-H. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.279278 · Cited by 2,108
Maximum likelihood linear transformations for HMM-based speech recognition
Gales, M. J. F. (1998) · Computer Speech & Language · doi:10.1006/csla.1998.0043 · Cited by 1,482
Unit selection in a concatenative speech synthesis system using a large speech database
Hunt, A. J., & Black, A. W. (2002) · 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings · doi:10.1109/icassp.1996.541110 · Cited by 1,190
Speech parameter generation algorithms for HMM-based speech synthesis
Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., & Kitamura, T. (2002) · 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100) · doi:10.1109/icassp.2000.861820 · Cited by 999
Self-citationA robust parser for spoken language understanding
Wang, Y.-Y. (1999) · 6th European Conference on Speech Communication and Technology · doi:10.21437/eurospeech.1999-513 · Cited by 653
Semi-tied covariance matrices for hidden Markov models
Gales, M. J. F. (1999) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.759034 · Cited by 537
A compact model for speaker-adaptive training
Anastasakos, T., McDonough, J., Schwartz, R., & Makhoul, J. (2002) · Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96 · doi:10.1109/icslp.1996.607807 · Cited by 476
Continuously variable duration hidden Markov models for automatic speech recognition
Levinson, S. E. (1986) · Computer Speech & Language · doi:10.1016/s0885-2308(86)80009-2 · Cited by 457
Mean and variance adaptation within the MLLR framework
Gales, M. J. F., & Woodland, P. C. (1996) · Computer Speech & Language · doi:10.1006/csla.1996.0013 · Cited by 393
Speaker adaptation using constrained estimation of Gaussian mixtures
Digalakis, V. V., Rtischev, D., & Neumeyer, L. G. (1995) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.466659 · Cited by 377
A Speech Parameter Generation Algorithm Considering Global Variance for HMM-Based Speech Synthesis
TODA, T., & TOKUDA, K. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-d.5.816 · Cited by 358
The HMM-based speech synthesis system (HTS) version 2.0.
Zen, H., Nose, T., Yamagishi, J., Sako, S., Masuko, T., Black, A. W., & Tokuda, K. (2007) · SSW · Cited by 343
Self-citationAn adaptive algorithm for mel-cepstral analysis of speech
Fukada, T., Tokuda, K., Kobayashi, T., & Imai, S. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225953 · Cited by 328
Self-citationMaximum likelihood modeling with Gaussian distributions for classification
Gopinath, R. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1998.675351 · Cited by 267
MDL-based context-dependent subword modeling for speech recognition.
Shinoda, K., & Watanabe, T. (2000) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.21.79 · Cited by 244
Cepstral analysis synthesis on the mel frequency scale
Imai, S. (2005) · ICASSP '83. IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1983.1172250 · Cited by 239
A Hidden Semi-Markov Model-Based Speech Synthesis System
ZEN, H., TOKUDA, K., MASUKO, T., KOBAYASIH, T., & KITAMURA, T. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-d.5.825 · Cited by 209
Explicit modelling of state occupancy in hidden Markov models for automatic speech recognition
Russell, M., & Moore, R. (1985) · ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1985.1168477 · Cited by 194
Optimising selection of units from speech databases for concatenative synthesis
Black, A. W., & Campbell, N. (1995) · 4th European Conference on Speech Communication and Technology (Eurospeech 1995) · doi:10.21437/eurospeech.1995-148 · Cited by 175
Average-Voice-Based Speech Synthesis Using HSMM-Based Speaker Adaptation and Adaptive Training
YAMAGISHI, J., & KOBAYASHI, T. (2007) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e90-d.2.533 · Cited by 170
Self-citationSignal bias removal by maximum likelihood estimation for robust telephone speech recognition
Juang, B.-H., & Rahim, M. G. (1996) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.1996.481449 · Cited by 170
Simultaneous Modeling Of Spectrum, Pitch And Duration In HMM-Based Speech Synthesis
Yoshimura, T., Tokuda, K., Kobayashi, T., Masuko, T., & Kitamura, T. (1999) · Cited by 166
Self-citationA structural Bayes approach to speaker adaptation
Shinoda, K., & Lee, C.-H. (2001) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.906001 · Cited by 155
Speech synthesis using HMMs with dynamic features
Masuko, T., Tokuda, K., Kobayashi, T., & Imai, S. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1996.541114 · Cited by 129
Self-citationStructural maximum a posteriori linear regression for fast HMM adaptation
Siohan, O., Myrvoll, T. A., & Lee, C. (2002) · Computer Speech & Language · doi:10.1006/csla.2001.0181 · Cited by 105
Speaker adaptation using combined transformation and Bayesian methods
Digalakis, V., & Neumeyer, L. (1996) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.506933 · Cited by 102
Voice characteristics conversion for HMM-based speech synthesis system
Masuko, T., Tokuda, K., Kobayashi, T., et al. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1997.598807 · Cited by 79
Self-citationA hidden Markov-model-based trainable speech synthesizer
Donovan, R. E., & Woodland, P. C. (1999) · Computer Speech & Language · doi:10.1006/csla.1999.0123 · Cited by 61
Model Adaptation Approach to Speech Synthesis with Diverse Voices and Styles
Yamagishi, J., Kobayashi, T., Tachibana, M., Ogata, K., & Nakano, Y. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367299 · Cited by 40
Self-citationHSMM-Based Model Adaptation Algorithms for Average-Voice-Based Speech Synthesis
Yamagishi, J., Ogata, K., Nakano, Y., Isogai, J., & Kobayashi, T. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2006.1659961 · Cited by 31
Self-citationMultiple-cluster adaptive training schemes
Gales, M. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2001.940842 · Cited by 26
Takahashi, J., & Sagayama, S. (1997) · Computer Speech & Language · doi:10.1006/csla.1996.0025 · Cited by 23
Cited by
Statistical parametric speech synthesis
Zen, H., Tokuda, K., & Black, A. W. (2009) · Speech Communication · doi:10.1016/j.specom.2009.04.004 · Cited by 1,195
Spoofing and countermeasures for speaker verification: A survey
Wu, Z., Evans, N., Kinnunen, T., Yamagishi, J., Alegre, F., & Li, H. (2015) · Speech Communication · doi:10.1016/j.specom.2014.10.005 · Cited by 601
Self-citationASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484
Self-citationInvestigating RNN-based speech enhancement methods for noise-robust Text-to-Speech
Valentini-Botinhao, C., Wang, X., Takaki, S., & Yamagishi, J. (2016) · 9th ISCA Workshop on Speech Synthesis Workshop (SSW 9) · doi:10.21437/ssw.2016-24 · Cited by 463
Self-citationSpeech Synthesis Based on Hidden Markov Models
Tokuda, K., Nankaku, Y., Toda, T., Zen, H., Yamagishi, J., & Oura, K. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2013.2251852 · Cited by 404
Self-citation
Metadata
- Authors
- Yamagishi, J., Kobayashi, T., Nakano, Y., Ogata, K., & Isogai, J.
- Venue
- IEEE Transactions on Audio, Speech, and Language Processing
- Published
- 2009-01
- Volume
- 17
- Issue
- 1
- Pages
- 66-83
- ISSN
- 1558-7916 (ISSN-L)
- OpenAlex
- W2153914468
- Cited by
- 324
- References
- 34
- FWCI
- 31.08
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.