The DOI matches its Crossref record; 249 of the 249 references it cites were found in a registry or an index.
An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Open accessAbstract
Speaker identity is one of the important characteristics of human speech. In voice conversion, we change the speaker identity from one to another, while keeping the linguistic content unchanged. Voice conversion involves multiple speech processing techniques, such as speech analysis, spectral conversion, prosody conversion, speaker characterization, and vocoding. With the recent advances in theory and practice, we are now able to produce human-like voice quality with high speaker similarity. In this article, we provide a comprehensive overview of the state-of-the-art of voice conversion techniques and their performance evaluation methods from the statistical approaches to deep learning, and discuss their promise and limitations. We will also report the recent Voice Conversion Challenges (VCC), the performance of the current state of technology, and provide a summary of the available resources for voice conversion research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
ALGORITHMS FOR NON-NEGATIVE MATRIX FACTORIZATION
Lee, D. D., & Seung, H. S. (2000) · neural information processing systems · Cited by 9,878
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
Chai, T., & Draxler, R. R. (2014) · Geoscientific Model Development · doi:10.5194/gmd-7-1247-2014 · Cited by 8,761 · cited 8×
“The common objective evaluation metrics include Mel-cepstral distortion (MCD) [246] for spectrum, and PCC [247] and RMSE [248]–[250] for prosody.”
BackgroundInfluentialEffective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
Willmott, C., & Matsuura, K. (2005) · Climate Research · doi:10.3354/cr030079 · Cited by 7,958
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955 · cited 1×
“ory blocks and gates, that support the storage and access to long-range contextual information [175].”
BackgroundWaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
ALGORITHMS FOR NON-NEGATIVE MATRIX FACTORIZATION
Seung, D., & Lee, L.-W. (2001) · Cited by 4,753
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., & Catanzaro, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00917 · Cited by 4,332
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
Front-End Factor Analysis for Speaker Verification
Dehak, N., Kenny, P. J., Dehak, R., Dumouchel, P., & Ouellet, P. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2064307 · Cited by 3,549
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
The expectation-maximization algorithm
Moon, T. K. (1996) · IEEE Signal Processing Magazine · doi:10.1109/79.543975 · Cited by 3,181
Rix, A. W., Beerends, J. G., Hollier, M. P., & Hekstra, A. P. (2002) · 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221) · doi:10.1109/icassp.2001.941023 · Cited by 3,149
Pearson Correlation Coefficient
Benesty, J., Chen, J., Huang, Y., & Cohen, I. (2009) · Springer Topics in Signal Processing · doi:10.1007/978-3-642-00296-0_5 · Cited by 3,059
Convolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850 · cited 1×
“ies have shown that convolutional neural networks also learn well the long-term dependencies [66], [187].”
BackgroundNatural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
Neural Discrete Representation Learning
Oord, A. V. D., Vinyals, O., & Kavukcuoglu, K. (2017) · arXiv · doi:10.48550/arxiv.1711.00937 · Cited by 2,729
Multimodal Unsupervised Image-to-Image Translation
Huang, X., Liu, M.-Y., Belongie, S., & Kautz, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_11 · Cited by 2,451
Learning to forget: continual prediction with LSTM
Gers, F. A. (1999) · 9th International Conference on Artificial Neural Networks: ICANN '99 · doi:10.1049/cp:19991218 · Cited by 2,337
Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
Signal estimation from modified short-time Fourier transform
Griffin, D., & Lim, J. (1984) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1984.1164317 · Cited by 2,095
Autoencoding beyond pixels using a learned similarity metric
Larsen, A., Sønderby, S. K., Larochelle, H., & Winther, O. (2016) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 1,990
Kawahara, H., Masuda-Katsuse, I., & de Cheveigné, A. (1999) · Speech Communication · doi:10.1016/s0167-6393(98)00085-5 · Cited by 1,831
Tacotron: towards end-to-end speech synthesis
Wang, Y., Skerry-Ryan, R. J., Stanton, D., Wu, Y., Weiss, R. J., Jaitly, N., Yang, Z., Xiao, Y., Chen, Z., Bengio, S., et al. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1452 · Cited by 1,746 · cited 2×
“Tacotron [89], [180], [218]–[220] represents one of the successful text-to-speech (TTS) implementations, that has been extended to voice conversion [3], [183], [221].”
BackgroundStarGAN v2: Diverse Image Synthesis for Multiple Domains
Choi, Y., Uh, Y., Yoo, J., & Ha, J.-W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00821 · Cited by 1,663
(2018) · doi:10.21437/interspeech.2018-1456 · Cited by 1,366
Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones
Moulines, E., & Charpentier, F. (1990) · Speech Communication · doi:10.1016/0167-6393(90)90021-z · Cited by 1,244
“Waveglow: a flow-based generative network for speech synthesis,”
Prenger, R., Valle, R., & Catanzaro, B. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683143 · Cited by 1,004
Speech parameter generation algorithms for HMM-based speech synthesis
Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., & Kitamura, T. (2002) · 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100) · doi:10.1109/icassp.2000.861820 · Cited by 999
Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter Trajectory
Toda, T., Black, A. W., & Tokuda, K. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.907344 · Cited by 937
Continuous probabilistic transform for voice conversion
Stylianou, Y., Cappe, O., & Moulines, E. (1998) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.661472 · Cited by 931
Mel Frequency Cepstral Coefficients For Music Modeling.
Logan, B. (2000) · doi:10.5281/zenodo.1416443 · Cited by 913
Toward Multimodal Image-to-Image Translation
Zhu, J.-Y., Zhang, R., Pathak, D., Darrell, T. J., Efros, A. A., Wang, O., & Shechtman, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11586 · Cited by 906
Yamamoto, R., Song, E., & Kim, J.-M. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053795 · Cited by 827
LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech
Zen, H., Dang, V., Clark, R., Zhang, Y., Weiss, R. J., Jia, Y., Chen, Z., & Wu, Y. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2441 · Cited by 752
MelGAN: generative adversarial networks for conditional waveform synthesis
Kumar, K., Kumar, R., de Boissiere, T., Gestin, L., Teoh, W. Z., Sotelo, J., de Brebisson, A., Bengio, Y., & Courville, A. (2019) · arXiv · doi:10.48550/arxiv.1910.06711 · Cited by 722 · cited 2×
“MelGAN shows the effectiveness of GANbased approaches for high quality mel-spectrogram inversion in speech synthesis, music domain translation and unconditional music synthesis.”
MethodGenerating diverse high-fidelity images with vq-vae-2
Razavi, A., Oord, A. V. D., & Vinyals, O. (2019) · arXiv · doi:10.48550/arxiv.1906.00446 · Cited by 709 · cited 1×
“It was shown that discrete representation, that is the latent code obtained from VQVAE [234], [235], preserves the most linguistic content while”
BackgroundASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T., & Lee, K. A. (2019) · arXiv · doi:10.48550/arxiv.1904.05441 · Cited by 688
Self-citationASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T. H., & Lee, K. A. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2249 · Cited by 687
Self-citationVoxceleb: Large-scale speaker verification in the wild
Nagrani, A., Chung, J. S., Xie, W., & Zisserman, A. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2019.101027 · Cited by 660
Few-Shot Unsupervised Image-to-Image Translation
Liu, M.-Y., Huang, X., Mallya, A., Karras, T., Aila, T., Lehtinen, J., & Kautz, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01065 · Cited by 646
What is the expectation maximization algorithm?
Do, C. B., & Batzoglou, S. (2008) · Nature Biotechnology · doi:10.1038/nbt1406 · Cited by 607
Spoofing and countermeasures for speaker verification: A survey
Wu, Z., Evans, N., Kinnunen, T., Yamagishi, J., Alegre, F., & Li, H. (2015) · Speech Communication · doi:10.1016/j.specom.2014.10.005 · Cited by 601
Self-citationThe CMU Arctic speech databases.
Kominek, J., & Black, A. W. (2004) · Cited by 600
Spectral voice conversion for text-to-speech synthesis
Kain, A., & Macon, M. W. (2002) · Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181) · doi:10.1109/icassp.1998.674423 · Cited by 552
The ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535
Self-citationMel-cepstral distance measure for objective speech quality assessment
Kubichek, R. (2002) · Proceedings of IEEE Pacific Rim Conference on Communications Computers and Signal Processing · doi:10.1109/pacrim.1993.407206 · Cited by 534
Mean opinion score (MOS) revisited: Methods and applications, limitations and alternatives
Streijl, R. C., Winkler, S., & Hands, D. S. (2016) · Multimedia Systems · doi:10.1007/s00530-014-0446-1 · Cited by 506 · cited 1×
“(MOS) [2], [251]–[253], preference tests [18], [254] and bestworst scaling [255] could represent the intrinsic naturalness and similarity to the target.”
BackgroundASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech
Wang, X., Yamagishi, J., Todisco, M., Delgado, H., Nautsch, A., Evans, N., Sahidullah, M., Vestman, V., Kinnunen, T., Lee, K. A., et al. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101114 · Cited by 505
Self-citationASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484 · cited 1×
“This database became a reference standard in the automatic speaker verification (ASV) community [298], [299].”
MethodSelf-citationSUPERSEDED - CSTR VCTK Corpus: English Multi-speaker Corpus for CSTR Voice Cloning Toolkit
Veaux, C., Yamagishi, J., & MacDonald, K. (2016) · University of Edinburgh. The Centre for Speech Technology Research (CSTR) · doi:10.7488/ds/1495 · Cited by 434
Self-citationDigital speech processing, synthesis, and recognition
(1989) · Speech Communication · doi:10.1016/0167-6393(89)90009-5 · Cited by 412
Supervised and Unsupervised Speech Enhancement Using Nonnegative Matrix Factorization
Mohammadiha, N., Smaragdis, P., & Leijon, A. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2013.2270369 · Cited by 389
Deep Voice: Real-time Neural Text-to-Speech
Arık, S. Ö., Chrzanowski, M., Coates, A., Diamos, G., Gibiansky, A., Kang, Y., Li, X., Miller, J. J., Ng, A. Y., Raiman, J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07825 · Cited by 381
“StarGAN-VC: non-parallel many-to-many voice conversion using star generative adversarial networks,”
Kameoka, H., Kaneko, T., Tanaka, K., & Hojo, N. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639535 · Cited by 371
Unsupervised Cross-Domain Image Generation
Taigman, Y., Polyak, A., & Wolf, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.02200 · Cited by 359
CycleGAN-VC: Non-parallel Voice Conversion Using Cycle-Consistent Adversarial Networks
Kaneko, T., & Kameoka, H. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553236 · Cited by 358 · cited 2×
“Combining these three loss functions, we can obtain the overall loss function of CycleGAN [48], [210].”
BackgroundMethodVoice transformation using PSOLA technique
Valbret, H., Moulines, É., & Tubach, J.-P. (1992) · Speech Communication · doi:10.1016/0167-6393(92)90012-v · Cited by 340
Applying the harmonic plus noise model in concatenative speech synthesis
Stylianou, Y. (2001) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.890068 · Cited by 325
Unsupervised speech representation learning using WaveNet autoencoders
Chorowski, J., Weiss, R. J., Bengio, S., & van den Oord, A. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2938863 · Cited by 325 · cited 3×
“[100] provide a comparison of three autoencoding neural networks by studying how they learn a representation from speech data to separate speaker identity from”
BackgroundInfluentialHsu, C.-C., Hwang, H.-T., Wu, Y.-C., Tsao, Y., & Wang, H.-M. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-63 · Cited by 320
Deep voice 3: scaling text-to-speech with convolutional sequence learning
Ping, W., Peng, K., Gibiansky, A., Arik, S. O., Kannan, A., Narang, S., Raiman, J., & Miller, J. (2017) · arXiv · doi:10.48550/arxiv.1710.07654 · Cited by 313
The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
Lorenzo-Trueba, J., Yamagishi, J., Toda, T., Saito, D., Villavicencio, F., Kinnunen, T., & Ling, Z. (2018) · The Speaker and Language Recognition Workshop (Odyssey 2018) · doi:10.21437/odyssey.2018-28 · Cited by 305
Self-citationPhonetic posteriorgrams for many-to-one voice conversion without parallel data training
Sun, L., Li, K., Wang, H., Kang, S., & Meng, H. (2016) · 2016 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2016.7552917 · Cited by 297
Voice conversion from non-parallel corpora using variational auto-encoder
Hsu, C.-C., Hwang, H.-T., Wu, Y.-C., Tsao, Y., & Wang, H.-M. (2016) · 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) · doi:10.1109/apsipa.2016.7820786 · Cited by 289
Unsupervised Learning of Disentangled and Interpretable Representations from Sequential DataPreprint
Hsu, W.-N., Zhang, Y., & Glass, J. R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.07902 · Cited by 285
Query-by-example spoken term detection using phonetic posteriorgram templates
Hazen, T. J., Shen, W., & White, C. (2009) · 2009 IEEE Workshop on Automatic Speech Recognition & Understanding · doi:10.1109/asru.2009.5372889 · Cited by 275
Tachibana, H., Uenoyama, K., & Aihara, S. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461829 · Cited by 274
Speech denoising using nonnegative matrix factorization with priors
Wilson, K. W., Raj, B., Smaragdis, P., & Divakaran, A. (2008) · 2008 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2008.4518538 · Cited by 273
CycleGAN-VC2: improved CycleGAN-based non-parallel voice conversion.
Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682897 · Cited by 272
Speaker-Dependent WaveNet Vocoder
Tamamori, A., Hayashi, T., Kobayashi, K., Takeda, K., & Toda, T. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-314 · Cited by 269
An overview of voice conversion systems
Mohammadi, S. H., & Kain, A. (2017) · Speech Communication · doi:10.1016/j.specom.2017.01.008 · Cited by 264
Voice conversion using deep Bidirectional Long Short-Term Memory based Recurrent Neural Networks
Sun, L., Kang, S., Li, K., & Meng, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178896 · Cited by 257
MOSNet: Deep Learning-Based Objective Assessment for Voice Conversion
Lo, C.-C., Fu, S.-W., Huang, W.-C., Wang, X., Yamagishi, J., Tsao, Y., & Wang, H.-M. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2003 · Cited by 256
Self-citationHigh Fidelity Speech Synthesis with Adversarial NetworksPreprint
Bińkowski, M., Donahue, J., Dieleman, S., Clark, A., Elsen, E., Casagrande, N., Cobo, L. C., & Simonyan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11646 · Cited by 233
Chou, J.-C., & Lee, H.-Y. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2663 · Cited by 232
ASVspoof: The Automatic Speaker Verification Spoofing and Countermeasures Challenge
Wu, Z., Yamagishi, J., Kinnunen, T., Hanilci, C., Sahidullah, M., Sizov, A., Evans, N., Todisco, M., & Delgado, H. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2671435 · Cited by 229
Self-citationSpectral Mapping Using Artificial Neural Networks for Voice Conversion
Desai, S., Black, A. W., Yegnanarayana, B., & Prahallad, K. (2010) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2047683 · Cited by 223
Theory and Use of the EM Algorithm
Gupta, M. R. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984319 · Cited by 212
Voice Conversion Using Deep Neural Networks With Layer-Wise Generative Training
Chen, L.-H., Ling, Z.-H., Liu, L.-J., & Dai, L.-R. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2353991 · Cited by 210
Voice Conversion Using Partial Least Squares Regression
Helander, E., Virtanen, T., Nurminen, J., & Gabbouj, M. (2010) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2041699 · Cited by 207
Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotron
Skerry-Ryan, R., Battenberg, E., Xiao, Y., Wang, Y., Stanton, D., Shor, J., Weiss, R. J., Clark, R., & Saurous, R. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09047 · Cited by 207
Voice conversion using Artificial Neural Networks
Desai, S., Raghavendra, E. V., Yegnanarayana, B., Black, A. W., & Prahallad, K. (2009) · 2009 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2009.4960478 · Cited by 206
Neural Source-Filter Waveform Models for Statistical Parametric Speech Synthesis
Wang, X., Takaki, S., & Yamagishi, J. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2956145 · Cited by 191
Self-citationViswanathan, M., & Viswanathan, M. (2005) · Computer Speech & Language · doi:10.1016/j.csl.2003.12.001 · Cited by 183
Transformation of formants for voice conversion using artificial neural networks
Narendranath, M., Murthy, H. A., Rajendran, S., & Yegnanarayana, B. (1995) · Speech Communication · doi:10.1016/0167-6393(94)00058-i · Cited by 181
Quality-Net: An End-to-End Non-intrusive Speech Quality Assessment Model Based on BLSTM
Fu, S.-W., Tsao, Y., Hwang, H.-T., & Wang, H.-M. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1802 · Cited by 178
Optimising selection of units from speech databases for concatenative synthesis
Black, A. W., & Campbell, N. (1995) · 4th European Conference on Speech Communication and Technology (Eurospeech 1995) · doi:10.21437/eurospeech.1995-148 · Cited by 175
Voice Conversion Based on Weighted Frequency Warping
Erro, D., Moreno, A., & Bonafonte, A. (2010) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2009.2038663 · Cited by 175
Toda, T., Saruwatari, H., & Shikano, K. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2001.941046 · Cited by 169
Sequence-to-Sequence Acoustic Modeling for Voice Conversion
Zhang, J.-X., Ling, Z.-H., Liu, L.-J., Jiang, Y., & Dai, L.-R. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2892235 · Cited by 167
Exemplar-Based Sparse Representation With Residual Compensation for Voice Conversion
Wu, Z., Virtanen, T., Chng, E. S., & Li, H. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2333242 · Cited by 166
Self-citationBest-worst scaling: theory and methods
Flynn, T. N., & Marley, A. A. J. (2014) · Edward Elgar Publishing eBooks · doi:10.4337/9781781003152.00014 · Cited by 161
Parallel-Data-Free Voice Conversion Using Cycle-Consistent Adversarial Networks
Kaneko, T., & Kameoka, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11293 · Cited by 158
The Voice Conversion Challenge 2016
Toda, T., Chen, L.-H., Saito, D., Villavicencio, F., Wester, M., Wu, Z., & Yamagishi, J. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-1066 · Cited by 156 · cited 4×
“conversion challenge (VCC) 2016, which was first launched [67]–[69] at INTERSPEECH 2016.”
BackgroundMethodInfluentialSelf-citationMel Log Spectrum Approximation (MLSA) filter for speech synthesis
Imai, S., Sumita, K., & Furuichi, C. (1983) · Electronics and Communications in Japan (Part I Communications) · doi:10.1002/ecja.4400660203 · Cited by 152
CSTR VCTK Corpus: English Multi-Speaker Corpus for CSTR Voice Cloning Toolkit
Veaux, C. (2025) · TIB Data Manager · doi:10.57702/c0brh9iz · Cited by 152
Voice conversion through vector quantization
Abe, M., Nakamura, S., Shikano, K., & Kuwabara, H. (1990) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.11.71 · Cited by 150
Learning Attribute Representations with Localization for Flexible Fashion Search
Ak, K. E., Kassim, A. A., Lim, J., & Tham, J. Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00804 · Cited by 145
WaveNet Vocoder with Limited Training Data for Voice Conversion
Liu, L., Ling, Z.-H., Jiang, Y., Zhou, M. Q., & Dai, L.-R. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1190 · Cited by 144
Voice conversion in high-order eigen space using deep belief nets
Nakashika, T., Takashima, R., Takiguchi, T., & Ariki, Y. (2013) · Interspeech (USB) · doi:10.21437/interspeech.2013-102 · Cited by 143
Biadsy, F., Weiss, R. J., Moreno, P. J., Kanvesky, D., & Ye, J. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1789 · Cited by 142
Learning Latent Representations for Speech Generation and Transformation
Hsu, W.-N., Zhang, Y., & Glass, J. R. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-349 · Cited by 141
INCA Algorithm for Training Voice Conversion Systems From Nonparallel Corpora
Erro, D., Moreno, A., & Bonafonte, A. (2009) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2009.2038669 · Cited by 132
Huang, W.-C., Hayashi, T., Wu, Y.-C., Kameoka, H., & Toda, T. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1066 · Cited by 129
Neural Source-filter-based Waveform Model for Statistical Parametric Speech Synthesis
Wang, X., Takaki, S., & Yamagishi, J. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682298 · Cited by 128
Self-citation“High-quality nonparallel voice conversion based on cycle-consistent adversarial network,”
Fang, F., Yamagishi, J., Echizen, I., & Lorenzo-Trueba, J. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462342 · Cited by 128
Self-citationZhang, J.-X., Ling, Z.-H., & Dai, L.-R. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2960721 · Cited by 127
Voice Conversion Challenge 2020 –- Intra-lingual semi-parallel and cross-lingual voice conversion –-
Yi, Z., Huang, W.-C., Tian, X., Yamagishi, J., Das, R. K., Kinnunen, T., Ling, Z.-H., & Toda, T. (2020) · Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020 · doi:10.21437/vcc_bc.2020-14 · Cited by 126
Self-citationKain, A. B., & Macon, M. W. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2001.941039 · Cited by 126
Voice Conversion Using Dynamic Kernel Partial Least Squares Regression
Helander, E. E., Silén, H., Virtanen, T. I., & Gabbouj, M. (2011) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2165944 · Cited by 126
Godoy, E., Rosec, O., & Chonavel, T. (2011) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2177820 · Cited by 125
Exemplar-based voice conversion in noisy environment
Takashima, R., Takiguchi, T., & Ariki, Y. (2012) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424242 · Cited by 122
Text-Independent Voice Conversion Based on Unit Selection
Sundermann, D. H., Höge, H., Bonafonte, A., Ney, H., Black, A. W., & Narayanan, S. B. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2006.1659962 · Cited by 117
Saito, Y., Ijima, Y., Nishida, K., & Takamichi, S. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461384 · Cited by 115
Eigenvoice conversion based on Gaussian mixture model
Toda, T., Ohtani, Y., & Shikano, K. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-613 · Cited by 113
ATTS2S-VC: Sequence-to-sequence Voice Conversion with Attention and Context Preservation Mechanisms
Tanaka, K., Kameoka, H., Kaneko, T., & Hojo, N. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683282 · Cited by 112
Kaneko, T., Kameoka, H., Hiramatsu, K., & Kashino, K. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-970 · Cited by 108
Chu, W., & Alwan, A. A. (2009) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2009.4960497 · Cited by 106
Quality-enhanced voice morphing using maximum likelihood transformations
Ye, H., & Young, S. J. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tsa.2005.860839 · Cited by 106
Low-Complexity, Nonintrusive Speech Quality Assessment
Grancharov, V., Zhao, D., Lindblom, J., et al. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2006.883250 · Cited by 102
Best-worst scaling: theory and methods
Marley, A. A. J. (2024) · Edward Elgar Publishing eBooks · doi:10.4337/9781800375635.00014 · Cited by 102
Maximum likelihood voice conversion based on GMM with STRAIGHT mixed excitation
Ohtani, Y., Toda, T., Saruwatari, H., & Shikano, K. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-582 · Cited by 101
Nonparallel training for voice conversion based on a parameter adaptation approach
Mouchtaris, A., der Spiegel, J. V., & Müeller, P. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tsa.2005.857790 · Cited by 101
Attribute Manipulation Generative Adversarial Networks for Fashion Images
Ak, K. E., Kassim, A. A., Lim, J., & Tham, J. Y. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01064 · Cited by 98
Grancharov, V., & Kleijn, W. B. (2007) · Springer handbooks · doi:10.1007/978-3-540-49127-9_5 · Cited by 97
An investigation of multi-speaker training for wavenet vocoder
Hayashi, T., Tamamori, A., Kobayashi, K., Takeda, K., & Toda, T. (2017) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2017.8269007 · Cited by 97
Expressive TTS Training With Frame and Style Reconstruction Loss
Liu, R., Şişman, B., Gao, G., & Li, H. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3076369 · Cited by 97
Self-citationDefending Your Voice: Adversarial Attack on Voice Conversion
Huang, C., Lin, Y. Y., Lee, H.-Y., & Lee, L.-S. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383529 · Cited by 96
Sun, M., Li, Y., Gemmeke, J. F., & Zhang, X. (2015) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2015.2427520 · Cited by 95
Towards Achieving Robust Universal Neural Vocoding
Lorenzo-Trueba, J., Drugman, T., Latorre, J., Merritt, T., Putrycz, B., Barra-Chicote, R., Moinet, A., & Aggarwal, V. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1424 · Cited by 95
GMM-based voice conversion applied to emotional speech synthesis
Kawanami, H., Iwami, Y., Toda, T., Saruwatari, H., & Shikano, K. (2003) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2003-661 · Cited by 94
Voice conversion using deep neural networks with speaker-independent pre-training
Mohammadi, S. H., & Kain, A. B. (2014) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2014.7078543 · Cited by 94
Transfer Learning From Speech Synthesis to Voice Conversion With Non-Parallel Training Data
Zhang, M., Zhou, Y., Li, Z., & Li, H. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3066047 · Cited by 89
Self-citationVQVC+: One-Shot Voice Conversion by Vector Quantization and U-Net Architecture
Wu, D.-Y., Chen, Y.-H., & Lee, H.-Y. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1443 · Cited by 88
Deep Voice: Real-time Neural Text-to-Speech
Arık, S. Ö., Chrzanowski, M., Coates, A., Diamos, G., Gibiansky, A., Kang, Y., Li, X., Miller, J. J., Ng, A. Y., Raiman, J., et al. (2017) · International Conference on Machine Learning · Cited by 88
Cross-lingual Voice Conversion with Bilingual Phonetic Posteriorgram and Average Modeling
Zhou, Y., Tian, X., Xu, H., Das, R. K., & Li, H. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683746 · Cited by 86
Self-citationBlow: a single-scale hyperconditioned flow for non-parallel raw-audio voice conversionPreprint
Serrà, J., Pascual, S., & Segura, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00794 · Cited by 86
NAUTILUS: A Versatile Voice Cloning System
Luong, H.-T., & Yamagishi, J. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3034994 · Cited by 84
Self-citationTransforming Spectrum and Prosody for Emotional Voice Conversion with Non-Parallel Training Data
Zhou, K., Şişman, B., & Li, H. (2020) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2020-33 · Cited by 80
Self-citationAutoMOS: Learning a non-intrusive assessor of naturalness-of-speechPreprint
Patton, B., Agiomyrgiannakis, Y., Terry, M. A., Wilson, K., Saurous, R. A., & Sculley, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09207 · Cited by 78
ATR μ-talk speech synthesis system
Sagisaka, Y., Kaiki, N., Iwahashi, N., & Mimura, K. (1992) · ICSLP · doi:10.21437/icslp.1992-125 · Cited by 77
Deep Bidirectional LSTM Modeling of Timbre and Prosody for Emotional Voice Conversion
Ming, H., Huang, D., Xie, L., Wu, J., Dong, M., & Li, H. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-1053 · Cited by 77
Self-citationConvS2S-VC: Fully Convolutional Sequence-to-Sequence Voice Conversion
Kameoka, H., Tanaka, K., Kwaśny, D., Kaneko, T., & Hojo, N. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3001456 · Cited by 75
Sundermann, D. H., & Ney, H. (2004) · IEEE International Symposium on Signal Processing and Information Technology (ISSPIT) · doi:10.1109/isspit.2003.1341181 · Cited by 74
Personalized, Cross-Lingual TTS Using Phonetic Posteriorgrams
Sun, L., Wang, H., Kang, S., Li, K., & Meng, H. M. L. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-1043 · Cited by 72
One-Shot Voice Conversion by Vector Quantization
Wu, D.-Y., & Lee, H.-Y. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053854 · Cited by 72
Zhang, M., Wang, X., Fang, F., Li, H., & Yamagishi, J. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1357 · Cited by 70
Self-citationNakatani, T., Amano, S., Irino, T., Ishizuka, K., & Kondo, T. (2007) · Speech Communication · doi:10.1016/j.specom.2007.09.003 · Cited by 69
A KL Divergence and DNN-Based Approach to Voice Conversion without Parallel Training Sentences
Xie, F., Soong, F. K., & Li, H. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-116 · Cited by 66
Self-citationZhao, Y. H., Takaki, S., Luong, H.-T., Yamagishi, J., Saito, D., & Minematsu, N. (2018) · IEEE Access · doi:10.1109/access.2018.2872060 · Cited by 66
Self-citationWang, X., Lorenzo-Trueba, J., Takaki, S., Juvela, L., & Yamagishi, J. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461452 · Cited by 65
Self-citationKinnunen, T., Juvela, L., Alku, P., & Yamagishi, J. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7953215 · Cited by 63
Self-citationAnalysis of the Voice Conversion Challenge 2016 Evaluation Results
Wester, M., Wu, Z., & Yamagishi, J. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-1331 · Cited by 61
Self-citationsprocket: Open-Source Voice Conversion Software
Kobayashi, K., & Toda, T. (2018) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2018-29 · Cited by 60
Voice Conversion Based on Cross-Domain Features Using Variational Auto Encoders
Huang, W.-C., Hwang, H.-T., Peng, Y., Tsao, Y., & Wang, H. (2018) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp.2018.8706604 · Cited by 60
Cotatron: Transcription-Guided Speech Encoder for Any-to-Many Voice Conversion Without Parallel Data
Park, S.-W., Kim, D.-Y., & Joe, M.-C. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1542 · Cited by 60
Efficient Multi-attribute Similarity Learning Towards Attribute-Based Fashion Search
Ak, K. E., Lim, J., Tham, J. Y., et al. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00186 · Cited by 59
Robust processing techniques for voice conversion
Türk, O., & Arslan, L. M. (2005) · Computer Speech & Language · doi:10.1016/j.csl.2005.06.001 · Cited by 57
Speaker adaptation and voice conversion by codebook mapping
Shikano, K., Nakamura, S., & Abe, M. (1991) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.1991.176405 · Cited by 54
Nakashika, T., Takiguchi, T., & Ariki, Y. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-447 · Cited by 54
Cycle-Consistent Speech Enhancement
Meng, Z., Li, J., Gong, Y., & Juang, B. H. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-2409 · Cited by 54
Şişman, B., Zhang, M., & Li, H. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1131 · Cited by 54
Self-citationMizuno, H., & Abe, M. (1995) · Speech Communication · doi:10.1016/0167-6393(94)00052-c · Cited by 53
Huang, W.-C., Luo, H., Hwang, H.-T., Lo, C.-C., Peng, Y.-H., Tsao, Y., & Wang, H.-M. (2020) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2020.2977678 · Cited by 53
Converting Anyone’s Emotion: Towards Speaker-Independent Emotional Voice Conversion
Zhou, K., Şişman, B., Zhang, M., & Li, H. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2014 · Cited by 53
Self-citationGroup sparse representation with wavenet vocoder adaptation for spectrum and prosody conversion
Sisman, B., Zhang, M., & Li, H. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2910637 · Cited by 52
Self-citationAk, K. E., Lim, J., Tham, J. Y., & Kassim, A. A. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.02.030 · Cited by 51
Teacher-Student Training For Robust Tacotron-Based TTS
Liu, R., Şişman, B., Li, J., Bao, F., Gao, G., & Li, H. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054681 · Cited by 51
Self-citationON the Use of Wavenet as a Statistical Vocoder
Adiga, N., Tsiaras, V., & Stylianou, Y. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462393 · Cited by 47
Group Latent Embedding for Vector Quantized Variational Autoencoder in Non-Parallel Voice Conversion
Ding, S., & Gutiérrez‐Osuna, R. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1198 · Cited by 47
Airaksinen, M., Juvela, L., Bollepalli, B., Yamagishi, J., & Alku, P. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2835720 · Cited by 46
Self-citationVoice conversion versus speaker verification: an overview
Wu, Z., & Li, H. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2014.17 · Cited by 45
Self-citationAn Exemplar-Based Approach to Frequency Warping for Voice Conversion
Tian, X., Lee, S. W., Wu, Z., Chng, E. S., & Li, H. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2723721 · Cited by 45
Self-citationWester, M., Valentini-Botinhao, C., & Henter, G. E. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-689 · Cited by 44
Improving Sequence-to-sequence Voice Conversion by Adding Text-supervision
Zhang, J.-X., Ling, Z.-H., Jiang, Y., Liu, L., Chen, L., & Dai, L.-R. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682380 · Cited by 44
On the impact of alignment on voice conversion performance
Helander, E. E., Schwarz, J., Nurminen, J., Silén, H., & Gabbouj, M. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-419 · Cited by 41
Exemplar-based sparse representation of timbre and prosody for voice conversion
Ming, H., Huang, D., Xie, L., Zhang, S., Dong, M., & Li, H. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472664 · Cited by 41
Self-citationSequence error (SE) minimization training of neural network for voice conversion
Xie, F., Qian, Y., Fan, Y., Soong, F. K., & Li, H. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-448 · Cited by 40
Self-citationVoice conversion based on Non-negative matrix factorization using phoneme-categorized dictionary
Aihara, R., Nakashika, T., Takiguchi, T., & Ariki, Y. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6855137 · Cited by 39
Sparse representation of phonetic features for voice conversion with and without parallel data
Şişman, B., Li, H., & Tan, K. C. (2017) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2017.8269002 · Cited by 39
Self-citationAverage Modeling Approach to Voice Conversion with Non-Parallel Data
Tian, X., Wang, J., Xu, H., Chng, E. S., & Li, H. (2018) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2018-32 · Cited by 38
Self-citationSinging Voice Synthesis Using Deep Autoregressive Neural Networks for Acoustic Modeling
Yi, Y., Ai, Y., Ling, Z.-H., & Dai, L.-R. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1563 · Cited by 38
Voice conversion for unknown speakers
Ye, H., & Young, S. (2004) · Interspeech (USB) · doi:10.21437/interspeech.2004-436 · Cited by 36
A system for voice conversion based on probabilistic classification and a harmonic plus noise model
Stylianou, Y., & Cappé, O. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1998.674422 · Cited by 36
Veaux, C., Yamagishi, J., & King, S. (2013) · Cited by 36
Self-citationA Hierarchical Predictor of Synthetic Speech Naturalness Using Neural Networks
Yoshimura, T., Henter, G. E., Watts, O., Wester, M., Yamagishi, J., & Tokuda, K. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-847 · Cited by 36
Self-citation
Research works printed but not linked: 66
- 10.1109/ICASSP.2018.8461960 · doi:10.1109/icassp.2018.8461960
- recommendation, 2001, 1534-1, Method for the subjective assessment of intermediate sound quality (MUSHRA), Int Telecommun Union
- benisty, 2011, Voice conversion using GMM with enhanced global variance, Proc 12th Annu Conf Int Speech Commun Assoc
- zielinski, 2007, Potential biases in MUSHRA listening tests, Proc 123rd Audio Eng Soc Convers
- 10.1016/j.asoc.2012.05.027 · doi:10.1016/j.asoc.2012.05.027
- song, 0, Text-independent voice conversion using speaker model alignment method from non-parallel speech, Proc Annu Conf Int Speech Commun Assoc INTERSPEECH, 2308
- tamura, 0, Speaker adaptation for HMM-based speech synthesis system using MLLR, Proc 3rd ESCA/COCOSDA Workshop (ETRW) Speech Synth
- remes, 2013, Objective evaluation measures for speaker-adaptive HMM-TTS systems, Proc 8th ISCA Workshop Speech Synth
- ping, 0, Deep voice 3: 2000-speaker neural text-to-speech, Proc ICLR, 214
- huang, 0, Prediction of perceived sound quality of synthetic speech, Proc Asia-Pacific Signal Inf Process Assoc Annu Summit Conf
- cernak, 0, An evaluation of synthetic speech using the PESQ measure, Proc Eur Congr Acoust, 2725
- erro, 0, Frame alignment method for cross-lingual voice conversion, Proc INTERSPEECH
- 10.1109/TASL.2010.2041688 · doi:10.1109/tasl.2010.2041688
- mashimo, 2002, Cross-language voice conversion evaluation using bilingual databases, Proc Int Conf Spoken Lang Process
- sundermann, 0, VTLN-based crosslanguage voice conversion, Proc IEEE Autom Speech Recognit Understanding Workshop
- 10.1109/ICASSP.2015.7178897 · doi:10.1109/icassp.2015.7178897
- 10.21437/Odyssey.2018-30 · DOI
- 10.21437/Odyssey.2018-34 · DOI
- 10.1109/TASLP.2019.2892235 · DOI
- fujii, 2007, High individuality voice conversion based on concatenative speech synthesis, Int J Elect Comput Energetic Electron Commun Eng, 1, 1617
- sagisaka, 0, Proc Int Conf Spoken Lang Process
- ney, 0, A first step towards text-independent voice conversion, Proc Int Conf Spoken Lang Process
- bi?kowski, 2018, Demystifying MMD GANs, arXiv 1801 01401
- 10.1109/ISCSLP.2014.6936599 · doi:10.1109/iscslp.2014.6936599
- 10.21437/Interspeech.2017-247 · doi:10.21437/interspeech.2017-247
- lorenzo-trueba, 2018, The voice conversion challenge: Promoting development of parallel and nonparallel methods, arXiv 1804 04262
- 10.1016/S0167-6393(99)00015-1 · doi:10.1016/s0167-6393(99)00015-1
- 10.23919/EUSIPCO.2019.8902651 · DOI
- kalchbrenner, 2018, Efficient neural audio synthesis, arXiv 1802 08435
- kim, 0, Flowavenet: A generative flow for raw audio, Proc Int Conf Mach Learn, 3370
- toda, 0, The voice conversion challenge, Proc INTERSPEECH, 1632
- 10.21437/Interspeech.2016-1331 · DOI
- 10.1109/ICCV.2017.244 · DOI · Paper page
- 10.21437/Interspeech.2018-1528 · DOI
- 10.1007/978-3-030-00794-2_48 · doi:10.1007/978-3-030-00794-2_48
- 10.1109/ASRU46091.2019.9003801 · DOI
- 10.21437/Interspeech.2019-1514 · doi:10.21437/interspeech.2019-1514
- 10.1109/TASLP.2018.2835720 · DOI
- huang, 0, TimbreTron: A wavenet (cycleGAN (CQT (audio))) pipeline for musical timbre transfer, Proc Int Conf Learn Representations
- 10.1088/1742-6596/1607/1/012046 · DOI
- 10.21437/Odyssey.2020-35 · DOI
- 10.1007/978-3-642-35292-8_4 · doi:10.1007/978-3-642-35292-8_4
- 10.1109/APSIPA.2013.6694179 · doi:10.1109/apsipa.2013.6694179
- 10.5923/j.ajsp.20120205.06 · doi:10.5923/j.ajsp.20120205.06
- ribeiro, 0, A perceptual investigation of wavelet-based decomposition of f0 for text-to-speech synthesis, Proc 16th Annu Conf Int Speech Commun Assoc
- 10.1109/ICASSP.2016.7472734 · doi:10.1109/icassp.2016.7472734
- 10.1109/TASL.2009.2038663 · DOI · Paper page
- 10.1109/CHINSL.2008.ECP.44 · doi:10.1109/chinsl.2008.ecp.44
- 10.1016/j.specom.2006.08.001 · doi:10.1016/j.specom.2006.08.001
- 10.1109/ICASSP.2004.1325911 · doi:10.1109/icassp.2004.1325911
- 10.1007/978-3-642-34584-5_24 · doi:10.1007/978-3-642-34584-5_24
- 10.1038/110311a0 · doi:10.1038/110311a0
- wu, 0, Examplar-based voice conversion using non-negative spectrogram deconvolution, Proc 8th ISCA Speech Synth Workshop
- liu, 2016, Coupled generative adversarial networks, Proc Adv Neural Inf Process Syst, 469
- zou, 2020, Edge-GAN: Edge conditioned multi-view face image generation, Proc IEEE Int Conf Image Process, 2401
- 10.1016/0167-6393(94)00053-D · doi:10.1016/0167-6393(94)00053-d
- 10.1109/ICSP.2016.7877819 · doi:10.1109/icsp.2016.7877819
- 10.1109/TASL.2011.2165944 · DOI
- 10.1109/ICASSP.2005.1415037 · doi:10.1109/icassp.2005.1415037
- 10.1250/ast.14.353 · doi:10.1250/ast.14.353
- 10.1109/89.661472 · DOI · Paper page
- xuan, 0, Em algorithms of Gaussian mixture model and hidden Markov model, Proc Int Conf Image Process, 145
- 10.1109/APSIPA.2014.7041540 · doi:10.1109/apsipa.2014.7041540
- 10.1109/APSIPA.2017.8282110 · doi:10.1109/apsipa.2017.8282110
- watanabe, 0, Transformation of spectral envelope for voice conversion based on radial basis function networks, Proc Int Conf Spoken Lang Process
- ramani, 0, Cross-lingual voice conversion-based polyglot speech synthesizer for indian languages, Proc 15th Annu Conf Int Speech Commun Assoc
Cited by
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
A survey on neural speech synthesis
Tan, X., Qin, T., Soong, F., & Liu, T.-Y. (2021) · arXiv · doi:10.48550/arxiv.2106.15561 · Cited by 216
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132
Voice Conversion Challenge 2020 –- Intra-lingual semi-parallel and cross-lingual voice conversion –-
Yi, Z., Huang, W.-C., Tian, X., Yamagishi, J., Das, R. K., Kinnunen, T., Ling, Z.-H., & Toda, T. (2020) · Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020 · doi:10.21437/vcc_bc.2020-14 · Cited by 126
Self-citationThe Vicomtech Audio Deepfake Detection System Based on Wav2vec2 for the 2022 ADD Challenge
Martin-Donas, J. M., & Alvarez, A. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747768 · Cited by 100
Metadata
- Authors
- Sisman, B., Yamagishi, J., King, S., & Li, H.
- Venue
- IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Published
- 2021
- Volume
- 29
- Pages
- 132-157
- ISSN
- 2329-9290 (ISSN-L)
- 2329-9304
- OpenAlex
- W3098557217
- Cited by
- 357
- References
- 249
- FWCI
- 15.63
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- SUTD Start-up Grant Artificial Intelligence for Human Voice Conversion (SRG ISTD 2020 158)
- SUTD AI
- The Understanding and Synthesis of Expressive Speech by AI (PIE-SGP-AI-2020-02)
- National Research Foundation Singapore (AISG-GC-2019-002, AISG-100E-2018-006)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.