The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
We present the Voice Conversion Challenge 2018, designed as a follow up to the 2016 edition with the aim of providing a common framework for evaluating and comparing different state-of-the-art voice conversion (VC) systems. The objective of the challenge was to perform speaker conversion (i.e. transform the vocal identity) of a source speaker to a target speaker while maintaining linguistic information. As an update to the previous challenge, we considered both parallel and nonparallel data to form the Hub and Spoke tasks, respectively. A total of 23 teams from around the world submitted their systems, 11 of them additionally participated in the optional Spoke task. A large-scale crowdsourced perceptual evaluation was then carried out to rate the submitted converted speech in terms of naturalness and similarity to the target speaker identity. In this paper, we present a brief summary of the state-of-the-art techniques for VC, followed by a detailed explanation of the challenge tasks and the results that were obtained.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Both are publicly available but neither has been used previously for ASVspoof challenges.”
From ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild (2023) · cites this paper as [31]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Voice conversion challenge 2018 database (Lorenzo-Trueba et al., 2018): The original dataset created by the challenge organisers was also based on the DAPS dataset. It contains 116 utterances (81 for training and 35 for testing) per speaker from 12 speakers in two different tasks (called Hub and Spoke).”
From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as Lorenzo-Trueba et al., 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Signal estimation from modified short-time Fourier transform
Griffin, D., & Lim, J. (1984) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1984.1164317 · Cited by 2,095
Kawahara, H., Masuda-Katsuse, I., & de Cheveigné, A. (1999) · Speech Communication · doi:10.1016/s0167-6393(98)00085-5 · Cited by 1,831
WORLD: A Vocoder-Based High-Quality Speech Synthesis System for Real-Time Applications
MORISE, M., YOKOMORI, F., & OZAWA, K. (2016) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2015edp7457 · Cited by 1,092
Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter Trajectory
Toda, T., Black, A. W., & Tokuda, K. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.907344 · Cited by 937
Self-citationContinuous probabilistic transform for voice conversion
Stylianou, Y., Cappe, O., & Moulines, E. (1998) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.661472 · Cited by 931
SampleRNN: An Unconditional End-to-End Neural Audio Generation Model
Mehri, S., Kumar, K., Gulrajani, I., Kumar, R., Jain, S., Sotelo, J., Courville, A. C., & Bengio, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07837 · Cited by 392
Applying the harmonic plus noise model in concatenative speech synthesis
Stylianou, Y. (2001) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.890068 · Cited by 325
Hsu, C.-C., Hwang, H.-T., Wu, Y.-C., Tsao, Y., & Wang, H.-M. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-63 · Cited by 320
Merlin: An Open Source Neural Network Speech Synthesis System
Wu, Z., Watts, O., & King, S. (2016) · 9th ISCA Workshop on Speech Synthesis Workshop (SSW 9) · doi:10.21437/ssw.2016-33 · Cited by 299
Research works printed but not linked: 3
- [4][4] T. Toda, M. Nakagiri, and K. Shikano, 'Statistical voice conversion techniques for body-conducted unvoiced 5. speech enhancement,' Audio, Speech, and Language Processing, IEEE Transactions on , vol. 20, no. 9, pp. 25052517, 2012. -
- [34][34] K. Kobayashi, T. Toda, and S. Nakamura, ' F 0 transformation techniques for statistical voice conversion with direct waveform modification with spectral differential,' in Proc. SLT , 2016, pp. 693-700. -
- [42][42] S. Young, G. Evermann, M. Gales, T. Hain, D. Kershaw, X. Liu, G. Moore, J. Odell, D. Ollason, D. Povey et al. , 'The HTK book,' Cambridge university engineering department , vol. 3, p. 175, 2002. Table 2: WERs (%) of all systems in the Hub and Spoke tasks, where 'B01' is the baseline system and 'source' denotes the natural speech from source speakers.
Cited by
Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · arXiv · doi:10.48550/arxiv.1906.06876 · Cited by 551
Self-citationMulti-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
Self-citationMasood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
“StarGAN-VC: non-parallel many-to-many voice conversion using star generative adversarial networks,”
Kameoka, H., Kaneko, T., Tanaka, K., & Hojo, N. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639535 · Cited by 371
An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Sisman, B., Yamagishi, J., King, S., & Li, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3038524 · Cited by 357
Self-citationASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild
Liu, X., Wang, X., Sahidullah, M., Patino, J., Delgado, H., Kinnunen, T., Todisco, M., Yamagishi, J., Evans, N., Nautsch, A., et al. (2023) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2023.3285283 · Cited by 312
“They are the 2018 [31] and 2020 [32] voice conversion challenge (VCC) databases.”
BackgroundSelf-citationCycleGAN-VC2: improved CycleGAN-based non-parallel voice conversion.
Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682897 · Cited by 272
MOSNet: Deep Learning-Based Objective Assessment for Voice Conversion
Lo, C.-C., Fu, S.-W., Huang, W.-C., Wang, X., Yamagishi, J., Tsao, Y., & Wang, H.-M. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2003 · Cited by 256
Self-citationGeneralization Ability of MOS Prediction Networks
Cooper, E., Huang, W.-C., Toda, T., & Yamagishi, J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746395 · Cited by 233
Self-citationRecurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226
A survey on neural speech synthesis
Tan, X., Qin, T., Soong, F., & Liu, T.-Y. (2021) · arXiv · doi:10.48550/arxiv.2106.15561 · Cited by 216
Deep Residual Neural Networks for Audio Spoofing Detection
Alzantot, M., Wang, Z., & Srivastava, M. B. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-3174 · Cited by 215
StarGAN-VC2: Rethinking Conditional Methods for StarGAN-Based Voice Conversion
Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2236 · Cited by 203
Huang, W.-C., Cooper, E., Tsao, Y., Wang, H., Toda, T., & Yamagishi, J. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-970 · Cited by 196
Self-citationNautsch, A., Wang, X., Evans, N., Kinnunen, T. H., Vestman, V., Todisco, M., Delgado, H., Sahidullah, M., Yamagishi, J., & Lee, K. A. (2021) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2021.3059479 · Cited by 185
Self-citationEmotional voice conversion: Theory, databases and ESD
Zhou, K., Sisman, B., Liu, R., & Li, H. (2022) · Speech Communication · doi:10.1016/j.specom.2021.11.006 · Cited by 181
ACVAE-VC: Non-Parallel Voice Conversion With Auxiliary Classifier Variational Autoencoder
Kameoka, H., Kaneko, T., Tanaka, K., & Hojo, N. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2917232 · Cited by 181
Introducing the VoicePrivacy Initiative
Tomashenko, N., Srivastava, B. M. L., Wang, X., Vincent, E., Nautsch, A., Yamagishi, J., Evans, N., Patiño, J. F., Bonastre, J.-F., Noé, .-G., et al. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1333 · Cited by 180
Self-citationZero-Shot Multi-Speaker Text-To-Speech with State-Of-The-Art Neural Speaker Embeddings
Cooper, E., Lai, C.-I., Yasuda, Y., Fang, F., Wang, X., Chen, N., & Yamagishi, J. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054535 · Cited by 164
Self-citationWu, Z., Das, R. K., Yang, J., & Li, H. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1810 · Cited by 111
SC-GlowTTS: An Efficient Zero-Shot Multi-Speaker Text-To-Speech Model
Casanova, E., Shulby, C., Gölge, E., Müller, N. M., Oliveira, F. S. D., Candido Jr., A., Soares, A. D. S., Aluisio, S. M., & Ponti, M. A. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1774 · Cited by 83
Any-to-Many Voice Conversion With Location-Relative Sequence-to-Sequence Modeling
Liu, S., Cao, Y., Wang, D., Wu, X., Liu, X., & Meng, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3076867 · Cited by 83
WaveNet Vocoder with Limited Training Data for Voice Conversion
Liu, L.-J., Ling, Z.-H., Jiang, Y., Zhou, M., & Dai, L.-R. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1190 · Cited by 124
Self-citationMBNET: MOS Prediction for Synthesized Speech with Mean-Bias Network
Leng, Y., Tan, X., Zhao, S., Soong, F. K., Li, X., & Qin, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413877 · Cited by 140
Deepfake: definitions, performance metrics and standards, datasets, and a meta-review
Altuncu, E., Franqueira, V. N. L., & Li, S. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1400024 · Cited by 134
DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices
Wang, R., Juefei-Xu, F., Huang, Y., Guo, Q., Xie, X., Ma, L., & Liu, Y. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413716 · Cited by 131
Voice Conversion Challenge 2020 –- Intra-lingual semi-parallel and cross-lingual voice conversion –-
Yi, Z., Huang, W.-C., Tian, X., Yamagishi, J., Das, R. K., Kinnunen, T., Ling, Z.-H., & Toda, T. (2020) · Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020 · doi:10.21437/vcc_bc.2020-14 · Cited by 126
Self-citationCycleGAN-VC3: Examining and Improving CycleGAN-VCs for Mel-Spectrogram Conversion
Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2280 · Cited by 127
HIFI++: A Unified Framework for Bandwidth Extension and Speech Enhancement
Andreev, P., Alanov, A., Ivanov, O., & Vetrov, D. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097255 · Cited by 118
How do Voices from Past Speech Synthesis Challenges Compare Today?
Cooper, E., & Yamagishi, J. (2021) · ISCA Speech Synthesis Workshop (SSW) · doi:10.21437/ssw.2021-32 · Cited by 109
Self-citationLDNet: Unified Listener Dependent Modeling in MOS Prediction for Synthetic Speech
Huang, W.-C., Cooper, E., Yamagishi, J., & Toda, T. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747222 · Cited by 109
Self-citationDeep Learning Based Assessment of Synthetic Speech Naturalness
Mittag, G., & Möller, S. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2382 · Cited by 108
Shaaban, O. A., Yıldırım, R., & Alguttar, A. A. (2023) · IEEE Access · doi:10.1109/access.2023.3333866 · Cited by 107
Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversionPreprint
Zhao, Y., Huang, W.-C., Tian, X., Yamagishi, J., Das, R. K., Kinnunen, T., Ling, Z.-H., & Toda, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.12527 · Cited by 102
Self-citationA Survey on Speech Deepfake Detection
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2025) · ACM Computing Surveys · doi:10.1145/3714458 · Cited by 101
Supervised Determined Source Separation with Multichannel Variational Autoencoder
Kameoka, H., Li, L., Inoue, S., & Makino, S. (2019) · Neural Computation · doi:10.1162/neco_a_01217 · Cited by 100
CDPAM: Contrastive Learning for Perceptual Audio Similarity
Manocha, P., Jin, Z., Zhang, R., & Finkelstein, A. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413711 · Cited by 100
The Attacker’s Perspective on Automatic Speaker Verification: An Overview
Das, R. K., Tian, X., Kinnunen, T., & Li, H. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1052 · Cited by 76
Self-citationVoCo: text-based insertion and replacement in audio narration
Jin, Z., Mysore, G. J., Diverdi, S., Lu, J., & Finkelstein, A. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073702 · Cited by 64
The Singing Voice Conversion Challenge 2023
Huang, W.-C., Violeta, L. P., Liu, S., Shi, J., & Toda, T. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389671 · Cited by 97
Self-citationMaskcyclegan-VC: Learning Non-Parallel Voice Conversion with Filling in Frames
Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414851 · Cited by 92
Transfer Learning From Speech Synthesis to Voice Conversion With Non-Parallel Training Data
Zhang, M., Zhou, Y., Li, Z., & Li, H. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3066047 · Cited by 92
Text-Free Image-to-Speech Synthesis Using Learned Segmental Units
Hsu, W.-N., Harwath, D. F., Miller, T., Song, C., & Glass, J. R. (2021) · doi:10.18653/v1/2021.acl-long.411 · Cited by 89
Non-Parallel Voice Conversion with Cyclic Variational Autoencoder
Tobing, P. L., Wu, Y.-C., Hayashi, T., Kobayashi, K., & Toda, T. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2307 · Cited by 87
Self-citationCross-lingual Voice Conversion with Bilingual Phonetic Posteriorgram and Average Modeling
Zhou, Y., Tian, X., Xu, H., Das, R. K., & Li, H. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683746 · Cited by 86
Blow: a single-scale hyperconditioned flow for non-parallel raw-audio voice conversionPreprint
Serrà, J., Pascual, S., & Segura, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00794 · Cited by 88
SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesis
Maniati, G., Vioni, A., Ellinas, N., Nikitaras, K., Klapsas, K., Sung, J. S., Jho, G., Chalamandaris, A., & Tsiakoulis, P. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10922 · Cited by 85
NAUTILUS: A Versatile Voice Cloning System
Luong, H.-T., & Yamagishi, J. (2020) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3034994 · Cited by 68
Self-citationLee, P. Y. K., Ma, N. F., Kim, I.-J., & Yoon, D. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579524 · Cited by 84
SongEval: A Benchmark Dataset for Song Aesthetics EvaluationPreprint
Yao, J., Ma, G., Xue, H., Chen, H., Hao, C., Jiang, Y., Liu, H., Yuan, R., Xu, J., Xue, W., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.10793 · Cited by 84
Low-Resource Expressive Text-To-Speech Using Data Augmentation
Huybrechts, G., Merritt, T., Comini, G., Perz, B., Shah, R., & Lorenzo-Trueba, J. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413466 · Cited by 78
Self-citationTowards Multimodal Empathetic Response Generation: A Rich Text-Speech-Vision Avatar-based Benchmark
Zhang, H., Meng, Z., Luo, M., Han, H. W., Liao, L., Cambria, E., & Fei, H. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714739 · Cited by 78
Didispeech: A Large Scale Mandarin Speech Corpus
Guo, T., Cheng, W., Jiang, D., Luo, N., Zhang, R., Zhao, S., Li, W., Cheng, G., Zou, W., Han, K., et al. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414423 · Cited by 76
Utilizing Self-Supervised Representations for MOS Prediction
Tseng, W.-C., Huang, C., Kao, W.-T., Lin, Y. Y., & Lee, H.-Y. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-2013 · Cited by 75
A review on subjective and objective evaluation of synthetic speech
Cooper, E., Huang, W.-C., Tsao, Y., Wang, H., Toda, T., & Yamagishi, J. (2024) · Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi · doi:10.1250/ast.e24.12 · Cited by 75
Self-citationLong Range Acoustic and Deep Features Perspective on ASVspoof 2019
Das, R. K., Yang, J., & Li, H. (2019) · 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru46091.2019.9003845 · Cited by 65
ConvS2S-VC: Fully Convolutional Sequence-to-Sequence Voice Conversion
Kameoka, H., Tanaka, K., Kwaśny, D., Kaneko, T., & Hojo, N. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3001456 · Cited by 75
The Voicemos Challenge 2023: Zero-Shot Subjective Speech Quality Prediction for Multiple Domains
Cooper, E., Huang, W.-C., Tsao, Y., Wang, H., Toda, T., & Yamagishi, J. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389763 · Cited by 72
Self-citationSpeech is Silver, Silence is Golden: What do ASVspoof-trained Models Really Learn?
Müller, N., Dieckmann, F., Czempin, P., Canals, R., Böttinger, K., & Williams, J. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-9 · Cited by 69
An Enhanced Deep Learning-Based DeepFake Video Detection and Classification System
Awotunde, J. B., Jimoh, R. G., Imoize, A. L., Abdulrazaq, A. T., Li, C.-T., & Lee, C.-C. (2022) · Electronics · doi:10.3390/electronics12010087 · Cited by 47
Das, R. K., Kinnunen, T., Huang, W.-C., Ling, Z.-H., Yamagishi, J., Yi, Z., Tian, X., & Toda, T. (2020) · Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020 · doi:10.21437/vcc_bc.2020-15 · Cited by 49
Self-citationVoice Spoofing Countermeasure for Logical Access Attacks Detection
Arif, T., Javed, A., Alhameed, M., Jeribi, F., & Tahir, A. (2021) · IEEE Access · doi:10.1109/access.2021.3133134 · Cited by 48
Assessing the Scope of Generalized Countermeasures for Anti-Spoofing
Das, R. K., Yang, J., & Li, H. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053086 · Cited by 45
A study on data augmentation in voice anti-spoofing
Cohen, A., Rimon, I., Aflalo, E., & Permuter, H. H. (2022) · Speech Communication · doi:10.1016/j.specom.2022.04.005 · Cited by 60
Voice Conversion Based on Cross-Domain Features Using Variational Auto Encoders
Huang, W.-C., Hwang, H.-T., Peng, Y.-H., Tsao, Y., & Wang, H.-M. (2018) · 2018 11th International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp.2018.8706604 · Cited by 49
NORESQA: A Framework for Speech Quality Assessment using Non-Matching ReferencesPreprint
Manocha, P., Xu, B., & Kumar, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08125 · Cited by 61
Pretraining Techniques for Sequence-to-Sequence Voice Conversion
Huang, W.-C., Hayashi, T., Wu, Y.-C., Kameoka, H., & Toda, T. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3049336 · Cited by 57
Self-citationSpeechlmscore: Evaluating Speech Generation Using Speech Language Model
Maiti, S., Peng, Y., Saeki, T., & Watanabe, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095710 · Cited by 56
NVC-Net: End-To-End Adversarial Voice Conversion
Nguyen, B., & Cardinaux, F. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747020 · Cited by 56
Leveraging edges and optical flow on faces for deepfake detection
Chintha, A., Rao, A. G., Sohrawardi, S. J., Bhatt, K., Wright, M., & Ptucha, R. (2020) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb48548.2020.9304936 · Cited by 54
Poster: Towards Robust Open-World Detection of Deepfakes
Sohrawardi, S. J., Chintha, A., Thai, B., Seng, S., Hickerson, A., Ptucha, R., & Wright, M. (2019) · Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3319535.3363269 · Cited by 41
Preech: A System for Privacy-Preserving Speech TranscriptionPreprint
Ahmed, S., Chowdhury, A. R., Fawaz, K., & Ramanathan, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04198 · Cited by 54
Liz-López, H., Keïta, M., Ahmed, A. T., Hadid, A., Huertas‐Tato, J., & Camacho, D. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102103 · Cited by 54
Huang, W.-C., Luo, H., Hwang, H.-T., Lo, C.-C., Peng, Y.-H., Tsao, Y., & Wang, H.-M. (2020) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2020.2977678 · Cited by 53
Voice Mimicry Attacks Assisted by Automatic Speaker Verification
Vestman, V., Kinnunen, T., Hautamäki, R. G., & Sahidullah, M. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2019.05.005 · Cited by 49
Self-citationOne-Shot Voice Conversion with Global Speaker Embeddings
Lu, H., Wu, Z., Dai, D., Li, R., Kang, S., Jia, J., & Meng, H. M. L. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2365 · Cited by 47
Voice Conversion for Whispered Speech Synthesis
Cotescu, M., Drugman, T., Huybrechts, G., Lorenzo-Trueba, J., & Moinet, A. (2019) · IEEE Signal Processing Letters · doi:10.1109/lsp.2019.2961213 · Cited by 47
Self-citationWubet, Y. A., & Lian, K. (2022) · IEEE Access · doi:10.1109/access.2022.3200479 · Cited by 47
Many-To-Many Voice Conversion Using Conditional Cycle-Consistent Adversarial Networks
Lee, S., Ko, B., Lee, K., Yoo, I.-C., & Yook, D. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053726 · Cited by 46
Converting Foreign Accent Speech Without a Reference
Zhao, G., Ding, S., & Gutiérrez‐Osuna, R. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3060813 · Cited by 46
Refining the evaluation of speech synthesis: A summary of the Blizzard Challenge 2023
Perrotin, O., Stephenson, B., Gerber, S., Bailly, G., & King, S. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101747 · Cited by 45
EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model
Cui, C., Ren, Y., Liu, J., Chen, F., Huang, R., Lei, M., & Zhao, Z. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1148 · Cited by 43
Geometrically Constrained Independent Vector Analysis for Directional Speech Enhancement
Li, L., & Koishida, K. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053649 · Cited by 42
Generative Adversarial Networks in Human Emotion Synthesis: A Review
Hajarolasvadi, N., Ramírez, M. A., Beccaro, W., & Demirel, H. (2020) · IEEE Access · doi:10.1109/access.2020.3042328 · Cited by 42
TTS Skins: Speaker Conversion via ASR
Polyak, A., Wolf, L., & Taigman, Y. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1416 · Cited by 34
Sequence-to-Sequence Emotional Voice Conversion With Strength Control
Choi, H., & Hahn, M. (2021) · IEEE Access · doi:10.1109/access.2021.3065460 · Cited by 41
Semi-blind source separation with multichannel variational autoencoderPreprint
Kameoka, H., Li, L., Inoue, S., & Makino, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.00892 · Cited by 41
Many-to-Many Voice Transformer Network
Kameoka, H., Huang, W.-C., Tanaka, K., Kaneko, T., Hojo, N., & Toda, T. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3047262 · Cited by 42
Self-citationAn Adaptive-Learning-Based Generative Adversarial Network for One-to-One Voice Conversion
Dhar, S., Jana, N. D., & Das, S. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3149858 · Cited by 40
Controllable Accented Text-to-Speech Synthesis With Fine and Coarse-Grained Intensity Rendering
Liu, R., Şişman, B., Gao, G., & Li, H. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3378110 · Cited by 40
Wu, Y.-C., Hayashi, T., Okamoto, T., Kawai, H., & Toda, T. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3051765 · Cited by 37
Self-citationFusion of Self-supervised Learned Models for MOS Prediction
Yang, Z., Zhou, W., Chu, C., Li, S., Dabre, R., Rubino, R., & Zhao, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10262 · Cited by 37
From Audio Deepfake Detection to AI-Generated Music Detection–A Pathway and Overview
Li, Y.-P., Milling, M., Specia, L., & Schuller, B. (2024) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2026.3721724 · Cited by 28
Harder or Different? Understanding Generalization of Audio Deepfake Detection
Müller, N. M., Evans, N., Tak, H., Sperl, P., & Böttinger, K. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-247 · Cited by 37
Li, L., Kameoka, H., & Makino, S. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682623 · Cited by 35
Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speech
Shah, R., Pokora, K., Ezzerg, A., Klimkov, V., Huybrechts, G., Putrycz, B., Korzekwa, D., & Merritt, T. (2021) · ISCA Speech Synthesis Workshop (SSW) · doi:10.21437/ssw.2021-17 · Cited by 35
Wu, Y.-C., Hayashi, T., Tobing, P. L., Kobayashi, K., & Toda, T. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3061245 · Cited by 33
Self-citationNonparallel Voice Conversion With Augmented Classifier Star Generative Adversarial Networks
Kameoka, H., Kaneko, T., Tanaka, K., & Hojo, N. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3036784 · Cited by 33
The identification game: deepfakes and the epistemic limits of identity
Öhman, C. (2022) · Synthese · doi:10.1007/s11229-022-03798-5 · Cited by 32
Attention-based Wavenet Autoencoder for Universal Voice Conversion
Polyak, A., & Wolf, L. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682589 · Cited by 32
Metadata
- Authors
- Lorenzo-Trueba, J., Yamagishi, J., Toda, T., Saito, D., Villavicencio, F., Kinnunen, T., & Ling, Z.
- Affiliations
- National Institute of Informatics (JP)
- Nagoya University (JP)
- The University of Tokyo (JP)
- University of Eastern Finland (FI)
- Venue
- The Speaker and Language Recognition Workshop (Odyssey 2018)
- Publisher
- ISCA
- Published
- 2018-06-26
- Pages
- 195-202
- OpenAlex
- W2963035245
- Cited by
- 305
- References
- 38
- Citations by year
- 2026: 10 · 2025: 22 · 2024: 17 · 2023: 39 · 2022: 40 · 2021: 54 · 2020: 62 · 2019: 48 · 2018: 12
- FWCI
- 17.89
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- The Speaker and Language Recognition Workshop (Odyssey) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- voice conversion, parallel data, naturalness, speech synthesis evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.