VQVC+: One-Shot Voice Conversion by Vector Quantization and U-Net Architecture
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Voice conversion (VC) is a task that transforms the source speaker's timbre, accent, and tones in audio into another one's while preserving the linguistic content.It is still a challenging work, especially in a one-shot setting.Auto-encoder-based VC methods disentangle the speaker and the content in input speech without given the speaker's identity, so these methods can further generalize to unseen speakers.The disentangle capability is achieved by vector quantization (VQ), adversarial training, or instance normalization (IN).However, the imperfect disentanglement may harm the quality of output speech.In this work, to further improve audio quality, we use the U-Net architecture within an auto-encoder-based VC system.We find that to leverage the U-Net architecture, a strong information bottleneck is necessary.The VQ-based method, which quantizes the latent vectors, can serve the purpose.The objective and the subjective evaluations show that the proposed method performs well in both audio naturalness and speaker similarity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent research [59,60,61,62,63] in VC technologies has addressed long-standing challenges such as data scarcity, cross-lingual conversion, and real-time processing.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [61]
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727
Instance Normalization: The Missing Ingredient for Fast Stylization
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08022 · Cited by 2,775
Neural Discrete Representation Learning
Oord, A. V. D., Vinyals, O., & Kavukcuoglu, K. (2017) · arXiv · doi:10.48550/arxiv.1711.00937 · Cited by 2,729
Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter Trajectory
Toda, T., Black, A. W., & Tokuda, K. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.907344 · Cited by 937
Continuous probabilistic transform for voice conversion
Stylianou, Y., Cappe, O., & Moulines, E. (1998) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.661472 · Cited by 931
MelGAN: generative adversarial networks for conditional waveform synthesis
Kumar, K., Kumar, R., de Boissiere, T., Gestin, L., Teoh, W. Z., Sotelo, J., de Brebisson, A., Bengio, Y., & Courville, A. (2019) · arXiv · doi:10.48550/arxiv.1910.06711 · Cited by 722
SUPERSEDED - CSTR VCTK Corpus: English Multi-speaker Corpus for CSTR Voice Cloning Toolkit
Veaux, C., Yamagishi, J., & MacDonald, K. (2016) · University of Edinburgh. The Centre for Speech Technology Research (CSTR) · doi:10.7488/ds/1495 · Cited by 434
Cited by
An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Sisman, B., Yamagishi, J., King, S., & Li, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3038524 · Cited by 357
Wang, D., Deng, L., Yeung, Y. T., Chen, X. D., Liu, X., & Meng, H. M. L. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-283 · Cited by 217
Freevc: Towards High-Quality Text-Free One-Shot Voice Conversion
Li, J., Tu, W., & Xiao, L. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49357.2023.10095191 · Cited by 129
Again-VC: A One-Shot Voice Conversion Using Activation Guidance and Adaptive Instance Normalization
Chen, Y.-H., Wu, D.-Y., Wu, T.-H., & Lee, H.-Y. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414257 · Cited by 147
Self-citationNeural Analysis and Synthesis: Reconstructing Speech from Self-Supervised RepresentationsPreprint
Choi, H., Lee, J., Kim, W., Lee, J. H., Heo, H., & Lee, K. (2021) · Neural Information Processing Systems · doi:10.48550/arxiv.2110.14513 · Cited by 205
Diffusion-Based Voice Conversion with Fast Maximum Likelihood Sampling SchemePreprint
Popov, V., Vovk, I., Gogoryan, V., Sadekova, T., Kudinov, M., & Wei, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.13821 · Cited by 144
Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead
Zhang, B., Cui, H., Nguyen, V., & Whitty, M. (2025) · Sensors · doi:10.3390/s25071989 · Cited by 72
S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations
Lin, J.-H., Lin, Y. Y., Chien, C.-M., & Lee, H.-Y. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1356 · Cited by 73
Self-citationAvqvc: One-Shot Voice Conversion By Vector Quantization With Applying Contrastive Learning
Tang, H., Zhang, X., Wang, J., Cheng, N., & Xiao, J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746369 · Cited by 75
"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real World
Wenger, E., Bronckers, M., Cianfarani, C., Cryan, J., Sha, A., Zheng, H.-T., & Zhao, B. Y. (2021) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3460120.3484742 · Cited by 75
The Multi-Speaker Multi-Style Voice Cloning Challenge 2021
Xie, Q., Tian, X., Liu, G., Song, K., Xie, L., Wu, Z., Li, H. H., Shi, S. X., Li, H., Hong, F., et al. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414001 · Cited by 42
How Far Are We from Robust Voice Conversion: A Survey
Huang, T.-H., Lin, J.-H., & Lee, H.-Y. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383498 · Cited by 39
Self-citationDRVC: A Framework of Any-to-Any Voice Conversion with Self-Supervised Learning
Wang, Q., Zhang, X., Wang, J., Cheng, N., & Xiao, J. Z. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747434 · Cited by 32
TriAAN-VC: Triple Adaptive Attention Normalization for Any-to-Any Voice Conversion
Park, H. J., Yang, S. W., Kim, J. S., Shin, W., & Han, S. W. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096642 · Cited by 40
NSVQ: Noise Substitution in Vector Quantization for Machine Learning
Vali, M. H., & Bäckström, T. (2022) · IEEE Access · doi:10.1109/access.2022.3147670 · Cited by 42
Gabryś, A., Huybrechts, G., Ribeiro, M. S., Chien, C.-M., Roth, J., Comini, G., Barra-Chicote, R., Perz, B., & Lorenzo-Trueba, J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747239 · Cited by 29
TGAVC: Improving Autoencoder Voice Conversion with Text-Guided and Adversarial Training
Tang, H., Zhang, X., Wang, J., Cheng, N., Zeng, Z., Xiao, E., & Xiao, J. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688088 · Cited by 25
UNET-TTS: Improving Unseen Speaker and Style Transfer in One-Shot Voice Cloning
Li, R., Pu, D., Huang, M., & Huang, B. X. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746049 · Cited by 27
Wav2vec-VC: Voice Conversion via Hidden Representations of Wav2vec 2.0
Lim, J., & Kim, K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447984 · Cited by 22
Many-to-Many Voice Conversion Based Feature Disentanglement Using Variational Autoencoder
Luong, M., & Tran, V. A. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-2086 · Cited by 22
Face-based Voice Conversion: Learning the Voice behind a Face
Lu, H.-H., Weng, S.-E., Yen, Y.-F., Shuai, H.-H., & Cheng, W.-H. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475198 · Cited by 23
Bargum, A. R., Serafin, S., & Erkut, C. (2024) · Frontiers in Signal Processing · doi:10.3389/frsip.2024.1339159 · Cited by 15
Zhang, H., Cai, Z., Qin, X., & Li, M. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746048 · Cited by 19
Revisiting U-Net: a foundational backbone for modern generative AI
Ignacio, M. J., Shin, S., Jin, H., Yoo, S. J., Han, D., & Kim, Y.-G. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11450-0 · Cited by 13
Disentangled Speech Representation Learning for One-Shot Cross-Lingual Voice Conversion Using ß-VAE
Lu, H., Wang, D., Wu, X., Wu, Z., Liu, X., & Meng, H. M. L. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022787 · Cited by 21
Active Defense Against Voice Conversion Through Generative Adversarial Network
Dong, S., Chen, B., Ma, K., & Zhao, G. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3365034 · Cited by 22
Speaker Adaptation For Enhancement Of Bone-Conducted Speech
Edraki, A., Chan, W.-Y., Jensen, J., & Fogerty, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447322 · Cited by 10
A Unified One-Shot Prosody and Speaker Conversion System with Self-Supervised Discrete Speech Units
Chen, L., Watanabe, S., & Rudnicky, A. I. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095565 · Cited by 14
NoiseVC: Towards High Quality Zero-Shot Voice ConversionPreprint
Wang, S., & Borth, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06074 · Cited by 9
Zero-Shot Voice Conversion via Content-Aware Timbre Ensemble and Conditional Flow Matching
Pan, Y., Yang, Y., Yao, J., Ma, L., & Zhao, J. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3618764 · Cited by 9
Zero-shot Voice Conversion via Self-supervised Prosody Representation Learning
Wang, S., & Borth, D. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892405 · Cited by 11
Reconstructing Dual Learning for Neural Voice Conversion Using Relatively Few Samples
Sun, A., Wang, J., Cheng, N., Tantrawenith, M., Wu, Z., Meng, H. M. L., Xiao, E., & Xiao, J. Z. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9687965 · Cited by 7
Tang, H., Zhang, X., Wang, J., Cheng, N., & Xiao, J. Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095654 · Cited by 9
HybridVC: Efficient Voice Style Conversion with Text and Audio Prompts
Niu, X., Zhang, J., & Martin, C. P. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-46 · Cited by 10
Random Cycle Loss and Its Application to Voice Conversion
Sun, H., Wang, D., Li, L., Chen, C., & Zheng, T. F. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3257839 · Cited by 11
One-shot voice conversion using a combination of U2-Net and vector quantization
Liu, F., Wang, H., Ke, Y., & Zheng, C. (2022) · Applied Acoustics · doi:10.1016/j.apacoust.2022.109014 · Cited by 7
VQ-CTAP: Cross-Modal Fine-Grained Sequence Representation Learning for Speech Processing
Qiang, C., Wang, G., Zhao, Y., Fu, R., Wang, T., Cheng, G., Wang, T., Liu, Q., Yi, J., Wen, Z., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3564168 · Cited by 12
One-shot emotional voice conversion based on feature separation
Lu, W., Zhao, X., Guo, N., Li, Y., Wei, J., Tao, J., & Dang, J. (2022) · Speech Communication · doi:10.1016/j.specom.2022.07.001 · Cited by 10
Multi-Level Temporal-Channel Speaker Retrieval for Zero-Shot Voice Conversion
Wang, Z., Xue, L., Kong, Q., Xie, L., Chen, Y., Tian, Q., & Wang, Y. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3407577 · Cited by 8
Self-citationOCTOPUS: Overcoming Performance and Privatization Bottlenecks in Distributed Learning
Wang, S., Nepal, ., Moore, K., Grobler, M. M., Rudolph, C., & Abuadbba, A. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3157258 · Cited by 9
Improving Spoofing Capability for End-to-end Any-to-many Voice Conversion
Hua, H., Chen, Z., Zhang, Y., Li, M., & Zhang, P. (2022) · doi:10.1145/3552466.3556532 · Cited by 7
WaveVC: Speech and Fundamental Frequency Consistent Raw Audio Voice Conversion
Ko, K., Kim, D., Oh, K., & Ko, H. (2024) · Neural Processing Letters · doi:10.1007/s11063-024-11613-0 · Cited by 5
Behdad, M., & Gharavian, D. (2024) · IEEE Access · doi:10.1109/access.2024.3471926 · Cited by 5
Investigation into Target Speaking Rate Adaptation for Voice Conversion
Kuhlmann, M. T., Seebauer, F., Ebbers, J., Wagner, P., & Haeb‐Umbach, R. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10740 · Cited by 6
StyleVC: Non-Parallel Voice Conversion with Adversarial Style Generalization
Hwang, I.-S., Lee, S.-H., & Lee, S. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956613 · Cited by 9
Learning Speech Representations with Flexible Hidden Feature Dimensions
Tang, H., Zhang, X., Wang, J., Cheng, N., & Xiao, J. Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094969 · Cited by 7
Learning Disentangled Speech Representations with Contrastive Learning and Time-Invariant Retrieval
Deng, Y., Tang, H., Zhang, X., Cheng, N., Xiao, J., & Wang, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447283 · Cited by 6
Conditional Deep Hierarchical Variational Autoencoder for Voice ConversionPreprint
Akuzawa, K., Onishi, K., Takiguchi, K., Mametani, K., & Mori, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.02796 · Cited by 10
Weng, S.-E., Shuai, H.-H., & Cheng, W.-H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26607 · Cited by 7
Yuguang, Y., Pan, Y., Yao, J., Zhang, X., Ye, J., Zhou, H., Xie, L., Ma, L., & Zhao, J. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.87 · Cited by 8
U2-VC: one-shot voice conversion using two-level nested U-structure
Liu, F., Wang, H., Peng, R., Zheng, C., & Li, X. (2021) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-021-00226-3 · Cited by 4
A Review of User Identification Methods Based on Digital Fingerprint
Владимирович, О. А., & Murashko, Y. (2023) · Proceedings of Telecommunication Universities · doi:10.31854/1813-324x-2023-9-5-91-111 · Cited by 4
DQR-TTS: Semi-supervised Text-to-speech Synthesis with Dynamic Quantized Representation
Wang, J., Li, P., Zhang, X., Cheng, N., & Xiao, J. Z. (2023) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom59178.2023.00154 · Cited by 4
Stochastic Optimization of Vector Quantization Methods in Application to Speech and Image Processing
Vali, M. H., & Bäckström, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096204 · Cited by 3
Any-to-Any Voice Conversion With Multi-Layer Speaker Adaptation and Content Supervision
Xu, X., Shi, L., Chen, X., Lin, P., Lian, J., Chen, J., Zhang, Z., & Hancock, E. R. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3306716 · Cited by 5
MAIN-VC: Lightweight Speech Representation Disentanglement for One-shot Voice Conversion
Li, P., Wang, J., Zhang, X., Zhang, Y., Xiao, J. Z., & Cheng, N. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10649929 · Cited by 4
Non-Parallel Any-to-Many Voice Conversion by Replacing Speaker Statistics
Liu, Y., Yu, C., Shuai, W., Yang, Z., Chao, Y., & Zhang, W. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-557 · Cited by 5
Unsupervised Quantized Prosody Representation for Controllable Speech Synthesis
Wang, Y., Xie, Y., Zhao, K., Wang, H., & Zhang, Q. (2022) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859946 · Cited by 4
Du, Z., Şişman, B., Zhou, K., & Li, H. (2021) · arXiv (Cornell University) · Cited by 3
Nørskov, A. V., Zahid, A. N., & Mørup, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.07788 · Cited by 5
Jahan, F., Shifat, S. M., Morol, M. K., Fahad, N., Goh, K. O. M., Nandi, D., Abdullah-Al-Jubair, M., & Hossen, M. J. (2026) · Discover Applied Sciences · doi:10.1007/s42452-026-08402-w · Cited by 2
Voice Conversion Using Learnable Similarity-Guided Masked Autoencoder
Gu, Y., Zhao, X., Yi, X., & Xiao, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25115-3_4 · Cited by 3
Ke, D., Yao, W., Hu, R., Huang, L., Luo, Q., & Shu, W. (2022) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp57327.2022.10038137 · Cited by 2
DVQVC: An Unsupervised Zero-Shot Voice Conversion Framework
Li, D., Li, X., & Li, X. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095393 · Cited by 8
Arbitrary Voice Conversion via Adversarial Learning and Cycle Consistency Loss
Lian, J., Lin, P., Dai, Y., & Li, G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-13829-4_49 · Cited by 2
Kishida, T., & Nakashika, T. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9980151 · Cited by 3
Enhanced exemplar autoencoder with cycle consistency loss in any-to-one voice conversionPreprint
Liang, W., Li, L., Du, W., & Wang, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.03847 · Cited by 2
Automatic Collection of Transcribed Speech for Low Resources Languages
de Lima, T. A., & Costa‐Abreu, M. D. (2023) · International Conference on Pattern Recognition Systems (ICPRS) · doi:10.1109/icprs58416.2023.10179033 · Cited by 1
Emotion transfer in audio using mel-cepstral representation and CycleGANs
Han, G., Zhao, J., & Zhou, Y. (2025) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00082-7 · Cited by 1
In This Environment, As That Speaker: A Text-Driven Framework for Multi-Attribute Speech Conversion
Jin, J., Yang, Z., Zhou, Y., & Wu, Z. (2025) · Interspeech (USB) · doi:10.21437/interspeech.2025-2697 · Cited by 1
Two-Pathway Style Embedding for Arbitrary Voice Conversion
Xu, X., Shi, L., Chen, J., Chen, X., Lian, J., Lin, P., Zhang, Z., & Hancock, E. R. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-506 · Cited by 2
WINVC: One-Shot Voice Conversion with Weight Adaptive Instance Normalization
Huang, S., Chen, M., Xu, Y., Ke, D., & Hain, T. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-89363-7_42 · Cited by 1
Li, W., & Wei, T.-J. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9979975 · Cited by 2
High Quality and Similarity One-Shot Voice Conversion Using End-to-End Model
Du, R., & Yao, J. (2022) · doi:10.1145/3577530.3577575 · Cited by 1
CNEG-VC: Contrastive Learning Using Hard Negative Example In Non-Parallel Voice Conversion
Prihasto, B., Lin, Y.-X., Le, P. T., Huang, C.-L., & Wang, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094995 · Cited by 2
Deng, Y., Wang, J.-Z., Zhang, X., Cheng, N., & Xiao, J. (2024) · IEEE International Joint Conference on Neural Network · doi:10.1109/ijcnn60899.2024.10650293 · Cited by 2
Learning in your voice: Non-parallel voice conversion based on speaker consistency lossPreprint
Kwon, Y., Chung, S.-W., Heo, H.-S., & Kang, H.-G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02168 · Cited by 1
Neural Conversion of Social Attitudes in Speech Signals
Veillon, C. L. M. (2023) · theses.fr (ABES) · doi:10.70675/26188a9az8183z44bez8209z26e91c50ae8f · Cited by 2
Zhang, H., Cai, Z., Qin, X., & Li, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.03811 · Cited by 1
Controllable voice conversion based on quantization of voice factor scores
Isako, T., Onishi, K., Kishida, T., & Nakashika, T. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9979912
Zero-Shot Voice Conversion Based on Speaker Embedding Domain Generalization
Lin, Y.-X., Cheng, C.-H., Le, P. T., Huang, B.-J., Chu-Xin, L., Huang, C.-L., & Wang, J. (2023) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf60135.2023.10471830
Liu, F., Wang, H., Li, X., & Zheng, C. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4798860
VQStarGAN: An Unseen-to-Unseen, Zero-Shot, Non-Parallel, Unsupervised Voice Conversion
Yue, H.-Y., Lee, C.-H.-M., Mak, T.-Y., Lau, W.-Y., & Lam, K. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650185
Real-Time One-Shot Voice Conversion Based on High-Order Recursive Networks
Lin, C., & Lai, J. (2024) · International Conference on Imaging, Signal Processing and Communications (ICISPC) · doi:10.1109/icispc63824.2024.00031
Impact of Target Speech Length on Performance in Voice Conversion Modeling
Cha, H., Kim, M., Yoon, J., & Kang, H.-G. (2024) · IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia) · doi:10.1109/icce-asia63397.2024.10773691
Discrete Unit Based Masking For Improving Disentanglement in Voice Conversion
Lee, P. H., Ülgen, İ. R., & Şişman, B. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832297 · Cited by 2
Kishida, T., & Nakashika, T. (2025) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2024edp7206
Voice Conversion for Low-Resource Languages via Knowledge Transfer and Domain-Adversarial Training
Tu, H. T., Long, L. P., Huan, V. P., Thao, N. T. P., Thang, N. V., Cường, N. T., & Trang, N. T. T. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889083
USIAL-VC: A One-Shot Voice Conversion by U-Net-Based Encoder and Speaker Identity Adaptive Learning
Peng, Y., & Wang, Y. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4279-3_10
RE-VC: Robust Zero-Shot Voice Conversion Model for Realistic Environments
Ho, L., Hao, D., Nguyen, M., & Chau, D. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-5881-7_22
PMIVC: Perturbation with Mutual Information Learning for One-Shot Voice Conversion
Wang, L., Zhang, H., Jiang, Y., Dong, H., Guo, P., & Zou, H. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-2528-4_34
Disentangling Segmental and Prosodic Factors to Non-Native Speech Comprehensibility
Quamer, W., & Gutiérrez‐Osuna, R. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3592320 · Cited by 3
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching
Zuo, J., Ji, S., Fang, M., Li, M., Jiang, Z. K., Cheng, X., Yang, X., Chen, F., Duan, X., & Zhao, Z. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.790 · Cited by 3
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow MatchingPreprint
Zuo, J., Ji, S., Fang, M., Li, M., Jiang, Z. K., Cheng, X., Yang, X., Chen, F., Duan, X., & Zhao, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.01014 · Cited by 1
Neural networks for singing voice extraction in monaural polyphonic music signals
Chandna, P. (2021) · Repositori digital de la UPF (Universitat Pompeu Fabra)
Vector quantization in deep neural networks for speech and image processing
Vali, M. H. (2025) · Aaltodoc (Aalto University) · Cited by 5
VQ-CycleDiffusion: Vector Quantized Cycle-Consistent Diffusion Models for Voice Conversion
Yook, D., Kim, S., & Chang, H.-P. (2026) · Applied Sciences · doi:10.3390/app16189314
Metadata
- Authors
- Wu, D.-Y., Chen, Y.-H., & Lee, H.-Y.
- Affiliations
- National Taiwan University (TW)
- Corresponding author
- Lee, Hung-yi
- Venue
- Interspeech 2020
- Publisher
- ISCA
- Published
- 2020-10-25
- Pages
- 4691-4695
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3096524539
- Cited by
- 88
- References
- 28
- Citations by year
- 2026: 2 · 2025: 11 · 2024: 15 · 2023: 19 · 2022: 19 · 2021: 19 · 2020: 3
- FWCI
- 5.72
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- public-domain
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, public-domain)
- arXiv (Cornell University) (public-domain)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- voice conversion, vector quantization, U-Net, autoencoder, disentanglement, latent representations, information bottleneck, timbre transfer, sound quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.