The DOI matches its Crossref record; 56 of the 58 references it cites were found in a registry or an index.
CycleGAN-VC2: improved CycleGAN-based non-parallel voice conversion.
Abstract
Non-parallel voice conversion (VC) is a technique for learning the mapping from source to target speech without relying on parallel data. This is an important task, but it has been challenging due to the disadvantages of the training conditions. Recently, CycleGAN-VC has provided a breakthrough and performed comparably to a parallel VC method without relying on any extra data, modules, or time alignment procedures. However, there is still a large gap between the real target and converted speech, and bridging this gap remains a challenge. To reduce the gap, we propose CycleGAN-VC2, which is an improved version of CycleGAN-VC incorporating three new techniques: an improved objective (two-step adversarial losses), improved generator (2-1-2D CNN), and improved discriminator (PatchGAN). We evaluated our method on a non-parallel VC task and analyzed the effect of each technique in detail. An objective evaluation showed that these techniques help bring the converted feature sequence closer to the target in terms of both global and local structures, which we assess by using Mel-cepstral distortion and modulation spectra distance, respectively. A subjective evaluation showed that CycleGAN-VC2 outperforms CycleGAN-VC in terms of naturalness and similarity for every speaker pair, including intra-gender and inter-gender pairs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To improve the stability of the training process, an additional cycle-consistency loss function was proposed to optimize the structure of GAN, which was defined as cycle GANs (Kaneko et al., 2019).”
From Data Augmentation for Deep Neural Networks Model in EEG Classification Task: A Review (2021) · cites this paper as Kaneko et al., 2019
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,119
GAN(Generative Adversarial Nets)
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., & Wang, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.207 · Cited by 7,570
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Flagged first, then by citations
2 of the 58 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 201–270 of 270
A Task-Oriented Deep Learning Approach for Human Localization
Chen, Y., Chen, W., Zhang, S. Q., Huang, H., & Kung, H. T. (2024) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2024.3485886 · Cited by 1
Preserving Voice Message Integrity: Strategies Against AI Cloning
Sakka, S., Liagkou, V., & Stylios, C. D. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-87532-8_39 · Cited by 1
MaskCycleGAN-based Whisper to Normal Speech Conversion
Joysingh, S. J., Gupta, K., Ramnath, K., Vijayalakshmi, P., & Nagarajan, T. (2025) · International Conference on Bio Signals, Images, and Instrumentation (ICBSII) · doi:10.1109/icbsii65145.2025.11013379 · Cited by 1
MetaSpeech: Speech Effects Switch Along with Environment for Metaverse
Zhang, X., Wang, J., Cheng, N., & Xiao, J. Z. (2022) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn57253.2022.00136 · Cited by 1
EG-GAN: Cross-Language Emotion Gain Synthesis based on Cycle-Consistent Adversarial Networks.Preprint
Jia, X., Tai, J., Huang, Q., Li, Y., Zhang, W., & Du, H. (2019) · arXiv (Cornell University) · Cited by 1
Many-to-Many Voice Conversion using Cycle-Consistent Variational Autoencoder with Multiple DecodersPreprint
Lee, K., Yoo, I.-C., & Yook, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06805 · Cited by 1
CinC-GAN for Effective F0 prediction for Whisper-to-Normal Speech ConversionPreprint
Patel, M., Purohit, M., Shah, J., & Patil, H. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.07788 · Cited by 1
MaskCycleGAN-VC: Learning Non-parallel Voice Conversion with Filling in FramesPreprint
Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12841 · Cited by 1
Self-citationSaito, Y., Akuzawa, K., & Tachibana, K. (2020) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2019edp7297
A Robust Framework for High-Quality Voice Conversion with Conditional Generative Adversarial Network
Chen, L., Wang, Y., Liu, Y., Xiao, W., & Xie, H. (2020) · Communications in computer and information science · doi:10.1007/978-981-15-8083-3_18
Towards Low-Resource StarGAN Voice Conversion using Weight Adaptive Instance Normalization
Chen, M., Shi, Y., & Hain, T. (2020) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.2010.11646
A Color Adaptation Method in Picture Story with Emotional Expression of Body Motion
Chi, H. T. K., Takano, K., & Li, K. F. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-75078-7_62
Learning to Model Prosodic and Spectral Features for Non-parallel Emotive Speech Conversion
Dumpala, S. H., & Oore, S. (2021) · doi:10.21428/594757db.930ce165
Automatic Speech Recognition for the Archive of Ainu Folklores
Matsuura, K., Mimura, M., & Kawahara, T. (2021) · Journal of Natural Language Processing · doi:10.5715/jnlp.28.824
VSUGAN unify voice style based on spectrogram and generated adversarial networks
Ouyang, T., Yang, Z., Xie, H., Hu, T., & Liu, Q. (2021) · Scientific Reports · doi:10.1038/s41598-021-03770-2
Midtlyng, M., Sato, Y., & Hosobe, H. (2022) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00604-6
Speech Generation by Generative Adversarial Network
Chen, Y. (2021) · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE) · doi:10.1109/icbase53849.2021.00086
SSCGAN: speech style conversion based on GAN
Mao, W., Li, J., Guo, X., Shen, R., Lu, H., Cao, Z., Wang, X., & Zhang, C. (2022) · International Conference on Algorithms, Microchips, and Network Applications (AMNA) · doi:10.1117/12.2636492
The UFRJ Entry for the Voice Conversion Challenge 2020
da Costa, V. P., Maia, R., Quintanilha, I. M., Netto, S. L., & Biscainho, L. W. P. (2020) · doi:10.21437/vcc_bc.2020-29
Non-Parallel Denoised Voice Conversion using Vector Quantisation
Prasad, S., Manu, A., Kapoor, A., Pujara, V., & Sampatrao, G. S. (2022) · International Conference on Recent Trends in Computer Science and Technology (ICRTCST) · doi:10.1109/icrtcst54752.2022.9782001
An Audio Frequency Unfolding Framework for Ultra-Low Sampling Rate Sensors
Gao, Z., Tang, M., Li, A., & Chen, Y. (2022) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed54688.2022.9806149
Mel-S3r: Combining Mel-Spectrogram and Self-Supervised Speech Representation for Voice ConversionPreprint
Yang, J., Zhou, Y. X., & Huang, H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4183301
Schiller, D., Mertes, S., van Rijn, P., & André, E. (2022) · doi:10.1145/3551876.3554816
Evaluation of Linguistic Properties of Synthesized Laughter Using its Transcription
Suto, N., & Kondo, K. (2022) · IEEE Global Conference on Consumer Electronics (GCCE) · doi:10.1109/gcce56475.2022.10014253
Chen, P., & Soo, V. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097009
Speech enhancement by CycleGAN using feature map regularization
Popovic, B. Z., & Janev, M. B. (2023) · Journal of Computer and Forensic Sciences · doi:10.5937/jcfs2-45100
Disentangling Content Information by Combining ASR and TTS Bottleneck Features for Voice Conversion
Zhao, Z., Ma, S., Jia, Y., Hou, J., Yang, L., & Wang, J. (2023) · International Journal of Asian Language Processing · doi:10.1142/s271755452350011x
Huang, R., Zhang, M., Huang, K., & Huang, W. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-5847-4_7
Zhang, Z., & Zhang, B. (2023) · International Conference on Information Systems Engineering (ICISE) · doi:10.1109/icise60366.2023.00007
Accent-Preserving Voice Conversion between Native-Nonnative Speakers for Second Language Learning
Correa, I., Ueno, S., & Lee, A. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317245
Can We Transfer Noise Patterns? A Multi-environment Spectrum Analysis Model Using Generated Cases
Du, H., Ju, Z., An, Y., Du, H., Zhu, D., Tian, Z., Lawlor, A., & Dong, R. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-8184-7_10
Yang, Y., Wang, L., Gao, S., Yu, Z., & Dong, L. (2024) · Communications in computer and information science · doi:10.1007/978-981-99-9640-7_14
End-to-End Cross-Lingual Voice Conversion using CycleGAN for Low Resource Indian Languages
Khadse, P. S., Chandra, S., Mukherjee, S., Bharati, P., Pramanik, D., Aitawade, A., & Mandal, S. K. D. (2023) · International Conference on Speech Database and Assessments · doi:10.1109/o-cocosda60357.2023.10482914
Liu, F., Wang, H., Li, X., & Zheng, C. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4798860
Unified model for voice conversion of speech and singing voice using adaptive pitch constraints
Fukawa, S., Nose, T., Imai, S., & Ito, A. (2024) · Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi · doi:10.1250/ast.e24.47
Investigating Self-Supervised Features for Expressive, Multilingual Voice Conversion
Martín-Cortinas, Á., Sáez-Trigueros, D., Beringer, G., Vallés-Ṕerez, I., Barra-Chicote, R., Vecino, B. T., Gabryś, A., Merritt, T., Biliński, P., & Lorenzo-Trueba, J. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10627128
Imai, S., Kanagaki, A., Nose, T., Fukawa, S., & Ito, A. (2024) · Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi · doi:10.1250/ast.e24.46
Voice Conversion Based Data Augmentation Using CycleGAN for Children's ASR
Singh, D. K., Amin, P. P., Patil, H. A., & Sailor, H. B. (2024) · International Conference on Signal Processing and Communications (SPCOM) · doi:10.1109/spcom60851.2024.10631628
What's the Real: A Novel Design Philosophy for Robust AI-Synthesized Voice Detection
Xuan, H., Liu, X., Tan, Y., Liu, G., Li, S., Niu, W., Zhou, R., & Zhou, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681100 · Cited by 1
Kawa, R., Banno, H., & Asahi, K. (2024) · IEEJ Transactions on Electronics Information and Systems · doi:10.1541/ieejeiss.144.1136
Kawa, R., Banno, H., & Asahi, K. (2025) · Electronics and Communications in Japan · doi:10.1002/ecj.12482
CSA-VC: Contrastive Learning With Selective Attention in Non-Parallel Voice Conversion
Prihasto, B., Lin, Y.-X., Le, P. T., Wang, J., & Wu, C. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3542288
Kishida, T., & Nakashika, T. (2025) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2024edp7206
Learning Control of Neural Sound Effects Synthesis from Physically Inspired Models
Zong, Y., & Reiss, J. D. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889683
Noise and Reverberation-Controllable Voice Conversion
Choi, Y., Xie, C., & Toda, T. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3578761
An Adaptive Stacking Ensemble for Multilingual Speech Forgery DetectionPreprint
Hung, C. H., Wang, S., & Fang, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5354085
Esposito, S., Sgandurra, D., Giampaolo Bella, A., & O’Keeffe, D. (2025) · Springer eBooks · doi:10.1007/978-3-031-88145-9_2
A Stable and Robust Emotional Voice Conversion Framework Using CycleGAN
Kumar, V., Varghese, A., Sharma, V., & Bakshi, N. (2025) · International Conference on Computing for Sustainable Global Development · doi:10.23919/indiacom66777.2025.11115407
Challenges and Opportunities of Generative Ai Models in Audio/AcousticPreprint
Dibbo, S. V., Lin, C.-H., & Vhaduri, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5404604
Bridging the Gap: Converting Read Text to Conversational Dialogue
Singla, P., Banerjee, A., Arora, A., Aggarwal, S., Verma, A. K., Vikram, C. M., Gohil, R. P., & Agarwal, G. K. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-6681-2_38
Deep Learning Models for Medical Image Translation
Chen, Y., Lin, L., & Jain, R. K. (2025) · Intelligent systems reference library · doi:10.1007/978-3-031-94791-9_9
Autonomous Vehicle License Plate Image Restoration and Recognition: A Comparative Analysis
Sharma, D., Sharma, S., & Bhatnagar, V. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-95-0629-3_31
Kobayashi, S., Nose, T., & Ito, A. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249275
Improving Automatic Speech Recognition Model for Super-Elderly Voice Using Speech Synthesis Model
Uematsu, R., Leow, C. S., Kitaoka, N., & Nishizaki, H. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11248972
MultiSiFer: Detecting Multiple-Speaker Fake Voice Without Speaker-Irrelative Features
Liu, X., Xuan, H., Yu, Z., Zhang, Z., Fei, Q., & Zhou, Q. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3648834
Long, P., & Guo, X. (2026) · Springer eBooks · doi:10.1007/978-981-96-9404-4_12
Jia, N., & Zheng, C. (2026) · Sound&Vibration · doi:10.59400/sv3603
Garg, A., Cai, Z., Xinyuan, H. L., Garcia, L. P., Duh, K., Wiesner, M., & Andrews, N. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434594 · Cited by 1
CLARIS: Clear and Intelligible Speech from Whispered and Dysarthric Voices
Shah, N., Sonkar, Y., Karande, S. S., & Gandhi, V. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791734
Sun, W., Liu, Z., Sun, Y., Chen, L., Yan, B., & Yang, Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461934
Cyclegan++: enhancing performance through parameter sharing and domain alignment
Mahmoudabadi, M., & Rezghi, M. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21645-4
Instrument-to-Instrument Timbre Conversion Using MaskCycleGAN
Lai, W.-H., & Hsieh, C.-W. (2026) · International Conference on Information Networking · doi:10.1109/icoin68469.2026.11480919
Protecting Intellectual Property in GANs: Challenges and Technical Approaches for Data Security
Gudivaka, M. (2026) · IEEE International Conference on Emerging Computing and Intelligent Technologies (ICoECIT) · doi:10.1109/icoecit68303.2026.11498015
Dharmalingam, A., & Kolli, V. K. K. (2025) · IEEE International Conference on Recent Trends in Computing and Smart Mobility (RCSM) · doi:10.1109/rcsm67767.2025.11507566
ORGAN: Object-Centric Representation Learning Using Cycle Consistent Generative Adversarial Networks
Küchler, J., van Maren, E., Vasiliauskaitė, V., Vulić, K., Abbasi-Asl, R., & Ihle, S. J. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-30612-8_7
Cross-Dialect Bird Species Recognition With Dialect-Calibrated Augmentation
Ding, J., Sun, Q., Akman, A., & Schuller, B. W. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3722152
Non-Parallel Dysarthric Speech Enhancement Using CycleGAN-VC2 and Melgan with Ablation Validation
Naveenkumar, V., Ganesh, J., Padmasai, Y., & Sansitha, B. (2026) · International Conference on Inventive Systems and Control (ICISC) · doi:10.1109/icisc69558.2026.11681483
VQ-CycleDiffusion: Vector Quantized Cycle-Consistent Diffusion Models for Voice Conversion
Yook, D., Kim, S., & Chang, H.-P. (2026) · Applied Sciences · doi:10.3390/app16189314
Multimodal Style Control in Voice Conversion Using Textual and Acoustic Prompts
Kim, M., Um, S., & Kang, H.-G. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3742217
Metadata
- Authors
- Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N.
- Affiliations
- NTT (Japan) (JP)
- Venue
- ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 6820-6824
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2937579788
- Cited by
- 272
- References
- 58
- Citations by year
- 2026: 14 · 2025: 34 · 2024: 36 · 2023: 57 · 2022: 39 · 2021: 43 · 2020: 34 · 2019: 15
- FWCI
- 12.53
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- Funders
- Virginia Agricultural Experiment Station, Virginia Polytechnic Institute and State University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- non-parallel voice conversion, adversarial training, PatchGAN discriminator, Mel cepstral distortion, speech naturalness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review