The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
The Voice Conversion Challenge 2016
Open accessAbstract
This paper describes the Voice Conversion Challenge 2016 devised by the authors to better understand different voice conversion (VC) techniques by comparing their performance on a common dataset. The task of the challenge was speaker conversion, i.e., to transform the voice identity of a source speaker into that of a target speaker while preserving the linguistic content. Using a common dataset consisting of 162 utterances for training and 54 utterances for evaluation from each of 5 source and 5 target speakers, 17 groups working in VC around the world developed their own VC systems for every combination of the source and target speakers, i.e., 25 systems in total, and generated voice samples converted by the developed systems. These samples were evaluated in terms of target speaker similarity and naturalness by 200 listeners in a controlled environment. This paper summarizes the design of the challenge, its result, and a future plan to share views about unsolved problems and challenges faced by the current VC techniques.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A benefit of using voice conversion is it can help those with speech disorders, which is useful for rehabilitation medicine (Abe et al., 1990; Toda et al., 2016).”
From Audio deepfakes: A survey (2023) · cites this paper as Toda et al., 2016
In the citing paper
“Voice conversion challenge 2016 database (Toda et al., 2016): The original dataset created by the challenge organisers was derived from the DAPS (Device and Produced Speech) Dataset (Mysore, 2015). It contains 216 utterances (162 for training and 54 for testing) per speaker from 10 speakers.”
From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as Toda et al., 2016
Citations
Cites
Kawahara, H., Masuda-Katsuse, I., & de Cheveigné, A. (1999) · Speech Communication · doi:10.1016/s0167-6393(98)00085-5 · Cited by 1,831 · cited 1×
“Various sophisticated techniques, such as harmonic plus noise model (HNM) [15] and STRAIGHT [16], have been often used to extract high quality speech features from a speech waveform, and also to generate a speech wave-form from the converted speech features.”
MethodVoice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter Trajectory
Toda, T., Black, A. W., & Tokuda, K. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.907344 · Cited by 937
Self-citationContinuous probabilistic transform for voice conversion
Stylianou, Y., Cappe, O., & Moulines, E. (1998) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.661472 · Cited by 931
Voice conversion through vector quantization
Abe, M., Nakamura, S., Shikano, K., & Kuwabara, H. (2003) · ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1988.196671 · Cited by 415 · cited 1×
“VC research has a relatively long history from the late 1980s onwards [11].”
BackgroundApplying the harmonic plus noise model in concatenative speech synthesis
Stylianou, Y. (2001) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.890068 · Cited by 325
Voice conversion using deep Bidirectional Long Short-Term Memory based Recurrent Neural Networks
Sun, L., Kang, S., Li, K., & Meng, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178896 · Cited by 257
Mel-generalized cepstral analysis - a unified approach to speech spectral estimation
Tokuda, K., Kobayashi, T., Masuko, T., & Imai, S. (1994) · 3rd International Conference on Spoken Language Processing (ICSLP 1994) · doi:10.21437/icslp.1994-275 · Cited by 237
Spectral Mapping Using Artificial Neural Networks for Voice Conversion
Desai, S., Black, A. W., Yegnanarayana, B., & Prahallad, K. (2010) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2047683 · Cited by 223
Voice Conversion Using Deep Neural Networks With Layer-Wise Generative Training
Chen, L.-H., Ling, Z.-H., Liu, L.-J., & Dai, L.-R. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2353991 · Cited by 210
Self-citationStatistical Voice Conversion Techniques for Body-Conducted Unvoiced Speech Enhancement
Toda, T., Nakagiri, M., & Shikano, K. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2012.2205241 · Cited by 182
Self-citationVoice Conversion Based on Weighted Frequency Warping
Erro, D., Moreno, A., & Bonafonte, A. (2010) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2009.2038663 · Cited by 175 · cited 1×
“…[36], 2) a method to keep characteristics of natural speech parameters by partially using the source speech parameters, such as dynamic frequency warping (DFW) [37], and 3) a method to alleviate the averaging process to implement a sparse constraint as in the exemplar-based conversion [33, 34].”
MethodForeign accent conversion in computer assisted pronunciation training
Felps, D., Bortfeld, H., & Gutiérrez‐Osuna, R. (2008) · Speech Communication · doi:10.1016/j.specom.2008.11.004 · Cited by 170
Exemplar-Based Sparse Representation With Residual Compensation for Voice Conversion
Wu, Z., Virtanen, T., Chng, E. S., & Li, H. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2333242 · Cited by 166
Self-citationOptimal quantization of LSP parameters
Soong, F. K., & Juang, B.-H. (1993) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.221364 · Cited by 163
On artificial bandwidth extension of telephone speech
Jax, P., & Vary, P. (2003) · Signal Processing · doi:10.1016/s0165-1684(03)00082-3 · Cited by 160
Improving the intelligibility of dysarthric speech
Kain, A. B., Hosom, J.-P., Niu, X., van Santen, J. P. H., Fried-Oken, M., & Staehely, J. (2007) · Speech Communication · doi:10.1016/j.specom.2007.05.001 · Cited by 158
The blizzard challenge - 2005: evaluating corpus-based speech synthesis on common datasets
Black, A. W., & Tokuda, K. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-72 · Cited by 157 · cited 1×
“In speech synthesis as well, the Blizzard Challenge has been carried out since 2005 [14], enabling and measuring the improvements of corpus-based TTS technologies.”
MethodVoice conversion through vector quantization
Abe, M., Nakamura, S., Shikano, K., & Kuwabara, H. (1990) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.11.71 · Cited by 150
Kain, A. B., & Macon, M. W. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2001.941039 · Cited by 126 · cited 1×
“Moreover, ape-riodic components [20], phase components [21], or one-pitch waveform shapes [22] may also be parameterized to convert an excitation signal.”
BackgroundVoice Conversion Using Dynamic Kernel Partial Least Squares Regression
Helander, E. E., Silén, H., Virtanen, T. I., & Gabbouj, M. (2011) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2165944 · Cited by 126
Quality-enhanced voice morphing using maximum likelihood transformations
Ye, H., & Young, S. J. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tsa.2005.860839 · Cited by 106 · cited 1×
“Moreover, ape-riodic components [20], phase components [21], or one-pitch waveform shapes [22] may also be parameterized to convert an excitation signal.”
BackgroundWu, Z., Leon, P. L. D., Demiroğlu, C., Khodabakhsh, A., King, S., Ling, Z.-H., Saito, D., Stewart, B., Toda, T., Wester, M., et al. (2016) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2016.2526653 · Cited by 103 · cited 1×
“The baseline system is based on the voice conversion toolkit within the open-source Festvox system(2), as in our previous work [40], we found the toolkit can achieve similar performance to other state-of-the-art voice conversion or speech synthesis adaptation techniques.”
MethodSelf-citationMaximum likelihood voice conversion based on GMM with STRAIGHT mixed excitation
Ohtani, Y., Toda, T., Saruwatari, H., & Shikano, K. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-582 · Cited by 101 · cited 1×
“Moreover, ape-riodic components [20], phase components [21], or one-pitch waveform shapes [22] may also be parameterized to convert an excitation signal.”
BackgroundSelf-citationMysore, G. J. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2379648 · Cited by 81 · cited 1×
“The dataset used in VCC 2016 is based on the DAPS (Data And Production Speech) dataset [38], which was recorded by professional US English speakers in a professional recording studio without significant noise effects and is available online for free 1 .”
MethodData-driven emotion conversion in spoken English
Inanoglu, Z., & Young, S. J. (2008) · Speech Communication · doi:10.1016/j.specom.2008.09.006 · Cited by 79 · cited 1×
“…hand-icapped people such as dysarthric patients [2] and laryngec-tomees [3], as a voice changer to flexibly generate various types of emotional [4] and expressive speech [5], for vocal effects to produce more varieties of singing voices [6, 7], for enhanced mobile speech communication using…”
BackgroundVoice transformation using PSOLA technique
Valbret, H., Moulines, É., & Tubach, J.-P. (1992) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1992.225951 · Cited by 76
Postfilters to Modify the Modulation Spectrum for Statistical Parametric Speech Synthesis
Takamichi, S., Toda, T., Black, A., Neubig, G., Sakti, S., & Nakamura, S. (2016) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2016.2522655 · Cited by 67
Self-citationApplying voice conversion to concatenative singing-voice synthesis
Villavicencio, F., & Bonada, J. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-596 · Cited by 64
Self-citationAnalysis of the Voice Conversion Challenge 2016 Evaluation Results
Wester, M., Wu, Z., & Yamagishi, J. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-1331 · Cited by 61 · cited 2×
“A general description of the test is given below, a more detailed description of the listening test design is given in [39].”
BackgroundSelf-citationEvaluation of Expressive Speech Synthesis With Voice Conversion and Copy Resynthesis Techniques
Türk, O., & Schroder, M. (2010) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2010.2041113 · Cited by 56
Alaryngeal Speech Enhancement Based on One-to-Many Eigenvoice Conversion
Doi, H., Toda, T., Nakamura, K., Saruwatari, H., & Shikano, K. (2013) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2013.2286917 · Cited by 55
Self-citationGaussian process experts for voice conversion
Pilkington, N. C. V., Zen, H., & Gales, M. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-691 · Cited by 42
Voice Conversion Based on Speaker-Dependent Restricted Boltzmann Machines
Nakashika, T., Takiguchi, T., & Ariki, Y. (2014) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.e97.d.1403 · Cited by 40
Exemplar-Based Voice Conversion Using Sparse Representation in Noisy Environments
Takashima, R., Takiguchi, T., & Ariki, Y. (2013) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1587/transfun.e96.a.1946 · Cited by 38
Gillett, B., & King, S. (2003) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2003-74 · Cited by 37 · cited 1×
“Several methods to achieve such a parameterization have been proposed [23, 24, 25] but it is not straightforward to do it without any linguistic information.”
MethodStatistical analysis of bilingual speaker’s speech for cross-language voice conversion
Abe, M., Shikano, K., & Kuwabara, H. (1991) · The Journal of the Acoustical Society of America · doi:10.1121/1.402284 · Cited by 31
Xu, N., Tang, Y., Bao, J., Jiang, A., Liu, X., & Yang, Z. (2013) · Speech Communication · doi:10.1016/j.specom.2013.11.005 · Cited by 21
Generative Modeling of Voice Fundamental Frequency Contours
Kameoka, H., Yoshizato, K., Ishihara, T., Kadowaki, K., Ohishi, Y., & Kashino, K. (2015) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2015.2418576 · Cited by 21
Voice Timbre Control Based on Perceived Age in Singing Voice Conversion
Kobayashi, K., Toda, T., Doi, H., Nakano, T., Goto, M., Neubig, G., Sakti, S., & Nakamura, S. (2014) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.e97.d.1419 · Cited by 14 · cited 1×
“…to flexibly generate various types of emotional [4] and expressive speech [5], for vocal effects to produce more varieties of singing voices [6, 7], for enhanced mobile speech communication using wideband speech [8] and silent speech [9], accent conversion for computer assisted language…”
BackgroundSelf-citationYutani, K., Uto, Y., Nankaku, Y., Toda, T., & Tokuda, K. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-331 · Cited by 8
Self-citation
Cited by
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
“Various VC challenges (VCC) have been held to encourage the development of VC techniques and improve the quality of converted speech [198-200].”
BackgroundMethodInfluentialAn Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Sisman, B., Yamagishi, J., King, S., & Li, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3038524 · Cited by 357
“conversion challenge (VCC) 2016, which was first launched [67]–[69] at INTERSPEECH 2016.”
BackgroundMethodInfluentialSelf-citationCycleGAN-VC: Non-parallel Voice Conversion Using Cycle-Consistent Adversarial Networks
Kaneko, T., & Kameoka, H. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553236 · Cited by 358
“We evaluated our method on a non-parallel VC task using the VCC 2016 dataset [32], which was recorded by professional US English speakers, including five females and five males.”
MethodHsu, C.-C., Hwang, H.-T., Wu, Y.-C., Tsao, Y., & Wang, H.-M. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-63 · Cited by 320
“The proposed VC system was evaluated on the Voice Conversion Challenge 2016 dataset [8].”
MethodThe Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
Lorenzo-Trueba, J., Yamagishi, J., Toda, T., Saito, D., Villavicencio, F., Kinnunen, T., & Ling, Z. (2018) · The Speaker and Language Recognition Workshop (Odyssey 2018) · doi:10.21437/odyssey.2018-28 · Cited by 305
Self-citation
Metadata
- Authors
- Toda, T., Chen, L.-H., Saito, D., Villavicencio, F., Wester, M., Wu, Z., & Yamagishi, J.
- Affiliations
- Nagoya University (JP)
- University of Science and Technology of China (CN)
- The University of Tokyo (JP)
- National Institute of Informatics (JP)
- University of Edinburgh (GB)
- Venue
- Interspeech 2016
- Publisher
- ISCA
- Published
- 2016-09-08
- Pages
- 1632-1636
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2473388484
- Cited by
- 156
- References
- 40
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 12 · 2023: 16 · 2022: 18 · 2021: 20 · 2020: 21 · 2019: 25 · 2018: 14 · 2017: 11 · 2016: 8
- FWCI
- 10.42
- Type
- conference paper
- Language
- en
- Open access
- Licence
- other-oa
- Locations
- Interspeech (USB) (publishedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- Funders
- Engineering and Physical Sciences Research Council (EP/J002526/1, EP/I031022/1)
- Japan Society for the Promotion of Science (26280060)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- voice conversion, naturalness evaluation, listener evaluation, speech synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.