The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
MOSNet: Deep Learning-Based Objective Assessment for Voice Conversion
Open accessAbstract
Existing objective evaluation metrics for voice conversion (VC) are not always correlated with human perception. Therefore, training VC models with such criteria may not effectively improve naturalness and similarity of converted speech. In this paper, we propose deep learning-based assessment models to predict human ratings of converted speech. We adopt the convolutional and recurrent neural network models to build a mean opinion score (MOS) predictor, termed as MOSNet. The proposed models are tested on large-scale listening test results of the Voice Conversion Challenge (VCC) 2018. Experimental results show that the predicted scores of the proposed MOSNet are highly correlated with human MOS ratings at the system level while being fairly correlated with human MOS ratings at the utterance level. Meanwhile, we have modified MOSNet to predict the similarity scores, and the preliminary results show that the predicted scores are also fairly correlated with human ratings. These results confirm that the proposed models could be used as a computational evaluator to measure the MOS of VC systems to reduce the need for expensive human rating.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
(2014) · Cited by 33,419
(2010) · International Conference on Machine Learning · Cited by 13,995
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
Rix, A. W., Beerends, J. G., Hollier, M. P., & Hekstra, A. P. (2002) · 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221) · doi:10.1109/icassp.2001.941023 · Cited by 3,149
Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks
Sainath, T. N., Vinyals, O., Senior, A., & Sak, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178838 · Cited by 1,678
NOTES ON THE HISTORY OF CORRELATION
PEARSON, K. (1920) · Biometrika · doi:10.1093/biomet/13.1.25 · Cited by 918
Mel-cepstral distance measure for objective speech quality assessment
Kubichek, R. (2002) · Proceedings of IEEE Pacific Rim Conference on Communications Computers and Signal Processing · doi:10.1109/pacrim.1993.407206 · Cited by 534 · cited 1×
“In the VC community, objective measures such as the Mel-cepstral distance (MCD) [1] are widely used for automatically measuring the quality of converted speech.”
MethodA Convolutional Recurrent Neural Network for Real-Time Speech Enhancement
Tan, K., & Wang, D. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1405 · Cited by 497
Learning the speech front-end with raw waveform CLDNNs
Sainath, T. N., Weiss, R. J., Senior, A., Wilson, K. W., & Vinyals, O. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-1 · Cited by 430
The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
Lorenzo-Trueba, J., Yamagishi, J., Toda, T., Saito, D., Villavicencio, F., Kinnunen, T., & Ling, Z. (2018) · The Speaker and Language Recognition Workshop (Odyssey 2018) · doi:10.21437/odyssey.2018-28 · Cited by 305
Self-citationBootstrap estimates for confidence intervals in ASR performance evaluation
Bisani, M., & Ney, H. (2004) · 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.2004.1326009 · Cited by 227
Quality-Net: An End-to-End Non-intrusive Speech Quality Assessment Model Based on BLSTM
Fu, S.-W., Tsao, Y., Hwang, H.-T., & Wang, H.-M. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1802 · Cited by 178
Self-citationNon-intrusive Speech Quality Assessment Using Neural Networks
Avila, A. R., Gamper, H., Reddy, C. K. A., Cutler, R., Tashev, I., & Gehrke, J. E. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683175 · Cited by 104
Mysore, G. J. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2379648 · Cited by 81
AutoMOS: Learning a non-intrusive assessor of naturalness-of-speechPreprint
Patton, B., Agiomyrgiannakis, Y., Terry, M. A., Wilson, K., Saurous, R. A., & Sculley, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09207 · Cited by 78
A Hierarchical Predictor of Synthetic Speech Naturalness Using Neural Networks
Yoshimura, T., Henter, G. E., Watts, O., Wester, M., Yamagishi, J., & Tokuda, K. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-847 · Cited by 36
Self-citationGated Convolutional LSTM for Speech Commands Recognition
Wang, D., Lv, S., Wang, X., & Lin, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93701-4_53 · Cited by 20
Self-citation
Cited by
An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Sisman, B., Yamagishi, J., King, S., & Li, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3038524 · Cited by 357
Self-citationASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild
Liu, X., Wang, X., Sahidullah, M., Patino, J., Delgado, H., Kinnunen, T., Todisco, M., Yamagishi, J., Evans, N., Nautsch, A., et al. (2023) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2023.3285283 · Cited by 312
“Some form of objective scores, e.g. derived using MOSNet [58], might also be used as a proxy for subjective scores.”
MethodSelf-citationTIMIT-TTS: A Text-to-Speech Dataset for Multimodal Synthetic Media Detection
Salvi, D., Hosler, B., Bestagini, P., Stamm, M. C., & Tubaro, S. (2023) · IEEE Access · doi:10.1109/access.2023.3276480 · Cited by 65
Measuring the Accuracy of Automatic Speech Recognition Solutions
Kuhn, K., Kersken, V., Reuter, B., Egger, N., & Zimmermann, G. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3636513 · Cited by 44
“We additionally measured the quality of all speech recordings with MOSNet and selected only recordings with an absolute value of 2 or higher [Lo et al. 2019].”
Method
Metadata
- Authors
- Lo, C.-C., Fu, S.-W., Huang, W.-C., Wang, X., Yamagishi, J., Tsao, Y., & Wang, H.-M.
- Venue
- Interspeech 2019
- Publisher
- ISCA
- Published
- 2019-09-15
- Pages
- 1541-1545
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2937993361
- Cited by
- 256
- References
- 19
- FWCI
- 7.81
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.