The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
wav2vec: Unsupervised Pre-Training for Speech Recognition
Open accessAbstract
We explore unsupervised pre-training for speech recognition by learning representations of raw audio. wav2vec is trained on large amounts of unlabeled audio data and the resulting representations are then used to improve acoustic model training. We pre-train a simple multi-layer convolutional neural network optimized via a noise contrastive binary classification task. Our experiments on WSJ reduce WER of a strong character-based log-mel filterbank baseline by up to 36% when only a few hours of transcribed data is available. Our approach achieves 2.43% WER on the nov92 test set. This outperforms Deep Speech 2, the best reported character-based system in the literature while using two orders of magnitude less labeled training data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
13 Own result · 7 Not checked yet · 3 Own interpretation · 2 No basis given · 1 Own method
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Thereafter, performance plateaus while training time increases.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.3 ABLATIONS
plainn = 10- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 3 shows that increasing the number of negative samples only helps up to ten samples.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.3 ABLATIONS
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 1 shows that pre-training on more data leads to better accuracy on the WSJ benchmark.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.1 PRE-TRAINING FOR THE WSJ BENCHMARK
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On TIMIT, pre-training enables us to match the best reported result in the literature.”
- Also stated in: § 4.2 PRE-TRAINING FOR TIMIT · plain
“Table 2 shows that wav2vec pre-training on Librispeech and WSJ audio data can lead to results matching the state of the art.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 1 INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4.2 PRE-TRAINING FOR TIMIT · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Pretrained representations can substantially improve performance over our character-based baseline which is trained on log-mel filterbank features.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.1 PRE-TRAINING FOR THE WSJ BENCHMARK
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 4 shows that a crop size of 150k frames results in the best performance.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.3 ABLATIONS
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found it important to choose a normalization scheme that is invariant to the scaling and the offset of the input.This choice resulted in representations that generalize well across datasets.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 2 PRE-TRAINING APPROACH
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Experimental results on the WSJ benchmark demonstrate that pre-trained representations estimated on about 1,000 hours of unlabeled speech can substantially improve a character-based ASR system and outperform the best character-based result in the literature, Deep Speech 2, improving WER from 3.1 % to 2.43 %.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 1 INTRODUCTION
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: Unlabeled audio data is much easier to collect than labeled data.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Pre-training only on the audio data of WSJ (wav2vec WSJ) performs worse compared to the much larger Librispeech (wav2vec Libri).”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.1 PRE-TRAINING FOR THE WSJ BENCHMARK
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Similar tovan den Oord et al. (2018), we found that sampling negatives from different sequences and speakers yields inferior results.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 5 CONCLUSIONS
What the sources say
- Not checked yetcites van den Oord et al., 2018
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 8
- The quote only partly states this claim. 1
- Probably not a substantial claim. 3
In the paper
“Our approach achieves 2.43 % WER on the nov92 test set.This outperforms Deep Speech 2, the best reported character-based system in the literature while using two orders of magnitude less labeled training data.”
- Also stated in: § 5 CONCLUSIONS · plain
“Our approach achieves 2.43 % WER on the test set of WSJ, a result that outperforms the next best known character-based speech recognition model in the literature (Amodei et al., 2016) while using two orders of magnitude less transcribed training data.”
- Also stated in: § 4.1 PRE-TRAINING FOR THE WSJ BENCHMARK · boosted
“This shows that pre-training on unlabeled audio data can improve over the best character-based approach, Deep Speech 2 (Amodei et al., 2016), by 0.67 WER on nov92.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > Abstract
What the sources say
- Not checked yetcites Amodei et al., 2016
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one. The quote only partly states this claim.
- Also stated in: § 5 CONCLUSIONS · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found it important to introduce skip connections in the aggregator to help convergence in this case.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 2 PRE-TRAINING APPROACH
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“In comparison to Hadian et al. (2018), wav2vec performs as well as their phoneme-based model and wav2vec large outperforms it by 0.37 WER.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.1 PRE-TRAINING FOR THE WSJ BENCHMARK
What the sources say
- Not checked yetcites Hadian et al., 2018
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We show that more data for pre-training improves performance and that this approach not only improves resource-poor setups, but also settings where all WSJ training data is used.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 5 CONCLUSIONS
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: Unlabeled audio data is much easier to collect than labeled data.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 5 also shows that predicting more than 12 steps ahead in the future does not result in better performance and increasing the number of steps increases training time.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 5 CONCLUSIONS
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Similar to Hénaff et al. (2019), we noticed that fine-tuning the embedding network does not meaningfully improve performance while substantially increasing the acoustic model training time.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.1 PRE-TRAINING FOR THE WSJ BENCHMARK
What the sources say
- Not checked yetcites Hénaff et al., 2019
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Accuracy steadily increases with more data for pre-training and the best accuracy is achieved with the largest amount of data for pre-training.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.2 PRE-TRAINING FOR TIMIT
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Not restricting the maximum length (None) gives an average sequence length of about 207k frames and results in the worst accuracy.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.3 ABLATIONS
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“wav2vec relies on a fully convolutional architecture which can be easily parallelized over time on modern hardware compared to recurrent models used in previous work ( §2).”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 1 INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In this experiment, everything is kept equal except for the number of negative samples.”
§ WAV2VEC: UNSUPERVISED PRE-TRAINING FOR SPEECH RECOGNITION > 4.3 ABLATIONS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper relies on this without support.
Unlabeled audio data is much easier to collect than labeled data.
“This enables exploiting unlabeled audio data which is much easier to collect than labeled data.”
The paper relies on this without support.
Accurately modeling the data distribution p(x) is a common and challenging problem for these approaches.
“A common problem with these approaches is the requirement to accurately model the data distribution p(x), which is challenging.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As in [15], utilizing the causal convolutional aggregator results in a fully convolutional model, increasing the parallelizability of the pre-training, resulting in faster training times.”
From Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition (2023) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“we propose to instead utilize multiple causal convolution blocks to perform the autoregressive summarization, due to its simplicity, faster training times, and ease of parallelization that recurrent models do not enjoy.”
From Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition (2023) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Note that wav2vec directly trains on speech’s raw waveform to extract deep features that represent speech signals.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [54]
The cited source says what the claim attributes to it.
In the citing paper
“For example, Schneider et al. [54] proposed an unsupervised speech pre-training method named wav2vec that only uses unlabeled speech data for self-supervised training to obtain generalized speech features that can be applied to multiple tasks.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [54]
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Natural Language Processing (almost) from ScratchPreprint
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 6,920
Self-citationRepresentation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Cited by
Sorted by citations
Items 901–1,000 of 1,003
Multimodal prediction of profanity based on speech analysis
Smirnov, I., & Laushkina, A. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.12.008 · Cited by 2
Liu, M., Chen, K., Ye, Q., & Wu, H. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104757 · Cited by 2
Transformer-Based Model for Auditory EEG Decoding
Chen, J., Liu, Y.-L., Feng, R., Yuan, J., & Ling, Z.-H. (2024) · Communications in computer and information science · doi:10.1007/978-981-96-1045-7_11 · Cited by 2
Respiratory Sounds Classification by Fusing the Time-Domain and 2D Spectral Features
Dong, G., Wang, J., Shen, Y., Zhang, M., Zhang, M., & Sun, P. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822226 · Cited by 2
M-BEST-RQ: A Multi-Channel Speech Foundation Model for Smart Glasses
Yang, Y., Raj, D., Lin, J., Moritz, N., Jia, J., Keren, G., Lakomkin, E., Huang, Y. A., Donley, J., Mahadeokar, J., et al. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890482 · Cited by 2
WhisPrompt: Audio classification of Chinese opera genres by transferring time-series features
Shi, B., Wang, H., Qiu, J., & Li, X. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127301 · Cited by 3
Applications of Machine Learning in Speech Recognition
Davitaia, A. (2025) · International Journal of Artificial Intelligence and Machine Learning · doi:10.51483/ijaiml.5.2.2025.66-69 · Cited by 2
Misra, A., Loukina, A., Klebanov, B. B., Gyawali, B., & Zechner, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78292-4_25 · Cited by 2
Non-Intrusive Binaural Speech Intelligibility Prediction From Discrete Latent Representations
McKinney, A. F., & Cauchi, B. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3161115 · Cited by 2
Krishna, V., & Ganapathy, S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747259 · Cited by 2
End-to-End Low Resource Keyword Spotting Through Character Recognition and Beam-Search Re-Scoring
Mekonnen, E. T., Brutti, A., & Falavigna, D. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746012 · Cited by 2
Yang, J.-Y., & Chang, J. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3205752 · Cited by 2
SCaLa: Supervised Contrastive Learning for End-to-End Speech Recognition
Fu, L., Li, X., Wang, R., Fan, L., Zhang, Z., Chen, M., Wu, Y., & He, X. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-412 · Cited by 2
Exploring representation learning for small-footprint keyword spotting
Cui, F., Guo, L., Wang, Q., Gao, P., & Wang, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10558 · Cited by 2
Detecting Anomaly Event in Video Based on Generative Adversarial Network
Zhang, Z. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/8633955 · Cited by 2
Is Smaller Always Faster? Tradeoffs in Compressing Self-Supervised Speech Transformers
Lin, T.-Q., Yang, T.-H., Chang, C.-Y., Chen, K.-M., Feng, T.-H., Lee, H.-Y., & Tang, H. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434686 · Cited by 2
Kim, J.-W., Chung, H., & Jung, H. (2023) · Mathematics · doi:10.3390/math11030622 · Cited by 2
A Comparison of Semi-Supervised Learning Techniques for Streaming ASR at Scale
Peyser, C., Picheny, M., Cho, K., Prabhavalkar, R., Huang, W., & Sainath, T. N. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095838 · Cited by 2
Length-Aware NMT and Adaptive Duration for Automatic Dubbing
Rao, Z., Shang, H., Yang, J., Wei, D., Li, Z., Guo, J., Li, S., Yu, Z., Wu, Z., Xie, Y., et al. (2023) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2023.iwslt-1.9 · Cited by 2
Audio-Driven 3D Talking Face for Realistic Holographic Mixed-Reality Telepresence
Christoff, N., Tonchev, K., Neshov, N. N., Manolova, A. H., & Poulkov, V. K. (2023) · IEEE International Black Sea Conference on Communications and Networking · doi:10.1109/blackseacom58138.2023.10299781 · Cited by 2
A Few-Shot Speech Keyword Spotting Method Based on Self-Supervise Learning
Yu, M., Xiaofeng, J., Wan, B., & Wang, G. (2023) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei60920.2023.10373303 · Cited by 2
Contrastive Separative Coding for Self-Supervised Representation Learning
Wang, J., Lam, M. W. Y., Su, D., & Yu, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414352 · Cited by 2
Speech Augmentation Based Unsupervised Learning for Keyword Spotting
Luo, J., Wang, J., Cheng, N., Tang, H., & Xiao, J. Z. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892207 · Cited by 2
Self-supervised Semantic-driven Phoneme Discovery for Zero-resource Speech Recognition
Wang, L., Feng, S., Hasegawa‐Johnson, M., & Yoo, C. D. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.553 · Cited by 2
Quantized rewiring: hardware-aware training of sparse deep neural networks
Petschenig, H., & Legenstein, R. A. (2023) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/accd8f · Cited by 3
Fast Development of ASR in African Languages using Self Supervised Speech Representation LearningPreprint
Mohamud, J. H., Thompson, L. A., Ndoye, A., & Besacier, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08993 · Cited by 3
Tahon, M., Macary, M., Estève, Y., & Luzzati, D. (2021) · doi:10.36227/techrxiv.17104526.v1 · Cited by 2
Morandé, S. (2023) · Qeios · doi:10.32388/znkj97 · Cited by 2
CCA-Transformer: Cascaded Cross-Attention Based Transformer for Facial Analysis in Multi-modal DataPreprint
Kim, J.-H., Kim, N., Hong, M., & Won, C. S. (2024) · Preprints.org · doi:10.20944/preprints202403.1629.v1 · Cited by 2
Deep and statistical learning on audio-visual data for human-machine interface on embedded systems
Pouthier, B. (2024) · theses.fr (ABES) · doi:10.70675/8fc20884z8244z4d31z9a57zc5ed94601377 · Cited by 2
Recognition Method of Sports Training Based on Intelligent Information Platform
Bu, J., Yao, D., & Wang, C. (2023) · International Journal of e-Collaboration · doi:10.4018/ijec.316872 · Cited by 1
ERSAM: Neural Architecture Search for Energy-Efficient and Real-Time Social Ambiance Measurement
Li, C., Chen, W., Yuan, J., Lin, Y., & Sabharwal, A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095360 · Cited by 1
Improving the performance of CMGAN in speech enhancement with the phone fortified perceptual loss
Dai, C.-E., Zeng, J.-X., Zeng, W.-L., Li, E. S., & Hung, J.-W. (2023) · IEEE International Conference on Consumer Electronics - Taiwan (ICCE-Taiwan) · doi:10.1109/icce-taiwan58799.2023.10226904 · Cited by 1
A pruning-then-quantization model compression framework for facial emotion recognition
Sun, H., Shao, W., Li, T., Zhao, J., Xu, W., & Song, L. (2023) · Intelligent and Converged Networks · doi:10.23919/icn.2023.0020 · Cited by 1
Complex Feature Information Enhanced Speech Emotion Recognition
Yue, P., Zheng, S., & Li, T. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317348 · Cited by 1
Multimodal Embeddings In Emotion Recognition Research
Mustafina, S., Akimov, А. А., & Мустафина, С. А. (2023) · International Conference on Control Systems, Mathematical Modeling, Automation and Energy Efficiency (SUMMA) · doi:10.1109/summa60232.2023.10349422 · Cited by 1
A Comparative Study on using English ASR Models for Leveraging Medical Speech Recognition System
Sasikala, D., & Sathya, S. S. (2023) · International Conference on Advances in Computational Intelligence and Communication (ICACIC) · doi:10.1109/icacic59454.2023.10434950 · Cited by 1
Spoofing Speech Detection Method Based on Self-supervised Front End and Feature Enhancement
Guo, B., Wei, G., Meng, C., Liu, J., & Zhang, C. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0125-7_32 · Cited by 1
Infant Crying Recognition Method of Limited Data Based on Self-supervised Learning
Wang, B., Chen, Z., Ren, S., & Sun, M. (2024) · International Conference on Information Communication and Signal Processing (ICICSP) · doi:10.1109/icicsp62589.2024.10809055 · Cited by 1
SWIM: Short-Window CNN Integrated With Mamba for EEG-Based Auditory Spatial Attention Decoding
Zhang, Z., Thwaites, A., Woolgar, A., Moore, B. C. J., & Zhang, C. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832311 · Cited by 2
DQ-Data2vec: Decoupling Quantization for Multilingual Speech Recognition
Shao, Q., Dong, L., Wei, K., Sun, S., & Xie, L. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3551074 · Cited by 1
Enhancing and Exploring Mild Cognitive Impairment Detection with W2V-BERT-2.0
Wang, Y., Matsushima, T., Matsushima, S., & Sakai, T. (2025) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw65056.2025.11011147 · Cited by 1
End-to-End Spoken Language Recognition Using Self-Attention Speech Models
Kılınç, H. H., Kilimci, H., & Kilimci, Z. H. (2025) · International Conference on Electronics, Computers and Artificial Intelligence (ECAI) · doi:10.1109/ecai65401.2025.11095447 · Cited by 1
Abed, M. H., & Sztahó, D. (2025) · IEEE Access · doi:10.1109/access.2025.3593024 · Cited by 1
Unified Acoustic Representation Learning for Vietnamese Speech Classification Tasks
Ha, X.-T., Nguyen, V., Do, T.-N., Phan, T.-K., & Mạc, Đ.-K. (2025) · International Conference on Multimedia Analysis and Pattern Recognition (MAPR) · doi:10.1109/mapr67746.2025.11133876 · Cited by 1
Li, X., Huang, P., Peng, X., Sha, F., Fan, X., & Li, Y. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103279 · Cited by 1
Xu, J., Liu, Y., & Ren, W. (2025) · International Conference on Computer Communication and Artificial Intelligence (CCAI) · doi:10.1109/ccai65422.2025.11189361 · Cited by 1
Multi-Level Interaction for Emotion Recognition From Unaligned Speech and Text
Han, L., Chen, X., Jia, M., & Bao, C. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3630662 · Cited by 1
Advancing End-To-End Indonesian Speech Emotion Recognition Using XLSR-Wav2Vec2
Nugroho, K. S., Iriananda, S. W., Akbar, I., Isnan, M., & Pardamean, B. (2025) · International Conference on Information Technology Research and Innovation (ICITRI) · doi:10.1109/icitri67507.2025.11232655 · Cited by 1
Skierkowska, M., Piernicki, T., Seifzadeh, S., Cimbálník, J., Kucewicz, M. T., & Kostek, B. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3620128 · Cited by 1
Listening for “You”: Enhancing Speech Image Retrieval via Target Speaker Extraction
Yang, W., Wei, J., Lu, W., Song, X., & Yue, X. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3639371 · Cited by 1
Harnessing Multimodal Unlabeled Data for Enhanced Speech Emotion Recognition
Goncalves, L., & Busso, C. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3647876 · Cited by 1
Robust End-to-End Spoken Language Understanding in Low-Resource Settings
Piñeiro-Martín, A., Mateo, C. G., Docío-Fernández, L., & López-Pérez, M. D. C. (2026) · IEEE Access · doi:10.1109/access.2026.3660257 · Cited by 1
Ma, S., Ma, L., Cui, J., & Wan, Z. (2025) · International Conference on Machine Learning and Natural Language Processing (MLNLP) · doi:10.1109/mlnlp66797.2025.11388500 · Cited by 1
Yang, J., Shi, R., Du, X., Xie, Y., & Wang, W. (2026) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2026.3691830 · Cited by 1
Multi-Task Learning-Based Speech Emotion Recognition Using Pre-Trained Acoustic Model
Wang, X., Yao, K., & Yi, Y. (2026) · Applied Sciences · doi:10.3390/app16105166 · Cited by 1
Speaker-Invariant Speech-to-Intent Classification for Low-Resource Languages
Ignatius, A., & Thayasivam, U. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87802-3_26 · Cited by 1
Guided Contrastive Self-Supervised Pre-Training for Automatic Speech Recognition
Khare, A., Wu, M., Bhati, S., Droppo, J., & Maas, R. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022676 · Cited by 1
Spectral Salt-and-Pepper Patch Masking for Self-Supervised Speech Representation Learning
Kim, J.-W., Chung, H., & Jung, H. (2023) · Mathematics · doi:10.3390/math11153418 · Cited by 1
Analysis of Features for Machine Learning Approaches to Parkinson's Disease Detection
Ferrante, C., Sbattella, L., Scotti, V., Menon, B., & Pillai, A. S. (2023) · CRC Press eBooks · doi:10.1201/9781003296126-13 · Cited by 1
Wang, Z., Xu, X., Song, X., Li, H., Wei, X., & Huang, D. (2023) · International Journal of Intelligent Systems · doi:10.1155/2023/1202315 · Cited by 1
BIMO: Bootstrap Inter–Intra Modality at Once Unsupervised Learning for Multivariate Time Series
Heo, S., Kim, S., & Lee, J. (2024) · Applied Sciences · doi:10.3390/app14093825 · Cited by 1
de Almeida, R. J. S., Souza, D. Y., Oliveira, L. P., Correia, D. V., Pinheiro, S. R. N. B., & Sousa, E. S. D. S. (2024) · doi:10.5753/sbcas.2024.2319 · Cited by 1
Efficiency-oriented approaches for self-supervised speech representation learning
Lugo, L., & Vielzeuf, V. (2024) · International Journal of Speech Technology · doi:10.1007/s10772-024-10121-9 · Cited by 2
MedTalkAI: Assisted Anamnesis Creation With Automatic Speech Recognition
Gonçalves, Y. T., Alves, J. V. B., Sá, B. A. D., da Silva, L. N., de Macêdo, J. A. F., & da Silva, T. L. C. (2024) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd_estendido.2024.243214 · Cited by 1
Systematic Review of Advancing Machine Learning Through Cross-Domain Analysis of Unlabeled Data
Zhu, Y., & Crowell, J. (2023) · Journal of Science & Technology · doi:10.55662/jst.2023.4104 · Cited by 1
Tessellated Linear Model for Age Prediction from Voice
Alharthi, D., Zamani, M., Raj, B., & Singh, R. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888079 · Cited by 1
DEEPFAKE AUDIO DETECTION USING YOLOV8 WITH MEL-SPECTROGRAM ANALYSIS: A CROSS-DATASET EVALUATION
Zbezhkhovska, U. (2025) · Radio Electronics Computer Science Control · doi:10.15588/1607-3274-2025-1-14 · Cited by 2
Towards development of the first continuous speech recognition system in Indian language Nagpuri
Paul, S., Bhattacharjee, V., & Saha, S. K. (2025) · International Journal of Speech Technology · doi:10.1007/s10772-025-10180-6 · Cited by 1
Quantum Transfer Learning: The Impact of Classical Preprocessing
Kölle, M., Maurer, J., Altmann, P. J., Sünkel, L., Stein, J., Hager, J., Zielinski, S., & Linnhoff–Popien, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-87327-0_18 · Cited by 3
Detecting Voice Cloning and Text to Speech Audio in Real Time on Mobile Devices
Berchtold, W., Heeger, J., Bugert, S., & Steinebach, M. (2025) · Electronic Imaging · doi:10.2352/ei.2025.37.3.mobmu-310 · Cited by 1
Revisiting SSL for sound event detection: complementary fusion and adaptive post-processing
Cui, H., Song, L., Li, L., Xu, D., & Long, Y. (2025) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00181-5 · Cited by 1
Kang, G., Ge, Z., Hu, J., Zhang, X., Wang, L., & Zhan, J. (2025) · Proceedings of the VLDB Endowment · doi:10.14778/3718057.3718078 · Cited by 1
Park, K. H., Kim, J., & Kang, U. (2025) · PLoS ONE · doi:10.1371/journal.pone.0333915 · Cited by 1
Beyond Audio: Enhancing SoccerNet-Echoes with Multimodal Event Extraction Using LLMs
Sarkhoosh, M. H., Gautam, S., Midoglu, C., Nguyen, T., Held, J., Cioppa, A., Giancola, S., Thambawita, V. L., Riegler, M. A., & Halvorsen, P. (2025) · International Journal of Semantic Computing · doi:10.1142/s1793351x25450035 · Cited by 1
Liu, Y., Zhang, K., Ma, Y., Xu, X., Qi, T., Zheng, W., Lu, C., & Zong, Y. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3762064 · Cited by 1
HOPE: Hierarchical Fusion for Optimized and Personality-Aware Estimation of Depression
Shi, H., Liu, Y., Li, H., Ding, Y., Hu, J., Qu, L., & Li, T. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3762063 · Cited by 5
AV-RISE: Hierarchical Cross-Modal Denoising for Learning Robust Audio-Visual Speech Representation
Zhao, Z., Lin, Y., Guo, D., & Fan, J. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755639 · Cited by 1
Noro: Noise-Robust One-Shot Voice Conversion with Hidden Speaker Representation Learning
He, H., Song, Y., Wang, Y., Li, H., Zhang, X., Wang, L., Huang, G., Chng, E. S., & Wu, Z. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249193 · Cited by 2
Causal Self-Supervised Pretrained Frontend With Predictive Patterns for Speech Separation
Wang, W., Pan, Z., Li, X., Wang, S., & Li, H. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3640969 · Cited by 1
Whisper Based Cross-Lingual Phoneme Recognition Between Vietnamese and English
Nguyen, H. N. M., Tran, N. A., Truong, D. D., Vo, V. N., & Le, P. T. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-00972-2_20 · Cited by 1
Zhou, Y., Bai, P., & Shi, X. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07137-w · Cited by 1
Multilingual speech representation for the Manipuri automatic speech recognition system
Devi, T. C., Thaoroijam, K., & Nongmeikapam, K. (2026) · Language Resources and Evaluation · doi:10.1007/s10579-026-09908-w · Cited by 1
Mai, A.-T., Nguyen, C.-V. T., & Le, D.-T. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00265 · Cited by 1
StableDub: Taming Diffusion Prior for Generalized and Efficient Visual Dubbing
Chen, L., Zhou, T., He, X., Tang, B., Wu, Z., Huang, Y., Wu, Y., Sun, Z., Yang, W., & Meng, H. M. L. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3688404 · Cited by 1
Lee, G., & Yoon, S. (2026) · Energy and Buildings · doi:10.1016/j.enbuild.2026.117688 · Cited by 1
From Physics to Representation: Audio Learning with Synthetic Pre-training via Procedural Generation
Liu, F., Huang, R., Zheng, Q., Wang, Y., & Liu, F. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810789 · Cited by 1
Polyglot: Multilingual Style Preserving Speech-Driven Facial Animation
Nocentini, F., Seo, K., Liu, Q., Ferrari, C., Berretti, S., Ferman, D., Kim, H., Garrido, P., & Çalışkan, A. (2026) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg67764.2026.11557042 · Cited by 1
A Study on the improvement of chinese automatic speech recognition accuracy using a lexicon
Gu, M.-J., & Kang, S. (2022) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic54071.2022.9722645 · Cited by 1
A Convenient and Efficient Scene Shop Recognition Assistant Tool for the Visually Impaired
Gu, Y. X., Yu, Z., Shao, Z., & Wang, W. (2022) · Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC) · doi:10.1109/ipec54454.2022.9777308 · Cited by 1
Li, J., & Hasegawa‐Johnson, M. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3178238 · Cited by 1
Gan, A., Zhang, J., Wu, M., Fang, X., & Dai, L.-R. (2022) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859822 · Cited by 1
Learning Invariant Representation and Risk Minimized for Unsupervised Accent Domain Adaptation
Zhao, C., Wang, J., Qu, X., Wang, H., & Xiao, J. Z. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022892 · Cited by 1
ASBERT: ASR-Specific Self-Supervised Learning with Self-Training
Kim, H. Y., Kim, B.-Y., Yoo, S. W., Lim, Y., Lim, Y., & Lee, H. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023214 · Cited by 1
Individualized Conditioning and Negative Distances for Speaker Separation
Sun, T., Abuhajar, N., Gong, S., Wang, Z., Smith, C. D., Wang, X., Xu, L., & Liu, J. (2022) · International Conference on Machine Learning and Applications · doi:10.1109/icmla55696.2022.00114 · Cited by 1
M-CTRL: A Continual Representation Learning Framework with Slowly Improving Past Pre-Trained Model
Choi, J.-S., Lee, J., Lee, C.-W., & Chang, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096793 · Cited by 1
Transcription Free Filler Word Detection with Neural Semi-CRFs
Zhu, G., Yan, Y., Cáceres, J.-P., & Duan, Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097095 · Cited by 1
Masked Token Similarity Transfer for Compressing Transformer-Based ASR Models
Choi, E., Lim, Y., Kim, B.-Y., Kim, H. Y., Lee, H., Lim, Y., Yu, S. W., & Yoo, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096531 · Cited by 1
Spectral Clustering-Aware Learning of Embeddings for Speaker Diarisation
Lee, E. P. C., Sun, G., Zhang, C., & Woodland, P. C. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096993 · Cited by 1
Metadata
- Authors
- Schneider, S., Baevski, A., Collobert, R., & Auli, M.
- Affiliations
- Technical University of Munich (DE)
- Meta (Israel) (IL)
- Venue
- Interspeech 2019
- Publisher
- ISCA
- Published
- 2019-09-15
- Pages
- 3465-3469
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2939710050
- Cited by
- 1,290
- References
- 32
- Citations by year
- 2026: 86 · 2025: 169 · 2024: 222 · 2023: 262 · 2022: 221 · 2021: 225 · 2020: 97 · 2019: 7
- FWCI
- 52.61
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- public-domain
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, public-domain)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- wav2vec, unsupervised pre-training, speech recognition, audio representation learning, noise contrastive estimation, acoustic model training, convolutional neural networks, Wall Street Journal
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
