Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptation
Open accessAbstract
Speech distortions are a long-standing problem that degrades the performance of supervisely trained speech processing models. It is high time that we enhance the robustness of speech processing models to obtain good performance when encountering speech distortions while not hurting the original performance on clean speech. In this work, we propose to improve the robustness of speech processing models by domain adversarial training (DAT). We conducted experiments based on the SUPERB framework on five different speech processing tasks. In case we do not always have knowledge of the distortion types for speech data, we analyzed the binary-domain and multi-domain settings, where the former treats all distorted speech as one domain, and the latter views different distortions as different domains. In contrast to supervised training methods, we obtained promising results in target domains where speech data is distorted with different distortions including new unseen distortions introduced during testing.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 2
- Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, and V. Lempitsky, "Domain- adversarial training of neural networks," The journal of machine learning research, vol. 17, no. 1, pp. 2096-2030, 2016.
- P. Warden, "Speech commands: A public dataset for single-word speech recognition," Dataset available from http://download. ten- sorflow. org/data/speech commands v0, vol. 1, 2017.
Cited by
Sorted by citations
Self-supervised speech representation learning: A review
Mohamed, A., Lee, H.-Y., Borgholt, L., Havtorn, J. D., Edin, J., Igel, C., Kirchhoff, K., Li, S.-W., Livescu, K., Maaløe, L., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3207050 · Cited by 372 · see citing works
Self-citationFeng, T.-H., Dong, A., Yeh, C.-F., Yang, S.-W., Lin, T.-Q., Shi, J., Chang, K., Huang, Z., Wu, H., Chang, X., et al. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022770 · Cited by 25 · see citing works
Self-citationEnsemble Knowledge Distillation of Self-Supervised Speech Models
Huang, K. P., Feng, T.-H., Fu, Y.-K., Hsu, T.-Y., Yen, P.-C., Tseng, W.-C., Chang, K., & Lee, H.-Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096445 · Cited by 19 · see citing works
Self-citationMasuyama, Y., Chang, X., Cornell, S., Watanabe, S., & Ono, N. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023199 · Cited by 19 · see citing works
Robustdistiller: Compressing Universal Speech Representations for Enhanced Environment Robustness
Guimarães, H. R., Pimentel, A., Avila, A. R., Rezagholizadeh, M., Chen, B., & Falk, T. H. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095480 · Cited by 11 · see citing works
Huang, R., Zhang, C., Ren, Y., Zhao, Z., & Yu, D. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.508 · Cited by 10 · see citing works
Huang, K.-P., Fu, Y.-K., Hsu, T.-Y., Ritter-Gutierrez, F., Wang, F.-L., Tseng, L.-H., Zhang, Y., & Lee, H.-Y. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022474 · Cited by 10 · see citing works
Self-citationMADI: Inter-Domain Matching and Intra-Domain Discrimination for Cross-Domain Speech Recognition
Zhou, J., Zhao, S., Jiang, N., Zhao, G., & Qin, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095177 · Cited by 9 · see citing works
Huang, K.-P., Yang, C.-K., Fu, Y.-K., Dunbar, E., & Lee, H.-Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446737 · Cited by 9 · see citing works
Self-citationSchäfer, K., Choi, J.-E., & Neu, M. (2024) · The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024) · doi:10.21437/asvspoof.2024-9 · Cited by 8 · see citing works
“As only front-ends not pre-trained on MLS or other databases sourced from LibriVox audiobooks [10] were allowed, we choose to use HuBERT base [11], HuBERT-MGR [12] (hubert base robust mgr) and Wav2Vec2.”
Addressing Data Scarcity in Voice Disorder Detection with Self-Supervised Models
Gupta, R., Madill, C., Gunjawate, D. R., Nguyên, D. D., & Jin, C. T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446075 · Cited by 6 · see citing works
Masuyama, Y., Chang, X., Zhang, W., Cornell, S., Wang, Z.-Q., Ono, N., Qian, Y., & Watanabe, S. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101813 · Cited by 5 · see citing works
SCORE: Self-Supervised Correspondence Fine-Tuning for Improved Content Representations
Meghanani, A., & Hain, T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448060 · Cited by 5 · see citing works
Unsupervised End-to-End Accented Speech Recognition Under Low-Resource Conditions
Li, L., Li, Y., Xu, D., & Long, Y. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3557248 · Cited by 4 · see citing works
Noise Robust Distillation of Self-Supervised Speech Models via Correlation Metrics
Ritter-Gutierrez, F., Huang, K.-P., Ng, D., Wong, J. H. M., Lee, H.-Y., Chng, E. S., & Chen, N. F. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10627241 · Cited by 4 · see citing works
Self-citationAutomatic Data Augmentation for Domain Adapted Fine-Tuning of Self-Supervised Speech Representations
Zaiem, S., Parcollet, T., & Essid, S. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1040 · Cited by 3 · see citing works
Sequence Distribution Matching for Unsupervised Domain Adaptation in ASR
Li, Q., Zhu, H., Luo, L., Cheng, G., Zhang, P., Sun, J., & Yan, Y. (2022) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp57327.2022.10037857 · Cited by 3 · see citing works
Environment-Aware Knowledge Distillation for Improved Resource-Constrained Edge Speech Recognition
Pimentel, A., Guimarães, H. R., Avila, A. R., & Falk, T. H. (2023) · Applied Sciences · doi:10.3390/app132312571 · Cited by 1 · see citing works
Music Auto-Tagging with Robust Music Representation Learned via Domain Adversarial Training
Joung, H., & Lee, K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447318 · Cited by 1 · see citing works
Informed Speech Self-supervised Representation Learning
Zaiem, S. (2024) · theses.fr (ABES) · doi:10.70675/dc53ad72z177fz4bb4z91fbzd00576ba3f2e · Cited by 1 · see citing works
- Authors
- Huang, K. P., Fu, Y.-K., Zhang, Y., & Lee, H.-Y.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 2193-2197
- ISSN
- 2308-457X (ISSN-L)
- arXiv
- 2203.16104
- OpenAlex
- W4296068785
- Cited by
- 19
- References
- 0
- Citations by year
- 2025: 2 · 2024: 6 · 2023: 9 · 2022: 2
- FWCI
- 2.63
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- domain adaptation, robustness to distortion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
