AST: Audio Spectrogram Transformer
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for endto-end audio classification models, which aim to learn a direct mapping from audio spectrograms to corresponding labels.To better capture long-range global context, a recent trend is to add a self-attention mechanism on top of the CNN, forming a CNN-attention hybrid model.However, it is unclear whether the reliance on a CNN is necessary, and if neural networks purely based on attention are sufficient to obtain good performance in audio classification.In this paper, we answer the question by introducing the Audio Spectrogram Transformer (AST), the first convolution-free, purely attention-based model for audio classification.We evaluate AST on various audio classification benchmarks, where it achieves new state-of-the-art results of 0.485 mAP on AudioSet, 95.6% accuracy on ESC-50, and 98.1% accuracy on Speech Commands V2.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Goel et al. [143] used a self-supervised audio spectrogram Transformer (SSAST) [144,145], a ViT-based architecture, to develop a contrastive learning framework, SSAST-CL, for detecting audio deepfakes. Their approach integrates Siamese networks with self-attention and cross-attention mechanisms to enhance the ViT’s feature representation”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [144]
In the citing paper
“This change enables LTU-AS to recognize both speech and audio events.”
From Joint Audio and Speech Understanding (2023) · cites this paper as [6]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3015 · Cited by 3,150
Cited by
Items 301–400 of 1,006
Hierarchical classification for acoustic scenes using deep learning
Ding, B., Zhang, T., Liu, G., & Wang, C. (2023) · Applied Acoustics · doi:10.1016/j.apacoust.2023.109594 · Cited by 9
Wang, Z., Yi, J., Yuan, J., Hu, R., Peng, X., Chen, A., & Shen, X. (2024) · Remote Sensing of Environment · doi:10.1016/j.rse.2024.114021 · Cited by 10
Environmental Sound Classification Using 1-D and 2-D Convolutional Neural Networks
Annabel, L. S. P., Shirley Praylin, G., & Thulasi, V. (2023) · International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca58529.2023.10395326 · Cited by 8
Kirigami: Lightweight Speech Filtering for Privacy-Preserving Activity Recognition using Audio
Boovaraghavan, S., Zhou, H., Goel, M., & Agarwal, Y. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3643502 · Cited by 16
A Multimodal Approach to Device-Directed Speech Detection with Large Language Models
Wagner, D., Churchill, A., Sigtia, S., Georgiou, P., Mirsamadi, M., Mishra, A., & Marchi, E. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446224 · Cited by 16
Exploring the power of pure attention mechanisms in blind room parameter estimation
Wang, C., Jia, M., Li, M., Bao, C., & Jin, W. (2024) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-024-00344-8 · Cited by 11
Roozbehi, A., Abbasi, H., Davidson, J. O., Dhillon, S. K., Zhou, K. Q., Wassink, G., Gunn, A. J., & Bennet, L. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125081 · Cited by 9
SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos
Chen, C., Kumar, A., Girdhar, R., Harwath, D. F., & Grauman, K. L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02573 · Cited by 17
A Survey of Recent Advances and Challenges in Deep Audio-Visual Correlation Learning
Vilaça, L., Yu, Y., & Viana, P. (2025) · ACM Computing Surveys · doi:10.1145/3696445 · Cited by 19
Bat Echolocation Call Detection and Species Recognition by Transformers with Self-attention
Bellafkir, H., Vogelbacher, M., Gottwald, J., Mühling, M., Korfhage, N., Lampe, P., Frieß, N., Nauß, T., & Freisleben, B. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-08277-1_16 · Cited by 11
Transformer-CNN Automatic Hyperparameter Tuning for Speech Emotion Recognition
Gumelar, A. B., Yuniarno, E. M., Adi, D. P., Setiawan, R., Sugiarto, I., & Purnomo, M. H. (2022) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist55454.2022.9827732 · Cited by 10
I2CR: Improving Noise Robustness on Keyword Spotting using Inter-Intra Contrastive Regularization
Ng, D., Yip, J. Q., Surana, T., Yang, Z., Zhang, C., Ma, Y., Ni, C., Chng, E. S., & Ma, B. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9980261 · Cited by 11
Díez, I., Saratxaga, I., Salegi, U., Navas, E., & Hernáez, I. (2023) · Applied Sciences · doi:10.3390/app13169358 · Cited by 9
Dense 2D-3D Indoor Prediction with Sound via Aligned Cross-Modal Distillation
Yun, H., Na, J., & Kim, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00723 · Cited by 9
Foundation Models for Video Understanding: A SurveyPreprint
Madan, N., Møgelmose, A., Modi, R., Rawat, Y. S., & Moeslund, T. B. (2024) · doi:10.36227/techrxiv.171769139.99464428/v2 · Cited by 11
A Comprehensive Overview and Comparative Analysis of CNN, RNN-LSTM and TransformerPreprint
Ali, Z. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5175090 · Cited by 17
Robust Deepfake Audio Detection via Bi-Level Optimization
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2023) · 2023 IEEE 25th International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp59012.2023.10337724 · Cited by 7
Towards Attention-based Contrastive Learning for Audio Spoof Detection
Goel, C., Koppisetti, S., Colman, B., Shahriyari, A., & Bharaj, G. (2023) · INTERSPEECH 2023 · doi:10.21437/interspeech.2023-245 · Cited by 7
Yue, H., Zhang, Z., Mu, D., Dang, Y., Yin, J., & Tang, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78498-9_18 · Cited by 8
Auto-Masked Audio Spectrogram Transformer for depression detection from speech
Zhang, M., He, J., Peng, X., Huang, J., Zhang, N., Wang, C., & Jiang, D. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.120295 · Cited by 9
MMFformer: Multimodal Fusion Transformer Network for Depression Detection
Haque, M. R., Islam, M. M., Raju, S. M. T. U., Altaheri, H., Nassar, L., & Karray, F. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11342694 · Cited by 7
Audio-visual scene classification via contrastive event-object alignment and semantic-based fusion
Hou, Y., Kang, B., & Botteldooren, D. B. (2022) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp55362.2022.9949447 · Cited by 7
NeuProNet: neural profiling networks for sound classification
Tran, K.-T., Vu, X.-S., Nguyen, K., & Nguyen, H. D. (2024) · Neural Computing and Applications · doi:10.1007/s00521-023-09361-8 · Cited by 7
AudioRepInceptionNeXt: A lightweight single-stream architecture for efficient audio recognition
Lau, K. W., Rehman, Y. A. U., & Po, L.-M. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127432 · Cited by 8
Scanning dial: the instantaneous audio classification transformer
Jiang, H., Mutahira, H., Park, U., & Muhammad, M. S. (2024) · Discover Applied Sciences · doi:10.1007/s42452-024-05731-6 · Cited by 7
Attention Is All You Need For Blind Room Volume Estimation
Wang, C., Jia, M., Li, M., Bao, C., & Jin, W. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447723 · Cited by 10
Beyond Deep Learning: Charting the Next Frontiers of Affective Computing
Triantafyllopoulos, A., Christ, L., Gebhard, A., Jing, X., Kathan, A., Milling, M., Tsangko, I., Amiriparian, S., & Schuller, B. W. (2024) · Intelligent Computing · doi:10.34133/icomputing.0089 · Cited by 13
Tang, L., Hu, S., Yang, C., Deng, R., Chen, A., & Zhou, G. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124620 · Cited by 9
Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
Zhang, Y., Ding, X., Gong, K., Ge, Y., Shan, Y., & Yue, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00584 · Cited by 18
Audio-Visual Generalized Zero-Shot Learning using Pre-Trained Large Multi-Modal Models
Kurzendörfer, D., Mercea, O.-B., Koepke, A. S., & Akata, Z. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00269 · Cited by 13
Yao, W., Yang, J., He, Y., Liu, J., & Wen, W. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128779 · Cited by 16
Bodini, M. (2024) · Societies · doi:10.3390/soc14120268 · Cited by 15
DeFT-Mamba: Universal Multichannel Sound Separation and Polyphonic Audio Classification
Lee, D., & Choi, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890324 · Cited by 19
Li, J., Qu, S., Huang, P.-Y., & Metze, F. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-515 · Cited by 13
Li, Y., Parsan, A., Wang, B., Dong, P., Yao, S., & Qin, R. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105597 · Cited by 7
MAST: Multiscale Audio Spectrogram Transformers
Ghosh, S., Seth, A., Umesh, S., & Manocha, D. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095023 · Cited by 16
SemanticAC: Semantics-Assisted Framework for Audio Classification
Xiao, Y., Ma, Y., Li, S., Zhou, H., Liao, R., & Li, X. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096319 · Cited by 14
How to Estimate Model Transferability of Pre-Trained Speech Models?
Chen, Z.-C., Yang, C.-H. H., Li, B., Zhang, Y., Chen, N., Chang, S.-Y., Prabhavalkar, R., Lee, H.-Y., & Sainath, T. N. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1079 · Cited by 14
Shen, K., Yan, D., & Dong, L. (2023) · Applied Acoustics · doi:10.1016/j.apacoust.2023.109584 · Cited by 8
Underwater Acoustic Signal Classification using Hierarchical Audio Transformer with Noisy Input
Vo, Q. T., & Han, D. K. (2023) · Machine learning for signal processing ... · doi:10.1109/mlsp55844.2023.10285893 · Cited by 10
Adversarial Attacks in Underwater Acoustic Target Recognition with Deep Learning Models
Feng, S., Zhu, X., Ma, S., & Lan, Q. (2023) · Remote Sensing · doi:10.3390/rs15225386 · Cited by 9
Contextual Dependency Vision Transformer for spectrogram-based multivariate time series analysis
Yao, J., Han, L., Yang, K., Guo, G., Liu, N., Huang, X., Zheng, Z., Zhang, D., & Han, J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127215 · Cited by 8
Nasef, M. M., Nabil, M. M., & Sauber, A. M. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18421-7 · Cited by 7
Transformer Ensemble for Synthesized Speech Detection
Bartusiak, E. R., Bhagtani, K., Yadav, A. K. S., & Delp, E. J. (2023) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf59524.2023.10477041 · Cited by 8
A Military Audio Dataset for Situational Awareness and Surveillance
Kim, J.-W., Yoon, C., & Jung, H. (2024) · Scientific Data · doi:10.1038/s41597-024-03511-w · Cited by 14
Chen, X., Wang, M., Kan, R., & Qiu, H. (2024) · Applied Sciences · doi:10.3390/app14219711 · Cited by 8
A Closer Look at Class-Incremental Learning for Multi-Label Audio Classification
Mulimani, M., & Mesaros, A. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3547233 · Cited by 12
He, C., Cheng, S., Bao, J., & Liu, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887709 · Cited by 8
Acoustic Event Detection in Vehicles: A Multi-Label Classification Approach
Antony, A. J., Theimer, W., Grossetti, G., & Friedrich, C. M. (2025) · Sensors · doi:10.3390/s25082591 · Cited by 10
Kazeneza, M., Bosman, A. S., Amenyedzi, D. K., Hanyurwimfura, D., Ndashimye, E., & Vodacek, A. (2025) · IEEE Access · doi:10.1109/access.2025.3580620 · Cited by 9
Wu, J., Chang, Z., Zhang, L., Chen, M., Li, S., & Qiu, F. (2025) · Electronics · doi:10.3390/electronics14132566 · Cited by 6
Guiding Audio-Visual Question Answering with Collective Question Reasoning
Pei, B., Huang, Y., Chen, G., Xu, J., Wang, Y., Wang, L., Lü, T., Qiao, Y., & Wu, F. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02510-7 · Cited by 12
A survey on multi-modal and weakly supervised approaches for robust anomaly detection in video data
Barbosa, R. Z., Oliveira, H. S., & Tavares, J. M. R. S. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103388 · Cited by 12
Gong, Y., Xu, C., Mo, C., Wu, J., Lin, H., Su, H., Zhang, Q., Zhang, Q., & Yang, S. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02086-z · Cited by 6
Self-citationTime Series Information Visualization - A Review of Approaches and Tools
Ortigossa, E. S., Dias, F. F., do Nascimento, D. C., & Nonato, L. G. (2025) · IEEE Access · doi:10.1109/access.2025.3609404 · Cited by 10
Environmental acoustic intelligence through sound event localization and detection: a review
Yeow, J.-W., Tan, E.-L., Peksi, S., & Gan, W. (2025) · npj Acoustics · doi:10.1038/s44384-025-00036-3 · Cited by 13
A lightweight dual branch masking network for environmental sound classification
Chen, G., Zhang, B., Zhikang, D. I. N. G., Xiao, K. F., Guan, P., Xiao, X., Wang, X., Yi, H., Hu, H. G., & Zhang, W. (2025) · Scientific Reports · doi:10.1038/s41598-025-33636-w · Cited by 9
Xu, C., Zhao, L., Wen, H., Zhang, Y., Wang, L., & Zhang, L. (2026) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2026.111443 · Cited by 9
Content-based and Knowledge-enriched Representations for Classification Across Modalities: A Survey
Pittaras, N., Giannakopoulos, G., Stamatopoulos, P., & Karkaletsis, V. (2023) · ACM Computing Surveys · doi:10.1145/3583682 · Cited by 8
InFi: End-to-End Learning to Filter Input for Resource-Efficiency in Mobile-Centric Inference
Yuan, M., Zhang, L., He, F., Tong, X., Song, M.-H., Xu, Z., & Li, X. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3275981 · Cited by 10
GIT: A Transformer-Based Deep Learning Model for Geoacoustic Inversion
Feng, S., Zhu, X., Ma, S., & Lan, Q. (2023) · Journal of Marine Science and Engineering · doi:10.3390/jmse11061108 · Cited by 6
Han, C., Seshadri, P., Ding, Y., Posner, N., Koo, B. W., Agrawal, A., Lerch, A., & Guhathakurta, S. (2024) · Urban Informatics · doi:10.1007/s44212-024-00053-9 · Cited by 13
ISPA: Inter-Species Phonetic Alphabet for Transcribing Animal Sounds
Hagiwara, M., Miron, M., & Liu, J.-Y. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10669911 · Cited by 13
HCMT: A Novel Hierarchical Cross-Modal Transformer for Recognition of Abnormal Behavior
Liu, H. L., Khairuddin, A. S. M., Chuah, J. H., Zhao, X. M., Wang, X. D., & Fang, L. (2024) · IEEE Access · doi:10.1109/access.2024.3483896 · Cited by 8
DASS: Distilled Audio State Space Models are Stronger and More Duration-Scalable Learners
Bhati, S., Gong, Y., Karlinsky, L., Kuehne, H., Feris, R., & Glass, J. R. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832169 · Cited by 14
Self-citationClassifying Music-Induced Emotion Using Multi-Modal Ensembles of EEG and Audio Feature Models
Paukner, P., Ripoll, M., Sabir, D., Erdoğan, D. O., Sacchetto, L., & Diepold, K. J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888818 · Cited by 6
FAST: Fast Audio Spectrogram Transformer
Naman, A., & Zhang, G. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889238 · Cited by 9
SoundBeam meets M2D: Target Sound Extraction with Audio Foundation Model
Hernandez-Olivan, C., Delcroix, M., Ochiai, T., Niizumi, D., Tawara, N., Nakatani, T., & Araki, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888410 · Cited by 11
Exploring Missing Modality in Multimodal Egocentric Datasets
Ramazanova, M., Pardo, A., Alwassel, H., & Ghanem, B. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00013 · Cited by 18
Through-Ice Acoustic Source Tracking Using Vision Transformers with Ordinal Classification
Whitaker, S., Barnard, A. R., Anderson, G. D., & Havens, T. C. (2022) · Sensors · doi:10.3390/s22134703 · Cited by 8
Cough Classification with Deep Derived Features using Audio Spectrogram Transformer
Valdés, J. J., Habashy, K., Xi, P., Cohen-McFarlane, M., Wallace, B., Goubran, R. A., & Knoefel, F. D. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020878 · Cited by 6
Liu, W., Ren, Y., & Wang, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096755 · Cited by 7
Hou, Y., Song, S., Luo, C., Mitchell, A., Ren, Q., Xie, W., Kang, J., Wang, W., & Botteldooren, D. B. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1021 · Cited by 6
A Multi-Modal Transformer Approach for Football Event Classification
Zhang, Y., Li, B., Fang, H., & Meng, Q. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10223172 · Cited by 6
Spectro-ViT: A vision transformer model for GABA-edited MEGA-PRESS reconstruction using spectrograms
Dias, G., Berto, R. P., Oliveira, M. C., Ueda, L. H., Dertkigil, S. S. J., Costa, P. D. P., Shamaei, A., Bugler, H., de Souza, R. M., Harris, A. D., et al. (2024) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2024.110219 · Cited by 9
Pseudo Strong Labels for Large Scale Weakly Supervised Audio Tagging
Dinkel, H., Yan, Z., Wang, Y., Zhang, J., & Wang, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746431 · Cited by 8
On the Robustness of Cross-lingual Speaker Recognition using Transformer-based Approaches
Liao, W., Chen, W.-Y., & Wu, Y.-C. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956274 · Cited by 6
Infant Cry Classification Based-On Feature Fusion and Mel-Spectrogram Decomposition with CNNs
Ji, C., Jiao, Y., Chen, M., & Pan, Y. F. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-23504-7_10 · Cited by 6
Investigation of Bird Sound Transformer Modeling and Recognition
Yi, D., & Shen, X. (2024) · Electronics · doi:10.3390/electronics13193964 · Cited by 5
Improving Audio Explanations Using Audio Language Models
Akman, A., Sun, Q., & Schuller, B. W. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3532218 · Cited by 8
Kim, J.-W., Toikkanen, M., Jalali, A., Kim, M., Han, H.-J., Kim, H., Shin, W., Jung, H., & Kim, K. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3545159 · Cited by 18
MusicLIME: Explainable Multimodal Music Understanding
Sotirou, T., Lyberatos, V., Mastromichalakis, O. M., & Stamou, G. B. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889771 · Cited by 17
SonicBoom: Contact Localization Using Array of Microphones
Lee, M., Yoo, U., Oh, J., Ichnowski, J., Kantor, G. A., & Kroemer, O. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3576067 · Cited by 5
ATTSF-Net: Attention-Based Similarity Fusion Network for Audio-Visual Emotion Recognition
Zhang, J., Zhang, Z., & Ju, Z. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3591567 · Cited by 11
Attention-driven multimodal alignment for long-term action quality assessment
Wang, X., Li, P., & Shen, Y. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113649 · Cited by 8
Nguyễn, T. T., Kawanishi, Y., John, V., Komamizu, T., & Ide, I. (2025) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg61629.2025.11099071 · Cited by 9
YAMNet-based transfer learning for compact noise classification in urban and wireless systems
Liu, L., Xu, Q., Mao, S., Mu, J., Zhao, X., Song, W., & Cheng, P. (2025) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-025-02483-8 · Cited by 8
Garai, S., & Samui, S. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134028 · Cited by 19
Comprehensive discovery of m6A sites in the human transcriptome at single-molecule resolution
Kang, G., Hwang, H., Jeon, H., Choi, H., Chang, H. R., Yeo, N., Park, J., Son, N., Jeon, E., Lim, J., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-67417-w · Cited by 7
Mahmud, N.-A., Zhang, T., Iqbal, Y., Sumona, F. B., Azaz, I., Geng, Y., Khan, W., Kharma, Q. M., & Rubanenko, O. (2025) · Scientific Reports · doi:10.1038/s41598-025-32401-3 · Cited by 5
Wang, Z., Zhang, Z., Shao, Y., Qian, K., Liu, H., Hu, B., & Schuller, B. W. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad3d78 · Cited by 5
MSDFEN: Multi-scale dynamic feature extraction network for pathological voice detection
Dai, Z., Jiang, Y., Cao, L., Zhang, X., & Tao, Z. (2024) · Applied Acoustics · doi:10.1016/j.apacoust.2024.110438 · Cited by 8
Zhang, Q., Zhang, X., Sun, M., & Yang, J. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.112798 · Cited by 11
Sang, M., & Hansen, J. H. L. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3539005 · Cited by 8
Park, S.-Y., Park, J. S., Lee, J., Lee, H., Kim, Y., Suh, D. I., & Kim, K. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107693 · Cited by 5
CAS-TJ: Channel attention shuffle and temporal jigsaw for audio classification
Kim, Y., Ko, K., Lee, J., & Ko, H. (2025) · Applied Acoustics · doi:10.1016/j.apacoust.2025.110590 · Cited by 6
Chen, X., Zhao, L., Cui, J., Li, H., & Wang, X. (2025) · IEEE Access · doi:10.1109/access.2025.3545065 · Cited by 5
Text2Playlist: Generating Personalized Playlists from Text on Deezer
Delcluze, M., Khoury, A., Vast, C., Arnaudo, V., Briand, L., Bendada, W., & Bouabça, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88720-8_27 · Cited by 11
Jeong, S. G., Nam, S., Jung, S. K., & Kim, S. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719915 · Cited by 7
Multimodal Emotion Detection and Analysis from Conversational Data
Jatoth, A., Abri, F., & Nguyen, T. (2025) · Journal of Advances in Information Technology · doi:10.12720/jait.16.8.1127-1141 · Cited by 8
Metadata
- Authors
- Gong, Y., Chung, Y.-A., & Glass, J.
- Affiliations
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 571-575
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3196974791
- Cited by
- 1,159
- References
- 33
- Citations by year
- 2026: 260 · 2025: 356 · 2024: 241 · 2023: 193 · 2022: 100 · 2021: 9
- FWCI
- 82.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- Audio Spectrogram Transformer, audio classification, self-attention, spectrogram, AudioSet, ESC-50
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.