AST: Audio Spectrogram Transformer
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for endto-end audio classification models, which aim to learn a direct mapping from audio spectrograms to corresponding labels.To better capture long-range global context, a recent trend is to add a self-attention mechanism on top of the CNN, forming a CNN-attention hybrid model.However, it is unclear whether the reliance on a CNN is necessary, and if neural networks purely based on attention are sufficient to obtain good performance in audio classification.In this paper, we answer the question by introducing the Audio Spectrogram Transformer (AST), the first convolution-free, purely attention-based model for audio classification.We evaluate AST on various audio classification benchmarks, where it achieves new state-of-the-art results of 0.485 mAP on AudioSet, 95.6% accuracy on ESC-50, and 98.1% accuracy on Speech Commands V2.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Goel et al. [143] used a self-supervised audio spectrogram Transformer (SSAST) [144,145], a ViT-based architecture, to develop a contrastive learning framework, SSAST-CL, for detecting audio deepfakes. Their approach integrates Siamese networks with self-attention and cross-attention mechanisms to enhance the ViT’s feature representation”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [144]
In the citing paper
“This change enables LTU-AS to recognize both speech and audio events.”
From Joint Audio and Speech Understanding (2023) · cites this paper as [6]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3015 · Cited by 3,150
Cited by
Items 401–500 of 1,006
Tsalera, E., Papadakis, A. E., Pagiatakis, G. K., & Σαμαράκου, Μ. (2025) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan14050091 · Cited by 7
Transformer Based Multimodal Scene Recognition in Soccer Videos
Gan, Y., Togo, R., Ogawa, T., & Haseyama, M. (2022) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew56448.2022.9859304 · Cited by 5
Zero-Shot Style Transfer for Multimodal Data-Driven Gesture Synthesis
Fares, M., Pélachaud, C., & Obin, N. (2023) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg57933.2023.10042658 · Cited by 7
Heterogeneous Graph Learning for Acoustic Event Classification
Shirian, A., Ahmadian, M., Somandepalli, K., & Guha, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095073 · Cited by 7
ASSD: Synthetic Speech Detection in the AAC Compressed Domain
Yadav, A. K. S., Xiang, Z., Bartusiak, E. R., Bestagini, P., Tubaro, S., & Delp, E. J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095043 · Cited by 13
Mu, H., Xia, W., & Che, W. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00193 · Cited by 5
Lu, P., Creagh, A. P., Lu, H., Hai, H., Thwaites, L., & Clifton, D. A. (2023) · Italian National Conference on Sensors · doi:10.3390/s23187705 · Cited by 6
Denoising cosine similarity: A theory-driven approach for efficient representation learning
Nakagawa, T., Sanada, Y., Waida, H., Zhang, Y., Wada, Y., Takanashi, K., Yamada, T., & Kanamori, T. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.10.027 · Cited by 9
Pipariya, K., Pramanik, D., Bharati, P., Chandra, S., & Mandal, S. K. D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-48312-7_42 · Cited by 5
Multimodal Transformer with a Low-Computational-Cost Guarantee
Park, S., & Choi, E. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447954 · Cited by 10
DTF-AT: Decoupled Time-Frequency Audio Transformer for Event Classification
Alex, T., Ahmed, S. A. A., Mustafa, A., Awais, M., & Jackson, P. J. B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29716 · Cited by 13
Saini, S., Engel, I., & Peissig, J. (2024) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-024-00338-6 · Cited by 5
Bhagtani, K., Yadav, A. K. S., Xiang, Z., Bestagini, P., & Delp, E. J. (2023) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf59524.2023.10476982 · Cited by 6
Chen, L., Luo, X., & Zhou, H. (2024) · International Conference on Image, Video and Signal Processing (IVSP) · doi:10.1145/3655755.3655758 · Cited by 9
Exploring the Role of Audio in Video Captioning
Shen, Y., Yang, L., Wen, L., Yu, H., Elhamifar, E., & Wang, H. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00214 · Cited by 12
The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
Son, S., Ryu, J., Lee, N., & Lee, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72855-6_22 · Cited by 16
Siamese Vision Transformers are Scalable Audio-Visual Learners
Lin, Y.-B., & Bertasius, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72630-9_18 · Cited by 21
Vision Transformer based Audio Classification using Patch-level Feature Fusion
Luo, J., Yang, J., Chng, E. S., & Zhong, X. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9980194 · Cited by 8
Deep Learning for Recognizing Bat Species and Bat Behavior in Audio Recordings
Vogelbacher, M., Bellafkir, H., Gottwald, J., Schneider, D. M., Muhling, M., & Freisleben, B. (2023) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds57534.2023.00014 · Cited by 8
Max-AST: Combining Convolution, Local and Global Self-Attentions for Audio Event Classification
Alex, T., Ahmed, S. A. A., Mustafa, A., Awais, M., & Jackson, P. J. B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447697 · Cited by 7
Visual signatures for music mood and timbre
Wang, H., & Sourin, A. (2024) · The Visual Computer · doi:10.1007/s00371-024-03417-z · Cited by 7
Speech Command Recognition: Text-to-Speech and Speech Corpus Scraping Are All You Need
Kuzdeuov, A., Nurgaliyev, S., Turmakhan, D., Laiyk, N., & Varol, H. A. (2023) · International Conference on Robotics, Automation and Artificial Intelligence (RAAI) · doi:10.1109/raai59955.2023.10601292 · Cited by 7
Challenges and Perspectives in Interpretable Music Auto-Tagging Using Perceptual Features
Lyberatos, V., Kantarelis, S., Dervakos, E., & Stamou, G. B. (2025) · IEEE Access · doi:10.1109/access.2025.3555741 · Cited by 8
Music Genre Classification using Large Language Models
Meguenani, M. E. A., Britto, A. D. S., & Koerich, A. L. (2025) · doi:10.1109/cism64958.2025.11060866 · Cited by 5
Reza, S., Ferreira, M. C., Machado, J. J. M., & Tavares, J. M. R. S. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3585801 · Cited by 10
Urban Sound Classification on Resource-Constrained Edge Devices
Bellafkir, H., Vogelbacher, M., & Freisleben, B. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-7238-7_19 · Cited by 4
Chung, S., Zhou, H., Arsa, D. M. S., Kim, S. C., & Kim, H. (2025) · Scientific Reports · doi:10.1038/s41598-025-17205-9 · Cited by 4
Zhang, X., Liu, X., Alksne, M. N., & Roch, M. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-21642-x · Cited by 8
Dissanayake, T., Müller, K., & von Lühmann, A. (2025) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2025.3617858 · Cited by 9
Fredianelli, L., Iannace, G., & Akbaba, A. (2025) · Applied Acoustics · doi:10.1016/j.apacoust.2025.111171 · Cited by 5
Joint modeling of rhythm and emotion in music via frequency-domain attention and multi-task learning
Liu, S., Ren, L., & Zhao, J. (2025) · Multimedia Systems · doi:10.1007/s00530-025-02071-2 · Cited by 4
Kim, J.-Y., & Lee, S.-H. (2025) · IEEE Access · doi:10.1109/access.2025.3599218 · Cited by 4
Zhao, R., Shen, T., Zhao, L., Chen, J., Xu, J., & Liu, F. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3615242 · Cited by 5
Environmental Sound Classification Using Advanced Pooling and Hybrid Convolution-KAN Architecture
Sarathchandra, P., Madushani, D., Mallikarachchi, S., & Meedeniya, D. (2026) · IEEE Access · doi:10.1109/access.2026.3660484 · Cited by 5
A device-invariant multi-modal learning framework for respiratory disease classification
Yang, M., Liu, X., Du, W. D., Liu, Y., Zhu, W., Bu, Z., Mao, J., Wang, Q., Chen, S., Zhou, M., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02445-4 · Cited by 10
Roslidar, R., Alhamdi, M. J., & Yunida, Y. (2024) · Indonesian Journal of Electrical Engineering and Informatics (IJEEI) · doi:10.52549/ijeei.v12i4.5530 · Cited by 4
Audio Explanation Synthesis with Generative Foundation Models
Akman, A., Sun, Q., & Schuller, B. W. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890370 · Cited by 9
Consensus-Aware Balance Learning for Sexually Suggestive Video Classification
Zhou, D., Li, J., Wang, H., Burns, M., & Liu, M. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-5809-1_10 · Cited by 4
Yang, Y., Kataoka, J., Yun, S.-B., & Yoon, H. (2025) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-025-02635-z · Cited by 4
Waveform-Logmel Audio Neural Networks for Respiratory Sound Classification
Xie, J., Zhou, Y., & Xu, M. (2024) · Asia Conference on Cognitive Engineering and Intelligent Interaction (CEII) · doi:10.1109/ceii65291.2024.00022 · Cited by 5
Exploring Self-Supervised Audio Models for Generalized Anomalous Sound Detection
Han, B., Jiang, A., Zheng, X., Zhang, W.-Q., Liu, J., Fan, P., & Qian, Y. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3606200 · Cited by 11
Tompkins, D. G., Kumar, K., & Wu, J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747250 · Cited by 4
Event-related data conditioning for acoustic event classification
Hou, Y., & Botteldooren, D. B. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11481 · Cited by 4
CT-SAT: Contextual Transformer for Sequential Audio Tagging
Hou, Y., Liu, Z., Kang, B., Wang, Y., & Botteldooren, D. B. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-196 · Cited by 4
Visually-aware Acoustic Event Detection using Heterogeneous Graphs
Shirian, A., Somandepalli, K., Sánchez, V., & Guha, T. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10670 · Cited by 7
Adapted Spectrogram Transformer for Unsupervised Cross-Domain Acoustic Anomaly Detection
Vyver, G. V. D., Liu, Z., Dolui, K., Hughes, D., & Michiels, S. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9980266 · Cited by 5
Yang, J., Zhou, Y., & Huang, H. (2023) · Speech Communication · doi:10.1016/j.specom.2023.05.004 · Cited by 7
Using various pre-trained models for audio feature extraction in automated audio captioning
Won, H., Kim, B., Kwak, I., & Lim, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120664 · Cited by 5
EMOLIPS: Towards Reliable Emotional Speech Lip-Reading
Ryumin, D., Рюмина, Е. В., & Ivanko, D. (2023) · Mathematics · doi:10.3390/math11234787 · Cited by 6
AAT: Adapting Audio Transformer for Various Acoustics Recognition Tasks
Liang, Y., Lin, H. Y., Qiu, S., & Zhang, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447544 · Cited by 7
Hou, Y., Ren, Q., Song, S., Song, Y., Wang, W., & Botteldooren, D. B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446633 · Cited by 5
From Coarse to Fine: Efficient Training for Audio Spectrogram Transformers
Feng, J., Erol, M. H., Chung, J. S., & Senocak, A. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448376 · Cited by 5
Jeong, T.-I., Nguyen, T. M., Choi, E., Gliserin, A., Nguyen, T. M. T., Kim, S., Kim, S., Kim, H., Bak, G.-H., Kim, N., et al. (2024) · ACS Sensors · doi:10.1021/acssensors.3c02663 · Cited by 4
Melek, N. (2024) · Journal of Edge Computing · doi:10.55056/jec.679 · Cited by 5
An invasive species model and dataset for bioacoustic monitoring of common brushtail possum
McEwen, B., Bainbridge-Smith, A., Gutschmidt, S., Green, R. D., & Atlas, J. (2024) · New Zealand Journal of Ecology · doi:10.20417/nzjecol.48.3566 · Cited by 5
Learnable Counterfactual Attention for Music Classification
Lin, Y.-X., Lin, J.-C., Wei, W.-L., & Wang, J. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3527143 · Cited by 10
Audio-Language Datasets of Scenes and Events: A Survey
Wijngaard, G., Formisano, E., Esposito, M., & Dumontier, M. (2025) · IEEE Access · doi:10.1109/access.2025.3534621 · Cited by 14
Audio-Assisted Smart Home Security Monitoring with Few Samples
Chi, H., Ma, Q., Zhang, Y., Fu, C., Wang, Y., Geng, H., & Du, X. (2024) · Globecom · doi:10.1109/globecom52923.2024.10901276 · Cited by 5
RadDet: A Wideband Dataset for Real-Time Radar Spectrum Detection
Huang, Z., Denman, S., Pemasiri, A., Martin, T. L., & Fookes, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887772 · Cited by 4
SS-BRPE: Self-Supervised Blind Room Parameter Estimation Using Attention Mechanisms
Wang, C., Jia, M., Li, M., Bao, C., & Jin, W. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890462 · Cited by 4
Cohen, O., Hazan, G., & Gannot, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887873 · Cited by 8
Interactive Robot Action Replanning using Multimodal LLM Trained from Human Demonstration Videos
Hori, C., Kambara, M., Sugiura, K., Ota, K., Khurana, S., Jain, S., Corcodel, R., Jha, D. K., Romeres, D., & Roux, J. L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887717 · Cited by 5
Feedback Module Based Convolution Neural Networks for Sound Event Classification
Kim, G., Han, D. K., & Ko, H. (2021) · IEEE Access · doi:10.1109/access.2021.3126004 · Cited by 4
Transformer for authenticating the source microphone in digital audio forensics
Qamhan, M. A., Alotaibi, Y. A., & Selouani, S. (2023) · Forensic Science International Digital Investigation · doi:10.1016/j.fsidi.2023.301539 · Cited by 4
Unified Keyword Spotting and Audio Tagging on Mobile Devices with Transformers
Dinkel, H., Wang, Y., Yan, Z., Zhang, J., & Wang, Y. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49357.2023.10095534 · Cited by 4
How Robust are Audio Embeddings for Polyphonic Sound Event Tagging?
Abeßer, J., Grollmisch, S., & Müller, M. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3293032 · Cited by 10
Ontology-aware Learning and Evaluation for Audio Tagging
Liu, H., Kong, Q., Liu, X., Mei, X., Wang, W., & Plumbley, M. D. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-979 · Cited by 6
MFAE: Masked frame-level autoencoder with hybrid-supervision for low-resource music transcription
Wu, Y., Zhao, J., Yu, Y., & Li, W. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00194 · Cited by 4
Low-Complexity Audio Embedding Extractors
Schmid, F. T., Koutini, K., & Widmer, G. (2023) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco58844.2023.10289815 · Cited by 10
Deep Learning-based Visualization of Music Mood
Wang, H., & Sourin, A. (2023) · International Conference on Cyberworlds (CW) · doi:10.1109/cw58918.2023.00015 · Cited by 4
Jang, S., Lee, G., & Chi, S. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105239 · Cited by 5
Yang, Z., Li, Z., Zhu, D., & Zhou, Y. (2024) · Information Technology And Control · doi:10.5755/j01.itc.53.1.35060 · Cited by 5
Review of Existing Methods for Generating and Detecting Fake and Partially Fake Audio
AlAli, A., & Theodorakopoulos, G. (2024) · ACM International Workshop on Security and Privacy Analytics (IWSPA) · doi:10.1145/3643651.3659894 · Cited by 7
Audio MFCC-gram Transformers for respiratory insufficiency detection in COVID-19
Gauy, M. M., & Finger, M. (2021) · Simpósio Brasileiro de Tecnologia da Informação e da Linguagem Humana (STIL) · doi:10.5753/stil.2021.17793 · Cited by 10
Kek, X. Y., Chin, C. S., & Li, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3196338 · Cited by 6
Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queries
Cai, P., Song, Y., Gu, Q., Jiang, N., Song, H., & McLoughlin, I. (2025) · arXiv · doi:10.48550/arxiv.2507.16343 · Cited by 4
A No-Reference model for Detecting Audio Artifacts using Pretrained Audio Neural Networks
Higham, D., Bagla, A., & Haralampieva, V. (2022) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00006 · Cited by 3
Improving Audio Classification Method by Combining Self-Supervision with Knowledge Distillation
Gong, X., Duan, H., Yang, Y., Tan, L., Wang, J., & Vasilakos, A. V. (2023) · Electronics · doi:10.3390/electronics13010052 · Cited by 4
Cascaded cross-modal transformer for audio–textual classification
Ristea, N.-C., Anghel, A., & Ionescu, R. T. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10869-1 · Cited by 7
Vilfroy, S., Urruty, T., Carré, P., Lebrat, J.-P., & Bombrun, L. (2024) · IEEE Transactions on Radar Systems · doi:10.1109/trs.2024.3488475 · Cited by 3
Lungmix: A Mixup-Based Strategy for Generalization in Respiratory Sound Classification
Ge, S., Zhang, W., Xie, S., Yan, B., & Wang, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888016 · Cited by 3
BAST-Mamba: Binaural Audio Spectrogram Mamba Transformer for binaural sound localization
Kuang, S., Shi, J., van der Heijden, K., & Mehrkanoon, S. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130804 · Cited by 11
Ortiz-Pérez, D., Benavent-Lledó, M., Garcia-Rodriguez, J., Tomás, D., & Vizcaya-Moreno, M. F. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113787 · Cited by 7
AudioSet-R: A Refined AudioSet with Multi-Stage LLM Label Reannotation
Sun, Y., Xu, Q., Su, Y., Zhu, Q., Dou, Y., Liu, X., & Xu, K. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758260 · Cited by 7
TACOS: Temporally-aligned Audio CaptiOnS for Language-Audio Pretraining
Primus, P., Schmid, F. T., & Widmer, G. (2025) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa66052.2025.11230997 · Cited by 18
Efficient On-Device Domain Learning for Keyword Spotting on Ultra-Low-Power Platforms
Cioflan, C., Cavigelli, L., Rusci, M., de Prado, M., & Benini, L. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3654437 · Cited by 4
HACG: Leveraging Hierarchical Alignment and Caption Generation for Text-Video Retrieval
Zhang, D., Wang, Z., Wu, X.-J., & Kittler, J. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02645-7 · Cited by 4
Automated bird sound recognition in ecology: A methodological review and application framework
Shen, X., Xu, J., Zhang, Q., Luo, P., Liu, Z., Chen, J., Zhou, G., Yi, J., Xiao, Z., & Chen, A. (2026) · Avian Research · doi:10.1016/j.avrs.2026.100368 · Cited by 5
Wang, K., & Hatzinakos, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446627 · Cited by 3
Ju, Z., Wang, H., Luo, J., & Sun, F. (2024) · Computer Communications · doi:10.1016/j.comcom.2024.04.029 · Cited by 4
Multimodal dynamic fusion framework: Multilevel feature fusion guided by prompts
Pan, L., & Wu, H. (2024) · Expert Systems · doi:10.1111/exsy.13668 · Cited by 4
Wang, Y., Wang, W., Chen, Y., Su, X., Chen, J., Yang, W., Li, Q., & Duan, C. (2024) · Electronics · doi:10.3390/electronics13163194 · Cited by 2
WavRx: A Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model
Zhu, Y. M., & Falk, T. H. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3454550 · Cited by 7
Zhang, P., Wang, J., Wan, M., Zhang, S., Jing, J., Ding, L., & Shi, P. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01654-2 · Cited by 7
Spoken Accent Detection in English Using Audio-Based Transformer Models
Ozturk, O., Kilimci, H., Kılınç, H. H., & Kilimci, Z. H. (2024) · doi:10.1109/ubmk63289.2024.10773414 · Cited by 3
Video Anomaly Detection using Factorized Self-Attention Transformer
Karthik, R., Adithya, S., Shalmiya, P., & Subramaniyaswamy, V. (2024) · International Conference on Computational Intelligence and Network Systems (CINS) · doi:10.1109/cins63881.2024.10862995 · Cited by 3
Zhu, Q., Xu, Q., Zhu, B., Gao, Z., Zeng, L., & Xu, K. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887650 · Cited by 7
GraFPrint: A GNN-Based Approach for Audio Identification
Bhattacharjee, A., Singh, S., & Benetos, E. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888557 · Cited by 14
Souza, A. M., Kobayashi, L., Andrietta, L. T., Garbossa, C. A. P., Ventura, R. V., & de Sousa, E. P. M. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06555-6 · Cited by 3
Improved Baselines for Data-Efficient Perceptual Augmentation of LLMs
Vallaeys, T., Shukor, M., Cord, M., & Verbeek, J. J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92089-9_23 · Cited by 21
Metadata
- Authors
- Gong, Y., Chung, Y.-A., & Glass, J.
- Affiliations
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 571-575
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3196974791
- Cited by
- 1,159
- References
- 33
- Citations by year
- 2026: 260 · 2025: 356 · 2024: 241 · 2023: 193 · 2022: 100 · 2021: 9
- FWCI
- 82.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- Audio Spectrogram Transformer, audio classification, self-attention, spectrogram, AudioSet, ESC-50
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.