AST: Audio Spectrogram Transformer
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for endto-end audio classification models, which aim to learn a direct mapping from audio spectrograms to corresponding labels.To better capture long-range global context, a recent trend is to add a self-attention mechanism on top of the CNN, forming a CNN-attention hybrid model.However, it is unclear whether the reliance on a CNN is necessary, and if neural networks purely based on attention are sufficient to obtain good performance in audio classification.In this paper, we answer the question by introducing the Audio Spectrogram Transformer (AST), the first convolution-free, purely attention-based model for audio classification.We evaluate AST on various audio classification benchmarks, where it achieves new state-of-the-art results of 0.485 mAP on AudioSet, 95.6% accuracy on ESC-50, and 98.1% accuracy on Speech Commands V2.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Goel et al. [143] used a self-supervised audio spectrogram Transformer (SSAST) [144,145], a ViT-based architecture, to develop a contrastive learning framework, SSAST-CL, for detecting audio deepfakes. Their approach integrates Siamese networks with self-attention and cross-attention mechanisms to enhance the ViT’s feature representation”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [144]
In the citing paper
“This change enables LTU-AS to recognize both speech and audio events.”
From Joint Audio and Speech Understanding (2023) · cites this paper as [6]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3015 · Cited by 3,150
Cited by
Items 101–200 of 1,006
Kim, K. K., Zaluska, T. J., Skov, S., Lee, Y., Park, H., Zhong, D., Khatib, M., Nishio, Y., Jiang, Y., Delp, S. L., et al. (2025) · Nature Sensors · doi:10.1038/s44460-025-00002-2 · Cited by 67
Identifying Parkinson’s Disease using Multimodal Approach and Deep Learning
Mohaghegh, M., & Gascon, J. (2021) · International Conference on Innovative Technologies in Intelligent Systems and Industrial Applications (CITISIA) · doi:10.1109/citisia53721.2021.9719945 · Cited by 32
AST-SED: An Effective Sound Event Detection Method Based on Audio Spectrogram Transformer
Li, K., Song, Y., Dai, L.-R., McLoughlin, I. V., Fang, X., & Liu, L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096853 · Cited by 53
CED: Consistent Ensemble Distillation for Audio Tagging
Dinkel, H., Wang, Y., Yan, Z., Zhang, J., & Wang, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446348 · Cited by 77
ChatGPT for Visually Impaired and Blind
Kuzdeuov, A., Mukayev, O., Nurgaliyev, S., Kunbolsyn, A., & Varol, H. A. (2024) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic60209.2024.10463430 · Cited by 48
Jeong, S.-M., Song, Y.-D., Seok, C. L., Lee, J., Lee, E. C., & Kim, H. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109078 · Cited by 36
Lü, P., Wang, C., Hagenah, J., Ghiasi, S., VITAL consortium, Zhu, T., Thwaites, L., & Clifton, D. A. (2022) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2022.3216383 · Cited by 34
Modeling Speech Emotion Recognition via Attention-Oriented Parallel CNN Encoders
Makhmudov, F., Kutlimuratov, A., Akhmedov, F., Abdallah, M. S., & Cho, Y. I. (2022) · Electronics · doi:10.3390/electronics11234047 · Cited by 35
HTS-AT: A hierarchical token-semantic audio transformer for sound classification and detectionPreprint
Chen, K., Du, X., Zhu, B., Ma, Z., Berg-Kirkpatrick, T., & Dubnov, S. (2022) · doi:10.31219/osf.io/d264y · Cited by 29
Transformers and audio detection tasks: An overview
Zaman, K., Li, K., Şah, M., Direkoğlu, C., Okada, S., & Unoki, M. (2024) · Digital Signal Processing · doi:10.1016/j.dsp.2024.104956 · Cited by 48
ATST: Audio Representation Learning with Teacher-Student Transformer
Xian, L. I., & Li, X. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10126 · Cited by 47
Divide and Distill: New Outlooks on Knowledge Distillation for Environmental Sound Classification
Tripathi, A. M., & Pandey, O. J. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3244507 · Cited by 39
(2023) · doi:10.1109/cvpr52729.2023.00627 · Cited by 28
AI-based soundscape analysis: Jointly identifying sound sources and predicting annoyance
Hou, Y., Ren, Q., Zhang, H., Mitchell, A., Aletta, F., Kang, J., & Botteldooren, D. B. (2023) · The Journal of the Acoustical Society of America · doi:10.1121/10.0022408 · Cited by 37
Content-based Graph Reconstruction for Cold-start Item Recommendation
Kim, J., Kim, E., Yeo, K., Jeon, Y., Kim, C., Lee, S., & Lee, J. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657801 · Cited by 49
Enhancing Speech Emotion Recognition Using Dual Feature Extraction Encoders
Pulatov, I., Oteniyazov, R., Makhmudov, F., & Cho, Y. I. (2023) · Sensors · doi:10.3390/s23146640 · Cited by 33
Tougui, I., Zakroum, M., Karrakchou, O., & Ghogho, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-81824-x · Cited by 34
Exploring Embodied Multimodal Large Models: Development, datasets, and future directions
Chen, S., Wu, Z., Zhang, K., Li, C., Zhang, B., Ma, F., Yu, F. R., & Li, Q. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103198 · Cited by 57
Scaling Up Your Kernels: Large Kernel Design in ConvNets Toward Universal Representations
Zhang, Y., Ding, X., & Yue, X. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3600702 · Cited by 46
Spectrogram Transformers for Audio Classification
Zhang, Y., Li, B., Fang, H., & Meng, Q. (2022) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist55454.2022.9827729 · Cited by 36
XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning
Sarkar, P., & Etemad, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29407 · Cited by 58
Assisting Heart Valve Diseases Diagnosis via Transformer-Based Classification of Heart Sound Signals
Yang, D., Lin, Y., Wei, J., Lin, X., Zhao, X., Yao, Y., Tao, T., Liang, B., & Lu, S. (2023) · Electronics · doi:10.3390/electronics12102221 · Cited by 31
Hashmi, A., Shahzad, S. A., Lin, C., Tsao, Y., & Wang, H. (2025) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2025.3554477 · Cited by 47
Beyond the Status Quo: A Contemporary Survey of Advances and Challenges in Audio Captioning
Xu, X., Xie, Z., Wu, M., & Yu, K. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3321968 · Cited by 45
Graph-Based Audio Classification Using Pre-Trained Models and Graph Neural Networks
Castro-Ospina, A. E., Solarte-Sanchez, M., Vega-Escobar, L. S., Isaza, C., & Martinez-Vargas, J. D. (2024) · Sensors · doi:10.3390/s24072106 · Cited by 31
Co-learning synaptic delays, weights and adaptation in spiking neural networks
Deckers, L., Damme, L. V., Leekwijck, W. V., Tsang, I. J., & Latré, S. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1360300 · Cited by 38
Tzeng, J.-T., Li, J.-L., Chen, H., Huang, C.-H., Chen, C., Fan, C., Huang, E. P., & Lee, C.-C. (2025) · JMIR AI · doi:10.2196/67239 · Cited by 37
A DCRNN-based ensemble classifier for speech emotion recognition in Odia language
Swain, M., Maji, B., Kabisatpathy, P., & Routray, A. (2022) · Complex & Intelligent Systems · doi:10.1007/s40747-022-00713-w · Cited by 32
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit
Zhang, H., Tian, Y., Chen, J., Li, X., Zheng, R., Huang, Y., Chen, X., Gong, E., Chen, Z., Hu, X., et al. (2022) · doi:10.18653/v1/2022.naacl-demo.12 · Cited by 33
Adapting a ConvNeXt Model to Audio Classification on AudioSet
Pellegrini, T., Khalfaoui-Hassani, I., Labbé, É., & Masquelier, T. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1564 · Cited by 41
ASiT: Local-Global Audio Spectrogram Vision Transformer for Event Classification
Ahmed, S. A. A., Awais, M., Wang, W., Plumbley, M. D., & Kittler, J. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3428908 · Cited by 50
Multitask Transformer for Cross-Corpus Speech Emotion Recognition
Ahn, C.-S., Rana, R. K., Busso, C., & Rajapakse, J. C. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3526592 · Cited by 26
UAVM: Towards Unifying Audio and Visual Models
Gong, Y., Liu, A. H., Rouditchenko, A., & Glass, J. R. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3224688 · Cited by 39
Self-citationSemi-Supervised Sound Event Detection with Pre-Trained Model
Xu, L., Wang, L., Bi, S., Liu, H., & Wang, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095687 · Cited by 29
Ghani, B., Kalkman, V. J., Planqué, B., Vellinga, W.-P., Gill, L., & Stowell, D. (2025) · Scientific Reports · doi:10.1038/s41598-025-00996-2 · Cited by 22
Learning with Structural Labels for Learning with Noisy Labels
Kim, N.-R., Lee, J.-S., & Lee, J.-H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02607 · Cited by 43
Vocal Biomarkers for Parkinson’s Disease Classification Using Audio Spectrogram Transformers
Madusanka, N., & Lee, B.-I. (2024) · Journal of Voice · doi:10.1016/j.jvoice.2024.11.008 · Cited by 22
Wen, Z., Chen, A., Zhou, G., Yi, J., & Peng, W. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16024-2 · Cited by 22
Wang, J., Qian, P., Chen, Y., Zhou, S., Li, Z., & Xiao, P. (2025) · Digital Signal Processing · doi:10.1016/j.dsp.2025.105193 · Cited by 23
Yu, S., Yu, J., Chen, L., Zhu, B., Liang, X., Xie, Y., & Sun, Q. (2025) · Electronics · doi:10.3390/electronics14142794 · Cited by 33
Bae, S., Hong, J., Ha, S., Moon, J., Yu, J., Choi, H., Lee, J., Do, R., Sim, H., Kim, H., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01914-6 · Cited by 35
Data Augmentation for Dementia Detection in Spoken Language.
Woszczyk, D. C., Hedlikova, A., Akman, A., Demetriou, S., & Schuller, B. W. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10210 · Cited by 34
Multi-Task Learning For Radar Signal Characterisation
Huang, Z., Pemasiri, A., Denman, S., Fookes, C., & Martin, T. L. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193318 · Cited by 21
A Noise-Robust Heart Sound Segmentation Algorithm Based on Shannon Energy
Arjoune, Y., Nguyen, T., Doroshow, R. W., & Shekhar, R. (2024) · IEEE Access · doi:10.1109/access.2024.3351570 · Cited by 28
Multi-View Spectrogram Transformer for Respiratory Sound Classification
He, W., Yan, Y., Ren, J., Bai, R., & Jiang, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445825 · Cited by 45
Synchformer: Efficient Synchronization From Sparse Cues
Iashin, V., Xie, W., Rahtu, E., & Zisserman, A. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448489 · Cited by 46
Deep Convolutional Transformer Network for Stock Movement Prediction
Xie, L., Chen, Z., & Yu, S. (2024) · Electronics · doi:10.3390/electronics13214225 · Cited by 24
A Comprehensive Survey on Large-Language-Model-Based Agents for Education
Yang, J., Wang, M., Du, X., & Na, R. (2025) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2025.3617909 · Cited by 23
Low-Resource Music Genre Classification with Cross-Modal Neural Model Reprogramming
Hung, Y.-N. A., Yang, C.-H. H., Chen, P., & Lerch, A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096568 · Cited by 20
ATGNN: Audio Tagging Graph Neural Network
Singh, S., Steinmetz, C. J., Benetos, E., Phan, H., & Stowell, D. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3352514 · Cited by 28
Automated Data Augmentation for Audio Classification
Sun, Y., Xu, K., Liu, C., Dou, Y., Wang, H., Ding, B., & Pan, Q. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3402049 · Cited by 26
RepAugment: Input-Agnostic Representation-Level Augmentation for Respiratory Sound Classification
Kim, J.-W., Toikkanen, M., Bae, S., Kim, M., & Jung, H.-Y. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc53108.2024.10782363 · Cited by 38
Transformer-Based Approach to Pathology Diagnosis Using Audio Spectrogram
Tami, M. A., Masri, S., Hasasneh, A., & Tadj, C. (2024) · Information · doi:10.3390/info15050253 · Cited by 19
A Survey on MLLMs in Education: Application and Future Directions
Xing, W., Zhu, T., Wang, J., & Liu, B. (2024) · Future Internet · doi:10.3390/fi16120467 · Cited by 36
Manikandan, V., & Neethirajan, S. R. (2025) · Sensors · doi:10.3390/s25134058 · Cited by 36
Transformers for Urban Sound Classification—A Comprehensive Performance Evaluation
Nogueira, A. F. R., Oliveira, H. S., Machado, J. J. M., & Tavares, J. M. R. S. (2022) · Sensors · doi:10.3390/s22228874 · Cited by 19
Fares, M., Pélachaud, C., & Obin, N. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1142997 · Cited by 27
Recognizing the State of Motion by Ship-Radiated Noise Using Time-Frequency Swin-Transformer
Wu, F., Yao, H., & Wang, H. (2024) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2024.3369663 · Cited by 21
Zeng, C., Li, K., & Wang, Z. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111938 · Cited by 28
Cluster search optimisation of deep neural networks for audio emotion classification
Slade, S., Zhang, L., Asadi, H., Lim, C. P., Yu, Y., Zhao, D., Panesar, A., Wu, P. F., & Gao, R. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113223 · Cited by 19
Exploring Inter-Node Relations in CNNs for Environmental Sound Classification
Song, H., Deng, S., & Han, J. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3130502 · Cited by 20
Self-Supervised Graphs for Audio Representation Learning With Limited Labeled Data
Shirian, A., Somandepalli, K., & Guha, T. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3190083 · Cited by 20
Yang, C., Hu, S., Tang, L., Deng, R., Zhou, G., Yi, J., & Chen, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125213 · Cited by 20
Foundation Models for Video Understanding: A SurveyPreprint
Madan, N., Møgelmose, A., Modi, R., Rawat, Y. S., & Moeslund, T. B. (2024) · doi:10.36227/techrxiv.171769139.99464428/v1 · Cited by 39
Evaluating and accelerating vision transformers on GPU-based embedded edge AI systems
Martin-Salinas, I., Badía, J. M., Valls, Ó., León, G., del Amor, R., Belloch, J. A., Amor-Martín, A., & Naranjo, V. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06807-1 · Cited by 20
A new Two-Stream Temporal-Frequency transformer network for underwater acoustic target recognition
Bi, D., Zhang, L., & Chen, J. (2025) · Signal Processing · doi:10.1016/j.sigpro.2025.109891 · Cited by 19
The bottlenecks of AI: challenges for embedded and real-time research in a data-centric age
Abdelzaher, T., Hu, Y. C., Kara, D., Kimura, T., Misra, A., Ramani, V., Tardieu, O., Wang, T., Wigness, M., & Youssef, A. (2025) · Real-Time Systems · doi:10.1007/s11241-025-09452-w · Cited by 28
Language-Guided Audio-Visual Learning for Long-Term Sports Assessment
Xu, H., Ke, X., Wu, H., Xu, R., Li, Y., & Guo, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02232 · Cited by 34
Ortiz-Pérez, D., Benavent-Lledó, M., Rodriguez-Juan, J., García‐Rodríguez, J., & Tomás, D. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114264 · Cited by 29
Yang, T., Xiao, Y., Bao, Z., Hao, J., & Peng, J. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf601 · Cited by 34
Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge Transfer
Zhao, Y., Hessel, J., Yu, Y., Lu, X., Zellers, R., & Choi, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.333 · Cited by 24
Transformer-Based Bioacoustic Sound Event Detection on Few-Shot Learning Tasks
You, L., Coyotl, E. P., Gunturu, S., & Segbroeck, M. V. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097081 · Cited by 26
SleepViTransformer: Patch-based sleep spectrogram transformer for automatic sleep staging
Li, P., Ren, Y., Luan, Z., Chen, X., Yang, X., & Tu, W. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105203 · Cited by 26
Cooperative Scene-Event Modelling for Acoustic Scene Classification
Hou, Y., Kang, B., Mitchell, A., Wang, W., Kang, J., & Botteldooren, D. B. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3323135 · Cited by 24
Li, Z., Zhao, Y., Zhang, Y., Li, X., & Bu, L. (2024) · Journal of Engineering Design · doi:10.1080/09544828.2024.2332122 · Cited by 17
Quality-Guided Vision-Language Learning for Long-Term Action Quality Assessment
Xu, H., Wu, H., Ke, X., Li, Y., Xu, R., & Guo, W. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3599078 · Cited by 31
Lin, J., Cui, Y., Fang, C., Pan, B., Pan, C., Jiang, G., Zhang, S., Ma, S., & Tian, Q. C. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3652641 · Cited by 23
Exploring Fine-Grained Audiovisual Categorization with the SSW60 Dataset
Horn, G. V., Qian, R., Wilber, M. J., Adam, H., Aodha, O. M., & Belongie, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20074-8_16 · Cited by 30
Multi-Scale Audio Spectrogram Transformer for Classroom Teaching Interaction Recognition
Liu, F., & Fang, J. (2023) · Future Internet · doi:10.3390/fi15020065 · Cited by 21
eP-ALM: Efficient Perceptual Augmentation of Language Models
Shukor, M., Dancette, C., & Cord, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02016 · Cited by 16
Kim, J.-Y., & Lee, S.-H. (2024) · IEEE Access · doi:10.1109/access.2024.3447770 · Cited by 19
Ding, H., Du, Z., Wang, Z., Xue, J., Wei, Z., Yang, K., Jin, S., Zhang, Z., & Wang, J. (2024) · Frontiers in Physics · doi:10.3389/fphy.2024.1430035 · Cited by 18
RADIANCE: Reliable and interpretable depression detection from speech using transformer
Gupta, A. K., Dhamaniya, A., & Gupta, P. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109325 · Cited by 18
EfficientLEAF: A Faster LEarnable Audio Frontend of Questionable Use
Schlüter, J., & Gutenbrunner, G. (2022) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco55093.2022.9909910 · Cited by 33
Kannan, A., Saikia, M. J., Kumar, S., & Datta, S. (2025) · IEEE Access · doi:10.1109/access.2025.3583263 · Cited by 22
Beyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Grounding
Jones, J., Mees, O., Sferrazza, C., Stachowicz, K., Abbeel, P., & Levine, S. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127987 · Cited by 83
Self‐supervised multimodal fusion transformer for passive activity recognition
Koupaï, A. K., Bocus, M. J., Santos‐Rodríguez, R., Piechocki, R. J., & McConville, R. (2022) · IET Wireless Sensor Systems · doi:10.1049/wss2.12044 · Cited by 18
Accommodating Audio Modality in CLIP for Multimodal Processing
Ruan, L., Hu, A., Song, Y., Zhang, L., Zheng, S., & Jin, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26153 · Cited by 31
Shi, L., Zhang, J., Yang, B., & Gao, Y. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3306911 · Cited by 17
Secure short-term load forecasting for smart grids with transformer-based federated learning
Sievers, J., & Blank, T. (2023) · International Conference on Clean Electrical Power · doi:10.1109/iccep57914.2023.10247363 · Cited by 20
Wang, Y., Zhang, H., & Huang, W. K. (2023) · Frontiers in Marine Science · doi:10.3389/fmars.2023.1280708 · Cited by 18
Learning Temporal Resolution in Spectrogram for Audio Classification
Liu, H., Liu, X., Kong, Q., Wang, W., & Plumbley, M. D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29294 · Cited by 24
DS-TDNN: Dual-Stream Time-Delay Neural Network With Global-Aware Filter for Speaker Verification
Li, Y., Gan, J., Lin, X., Qiu, Y., Zhan, H., & Tian, H. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3402072 · Cited by 21
Choi, H., Zhang, L., & Watkins, C. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129415 · Cited by 18
Kim, B. J., Mun, J. H., Hwang, D. H., Suh, D. I., Lim, C., & Kim, K. (2025) · Scientific Reports · doi:10.1038/s41598-025-89533-9 · Cited by 15
Decorrelating Feature Spaces for Learning General-Purpose Audio Representations
Ghosh, S., Seth, A., & Umesh, S. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3202093 · Cited by 17
Fang, L., Cai, J., Huang, Z., Tuohuti, A., & Chen, X. (2024) · Sleep Medicine · doi:10.1016/j.sleep.2024.11.018 · Cited by 19
Merler, M., Agurto, C., Peller, J., Roitberg, E., Taitz, A., Trevisan, M. A., Navar, I., Berry, J. D., Fraenkel, E., Ostrow, L. W., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01654-7 · Cited by 22
Kim, J.-Y., & Lee, S.-H. (2023) · International Conference on Electronics, Information, and Communication (ICEIC) · doi:10.1109/iceic57457.2023.10049941 · Cited by 14
Classification of stuttering – The ComParE challenge and beyond
Bayerl, S. P., Gerczuk, M., Batliner, A. M., Bergler, C., Amiriparian, S., Schuller, B. W., Nöth, E., & Riedhammer, K. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101519 · Cited by 27
Metadata
- Authors
- Gong, Y., Chung, Y.-A., & Glass, J.
- Affiliations
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 571-575
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3196974791
- Cited by
- 1,159
- References
- 33
- Citations by year
- 2026: 260 · 2025: 356 · 2024: 241 · 2023: 193 · 2022: 100 · 2021: 9
- FWCI
- 82.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- Audio Spectrogram Transformer, audio classification, self-attention, spectrogram, AudioSet, ESC-50
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.