AST: Audio Spectrogram Transformer
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for endto-end audio classification models, which aim to learn a direct mapping from audio spectrograms to corresponding labels.To better capture long-range global context, a recent trend is to add a self-attention mechanism on top of the CNN, forming a CNN-attention hybrid model.However, it is unclear whether the reliance on a CNN is necessary, and if neural networks purely based on attention are sufficient to obtain good performance in audio classification.In this paper, we answer the question by introducing the Audio Spectrogram Transformer (AST), the first convolution-free, purely attention-based model for audio classification.We evaluate AST on various audio classification benchmarks, where it achieves new state-of-the-art results of 0.485 mAP on AudioSet, 95.6% accuracy on ESC-50, and 98.1% accuracy on Speech Commands V2.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Goel et al. [143] used a self-supervised audio spectrogram Transformer (SSAST) [144,145], a ViT-based architecture, to develop a contrastive learning framework, SSAST-CL, for detecting audio deepfakes. Their approach integrates Siamese networks with self-attention and cross-attention mechanisms to enhance the ViT’s feature representation”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [144]
In the citing paper
“This change enables LTU-AS to recognize both speech and audio events.”
From Joint Audio and Speech Understanding (2023) · cites this paper as [6]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3015 · Cited by 3,150
Cited by
Items 801–900 of 1,006
Hamsa, S., Iraqi, Y., Shahin, I. M. A., Damiani, E., & Werghi, N. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4783743
Ghosal, S., Bennett, A., & Turner, M. B. (2024) · Linguistics Vanguard · doi:10.1515/lingvan-2022-0130
Speech Emotion Recognition using CNN-TRANSFORMER Architecture
Mangalmurti, S., Saxena, O., & Singh, T. (2024) · IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI) · doi:10.1109/iatmsi60426.2024.10503276
Weighted Initialisation of Evolutionary Instrument and Pitch Detection in Polyphonic Music
Dettmer, J., Vatolkin, I., & Glasmachers, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56992-0_8 · Cited by 1
Multimodal Learning and Representation
Santosh, K., Rizk, R., & Bajracharya, S. K. (2024) · Studies in computational intelligence · doi:10.1007/978-981-97-2720-9_6
AlertMind: A Multimodal Approach for Detecting Menace using Transformers
Mallya, R., Rao, P. D., Nukal, P. S., Ranganath, R., & Prasad, V. R. B. (2024) · International Conference on Applied Artificial Intelligence (ICAPAI) · doi:10.1109/icapai61893.2024.10541232
DanceFree: A Somatosensory Dance Game Based on 3D Dance Animation Generation Algorithm
Zhao, J., Su, M., Zhou, Q., Luo, X., Li, J., Zhang, J., & Li, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60692-2_22
Mahajan, A., & Bhat, A. (2023) · International Conference on Advances in Computing, Communication Control and Networking (ICAC3N) · doi:10.1109/icac3n60023.2023.10541421
Multi-source Fusion in Audio Scene Classification with Refined Transformers
Chen, S., Liu, W., Liu, X., Tang, P., Lv, J., & Guo, C. (2024) · International Conference on Algorithms, Software Engineering and Network Security (ASENS) · doi:10.1145/3677182.3677242
Zhu, L., Ma, X., Zhang, R., & Zheng, J. (2024) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-65126-7_1
Halas, M., Maj, M., Guz, E., Stencel, M., & Cieplak, T. (2024) · Journal of Modern Science · doi:10.13166/jms/191163
Nagarajan, A., & Raghunathan, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70362-1_5
Prembed: Balancing Conditional Generative Models with Embedding Pretraining and RegularizationPreprint
Liu, H., Endo, Y., Lee, J., & Kamijo, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4953737
Lee, K., Tan, Y. H., Chuah, J. H., & Youn, C. (2024) · IEEE Access · doi:10.1109/access.2024.3466226
Robust Keyword Spotting Based on Long-Term Feature Fusion and Band-Weighted Normalization
Qiu, Z., Zhao, L., Wang, L., & Zhang, T. (2024) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat62382.2024.10695189
Sequential choice in ordered bundlesPreprint
Kohli, R., Krstovski, K., Kuang, H., & Lin, H. L. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5000099
Audio Sentiment Analysis with Spectrogram Representations and Transformer Models
Luitel, S., Liu, Y., & Anwar, M. M. (2024) · Conference on AI, Science, Engineering, and Technology (AIxSET) · doi:10.1109/aixset62544.2024.00027 · Cited by 2
A Multi-modal Framework to Counter Hate Speeches
Bhesra, K., & Agarwal, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78119-3_14
Araujo, W. S. B., Landim, R. G., Costa, T. B. D. S., da Silva, E. L., Castellano, G., & Rittner, L. (2024) · International Symposium on Medical Information Processing and Analysis (SIPAIM) · doi:10.1109/sipaim62974.2024.10783635
Cross-Model Knowledge Distillation and Metadata Fusion for Respiratory Sound Classification
Sun, Z., Huang, Z., Xu, X., & Li, B. (2024) · Communications in computer and information science · doi:10.1007/978-981-96-1045-7_31
Beyond Essentials: Nuanced and Diverse Text-to-video Retrieval
Yang, Y. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825297
Cheng, J., Liu, Y., Yin, J., Wang, L., & Pan, Y. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10832034
Audio-Guided Visual Knowledge Representation
Yu, F., Wan, Z., & Li, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-0914-7_9
HearDrinking: Drunkenness detection and BACs predictions based on acoustic signal
Wu, Y. L., Zhao, G., Zhang, L., Hu, X., & Ding, L. (2025) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2025.102020 · Cited by 1
Improving Automated Audio Captioning with LLM Decoder and BEATs Audio Encoder
Liu, W., & Gao, Z. (2024) · doi:10.1145/3709026.3709118 · Cited by 1
Chwalek, P. C., Coblentz, M., Montague, S., Kuronaga, M., Zhu, I., & Paradiso, J. A. (2025) · Scientific Data · doi:10.1038/s41597-025-04601-z
Speech Deepfake Recognition with Data-Efficient Vision Transformers
Modrzejewski, M., Skarzyński, S., & Rokita, P. S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-81596-6_10
Can Large Sound Event Detection Models Be Accurately Adapted to Specific Acoustic Scenarios?
Fernández-Castañón, R., Espinoza-Cuadros, F., Perero-Codosero, J. M., Sancho-Lozano, E., & Gómez, L. A. H. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-80946-0_4
Audio Sparse-Transformer for Speech Classification
Kavaki, H. S., & Mandel, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890475 · Cited by 3
Hybrid Losses for Hierarchical Embedding Learning
Tian, H., Lattner, S., McFee, B., & Saitis, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889639 · Cited by 2
No Class Left Behind: A Closer Look at Class Balancing for Audio Tagging
Ebbers, J., Germain, F. G., Wilkinghoff, K., Wichern, G., & Roux, J. L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890706 · Cited by 1
VoxVietnam: a Large-Scale Multi-Genre Dataset for Vietnamese Speaker Recognition
Vu, H. L., Dat, P. T., Nhi, P. T. T., Hao, N. S., & Trang, N. T. T. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890124 · Cited by 6
Concentrating Harder for Faster Audio Transformer
Schmidt, L. P., & Peters, N. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887669
PD-VOST: Parkinson’s Disease Voice Spectrogram Transformer
Tougui, I., Zakroum, M., Karrakchou, O., & Ghogho, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889820
Preconditioned Sharpness-Aware Minimization: Unifying Analysis and a Novel Learning Algorithm
Zhang, Y., Li, B., & Giannakis, G. B. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889586 · Cited by 3
Gupta, R., Agri, S., Palanivel, Y., Chelamkuri, O., & Gadde, R. N. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888093
An Objective Metric Towards Music Mood Visualization
Wang, H., & Sourin, A. (2024) · International Conference on Cyberworlds (CW) · doi:10.1109/cw64301.2024.00050
Emotion Recognition from Recorded Speech
Devi, S. P., & Rekha, K. S. (2024) · International Conference on Recent Innovation in Smart and Sustainable Technology (ICRISST) · doi:10.1109/icrisst59181.2024.10921969
Instrumentality Classification Evaluation System for Natural Sounds *
Wang, Y., & Itou, K. (2024) · International Symposium on Multimedia · doi:10.1109/ism63611.2024.00025
Intoxication detection from speech using representations learned from self-supervised pre-training
Albuquerque, A., Uche, S. C., & Agu, E. (2025) · Smart Health · doi:10.1016/j.smhl.2025.100562 · Cited by 2
Chwalek, P. C., Kuronaga, M., Zhu, I., Montague, S., Robinson, V. C., Lohrmann, J., Villagra, C., Susič, D., Gradišek, A., Schul, J., et al. (2025) · Scientific Data · doi:10.1038/s41597-025-04877-1
Paladin: Understanding Video Intentions in Political Advertisement Videos
Liu, H., Nakashima, Y., & Babaguchi, N. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00799 · Cited by 1
A Study on Synthesizing Expressive Violin Performances: Approaches and Comparisons
Hung, T.-Y., Wu, J.-T., Kuo, Y.-C., Hsiao, Y.-W., Lin, T.-W., & Li, S. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4589-3_1
Qin, X., & Xu, M. (2024) · International Conference on Image Processing, Computer Vision and Machine Learning (ICICML) · doi:10.1109/icicml63543.2024.10958032
Miao, S., Su, Q., Pan, H., Wei, P., Li, Y., Jinzhun, W., Hong, Q., & Li, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5230365 · Cited by 1
TexHOI: Reconstructing Textures of 3D Unknown Objects in Monocular Hand-Object Interaction Scenes
Aggarwal, A., Wang, N., & Guo, X. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3567276 · Cited by 3
Attention-Based Audio Depression Recognition Integrating Handcrafted and Deep Features
Jin, C., Zhao, S., Zhang, S., Fang, Z., Xie, J., & Chen, Y. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-5084-2_14
Quantized Approximate Signal Processing (QASP): Towards Homomorphic Encryption for Audio
Nguyen, T. D., Lesage, A., Cantini, C., & Riad, R. (2026) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2026-14 · Cited by 1
Kim, G., & Choo, Y. (2025) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2025.3558812 · Cited by 1
Zhong, Z., Li, T., Martín, M., Cormier, M., Wu, C., Diederichs, F., & Beyerer, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91575-8_2
Sound signatures for images and geometric shapes
Wang, H., & Sourin, A. (2025) · The Visual Computer · doi:10.1007/s00371-025-03954-1
Multi-purpose technology commercialization recommender system with large-scale Korean language model
Noh, K., Hwang, H., Lim, Y., Oh, C., Kim, S., Lee, E., Choi, Y., Kim, S., Choi, H., & Song, K. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07341-4
Classification of Environmental and Urban Sounds Using Deep Learning Techniques
Reddy, B. S., Chowdary, D. L., Srinivas, R., & Rahmani, M. O. (2025) · International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE) · doi:10.1109/icdcece65353.2025.11036020
Music Genre Classification with AST Models: A Path to Emotional Resilience in Bengaluru
Rao, R. V., & Juliet, S. (2025) · International Conference on Augmented Intelligence and Sustainable Systems (ICAISS) · doi:10.1109/icaiss61471.2025.11041853
Rekavandi, A. M., Bennamoun, M., Boussaïd, F., Davis, W. A., & Davis, T. M. E. (2025) · IEEE Access · doi:10.1109/access.2025.3582938
Horzyk, A. M., Lu, T., & Guo, R. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6599-0_6
NCSV: A Multimodal Benchmark for Negative Chinese Short Video Detection with Social Context
Qin, Y., & Xu, G. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6599-0_14 · Cited by 1
Multimodal Transformer Models for Human Action Classification
Varga, Z., Mascaro, E. V., Sliwowski, D., & Lee, D. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-92011-0_5
Fu, J., Luo, X., Yuan, J., & Yu, H. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0030-7_24
SKANN: Selective Kernel Audio Neural Networks for Underwater Mixed Ship Event Detection
Shan, C., Zou, T., Zhao, L., Zhang, Q., Zhu, Y., Mohsen, G., & Qiu, J. (2025) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.70037
Mehra, S., Ranga, V., & Agarwal, R. (2025) · Circuits Systems and Signal Processing · doi:10.1007/s00034-025-03231-5 · Cited by 1
Music Genre Classification Based on Convolutional Neural Networks and Transformer
Chen, J. (2025) · Applied and Computational Engineering · doi:10.54254/2755-2721/2025.bj25786
TranSTYLer: Multimodal behavioural style transfer for facial and body gestures generation
Fares, M., Pélachaud, C., & Obin, N. (2025) · Speech Communication · doi:10.1016/j.specom.2025.103286 · Cited by 3
An Adaptive Time-Frequency Fusion Framework for Real-Time Sound Monitoring in Cvd Roller DressingPreprint
Chen, G., Zhou, W., Zhang, J., Yitong, H., Peng, P., & Yu, G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5400401
Challenges and Opportunities of Generative Ai Models in Audio/AcousticPreprint
Dibbo, S. V., Lin, C.-H., & Vhaduri, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5404604
Feature Extraction Methods for Anomaly Detection Using Electrocardiography Signal
Vu, T. A., Tran, B. X., Hoang, H. Q., & Phạm, T. T. H. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-032-00267-9_35
Wang, C., Ito, A., Nose, T., & Chen, C.-P. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-94898-5_28
Multimodal Large Language Models for Video Understanding
Wang, Y., Yu, J., He, Y., Wang, L., & Qiao, Y. (2025) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-031-94969-2_3
Li, F., Duorinaah, F. X., Kim, M.-K., Thedja, J. P. P., Seo, J., & Lee, D. (2025) · Buildings · doi:10.3390/buildings15173136
Fine-Grained Audio–Visual Event Localization
Fan, B., Liu, L., Li, X., Zhang, R., Jin, L., & Zhang, J. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3600878 · Cited by 4
Super Encoding Network: Recursive Association of Multi-Modal Encoders for Video UnderstandingPreprint
Chen, B., Chen, S., Li, K., Qing-lin, X., Qiao, Y., & Wang, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5458392
SeqFusionNet: A hybrid model for sequence-aware and globally integrated acoustic representation
Wu, T., Ma, W., Gu, O., Bing, Y., Zhou, Y., & Li, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0330691 · Cited by 2
Paim, K. O., Silva, T. R. M. B., Dilly, J., Tavares, A. R., Cunha, M. D. P., da Silva, O. S., Recamonde‐Mendoza, M., Mansilha, R. B., & Cordeiro, W. L. D. C. (2025) · Anais do Seminário Integrado de Software e Hardware (SEMISH) · doi:10.5753/semish.2025.6555 · Cited by 1
Alhussein, G., Alkhodari, M., Saleem, S., Khandoker, A. H., & Hadjileontiadis, L. J. (2025) · Expert Systems · doi:10.1111/exsy.70146
Assessing AI Consciousness: A Substrate-Independent FrameworkPreprint
Vale, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5551300
Adaptive Fine-Grained Pruning via Binary Search for Efficient Environmental Sound Classification
Wang, C., Ito, A., & Nose, T. (2025) · IEEE Access · doi:10.1109/access.2025.3617879 · Cited by 1
Tang, W., Doğan, F. I., Qing, L., & Güneş, H. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3616347 · Cited by 8
Yang, H., Wang, J., Li, S., Zhou, D., Chen, X., Li, J., Hua, Y., & Shi, J. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3616585
Non-Contact Hand Tremor Detection Via Water Pouring Sound Recognition
Tran, V.-T., Nguyen, T.-T., Chen, Y., & Tsai, W.-H. (2025) · IEEE Access · doi:10.1109/access.2025.3620096
Visual Feature Domain Audio Coding for Anomaly Sound Detection Application
Byun, S., & Seo, J. (2025) · Algorithms · doi:10.3390/a18100646
A YOLOv8-Based Visual Approach for Dolphin Whistle Call Detection
Lv, H., Zhao, Z., Xiang, M., Chen, Y., Li, K., & Chen, J. (2025) · IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC) · doi:10.1109/icspcc66825.2025.11194572
Smoker Detection from Cough Sounds: A Deep Learning Approach Using AST
Nugroho, W., Bustamam, A., & Anwar, R. (2025) · International Conference on Metaverse and Current Trends in Computing (ICMCTC) · doi:10.1109/icmctc62214.2025.11196138
SoundNarratives: Rich Auditory Scene Descriptions to Support Deaf and Hard of Hearing People
Wu, L.-Y., & Jain, D. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746341 · Cited by 4
Audio-Visual Contact Classification for Tree Structures in Agriculture
Spears, R., Lee, M. Y., Kantor, G. A., & Kroemer, O. (2025) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids65713.2025.11203167
Benchmarking Transfer Learning in Passive Sonar: An Evaluation Study
Ingham, F., Culwick, R., Williams, D. P., & Hospedales, T. M. (2025) · Machine learning for signal processing ... · doi:10.1109/mlsp62443.2025.11204218
Singh, M., Choudhary, P., Saddik, A. E., & Saini, M. K. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209138
MAPLE: Modality-Agnostic Prototype Learning for Egocentric Action Recognition
Li, D., Zhou, D., Zou, Y., Li, S., & Liu, M. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209479
DiBAN: Dual-Drive Broad Attentive Network for Speech Emotion Recognition
Zhang, G., Chen, C. L. P., Zhang, T., Liu, Z., Hu, X., & Chen, B. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209814
Endo, H., Yajima, H., Leow, C. S., Tanzawa, T., Makino, K., Ishida, K., & Nishizaki, H. (2025) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon58223.2025.11221896
Multilingual Speech Command Recognition with Language Identification
Muratov, A., Kuzdeuov, A., & Varol, H. A. (2025) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon58223.2025.11221185
Churchwell, C., Kim, M., & Smaragdis, P. (2025) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa66052.2025.11231004
The Perception of Phase Intercept Distortion and its Application in Data Augmentation
Krishnan, V. V., & Condit-Schultz, N. (2025) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa66052.2025.11231010
Lightweight Transformer with Enhanced Inverted Residual Blocks for Bird Sound Recognition
Cheng, X., Fan, S., Ding, J., Wu, Q., Cheng, L., & Chai, Z. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229104
Counterfactual Multi-agent Decision Transformer
Zhao, F., Hu, Y., & Chan, W. K. V. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227266
Kishimoto, K., Takemura, T., Sugiyama, O., Kojima, R., Yakami, M., Yamamoto, G., & Kuroda, T. (2025) · JMIR Medical Informatics · doi:10.2196/35987
Shinde, D., & Mulani, A. O. (2025) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-29521
Neonatal Pain Speech Emotion Recognition Based on Multiscale Multilevel MAE Network
Yan, J., Sun, W., Sun, B., Zhou, X., Lu, G., Li, X., & Zheng, X. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3625592 · Cited by 3
Liang, Y., Luo, T., & Zhong, C. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114893
VOCAL-denoiser: A novel focal-based Unet for a robust speech denoising
Nasef, M. M., Nabil, M. M., & Sauber, A. M. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101904
Hybrid Deep Learning–Data Augmentation Approach for Sound Classification
Thien, T. C. T. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4724-1_30
Metadata
- Authors
- Gong, Y., Chung, Y.-A., & Glass, J.
- Affiliations
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 571-575
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3196974791
- Cited by
- 1,159
- References
- 33
- Citations by year
- 2026: 260 · 2025: 356 · 2024: 241 · 2023: 193 · 2022: 100 · 2021: 9
- FWCI
- 82.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- Audio Spectrogram Transformer, audio classification, self-attention, spectrogram, AudioSet, ESC-50
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.