AST: Audio Spectrogram Transformer
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for endto-end audio classification models, which aim to learn a direct mapping from audio spectrograms to corresponding labels.To better capture long-range global context, a recent trend is to add a self-attention mechanism on top of the CNN, forming a CNN-attention hybrid model.However, it is unclear whether the reliance on a CNN is necessary, and if neural networks purely based on attention are sufficient to obtain good performance in audio classification.In this paper, we answer the question by introducing the Audio Spectrogram Transformer (AST), the first convolution-free, purely attention-based model for audio classification.We evaluate AST on various audio classification benchmarks, where it achieves new state-of-the-art results of 0.485 mAP on AudioSet, 95.6% accuracy on ESC-50, and 98.1% accuracy on Speech Commands V2.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Goel et al. [143] used a self-supervised audio spectrogram Transformer (SSAST) [144,145], a ViT-based architecture, to develop a contrastive learning framework, SSAST-CL, for detecting audio deepfakes. Their approach integrates Siamese networks with self-attention and cross-attention mechanisms to enhance the ViT’s feature representation”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [144]
In the citing paper
“This change enables LTU-AS to recognize both speech and audio events.”
From Joint Audio and Speech Understanding (2023) · cites this paper as [6]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3015 · Cited by 3,150
Cited by
Items 501–600 of 1,006
SputumLocator: Enhancing Airway Clearance with Auscultation-based Sputum Localization
Gong, Y., Xie, W., Xu, C., Zhang, Q., & Yang, S. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3729472 · Cited by 3
Self-citationTri-MTL: A Triple Multitask Learning Approach for Respiratory Disease Diagnosis
Kim, J.-W., Lee, S., Toikkanen, M., Hwang, D., & Kim, K. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11251810 · Cited by 3
WaveBYOL: Self-Supervised Learning for Audio Representation From Raw Waveforms
Kim, S., & Choi, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3239660 · Cited by 3
Improving latency performance trade-off in keyword spotting applications at the edge
Paissan, F., Sahabdeen, A. M., Ancilotto, A., & Farella, E. (2023) · International Workshop on Advances in Sensors and Interfaces (IWASI) · doi:10.1109/iwasi58316.2023.10164328 · Cited by 6
Online Continual Learning in Acoustic Scene Classification: An Empirical Study
Ha, D., Kim, M., & Jeong, C. Y. (2023) · Sensors · doi:10.3390/s23156893 · Cited by 4
Weak Supervised Sound Event Detection Based on Puzzle CAM
Cai, X., Gan, Y., Wu, M., & Wu, J. (2023) · IEEE Access · doi:10.1109/access.2023.3305633 · Cited by 3
Heo, Y., Kang, S., & Seo, J. (2023) · Sensors · doi:10.3390/s23187875 · Cited by 3
Cascaded Cross-Modal Transformer for Request and Complaint Detection
Ristea, N.-C., & Ionescu, R. T. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612846 · Cited by 4
Low-Cost Gunshot Detection System with Localization for Community Based Violence Interruption
Manring, I., Hill, J. H., Mohler, G., Brantingham, P. J., Williams, T. G., & White, B. (2023) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa60987.2023.10302469 · Cited by 3
Multi-Task Learning Using Facial Features for Mental Health Screening
Flores, R., Shrestha, A., Tlachac, M., & Rundensteiner, E. A. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386191 · Cited by 7
MHAiR: A Dataset of Audio-Image Representations for Multimodal Human Actions
Shaikh, M. B., Chai, D., Islam, S. M. S., & Akhtar, N. (2024) · Data · doi:10.3390/data9020021 · Cited by 3
SV-DeiT: Speaker Verification with DeiTCap Spoofing Detection
Ranjan, R., Mayank Vatsa, A., & Singh, R. (2023) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb57857.2023.10449121 · Cited by 9
ASPED: An Audio Dataset for Detecting Pedestrians
Seshadri, P., Han, C., Koo, B.-W., Posner, N., Guhathakurta, S., & Lerch, A. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447655 · Cited by 3
Exploring Meta Information for Audio-Based Zero-Shot Bird Classification
Gebhard, A., Triantafyllopoulos, A., Bez, T., Christ, L., Kathan, A., & Schuller, B. W. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445807 · Cited by 9
AttHear: Explaining Audio Transformers Using Attention-Aware NMF
Akman, A., & Schuller, B. W. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447390 · Cited by 6
On The Choice of the Optimal Temporal Support for Audio Classification with Pre-Trained Embeddings
Quélennec, A., Olvera, M., Peeters, G. G., & Essid, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447963 · Cited by 6
The Evolution of Technology in Artificial Intelligence and Its Impact on Project Management
Wagner, P., & Wagner, R. (2024) · Engineering cyber-physical systems and critical infrastructures · doi:10.1007/978-3-031-56322-5_19 · Cited by 9
EMOVA: Emotion-driven neural volumetric avatar
Hwang, J., Kim, B.-G., Kim, T., Oh, H., & Kang, J. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105043 · Cited by 3
Sound Tagging in Infant-centric Home Soundscapes
Khan, M. N. H., Li, J., McElwain, N. L., Hasegawa‐Johnson, M., & Islam, B. (2024) · IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1109/chase60773.2024.00023 · Cited by 4
A Data-Driven Environmental Sound Classification System with Acoustic Triboelectric Nanogenerators
Bagheri, M. H., Li, J., Gu, E., Habashy, K., Rana, M. M., Khan, A. A., Zhang, Y., Xiao, G. G., Xi, P., & Ban, D. (2024) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece59415.2024.10667121 · Cited by 6
Wang, J., Dong, G., Shen, Y., Zhang, M., & Sun, P. (2024) · doi:10.1109/icsip61881.2024.10671504 · Cited by 7
MusicTalk: A Microservice Approach for Musical Instrument Recognition
Lin, Y., Cheng, C., & Chiu, S.-C. (2024) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2024.3476416 · Cited by 4
A Residual Multi-Scale Convolutional Neural Network With Transformers for Speech Emotion Recognition
Yan, T., Meng, H., Parada‐Cabaleiro, E., Tao, J., Li, T., & Schuller, B. W. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3481253 · Cited by 4
Spherical World-Locking for Audio-Visual Localization in Egocentric Videos
Yun, H., Gao, R., Ananthabhotla, I., Kumar, A. K., Donley, J., Li, C., Kim, G., Ithapu, V. K., & Murdock, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72691-0_15 · Cited by 11
Amazigh Speech Recognition via Parallel CNN Transformer-Encoder Model
Daouad, M., Allah, F. A., & Dadi, E. W. (2024) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-75329-9_28 · Cited by 3
Authenticity at Risk: Key Factors in the Generation and Detection of Audio Deepfakes
Martínez-Serrano, A., Montero-Ramírez, C., & Peláez-Moreno, C. (2025) · Applied Sciences · doi:10.3390/app15020558 · Cited by 4
REDT: a specialized transformer model for the respiratory phase and adventitious sound detection
Wang, J., Dong, G., Shen, Y., Xu, X., Zhang, M., & Sun, P. (2025) · Physiological Measurement · doi:10.1088/1361-6579/adaf08 · Cited by 4
Iqbal, R., Ritz, C. H., Yang, J., & Howard, S. K. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10849057 · Cited by 3
Synergy-CLIP: Extending CLIP With Multi-Modal Integration for Robust Representation Learning
Cho, S., Jeon, J., Kim, M., & Kim, J. (2025) · IEEE Access · doi:10.1109/access.2025.3559663 · Cited by 7
Adaptive Depth-Wise Pruning for Efficient Environmental Sound Classification
Wang, C., Ito, A., & Nose, T. (2025) · IEEE Access · doi:10.1109/access.2025.3561590 · Cited by 3
AudioInsight: Detecting Social Contexts Relevant to Social Anxiety from Speech
Reddy, V., Wang, Z., Toner, E. R., Larrazabal, M. A., Boukhechba, M., Teachman, B. A., & Barnes, L. E. (2024) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii63134.2024.00011 · Cited by 6
On a Time-Frequency Blurring Operator with Applications in Data Augmentation
Halvdansson, S. (2025) · Journal of Fourier Analysis and Applications · doi:10.1007/s00041-025-10164-9 · Cited by 3
Fernandez-Morales, I., Mitre-Hernández, H. A., Lara-Álvarez, C. A., Gutiérrez, H. D. L. T., & Jaramillo-Avila, U. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3574903 · Cited by 5
Action Selection Learning for Weakly Labeled Multi-modal Multi-view Action Recognition
Nguyễn, T. T., Kawanishi, Y., John, V., Komamizu, T., & Ide, I. (2025) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3744742 · Cited by 7
OAFN: An efficient open-world audio few-shot learning network for event classification
Chen, F., Xue, H., & Fang, P. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114201 · Cited by 3
Improving Speech Enhancement via Event-Based Query
Xin, Y., Peng, X., & Lu, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096304 · Cited by 4
Neri, M., Pallotta, L., & Carli, M. (2023) · International symposium on image and signal processing and analysis/ISPA ... · doi:10.1109/ispa58351.2023.10279538 · Cited by 3
Sinko, M., Medvedev, A., Smirnov, I., Laushkina, A., Kadnova, A., & Basov, O. O. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.11.001 · Cited by 4
Voice Detection Using Convolutional Neural Network
Vishniakou, U. А., & Shaya, B. H. (2023) · Doklady BGUIR · doi:10.35596/1729-7648-2023-21-2-114-120 · Cited by 3
From sound to source: Human and model recognition of environmental soundsPreprint
Alavilli, S., & McDermott, J. H. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.03.12.711349 · Cited by 4
Interpreting pretrained speech models for automatic speech assessment of voice disorders
Lau, H. S., Huntly, M., Morgan, N., Iyenoma, A., Zeng, B., & Bashford, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-67278-1_5 · Cited by 2
Li, Y., Li, H., Specia, L., & Schuller, B. W. (2026) · Scientific Reports · doi:10.1038/s41598-026-36044-w · Cited by 14
Multimodal Engagement Prediction in Human-Robot Interaction Using Transformer Neural Networks
Lim, J. Y., See, J., & Dondrup, C. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-2074-6_1 · Cited by 5
PulseFormer: Continuous Remote Heart Rate Measurement Through Zoomed Time-Spectral Attention
Comas, J., Ruiz, A., & Sukno, F. M. (2025) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2025.3544647 · Cited by 2
Targeted Data Poisoning for Black-Box Audio Datasets Ownership Verification
Bouaziz, W., El-Mhamdi, E.-M., & Usunier, N. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888515 · Cited by 2
Trainingless Adaptation of Pretrained Models for Environmental Sound Classification
Tonami, N., Kohno, W., Imoto, K., Yajima, Y., Mishima, S., Kondo, R., & Hino, T. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889784 · Cited by 2
Pre-training with Synthetic Patterns for Audio
Ishikawa, Y., Komatsu, T., & Aoki, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890881 · Cited by 5
Liu, J., Lam, W., Zhu, Z., & Tang, H. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00295 · Cited by 2
Sleep Staging Using Compressed Vision Transformer With Novel Two-Step Attention Weighted Sum
Kim, H., Kim, M., & Chung, W. (2025) · IEEE Access · doi:10.1109/access.2025.3561310 · Cited by 2
Dense dynamic convolutional network for Bel canto vocal technique assessment
Hou, Z., Zhao, X., Jiang, S., Luo, D., Sheng, X., Geng, K., Ye, K., Xia, J., Zhang, Y., Ban, C., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-98726-1 · Cited by 5
SoftEx: A Low Power and Flexible Softmax Accelerator with Fast Approximate Exponentiation
Belano, A., Tortorella, Y., Garofalo, A., Luca Benini, C., Rossi, D., & Conti, F. (2025) · Design, Automation, and Test in Europe · doi:10.23919/date64628.2025.10993043 · Cited by 2
Open-Set Recognition of Environmental Sound Based on KDE-GAN and Attractor–Reciprocal Point Learning
Wu, J., Wang, N., Hong, H., Wang, W., Xing, K., & Jiang, Y. (2025) · Acoustics · doi:10.3390/acoustics7020033 · Cited by 3
Exploring Audio Cues for Enhanced Test-Time Video Model Adaptation
Zeng, R., Deng, Q., Zhang, R., Niu, S., Chen, J., Hu, X., & Leung, V. C. M. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3579549 · Cited by 7
Multimodal Fusion for Dementia Detection using Voice and Facial Features
Chen, J., & Chu, W.-T. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11043557 · Cited by 2
CoAVT: A Cognition-Inspired Unified Audio-Visual-Text Pre-Training Model for Multimodal Processing
Yue, X., Tian, X., Zhang, M., Wu, Z., & Li, H. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3587467 · Cited by 5
Speech emotion recognition using graph convolutional networks
Zha, C., & Huang, C. (2025) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-025-04998-w · Cited by 2
MT2KD: Toward a General-Purpose Encoder for Speech, Speaker, and Audio Events
Yang, X., Li, Q., Zhang, C., & Woodland, P. C. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3594300 · Cited by 4
Cross-modal Emotion-specific Attention model for Multimodal Emotion Recognition
Chen, J., John, V., & Kawanishi, Y. (2025) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg61629.2025.11099454 · Cited by 2
DiemaNet: An automated detection model for three typical respiratory diseases
Xie, J., Xie, L., Xiao, T., Zhu, R., Hu, C., Qian, K., & Zhang, C. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108504 · Cited by 3
Adaptive frequency-aware network for action quality assessment
Wang, C., Ding, X., Zhao, X., Shang, H., Gu, L., & Wang, M. (2025) · Multimedia Systems · doi:10.1007/s00530-025-01857-8 · Cited by 3
Multi-Channel Spectro-Temporal Representations for Speech-Based Parkinson’s Disease Detection
Malekroodi, H. S., Madusanka, N., Lee, B.-I., & Yi, M. (2025) · Journal of Imaging · doi:10.3390/jimaging11100341 · Cited by 3
Task-Oriented Multimodal Token Transmission in Resource-Constrained Multiuser Networks
Zhang, J., Ni, W., Wang, P., & Wang, D. (2025) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2025.3628928 · Cited by 2
${\text{CA}^{2}\text{ST}}$: Cross-Attention in Audio, Space, and Time for Holistic Video Recognition
Lee, J., Chang, J., Lee, D., & Choi, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3628653 · Cited by 7
Cross‐Modal Urban Sensing: Evaluating Sound–Vision Alignment Across Street‐Level and Aerial Imagery
Chen, P., Huang, X., Fei, T., & Wang, S. (2026) · Transactions in GIS · doi:10.1111/tgis.70246 · Cited by 5
Domain generalization for voice-based cognitive impairment detection
Kim, M., Youn, Y. C., Won, Y., Choi, H., Shim, Y., Ryoo, N., Jeong, H. T., Yun, G., Lee, H., & Kim, S. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03268-1 · Cited by 2
Investigation of Feature Selection and Pooling Methods for Environmental Sound Classification
Dehaghani, P. B., Peña, D., & Aguiar, A. P. (2025) · International symposium on image and signal processing and analysis/ISPA ... · doi:10.1109/ispa66905.2025.11259460 · Cited by 2
Hossain, R., Ali, L. E., & Ripon, K. S. N. (2025) · International Conference on Image and Vision Computing New Zealand (IVCNZ) · doi:10.1109/ivcnz67716.2025.11281826 · Cited by 3
ADFF-Net: An Attention-Based Dual-Stream Feature Fusion Network for Respiratory Sound Classification
Zhu, B., Chen, L., Li, X., Zhao, S., Yu, S., & Sun, Q. (2025) · Technologies · doi:10.3390/technologies14010012 · Cited by 2
From Sound to Risk: Streaming Audio Flags for Real-World Hazard Inference Based on AI
Potamitis, I. (2026) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan15010006 · Cited by 2
Reliable Audio Deepfake Detection in Variable Conditions via Quantum-Kernel SVMs
Amin, L. A., & Janeja, V. P. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00166 · Cited by 4
Acoustic Violence Detection Using Cascade Strategy for Computationally Constrained Scenarios
Zhu-Zhou, F., Tejera-Berengué, D., Gil‐Pita, R., Utrilla-Manso, M., & Rosa-Zurera, M. (2026) · Electronics · doi:10.3390/electronics15061227 · Cited by 2
AI-Driven Detection and Classification of Voice Disorders Using Acoustic Recordings
Berteloot, L., Sismono, F., Maertens, L., Maryn, Y., Verguts, M., Vandaele, M., de Pol, C. V., Jaeger, P. D., & Delsupehe, K. (2026) · Journal of Voice · doi:10.1016/j.jvoice.2026.04.024 · Cited by 3
Feature engineering and deep learning for musical interval recognition through spectral analysis
Shanurina, D., Savitskyi, R. S., & Вакалюк, Т. А. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01499-3 · Cited by 3
Multimodal Video Understanding: A Capability-Based Survey of Alignment, Expression, and Reasoning
Zhao, R., Pu, D., Li, C., Zhang, Z. D., Xingzhu, P., & Ma, Y. (2026) · Applied Sciences · doi:10.3390/app16147154 · Cited by 2
Adversarial Audio Detection Method Based on Transformer
Li, Y., & Luo, D. (2022) · International Conference on Machine Learning and Intelligent Systems Engineering (MLISE) · doi:10.1109/mlise57402.2022.00023 · Cited by 2
Enhancing Spectrogram for Audio Classification Using Time-Frequency Enhancer
Xing, H., Zhang, S., Takeuchi, D., Niizumi, D., Harada, N., & Makino, S. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317328 · Cited by 2
Sound of Story: Multi-modal Storytelling with Audio
Bae, J., Jeong, S., Kang, S., Han, N., Lee, J.-Y., Kim, H., & Kim, T.-H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.898 · Cited by 7
An End-to-End Transformer with Progressive Tri-Modal Attention for Multi-modal Emotion Recognition
Wu, Y., Peng, P., Zhang, Z., Zhao, Y., & Qin, B. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-8540-1_32 · Cited by 2
Wei, W., Yang, Z., Gao, Y., Li, J., Chu, C., Okada, S., & Li, S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389690 · Cited by 6
LoRA-like Calibration for Multimodal Deception Detection using ATSFace Data
Hsiao, S.-W., & Sun, C.-Y. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386630 · Cited by 5
A Comparative Study of Pre-trained Audio and Speech Models for Heart Sound Detection
Duan, Y., Yang, C., Zhao, Z., Jiang, Y., Wang, Y., & Wang, Y. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-0601-3_25 · Cited by 3
Sharma, S., Phoga, A., & Kadyan, V. (2023) · OITS International Conference on Information Technology (OCIT) · doi:10.1109/ocit59427.2023.10431114 · Cited by 2
uaMix-MAE: Efficient Tuning of Pretrained Audio Transformers with Unsupervised Audio Mixtures
Tabassum, A., Tran, D. K., Dang, T., Lourentzou, I., & Koishida, K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446342 · Cited by 3
Sridhar, A. K., Guo, Y., Visser, E., & Mahfuz, R. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448154 · Cited by 5
Audio Spectrogram Transformer-based Audio Classification using Voice data of Dementia Patients
Lee, Y., Park, C., Moon, Y., & Jeong, J. (2023) · IEEE/ACIS International Conference on Big Data, Cloud Computing, and Data Science (BCD) · doi:10.1109/bcd57833.2023.10466301 · Cited by 2
Samui, S., & Garai, S. (2023) · International Conference on Computers and Devices for Communication · doi:10.1109/codec60112.2023.10465846 · Cited by 3
Exploring Transformer Extrapolation
Qin, Z., Zhong, Y., & Deng, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29855 · Cited by 2
Reddy, N. S. S. C., Venkat, P. M. D., Rohith, G., & Murugaveni, S. (2024) · International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI) · doi:10.1109/raeeucci61380.2024.10547766 · Cited by 2
Shuai, 陈. C., Xiaorun, 厉. L., Dongming, 李. L., & Jing, 王. W. (2024) · Laser & Optoelectronics Progress · doi:10.3788/lop231968 · Cited by 2
Automatic re-labeling of Google AudioSet for improved quality of learned features and pre-training
Grzywalski, T., & Botteldooren, D. B. (2024) · Signal Processing: Algorithms, Architectures, Arrangements, and Applications · doi:10.23919/spa61993.2024.10715611 · Cited by 2
Hierarchical-Concatenate Fusion TDNN for sound event classification
Zhao, B., & Liang, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0312998 · Cited by 2
Depression Classification Using Token Merging-Based Speech Spectrotemporal Transformer
Kumar, L., Kaustubh, K., & Prasanna, S. R. M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-77961-9_24 · Cited by 2
Accurate Mapping of RNNs on Neuromorphic Hardware with Adaptive Spiking Neurons
Boeshertz, G., Indiveri, G., Nair, M. V., & Renner, A. (2024) · International Conference on Neuromorphic Systems (ICONS) · doi:10.1109/icons62911.2024.00064 · Cited by 6
Liu, M., Chen, K., Ye, Q., & Wu, H. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104757 · Cited by 2
John, V., & Kawanishi, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78192-6_7 · Cited by 2
Machine learning based heart murmur detection and classification
Fernando, I., Kannangara, D. O., Kodituwakku, S., Maddumage, R. A. S., Gayan, S., Herath, T., Lokunarangoda, N. C., & Liyanaarachchi, M. R. (2024) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/ad9aab · Cited by 2
Arterial Diameter Trend Estimation Using Deep Learning on Ultrasound Spectral Doppler
Lozhkin, A., Iring-Sanchez, S., Serrador, J. M., & Siderskiy, V. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc53108.2024.10782605 · Cited by 2
Transformer-Based Model for Auditory EEG Decoding
Chen, J., Liu, Y.-L., Feng, R., Yuan, J., & Ling, Z.-H. (2024) · Communications in computer and information science · doi:10.1007/978-981-96-1045-7_11 · Cited by 2
Si, Y., Li, Y., Tan, J., Chen, G., Li, Q., & Russo, M. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3527147 · Cited by 8
EL-Alert: An Explainable Lightweight AST Model for Military Situational Awareness and Surveillance
Njoku, J. N., Nwakanma, C. I., Lee, J., & Kim, D.-S. (2024) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc62082.2024.10826893 · Cited by 3
Metadata
- Authors
- Gong, Y., Chung, Y.-A., & Glass, J.
- Affiliations
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 571-575
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3196974791
- Cited by
- 1,159
- References
- 33
- Citations by year
- 2026: 260 · 2025: 356 · 2024: 241 · 2023: 193 · 2022: 100 · 2021: 9
- FWCI
- 82.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- Audio Spectrogram Transformer, audio classification, self-attention, spectrogram, AudioSet, ESC-50
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.