AST: Audio Spectrogram Transformer
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for endto-end audio classification models, which aim to learn a direct mapping from audio spectrograms to corresponding labels.To better capture long-range global context, a recent trend is to add a self-attention mechanism on top of the CNN, forming a CNN-attention hybrid model.However, it is unclear whether the reliance on a CNN is necessary, and if neural networks purely based on attention are sufficient to obtain good performance in audio classification.In this paper, we answer the question by introducing the Audio Spectrogram Transformer (AST), the first convolution-free, purely attention-based model for audio classification.We evaluate AST on various audio classification benchmarks, where it achieves new state-of-the-art results of 0.485 mAP on AudioSet, 95.6% accuracy on ESC-50, and 98.1% accuracy on Speech Commands V2.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Goel et al. [143] used a self-supervised audio spectrogram Transformer (SSAST) [144,145], a ViT-based architecture, to develop a contrastive learning framework, SSAST-CL, for detecting audio deepfakes. Their approach integrates Siamese networks with self-attention and cross-attention mechanisms to enhance the ViT’s feature representation”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [144]
In the citing paper
“This change enables LTU-AS to recognize both speech and audio events.”
From Joint Audio and Speech Understanding (2023) · cites this paper as [6]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3015 · Cited by 3,150
Cited by
Items 701–800 of 1,006
Emotion and noise-robust speaker identification via filter-free self-supervised learning
Hamsa, S., Iraqi, Y., Shahin, I. M. A., Damiani, E., Khalaf, K. A., Jelinek, H. F., & Werghi, N. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104774 · Cited by 1
Bawa, M. S., Yusuf, S. M., & Saminu, S. S. (2026) · Journal of Future Artificial Intelligence and Technologies · doi:10.62411/faith.3048-3719-313 · Cited by 1
Nguyễn, T. T., Kawanishi, Y., John, V., Komamizu, T., & Ide, I. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.113810 · Cited by 2
Siddiqui, M. S. B., & Saha, U. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464477 · Cited by 3
Fingerprinting Generative Audio Sources
Vardhini, P., Sharma, N., Bhore, H., & Iyengar, R. S. (2025) · Artificial Intelligence and Cloud Computing Conference (AICCC) · doi:10.1145/3789982.3790015 · Cited by 1
Zero-Shot to Zero-Lies: Detecting Bengali Deepfake Audio Through Transfer Learning
Samu, M. S. S., Islam, M. R., Hossain, M. Z., Bhuiyan, M. K., & Zaman, F. U. (2025) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit68739.2025.11491615 · Cited by 4
Chen, L., Hu, P., Zhang, S., Qiu, X., & Liu, Z. J. (2026) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2026.3691238 · Cited by 1
Real-Time Multimodal Hazard Detection for Assistive Wheelchair Navigation
Nakahara, E., & Li, X. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7141-3_8 · Cited by 1
Acoustic Intelligence with Multi-Stage Model Optimization for Environmental Sound Classification
Sarathchandra, P., Mallikarachchi, S., Madushani, D., & Meedeniya, D. (2026) · Smart Cities · doi:10.3390/smartcities9050086 · Cited by 1
Yang, K., & Chen, J. (2026) · Scientific Reports · doi:10.1038/s41598-026-45945-9 · Cited by 1
Fraihi, N., Karrakchou, O., & Ghogho, M. (2026) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2026.3701932 · Cited by 1
From Physics to Representation: Audio Learning with Synthetic Pre-training via Procedural Generation
Liu, F., Huang, R., Zheng, Q., Wang, Y., & Liu, F. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810789 · Cited by 1
Modern Deep Learning Architectures for Urban Sound Classification on UrbanSound8K
Yurtsever, U. (2026) · Sakarya University Journal of Computer and Information Sciences · doi:10.35377/saucis...1830726 · Cited by 1
Shukla, S., Naliyatthaliyazchayil, P., Gichoya, J. W., & Purkayastha, S. (2026) · Journal of Medical Internet Research · doi:10.2196/95609 · Cited by 2
Khan, J., Ryzhikov, I., & Kolehmainen, M. (2026) · Applied Sciences · doi:10.3390/app16147234 · Cited by 1
Рюмина, Е. В., Axyonov, A., Koryakovskaya, D., Abdulkadirov, T., Egorova, A., Fedchin, S., Zaburdaev, A., Salova, I., Savchenko, A., & Ryumin, D. (2026) · IEEE Access · doi:10.1109/access.2026.3723020 · Cited by 2
Dual-stream audio–visual Transformer fusion for harmful video content detection
Jattioui, M. E., Tairi, H., & Takrouni, W. (2026) · Array · doi:10.1016/j.array.2026.101254 · Cited by 1
An overview of practices used in environmental sound classification
Chochul, M., & Sevcik, P. (2021) · International Conference on Emerging eLearning Technologies and Applications (ICETA) · doi:10.1109/iceta54173.2021.9726625 · Cited by 1
Improving Self-supervised Audio Representation based on Contrastive Learning with Conformer Encoder
Duong, Q. T., Nguyen, D. H., Thang, T. B., Le, N. M., & Hai, V. (2022) · International Symposium on Information and Communication Technology · doi:10.1145/3568562.3568645 · Cited by 5
Anand, J., Koch, M., Schlenke, F., Kohlmorgen, F., & Wöhrle, H. (2022) · IEEE International Conference and Workshop Óbuda on Electrical and Power Engineering (CANDO-EPE) · doi:10.1109/cando-epe57516.2022.10046362 · Cited by 1
Yuan, M., Bi, X., Huang, X., Zhang, W., Hu, L., Yuan, G., Zhao, X., & Sun, Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-30637-2_16 · Cited by 1
Domestic Sound Classification with Deep Learning
Zhang, Z., Shen, Y., Valdés, J. J., Huq, S., Wallace, B., Green, J. R., Xi, P., & Goubran, R. A. (2023) · IEEE Sensors Applications Symposium (SAS) · doi:10.1109/sas58821.2023.10254050 · Cited by 1
Primus, P., & Widmer, G. (2023) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco58844.2023.10289774 · Cited by 1
DeepScreen: Boosting Depression Screening Performance with an Auxiliary Task
Flores, R., Shrestha, A., & Rundensteiner, E. A. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386595 · Cited by 1
VANet: A New Network for Multi-modal Self-supervised Learning from Video and Audio
Liu, X., Zhang, C., Feng, Z., Dong, J., Niu, S., & Gao, X. (2024) · Lecture notes in electrical engineering · doi:10.1007/978-981-97-0855-0_32 · Cited by 1
A Multimodal Benchmark and Improved Architecture for Zero Shot Learning
Doshi, K., Garg, A., Uzkent, B., Wang, X., & Omar, M. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00202 · Cited by 2
Improving diversity of speech‐driven gesture generation with memory networks as dynamic dictionaries
Zhao, Z., Gao, N., Zeng, Z., Zhang, G., Liu, J., & Zhang, S. (2024) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12321 · Cited by 1
Audio Simulation for Sound Source Localization in Virtual Environment
Di, Y. Y., Wong, S. L., & Pan, J. Z. (2024) · IEEE World Forum on Public Safety Technology (WF-PST) · doi:10.1109/wfpst58552.2024.00011 · Cited by 1
Light Gated Multi Mini-Patch Extractor for Audio Classification
He, B., Zhang, S., Wang, X., Qiu, Z. H., Takeuchi, D., Niizumi, D., Harada, N., & Makino, S. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10626081 · Cited by 4
From Pixels to Waveforms: Evaluating Pre-trained Image Models for Few-Shot Audio Classification
Heggan, C., Hospedales, T., Budgett, S., & Yaghoobi, M. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650537 · Cited by 2
Self-Attention Mechanism in Multimodal Context for Banking Transaction Flow
Delestre, C., & Sola, Y. (2025) · International Conference on Emerging Technologies and Computing (IC_ETC) · doi:10.1109/ic_etc65981.2025.11141339 · Cited by 2
InMRSALnet: A method for diagnosing arteriovenous fistula stenosis based on blood flow sounds
Zhang, J., Shu, X., Zhang, R., & Zhang, H. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.107086 · Cited by 2
Audio meets text: a loss-enhanced journey with manifold mixup and re-ranking
Suryawanshi, Y., Shah, V., Randar, S., & Joshi, A. D. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-024-02283-4 · Cited by 2
Gong, Y., Xie, W., Zhang, Q., & Yang, S. (2024) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn63547.2024.10780530 · Cited by 1
Self-citationInvestigating the Effective Dynamic Information of Spectral Shapes for Audio Classification
Chen, L., Zhou, X., Chen, Q., Xiong, F., & Chen, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521837 · Cited by 1
LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Tagging
Papaioannou, C., Benetos, E., & Potamianos, A. (2025) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2025.3529315 · Cited by 13
Enhancing Acoustic Scene Classification with Layer-wise Fine-Tuning on the SSAST Model
Hao, S., Saito, D., & Minematsu, N. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10849053 · Cited by 1
Wakayama, T., Inoue, T., Ogata, J., Iida, M., & Ogawa, T. (2024) · International Conference on Machine Learning and Applications · doi:10.1109/icmla61862.2024.00101 · Cited by 1
Garoufis, C., Glytsos, M., Chourdaki, I., Filntisis, P. P., & Maragos, P. A. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889003 · Cited by 1
Stumpf, L., Kadirvelu, B., & Faisal, A. A. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889800 · Cited by 6
Noise-Agnostic Multitask Whisper Training for Reducing False Alarm Errors in Call-for-Help Detection
Ryu, M., Kim, J.-W., Oh, M., Lee, S., & Park, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890654 · Cited by 5
DeepFake Classification Using Fine-Tuned Wave2Vec2.0
Sarkar, S., Gupta, A., Ghosh, A., & Ganesan, S. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-91340-2_6 · Cited by 1
OneEncoder: a lightweight framework for efficient multimodal training
Faye, B., Azzag, H., Lebbah, M., & Bouchaffra, D. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-11435-8 · Cited by 5
Multilingual Speech Command Recognition for Voice Controlled Robots and Smart Systems
Kuzdeuov, A., & Varol, H. A. (2025) · International Conference on Control, Automation and Robotics (ICCAR) · doi:10.1109/iccar64901.2025.11073019 · Cited by 1
Automated detection of wolf howls using audio spectrogram transformers
Makarov, N., Savchenko, A., Zemtsova, I., Novopoltsev, M., Poyarkov, A. D., Viricheva, A. O., Chistopolova, M. D., Никольский, А. А., & Hernandez-Blanco, J. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-11413-z · Cited by 1
Neural Edge Histogram Descriptors for Underwater Acoustic Target Recognition
Agashe, A., Carreiro, D., Dine, A. V., & Peeples, J. (2025) · OCEANS 2025 Brest · doi:10.1109/oceans58557.2025.11104298 · Cited by 2
Feng, J., Fu, X., & Dong, S. (2025) · Advances in Space Research · doi:10.1016/j.asr.2025.10.070 · Cited by 1
Benchmarking Sub-Genre Classification For Mainstage Dance Music
Shu, H., Li, X., Jiang, H., Fu, M., & Li, X. (2025) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa66052.2025.11231007 · Cited by 3
Environment Sound Classification (ESC) with Choquet Integral Fusion
Wang, Y., Havens, T. C., & Barnard, A. R. (2021) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci50451.2021.9660148 · Cited by 1
Koh, E., Nam, G.-H., Kim, S. W., Park, K. H., & Kim, S. B. (2022) · Journal of Korean Institute of Industrial Engineers · doi:10.7232/jkiie.2022.48.4.389 · Cited by 1
Uddin, M. Z. (2022) · Springer eBooks · doi:10.1007/978-3-031-11534-9_3 · Cited by 3
Tripathi, A. M., Behera, S. R., & Paul, K. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892839 · Cited by 1
Transfer learning based on self-attention mechanism in sound event detection
Liu, Z., Cai, X., Li, J., & Qiao, Z. (2022) · International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI) · doi:10.1109/cei57409.2022.9950132 · Cited by 1
Gct: Gated Contextual Transformer for Sequential Audio Tagging
Hou, Y., Wang, Y., Wang, W., & Botteldooren, D. B. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096842 · Cited by 1
Gong, X., & Li, Z. (2023) · Journal of Computer-Aided Design & Computer Graphics · doi:10.3724/sp.j.1089.2023.19353 · Cited by 1
Speech Command Recognition: Text-to-Speech and Speech Corpus Scraping Are All You NeedPreprint
Kuzdeuov, A., Nurgaliyev, S., Turmakhan, D., Laiyk, N., & Varol, H. A. (2023) · doi:10.36227/techrxiv.22717657 · Cited by 1
ASFNet: Audio Spectrogram Fourier Network for Efficient Medical Sound Event DetectionPreprint
Hassan, K., & Haque, M. A. (2023) · doi:10.36227/techrxiv.23732205 · Cited by 1
Eguchi, M., Hayase, T., Hiroi, Y., & Hiraki, T. (2026) · Scientific Data · doi:10.1038/s41597-026-06760-z · Cited by 6
Dilated convolution with learnable spacings
Khalfaoui-Hassani, I. (2024) · theses.fr (ABES) · doi:10.70675/3e808438zb5adz4b80z9d98z555b4f28be22 · Cited by 14
Joint Audio and Speech Understanding
Gong, Y., Liu, A. H., Luo, H., Karlinsky, L., & Glass, J. (2023) · arXiv · doi:10.48550/arxiv.2309.14405 · Cited by 67
“Particularly, LTU-AS adopts Whisper [1] and TLTR [3] as the audio encoder instead of the AST [6] audio encoder in LTU.”
MethodSelf-citationFAST: Efficient Action Tokenization for Vision-Language-Action Models
Pertsch, K., Stachowicz, K., Ichter, B., Driess, D., Nair, S., Vuong, Q., Mees, O., Finn, C., & Levine, S. (2025) · arXiv · doi:10.48550/arxiv.2501.09747 · Cited by 73
An Empirical Study of Weakly Supervised Audio Tagging Embeddings for General Audio Representations
Dinkel, H., Yan, Z., Wang, Y., Zhang, J., & Wang, Y. (2022) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2022-54 · Cited by 1
Mel-S3r: Combining Mel-Spectrogram and Self-Supervised Speech Representation for Voice ConversionPreprint
Yang, J., Zhou, Y. X., & Huang, H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4183301
Whitaker, S. (2022) · Digital Commons - Michigan Tech (Michigan Technological University) · doi:10.37099/mtu.dc.etdr/1431
Cross-modal Token Selection for Video Understanding
Pan, L., Li, Z., Zhao, H., & Yan, R. (2022) · International Workshop on Human-centric Multimedia Analysis (HCMA) · doi:10.1145/3552458.3556444
Yan, T., Meng, H., Parada‐Cabaleiro, E., Tao, J., & Schuller, B. W. (2022) · doi:10.36227/techrxiv.21309600
A Temporal-oriented Broadcast ResNet for COVID-19 Detection
Jing, X., Liu, S., Parada‐Cabaleiro, E., Triantafyllopoulos, A., Song, M., Yang, Z., & Schuller, B. W. (2022) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi56158.2022.9926930
Music Instrument Classification Reprogrammed
Chen, H.-H., & Lerch, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-27077-2_27 · Cited by 3
Speech Command Recognition: Text-to-Speech and Speech Corpus Scraping Are All You NeedPreprint
Kuzdeuov, A., Nurgaliyev, S., Turmakhan, D., Laiyk, N., & Varol, H. A. (2023) · doi:10.36227/techrxiv.22717657.v1
Hierarchical Transformer for Multi-Label Trailer Genre Classification
Cai, Z.-H., Ding, H., Wu, X., Xu, M., & Cui, X. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095502 · Cited by 1
Lin, G.-T., Tang, Q., Kao, C.-C., Rozgić, V., & Wang, C. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096117 · Cited by 1
Progressive Dominant Token Embedding for Speaker Identification from Emotional and Noisy SpeechPreprint
Hamsa, S., Iraqi, Y., Shahin, I. M. A., Damiani, E., & Werghi, N. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4460029
Automatic Detection and Analysis of Singing Mistakes for Music PedagogyPreprint
Kumar, S., Jaiswal, S., Singh, P., & Arora, V. (2023) · doi:10.36227/techrxiv.23269502.v1
Dabbabi, K., & Mars, A. (2023) · IEEE International Conference on Advanced Systems and Emergent Technologies (IC_ASET) · doi:10.1109/ic_aset58101.2023.10151158
Wang, Q., Chu, Y., Zhou, E., Zheng, G., & Liu, Q. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4482035
ASFNet: Audio Spectrogram Fourier Network for Efficient Medical Sound Event DetectionPreprint
HASSAN, K. M. N., & Haque, M. A. (2023) · doi:10.36227/techrxiv.23732205.v1
TranSTYLer: Multimodal Behavioral Style Transfer for Facial and Body Gestures GenerationPreprint
Fares, M., Pélachaud, C., & Obin, N. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.10843
Training audio transformers for cover song identification
Zeng, T. Y., & Lau, F. C. M. (2023) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-023-00297-4 · Cited by 3
Environmental Sound Classification Based on Attention Feature Fusion and Improved Residual Network
Zeng, J., Liu, Y., Wang, M., & Zhang, X. (2023) · Automatic Control and Computer Sciences · doi:10.3103/s0146411623040119
Group Masked Model Learning for General Audio Representation
Atito, S., Awais, M., Alex, T., & Kittler, J. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222551 · Cited by 1
Attention-Based Sound Classification Pipeline with Sound Spectrum
Tan, K. I., Yean, S., & Lee, B. (2023) · IEEE Sensors Applications Symposium (SAS) · doi:10.1109/sas58821.2023.10254193 · Cited by 1
Audiorepinceptionnext: A Lightweight Single-Stream Architecture for Efficient Audio RecognitionPreprint
Lau, K. W., Rehman, Y. A. U., & Po, L.-M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4588783
ASPED: An Audio Dataset for Detecting PedestriansPreprint
Seshadri, P., Han, C., Koo, B. W., Posner, N., Guhathakurta, S., & Lerch, A. (2023) · doi:10.32920/24231337
ASPED: An Audio Dataset for Detecting PedestriansPreprint
Seshadri, P., Han, C., Koo, B. W., Posner, N., Guhathakurta, S., & Lerch, A. (2023) · doi:10.32920/24231337.v1
SAliCLIP: Generating Speech-Conditioned Images by Aligning Speech With CLIP Latents
Prajwal Gupta, C. R., Rao, V. S., Rithvik, G., Sameeksha, R. L., & R, B. P. V. (2023) · International Conference on Image, Vision and Computing (ICIVC) · doi:10.1109/icivc58118.2023.10270664
Averianov, D. D., Bosch, R., Zheludev, M. V., & Kiyaev, V. I. (2023) · Differential Equations and Control Processes · doi:10.21638/11701/spbu35.2023.306
Fares, M., Pélachaud, C., & Obin, N. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.05481 · Cited by 1
UniVR: A Unified Framework for Pitch-Shifted Voice Restoration in Speaker Identification
Li, Y., & Lin, X. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317450
A Cross-Modality Transfer Reinforcement Learning Blind Agent on DareFightingICE
Nguyen, T. V., Khan, I., Nimpattanavong, C., Thawonmas, R., & Pham, H. V. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333256
Misophonia Sound Recognition Using Vision Transformer
Bahmei, B., Birmingham, E., & Arzanpour, S. (2023) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc40787.2023.10340283 · Cited by 2
An Iterative Neighborhood Blending Method For Multimodal Product Retrieval
Liu, Q., He, T., & Zhou, Z. (2023) · Asia Conference on Advanced Robotics, Automation, and Control Engineering (ARACE) · doi:10.1109/arace60380.2023.00011
Audio-visual Neural Face Generation with Emotional Stimuli
Hwang, J., & Kang, J. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386942
Chowdhury, S., & Widmer, G. (2023) · Annual Meeting of the Forum for Information Retrieval Evaluation (FIRE) · doi:10.1145/3632754.3632761
Sound Event Classification Based on Fusion of Multiple Pre-trained Models
Cai, X., Wu, J., Wu, M., & Gan, Y. (2023) · International Conference on Computer Engineering and Intelligent Control (ICCEIC) · doi:10.1109/icceic60201.2023.10426682
Deep Segment-Attentive Network for Altered-Engine Recognition
Gan, C.-X., Mak, M., Ho, I. W., & Lee, S. W.-C. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10422665
WI-FI based Indoor Monitoring Enhanced by Multimodal Fusion
Hori, C., Wang, P. P., Rahman, M., Vaca-Rubio, C. J., Khurana, S., Cherian, A., & Roux, J. L. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447600
Liu, W., & Ren, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446928
Weakly Labeled Sound Event Detection using Attention Mechanism with Teacher-Student Model
Akar, Y., & Sert, M. (2023) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism59092.2023.00034 · Cited by 1
The Effects of Noise Reduction on Bioacoustic Segmentation and ClassificationPreprint
McEwen, B., Bainbridge-Smith, A., Atlas, J., Gutschmidt, S., & Green, R. R. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4767160
Active Few-Shot Learning for Rare Bioacoustic Feature AnnotationPreprint
McEwen, B., Soltero, K., Gutschmidt, S., Bainbridge-Smith, A., Atlas, J., & Green, R. R. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4767161
Metadata
- Authors
- Gong, Y., Chung, Y.-A., & Glass, J.
- Affiliations
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 571-575
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3196974791
- Cited by
- 1,159
- References
- 33
- Citations by year
- 2026: 260 · 2025: 356 · 2024: 241 · 2023: 193 · 2022: 100 · 2021: 9
- FWCI
- 82.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- Audio Spectrogram Transformer, audio classification, self-attention, spectrogram, AudioSet, ESC-50
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.