CoChat
Sign Up
PreprintCited by 4Music and Audio ProcessingSpeech Recognition and SynthesisSpeech and Audio Processing

The DOI matches its DataCite record; the references it cites are not checked yet.

Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queries

Open access
Cai, Pengfei, Song, Yan, Gu, Qing, Jiang, Nan, Song, Haoyu, McLoughlin, Ian·2025·arXiv
DOI 10.48550/arxiv.2507.16343arXiv 2507.16343
Open this paper in CoChat — free accountOpen PDF

Abstract

Most existing sound event detection~(SED) algorithms operate under a closed-set assumption, restricting their detection capabilities to predefined classes. While recent efforts have explored language-driven zero-shot SED by exploiting audio-language models, their performance is still far from satisfactory due to the lack of fine-grained alignment and cross-modal feature fusion. In this work, we propose the Detect Any Sound Model (DASM), a query-based framework for open-vocabulary SED guided by multi-modal queries. DASM formulates SED as a frame-level retrieval task, where audio features are matched against query vectors derived from text or audio prompts. To support this formulation, DASM introduces a dual-stream decoder that explicitly decouples event recognition and temporal localization: a cross-modality event decoder performs query-feature fusion and determines the presence of sound events at the clip-level, while a context network models temporal dependencies for frame-level localization. Additionally, an inference-time attention masking strategy is proposed to leverage semantic relations between base and novel classes, substantially enhancing generalization to novel classes. Experiments on the AudioSet Strong dataset demonstrate that DASM effectively balances localization accuracy with generalization to novel classes, outperforming CLAP-based methods in open-vocabulary setting (+ 7.8 PSDS) and the baseline in the closed-set setting (+ 6.9 PSDS). Furthermore, in cross-dataset zero-shot evaluation on DESED, DASM achieves a PSDS1 score of 42.2, even exceeding the supervised CRNN baseline. The project page is available at https://cai525.github.io/Transformer4SED/demo_page/DASM/.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2507.16343

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

The citation lists haven’t been fetched yet

References 17 · Cited by 4

Research works printed but not linked: 57

  1. [1][1] Keyu An, Qian Chen, Chong Deng, Zhihao Du, Changfeng Gao, Zhifu Gao, Yue Gu, Ting He, Hangrui Hu, Kai Hu, Shengpeng Ji, Yabin Li, Zerui Li, Heng Lu, Haoneng Luo, Xiang Lv, Bin Ma, Ziyang Ma, Chongjia Ni, Changhe Song, Jiaqi Shi, Xian Shi, Hao Wang, Wen Wang, Yuxuan Wang, Zhangyu Xiao, Zhijie Yan, Yexin Yang, Bin Zhang, Qinglin Zhang, Shiliang Zhang, Nan Zhao, and Siqi Zheng. 2024. FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs. arXiv:2407.04051 [cs.SD] https://arxiv.org/abs/2407.04051 - · arXiv
  2. [2][2] Ankan Bansal, Karan Sikka, Gaurav Sharma, Rama Chellappa, and Ajay Divakaran. 2018. Zero-shot object detection. In Proceedings of the European conference on computer vision (ECCV) . 384-400. -
  3. [3][3] Swapnil Bhosale, Sauradip Nag, Diptesh Kanojia, Jiankang Deng, and Xiatian Zhu. 2024. DiffSED: Sound Event Detection with Denoising Diffusion. In Thirty-Eighth AAAI Conference on Artificial Intelligence , Michael J. Wooldridge, Jennifer G. Dy, and Sriraam Natarajan (Eds.). AAAI Press, 792-800. -
  4. [4][4] Cagdas Bilen, Giacomo Ferroni, Francesco Tuveri, Juan Azcarreta, and Sacha Krstulovic. 2020. A Framework for the Robust Evaluation of Sound Event Detection. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 61-65. -
  5. [5][5] Pengfei Cai, Yan Song, Kang Li, Haoyu Song, and Ian McLoughlin. 2024. MAT-SED: A Masked Audio Transformer with Masked-Reconstruction Based Pre-training for Sound Event Detection. In Interspeech 2024 . 557-561. doi:10.21437/Interspeech. 2024-714 - · DOI
  6. [6][6] Emre Cakır, Giambattista Parascandolo, Toni Heittola, Heikki Huttunen, and Tuomas Virtanen. 2017. Convolutional recurrent neural networks for polyphonic sound event detection. IEEE/ACM Transactions on Audio, Speech, and Language Processing 25, 6 (2017), 1291-1303. -
  7. [7][7] Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. 2020. End-to-End Object Detection with Transformers. In Computer Vision - ECCV 2020 - 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part I . -
  8. [8][8] Carlos Castorena, Maximo Cobos, Jesus Lopez-Ballester, and Francesc J. Ferri. 2024. A safety-oriented framework for sound event detection in driving scenarios. Applied Acoustics 215 (2024), 109719. doi:10.1016/j.apacoust.2023.109719 - · DOI
  9. [9][9] Honglie Chen, Weidi Xie, Andrea Vedaldi, and Andrew Zisserman. 2020. Vggsound: A Large-Scale Audio-Visual Dataset. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 721-725. doi:10.1109/ICASSP40776.2020.9053174 - · DOI
  10. [10][10] Ke Chen, Xingjian Du, Bilei Zhu, Zejun Ma, Taylor Berg-Kirkpatrick, and Shlomo Dubnov. 2022. HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 646-650. -
  11. [11][11] Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Wanxiang Che, Xiangzhan Yu, and Furu Wei. 2023. BEATs: Audio Pre-Training with Acoustic Tokenizers. In Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 202) , Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 5178-5193. -
  12. [12][12] Yunfei Chu, Jin Xu, Xiaohuan Zhou, Qian Yang, Shiliang Zhang, Zhijie Yan, Chang Zhou, and Jingren Zhou. 2023. Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models. arXiv preprint arXiv:2311.07919 (2023). - · arXiv
  13. [13][13] Chloé Clavel, Thibaut Ehrette, and Gaël Richard. 2005. Events detection for an audio-based surveillance system. In 2005 IEEE International Conference on Multimedia and Expo . IEEE, 1306-1309. -
  14. [15][15] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics . Association for Computational Linguistics, 41714186. -
  15. [16][16] Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations . -
  16. [17][17] Benjamin Elizalde, Soham Deshmukh, Mahmoud Al Ismail, and Huaming Wang. 2023. CLAP Learning Audio Concepts from Natural Language Supervision. In ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . -
  17. [18][18] Jort F Gemmeke, Daniel PW Ellis, Dylan Freedman, Aren Jansen, Wade Lawrence, RChanning Moore, Manoj Plakal, and Marvin Ritter. 2017. Audio set: An ontology and human-labeled dataset for audio events. In IEEE international conference on acoustics, speech and signal processing (ICASSP) . IEEE, 776-780. -
  18. [19][19] Yuan Gong, Yu-An Chung, and James Glass. 2021. AST: Audio Spectrogram Transformer. In Interspeech 2021 . 571-575. doi:10.21437/Interspeech.2021-698 - · DOI · Paper page
  19. [20][20] Xiuye Gu, Tsung-Yi Lin, Weicheng Kuo, and Yin Cui. 2022. Open-vocabulary Object Detection via Vision and Language Knowledge Distillation. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022 . -
  20. [21][21] Anmol Gulati, James Qin, Chung-Cheng Chiu, Niki Parmar, Yu Zhang, Jiahui Yu, Wei Han, Shibo Wang, Zhengdong Zhang, Yonghui Wu, and Ruoming Pang. 2020. Conformer: Convolution-augmented Transformer for Speech Recognition. In Proc. Interspeech 2020 . 5036-5040. -
  21. [22][22] Shawn Hershey, Daniel P W Ellis, Eduardo Fonseca, Aren Jansen, Caroline Liu, R Channing Moore, and Manoj Plakal. 2021. The Benefit of Temporally-Strong Labels in Audio Event Classification. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . -
  22. [23][23] Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, and Christoph Feichtenhofer. 2022. Masked Autoencoders that Listen. In NeurIPS . -
  23. [24][24] Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Yuexian Zou, Zhou Zhao, and Shinji Watanabe. 2024. AudioGPT: understanding and generating speech, music, sound, and talking head. In Proceedings of the 38th AAAI Conference on Artificial Intelligence (AAAI'24/IAAI'24/EAAI'24) . AAAI Press, Article 2847, 3 pages. -
  24. [25][25] Keisuke Imoto, Sakiko Mishima, Yumi Arai, and Reishi Kondo. 2021. Impact of Sound Duration and Inactive Frames on Sound Event Detection Performance. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . -
  25. [26][26] Yidi Jiang, Ruijie Tao, Wen Huang, Qian Chen, and Wen Wang. 2025. Unified Audio Event Detection. In ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 1-5. doi:10.1109/ICASSP49660. 2025.10888080 - · DOI
  26. [27][27] Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Dollár, and Ross Girshick. 2023. Segment Anything. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV) . 3992-4003. doi:10.1109/ICCV51070.2023. 00371 - · DOI
  27. [28][28] Chih-Yuan Koh, You-Siang Chen, Yi-Wen Liu, and Mingsian R. Bai. 2021. Sound Event Detection by Consistency Training and Pseudo-Labeling With FeaturePyramid Convolutional Recurrent Neural Networks. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 376-380. doi:10.1109/ICASSP39728.2021.9414350 - · DOI
  28. [29][29] Khaled Koutini, Jan Schlüter, Hamid Eghbal-zadeh, and Gerhard Widmer. 2022. Efficient Training of Audio Transformers with Patchout. In Proc. Interspeech 2022 . 2753-2757. -
  29. [30][30] Boyi Li, Kilian Q. Weinberger, Serge J. Belongie, Vladlen Koltun, and René Ranftl. 2022. Language-driven Semantic Segmentation. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022 . OpenReview.net. https://openreview.net/forum?id=RriDjddCLN -
  30. [31][31] Kang Li, Yan Song, Li-Rong Dai, Ian McLoughlin, Xin Fang, and Lin Liu. 2023. ASTSED: An Effective Sound Event Detection Method Based on Audio Spectrogram Transformer. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 1-5. -
  31. [32][32] Kang Li, Yan Song, Ian McLoughlin, Lin Liu, Jin Li, and Li-Rong Dai. 2023. Finetuning Audio Spectrogram Transformer with Task-aware Adapters for Sound Event Detection. In Proc. INTERSPEECH 2023 . 291-295. -
  32. [33][33] Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, and Jianfeng Gao. 2022. Grounded Language-Image Pre-training. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 10955-10965. -
  33. [34][34] Yiming Li, Zhifang Guo, Xiangdong Wang, and Hong Liu. 2024. Advancing Multi-grained Alignment for Contrastive Language-Audio Pre-training. In Proceedings of the 32nd ACM International Conference on Multimedia (Melbourne VIC, Australia) (MM '24) . Association for Computing Machinery, New York, NY, USA, 7356-7365. -
  34. [35][35] Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021. Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV) . 9992-10002. doi:10.1109/ICCV48922.2021.00986 - · DOI · Paper page
  35. [36][36] Ilya Loshchilov and Frank Hutter. 2019. Decoupled Weight Decay Regularization. In 7th International Conference on Learning Representations (ICLR) . -
  36. [37][37] Xinhao Mei, Chutong Meng, Haohe Liu, Qiuqiang Kong, Tom Ko, Chengqi Zhao, Mark D. Plumbley, Yuexian Zou, and Wenwu Wang. 2024. WavCaps: A ChatGPTAssisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Research. IEEE/ACM Transactions on Audio, Speech, and Language Processing 32 (2024), 3339-3354. doi:10.1109/TASLP.2024.3419446 - · DOI · Paper page
  37. [38][38] Annamaria Mesaros, Toni Heittola, Tuomas Virtanen, and Mark D. Plumbley. 2021. Sound Event Detection: A tutorial. IEEE Signal Processing Magazine 38, 5 (2021), 67-83. -
  38. [40][40] Tobias Morocutti, Florian Schmid, Jonathan Greif, Francesco Foscarin, and Gerhard Widmer. 2025. Exploring Performance-Complexity Trade-Offs in Sound Event Detection. arXiv preprint arXiv:2503.11373 (2025). - · arXiv
  39. [41][41] Hyeonuk Nam, Seong-Hu Kim, Byeong-Yun Ko, and Yong-Hwa Park. 2022. Frequency Dynamic Convolution: Frequency-Adaptive Pattern Recognition for Sound Event Detection. In Interspeech 2022 . 2763-2767. doi:10.21437/Interspeech. 2022-10127 - · DOI
  40. [42][42] Daniel S. Park, William Chan, Yu Zhang, Chung-Cheng Chiu, Barret Zoph, Ekin D. Cubuk, and Quoc V. Le. 2019. SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition. In Interspeech 2019 . 2613-2617. doi:10. 21437/Interspeech.2019-2680 -
  41. [43][43] Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models From Natural Language Supervision. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event (Proceedings of Machine Learning Research, Vol. 139) , Marina Meila and Tong Zhang (Eds.). PMLR, 8748-8763. -
  42. [44][44] Tal Ridnik, Emanuel Ben-Baruch, Nadav Zamir, Asaf Noy, Itamar Friedman, Matan Protter, and Lihi Zelnik-Manor. 2021. Asymmetric loss for multi-label classification. In Proceedings of the IEEE/CVF international conference on computer vision . 82-91. -
  43. [45][45] Florian Schmid, Tobias Morocutti, Francesco Foscarin, Jan Schlüter, Paul Primus, and Gerhard Widmer. 2025. Effective Pre-Training of Audio Transformers for Sound Event Detection. In ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 1-5. doi:10.1109/ICASSP49660. 2025.10888942 - · DOI
  44. [46][46] Nian Shao, Xian Li, and Xiaofei Li. 2024. Fine-Tune the Pretrained ATST Model for Sound Event Detection. In ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . -
  45. [47][47] Kazuki Shimada, Kengo Uchida, Yuichiro Koyama, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji, and Tatsuya Kawahara. 2024. Zero- and Few-Shot Sound Event Localization and Detection. In ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 636-640. doi:10. 1109/ICASSP48485.2024.10448497 -
  46. [48][48] Yi Su, Jisheng Bai, Qisheng Xu, Kele Xu, and Yong Dou. 2025. Audio-Language Models for Audio-Centric Tasks: A survey. arXiv:2501.15177 [cs.SD] https: //arxiv.org/abs/2501.15177 - · arXiv
  47. [49][49] Antti Tarvainen and Harri Valpola. 2017. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. Advances in neural information processing systems 30 (2017). -
  48. [50][50] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017). -
  49. [51][51] Keigo Wakayama and Shoichiro Saito. 2022. CNN-transformer with self-attention network for sound event detection. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 806-810. -
  50. [52][52] Jianzong Wu, Xiangtai Li, Shilin Xu, Haobo Yuan, Henghui Ding, Yibo Yang, Xia Li, Jiangning Zhang, Yunhai Tong, Xudong Jiang, Bernard Ghanem, and Dacheng Tao. 2024. Towards Open Vocabulary Learning: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence (2024). -
  51. [53][53] Yusong Wu, Ke Chen, Tianyu Zhang, Yuchen Hui, Taylor Berg-Kirkpatrick, and Shlomo Dubnov. 2023. Large-Scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation. In ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 1-5. doi:10.1109/ICASSP49357.2023.10095969 - · DOI · Paper page
  52. [54][54] Zhirong Ye, Xiangdong Wang, Hong Liu, Yueliang Qian, Rui Tao, Long Yan, and Kazushige Ouchi. 2021. Sound Event Detection Transformer: An Eventbased End-to-End Model for Sound Event Detection. arXiv:2110.02011 [cs.SD] https://arxiv.org/abs/2110.02011 - · arXiv
  53. [55][55] Yuhang Zang, Wei Li, Kaiyang Zhou, Chen Huang, and Chen Change Loy. 2022. Open-Vocabulary DETR with Conditional Matching. In Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part IX (Lecture Notes in Computer Science, Vol. 13669) , Shai Avidan, Gabriel J. Brostow, Moustapha Cissé, Giovanni Maria Farinella, and Tal Hassner (Eds.). Springer, 106-122. -
  54. [56][56] Alireza Zareian, Kevin Dela Rosa, Derek Hao Hu, and Shih-Fu Chang. 2021. Open-Vocabulary Object Detection Using Captions. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 14388-14397. -
  55. [57][57] Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, and David Lopez-Paz. 2018. mixup: Beyond Empirical Risk Minimization. In International Conference on Learning Representations (ICLR) . -
  56. [58][58] Hang Zhao, Xavier Puig, Bolei Zhou, Sanja Fidler, and Antonio Torralba. 2017. Open Vocabulary Scene Parsing. In 2017 IEEE International Conference on Computer Vision (ICCV) . -
  57. [59][59] Xu Zheng, Yan Song, Ian McLoughlin, Lin Liu, and Li-Rong Dai. 2021. An Improved Mean Teacher Based Method for Large Scale Weakly Labeled SemiSupervised Sound Event Detection. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 356-360. doi:10. 1109/ICASSP39728.2021.9414931

Metadata

Authors
Cai, P., Song, Y., Gu, Q., Jiang, N., Song, H., & McLoughlin, I.
Affiliations
  • University of Science and Technology of China (CN)
  • Singapore Institute of Technology (SG)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
Pages
582-591
DOI
10.48550/arxiv.2507.16343
arXiv
2507.16343
OpenAlex
W4415538721
Cited by
4
References
17
Citations by year
2026: 4
FWCI
4.23
Type
conference paper
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • ACM International Conference on Multimedia (ACM MM) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Figshare (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
text prompts, audio prompts, temporal localization, cross-modal feature fusion, attention masking, novel class generalization, audio-language models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queries. https://app.cochat.ai/papers/10.48550/arxiv.2507.16343
The paper
Cai, P., Song, Y., Gu, Q., Jiang, N., Song, H., & McLoughlin, I. (2025). Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queries. arXiv. https://doi.org/10.48550/arxiv.2507.16343