The Interspeech 2026 Audio Encoder Capability Challenge for Large Audio Language Models
Open accessAbstract
This paper presents the Interspeech 2026 Audio Encoder Capability Challenge, a benchmark specifically designed to evaluate and advance the performance of pre-trained audio encoders as front-end modules for Large Audio Language Models (LALMs). While LALMs have shown remarkable understanding of complex acoustic scenes, their performance depends on the semantic richness of the underlying audio encoder representations. This challenge addresses the integration gap by providing a unified generative evaluation framework, XARES-LLM, which assesses submitted encoders across a diverse suite of downstream classification and generation tasks. By decoupling encoder development from LLM fine-tuning, the challenge establishes a standardized protocol for general-purpose audio representations that can effectively be used for the next generation of multimodal language models.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The XARES-LLM framework is a holistic evaluation suite which trains a typical Large Audio Language Model using the audio encoder provided by the user.
“we conduct comparative experiments using the XARES-LLM framework[63], a holistic evaluation suite which trains a typical LALM(Large Audio Language Model) using the audio encoder provided by the user.”
From MOSS-Audio Technical Report (2026) · cites this paper as [63]
Cites
Still being checked.
Cited by
Sorted by citations
Yang, C., Yu, C., Chen, H., Zhu, J., Chen, J., Chen, K., Wang, W., Wang, Y., Jiang, Y., Jiang, Y., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.01802
“To rigorously assess the representation quality of our pre-trained audio backbone, we conduct comparative experiments using the XARES-LLM framework[63], a holistic evaluation suite which trains a typical LALM(Large Audio Language Model) using the audio encoder provided by the user.”
Self-citation
- Authors
- Dinkel, H., Zhou, J., Wang, G., Niu, Y., Zhang, J., Hao, Y., Liu, Y., Li, K., Wang, W., Wu, Z., & Luan, J.
- Affiliations
- Ocean Energy (Norway) (NO)
- University of Surrey (GB)
- Tsinghua Shenzhen International Graduate School (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2603.22728
- OpenAlex
- W7140320553
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- audio encoder, large audio language models, audio representation learning, benchmark challenge, audio classification, audio generation, multimodal language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
