The DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.
Bootstrapping Language-Audio Pre-training for Music Captioning
Abstract
We introduce BLAP, a model capable of generating high-quality captions for music. BLAP leverages a fine-tuned CLAP audio encoder and a pre-trained Flan-T5 large language model. To achieve effective cross-modal alignment between music and language, BLAP utilizes a Querying Transformer, allowing us to obtain state-of-the-art performance using 6x less data compared to previous models. This is a critical consideration given the scarcity of descriptive music data and the subjective nature of music interpretation. We provide qualitative examples demonstrating BLAP’s ability to produce realistic captions for music, and perform a quantitative evaluation on three datasets. BLAP achieves a relative improvement on FENSE compared to previous models of 3.5%, 6.5%, and 7.5% on the MusicCaps, Song Describer, and YouTube8m-MTC datasets, respectively. The codebase is available at https://github.com/ETH-DISCO/blap.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although MusiLingo (Deng et al., 2023), MU-LLaMA (Liu et al., 2024), and BLAP (Lanzendörfer et al., 2025) provide publicly available weights, none offer an explicit music-feature extraction module.”
From SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning (2025) · cites this paper as Lanzendörfer et al., 2025
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
(2004) · Cited by 9,718
CIDEr: Consensus-based image description evaluation
Vedantam, R., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299087 · Cited by 4,845
(2005) · Cited by 4,152
A Neural Probabilistic Language Model
Bengio, Y., Ducharme, R., Vincent, P., Jauvin, C., Jaz, K., Hofmann, T., Poggio, T., & Shawe-Taylor, J. S. (2000) · Cited by 3,479
Audio Set: An ontology and human-labeled dataset for audio events
Gemmeke, J. F., Ellis, D. P. W., Freedman, D., Jansen, A., Lawrence, W., Moore, R. C., Plakal, M., & Ritter, M. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952261 · Cited by 3,134
BERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865
Research works printed but not linked: 1
- Labbé, Irit-ups dcase 2023 audio captioning and retrieval system, 1
Cited by
AudioSet-R: A Refined AudioSet with Multi-Stage LLM Label Reannotation
Sun, Y., Xu, Q., Su, Y., Zhu, Q., Dou, Y., Liu, X., & Xu, K. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758260 · Cited by 7
“To this end, we adopt Qwen-Audio as the core component of the semantic extraction module, based on its demonstrated effectiveness in audio understanding and cross-modal generation [17, 33, 36].”
Bad Designs by Good Talkers: Chatbots Failing to Architect Audio Encoders for Image Synthesis
León, J. E., Carrasco, M., & Peters, A. A. (2026) · IEEE Access · doi:10.1109/access.2026.3668130
SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning
Chopra, A., Roy, A., & Herremans, D. (2025) · arXiv · doi:10.48550/arxiv.2506.15154 · Cited by 3
“Although MusiLingo (Deng et al., 2023), MU-LLaMA (Liu et al., 2024), and BLAP (Lanzendörfer et al., 2025) provide publicly available weights, none offer an explicit music-feature extraction module.”
Metadata
- Authors
- Lanzendörfer, L. A., Pinkl, C., Perraudin, N., & Wattenhofer, R.
- Affiliations
- ETH Zurich (CH)
- Swiss Data Science Center (CH)
- Venue
- ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2025-04-06
- Pages
- 1-5
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W4408353080
- Cited by
- 3
- References
- 38
- Citations by year
- 2026: 2 · 2025: 1
- FWCI
- 3.17
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- music captioning, cross-modal alignment, Flan-T5
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bootstrapping Language-Audio Pre-training for Music Captioning. https://app.cochat.ai/papers/10.1109/icassp49660.2025.10887618
- The paper
- Lanzendörfer, L. A., Pinkl, C., Perraudin, N., & Wattenhofer, R. (2025). Bootstrapping Language-Audio Pre-training for Music Captioning. ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp49660.2025.10887618
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.