PreprintCited by 290Speech and Audio ProcessingMusic and Audio ProcessingAdvanced Data Compression Techniques

The DOI matches its DataCite record.

High Fidelity Neural Audio Compression

Open access

Défossez, Alexandre, Copet, Jade, Synnaeve, Gabriel, Adi, Yossi·2022·arXiv

DOI 10.48550/arxiv.2210.13438arXiv 2210.13438

Open this paper in CoChat — free account Open PDF

Abstract

We introduce a state-of-the-art real-time, high-fidelity, audio codec leveraging neural networks. It consists in a streaming encoder-decoder architecture with quantized latent space trained in an end-to-end fashion. We simplify and speed-up the training by using a single multiscale spectrogram adversary that efficiently reduces artifacts and produce high-quality samples. We introduce a novel loss balancer mechanism to stabilize training: the weight of a loss now defines the fraction of the overall gradient it should represent, thus decoupling the choice of this hyper-parameter from the typical scale of the loss. Finally, we study how lightweight Transformer models can be used to further compress the obtained representation by up to 40%, while staying faster than real time. We provide a detailed description of the key design choices of the proposed model including: training objective, architectural changes and a study of various perceptual loss functions. We present an extensive subjective evaluation (MUSHRA tests) together with an ablation study for a range of bandwidths and audio domains, including speech, noisy-reverberant speech, and music. Our approach is superior to the baselines methods across all evaluated settings, considering both 24 kHz monophonic and 48 kHz stereophonic audio. Code and models are available at github.com/facebookresearch/encodec.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2210.13438

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Still being checked.

Sorted by citations

Items 201–290 of 290

Estimating the Completeness of Discrete Speech Units
Yeh, S.-L., & Tang, H. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832198 · Cited by 2
Investigating Disentanglement in a Phoneme-Level Speech Codec for Prosody Modeling
Karapiperis, S., Ellinas, N., Vioni, A., Oh, J., Jho, G., Hwang, I.-C., & Raptis, S. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832258 · Cited by 2
Semi-Supervised Cognitive State Classification from Speech with Multi-View Pseudo-Labeling
Li, Y., Zhang, Z., Han, J., Bell, P., & Lai, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890660 · Cited by 2
Why disentanglement-based speaker anonymization systems fail at preserving emotions?
Gaznepoglu, Ü. E., & Peters, N. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889709 · Cited by 2
Get Large Language Models Ready to Speak: A Late-fusion Approach for Speech Generation
Shen, M., Zhang, S., Wu, J., Xiu, Z., AlBadawy, E. A., Lu, Y., Seltzer, M., & He, Q. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890141 · Cited by 2
Speaking from Coarse to Fine: Improving Neural Codec Language Model via Multi-Scale Speech Coding and Generation
Guo, H., Xie, F., Yang, D., Wu, X., & Meng, H. M. L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889794 · Cited by 5
SimulTron: On-Device Simultaneous Speech to Speech Translation
Agranovich, A., Nachmani, E., Rybakov, O., Ding, Y., Ye, J., Bar, N., Zen, H., & Ramanovich, M. T. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889296 · Cited by 2
TTS-Transducer: End-to-End Speech Synthesis with Neural Transducer
Bataev, V., Ghosh, S., Lavrukhin, V., & Li, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890256 · Cited by 2
Enabling Beam Search for Language Model-Based Text-to-Speech Synthesis
Tu, Z., Zhang, G., Lu, Y., Adigwe, A., King, S., & Guo, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890055 · Cited by 4
Progressive Residual Extraction Based Pre-Training for Speech Representation Learning
Wang, T., Li, J., Ma, Z., Cao, R., Chen, X., Wang, L., Ge, M., Wang, X., Wang, Y. G., Dang, J., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3564118 · Cited by 3
A multimodal symphony: integrating taste and sound through generative AI
Spanio, M., Zampini, M., Rodà, A., & Pierucci, F. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1575741 · Cited by 4
Enhancing text-audio generation by music classification and Retrieval-Augmented Generation
He, R., Zhu, J., Wang, B., & Yin, Y. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/68/20241505 · Cited by 1
Generating Stereophonic Music with Single-Stage Language Models
Li, X., Zhuo, F., Luo, D., Chen, J., Kang, S., Wu, Z., Jiang, T., Li, Y., Fang, H., & Zhou, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446643 · Cited by 1
MDCTNet: A Hybrid Approach to Neural Audio Coding
Villemoes, L. F., Vinton, M. S., Ekstrand, P., Lu, L., Davidson, G. A., & Zhou, C. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3482721 · Cited by 1
IBACodec: End-to-end speech codec with intra-inter broad attention
Yang, X., Zhou, J., Yang, D., Wan, Y., Pan, L., & Luo, S. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103979 · Cited by 1
A Dual-path Conformer-Based Network for Neural Speech Coding
Ru, J., Jia, M., Zhao, Y., & Tao, L. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800720 · Cited by 1
Pitch-and-Spectrum-Aware Singing Quality Assessment with Bias Correction and Model Fusion
Shi, Y.-F., Ai, Y., Lu, Y.-X., Du, H.-P., & Ling, Z.-H. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832260 · Cited by 1
NAT3DSound: 3D Spatial Sound Field Synthesis with Multi-Modal Non-Autoregressive Transformer
You, F., Huang, R., Zhang, B., Wang, Y., Hong, Z., Zhang, Z., & Zhao, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888008 · Cited by 1
ZSVC: Zero-shot Style Voice Conversion with Disentangled Latent Diffusion Models and Adversarial Training
Zhu, X., He, L., Xiao, Y., Wang, X., Tan, X., Zhao, S., & Xie, L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888535 · Cited by 1
Attention Weighting and Conditional Entropy-driven Quantization Loss for Neural Audio Codecs
Zhang, H., Tu, W., Yang, Y., Xu, X., Ren, Y., & Zhu, R. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889560 · Cited by 1
Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decoding
Pasini, M., Lattner, S., & Fazekas, G. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890049 · Cited by 3
Universal Low-Resource Speech Synthesis Via Phoneme Fusion Coordinating Low-Rank Decomposition
Li, Y., Yu, Z., Wang, L., Gao, S., Dong, L., & Wang, W. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889039 · Cited by 1
Black-Box Adversarial Defense Against Voice Conversion Using Latent Space Perturbation
Gao, J., Li, H., Zhang, Z., & Wu, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890469 · Cited by 1
MARS6: A Small and Robust Hierarchical-Codec Text-to-Speech Model
Baas, M., Scholtz, P., Mehta, A., Dyson, E., Prakash, A., & Kamper, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890838 · Cited by 1
From Pixels to Voice: A Simple and Efficient End-to-End Spoken Image Description Approach via Vision Codec Language Models
Tran, C., & Sakti, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890285 · Cited by 1
AVS3P10 Standard for Real-time Speech Coding
Xiao, W., Dou, W., Wang, W., Yi, G., Li, J., & Shang, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887781 · Cited by 1
Make Some Noise: Towards LLM audio reasoning and generation using sound tokens
Mehta, S., Jojić, N., & Gamper, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888809 · Cited by 1
Sovereign Sound in Federated Learning: Secured Arabic Pronunciation Assessment for Children in Noisy Environments
Sadik, M. A., ElSayed, A., Moussa, S. M., & Fayed, Z. T. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.02.071 · Cited by 1
Vector-Quantized Feedback Recurrent Autoencoders for the Compression of the Stimulation Patterns of Cochlear Implants at Zero Delay
Hinrichs, R., Bilsky, J., & Östermann, J. (2023) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/dsp58604.2023.10167999 · Cited by 1
A High-Rate Extension to Soundstream
Kang, H.-G., Skoglund, J., Kleijn, W. B., Storus, A., & Yeh, H. (2023) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa58266.2023.10248100 · Cited by 1
Edge Storage Management Recipe with Zero-Shot Data Compression for Road Anomaly Detection
Park, Y., Gim, U.-J., & Kim, M. J. (2023) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc58733.2023.10393463 · Cited by 1
M2BART: Multilingual and Multimodal Encoder-Decoder Pre-Training for Any-to-Any Machine Translation
Chen, P., Shi, B., Niu, K., Lee, A., & Hsu, W.-N. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446620 · Cited by 1
Deep Low-Latency Joint Speech Transmission and Enhancement over A Gaussian Channel
Bokaei, M., Jensen, J., Doclo, S., & Østergaard, J. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10626232 · Cited by 1
Semantic Communication for VR Music Live Streaming With Rate Splitting
Zou, J., Xu, L., & Sun, S. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3443176 · Cited by 1
Large-Scale Room Impulse Response Dataset Compression with Neural Audio Codecs
Mezza, A. I., Bernardini, A., & Antonacci, F. (2024) · IEEE International Symposium on the Internet of Sounds (IS2) · doi:10.1109/is262782.2024.10704165 · Cited by 1
A Preliminary Case Study on Long-Form In-the-Wild Audio Spoofing Detection
Liu, X., Wang, X., & Yamagishi, J. (2024) · International Conference of the Biometrics Special Interest Group (BIOSIG) · doi:10.1109/biosig61931.2024.10786724 · Cited by 1
The Codec Language Model-Based Zero-Shot Spontaneous Style TTS System for CoVoC Challenge 2024
Zhou, S., Zhou, Y., Li, W., Chen, J., Ye, R., Wu, W., Lin, Z., Lei, S., & Wu, Z. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800681 · Cited by 1
Sparse Sounds: Exploring Low-Dimensionality in Music Generation Model
Wang, S., & Liu, S. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825581 · Cited by 1
SRC-gAudio: Sampling-Rate-Controlled Audio Generation
Li, C., Xu, M., & Yu, D. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10849319 · Cited by 2
Towards Training Music Taggers on Synthetic Data
Kroher, N., Manangu, S., & Pikrakis, A. (2024) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1109/cbmi62980.2024.10859229 · Cited by 2
BANC: Towards Efficient Binaural Audio Neural Codec for Overlapping Speech
Ratnarajah, A. J., Zhang, S.-X., & Yu, D. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888151 · Cited by 1
DOSE: Drum One-Shot Extraction from Music Mixture
Hwang, S., Kang, S.-H., Kim, K., Ahn, S., & Lee, K. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889237 · Cited by 1
Code Drift: Towards Idempotent Neural Audio Codecs
O’Reilly, P., Seetharaman, P., Su, J., Jin, Z., & Pardo, B. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890096 · Cited by 1
DecoupledSynth: Enhancing Zero-Shot Text-to-Speech Via Factors Decoupling
Xing, J., Chen, S., Xu, X., & Xing, X. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887763 · Cited by 1
Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction
Kim, M., Jeong, M., Choi, B. J., Kim, S., Lee, J. Y., & Kim, N. S. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3566247 · Cited by 1
Survey On Monolingual Speech-to-Speech Translation
Vachhani, Y., & Viradiya, P. J. (2025) · International Journal of Research in Advent Technology · doi:10.32622/ijrat.131202513 · Cited by 1
Rate-Aware Learned Speech Compression
Xu, J., Cheng, Z., Chi, G., Liu, Y., Hu, Y., & Song, L. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11043747 · Cited by 1
Few-shot Algorithms for Consistent Neural Decoding (FALCON) Benchmark
Karpowicz, B. M., Ye, J., Fan, C., Tostado-Marcos, P., Rizzoglio, F., Washington, C., Scodeler, T., de Lucena, D., Nason, S. R., Mender, M. J., et al. (2024) · neural information processing systems · doi:10.52202/079017-2439 · Cited by 6
A Design of An Autoencoder-Based Audio Compression and Decompression System
Tawfik, A., Hosny, S., Hisham, S., Farouk, A. A., Mustafa, D., Moaty, S. A., Gamal, A. Y., & Salah, K. (2023) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs58634.2023.10382933 · Cited by 1
Biologically informed cortical models predict optogenetic perturbationsPreprint
Sourmpis, C., Petersen, C. C. H., Wulfram Gerstner, B., & Bellec, G. (2025) · eLife · doi:10.7554/elife.106827 · Cited by 4
MOSS-Audio Technical Report
Yang, C., Yu, C., Chen, H., Zhu, J., Chen, J., Chen, K., Wang, W., Wang, Y., Jiang, Y., Jiang, Y., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.01802
“In parallel, neural audio codecs and speech tokenizers, including EnCodec [57], improved RVQGAN codecs [58], and Speech-Tokenizer [59], provide discrete or compressed representations that are useful for speech generation and speech language modeling.”
Measuring the Robustness of Audio Deepfake Detection under Real-World Corruption
Li, X., Chen, P.-Y., & Wei, W. (2026) · Proceedings of the Sixteenth ACM Conference on Data and Application Security and Privacy · doi:10.1145/3800506.3803494
Evaluation of the Quality of Compression of Acoustic Signals in the Low-Frequency and Mid-Frequency Sound Range Using a Neural Network Codec
Sushkov, N., & Mironov, A. (2023) · International Russian Automation Conference (RusAutoCon) · doi:10.1109/rusautocon58002.2023.10272933
SPATIALCODEC: Neural Spatial Speech Coding
Xu, Z., Xu, Y., Kothapally, V., Wang, H., Yang, M., & Yu, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445853
Regeneration of Realistic Grain Shapes Using Spherical Harmonic Analysis and Vector Quantized Time Series Generative ModelPreprint
Lu, J., & Pan, B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4822798
AudioPalette: Generating Soundtracks through Feature Extraction from Images
Vasireddy, A., Kumar, T. N. L., Chebrolu, M., Nair, K., & Prasad, V. R. B. (2024) · International Conference on Inventive Computation Technologies (ICICT) · doi:10.1109/icict60155.2024.10544569
Optimizations of Neural Audio Coder Toward Perceptual Transparency
Byun, J., Shin, S., Hwang, S.-R., Sung, J., Beack, S., & Park, Y. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3437155
Low Bitrate Codec with Joint Vector Quantization and Hoffman Coding for Internet of Things
Peng, D., Yuan, X., Ouyang, M., Weng, Q., Xie, T., Zhong, N., & Zhu, X. (2024) · International Conference on Internet of Things, Automation and Artificial Intelligence (IoTAAI) · doi:10.1109/iotaai62601.2024.10692706
Prediction of creep characteristics of superalloy bolts based on itransformer and θ projection method
Yu, J., Linxiao, X., Cao, Y., Yao, Q., Yanxiang, C., & Chen, C. (2024) · Materials Today Communications · doi:10.1016/j.mtcomm.2024.110998
LMCodec2: Ultra-low bit rate codec with causal multiple transformers
Peng, D., Weng, Q., Zhong, N., Xie, T., Gong, C., Zhu, X., Yuan, X., & Ouyang, M. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109960 · Cited by 1
Hola-TTS: A Cross-Lingual Zero-Shot Text-to-Speech System for Chinese, English, Japanese, and Korean
Ding, H., Zhou, Y., Wang, W., Xu, J., & Mei, J. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800183
ERVQ: Leverage Residual Vector Quantization for Speech Emotion Recognition
Xie, J., Xiang, Y., Wang, H., Wu, X., Wu, Z., & Meng, H. M. L. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800636
A Hybrid DFSMN and Mamba Architecture for Low Bitrate Neural Speech Coding
Zhao, Y., Jia, M., Ru, J., & Tai, J. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800201
The X-Lance Technical Report for Interspeech 2024 Speech Processing using Discrete Speech Unit Challenge
Guo, Y., Wang, C., Yang, Y., Wang, H., Ma, Z., Du, C., Wang, S., Li, H. B., Li, X., Fan, S., et al. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800009
A Differential Quantization Based End-to-End Neural Speech Codec
Lu, P., Xu, L., & Wang, J. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800135
SegINR: Segment-Wise Implicit Neural Representation for Sequence Alignment in Neural Text-to-Speech
Kim, M., Jeong, M., Lee, J. Y., & Kim, N. S. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3528858
Data Efficient Reflow for Few Step Audio Generation
Wu, L., Ni, Z., Shi, B., Lan, G. L., Kumar, A., Nagaraja, V., Mei, X., Xiong, Y., Soran, B., Krishnamoorthi, R., et al. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832165
Investigating Neural Audio Codecs For Speech Language Model-Based Speech Generation
Li, J., Wang, D., Wang, X., Qian, Y., Zhou, L., Liu, S., Yousefi, M., Li, C., Tsai, C.-H., Xiao, Z. Y., et al. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832266 · Cited by 5
LIMMITS'24: Multi-Speaker, Multi-Lingual INDIC TTS With Voice Cloning
Udupa, S., Bandekar, J., Singh, A., Deekshitha, G., Kumar, S., Badiger, S., Nagireddi, A., Roopa, R., Ghosh, P. K., Murthy, H. A., et al. (2025) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2025.3531782
NecoBERT: Self-Supervised Learning Model Trained by Masked Language Modeling on Rich Acoustic Features Derived from Neural Audio Codec
Nakata, W., Saeki, T., Saito, Y., Takamichi, S., & Saruwatari, H. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10849090
NeuralEVC: End-to-End High-Quality Expressive Voice Conversion
Cao, D., & Zhang, J. (2024) · International Conference on Electrical, Mechanical and Computer Engineering (ICEMCE) · doi:10.1109/icemce64157.2024.10862530
Enhancing TTS Stability in Hebrew using Discrete Semantic Units
Zeldes, E., Tal, O., & Adi, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888310
Self-citation
On the Relation Between Speech Quality and Quantized Latent Representations of Neural Codecs
Halimeh, M. M., Torcoli, M., Grundhuber, P., & Habets, E. A. P. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890357
BEST-STD: Bidirectional Mamba-Enhanced Speech Tokenization for Spoken Term Detection
Singh, A. K., Demuynck, K., & Arora, V. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889633
Learning Rich Speech Representations with Acoustic-Semantic Factorization
Niu, M., Sadoughi, N., Yanamandra, A., Wang, P., Liu, Z., Bhat, V., & Norred, S. E. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889923
Codec-ASV: Exploring Neural Audio Codec For Speaker Representation Learning
Lin, Y., Zhang, F., Gao, Y., Zhang, S., & Li, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888177
DetailTTS: Learning Residual Detail Information for Zero-shot Text-to-speech
Wang, C., Han, Y., Geng, Y., Gao, Y., Wang, F., Bai, B., Li, Q., Xue, J., Deng, Y., Wen, Z., et al. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890840
Single-stage TTS with Masked Audio Token Modeling and Semantic Knowledge Distillation
Gállego, G. I., Fejgin, R., Yeh, C., Liu, X., & Bhattacharya, G. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889934
Accompaniment Prompt Adherence: A measure for evaluating music accompaniment systems
Grachten, M., & Nistal, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888854
SSC: 106 bit/s Ultra-low Bitrate Semantic Speech Coding
Jia, R., He, Z., Niu, K., Xiao, Z., Liu, Y., & Liu, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889978
Estimating Musical Surprisal in Audio
Bjare, M. R., Cantisani, G., Lattner, S., & Widmer, G. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890619
Adaptive Large Language Models via Attention Shortcuts
Verma, P., & Pilancı, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889322
Biologically informed cortical models predict optogenetic perturbationsPreprint
Sourmpis, C., Petersen, C. C. H., Wulfram Gerstner, B., & Bellec, G. (2025) · eLife · doi:10.7554/elife.106827.1
Dual-Branch Codec With Orthogonality Constraint and Knowledge Distillation for Noisy Environment
Han, Y., Chen, H., Liu, L., & Du, J. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3591726
MetrikaBox: An open framework for experimenting with audio classification
Perianez-Pascual, J., Gutiérrez, J. D., Delgado, E., Sánchez-Figueroa, F., & Rodríguez-Echeverría, R. (2025) · SoftwareX · doi:10.1016/j.softx.2025.102306
A Multi-Scale Low-Bitrate Speech Codec for LEO Communication With Deep Feature Preservation Losses
Lu, P., Chen, X., Cheng, Z., Wang, J., Zheng, Z., & Fei, Z. (2025) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/icccworkshops67136.2025.11148169
A speech prediction model based on codec modeling and transformer decoding
Wang, H., Yang, Y., & Wang, D. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101892
Testing Audio Compression Autoencoders for Seismology: Moving Toward Foundation Models
Laurenti, L., Johnson, C. W., Trappolini, D., Tinti, E., Galasso, F., & Marone, C. J. (2026) · Journal of Geophysical Research Machine Learning and Computation · doi:10.1029/2025jh000787 · Cited by 1
De-Codec: Decoupling Speech and Background-Sound in Codec to Allow Explicit Feature Selections for Downstream Audio Tasks
Luo, X. Y., Huang, J., Cui, Z., Li, T., Chen, Y., Gao, Y., Deng, C., Zhang, S., & Feng, J. (2026) · Journal of Shanghai Jiaotong University (Science) · doi:10.1007/s12204-026-2916-y
Design and implementation of an end to end music audio generation system based on diffusion probabilistic model
Yang, Y., Luo, R., & Zhang, R. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02280-2

Authors: Défossez, A., Copet, J., Synnaeve, G., & Adi, Y.
Affiliations: Meta (Israel) (IL)
ORCID: Synnaeve, Gabriel
Adi, Yossi
Venue: arXiv
Publisher: arXiv
Published: 2022
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.2210.13438
arXiv: 2210.13438
OpenAlex: W4307323391
Cited by: 282
References: 0
Citations by year: 2026: 4 · 2025: 112 · 2024: 145 · 2023: 21
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Data Compression Techniques
Keywords: audio codec, encoder-decoder architecture, loss balancing, lightweight transformer, perceptual loss, MUSHRA, stereo audio

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

High Fidelity Neural Audio Compression

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks