UVeQFed: Universal Vector Quantization for Federated Learning
Open accessThe DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index.
Abstract
Traditional deep learning models are trained at a centralized server using data samples collected from users. Such data samples often include private information, which the users may not be willing to share. Federated learning (FL) is an emerging approach to train such learning models without requiring the users to share their data. FL consists of an iterative procedure, where in each iteration the users train a copy of the learning model locally. The server then collects the individual updates and aggregates them into a global model. A major challenge that arises in this method is the need of each user to repeatedly transmit its learned model over the throughput limited uplink channel. In this work, we tackle this challenge using tools from quantization theory. In particular, we identify the unique characteristics associated with conveying trained models over rate-constrained channels, and propose a suitable quantization scheme for such settings, referred to as universal vector quantization for FL (UVeQFed). We show that combining universal vector quantization methods with FL yields a decentralized training system in which the compression of the trained models induces only a minimum distortion. We then theoretically analyze the distortion, showing that it vanishes as the number of users grows. We also characterize how models trained with conventional federated averaging combined with UVeQFed converge to the model which minimizes the loss function. Our numerical results demonstrate the gains of UVeQFed over previously proposed methods in terms of both distortion induced in quantization and accuracy of the resulting aggregated model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Scalar quantization is a typical way to implement lossy compression for the high-dimensional gradient vectors by quantizing each of their entries to a finite-bit low precision value [123]- [125], which was further improved by the recent proposal of vector quantization [126], [127].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [127]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210 · cited 3×
“One of the major challenges of FL is the transfer of a large number of updated model parameters over the uplink communication channel from the users to the server, whose throughput is typically constrained [5], [7]–[9].”
BackgroundLarge Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
Sphere Packings, Lattices and Groups.
Coxeter, H. S. M., Conway, J. H., & Sloane, N. J. A. (1989) · The American Mathematical Monthly · doi:10.2307/2323992 · Cited by 3,377
The rate-distortion function for source coding with side information at the decoder
Wyner, A., & Ziv, J. (1976) · IEEE Transactions on Information Theory · doi:10.1109/tit.1976.1055508 · Cited by 3,023
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Research works printed but not linked: 1
- [56] MathWorks Deep Learning Toolbox Team, 'Deep learning tutorial series,' MATLAB Central File Exchange , 2020. [Online]. Available: https://www.mathworks.com/matlabcentral/fileexchange/62990-deep-learning-tutorial-series -
Cited by
Items 301–343 of 343
Li, A., Yang, X., Ma, L., Yu, L., Hao, L. Y., & Liu, Y. (2025) · The European Journal on Artificial Intelligence · doi:10.1177/30504554251340238
Asy-MSFL: Communication-Efficient Federated Learning With Multiserver Adaptive Updates
Li, J., Gu, H., & Wen, H. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3577986
A Joint Decoding Scheme for Communication-Efficient NOMA-Empowered Federated Learning
Chen, J., Cai, S., Wan, H., & Ma, X. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2025.3612733
MIMO Over-The-Air Federated Learning With Spiking Neural Network Via Lattice Code
Wang, C., Wu, Y., Wang, T., & Shi, Y. (2025) · International Conference on Communications · doi:10.1109/icc52391.2025.11160731
FDA-Opt: Federated Fine-Tuning via Dynamic Update Schedules
Theologitis, M., Samoladas, V., & Deligiannakis, A. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840785
Lan, M., Xiao, S., & Zhang, W. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.03973
Guan, Y., Niu, J., Ren, T., & Liu, X. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209237
Chen, J., Gao, Y., & Fu, R. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227845
Fan, L., Zeng, Z., Zhang, X., & Duan, M. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111938
Improving Wireless Networking from the Learning and Security Perspectives
Qu, Z. (2022) · Digital Commons - University of South Florida (University of South Florida)
Federated Computing Systems In The Context of Energy Informatics
Schwermer, R., Jacobsen, H.-A., & München, T. U. (2023)
Ahmed, S. F., & Jamal, L. (2025) · International Conference on Federated Learning Technologies and Applications (FLTA) · doi:10.1109/flta67013.2025.11336645
Fed-CoID:An Event-Triggered Federated Learning Intrusion Detection Algorithm for Smart Grids
Cui, W., Sun, F., Ren, S., Li, R., Xu, R., & Zhang, Y. (2025) · International Conference on Cyber-Energy Systems and Intelligent Energy (ICCSIE) · doi:10.1109/iccsie67394.2025.11379243
Lattice coding for reliable and efficient communication
de Souza, J. G. F. (2025) · doi:10.47749/t/unicamp.2025.1509222
Scalable Systems for Machine Learning
Khan, A. F. (2026) · VTechWorks (Virginia Tech)
Sahoo, A., & Tripathy, A. K. (2026) · Results in Engineering · doi:10.1016/j.rineng.2026.109985
Communication-Efficient Federated Learning Framework for Autonomous Vehicles
Sinaei, S., Mohammadi, M., & Alibeigi, M. (2026) · International Conference on Consumer Electronics · doi:10.1109/icce67443.2026.11449665
Plassier, V. (2023) · theses.fr (ABES) · doi:10.70675/9b6101b0zc3dez4c4az9bb1zc3b4392f012a
PubSwap: Public-Data Off-Policy Coordination for Federated RLVRPreprint
Nayak, A., Askin, B., Ustaomeroglu, M., Joe‐Wong, C., & Joshi, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.12160
Makris, A., Dousis, C., Kritharakis, E., Bouras, S., & Tserpes, K. (2026) · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT) · doi:10.1109/dcoss-iot69657.2026.00117
Abdel-lah, M., Hesham, A., Salah, A., & Behery, G. M. (2026) · Information · doi:10.3390/info17060528
Security and Privacy Concerns for Blockchain‐Enabled Federated Learning
Ghosh, P., Biswas, A., Ghosh, S., Bhowmik, R., & Barua, A. (2026) · Wiley eBooks · doi:10.1002/9781394347124.ch14
Quantization in Federated Learning: Methods, Challenges and Future DirectionsPreprint
Ikram, F., Thakur, D., Guzzo, A., & Fortino, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.26822 · Cited by 1
Resource-Aware Decentralized Learning with Rate-Adaptive Quantization
Qiao, J., Liu, Y., Yuan, Y., Zou, Y., Zhang, X., & Yu, D. (2026) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom59046.2026.11571464
Entropy-Adaptive Federated Learning with Efficient Bit Allocation over Wireless Channels
Hamidi, S. M., & Liang, B. (2026) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom59046.2026.11571579
Fed-RSAdapter: Federated Fine-Tuning of Remote Sensing Images via Multi-Scale Adapter Modules
Wang, Y., Lin, L., Zhou, Y., Wang, S., Wang, Z., & Qi, X. (2026) · Remote Sensing · doi:10.3390/rs18142352
Low-Latency Federated Learning via Adaptive Batch-Size Control under Device Heterogeneity
Yang, H., Wang, Z., & Huang, K. (2026) · International Conference on Communications · doi:10.1109/icc59461.2026.11588293
Transmission-Efficient Federated Learning via Chessboard Convolutional Kernel
Li, W., Li, W., Ma, C., Vasilakos, A. V., Wang, Y., Wu, T., Song, W., & Cao, J. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3713384
Alshami, F., Yao, L., Xu, H., Wu, G., & Sultan, A. (2026) · Ad Hoc Networks · doi:10.1016/j.adhoc.2026.104379
Reddy, C. R. S., Bhargav, S., Thirupathi, G., & Babu, K. R. (2026) · International Journal of Electronics and Communication Engineering · doi:10.14445/23488549/ijece-v13i7p108
Peddireddy, H., Gadde, S. K., Bheemavarapu, P., Ponugoti, R. K. R., Pandey, A., & Randhawa, P. (2026) · International Conference on Secure Information Systems and Technologies (ICSIST) · doi:10.1109/icsist70215.2026.11705939
Almanifi, O. R. A., Chow, C.-O., Tham, M., Chuah, J. H., Kanesan, J., & Chieng, D. H. T. (2026) · Internet of Things · doi:10.1016/j.iot.2026.102113
Semi-Asynchronous Efficient Hierarchical Federated Learning for heterogeneous resources
Xiao, J., Chen, Y., Wei, Z., Xie, K., Li, X., Li, K., Martino, B. D., & Liang, W. (2026) · Future Generation Computer Systems · doi:10.1016/j.future.2026.108835
Progressive-Resolution Secure Aggregation for Federated LearningPreprint
Azimi‐Abarghouyi, S. M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.00695
Hoxha, J., Panxhi, M., & Thanasi-Boçe, M. (2026) · IEEE Access · doi:10.1109/access.2026.3743411
Ge, K., Long, W., Dong, Y., Li, D., Xie, M., 吕鹏龙, Zhang, W., & Zhang, W. (2026) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2026.104047
Anada, H., Ou, Y., & Takamaeda-Yamazaki, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22996
Optimality of the $D_4$ lattice quantizerPreprint
Liu, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.00100
Distributed Consensus, Optimization, and Learning under Communication ConstraintsPreprint
Chen, Z., Michelusi, N., Charalambous, T., & Huang, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.06524
Metadata
- Authors
- Shlezinger, N., Chen, M., Eldar, Y. C., Poor, H. V., & Cui, S.
- Affiliations
- Ben-Gurion University of the Negev (IL)
- Princeton University (US)
- Weizmann Institute of Science (IL)
- Shenzhen Research Institute of Big Data (CN)
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2021
- Volume
- 69
- Pages
- 500-514
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W3033664100
- Cited by
- 275
- References
- 65
- Citations by year
- 2026: 26 · 2025: 45 · 2024: 58 · 2023: 60 · 2022: 48 · 2021: 35
- FWCI
- 14.35
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Israel Science Foundation (0100101)
- Horizon 2020 Framework Programme (646804-ERC-COG-BNYQ)
- National Natural Science Foundation of China (NSFC-61629101)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Sensor Networks and Detection Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- federated learning, model compression, uplink channel, quantization distortion, decentralized learning, FedAvg, convergence analysis, privacy-preserving machine learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.