UVeQFed: Universal Vector Quantization for Federated Learning
Open accessThe DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index.
Abstract
Traditional deep learning models are trained at a centralized server using data samples collected from users. Such data samples often include private information, which the users may not be willing to share. Federated learning (FL) is an emerging approach to train such learning models without requiring the users to share their data. FL consists of an iterative procedure, where in each iteration the users train a copy of the learning model locally. The server then collects the individual updates and aggregates them into a global model. A major challenge that arises in this method is the need of each user to repeatedly transmit its learned model over the throughput limited uplink channel. In this work, we tackle this challenge using tools from quantization theory. In particular, we identify the unique characteristics associated with conveying trained models over rate-constrained channels, and propose a suitable quantization scheme for such settings, referred to as universal vector quantization for FL (UVeQFed). We show that combining universal vector quantization methods with FL yields a decentralized training system in which the compression of the trained models induces only a minimum distortion. We then theoretically analyze the distortion, showing that it vanishes as the number of users grows. We also characterize how models trained with conventional federated averaging combined with UVeQFed converge to the model which minimizes the loss function. Our numerical results demonstrate the gains of UVeQFed over previously proposed methods in terms of both distortion induced in quantization and accuracy of the resulting aggregated model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Scalar quantization is a typical way to implement lossy compression for the high-dimensional gradient vectors by quantizing each of their entries to a finite-bit low precision value [123]- [125], which was further improved by the recent proposal of vector quantization [126], [127].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [127]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210 · cited 3×
“One of the major challenges of FL is the transfer of a large number of updated model parameters over the uplink communication channel from the users to the server, whose throughput is typically constrained [5], [7]–[9].”
BackgroundLarge Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
Sphere Packings, Lattices and Groups.
Coxeter, H. S. M., Conway, J. H., & Sloane, N. J. A. (1989) · The American Mathematical Monthly · doi:10.2307/2323992 · Cited by 3,377
The rate-distortion function for source coding with side information at the decoder
Wyner, A., & Ziv, J. (1976) · IEEE Transactions on Information Theory · doi:10.1109/tit.1976.1055508 · Cited by 3,023
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Research works printed but not linked: 1
- [56] MathWorks Deep Learning Toolbox Team, 'Deep learning tutorial series,' MATLAB Central File Exchange , 2020. [Online]. Available: https://www.mathworks.com/matlabcentral/fileexchange/62990-deep-learning-tutorial-series -
Cited by
A Novel Framework for the Analysis and Design of Heterogeneous Federated Learning
Wang, J., Liu, Q., Liang, H., Joshi, G., & Poor, H. V. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3106104 · Cited by 1,198
Self-citationFederated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“Scalar quantization is a typical way to implement lossy compression for the high-dimensional gradient vectors by quantizing each of their entries to a finite-bit low precision value [123], [124], [125], which was further improved by the recent proposal of vector quantization [126], [127].”
BackgroundFederated learning meets blockchain in edge computing: Opportunities and challenges
Nguyen, D. C., Ding, M., Pham, Q.-V., Pathirana, P. N., Le, L. B., Seneviratne, A., Li, J., Niyato, D., & Poor, H. V. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3072611 · Cited by 661
Self-citationDistributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Self-citationCommunication-efficient federated learning
Chen, M., Shlezinger, N., Poor, H. V., Eldar, Y. C., & Cui, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2024789118 · Cited by 397
Self-citationFrom distributed machine learning to federated learning: a survey
Liu, J., Huang, J., Zhou, Y., Li, X., Ji, S., Xiong, H., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01664-x · Cited by 356
Liu, S., Yu, J., Deng, X., & Wan, S. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3099368 · Cited by 232
Over-the-Air Federated Learning From Heterogeneous Data
Sery, T., Shlezinger, N., Cohen, K., & Eldar, Y. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3090323 · Cited by 219
Self-citationSecure Smart Communication Efficiency in Federated Learning: Achievements and Challenges
Pouriyeh, S., Shahid, O., Parizi, R. M., Sheng, Q. Z., Srivastava, G., Zhao, L., & Nasajpour, M. (2022) · Applied Sciences · doi:10.3390/app12188980 · Cited by 213
Kim, M., Gunlu, O., & Schaefer, R. F. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413764 · Cited by 128
FedAS: Bridging Inconsistency in Personalized Federated Learning
Yang, X., Huang, W., & Ye, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01139 · Cited by 195
Green Edge AI: A Contemporary Survey
Mao, Y., Yu, X., Huang, K., Zhang, Y. A., & Zhang, J. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3437365 · Cited by 187
Federated Learning: A signal processing perspective
Gafni, T., Shlezinger, N., Cohen, K., Eldar, Y. C., & Poor, H. V. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3125282 · Cited by 176
Self-citationCFD: Communication-Efficient Federated Distillation via Soft-Label Quantization and Delta Coding
Sattler, F., Marbán, A., Rischke, R., & Samek, W. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3081748 · Cited by 174
Hasan, M. K., Jahan, N., Nazri, M. Z. A., Islam, S., Attique Khan, M., Alzahrani, A. I., Alalwan, N., & Nam, Y. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3357530 · Cited by 174
Communication and computation efficiency in Federated Learning: A survey
Almanifi, O. R. A., Chow, C.-O., Tham, M.-L., Chuah, J. H., & Kanesan, J. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100742 · Cited by 161
A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services
Katare, D., Perino, D., Nurmi, J., Warnier, M., Janssen, M., & Ding, A. Y. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3302474 · Cited by 158
Communication-efficient distributed learning: An overview
Cao, X., Başar, T., Diggavi, S., Eldar, Y. C., Letaief, K. B., Poor, H. V., & Zhang, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242710 · Cited by 139
“forth in [90] for FL over rate-constrained wireless channels in a server-agent system.”
BackgroundSelf-citationLightSecAgg: a Lightweight and Versatile Design for Secure Aggregation in Federated Learning
So, J., He, C., Yang, C.-S., Li, S., Yu, Q., Ali, R. E., Güler, B., & Avestimehr, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.14236 · Cited by 58
Saraswat, D., Verma, A., Bhattacharya, P., Tanwar, S., Sharma, G., Bokoro, P. N., & Sharma, R. (2022) · IEEE Access · doi:10.1109/access.2022.3161132 · Cited by 127
Adaptive Quantization of Model Updates for Communication-Efficient Federated Learning
Jhunjhunwala, D., Gadhikar, A., Joshi, G., & Eldar, Y. C. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413697 · Cited by 126
“A natural extension of AdaQuantFL would be using other quantizers such as the stochastic rotated quantizer [18] and the universal vector quantizer [9].”
BackgroundMethodSelf-citationContext-Aware Online Client Selection for Hierarchical Federated Learning
Qu, Z., Duan, R., Chen, L., Xu, J., Lu, Z., & Liu, Y. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3186960 · Cited by 123
Towards efficient communications in federated learning: A contemporary survey
Zhao, Z., Mao, Y., Liu, Y., Song, L., Ouyang, Y., Chen, X., & Ding, W. (2023) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2022.12.053 · Cited by 123
Zhang, C., Zhang, W., Wu, Q., Fan, P., Fan, Q., Wang, J., & Letaief, K. B. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3447036 · Cited by 115
Federated Learning With Spiking Neural Networks
Venkatesha, Y., Kim, Y., Tassiulas, L., & Panda, P. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3121632 · Cited by 86
Joint Privacy Enhancement and Quantization in Federated Learning
Lang, N., Sofer, E., Shaked, T., & Shlezinger, N. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3244092 · Cited by 97
Self-citationCommunication-Efficient Federated Learning via Quantized Compressed Sensing
Oh, Y., Lee, N., Jeon, Y., & Poor, H. V. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3201207 · Cited by 97
Self-citationHou, X., Wang, J., Jiang, C., Meng, Z., Chen, J., & Ren, Y. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3345393 · Cited by 91
Adaptive Hierarchical Federated Learning Over Wireless Networks
Xu, B., Xia, W., Wen, W., Liu, P., Zhao, H., & Zhu, H. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3135541 · Cited by 81
Massive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning
Qiao, L., Gao, Z., Mashhadi, M. B., & Gündüz, D. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3431572 · Cited by 81
1-Bit Compressive Sensing for Efficient Federated Learning Over the Air
Fan, X., Wang, Y., Huo, Y., & Tian, Z. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3209190 · Cited by 80
DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated LearningPreprint
Hoenig, R., Zhao, Y., & Mullins, R. (2021) · arXiv (Cornell University) · doi:10.17863/cam.104286 · Cited by 80
Wireless Federated Learning Over Resource-Constrained Networks: Digital Versus Analog Transmissions
Yao, J., Xu, W., Yang, Z., You, X., Bennis, M., & Poor, H. V. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3407822 · Cited by 73
Self-citationWireless Quantized Federated Learning: A Joint Computation and Communication Design
Bouzinis, P. S., Diamantoulakis, P. D., & Karagiannidis, G. K. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2023.3258485 · Cited by 73
Cui, Y., Cao, K., Zhou, J., & Wei, T. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3205551 · Cited by 70
Communication-Efficient Federated Learning for Resource-Constrained Edge Devices
Lan, G., Liu, X.-Y., Zhang, Y., & Wang, X. (2023) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2023.3309773 · Cited by 73
Combating Interference for Over-the-Air Federated Learning: A Statistical Approach via RIS
Shi, W., Yao, J., Xu, W., Xu, J., You, X., Eldar, Y. C., & Zhao, C. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3536023 · Cited by 69
Self-citationMeta-heuristic as manager in federated learning approaches for image processing purposes
Połap, D., & Woźniak, M. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107872 · Cited by 65
Federated Learning With Client Selection and Gradient Compression in Heterogeneous Edge Systems
Xu, Y., Jiang, Z., Xu, H., Wang, Z., Qian, C., & Qiao, C. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3309497 · Cited by 63
Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned DataPreprint
Castiglia, T., Das, A., Wang, S., & Patterson, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.08330 · Cited by 62
Wireless for Machine Learning: A Survey
Hellström, H., da Silva, J. M. B., Amiri, M. M., Chen, M., Fodor, V., Poor, H. V., & Fischione, C. (2022) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000114 · Cited by 59
Self-citationFederated Edge Learning for 6G: Foundations, Methodologies, and Applications
Tao, M., Zhou, Y., Shi, Y., Lu, J., Cui, S. R., Lü, J., & Letaief, K. B. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3509739 · Cited by 58
Self-citationWireless for Machine Learning: A Survey
Hellström, H., da Silva, J. M. B., Amiri, M. M., Chen, M., Fodor, V., Poor, H. V., & Fischione, C. (2022) · doi:10.1561/9781638280071 · Cited by 58
Self-citationCommunication-Efficient Federated Edge Learning via Optimal Probabilistic Device Scheduling
Zhang, M., Zhu, G., Wang, S., Jiang, J., Liao, Q., Zhong, C., & Cui, S. R. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3166941 · Cited by 54
Self-citationPrompt-enhanced Federated Content Representation Learning for Cross-domain Recommendation
Guo, L., Lu, Z., Yu, J., Nguyen, Q. V. H., & Yin, H. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645337 · Cited by 53
Zhang, Z., Zhang, Y., Guo, D., Zhao, S., & Zhu, X. (2022) · Science China Information Sciences · doi:10.1007/s11432-020-3419-4 · Cited by 52
Performance Optimization for Variable Bitwidth Federated Learning in Wireless Networks
Wang, S., Chen, M., Brinton, C. G., Yin, C., Saad, W., & Cui, S. R. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3297790 · Cited by 51
Self-citationDecentralized Online Convex Optimization With Feedback Delays
Cao, X., & Başar, T. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3092562 · Cited by 48
Communication compression techniques in distributed deep learning: A survey
Wang, Z., Wen, M., Xu, Y., Zhou, Y., Wang, J. H., & Zhang, L. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.102927 · Cited by 48
Mixed-Precision Quantization for Federated Learning on Resource-Constrained Heterogeneous Devices
Chen, H., & Vikalo, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00587 · Cited by 49
Channel Simulation: Theory and Applications to Lossy Compression and Differential Privacy
Li, C. T. (2024) · Foundations and Trends® in Communications and Information Theory · doi:10.1561/0100000141 · Cited by 47
FedVQCS: Federated Learning via Vector Quantized Compressed Sensing
Oh, Y., Jeon, Y., Chen, M., & Saad, W. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3291877 · Cited by 45
Self-citationUnderstanding and Improving Model Averaging in Federated Learning on Heterogeneous Data
Zhou, T., Lin, Z., Zhang, J., & Tsang, D. H. K. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3406554 · Cited by 44
Task-Based Analog-to-Digital Converters
Neuhaus, P., Shlezinger, N., Dörpinghaus, M., Eldar, Y. C., & Fettweis, G. P. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3095726 · Cited by 44
Self-citationDistributed Machine Learning for Autonomous Agent Swarm: A Survey
Hou, X., Wang, J., Du, J., Jiang, C., & Ren, Y. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3594713 · Cited by 44
Communication-Efficient Split Learning via Adaptive Feature-Wise Compression
Oh, Y., Lee, J., Brinton, C. G., & Jeon, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3526227 · Cited by 42
AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices
Li, P., Cheng, G., Huang, X., Kang, J., Yu, R., Wu, Y., & Pan, M. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10229017 · Cited by 42
Deep Compression for Efficient and Accelerated Over-the-Air Federated Learning
Khan, F. M. A., Abou-Zeid, H., & Hassan, S. A. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3373460 · Cited by 41
Federated Learning With Over-the-Air Aggregation Over Time-Varying Channels
Tegin, B., & Duman, T. M. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3235894 · Cited by 40
DoCoFL: Downlink Compression for Cross-Device Federated LearningPreprint
Dorfman, R., Vargaftik, S., Ben-Itzhak, Y., & Levy, K. Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.00543 · Cited by 40
Turning Channel Noise Into an Accelerator for Over-the-Air Principal Component Analysis
Zhang, Z., Zhu, G., Wang, R., Lau, V. K. N., & Huang, K. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3162868 · Cited by 39
Liu, S., Yu, G., Yin, R., Yuan, J., & Qu, F. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3309088 · Cited by 38
Liu, P., Jiang, J., Zhu, G., Cheng, L., Jiang, W., Luo, W., Du, Y., & Wang, Z. (2022) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2100538 · Cited by 38
Federated Learning with Flexible Control
Wang, S., Perazzone, J. B., Ji, M., & Chan, K. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10229070 · Cited by 38
FLOAT: Federated Learning Optimizations with Automated Tuning
Khan, A. F., Khan, A. A., Abdelmoniem, A. M., Fountain, S., Butt, A. R., & Anwar, A. (2024) · European Conference on Computer Systems · doi:10.1145/3627703.3650081 · Cited by 37
Device Scheduling in Over-the-Air Federated Learning Via Matching Pursuit
Bereyhi, A., Vagollari, A., Asaad, S., Müller, R. R., Gerstacker, W., & Poor, H. V. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3284376 · Cited by 37
Self-citationAddressing Heterogeneity in Federated Learning with Client Selection via Submodular Optimization
Zhang, J., Wang, J., Li, Y., Xin, F., Dong, F., Luo, J., & Wu, Z. (2023) · ACM Transactions on Sensor Networks · doi:10.1145/3638052 · Cited by 37
Decentralized Low-Latency Collaborative Inference via Ensembles on the Edge
Malka, M., Farhan, E., Morgenstern, H., & Shlezinger, N. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3497167 · Cited by 37
Self-citationWang, B., Fang, J., Li, H., & Zeng, B. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3316588 · Cited by 36
Zhao, Z., Mao, Y., Shi, Z., Liu, Y., Lan, T., Ding, W., & Zhang, X.-P. S. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3332901 · Cited by 36
Collaborative Inference via Ensembles on the Edge
Shlezinger, N., Farhan, E., Morgenstern, H., & Eldar, Y. C. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414740 · Cited by 35
Self-citationSparse Personalized Federated Learning
Liu, X., Li, Y., Wang, Q., Zhang, X., Shao, Y., & Geng, Y. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3250658 · Cited by 35
Barbieri, L., Kianoush, S., Nicoli, M., Serio, L., & Savazzi, S. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3530265 · Cited by 34
Yang, J., Jiang, W. R., & Nie, L. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3322701 · Cited by 33
FedOComp: Two-Timescale Online Gradient Compression for Over-the-Air Federated Learning
Xue, Y., Su, L., & Lau, V. K. N. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3165268 · Cited by 32
Multi-Edge Server-Assisted Dynamic Federated Learning With an Optimized Floating Aggregation Point
Ganguly, B., Hosseinalipour, S., Kim, K. T., Brinton, C. G., Aggarwal, V., Love, D. J., & Chiang, M. (2023) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2023.3262482 · Cited by 32
Mathew, C., & Asha, D. (2024) · Journal of Internet Services and Information Security · doi:10.58346/jisis.2024.i3.021 · Cited by 32
FedGreen: Federated Learning with Fine-Grained Gradient Compression for Green Mobile Edge Computing
Li, P., Huang, X., Pan, M., & Yu, R. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685582 · Cited by 31
Mishra, K. N., Bhattacharjee, V., Saket, S., & Mishra, S. P. (2022) · Cluster Computing · doi:10.1007/s10586-022-03813-x · Cited by 31
Federated learning with superquantile aggregation for heterogeneous data
Pillutla, K., Laguel, Y., Malick, J., & Harchaoui, Z. (2023) · Machine Learning · doi:10.1007/s10994-023-06332-x · Cited by 31
Tighter Regret Analysis and Optimization of Online Federated Learning
Kwon, D., Park, J.-H., & Hong, S. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3316672 · Cited by 30
Accelerating Hybrid Federated Learning Convergence Under Partial Participation
Bian, J., Wang, L., Yang, K., Shen, C., & Xu, J. (2024) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2024.3408631 · Cited by 29
FedUR: Federated Learning Optimization Through Adaptive Centralized Learning Optimizers
Zhang, H., Zeng, K., & Lin, S. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3292497 · Cited by 28
Communication-Efficient Laplace Mechanism for Differential Privacy via Random Quantization
Shahmiri, A. M., Ling, C. W., & Li, C. T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446221 · Cited by 28
Federated learning with stochastic quantization
Li, Y., Li, W., & Xue, Z. (2022) · International Journal of Intelligent Systems · doi:10.1002/int.23056 · Cited by 27
Li, P., Cheng, G., Huang, X., Kang, J., Yu, R., Wu, Y., Pan, M., & Niyato, D. T. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3245601 · Cited by 27
Dynamic Scheduling for Vehicle-to-Vehicle Communications Enhanced Federated Learning
Yan, J., Chen, T., Sun, Y., Nan, Z., Zhou, S., & Niu, Z. (2025) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2025.3573048 · Cited by 27
Fedrec: Federated Learning of Universal Receivers Over Fading Channels
Mashhadi, M. B., Shlezinger, N., Eldar, Y. C., & Gündüz, D. (2021) · IEEE Statistical Signal Processing Workshop (SSP) · doi:10.1109/ssp49050.2021.9513736 · Cited by 27
Self-citationPrivacy-Aware Compression for Federated Data AnalysisPreprint
Chaudhuri, K., Guo, C., & Rabbat, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.08134 · Cited by 27
Bayesian Federated Learning over Wireless NetworksPreprint
Lee, S., Park, C., Hong, S., Eldar, Y. C., & Lee, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15486 · Cited by 26
Self-citationCommunication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications
Park, J., Samarakoon, S., Elgabli, A., Kim, J., Bennis, M., Kim, S.-L., & Debbah, M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3055679 · Cited by 25
“Leveraging the universal quantization algorithm [98], the work [99] applies universal vector quantization to FL, coined UVeQFed, such that the quantization error can be bounded by a term that vanishes as the number of workers grows.”
MethodStragglers-Aware Low-Latency Synchronous Federated Learning via Layer-Wise Model Updates
Lang, N., Cohen, A., & Shlezinger, N. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3486979 · Cited by 25
Self-citationDeng, Z., Sun, R., Xue, M., Wen, S., Camtepe, S. A., Nepal, ., & Xiang, Y. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3532957 · Cited by 25
Communication-Efficient Federated Learning via Predictive Coding
Yue, K., Jin, R., Wong, C.-W., & Dai, H. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3142678 · Cited by 25
Communication Reducing Quantization for Federated Learning with Local Differential Privacy Mechanism
Zong, H., Wang, Q., Liu, X., Li, Y., & Shao, Y. (2021) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc52777.2021.9580315 · Cited by 24
Multiple Parallel Federated Learning via Over-the-Air Computation
Shi, G., Guo, S., Ye, J., Saeed, N., & Dang, S. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3194821 · Cited by 24
Clustered Federated Learning for Population-Based Structural Health Monitoring
Cheema, M. A., Sarwar, M. Z., Cantero, D., & Rossi, P. S. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3556670 · Cited by 24
Li, Q., Yu, W., Xia, Y., & Pang, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.07505 · Cited by 24
Communication-Efficient Federated Learning Over MIMO Multiple Access Channels
Jeon, Y., Amiri, M. M., & Lee, N. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3198433 · Cited by 23
Metadata
- Authors
- Shlezinger, N., Chen, M., Eldar, Y. C., Poor, H. V., & Cui, S.
- Affiliations
- Ben-Gurion University of the Negev (IL)
- Princeton University (US)
- Weizmann Institute of Science (IL)
- Shenzhen Research Institute of Big Data (CN)
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2021
- Volume
- 69
- Pages
- 500-514
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W3033664100
- Cited by
- 275
- References
- 65
- Citations by year
- 2026: 26 · 2025: 45 · 2024: 58 · 2023: 60 · 2022: 48 · 2021: 35
- FWCI
- 14.35
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Israel Science Foundation (0100101)
- Horizon 2020 Framework Programme (646804-ERC-COG-BNYQ)
- National Natural Science Foundation of China (NSFC-61629101)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Sensor Networks and Detection Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- federated learning, model compression, uplink channel, quantization distortion, decentralized learning, FedAvg, convergence analysis, privacy-preserving machine learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.