PreprintCited by 588Privacy-Preserving Technologies in DataStochastic Gradient Optimization TechniquesDistributed Sensor Networks and Detection Algorithms

The DOI matches its DataCite record; 37 of the 40 references it cites were found in a registry or an index.

FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization

Open access

Reisizadeh, Amirhossein, Mokhtari, Aryan, Hassani, Hamed, Jadbabaie, Ali, Pedarsani, Ramtin·2019·arXiv

DOI 10.48550/arxiv.1909.13014arXiv 1909.13014

Open this paper in CoChat — free account Open PDF

Abstract

Federated learning is a distributed framework according to which a model is trained over a set of devices, while keeping data localized. This framework faces several systems-oriented challenges which include (i) communication bottleneck since a large number of devices upload their local updates to a parameter server, and (ii) scalability as the federated network consists of millions of devices. Due to these systems challenges as well as issues related to statistical heterogeneity of data and privacy concerns, designing a provably efficient federated learning method is of significant importance yet it remains challenging. In this paper, we present FedPAQ, a communication-efficient Federated Learning method with Periodic Averaging and Quantization. FedPAQ relies on three key features: (1) periodic averaging where models are updated locally at devices and only periodically averaged at the server; (2) partial device participation where only a fraction of devices participate in each round of the training; and (3) quantized message-passing where the edge nodes quantize their updates before uploading to the parameter server. These features address the communications and scalability challenges in federated learning. We also show that FedPAQ achieves near-optimal theoretical guarantees for strongly convex and non-convex loss functions and empirically demonstrate the communication-computation tradeoff provided by our method.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1909.13014

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
On the Convergence of FedAvg on Non-IID Data
Li, X., Huang, K., Yang, W., Wang, S., & Zhang, Z. (2019) · arXiv · doi:10.48550/arxiv.1907.02189 · Cited by 1,575
On First-Order Meta-Learning Algorithms
Nichol, A., Achiam, J., & Schulman, J. (2018) · arXiv · doi:10.48550/arxiv.1803.02999 · Cited by 1,438
QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
Alistarh, D., Grubic, D., Li, J. Z., Tomioka, R., & Vojnović, M. (2016) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · doi:10.48550/arxiv.1610.02132 · Cited by 1,262
The Tradeoffs of Large-Scale Learning
Bottou, L., & Bousquet, O. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/8996.003.0015 · Cited by 1,201
Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
Yin, D., Chen, Y., Ramchandran, K., & Bartlett, P. (2018) · arXiv · doi:10.48550/arxiv.1803.01498 · Cited by 1,130
Federated Learning of Deep Networks using Model AveragingPreprint
McMahan, H. B., Moore, E., Ramage, D., & y Arcas, B. A. (2016) · arXiv (Cornell University) · Cited by 1,005
Learning Differentially Private Recurrent Language Models
McMahan, H. B., Ramage, D., Talwar, K., & Zhang, L. (2017) · arXiv · doi:10.48550/arxiv.1710.06963 · Cited by 849

Flagged first, then by citations

Show all 40 references

3 of the 40 references couldn’t be matched to a known paper.

Sorted by citations

Items 101–200 of 588

Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse GradientsPreprint
Mitra, A., Jaafar, R. H., Pappas, G. J., & Hassani, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07053 · Cited by 53
Self-citation
Wireless Quantized Federated Learning: A Joint Computation and Communication Design
Bouzinis, P. S., Diamantoulakis, P. D., & Karagiannidis, G. K. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2023.3258485 · Cited by 60
Massive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning
Qiao, L., Gao, Z., Mashhadi, M. B., & Gündüz, D. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3431572 · Cited by 73
Joint Optimal Quantization and Aggregation of Federated Learning Scheme in VANETs
Li, Y., Guo, Y., Alazab, M., Chen, S., Shen, C., & Yu, K. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3145823 · Cited by 48
FLASH: Heterogeneity-Aware Federated Learning at Scale
Yang, C., Xu, M., Wang, Q., Chen, Z., Huang, K., Ma, Y., Bian, K., Huang, G., Liu, Y., Jin, X., et al. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3214234 · Cited by 48
Green, Quantized Federated Learning Over Wireless Networks: An Energy-Efficient Design
Kim, M., Saad, W., Mozaffari, M., & Debbah, M. A. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3289177 · Cited by 48
Personalized Federated Learning with Gaussian ProcessesPreprint
Achituve, I., Shamsian, A., Navon, A., Chechik, G., & Fetaya, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15482 · Cited by 52
Applying Federated Learning in Software-Defined Networks: A Survey
Ma, X., Liao, L., Li, Z., Lai, R. X., & Zhang, M. (2022) · Symmetry · doi:10.3390/sym14020195 · Cited by 50
SplitGP: Achieving Both Generalization and Personalization in Federated Learning
Han, D.-J., Kim, D.-Y., Choi, M., Brinton, C. G., & Moon, J. J. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10229027 · Cited by 47
Re-Thinking the Effectiveness of Batch Normalization and Beyond
Peng, H., Yu, Y., & Yu, S. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3319005 · Cited by 47
A Simple Federated Learning-Based Scheme for Security Enhancement Over Internet of Medical Things
Xu, Z., Guo, Y., Chakraborty, C., Hua, Q., Chen, S., & Yu, K. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3187471 · Cited by 52
Federated Offline Reinforcement Learning with Proximal Policy Evaluation
Yue, S., Deng, Y., Wang, G. Y., Ren, J., & Zhang, Y. (2024) · Chinese Journal of Electronics · doi:10.23919/cje.2023.00.288 · Cited by 46
Relaxed Contrastive Learning for Federated Learning
Seo, S., Kim, J., Kim, G., & Han, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01167 · Cited by 45
Federated Learning With Nesterov Accelerated Gradient
Yang, Z., Bao, W., Yuan, D., Tran, N. H. K., & Zomaya, A. Y. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3206480 · Cited by 53
Federated Learning in Massive MIMO 6G Networks: Convergence Analysis and Communication-Efficient Design
Mu, Y., Garg, N., & Ratnarajah, T. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3196463 · Cited by 46
Federated Multi-Agent Deep Reinforcement Learning (Fed-MADRL) for Dynamic Spectrum Access
Chang, H.-H., Song, Y., Doan, T. T., & Liu, L. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3233436 · Cited by 47
FedDQ: Communication-Efficient Federated Learning with Descending Quantization
Qu, L., Song, S., & Tsui, C.-Y. (2022) · Globecom · doi:10.1109/globecom48099.2022.10001205 · Cited by 44
Communication-Efficient Federated Learning for Resource-Constrained Edge Devices
Lan, G., Liu, X.-Y., Zhang, Y., & Wang, X. (2023) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2023.3309773 · Cited by 46
Model pruning enables localized and efficient federated learning for yield forecasting and data sharing
Li, A., Marković, M., Edwards, P. J., & Leontidis, G. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122847 · Cited by 54
FedPA: An adaptively partial model aggregation strategy in Federated Learning
Liu, J., Wang, J. H., Rong, C., Xu, Y., Yu, T., & Wang, J. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108468 · Cited by 44
Mandheling
Xu, D., Xu, M., Wang, Q., Wang, S., Ma, Y., Huang, K. R., Huang, G., Jin, X., & Liu, X. (2022) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3495243.3560545 · Cited by 56
Federated Split Learning With Joint Personalization-Generalization for Inference-Stage Optimization in Wireless Edge Networks
Han, D.-J., Kim, D.-Y., Choi, M., Nickel, D., Moon, J. J., Chiang, M., & Brinton, C. G. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3331690 · Cited by 46
Federated learning and next generation wireless communications: A survey on bidirectional relationship
Shome, D., Waqar, O., & Khan, W. U. (2022) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4458 · Cited by 49
Communication-efficient federated continual learning for distributed learning system with Non-IID data
Zhang, Z., Zhang, Y., Guo, D., Zhao, S., & Zhu, X. (2022) · Science China Information Sciences · doi:10.1007/s11432-020-3419-4 · Cited by 42
Over-the-Air Federated Learning and Optimization
Zhu, J., Shi, Y., Zhou, Y., Jiang, C., Chen, W., & Letaief, K. B. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3352280 · Cited by 51
FedRD: Privacy-preserving adaptive Federated learning framework for intelligent hazardous Road Damage detection and warning
Yuan, Y., Yuan, Y., Baker, T., Kolbe, L. M., & Hogrefe, D. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.06.035 · Cited by 42
Semi-Synchronous Federated Learning for Energy-Efficient Training and Accelerated Convergence in Cross-Silo Settings
Stripelis, D., Thompson, P. M., & Ambite, J. L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3524885 · Cited by 57
DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated LearningPreprint
Hoenig, R., Zhao, Y., & Mullins, R. (2021) · arXiv (Cornell University) · doi:10.17863/cam.104286 · Cited by 41
CriticalFL: A Critical Learning Periods Augmented Client Selection Framework for Efficient Federated Learning
Yan, G., Wang, H., Yuan, X., & Li, J. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599293 · Cited by 40
CEEP-FL: A comprehensive approach for communication efficiency and enhanced privacy in federated learning
Asad, M., Moustafa, A., & Aslam, M. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107235 · Cited by 39
Federated PCA on Grassmann Manifold for IoT Anomaly Detection
Nguyen, T.-A., Le, L. T., Nguyen, T. D., Bao, W., Seneviratne, S., Hong, C. S., & Tran, N. H. K. (2024) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2024.3423780 · Cited by 38
FedPE: Adaptive Model Pruning-Expanding for Federated Learning on Mobile Devices
Yi, L., Shi, X., Wang, N., Zhang, J., Wang, G., & Liu, X. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3374706 · Cited by 43
Speed Up Federated Learning in Heterogeneous Environments: A Dynamic Tiering Approach
Mohammadabadi, S. M. S., Zawad, S., Yan, F., & Yang, L. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3487473 · Cited by 46
A federated deep learning framework for privacy preservation and communication efficiency
Cao, T.-D., Truong-Huu, T., Tran, H., & Khanh, T. V. (2022) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2022.102413 · Cited by 37
Local SGD: Unified Theory and New Efficient MethodsPreprint
Gorbunov, E., Hanzely, F., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02828 · Cited by 37
Why Batch Normalization Damage Federated Learning on Non-IID Data?
Wang, Y., Shi, Q., & Chang, T. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3323302 · Cited by 46
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated LearningPreprint
Hyeon-Woo, N., Ye-Bin, M., & Oh, T.-H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.06098 · Cited by 126
Wireless for Machine Learning: A Survey
Hellström, H., da Silva, J. M. B., Amiri, M. M., Chen, M., Fodor, V., Poor, H. V., & Fischione, C. (2022) · doi:10.1561/9781638280071 · Cited by 55
Online Federated Learning
Mitra, A., Hassani, H., & Pappas, G. J. (2021) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc45484.2021.9683589 · Cited by 35
Self-citation
Faster Non-Convex Federated Learning via Global and Local MomentumPreprint
Das, R., Acharya, A., Hashemi, A., Sanghavi, S., Dhillon, I. S., & Topcu, U. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04061 · Cited by 35
Federated Learning Over Coupled Graphs
Lei, R., Wang, P., Zhao, J., Lan, L., Tao, J., Deng, C., Feng, J., Wang, X., & Guan, X. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3240527 · Cited by 36
Customized Federated Learning for accelerated edge computing with heterogeneous task targets
Jiang, H., Liu, M., Yang, B., Liu, Q., Li, J., & Guo, X. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107569 · Cited by 35
FLAS: Computation and Communication Efficient Federated Learning via Adaptive Sampling
Shu, J., Zhang, W., Zhou, Y., Cheng, Z., & Yang, L. T. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3056655 · Cited by 35
Federated Learning with Flexible Control
Wang, S., Perazzone, J. B., Ji, M., & Chan, K. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10229070 · Cited by 33
AdaFL: Adaptive Client Selection and Dynamic Contribution Evaluation for Efficient Federated Learning
Li, Q., Li, X., Zhou, L., & Yan, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447356 · Cited by 33
Communication-Efficient Federated Distillation with Active Data Sampling
Liu, L., Zhang, J., Song, S., & Letaief, K. B. (2022) · International Conference on Communications · doi:10.1109/icc45855.2022.9839214 · Cited by 33
AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices
Li, P., Cheng, G., Huang, X., Kang, J., Yu, R., Wu, Y., & Pan, M. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10229017 · Cited by 33
On the Outsized Importance of Learning Rates in Local Update Methods
Charles, Z., & Konečný, J. (2020) · arXiv · doi:10.48550/arxiv.2007.00878 · Cited by 32
Deep Compression for Efficient and Accelerated Over-the-Air Federated Learning
Khan, F. M. A., Abou-Zeid, H., & Hassan, S. A. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3373460 · Cited by 33
Federated Learning on Internet of Things: Extensive and Systematic Review
Aggarwal, M., Khullar, V., Rani, S., Prola, T. A., Bhattacharjee, S. B., Shawon, S. M., & Goyal, N. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.049846 · Cited by 38
Heterogeneous Model Fusion Federated Learning Mechanism Based on Model Mapping
Lu, X., Liao, Y., Liu, C., Lió, P., & Hui, P. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3110908 · Cited by 36
Resource-Constrained Federated Edge Learning With Heterogeneous Data: Formulation and Analysis
Liu, Y., Zhu, Y., & Yu, J. J. Q. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3126021 · Cited by 32
A survey on security and privacy threats to federated learning
Zhang, J., Li, M., Zeng, S., Xie, B., & Zhao, D. (2021) · International Conference on Networking and Network Applications (NaNA) · doi:10.1109/nana53684.2021.00062 · Cited by 34
AdaFed: Optimizing Participation-Aware Federated Learning With Adaptive Aggregation Weights
Tan, L., Zhang, X., Zhou, Y., Che, X., Hu, M., Chen, X., & Wu, D. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3168969 · Cited by 36
FedADMM: A federated primal-dual algorithm allowing partial participation
Wang, H., Marella, S., & Anderson, J. (2022) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc51059.2022.9992745 · Cited by 33
Toward Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search
Zhang, C., Yuan, X., Zhang, Q., Zhu, G., Cheng, L., & Zhang, N. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3154605 · Cited by 34
Intelligent digital twin for federated learning in AIoT networks
Rizwan, A., Ahmad, R., Khan, A. N., Xu, R., & Kim, D. H. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100698 · Cited by 31
COTAF: Convergent Over-the-Air Federated Learning
Sery, T., Shlezinger, N., Cohen, K., & Eldar, Y. C. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322580 · Cited by 30
Privacy-Preserving Communication-Efficient Federated Multi-Armed Bandits
Li, T. K., & Song, L. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3142374 · Cited by 30
AQUILA: Communication Efficient Federated Learning With Adaptive Quantization in Device Selection Strategy
Zhao, Z., Mao, Y., Shi, Z., Liu, Y., Lan, T., Ding, W., & Zhang, X.-P. S. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3332901 · Cited by 29
A Lightweight Small Object Detection Method Based on Multilayer Coordination Federated Intelligence for Coal Mine IoVT
Wu, J., Zheng, R., Jiang, J., Tian, Z., Chen, W., Wang, Z., Yu, F. R., & Leung, V. C. M. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3373028 · Cited by 31
Federated Learning under Arbitrary Communication Patterns
Avdiukhin, D., & Kasiviswanathan, S. P. (2021) · International Conference on Machine Learning · Cited by 29
A privacy preserving diagnostic collaboration framework for facial paralysis using federated learning
Nair, D. G., Nair, J. J., Reddy, K. J., & Narayana, C. V. A. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105476 · Cited by 32
A Survey of Distributed Optimization Methods for Multi-Robot SystemsPreprint
Halsted, T., Shorinwa, O., Yu, J., & Schwager, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.12840 · Cited by 29
FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous TiersPreprint
Chai, Z., Chen, Y., Anwar, A., Zhao, L., Cheng, Y., & Rangwala, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05958 · Cited by 48
Communication compression techniques in distributed deep learning: A survey
Wang, Z., Wen, M., Xu, Y., Zhou, Y., Wang, J. H., & Zhang, L. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.102927 · Cited by 31
Mixed-Precision Quantization for Federated Learning on Resource-Constrained Heterogeneous Devices
Chen, H., & Vikalo, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00587 · Cited by 32
SparSFA: Towards robust and communication-efficient peer-to-peer federated learning
Wang, H., Muñoz-González, L., Hameed, M. Z., Eklund, D., & Raza, S. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103182 · Cited by 28
A Comprehensive Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniques
Li, W., Hacid, H., Almazrouei, E., & Debbah, M. A. (2023) · AI · doi:10.3390/ai4030039 · Cited by 37
Energy-Efficient and Privacy-Preserving Blockchain Based Federated Learning for Smart Healthcare System
Singh, M. B., Singh, H. K., & Pratap, A. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3332955 · Cited by 27
Fed-MPS: Federated learning with local differential privacy using model parameter selection for resource-constrained CPS
Jiang, S., Wang, X., Que, Y., & Lin, H. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103108 · Cited by 27
Federated Learning With Over-the-Air Aggregation Over Time-Varying Channels
Tegin, B., & Duman, T. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3235894 · Cited by 35
Dispositivos, Eu Escolho Vocês: Seleção de Clientes Adaptativa para Comunicação Eficiente em Aprendizado Federado
Souza, A. M. D., Bittencourt, L. F., Cerqueira, E., Loureiro, A. A. F., & Villas, L. A. (2023) · Simpósio Brasileiro de Redes de Computadores e Sistemas Distribuídos (SBRC) · doi:10.5753/sbrc.2023.499 · Cited by 27
A Privacy Preserving System for Movie Recommendations Using Federated Learning
Neumann, D., Lutz, A., Müller, K., & Samek, W. (2023) · ACM Transactions on Recommender Systems · doi:10.1145/3634686 · Cited by 31
Communication-Efficient Federated Learning: A Variance-Reduced Stochastic Approach With Adaptive Sparsification
Wang, B., Fang, J., Li, H., & Zeng, B. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3316588 · Cited by 26
Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning
Elgabli, A., Park, J., Bedi, A. S., Bennis, M., & Aggarwal, V. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054491 · Cited by 27
Evaluation of the trade-off between performance and communication costs in federated learning scenario
Paragliola, G. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.06.006 · Cited by 27
Adaptive Upgrade of Client Resources for Improving the Quality of Federated Learning Model
AbdulRahman, S., Ould‐Slimane, H., Chowdhury, R., Mourad, A., Talhi, C., & Guizani, M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3218755 · Cited by 30
cFedDT: Cross-Domain Federated Learning in Digital Twins for Metaverse Consumer Electronic Products
Ma, R., Shi, H., Gao, H., Guan, H., Iqbal, M., & Mumtaz, S. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3327010 · Cited by 26
FedLC: Accelerating Asynchronous Federated Learning in Edge Computing
Xu, Y., Ma, Z., Xu, H., Chen, S., Liu, J., & Xue, Y. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3307610 · Cited by 25
FedAGL: A Communication-Efficient Federated Vehicular Network
Liu, S., Li, Y.-S., Guan, P.-Y., Li, T.-Y., Yu, J., Taherkordi, A., & Jensen, C. S. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3349655 · Cited by 25
A Framework of Decentralized Federated Learning With Soft Clustering and 1-Bit Compressed Sensing for Vehicular Networks
Tan, G., Yuan, H., Hu, H., Zhou, S., & Zhang, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3385913 · Cited by 25
Hierarchical Coded Gradient Aggregation for Learning at the Edge
Prakash, S., Reisizadeh, A., Pedarsani, R., & Avestimehr, A. S. (2020) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit44484.2020.9174077 · Cited by 23
Self-citation
A Layer Selection Optimizer for Communication-Efficient Decentralized Federated Deep Learning
Barbieri, L., Savazzi, S., & Nicoli, M. (2023) · IEEE Access · doi:10.1109/access.2023.3251571 · Cited by 25
DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning With Static and Streaming Datasets
Liu, W., Zhang, X., Duan, J., Joe‐Wong, C., Zhou, Z., & Chen, X. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3337016 · Cited by 29
Distributed Learning in the IoT–Edge–Cloud Continuum
Arzovs, A., Judvaitis, J., Nesenbergs, K., & Selavo, L. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6010015 · Cited by 26
Toward Communication Efficient Adaptive Gradient Method
Chen, X., Li, X., & Li, P. (2020) · ACM-IMS Foundations of Data Science Conference (FODS) · doi:10.1145/3412815.3416891 · Cited by 23
Secure and Efficient Federated Learning With Provable Performance Guarantees via Stochastic Quantization
Lyu, X., Hou, X., Ren, C., Ge, X., Yang, P., Cui, Q., & Tao, X. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3374590 · Cited by 23
Impact of Aggregation Function Randomization against Model Poisoning in Federated Learning
Nabavirazavi, S., Taheri, R., Shojafar, M., & Iyengar, S. S. (2023) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom60117.2023.00043 · Cited by 25
Energy-Harvesting Distributed Machine Learning
Güler, B., & Yener, A. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9518045 · Cited by 24
Joint Accuracy and Latency Optimization for Quantized Federated Learning in Vehicular Networks
Zhang, X., Chen, W., Zhao, H. J., Chang, Z., & Han, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3406531 · Cited by 24
DACFL: Dynamic Average Consensus-Based Federated Learning in Decentralized Sensors Network
Chen, Z., Li, D., Zhu, J., & Zhang, S. (2022) · Sensors · doi:10.3390/s22093317 · Cited by 23
Scaling Language Model Size in Cross-Device Federated Learning
Ro, J., Breiner, T., McConnaughey, L., Chen, M., Suresh, A., Kumar, S., & Mathews, R. (2022) · doi:10.18653/v1/2022.fl4nlp-1.2 · Cited by 35
Regulated Subspace Projection Based Local Model Update Compression for Communication-Efficient Federated Learning
Park, S., & Choi, W. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242722 · Cited by 21
Energy and Spectrum Efficient Federated Learning via High-Precision Over-the-Air Computation
Li, L., Huang, C., Shi, D., Wang, H., Zhou, X., Shu, M., & Pan, M. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3287549 · Cited by 26
Private Read Update Write (PRUW) in Federated Submodel Learning (FSL): Communication Efficient Schemes With and Without Sparsification
Vithana, S., & Ulukuş, Ş. (2023) · IEEE Transactions on Information Theory · doi:10.1109/tit.2023.3292187 · Cited by 24
Distributed Adaptive Learning Under Communication Constraints
Carpentiero, M., Matta, V., & Sayed, A. H. (2023) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2023.3344052 · Cited by 22
EfficientQ: An efficient and accurate post-training neural network quantization method for medical image segmentation
Zhang, R., & Chung, A. C. S. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103277 · Cited by 22
FedDBL: Communication and Data Efficient Federated Deep-Broad Learning for Histopathological Tissue Classification
Deng, T., Huang, Y., Han, G., Shi, Z., Lin, J., Dou, Q., Liu, Z., Guo, X., Chen, C. L. P., & Han, C. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3403927 · Cited by 26
Privacy-Preserving federated learning: An application for big data load forecast in buildings
Khalil, M., Esseghir, M., & Merghem, L. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103211 · Cited by 20

Authors: Reisizadeh, A., Mokhtari, A., Hassani, H., Jadbabaie, A., & Pedarsani, R.
ORCID: Reisizadeh, Amirhossein
Mokhtari, Aryan
Hassani, Hamed
Jadbabaie, Ali
Pedarsani, Ramtin
Venue: arXiv
Publisher: arXiv
Published: 2019
Pages: 2021-2031
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1909.13014
arXiv: 1909.13014
OpenAlex: W2975043678
Cited by: 587
References: 40
Citations by year: 2025: 41 · 2024: 146 · 2023: 156 · 2022: 96 · 2021: 100 · 2020: 46 · 2019: 2
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
International Conference on Artificial Intelligence and Statistics
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Sensor Networks and Detection Algorithms
Keywords: federated learning, communication efficiency, scalability, computation-communication trade-off, strongly convex loss, non-convex loss

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks