Expanding the Reach of Federated Learning by Reducing Client Resource Requirements
Open accessAbstract
Communication on heterogeneous edge networks is a fundamental bottleneck in Federated Learning (FL), restricting both model capacity and user participation. To address this issue, we introduce two novel strategies to reduce communication costs: (1) the use of lossy compression on the global model sent server-to-client; and (2) Federated Dropout, which allows users to efficiently train locally on smaller subsets of the global model and also provides a reduction in both client-to-server communication and local computation. We empirically show that these strategies, combined with existing compression approaches for client-to-server communication, collectively provide up to a $14\times$ reduction in server-to-client communication, a $1.7\times$ reduction in local computation, and a $28\times$ reduction in upload communication, all without degrading the quality of the final model. We thus comprehensively reduce FL's impact on client device resources, allowing higher capacity models to be trained, and a more diverse set of users to be reached.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Federated dropout lowers downlink communication, uplink update size, and local computation.
“Federated dropout not only reduces the downlink communication but also reduces the size of uplink updates. Moreover, the local computational costs is correspondingly reduced since the local training procedure dealing with parameters with smaller dimensions.”
From Federated Learning for Healthcare Informatics (2021) · cites this paper as [12]
Federated learning is vulnerable to both targeted and untargeted sybil attacks.
“Recent work has shown that federated learning is vulnerable to both targeted and untargeted sybil attacks [190].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [190]
The Introduction (pp. 1–2) and Related Work (p. 2) discuss communication costs and client resource constraints, not security attacks. Searches for sybil attacks and for malicious clients, adversarial attacks, and poisoning found no passage addressing targeted or untargeted sybil attacks. (LLM, conf=0.75)
Experimental — accuracy not yet measuredMAUI can decompose the whole program at runtime instead of manually partitioning before program deployment.
“this solution can decompose the whole program at runtime instead of manually partitioning of programmers before program deploying.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [178]
The Introduction (p. 2) and Federated Dropout section (p. 4) discuss reducing federated-learning model size and client computation, not decomposing a program at runtime. Searches for MAUI, runtime program partitioning, and pre-deployment manual partitioning found no passage addressing the claim. (LLM, conf=0.76)
Experimental — accuracy not yet measuredMAUI can conserve an order of magnitude energy by optimizing task allocation strategies under network constraints.
“MAUI, capable of adaptively partitioning general computer programs, can conserve an order of magnitude energy by optimizing the task allocation strategies, under the network constraints.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [178]
The Abstract (p. 1) and Results (section 4.4, p. 7) report reductions in federated-learning communication and local computation, not energy savings from MAUI. Searches for MAUI, program partitioning, task allocation, and order-of-magnitude energy savings found no passage addressing the attributed claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
(2014) · Cited by 33,419 · see citing works
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,890 · see citing works
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · see citing works
Stable signal recovery from incomplete and inaccurate measurements
Candès, E. J., Romberg, J. K., & Tao, T. (2006) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20124 · Cited by 7,036 · see citing works
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766 · see citing works
Self-citationStriving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447 · see citing works
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,189 · see citing works
A Mathematical Introduction to Compressive Sensing
Foucart, S., & Rauhut, H. (2013) · Applied and numerical harmonic analysis · doi:10.1007/978-0-8176-4948-7 · Cited by 2,638 · see citing works
Binarized Neural NetworksPreprint
Hubara, I., Soudry, D., & El-Yaniv, R. (2016) · arXiv.org · doi:10.48550/arxiv.1602.02505 · Cited by 2,241 · see citing works
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563 · see citing works
Self-citationEMNIST: an extension of MNIST to handwritten lettersPreprint
Cohen, G., Afshar, S., Tapson, J. C., & André, V. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05373 · Cited by 442 · see citing works
Towards Accurate Binary Convolutional Neural Network
Lin, X., Zhao, C., & Pan, W. L. (2017) · neural information processing systems · Cited by 262 · see citing works
DIAMETERS OF SOME FINITE-DIMENSIONAL SETS AND CLASSES OF SMOOTH FUNCTIONS
Kašin, B. S. (1977) · Mathematics of the USSR-Izvestiya · doi:10.1070/im1977v011n02abeh001719 · Cited by 251 · see citing works
ATOMO: Communication-efficient Learning via Atomic SparsificationPreprint
Wang, H., Sievert, S., Charles, Z., Liu, S., Wright, S. J., & Papailiopoulos, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04090 · Cited by 247 · see citing works
Distributed Mean Estimation with Limited CommunicationPreprint
Suresh, A. T., Yu, F. X., Kumar, S., & McMahan, H. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00429 · Cited by 227 · see citing works
Self-citationCoCoA: A General Framework for Communication-Efficient Distributed OptimizationPreprint
Smith, V., Forte, S., Ma, C., Takáč, M., Jordan, M. I., & Jaggi, M. (2016) · arXiv (Cornell University) · doi:10.3929/ethz-b-000282738 · Cited by 204 · see citing works
AIDE: Fast and Communication Efficient Distributed OptimizationPreprint
Reddi, S. J., Konecný, J., Richtárik, P., Póczos, B., & Smola, A. (2016) · arXiv.org · doi:10.48550/arxiv.1608.06879 · Cited by 156 · see citing works
Uncertainty Principles and Vector Quantization
Lyubarskii, Y., & Vershynin, R. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2048458 · Cited by 79 · see citing works
High-Accuracy Low-Precision TrainingPreprint
De, C., Leszczynski, M., Zhang, J., Marzoev, A., Aberger, C. R., Olukotun, K., & Ré, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03383 · Cited by 67 · see citing works
Randomized Distributed Mean Estimation: Accuracy vs CommunicationPreprint
Konečný, J., & Richtárik, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07555 · Cited by 8 · see citing works
Flagged first, then by citations
3 of the 24 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Song Han, Jeff Pool, John Tran, and William J Dally. Learning both weights and connections for efficient neural network. In Advances in neural information processing systems , pages 1135-1143, 2015.
- Song Han, Huizi Mao, and William J Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. International Conference on Learning Representations , 2016.
- H Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. Communicationefficient learning of deep networks from decentralized data. pages 1273-1282, 2017.
- Virginia Smith, Chao-Kai Chiang, Maziar Sanjabi, and Ameet S Talwalkar. Federated multi-task learning. In Advances in Neural Information Processing Systems , pages 4424-4434, 2017.
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · see citing works
Self-citationFederated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210 · see citing works
Self-citationFederated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565 · see citing works
A survey on federated learning
Zhang, C., Xie, Y., Bai, H., Yu, B., Li, W., & Gao, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106775 · Cited by 1,899 · see citing works
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00082-4 · Cited by 1,542 · see citing works
“Federated dropout, in which each client, instead of locally training an update to the whole global model, trains an update to a smaller sub-model [12].”
BackgroundConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498 · see citing works
“Different from only investigating on reducing communication cost on the uplink, [205] takes both server-to-device (downlink) and device-to-server (uplink) communication into consideration.”
BackgroundA survey on security and privacy of federated learning
Mothukuri, V., Parizi, R. M., Pouriyeh, S., Huang, Y., Dehghantanha, A., & Srivastava, G. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.007 · Cited by 1,480 · see citing works
Sattler, F., Muller, K.-R., & Samek, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015958 · Cited by 1,355 · see citing works
Abdulrahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030072 · Cited by 796 · see citing works
A Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774 · see citing works
Federated Learning: A Survey on Enabling Technologies, Protocols, and Applications
Aledhari, M., Razzak, R., Parizi, R. M., & Saeed, F. (2020) · IEEE Access · doi:10.1109/access.2020.3013541 · Cited by 733 · see citing works
Communication-efficient federated learning via knowledge distillation
Wu, C., Wu, F., Lyu, L., Huang, Y., & Xie, X. (2022) · Nature Communications · doi:10.1038/s41467-022-29763-x · Cited by 626 · see citing works
Model Pruning Enables Efficient Federated Learning on Edge Devices
Jiang, Y., Wang, S., Valls, V., Ko, B. J., Lee, W., Leung, K. K., & Tassiulas, L. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3166101 · Cited by 594 · see citing works
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gündüz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 558 · see citing works
Wahab, O. A., Mourad, A., Otrok, H., & Taleb, T. (2021) · IEEE Communications Surveys and Tutorials · doi:10.1109/comst.2021.3058573 · Cited by 444 · see citing works
Luo, S., Chen, X., Wu, Q., Zhou, Z., & Yu, S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3003744 · Cited by 456 · see citing works
Improving Federated Learning Personalization via Model Agnostic Meta Learning
Jiang, Y., Konečný, J., Rush, K., & Kannan, S. (2019) · arXiv · doi:10.48550/arxiv.1909.12488 · Cited by 381 · see citing works
“We suggest these objectives become the subject of MAML works, in addition to the performance after adaptation, and to consider the datasets with a natural user/client structure being established for Federated Learning (Caldas et al., 2018b) as the source of experiments for supervised learning.”
BackgroundMethodInfluentialThink Locally, Act Globally: Federated Learning with Local and Global RepresentationsPreprint
Liang, P. P., Liu, T., Ziyin, L., Allen, N. B., Auerbach, R. P., Brent, D., Salakhutdinov, R., & Morency, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.01523 · Cited by 375 · see citing works
From distributed machine learning to federated learning: a survey
Liu, J., Huang, J., Zhou, Y., Li, X., Ji, S., Xiong, H., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01664-x · Cited by 374 · see citing works
FedMCCS: Multicriteria Client Selection Model for Optimal IoT Federated Learning
AbdulRahman, S., Tout, H., Mourad, A., & Talhi, C. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3028742 · Cited by 323 · see citing works
Communication-Efficient Federated Learning for Digital Twin Edge Networks in Industrial IoT
Lu, Y., Huang, X., Zhang, K., Maharjan, S., & Zhang, Y. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3010798 · Cited by 316 · see citing works
A survey of federated learning for edge computing: Research problems and solutions
Xia, Q., Ye, W., Tao, Z., Wu, J., & Li, Q. (2021) · High-Confidence Computing · doi:10.1016/j.hcc.2021.100008 · Cited by 290 · see citing works
Blockchain-enabled Federated Learning: A Survey
Qu, Y., Uddin, M. P., Gan, C., Xiang, Y., Gao, L., & Yearwood, J. (2023) · ACM Computing Surveys · doi:10.1145/3524104 · Cited by 286 · see citing works
Edge Intelligence: Empowering Intelligence to the Edge of Network
Xu, D., Li, T., Li, Y., Su, X. J., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 281 · see citing works
Vulnerabilities in federated learning
Bouacida, N., & Mohapatra, P. (2021) · IEEE Access · doi:10.1109/access.2021.3075203 · Cited by 248 · see citing works
Recent advances on federated learning: A systematic survey
Liu, B., Lv, N., Guo, Y., & Li, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128019 · Cited by 244 · see citing works
Design and Analysis of Uplink and Downlink Communications for Federated Learning
Zheng, S., Shen, C., & Chen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041388 · Cited by 191 · see citing works
Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach
Han, P., Wang, S., & Leung, K. K. (2020) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs47774.2020.00026 · Cited by 191 · see citing works
BaFFLe: Backdoor Detection via Feedback-based Federated Learning
Andreina, S., Marson, G. A., Mollering, H., & Karame, G. (2021) · 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs51616.2021.00086 · Cited by 205 · see citing works
Decentralized Federated Learning: A Survey on Security and Privacy
Hallaji, E., Razavi‐Far, R., Saif, M., Wang, B., & Yang, Q. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3362191 · Cited by 191 · see citing works
Handling privacy-sensitive medical data with federated learning: Challenges and future directions
Aouedi, O., Sacco, A., Piamrat, K., & Marchetto, G. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3185673 · Cited by 165 · see citing works
Duan, Q., Huang, J., Hu, S., Deng, R., Lu, Z., & Yu, S. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3316615 · Cited by 175 · see citing works
Communication and computation efficiency in Federated Learning: A survey
Almanifi, O. R. A., Chow, C., Tham, M.-L., Chuah, J. H., & Kanesan, J. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100742 · Cited by 169 · see citing works
Tighter Theory for Local SGD on Identical and Heterogeneous Data
Khaled, A., Mishchenko, K., & Richtárik, P. (2019) · arXiv · doi:10.48550/arxiv.1909.04746 · Cited by 162 · see citing works
Towards Fairness-Aware Federated Learning
Shi, Y., Yu, H., & Leung, C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3263594 · Cited by 163 · see citing works
Challenges, Applications and Design Aspects of Federated Learning: A Survey
Rahman, K. M. J., Ahmed, F., Akhter, N., Hasan, M., Amin, R., Aziz, K. E., Islam, A. K. M. M., Mukta, M. S. H., & Islam, A. K. M. N. (2021) · IEEE Access · doi:10.1109/access.2021.3111118 · Cited by 147 · see citing works
Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications
Cai, H., Lin, J., Lin, Y., Liu, Z., Tang, H., Wang, H., Zhu, L., & Han, S. (2022) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3486618 · Cited by 152 · see citing works
FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered DropoutPreprint
Horváth, S., Laskaridis, S., Almeida, M., Ilias Leontiadis, A., Venieris, S. I., & Lane, N. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13451 · Cited by 140 · see citing works
Model Compression for Communication Efficient Federated Learning
Shah, S. M., & Lau, V. K. N. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3131614 · Cited by 129 · see citing works
Edge Intelligence: Architectures, Challenges, and ApplicationsPreprint
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12172 · Cited by 184 · see citing works
Federated Learning for Computationally Constrained Heterogeneous Devices: A Survey
Pfeiffer, K., Rapp, M., Khalili, R., & Henkel, J. (2023) · ACM Computing Surveys · doi:10.1145/3596907 · Cited by 125 · see citing works
Xu, W., Fang, W., Ding, Y., Zou, M., & Xiong, N. (2021) · IEEE Access · doi:10.1109/access.2021.3063291 · Cited by 112 · see citing works
Federated Learning With Quantized Global Model UpdatesPreprint
Amiri, M. M., Gündüz, D., Kulkarni, S. R., & Poor, H. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10672 · Cited by 111 · see citing works
On Demand Fog Federations for Horizontal Federated Learning in IoV
Hammoud, A., Otrok, H., Mourad, A., & Dziong, Z. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3172370 · Cited by 110 · see citing works
Cui, Y., Cao, K., Cao, G., Meikang Qiu, A., & Wei, T. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2021.3110743 · Cited by 105 · see citing works
Computation and Communication Efficient Federated Learning With Adaptive Model Pruning
Jiang, Z., Xu, Y., Xu, H., Wang, Z., Liu, J., Qian, C., & Qiao, C. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3247798 · Cited by 105 · see citing works
A Survey on Securing Federated Learning: Analysis of Applications, Attacks, Challenges, and Trends
Neto, H. N. C., Hribar, J., Dusparić, I., Mattos, D. M. F., & Fernandes, N. C. (2023) · IEEE Access · doi:10.1109/access.2023.3269980 · Cited by 108 · see citing works
Active Federated LearningPreprint
Goetz, J., Malik, K., Bui, D. V., Moon, S., Liu, H., & Kumar, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12641 · Cited by 98 · see citing works
Towards Faster and Better Federated Learning: A Feature Fusion Approach
Yao, X., Huang, T., Wu, C., Zhang, R.-X., & Sun, L. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803001 · Cited by 97 · see citing works
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning
Karimireddy, S. P., Jaggi, M., Kale, S., Mohri, M., Reddi, S. J., Stich, S. U., & Suresh, A. T. (2020) · arXiv · doi:10.48550/arxiv.2008.03606 · Cited by 96 · see citing works
Prakash, P., Ding, J., Chen, R., Qin, X., Shu, M., Cui, Q., Guo, Y., & Pan, M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3145865 · Cited by 95 · see citing works
Improving Semi-supervised Federated Learning by Reducing the Gradient Diversity of Models
Zhang, Z. J., Yang, Y. L., Yao, Z., Yan, Y., Gonzalez, J. E., Ramchandran, K., & Mahoney, M. W. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671693 · Cited by 104 · see citing works
Zhang, L., Luo, Y., Bai, Y., Du, B., & Duan, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00438 · Cited by 92 · see citing works
FedMP: Federated Learning through Adaptive Model Pruning in Heterogeneous Edge Computing
Jiang, Z., Xu, Y., Xu, H., Wang, Z., Qiao, C., & Zhao, Y. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00062 · Cited by 92 · see citing works
No One Left Behind: Inclusive Federated Learning over Heterogeneous Devices
Liu, R., Wu, F., Wu, C., Wang, Y., Lyu, L., Chen, H., & Xie, X. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539086 · Cited by 91 · see citing works
Federated Learning Over Noisy Channels: Convergence Analysis and Design Examples
Wei, X., & Shen, C. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3140788 · Cited by 90 · see citing works
Budgeted Online Selection of Candidate IoT Clients to Participate in Federated Learning
Mohammed, I., Tabatabai, S., Al‐Fuqaha, A., Bouanani, F. E., Qadir, J., Qolomany, B., & Guizani, M. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3036157 · Cited by 89 · see citing works
Communication-Efficient Federated Learning via Optimal Client Sampling
Ribero, M., & Vikalo, H. (2020) · LatinX in AI at International Conference on Machine Learning (LXAI) · doi:10.52591/lxai2020071310 · Cited by 87 · see citing works
Real-Time Federated Evolutionary Neural Architecture Search
Zhu, H., & Jin, Y. (2021) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2021.3099448 · Cited by 89 · see citing works
Federated Learning with Autotuned Communication-Efficient Secure Aggregation
Bonawitz, K., Salehi, F., Konečný, J., McMahan, H. B., & Gruteser, M. (2019) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf44664.2019.9049066 · Cited by 83 · see citing works
Self-citationArtificial Intelligence of Things: A Survey
Siam, M. S. I., Ahn, H., Liu, L., Alam, S., Shen, H., Cao, Z., Shroff, N. B., Krishnamachari, B., Srivastava, M. B., & Zhang, M. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3690639 · Cited by 90 · see citing works
Bouacida, N., Hou, J., Zang, H., & Liu, X. (2021) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps51825.2021.9484526 · Cited by 82 · see citing works
Convergence of Federated Learning Over a Noisy Downlink
Amiri, M., Gündüz, D., Kulkarni, S., & Poor, H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3103874 · Cited by 89 · see citing works
CFD: Communication-Efficient Federated Distillation via Soft-Label Quantization and Delta Coding
Sattler, F., Marbán, A., Rischke, R., & Samek, W. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3081748 · Cited by 132 · see citing works
Breaking the Communication-Privacy-Accuracy Trilemma
Chen, W., Kairouz, P., & Özgür, A. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3218772 · Cited by 79 · see citing works
Joint Device Selection and Power Control for Wireless Federated Learning
Guo, W. M., Li, R., Huang, C. Z., Qin, X., Shen, K., & Zhang, W. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3180807 · Cited by 77 · see citing works
FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems
Li, L., Duan, M., Liu, D., Zhang, Y., Ren, A., Chen, X., Tan, Y., & Wang, C. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533876 · Cited by 73 · see citing works
Helios: Heterogeneity-Aware Federated Learning with Dynamically Balanced Collaboration
Xu, Z., Yu, F., Xiong, J., & Chen, X. (2021) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586241 · Cited by 72 · see citing works
Joint Client Selection and Bandwidth Allocation Algorithm for Federated Learning
Ko, H., Lee, J., Seo, S., Pack, S., & Leung, V. C. M. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3136611 · Cited by 70 · see citing works
Evaluating the Communication Efficiency in Federated Learning Algorithms
Asad, M., Moustafa, A., Itō, T., & Aslam, M. (2021) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd49262.2021.9437738 · Cited by 68 · see citing works
Throughput-Optimal Topology Design for Cross-Silo Federated LearningPreprint
Marfoq, O., Xu, C., Neglia, G., & Vidal, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12229 · Cited by 70 · see citing works
Blockchain-Enabled Asynchronous Federated Learning in Edge Computing
Liu, Y., Qu, Y., Xu, C., Hao, Z., & Gu, B. (2021) · Sensors · doi:10.3390/s21103335 · Cited by 65 · see citing works
An Overview of Federated Deep Learning Privacy Attacks and Defensive Strategies
Enthoven, D., & Al-Ars, Z. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-70604-3_8 · Cited by 61 · see citing works
FedPacket: A Federated Learning Approach to Mobile Packet Classification
Bakopoulou, E., Tillman, B., & Markopoulou, A. P. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3058627 · Cited by 84 · see citing works
Communication Efficient Federated Learning with Energy Awareness over Wireless Networks
Jin, R., He, X.-F., & Dai, H.-Y. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3138394 · Cited by 31 · see citing works
Time Efficient Federated Learning with Semi-asynchronous Communication
Hao, J., Zhao, Y., & Zhang, J. (2020) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads51040.2020.00030 · Cited by 53 · see citing works
Federated Learning with Unbiased Gradient Aggregation and Controllable Meta UpdatingPreprint
Yao, X., Huang, T., Zhang, R.-X., Li, R., & Sun, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.08234 · Cited by 53 · see citing works
Wireless Quantized Federated Learning: A Joint Computation and Communication Design
Bouzinis, P. S., Diamantoulakis, P. D., & Karagiannidis, G. K. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2023.3258485 · Cited by 52 · see citing works
Federated Learning Under Importance Sampling
Rizk, E., Vlaski, S., & Sayed, A. H. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3210365 · Cited by 52 · see citing works
Managing Distributed Machine Learning Lifecycle for Healthcare Data in the Cloud
Zeydan, E., Arslan, Ş. S., & Liyanage, M. (2024) · IEEE Access · doi:10.1109/access.2024.3443520 · Cited by 54 · see citing works
Adam, M., & Baroudi, U. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3506214 · Cited by 46 · see citing works
Artificial Identification: A Novel Privacy Framework for Federated Learning Based on Blockchain
Ouyang, L., Wang, F., Tian, Y., Jia, X., Qi, H., & Wang, G. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3226861 · Cited by 46 · see citing works
Li, A., Marković, M., Edwards, P. J., & Leontidis, G. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122847 · Cited by 44 · see citing works
Fast-convergent federated learning with class-weighted aggregation
Ma, Z., Zhao, M., Cai, X., & Jia, Z. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2021.102125 · Cited by 43 · see citing works
Inter-Server Collaborative Federated Learning for Ultra-Dense Edge Computing
Guo, H., Huang, W., Liu, J., & Wang, Y. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3137843 · Cited by 43 · see citing works
Wen, H., Wu, Y., Yang, C., Duan, H., & Yu, S. (2020) · IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps50562.2020.9162672 · Cited by 41 · see citing works
A Survey on Blockchain-Based Federated Learning
Wu, L., Ruan, W., Hu, J., & He, Y. (2023) · Future Internet · doi:10.3390/fi15120400 · Cited by 48 · see citing works
Federated User Representation LearningPreprint
Bui, D., Malik, K., Goetz, J., Liu, H., Moon, S., Kumar, A., & Shin, K. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12535 · Cited by 41 · see citing works
Federated Learning Over Wireless Networks: Challenges and Solutions
Beitollahi, M., & Lu, N. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3285868 · Cited by 40 · see citing works
Adaptive Model Pruning for Communication and Computation Efficient Wireless Federated Learning
Chen, Z., Yi, W., Shin, H., & Nallanathan, A. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3342626 · Cited by 40 · see citing works
Privacy for Free: Communication-Efficient Learning with Differential Privacy Using SketchesPreprint
Li, T., Liu, Z., Sekar, V., & Smith, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00972 · Cited by 40 · see citing works
MP-FedCL: Multiprototype Federated Contrastive Learning for Edge Intelligence
Qiao, Y., Munir, M. S., Adhikary, A., Le, H. Q., Raha, A. D., Zhang, C., & Hong, C. S. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3320250 · Cited by 39 · see citing works
FedLP: Layer-Wise Pruning Mechanism for Communication-Computation Efficient Federated Learning
Zhu, Z., Shi, Y., Luo, J., Fei, W., Peng, C., Fan, P., & Letaief, K. B. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10278563 · Cited by 39 · see citing works
Fairness and Accuracy in Federated LearningPreprint
Huang, W. X., Li, T., Wang, D., Du, S., & Zhang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10069 · Cited by 38 · see citing works
FedPE: Adaptive Model Pruning-Expanding for Federated Learning on Mobile Devices
Yi, L., Shi, X., Wang, N., Zhang, J., Wang, G., & Liu, X. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3374706 · Cited by 37 · see citing works
Wireless for Machine Learning: A Survey
Hellström, H., da Silva, J. M. B., Amiri, M. M., Chen, M., Fodor, V., Poor, H. V., & Fischione, C. (2022) · doi:10.1561/9781638280071 · Cited by 52 · see citing works
Reducing communication in federated learning via efficient client sampling
Ribero, M., & Vikalo, H. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110122 · Cited by 35 · see citing works
Federated Learning with Additional Mechanisms on Clients to Reduce Communication CostsPreprint
Yao, X., Huang, T., Wu, C., Zhang, R.-X., & Sun, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.05891 · Cited by 44 · see citing works
Faster On-Device Training Using New Federated Momentum AlgorithmPreprint
Huo, Z., Yang, Q., Gu, B., & Huang, L. C. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02090 · Cited by 35 · see citing works
Reducing Communication Overhead of Federated Learning through Clustering Analysis
Al-Saedi, A. A., Boeva, V., & Casalicchio, E. (2021) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc53001.2021.9631391 · Cited by 34 · see citing works
- Authors
- Caldas, S., Konečny, J., McMahan, H. B., & Talwalkar, A.
- Affiliations
- Google (United States) (US)
- Carnegie Mellon University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.07210
- OpenAlex
- W2905444686
- Cited by
- 312
- References
- 24
- Citations by year
- 2025: 16 · 2024: 54 · 2023: 54 · 2022: 53 · 2021: 72 · 2020: 47 · 2019: 16
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1838017, 1705121)
- Amazon Web Services
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Keywords
- federated learning, communication cost reduction, edge networks, heterogeneous edge networks, user participation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
