The DOI matches its DataCite record; 42 of the 45 references it cites were found in a registry or an index.
Adaptive Federated Optimization
Open accessAbstract
Federated learning is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. Standard federated optimization methods such as Federated Averaging (FedAvg) are often difficult to tune and exhibit unfavorable convergence behavior. In non-federated settings, adaptive optimization methods have had notable success in combating such issues. In this work, we propose federated versions of adaptive optimizers, including Adagrad, Adam, and Yogi, and analyze their convergence in the presence of heterogeneous data for general non-convex settings. Our results highlight the interplay between client heterogeneity and communication efficiency. We also perform extensive experiments on these methods and show that the use of adaptive optimizers can significantly improve the performance of federated learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“MPC approaches to PIR break down into two main categories: computational PIR (cPIR), in which a single party can execute the entire server side of the protocol [286], and information theoretic PIR (itPIR), in which multiple non-colluding parties are required to execute the server side of the protocol [121].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [121]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Self-citation(2010) · Cited by 8,261
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationFederated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
Self-citationWu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
EMNIST: Extending MNIST to handwritten letters
Cohen, G., Afshar, S., Tapson, J. C., & André, V. S. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966217 · Cited by 2,410
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Self-citation
Research works printed but not linked: 3
- Debraj Basu, Deepesh Data, Can Karakus, and Suhas Diggavi. Qsparse-local-SGD: Distributed SGD with quantization, sparsification and local computations. In Advances in Neural Information Processing Systems , pp. 14668-14679, 2019.
- Aaron Defazio and Léon Bottou. On the ineffectiveness of variance reduced optimization for deep learning. arXiv preprint arXiv:1812.04529 , 2018. · arXiv
- H. Brendan McMahan and Matthew J. Streeter. Adaptive bound optimization for online convex optimization. In COLT The 23rd Conference on Learning Theory , 2010b.
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationA Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
Federated Learning on Non-IID Data Silos: An Experimental Study
Li, Q., Diao, Y., Chen, Q., & He, B. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00077 · Cited by 1,407
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization
Wang, J., Liu, Q., Liang, H., Joshi, G., & Poor, H. V. (2020) · arXiv · doi:10.48550/arxiv.2007.07481 · Cited by 927
Robust Aggregation for Federated Learning
Pillutla, K., Kakade, S. M., & Harchaoui, Z. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3153135 · Cited by 1,068
Inverting Gradients -- How easy is it to break privacy in federated learning?Preprint
Geiping, J., Bauermeister, H., Dröge, H., & Moeller, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.14053 · Cited by 848
Federated Learning: A Survey on Enabling Technologies, Protocols, and Applications
Aledhari, M., Razzak, R., Parizi, R. M., & Saeed, F. (2020) · IEEE Access · doi:10.1109/access.2020.3013541 · Cited by 733
Ensemble Distillation for Robust Model Fusion in Federated LearningPreprint
Lin, T., Kong, L., Stich, S. U., & Jaggi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07242 · Cited by 761
Personalized Federated Learning with Moreau EnvelopesPreprint
Dinh, C. T., Tran, N. H. K., & Nguyen, T. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08848 · Cited by 697
FedBN: Federated Learning on Non-IID Features via Local Batch NormalizationPreprint
Li, X., Jiang, M., Zhang, X., Kamp, M., & Dou, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07623 · Cited by 855
End-to-end privacy preserving deep learning on multi-institutional medical imaging
Kaissis, G., Ziller, A., Passerat-Palmbach, J., Ryffel, T., Usynin, D., Trask, A., Lima, I., Mancuso, J., Jungmann, F., Steinborn, M.-M., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00337-8 · Cited by 513
Exploiting Shared Representations for Personalized Federated LearningPreprint
Collins, L., Hassani, H., Mokhtari, A., & Shakkottai, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07078 · Cited by 453
A state-of-the-art survey on solving non-IID data in Federated Learning
Ma, X., Zhu, J., Lin, Z., Chen, S., & Qin, Y. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.05.003 · Cited by 435
FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction
Gao, L., Fu, H., Li, L., Chen, Y., Xu, M., & Xu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00987 · Cited by 417
Decentralized Federated Averaging
Sun, T., Li, D., & Wang, B. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3196503 · Cited by 408
Federated Learning Based on Dynamic RegularizationPreprint
Acar, D. A. E., Zhao, Y., Navarro, R. M., Mattina, M., Whatmough, P. N., & Saligrama, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.04263 · Cited by 730
FedML: A Research Library and Benchmark for Federated Machine LearningPreprint
He, C., Li, S., So, J., Zeng, X., Zhang, M., Wang, H., Wang, X., Vepakomma, P., Singh, A., Qiu, H., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.13518 · Cited by 668
Client Selection in Federated Learning: Principles, Challenges, and Opportunities
Fu, L., Zhang, H., Gao, G., Zhang, M., & Liu, X. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3299573 · Cited by 343
Multi-Task Federated Learning for Personalised Deep Neural Networks in Edge Computing
Mills, J., Hu, J. W., & Min, G. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3098467 · Cited by 314
Cho, Y. J., Wang, J., & Joshi, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01243 · Cited by 302
Fast-Convergent Federated Learning
Nguyen, H. T., Sehwag, V., Hosseinalipour, S., Brinton, C. G., Chiang, M., & Poor, H. V. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036952 · Cited by 290
Group Knowledge Transfer: Federated Learning of Large CNNs at the EdgePreprint
He, C., Annavaram, M., & Avestimehr, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.14513 · Cited by 316
Shejwalkar, V., Houmansadr, A., Kairouz, P., & Ramage, D. (2022) · 2022 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46214.2022.9833647 · Cited by 292
End-Edge-Cloud Collaborative Computing for Deep Learning: A Comprehensive Survey
Wang, Y., Yang, C., Lan, S., Zhu, L., & Zhang, Y. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3393230 · Cited by 269
Chellapandi, V. P., Yuan, L., Brinton, C. G., Żak, S. H., & Wang, Z. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3332675 · Cited by 271
Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark
Huang, W., Ye, M., Shi, Z., Wan, G., He, L., Du, B., & Yang, Q. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3418862 · Cited by 280
AUCTION: Automated and Quality-Aware Client Selection Framework for Efficient Federated Learning
Deng, Y., Lyu, F., Ren, J., Wu, H., Zhou, Y., Zhang, Y., & Shen, X. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3134647 · Cited by 232
FairFed: Enabling Group Fairness in Federated Learning
Ezzeldin, Y. H., Yan, S., He, C., Ferrara, E., & Avestimehr, A. S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25911 · Cited by 209
Rethinking Federated Learning with Domain Shift: A Prototype View
Huang, W., Ye, M., Shi, Z., He, L., & Du, B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01565 · Cited by 217
Design and Analysis of Uplink and Downlink Communications for Federated Learning
Zheng, S., Shen, C., & Chen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041388 · Cited by 191
Federated Learning with Buffered Asynchronous AggregationPreprint
Nguyen, J., Malik, K., Zhan, H., Yousefpour, A., Rabbat, M., Esmaeili, M. M., & Huba, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06639 · Cited by 182
Differentially Private Learning with Adaptive ClippingPreprint
Andrew, G., Thakkar, O. D., McMahan, H. B., & Ramaswamy, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03871 · Cited by 226
Self-citationFederated Learning Meets Multi-Objective Optimization
Hu, Z., Shaloudegi, K., Zhang, G., & Yu, Y. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3169117 · Cited by 173
HarmoFL: Harmonizing Local and Global Drifts in Federated Learning on Heterogeneous Medical Images
Jiang, M., Wang, Z.-R., & Dou, Q. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19993 · Cited by 174
A multi-centre polyp detection and segmentation dataset for generalisability assessment
Ali, S., Jha, D., Ghatwary, N., Realdon, S., Cannizzaro, R., Salem, O. E., Lamarque, D., Daul, C., Riegler, M., Ånonsen, K., et al. (2021) · Scientific Data · doi:10.1038/s41597-023-01981-y · Cited by 192
Federated Learning for Internet of Things
Zhang, T., He, C., Ma, T., Gao, L., Ma, M., & Avestimehr, S. (2021) · Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/3485730.3493444 · Cited by 157
Data Heterogeneity-Robust Federated Learning via Group Client Selection in Industrial IoT
Li, Z., He, Y., Yu, H., Kang, J., Li, X., Xu, Z., & Niyato, D. T. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3161943 · Cited by 166
Applications of Federated Learning; Taxonomy, Challenges, and Research Trends
Shaheen, M., Farooq, M. S., Umer, T., & Kim, B.-S. (2022) · Electronics · doi:10.3390/electronics11040670 · Cited by 157
Bhavsar, M., Bekele, Y. B., Roy, K., Kelly, J. C., & Limbrick, D. B. (2024) · IEEE Access · doi:10.1109/access.2024.3386631 · Cited by 174
Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated LearningPreprint
Yang, H., Fang, M., & Liu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.11203 · Cited by 202
FedBE: Making Bayesian Model Ensemble Applicable to Federated LearningPreprint
Chen, H.-Y., & Chao, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01974 · Cited by 233
Challenges, Applications and Design Aspects of Federated Learning: A Survey
Rahman, K. M. J., Ahmed, F., Akhter, N., Hasan, M., Amin, R., Aziz, K. E., Islam, A. K. M. M., Mukta, M. S. H., & Islam, A. K. M. N. (2021) · IEEE Access · doi:10.1109/access.2021.3111118 · Cited by 147
Sáez-de-Cámara, X., Flores, J. L., Arellano, C., Urbieta, A., & Zurutuza, U. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103299 · Cited by 169
Adaptive Federated Learning on Non-IID Data With Resource Constraint
Zhang, J., Guo, S., Qu, Z., Zeng, D., Zhan, Y., Liu, Q., & Akerkar, R. A. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3099723 · Cited by 150
A Novel Framework for the Analysis and Design of Heterogeneous Federated Learning
Wang, J., Liu, Q., Liang, H., Joshi, G., & Poor, H. V. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3106104 · Cited by 1,165
Federated Learning with Compression: Unified Analysis and Sharp GuaranteesPreprint
Haddadpour, F., Kamani, M. M., Mokhtari, A., & Mahdavi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01154 · Cited by 140
Reisizadeh, A., Tziotis, I., Hassani, H., Mokhtari, A., & Pedarsani, R. (2022) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2022.3205475 · Cited by 137
Hu, R., Guo, Y., & Gong, Y. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3343288 · Cited by 147
FedCorr: Multi-Stage Federated Learning for Label Noise Correction
Xu, J., Chen, Z., Quek, T. Q. S., & Chong, K. F. E. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00994 · Cited by 133
FedTP: Federated Learning by Transformer Personalization
Li, H., Cai, Z., Wang, J., Tang, J., Ding, W., Lin, C., & Shi, Y. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3269062 · Cited by 134
Do Gradient Inversion Attacks Make Federated Learning Unsafe?
Hatamizadeh, A., Yin, H., Molchanov, P. A., Myronenko, A., Li, W., Dogra, P., Feng, A., Flores, M. G., Kautz, J., Xu, D., et al. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3239391 · Cited by 144
Differentially Private Federated Learning with Local Regularization and Sparsification
Cheng, A., Wang, P., Zhang, X. S., & Cheng, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00988 · Cited by 131
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learning
Sattler, F., Korjakow, T., Rischke, R., & Samek, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3129371 · Cited by 131
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks
Lin, B. Y., He, C., Ze, Z., Wang, H., Hua, Y., Dupuy, C., Gupta, R., Soltanolkotabi, M., Ren, X., & Avestimehr, S. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.13 · Cited by 138
Al-Quraan, M. M., Mohjazi, L., Bariah, L., Centeno, A., Zoha, A., Arshad, K., Assaleh, K. T., Muhaidat, S., Debbah, M. A., & Imran, M. A. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3251404 · Cited by 159
Fairness and privacy preserving in federated learning: A survey
Rafi, T. H., Noor, F. A., Hussain, T., & Chae, D. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102198 · Cited by 138
The distributed discrete gaussian mechanism for federated learning with secure aggregation
Kairouz, P., Liu, Z., & Steinke, T. (2021) · arXiv · doi:10.48550/arxiv.2102.06387 · Cited by 117
FedGraphNN: A Federated Learning System and Benchmark for Graph Neural NetworksPreprint
He, C., Balasubramanian, K., Ceyani, E., Yang, C., Xie, H., Sun, L., He, L., Yang, L., Yu, P. S., Rong, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07145 · Cited by 243
Reviewing Federated Machine Learning and Its Use in Diseases Prediction
Moshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2023) · Sensors · doi:10.3390/s23042112 · Cited by 114
Federated Learning and Meta Learning: Approaches, Applications, and Directions
Liu, X., Deng, Y., Nallanathan, A., & Bennis, M. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3330910 · Cited by 116
Cost-Effective Federated Learning in Mobile Edge Networks
Luo, B., Li, X., Wang, S., Huang, J., & Tassiulas, L. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118436 · Cited by 116
FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learning
Xiong, Y., Wang, R., Cheng, M., Yu, F., & Hsieh, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01566 · Cited by 119
FedGKD: Toward Heterogeneous Federated Learning via Global Knowledge Distillation
Yao, D., Pan, W., Dai, Y., Wan, Y., Ding, X., Chen, Y., Jin, H., Xu, Z., & Sun, L. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3315066 · Cited by 107
Make Landscape Flatter in Differentially Private Federated Learning
Shi, Y., Liu, Y., Wei, K., Shen, L., Wang, X., & Tao, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02352 · Cited by 113
Islam, A., Amin, A. A., & Shin, S. Y. (2022) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2022.3151873 · Cited by 104
ScaleFL: Resource-Adaptive Federated Learning with Heterogeneous Clients
Ilhan, F., Su, G., & Liu, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02350 · Cited by 113
Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better
Bibikar, S., Vikalo, H., Wang, Z., & Chen, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20555 · Cited by 114
Faster Adaptive Federated Learning
Wu, X., Huang, F., Hu, Z., & Huang, H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26235 · Cited by 107
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning
Karimireddy, S. P., Jaggi, M., Kale, S., Mohri, M., Reddi, S. J., Stich, S. U., & Suresh, A. T. (2020) · arXiv · doi:10.48550/arxiv.2008.03606 · Cited by 96
Self-citationImproving Semi-supervised Federated Learning by Reducing the Gradient Diversity of Models
Zhang, Z. J., Yang, Y. L., Yao, Z., Yan, Y., Gonzalez, J. E., Ramchandran, K., & Mahoney, M. W. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671693 · Cited by 120
Improving Generalization in Federated Learning by Seeking Flat Minima
Caldarola, D., Barbara Caputo, B., & Ciccone, M. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20050-2_38 · Cited by 92
No One Left Behind: Inclusive Federated Learning over Heterogeneous Devices
Liu, R., Wu, F., Wu, C., Wang, Y., Lyu, L., Chen, H., & Xie, X. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539086 · Cited by 99
A Golden Decade of Deep Learning: Computing Systems & Applications
Dean, J. (2022) · Daedalus · doi:10.1162/daed_a_01900 · Cited by 107
Personalized Federated Learning With a Graph
Chen, F., Long, G., Wu, Z., Zhou, T., & Jiang, J. B. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/357 · Cited by 94
Communication-Efficient Federated Learning via Optimal Client Sampling
Ribero, M., & Vikalo, H. (2020) · LatinX in AI at International Conference on Machine Learning (LXAI) · doi:10.52591/lxai2020071310 · Cited by 87
Federated Learning With Spiking Neural Networks
Venkatesha, Y., Kim, Y., Tassiulas, L., & Panda, P. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3121632 · Cited by 91
FedScale: Benchmarking Model and System Performance of Federated Learning at ScalePreprint
Lai, F., Dai, Y., Singapuram, S. S. V., Liu, J., Zhu, X., Madhyastha, H. V., & Chowdhury, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.11367 · Cited by 103
Advancements in Physics-Informed Neural Networks for Laminated Composites: A Comprehensive Review
Khalid, S., Yazdani, M. H., Azad, M. M., Elahi, M. U., Raouf, I., & Kim, H. S. (2024) · Mathematics · doi:10.3390/math13010017 · Cited by 86
Federated Learning for Privacy-Preserving Open Innovation Future on Digital Health
Long, G., Shen, T., Tan, Y., Gerrard, L., Clarke, A., & Jiang, J. (2022) · Humanity Driven AI · doi:10.1007/978-3-030-72188-6_6 · Cited by 85
Zhou, T., Zhang, J., & Tsang, D. H. K. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3325366 · Cited by 106
Federated learning for 5G base station traffic forecasting
Perifanis, V., Pavlidis, N., Koutsiamanis, R.-A., & Efraimidis, P. S. (2023) · Computer Networks · doi:10.1016/j.comnet.2023.109950 · Cited by 87
Qiao, C., Li, M., Liu, Y., & Tian, Z. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3399612 · Cited by 92
A review on federated learning towards image processing
Khokhar, F. A., Shah, J. H., Khan, M. A., Sharif, M. I., Tariq, U., & Kadry, S. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.107818 · Cited by 82
Distilled One-Shot Federated LearningPreprint
Zhou, Y., Pu, G., Ma, X., Li, X., & Wu, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07999 · Cited by 166
Fair Federated Medical Image Segmentation via Client Contribution Estimation
Jiang, M., Roth, H. R., Li, W., Yang, D. L., Zhao, C. H., Nath, V., Xu, D., Dou, Q., & Xu, Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01564 · Cited by 86
Federated Reconstruction: Partially Local Federated LearningPreprint
Singhal, K., Sidahmed, H., Garrett, Z., Wu, S., Rush, K., & Prakash, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03448 · Cited by 78
Self-citationLayer-Wise Adaptive Model Aggregation for Scalable Federated Learning
Lee, S., Zhang, T., & Avestimehr, A. S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26023 · Cited by 84
Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentation
Xu, A. P., Li, W., Guo, P., Yang, D., Roth, H. R., Hatamizadeh, A., Zhao, C., Xu, D., Huang, H., & Xu, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02020 · Cited by 77
Cho, Y. J., Wang, J., Chirvolu, T., & Joshi, G. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3231527 · Cited by 100
Training Speech Recognition Models with Federated Learning: A Quality/Cost Framework
Guliani, D., Beaufays, F., & Motta, G. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413397 · Cited by 76
Mora, A., Bujari, A., & Bellavista, P. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.03.027 · Cited by 81
Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD
Wang, J., Wang, S., Chen, R., & Ji, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20832 · Cited by 73
FedSeg: Class-Heterogeneous Federated Learning for Semantic Segmentation
Miao, J., Yang, Z., Fan, L., & Yang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00777 · Cited by 75
Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics
Romandini, N., Mora, A., Mazzocca, C., Montanari, R., & Bellavista, P. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3478334 · Cited by 76
Integration of large language models and federated learning
Chen, C., Feng, X., Li, Y., Lyu, L., Zhou, J., Zheng, X., & Yin, J. (2024) · Patterns · doi:10.1016/j.patter.2024.101098 · Cited by 140
Papaya: Practical, Private, and Scalable Federated LearningPreprint
Huba, D., Nguyen, J., Malik, K., Zhu, R., Rabbat, M., Yousefpour, A., Wu, C.-J., Zhan, H., Ustinov, P., Srinivas, H., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.04877 · Cited by 79
A Review of Federated Learning Applications in Intrusion Detection Systems
Belenguer, A., Pascual, J. A., & Navaridas, J. (2025) · Computer Networks · doi:10.1016/j.comnet.2024.111023 · Cited by 134
FedDrive: Generalizing Federated Learning to Semantic Segmentation in Autonomous Driving
Fantauzzo, L., Fanì, E., Caldarola, D., Tavera, A., Cermelli, F., Ciccone, M., & Barbara Caputo, B. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981098 · Cited by 68
The Internet of Federated Things (IoFT)
Kontar, R. A., Shi, N., Yue, X., Chung, S., Byon, E., Chowdhury, M., Jin, J. J., Kontar, W., Masoud, N., Nouiehed, M., et al. (2021) · IEEE Access · doi:10.1109/access.2021.3127448 · Cited by 72
Convergence Analysis and System Design for Federated Learning Over Wireless Networks
Wan, S., Lu, J., Fan, P., Shao, Y., Peng, C., & Letaief, K. B. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118351 · Cited by 65
Metadata
- Authors
- Reddi, S., Charles, Z., Zaheer, M., Garrett, Z., Rush, K., Konečný, J., Kumar, S., & McMahan, H. B.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2003.00295
- OpenAlex
- W3008187686
- Cited by
- 840
- References
- 45
- Citations by year
- 2026: 10 · 2025: 127 · 2024: 233 · 2023: 222 · 2022: 120 · 2021: 92 · 2020: 35
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated learning, adaptive optimization, FedAvg, AdaGrad, Adam, yogis, convergence analysis, non-convex optimization, client heterogeneity, communication efficiency, distributed learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
