The DOI matches its DataCite record; 42 of the 45 references it cites were found in a registry or an index.
Adaptive Federated Optimization
Open accessAbstract
Federated learning is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. Standard federated optimization methods such as Federated Averaging (FedAvg) are often difficult to tune and exhibit unfavorable convergence behavior. In non-federated settings, adaptive optimization methods have had notable success in combating such issues. In this work, we propose federated versions of adaptive optimizers, including Adagrad, Adam, and Yogi, and analyze their convergence in the presence of heterogeneous data for general non-convex settings. Our results highlight the interplay between client heterogeneity and communication efficiency. We also perform extensive experiments on these methods and show that the use of adaptive optimizers can significantly improve the performance of federated learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“MPC approaches to PIR break down into two main categories: computational PIR (cPIR), in which a single party can execute the entire server side of the protocol [286], and information theoretic PIR (itPIR), in which multiple non-colluding parties are required to execute the server side of the protocol [121].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [121]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Self-citation(2010) · Cited by 8,261
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationFederated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
Self-citationWu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
EMNIST: Extending MNIST to handwritten letters
Cohen, G., Afshar, S., Tapson, J. C., & André, V. S. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966217 · Cited by 2,410
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Self-citation
Research works printed but not linked: 3
- Debraj Basu, Deepesh Data, Can Karakus, and Suhas Diggavi. Qsparse-local-SGD: Distributed SGD with quantization, sparsification and local computations. In Advances in Neural Information Processing Systems , pp. 14668-14679, 2019.
- Aaron Defazio and Léon Bottou. On the ineffectiveness of variance reduced optimization for deep learning. arXiv preprint arXiv:1812.04529 , 2018. · arXiv
- H. Brendan McMahan and Matthew J. Streeter. Adaptive bound optimization for online convex optimization. In COLT The 23rd Conference on Learning Theory , 2010b.
Cited by
Sorted by citations
Items 101–200 of 844
An Approach for Peer-to-Peer Federated Learning
Wink, T., & Nochta, Z. (2021) · International Conference on Dependable Systems and Networks workshops · doi:10.1109/dsn-w52860.2021.00034 · Cited by 70
A survey for federated learning evaluations: Goals and measures
Chai, D., Wang, L., Yang, L., Zhang, J., Chen, K., & Yang, Q. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3382002 · Cited by 64
A first look into the carbon footprint of federated learningPreprint
Qiu, X., Parcollet, T., Fernandez-Marques, J., de Gusmao, P. P. B., Gao, Y., Beutel, D. J., Topal, T., Mathur, A., & Lane, N. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07627 · Cited by 88
Differentially private knowledge transfer for federated learning
Qi, T., Wu, F., Wu, C., He, L., Huang, Y., & Xie, X. (2023) · Nature Communications · doi:10.1038/s41467-023-38794-x · Cited by 65
Adaptive Resource Optimized Edge Federated Learning in Real-Time Image Sensing Classifications
Tam, P., Math, S., Nam, C., & Kim, S. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3120724 · Cited by 61
Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints
Ribero, M., Vikalo, H., & Veciana, G. A. D. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3224590 · Cited by 60
EasyFL: A Low-Code Federated Learning Platform for Dummies
Zhuang, W., Gan, X., Wen, Y., & Zhang, S. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3143842 · Cited by 66
HFedMS: Heterogeneous Federated Learning With Memorable Data Semantics in Industrial Metaverse
Zeng, S., Li, Z., Yu, H., Zhang, Z., Luo, L., Li, B., & Niyato, D. T. (2023) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2023.3254587 · Cited by 59
Federated Graph Semantic and Structural Learning
Huang, W., Wan, G., Ye, M., & Du, B. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/426 · Cited by 64
A Survey of Federated Learning for Connected and Automated Vehicles
Chellapandi, V. P., Yuan, L., Żak, S. H., & Wang, Z. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10421974 · Cited by 72
On the Vulnerability of Backdoor Defenses for Federated Learning
Fang, P. C., & Chen, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26393 · Cited by 57
Federated Deep Learning for Intrusion Detection in IoT Networks
Belarbi, O., Spyridopoulos, T., Anthi, E., Mavromatis, I., Carnelli, P., & Khan, A. (2023) · Globecom · doi:10.1109/globecom54140.2023.10437860 · Cited by 69
Communication-Efficient Federated Learning with Accelerated Client Gradient
Kim, G., Kim, J., & Han, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01177 · Cited by 57
Ji, Y., & Chen, L. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3213650 · Cited by 61
Scalable and Low-Latency Federated Learning With Cooperative Mobile Edge Networking
Zhang, Z., Gao, Z., Guo, Y., & Gong, Y. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3216837 · Cited by 55
ACS: Accuracy-based client selection mechanism for federated industrial IoT
Putra, M. A. P., Putri, A. R., Zainudin, A., Kim, D., & Lee, J. (2022) · Internet of Things · doi:10.1016/j.iot.2022.100657 · Cited by 55
FedCluster: Boosting the Convergence of Federated Learning via Cluster-Cycling
Chen, C., Chen, Z., Zhou, Y., & Kailkhura, B. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9377960 · Cited by 62
Efficient-FedRec: Efficient Federated Learning Framework for Privacy-Preserving News Recommendation
Yi, J., Wu, F., Wu, C., Liu, R., Sun, G., & Xie, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.223 · Cited by 68
Luo, K., Li, X., Lan, Y., & Gao, M. Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00361 · Cited by 57
Federated Learning via Posterior Averaging: A New Perspective and Practical AlgorithmsPreprint
Al-Shedivat, M., Gillenwater, J., Xing, E. P., & Rostamizadeh, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05273 · Cited by 54
Training Keyword Spotting Models on Non-IID Data with Federated Learning
Hard, A., Partridge, K., Nguyen, C., Subrahmanya, N., Shah, A., Zhu, P., Moreno, I. L., & Mathews, R. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-3023 · Cited by 53
Elastic Aggregation for Federated Optimization
Chen, D., Hu, J., Tan, V. J., Wei, X., & Wu, E. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01173 · Cited by 56
Makris, I., Karampasi, A. S., Grammatikis, P. I. R., Episkopos, N., Iturbe, E., Rios, E., Piperigkos, N., Lalos, A. S., Xenakis, C., Λάγκας, Θ., et al. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100717 · Cited by 67
Pretraining Federated Text Models for Next Word Prediction
Stremmel, J., & Singh, A. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-73103-8_34 · Cited by 53
Optimization Strategies for Client Drift in Federated Learning: A review
Shi, Y., Zhang, Y., Yang, X., & Niu, L. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.11.292 · Cited by 52
FedICT: Federated Multi-Task Distillation for Multi-Access Edge Computing
Wu, Z., Sun, S., Wang, Y., Liu, M., Pan, Q., Jiang, X., & Gao, B. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3289444 · Cited by 60
Practical and private (deep) learning without sampling or shuffling
Kairouz, P., McMahan, B., Song, S., Thakkar, O., Thakurta, A., & Xu, Z. (2021) · arXiv · doi:10.48550/arxiv.2103.00039 · Cited by 52
Self-citationTimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Training
Zhang, T., Gao, L., Lee, S., Zhang, M., & Avestimehr, S. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00535 · Cited by 51
Shi, N., Lai, F., Kontar, R. A., & Chowdhury, M. (2023) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3269639 · Cited by 50
Massive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning
Qiao, L., Gao, Z., Mashhadi, M. B., & Gündüz, D. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3431572 · Cited by 73
FedLGA: Toward System-Heterogeneity of Federated Learning via Local Gradient Approximation
Li, X., Qu, Z., Tang, B., & Lu, Z. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2023.3247365 · Cited by 49
Federated learning: A cutting-edge survey of the latest advancements and applications
Akhtarshenas, A., Vahedifar, M. A., Ayoobi, N., Maham, B., Alizadeh, T., Ebrahimi, S., & López-Pérez, D. (2024) · Computer Communications · doi:10.1016/j.comcom.2024.107964 · Cited by 53
Federated learning of molecular properties with graph neural networks in a heterogeneous setting
Zhu, W., Luo, J., & White, A. D. (2022) · Patterns · doi:10.1016/j.patter.2022.100521 · Cited by 55
Xu, Z., Zhao, D., Liang, W., RANA, O. F., Zhou, P., Li, M., Xu, W., Li, H., & Xia, Q. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3218807 · Cited by 52
Kröger, T., Belnarsch, A., Bilfinger, P., Ratzke, W., & Lienkamp, M. (2023) · eTransportation · doi:10.1016/j.etran.2023.100294 · Cited by 49
A Review of Client Selection Methods in Federated Learning
Mayhoub, S., & M. Shami, T. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-10011-4 · Cited by 47
Federated Graph Learning under Domain Shift with Generalizable Prototypes
Wan, G., Huang, W., & Ye, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29468 · Cited by 47
Entropy to Mitigate Non-IID Data Problem on Federated Learning for the Edge Intelligence Environment
Orlandi, F. C., dos Anjos, J. C. S., Leithardt, V. R. Q., Paz, J. F. D., & Geyer, C. F. R. (2023) · IEEE Access · doi:10.1109/access.2023.3298704 · Cited by 54
Chen, L., Ding, X., Bao, Z., Zhou, P., & Jin, H. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3379001 · Cited by 50
Adaptive knowledge transfer using federated deep learning for plant disease detection
Hari, P., & Singh, M. P. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109720 · Cited by 46
FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated LearningPreprint
Jiang, Z., Wang, W., & Liu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.00675 · Cited by 78
FedCV: A Federated Learning Framework for Diverse Computer Vision TasksPreprint
He, C., Shah, A., Tang, Z., Sivashunmugam, D. F. N., Bhogaraju, K., Shimpi, M., Shen, L., Chu, X., Soltanolkotabi, M., & Avestimehr, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.11066 · Cited by 92
Chiaro, D., Prezioso, E., Ianni, M., & Giampaolo, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101836 · Cited by 44
Federated Learning with Sparsification-Amplified Privacy and Adaptive Optimization
Hu, R., Gong, Y., & Guo, Y. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/202 · Cited by 53
Chen, L., Yue, D., Ding, X., Wang, Z., Choo, K. R., & Jin, H. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3293961 · Cited by 45
Federated Learning in Computer Vision
Shenaj, D., Rizzoli, G., & Zanuttigh, P. (2023) · IEEE Access · doi:10.1109/access.2023.3310400 · Cited by 48
Over-the-Air Federated Learning and Optimization
Zhu, J., Shi, Y., Zhou, Y., Jiang, C., Chen, W., & Letaief, K. B. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3352280 · Cited by 51
On-device Training: A First Overview on Existing Systems
Zhu, S., Voigt, T., Rahimian, F., & Ko, J. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3696003 · Cited by 66
A novel federated learning-based IDS for enhancing UAVs privacy and security
Ceviz, Ö., Sadioglu, P., Şen, S., & Vassilakis, V. G. (2025) · Internet of Things · doi:10.1016/j.iot.2025.101592 · Cited by 55
Stripelis, D., Thompson, P. M., & Ambite, J. L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3524885 · Cited by 57
FADngs: Federated Learning for Anomaly Detection
Dong, B., Chen, D., Wu, Y., Tang, S., & Zhuang, Y. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3350660 · Cited by 46
Accelerating Fair Federated Learning: Adaptive Federated Adam
Ju, L., Zhang, T., Salman Zubair, T. O. O. R., & Hellander, A. (2024) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2024.3423648 · Cited by 46
End-to-End Speech Recognition from Federated Acoustic Models
Gao, Y., Parcollet, T., Zaiem, S., Fernández-Marqués, J., de Gusmão, P. P. B., Beutel, D. J., & Lane, N. D. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747161 · Cited by 41
Xu, Z., Li, D., Liang, W., Xu, W., Xia, Q., Zhou, P., RANA, O. F., & Li, H. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3262829 · Cited by 44
Federated Learning Over Wireless Networks: Challenges and Solutions
Beitollahi, M., & Lu, N. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3285868 · Cited by 45
Federated Ensemble Model-Based Reinforcement Learning in Edge Computing
Wang, J., Hu, J. W., Mills, J., Min, G., Xia, M., & Georgalas, N. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3264480 · Cited by 44
Liu, Y., Dong, Z., Liu, B., Xu, Y., & Ding, Z. (2023) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2023.109172 · Cited by 39
FedFM: Anchor-Based Feature Matching for Data Heterogeneity in Federated Learning
Ye, R., Ni, Z., Xu, C., Wang, J., Chen, S., & Eldar, Y. C. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3314277 · Cited by 39
Adaptive asynchronous federated learning
Lu, R., Zhang, W., Li, Q., He, H. X., Zhong, X., Yang, H., Wang, D., Xu, Z., & Alazab, M. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.11.001 · Cited by 42
FedADC: Accelerated Federated Learning with Drift Control
Özfatura, E., Özfatura, K., & Gündüz, D. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9517850 · Cited by 39
Borger, T., Mosteiro, P. J., Kaya, H., Rijcken, E., Salah, A. A., Scheepers, F. E., & Spruit, M. R. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116720 · Cited by 38
Khowaja, S. A., Dev, K., Anwar, S. M., & Linguraru, M. G. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125493 · Cited by 41
Speed Up Federated Learning in Heterogeneous Environments: A Dynamic Tiering Approach
Mohammadabadi, S. M. S., Zawad, S., Yan, F., & Yang, L. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3487473 · Cited by 46
Advancing breast, lung and prostate cancer research with federated learning. A systematic review
Ankolekar, A., Boie, S. D., Abdollahyan, M., Gadaleta, E., Hasheminasab, S. A., Yang, G., Beauville, C., Δικαίος, Ν., Kastis, G. A., Bussmann, M., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01591-5 · Cited by 44
On the Convergence of Multi-Server Federated Learning With Overlapping Area
Qu, Z., Li, X., Xu, J., Tang, B., Lu, Z., & Liu, Y. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3200016 · Cited by 36
Popli, M. S., Singh, R. P., Popli, N. K., & Mamun, M. (2025) · IEEE Access · doi:10.1109/access.2025.3530499 · Cited by 36
Multi-Job Intelligent Scheduling With Cross-Device Federated Learning
Liu, J., Jia, J., Ma, B., Zhou, C., Zhou, J., Zhou, Y., Dai, H., & Dou, D. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3224941 · Cited by 36
Asynchronous adaptive federated learning for distributed load forecasting with smart meter data
Fekri, M. N., Grolinger, K., & Mir, S. H. (2023) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2023.109285 · Cited by 37
Blockchain-Inspired Collaborative Cyber-Attacks Detection for Securing Metaverse
Zainudin, A., Putra, M. A. P., Alief, R. N., Akter, R., Kim, D.-S., & Lee, J.-M. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3364247 · Cited by 35
Fotohi, R., Aliee, F. S., & Farahani, B. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111764 · Cited by 35
Fotohi, R., Aliee, F. S., & Farahani, B. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3421602 · Cited by 42
FedHybrid: A Hybrid Federated Optimization Method for Heterogeneous Clients
Niu, X., & Wei, E. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3240083 · Cited by 36
Faster Non-Convex Federated Learning via Global and Local MomentumPreprint
Das, R., Acharya, A., Hashemi, A., Sanghavi, S., Dhillon, I. S., & Topcu, U. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04061 · Cited by 35
FedNL: Making Newton-Type Methods Applicable to Federated LearningPreprint
Safaryan, M., Islamov, R., Qian, X., & Richtárik, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02969 · Cited by 35
FedNLP: A Research Platform for Federated Learning in Natural Language Processing.
Lin, B., He, C., Zeng, Z., Wang, H., Huang, Y., Soltanolkotabi, M., Ren, X., & Avestimehr, S. (2021) · Cited by 34
Federated Learning Over Coupled Graphs
Lei, R., Wang, P., Zhao, J., Lan, L., Tao, J., Deng, C., Feng, J., Wang, X., & Guan, X. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3240527 · Cited by 36
Confidence-Aware Personalized Federated Learning via Variational Expectation Maximization
Zhu, J., Ma, X., & Blaschko, M. B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02351 · Cited by 36
FedGAMMA: Federated Learning With Global Sharpness-Aware Minimization
Dai, R., Yang, X., Sun, Y., Shen, L., Tian, X., Wang, M., & Zhang, Y. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3304453 · Cited by 42
One-shot Federated Learning without server-side training
Su, S., Li, B., & Xue, X. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.04.035 · Cited by 34
Adaptive Federated Learning With Negative Inner Product Aggregation
Deng, W., Chen, X., Li, X., & Zhao, H. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3312059 · Cited by 33
Federated learning with hyper-parameter optimization
Kundroo, M., & Kim, T. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101740 · Cited by 33
Exploring One-Shot Semi-supervised Federated Learning with Pre-trained Diffusion Models
Yang, M., Su, S., Li, B., & Xue, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i15.29568 · Cited by 53
Cross-modal prototype based multimodal federated learning under severely missing modality
Le, H. Q., Thwal, C. M., Qiao, Y., Tun, Y. L., Nguyen, M. N. H., Huh, E., & Zhang, C. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103219 · Cited by 33
Optimizing Federated Learning With Aggregation Strategies: A Comprehensive Survey
Khan, N., Nisar, S., Khan, M. A., Rehman, Y. A. U., Noor, F., & Barb, G. (2025) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2025.3590102 · Cited by 33
Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategies
Jiang, Z., Wang, W., Li, B., & Yang, Q. (2022) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2022.3177222 · Cited by 36
Blockchain-Based Swarm Learning for the Mitigation of Gradient Leakage in Federated Learning
Madni, H. A., Umer, R. M., & Foresti, G. L. (2023) · IEEE Access · doi:10.1109/access.2023.3246126 · Cited by 36
Towards Model Agnostic Federated Learning Using Knowledge DistillationPreprint
Afonin, A., & Karimireddy, S. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.15210 · Cited by 33
On the Outsized Importance of Learning Rates in Local Update Methods
Charles, Z., & Konečný, J. (2020) · arXiv · doi:10.48550/arxiv.2007.00878 · Cited by 32
Self-citationAdaFed: Optimizing Participation-Aware Federated Learning With Adaptive Aggregation Weights
Tan, L., Zhang, X., Zhou, Y., Che, X., Hu, M., Chen, X., & Wu, D. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3168969 · Cited by 36
Graph Federated Learning for CIoT Devices in Smart Home Applications
Rasti-Meymandi, A., Sheikholeslami, S. M., Abouei, J., & Plataniotis, K. N. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3228727 · Cited by 32
Korkmaz, A., Alhonainy, A., & Rao, P. R. (2022) · IEEE Applied Imagery Pattern Recognition Workshop · doi:10.1109/aipr57179.2022.10092212 · Cited by 36
A federated learning architecture for secure and private neuroimaging analysis
Stripelis, D., Gupta, U., Saleem, H., Dhinagar, N., Ghai, T., Anastasiou, C., Sánchez, R., Steeg, G. V., Ravi, S., Naveed, M., et al. (2024) · Patterns · doi:10.1016/j.patter.2024.101031 · Cited by 31
Prigent, C., Costan, A., Antoniu, G., & Cudennec, L. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.06.043 · Cited by 35
Chen, T., Yan, J., Sun, Y., Zhou, S., Gündüz, D., & Niu, Z. (2025) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3466299 · Cited by 31
Elaziz, M. A., Fares, I. A., Dahou, A., & Shrahili, M. (2025) · Frontiers in Big Data · doi:10.3389/fdata.2025.1526480 · Cited by 43
Dynamic Bank Learning for Semi-supervised Federated Image Diagnosis with Class Imbalance
Jiang, M., Yang, H., Li, X., Liu, Q., Heng, P., & Dou, Q. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16437-8_19 · Cited by 32
Data-Augmentation-Based Federated Learning
Zhang, H., Hou, Q., Wu, T., Cheng, S., & Liu, J. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3303889 · Cited by 31
Rehman, Y. A. U., Gao, Y., de Gusmão, P. P. B., Alibeigi, M., Shen, J., & Lane, N. D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01509 · Cited by 36
Machine Learning with Confidential Computing: A Systematization of Knowledge
Mo, F., Tarkhani, Z., & Haddadi, H. (2024) · ACM Computing Surveys · doi:10.1145/3670007 · Cited by 63
Federated Learning for Human Activity Recognition: Overview, Advances, and Challenges
Aouedi, O., Sacco, A., Khan, L. U., Nguyen, D. C., & Guizani, M. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3484228 · Cited by 42
Metadata
- Authors
- Reddi, S., Charles, Z., Zaheer, M., Garrett, Z., Rush, K., Konečný, J., Kumar, S., & McMahan, H. B.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2003.00295
- OpenAlex
- W3008187686
- Cited by
- 840
- References
- 45
- Citations by year
- 2026: 10 · 2025: 127 · 2024: 233 · 2023: 222 · 2022: 120 · 2021: 92 · 2020: 35
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated learning, adaptive optimization, FedAvg, AdaGrad, Adam, yogis, convergence analysis, non-convex optimization, client heterogeneity, communication efficiency, distributed learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review