PreprintCited by 844Privacy-Preserving Technologies in DataStochastic Gradient Optimization TechniquesDomain Adaptation and Few-Shot Learning

The DOI matches its DataCite record; 42 of the 45 references it cites were found in a registry or an index.

Adaptive Federated Optimization

Open access

Reddi, Sashank, Charles, Zachary, Zaheer, Manzil, Garrett, Zachary, Rush, Keith, Konečný, Jakub, Kumar, Sanjiv, McMahan, H. Brendan·2020·arXiv

DOI 10.48550/arxiv.2003.00295arXiv 2003.00295

Open this paper in CoChat — free account Open PDF

Abstract

Federated learning is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. Standard federated optimization methods such as Federated Averaging (FedAvg) are often difficult to tune and exhibit unfavorable convergence behavior. In non-federated settings, adaptive optimization methods have had notable success in combating such issues. In this work, we propose federated versions of adaptive optimizers, including Adagrad, Adam, and Yogi, and analyze their convergence in the presence of heterogeneous data for general non-convex settings. Our results highlight the interplay between client heterogeneity and communication efficiency. We also perform extensive experiments on these methods and show that the use of adaptive optimizers can significantly improve the performance of federated learning.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2003.00295

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Self-citation
Untitled work
(2010) · Cited by 8,261
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citation
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
Self-citation
Group Normalization
Wu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
EMNIST: Extending MNIST to handwritten letters
Cohen, G., Afshar, S., Tapson, J. C., & André, V. S. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966217 · Cited by 2,410
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Self-citation

Flagged first, then by citations

Show all 45 references

3 of the 45 references couldn’t be matched to a known paper.

Research works printed but not linked: 3

Debraj Basu, Deepesh Data, Can Karakus, and Suhas Diggavi. Qsparse-local-SGD: Distributed SGD with quantization, sparsification and local computations. In Advances in Neural Information Processing Systems , pp. 14668-14679, 2019.
Aaron Defazio and Léon Bottou. On the ineffectiveness of variance reduced optimization for deep learning. arXiv preprint arXiv:1812.04529 , 2018. · arXiv
H. Brendan McMahan and Matthew J. Streeter. Adaptive bound optimization for online convex optimization. In COLT The 23rd Conference on Learning Theory , 2010b.

Sorted by citations

Items 601–700 of 844

Policy-Based Federated LearningPreprint
Katevas, K., Bagdasaryan, E., Waterman, J., Safadieh, M. M., Birrell, E., Haddadi, H., & Estrin, D. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06612 · Cited by 6
Adaptive Serverless LearningPreprint
Gao, H., & Huang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10422 · Cited by 4
CosSGD: Nonlinear Quantization for Communication-efficient Federated Learning.Preprint
He, Y., Zenk, M., & Fritz, M. (2020) · arXiv (Cornell University) · Cited by 4
Federated Learning for Multi-Disease Ophthalmic Diagnostics using OCTAPreprint
Nabil, A. S., Gholami, S., Leng, T., Lim, J. I., & Alam, M. N. (2025) · medRxiv · doi:10.1101/2025.04.25.25326431 · Cited by 4
Communication-privacy-accuracy trade-offs in federated learning for non-IID data with shuffle model
Xiao, D., Fan, X., Chen, L., Li, M., & Zhang, M. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113872 · Cited by 3
Federated proximal learning with data augmentation for brain tumor classification under heterogeneous data distributions
Ghanta, S., Siddareddy, V. S., Boyapati, P., Biswas, S., Swain, G., & Pradhan, A. K. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3396 · Cited by 3
Federated Learning in Neurology: Bridging Data Privacy and Artificial Intelligence for Brain Health
Soltanieh, S., Khalvati, F., & Yeh, E. A. (2025) · Seminars in Neurology · doi:10.1055/a-2769-6752 · Cited by 4
A Communication-Efficient Local Differentially Private Algorithm in Federated Optimization
Alam, S. E., Shukla, D., & Rao, S. (2023) · IEEE Access · doi:10.1109/access.2023.3283503 · Cited by 3
DIN: A Decentralized Inexact Newton Algorithm for Consensus Optimization
Ghalkha, A., Issaid, C. B., Elgabli, A., & Bennis, M. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10278721 · Cited by 3
The Applicability of Federated Learning to Official Statistics
Stock, J., Hauke, O., Weißmann, J., & Federrath, H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-48232-8_8 · Cited by 3
Convergence Analysis of Over-the-Air FL with Compression and Power Control via Clipping
Wen, H.-F., Xing, H., & Simeone, O. (2023) · Global Communications Conference · doi:10.1109/globecom54140.2023.10437291 · Cited by 4
Fedsemgan: A Semi-Supervised Federated Learning-Based Edge-Cloud Collaborative Framework for Medical Diagnosis Service
Hu, R., & Yang, R. (2023) · China Automation Congress (CAC) · doi:10.1109/cac59555.2023.10450601 · Cited by 3
TSFed: A three-stage optimization mechanism for secure and efficient federated learning in industrial IoT networks
Putra, M. A. P., Karna, N. B. A., Zainudin, A., Kim, D., & Lee, J. (2024) · Internet of Things · doi:10.1016/j.iot.2024.101287 · Cited by 3
Federated learning for oncology: Breast Cancer subtyping Case Study Using Gene Expression
Paygambar, K., Mziou-Sallami, M., Baligand, F., & Meyer, V. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822609 · Cited by 4
A federated graph learning method to realize multi-party collaboration for molecular discovery
Zhang, L., Zhang, J., Huang, R., Wang, Y., Liu, L., Zhang, Y., Chen, K., Jiang, J., & Wu, Y. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01184-1 · Cited by 4
Decay Momentum for Improving Federated Learning
Fernandes, M., Silva, C., Arrais, J. P., Cardoso, A., & Ribeiro, B. (2021) · European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN) · doi:10.14428/esann/2021.es2021-106 · Cited by 3
Data-Driven Automotive Development: Federated Reinforcement Learning for Calibration and Control
Rudolf, T., Schürmann, T., Skull, M., Schwab, S., & Hohmann, S. (2022) · Proceedings · doi:10.1007/978-3-658-37009-1_26 · Cited by 3
Group Personalized Federated Learning
Liu, Z., Hui, Y., & Peng, F. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094708 · Cited by 3
ECSM: An Ensembled Client Selection Mechanism for Efficient Federated Learning
Putra, M. A. P., Sampedro, G. A., Kim, D., & Lee, J. (2023) · IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT) · doi:10.1109/iaict59002.2023.10205864 · Cited by 3
Federated Learning Technology in Serial Topology for IoT Networks
Sheng, J., Xiong, J., & Liu, B. (2023) · IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) · doi:10.1109/bmsb58369.2023.10211485 · Cited by 3
FedCime: An Efficient Federated Learning Approach For Clients in Mobile Edge Computing
Agbaje, P., Anjum, A., Talukder, Z., Islam, M. A., Nwafor, E., & Olufowobi, H. (2023) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge60047.2023.00042 · Cited by 3
Federated Learning Performance on Early ICU Mortality Prediction with Extreme Data Distributions
Georgoutsos, A., Kerasiotis, P., & Kantere, V. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-7254-8_37 · Cited by 3
FedDHr: Improved Adaptive Learning Strategy Using Federated Learning for Image Processing
Velagapudi, A., Jhansi, B., Hemalikha, M., & Vijayalakshmi, P. (2023) · International Conference on Self Sustainable Artificial Intelligence Systems (ICSSAS) · doi:10.1109/icssas57918.2023.10331636 · Cited by 3
UpCycling: Semi-supervised 3D Object Detection without Sharing Raw-level Unlabeled Scenes
Hwang, S., Kim, Y.-S., Kim, S., Bahk, S., & Kim, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02134 · Cited by 3
Federated Learning for Predictive Healthcare Analytics: From theory to real world applications
Rana, N., & Marwaha, H. (2024) · BIO Web of Conferences · doi:10.1051/bioconf/20248601003 · Cited by 3
Towards Efficient Edge Learning for Large Models in Heterogeneous Resource-limited Environments
Liu, D., Wang, Z., Pang, X., Sun, Y., Hu, J., Sun, P., & Hu, Y. (2023) · International Conference on Big Data Computing and Communications (BigCom) · doi:10.1109/bigcom61073.2023.00038 · Cited by 3
FedFit: Server Aggregation Through Linear Regression in Federated Learning
Kashima, T., Kishida, I., Amma, A., & Nakayama, H. (2024) · IEEE Access · doi:10.1109/access.2024.3363884 · Cited by 4
Evaluating Multi-Global Server Architecture for Federated Learning
Kawnine, A., Cao, H., Mih, A. N., & Wachowicz, M. (2024) · International Conference on Consumer Electronics · doi:10.1109/icce59016.2024.10444349 · Cited by 4
Federated Variational Inference: Towards Improved Personalization and Generalization
Vedadi, E., Dillon, J. V., Mansfield, P. A., Singhal, K., Afkanpour, A., & Morningstar, W. R. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v3i1.31228 · Cited by 3
Privacy Risks in Reinforcement Learning for Household Robots
Li, M., Ding, W., & Zhao, D. X. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610832 · Cited by 5
Blade: Pushing the Performance Envelope of Asynchronous Federated Learning
Ying, C., Li, B., & Li, B. (2024) · International Workshop on Quality of Service · doi:10.1109/iwqos61813.2024.10682956 · Cited by 3
Collaborative Visual Place Recognition through Federated Learning
Dutto, M., Berton, G., Caldarola, D., Fanì, E., Trivigno, G., & Masone, C. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00425 · Cited by 4
Privacy-Preserving Load Forecasting via Personalized Model Obfuscation
Bose, S., Zhang, Y., & Kim, K. (2024) · IEEE Power Engineering Society General Meeting · doi:10.1109/pesgm51994.2024.10689151 · Cited by 3
Deep Federated Fractional Scattering Network for Heterogeneous Edge Internet of Vehicles Fingerprinting: Theory and Implementation
Zhang, T., Xu, D., Ma, J., Bashir, A. K., Dabel, M. M. A., & Feng, H. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3501387 · Cited by 3
Enhancing Healthcare AI with Cross-Silo Personalized Federated Learning on Naturally Split Heterogeneous Data
Mukeshbhai, A. N., Annappa, B., & Sachin, D. N. (2024) · IEEE Region 10 Symposium (TENSYMP) · doi:10.1109/tensymp61132.2024.10751812 · Cited by 3
Communication-Efficient Device Scheduling for Federated Learning Using Lyapunov Optimization
Perazzone, J. B., Wang, S., Ji, M., & Chan, K. (2025) · IEEE Transactions on Networking · doi:10.1109/ton.2025.3539857 · Cited by 3
EncCluster: Scalable functional encryption in federated learning through weight clustering and probabilistic filters
Tsouvalas, V., Mohammadi, S., Balador, A., Özçelebi, T., Flammini, F., & Meratnia, N. (2025) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2025.102021 · Cited by 3
Lightweight Unsupervised Federated Learning with Pretrained Vision Language Model
Yan, H., & Guo, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-82240-7_11 · Cited by 3
Data-efficient Federated Learning for Edge Network Intrusion Detection
Bierbrauer, D., Coffey, S. M., Willeke, M., Beggs, J. D., & Bastian, N. D. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110685 · Cited by 3
PaddleBox: Communication-Efficient TeraByte-Scale Model Training Framework for Online Advertising
Zhao, W., Jiao, X., Hu, M., Li, X., Zhang, X., & Li, P. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10021133 · Cited by 3
The 5G-IANA platform: Bringing far-edge resources and ML potential to the disposal of automotive third parties
Moscatelli, F., Xirofotos, T., Rizk, A., Baganal-Krishna, N., Bonetto, E., Liotou, E., & Amditis, A. (2022) · IEEE Future Networks World Forum (FNWF) · doi:10.1109/fnwf55208.2022.00118 · Cited by 3
Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and Applications
Kaya, E. C., Sahin, M. B., & Hashemi, A. (2023) · IEEE Access · doi:10.1109/access.2023.3284891 · Cited by 3
Accelerating Federated Learning in Heterogeneous Data and Computational EnvironmentsPreprint
Stripelis, D., & Ambite, J. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.11281 · Cited by 10
Communication-Efficient Agnostic Federated AveragingPreprint
Ro, J. H., Chen, M., Mathews, R., Mohri, M., & Suresh, A. T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.02748 · Cited by 3
DP-REC: Private & Communication-Efficient Federated LearningPreprint
Triastcyn, A., Reisser, M., & Louizos, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05454 · Cited by 19
Towards Understanding the Risks of Gradient Inversion in Federated LearningPreprint
Hatamizadeh, A., Yin, H., Molchanov, P. A., Myronenko, A., Li, W., Dogra, P., Feng, A., Flores, M. G., Kautz, J., Xu, D., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-1147182/v1 · Cited by 3
Synthetic data shuffling accelerates the convergence of federated learning under data heterogeneityPreprint
Li, B., Esfandiari, Y., Schmidt, M. N., Alstrøm, T. S., & Stich, S. U. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.13263 · Cited by 8
Federated Multi-Task Learning: An Overview and Quantitative EvaluationPreprint
Ahmed, F. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4627317 · Cited by 3
FedOps Mobile: A Platform of Federated Learning Management for Enhanced Mobile CollaborationPreprint
Yusubov, F., & Lee, K. Y. (2024) · Preprints.org · doi:10.20944/preprints202405.1479.v1 · Cited by 3
Heterogeneity-Aware Clustering and Intra-Cluster Uniform Data Sampling for Federated Learning
Chen, J., Zhang, P., Chen, J., & Lau, T. S. C. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3515007 · Cited by 3
FedImp: Federated Learning Using Important Layers of Client Models for the Diagnosis of Breast Cancer Histopathology Images
Banerjee, M., & Paul, A. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890365 · Cited by 2
A functional RNA–based and curvature-aware learning framework for federated optimization
Khan, K., Goodridge, W. S., & Elibox, W. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131045 · Cited by 2
Towards Privacy-Preserving Big Data Analysis With Decentralized Learning for ROP Imaging
Mahrous, F. M., Abu-Leif, H. A., Modyiq, T. A., AlGhamdi, H. M., AlSaedi, K. S., & Algamdi, A. M. (2025) · International Conference on Innovation in Artificial Intelligence and Internet of Things (AIIT) · doi:10.1109/aiit63112.2025.11082911 · Cited by 2
Entropy-Regularized Federated Optimization for Non-IID Data
Khan, K. (2025) · Algorithms · doi:10.3390/a18080455 · Cited by 2
Collaborative and privacy-preserving cross-vendor united diagnostic imaging via server-rotating federated machine learning
Wang, H., Zhang, X., Ren, X., Zhang, Z., Yang, S., Lian, C., Ma, J., & Zeng, D. (2025) · Communications Engineering · doi:10.1038/s44172-025-00485-4 · Cited by 2
FedMcon: an adaptive aggregation method for federated learning via meta controller
Shen, T., Li, Z., Zhao, Z., Zhu, D., Lv, Z., Kuang, K., Zhang, S., Wu, C., & Wu, F. Q. (2025) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2400530 · Cited by 2
Kalman Filter Aided Federated Koopman Learning
Chen, Y., & Chen, W. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3587329 · Cited by 2
Coordinated Replay Sample Selection for Continual Federated Learning
Good, J., Majmudar, J., Dupuy, C., Wang, J., Peris, C., Chung, C., Zemel, R. S., & Gupta, R. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.32 · Cited by 2
A Federated implementation for MLOps framework based on non-intrusive load monitoring
Chen, H., Liu, C.-T., Hsu, H.-Y., & Hsieh, J. (2023) · IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE) · doi:10.1109/ecice59523.2023.10383048 · Cited by 2
Slingshot: Globally Favorable Local Updates for Federated Learning
Liu, J., Huang, H., Wang, C., Zhou, S., Li, R., & Zheng, Z. (2024) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2024.3356599 · Cited by 3
Evolutionary Multi-model Federated Learning on Malicious and Heterogeneous Data
Shang, C., Gu, F., & Jiang, J. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00055 · Cited by 2
Federated Learning with Client Availability Budgets
Bao, Y., Drew, S., Wang, X. Y., Zhou, J., & Niu, X. (2023) · Globecom · doi:10.1109/globecom54140.2023.10437111 · Cited by 2
Federated learning with a Balanced Heterogeneous-Yoke and Loose restriction
Li, B. (2024) · Internet of Things · doi:10.1016/j.iot.2024.101144 · Cited by 2
Research on Edge-Cloud Collaborative Data Sharing Method Based on Federated Learning in Internet of Vehicles
Ren, X., Wang, Y., Zhang, J., & Han, Z. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads60453.2023.00158 · Cited by 2
Federated Learning Applied to Arrhythmia Detection on Electrocardiograms
Couto, R. S., & Favaro, L. (2023) · IEEE Virtual Conference on Communications (VCC) · doi:10.1109/vcc60689.2023.10474963 · Cited by 2
Federated learning for prostate cancer detection in biparametric MRI: optimization of rounds, epochs, and aggregation strategy
Moradi, A., Zerka, F., Bosma, J. S., Yakar, D., Geerdink, J., Huisman, H. J., Bathen, T. F., & Elschot, M. (2024) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.2688568 · Cited by 2
Accelerating Federated Learning via Sequential Training of Grouped Heterogeneous Clients
Silvi, A., Rizzardi, A., Caldarola, D., Barbara Caputo, B., & Ciccone, M. (2024) · IEEE Access · doi:10.1109/access.2024.3387453 · Cited by 2
Benchmarking Federated Learning on High-Performance Computing: Aggregation Methods and Their Impact
Annunziata, D., Canzaniello, M., Savoia, M., Cuomo, S., & Piccialli, F. (2024) · Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP) · doi:10.1109/pdp62718.2024.00036 · Cited by 2
Consensus modeling: Safer transfer learning for small health systems
Tourani, R., Murphree, D. H., Sheka, A. C., Melton, G. B., Kor, D. J., & Simon, G. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102899 · Cited by 2
Improving Model Accuracy in Federated Learning with Mish Activation Function and the FedAvg-RAdam Optimization Algorithm
Dandani, S., & Yaghmaee, M. H. (2024) · International Conference on Smart Cities, Internet of Things and Applications (SCIoT) · doi:10.1109/sciot62588.2024.10570141 · Cited by 3
DDPG-FL: A Reinforcement Learning Approach for Data Balancing in Federated Learning
Ouyang, B., Li, J., & Chen, X. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-3890-8_3 · Cited by 3
Network-aware federated neural architecture search
Öcal, G., & Özgövde, A. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.07.053 · Cited by 2
Can Federated Learning Clients be Lightweight? A Plug-and-Play Symmetric Conversion Module
Liu, J., Huang, H., Wang, C., Li, R., Car, T., Yang, Q., & Zheng, Z. (2024) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs60910.2024.00080 · Cited by 2
Magnitude Matters: Fixing signSGD Through Magnitude-Aware Sparsification and Error Feedback in the Presence of Data Heterogeneity
Jin, R., He, X., Zhong, C., Zhang, Z., Quek, T. Q. S., & Dai, H. (2024) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2024.3454986 · Cited by 2
Sparsified Random Partial Model Update for Personalized Federated Learning
Hu, X., Chen, Z., Feng, C., Min, G., Quek, T. Q. S., & Yang, H. H. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3507286 · Cited by 3
Local methods with adaptivity via scaling
Chezhegov, S., Skorik, S., Khachaturov, N., Shalagin, D., Avetisyan, A. A., Takáč, M., Kholodov, Y. A., & Beznosikov, A. N. (2024) · Успехи математических наук · doi:10.4213/rm10209 · Cited by 2
Federated Learning With Meta-Layers Training for Privacy-Preserving in Vehicular Consumer Electronics
Shen, X., Li, H., Li, Y., Zhang, W., Alenazi, M. J. F., & Agarwal, K. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3510726 · Cited by 2
Federated Objective: Assessing Client Truthfulness in Federated Learning
Garofalo, M., Catalfamo, A., Colosi, M., & Villari, M. (2024) · 2024 IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825652 · Cited by 2
Tackling Data Heterogeneity in Federated Learning through Global Density Estimation
Ghosh, S., Kushwaha, A., & Singh, D. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825347 · Cited by 2
Optimization of Data and Model Transfer for Federated Learning to Manage Large-Scale Network
Tajiri, K., & Kawahara, R. (2025) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2025.3538156 · Cited by 3
A self-organized MoE framework for distributed federated learning
Lee, J., & Kim, W. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.107798 · Cited by 2
Domain-Specific Transport Protocols for In-Network Processing at the Edge: A Case Study of Accelerating Model Synchronization
Luo, S., Zhang, P., Song, X. G., Fan, P., Xing, H., Luo, L., & Yu, H. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3552220 · Cited by 2
Resource-Efficient Personalization in Federated Learning With Closed-Form Classifiers
Fanì, E., Camoriano, R., Barbara Caputo, B., & Ciccone, M. (2025) · IEEE Access · doi:10.1109/access.2025.3556587 · Cited by 2
Boosting Resource-Constrained Federated Learning Systems With Guessed Updates
Boukhari, M. Y., Dhasade, A., Kermarrec, A.-M., Pires, R. P., Safsafi, O., & Sharma, R. K. (2025) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2025.3578522 · Cited by 2
Federated Learning Optimization: Model Update Difference Minimization and Functional Based Adaptive Learning Rate Adjustment
Rong, Z., Liu, Y., Dai, M., Savazzi, S., & Kianoush, S. (2025) · World Conference on Computing and Communication Technologies (WCCCT) · doi:10.1109/wccct65447.2025.11027927 · Cited by 2
Accelerating Energy-Efficient Federated Learning in Cell-Free Networks With Adaptive Quantization
Mahmoudi, A., Xiao, M., & Björnson, E. (2025) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2025.3583659 · Cited by 2
In-silo federated learning vs. centralized learning for segmenting acute and chronic ischemic brain lesions
Kim, J., Lee, H., Park, J.-H., Park, S. H., Lee, M., Sunwoo, L., Kim, C. K., Kim, B. J., Kim, D., & Ryu, W. (2025) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2025.100283 · Cited by 2
FedDeepInsight—A privacy-first federated learning architecture for medical data
Duah, A. G., Bumbuc, R. V., Korkmaz, H. I., Wilding, R., & Sheraton, V. M. (2025) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2025.101691 · Cited by 2
Exploring Heterogeneous Characteristics of Layers in ASR Models for More Efficient Training
Zhou, L., Guliani, D., KABEL, A. C., Motta, G., & Beaufays, F. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746773 · Cited by 2
Communication-Constrained Exchange of Zeroth-Order Information with Application to Collaborative Target Tracking
Kaya, E. C., Sahin, M. B., & Hashemi, A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096148 · Cited by 2
Communication-efficient Federated Learning with an Event-triggering Strategy
Li, Y., Bai, J., Li, D., & Li, W. (2022) · IEEE Data Driven Control and Learning Systems Conference (DDCLS) · doi:10.1109/ddcls55054.2022.9858572 · Cited by 2
Distributed Censored Quantile Regression
Sit, T., & Xing, Y. (2023) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2023.2182310 · Cited by 2
Client Tuned Federated Learning for RSSI-based Indoor Localisation
Paulavičius, J., Carnelli, P., Piechocki, R. J., & Khan, A. (2023) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc51644.2023.10059919 · Cited by 2
Adaptive Gradient Methods For Over-the-Air Federated Learning
Wang, C., Chen, Z., Yang, H. H., & Παππάς, Ν. (2023) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc53906.2023.10304465 · Cited by 2
DIN: A Decentralized Inexact Newton Algorithm for Consensus Optimization
Ghalkha, A., Issaid, C. B., Elgabli, A., & Bennis, M. (2024) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2024.3400756 · Cited by 2
COMPARATIVE ANALYSIS OF FEDERATED MACHINE LEARNING ALGORITHMS
Bektemyssova, G., & Бакирова, Г. (2024) · Scientific Journal of Astana IT University · doi:10.37943/17bvcn7579 · Cited by 2
Multi–Task Model Personalization for Federated Supervised SVM in Heterogeneous Networks
Ponomarenko-Timofeev, A., Galinina, O., Balakrishnan, R., Himayat, N., Andreev, S. D., & Koucheryavy, Y. A. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3546550 · Cited by 2
Sparsified Privacy-Masking for Communication-Efficient and Privacy-Preserving Federated Learning.Preprint
Hu, R., Gong, Y., & Guo, Y. (2020) · arXiv (Cornell University) · Cited by 2
Federated Unbiased Learning to RankPreprint
Li, C., & Ouyang, H. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.04761 · Cited by 2
Compositional federated learning: Applications in distributionally robust averaging and meta learningPreprint
Huang, F., & Li, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11264 · Cited by 2

Authors: Reddi, S., Charles, Z., Zaheer, M., Garrett, Z., Rush, K., Konečný, J., Kumar, S., & McMahan, H. B.
Affiliations: Google (United States) (US)
ORCID: Charles, Zachary
Zaheer, Manzil
Garrett, Zachary
Rush, Keith
Kumar, Sanjiv
McMahan, H. Brendan
Venue: arXiv
Publisher: arXiv
Published: 2020
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.2003.00295
arXiv: 2003.00295
OpenAlex: W3008187686
Cited by: 840
References: 45
Citations by year: 2026: 10 · 2025: 127 · 2024: 233 · 2023: 222 · 2022: 120 · 2021: 92 · 2020: 35
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (publishedVersion)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords: federated learning, adaptive optimization, FedAvg, AdaGrad, Adam, yogis, convergence analysis, non-convex optimization, client heterogeneity, communication efficiency, distributed learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Adaptive Federated Optimization

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks