PreprintCited by 844Privacy-Preserving Technologies in DataStochastic Gradient Optimization TechniquesDomain Adaptation and Few-Shot Learning

The DOI matches its DataCite record; 42 of the 45 references it cites were found in a registry or an index.

Adaptive Federated Optimization

Open access

Reddi, Sashank, Charles, Zachary, Zaheer, Manzil, Garrett, Zachary, Rush, Keith, Konečný, Jakub, Kumar, Sanjiv, McMahan, H. Brendan·2020·arXiv

DOI 10.48550/arxiv.2003.00295arXiv 2003.00295

Open this paper in CoChat — free account Open PDF

Abstract

Federated learning is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. Standard federated optimization methods such as Federated Averaging (FedAvg) are often difficult to tune and exhibit unfavorable convergence behavior. In non-federated settings, adaptive optimization methods have had notable success in combating such issues. In this work, we propose federated versions of adaptive optimizers, including Adagrad, Adam, and Yogi, and analyze their convergence in the presence of heterogeneous data for general non-convex settings. Our results highlight the interplay between client heterogeneity and communication efficiency. We also perform extensive experiments on these methods and show that the use of adaptive optimizers can significantly improve the performance of federated learning.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2003.00295

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Self-citation
Untitled work
(2010) · Cited by 8,261
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citation
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
Self-citation
Group Normalization
Wu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
EMNIST: Extending MNIST to handwritten letters
Cohen, G., Afshar, S., Tapson, J. C., & André, V. S. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966217 · Cited by 2,410
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Self-citation

Show all 45 references

Research works printed but not linked: 3

Debraj Basu, Deepesh Data, Can Karakus, and Suhas Diggavi. Qsparse-local-SGD: Distributed SGD with quantization, sparsification and local computations. In Advances in Neural Information Processing Systems , pp. 14668-14679, 2019.
Aaron Defazio and Léon Bottou. On the ineffectiveness of variance reduced optimization for deep learning. arXiv preprint arXiv:1812.04529 , 2018. · arXiv
H. Brendan McMahan and Matthew J. Streeter. Adaptive bound optimization for online convex optimization. In COLT The 23rd Conference on Learning Theory , 2010b.

Sorted by citations

Items 701–800 of 844

ABC-FL: Anomalous and Benign client Classification in Federated LearningPreprint
Jeong, H., Hwang, J., & Chung, T.-M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04551 · Cited by 2
An Operator Splitting View of Federated LearningPreprint
Malekmohammadi, S., Shaloudegi, K., Hu, Z., & Yu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05974 · Cited by 2
Federated Learning of Molecular Properties in a Heterogeneous Setting.Preprint
Zhu, W., White, A. D., & Luo, J. (2021) · arXiv (Cornell University) · Cited by 3
Adaptive Differentially Private Empirical Risk MinimizationPreprint
Wu, X., Wang, L., Cristali, I., Gu, Q., & Willett, R. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07435 · Cited by 2
Exploring a Bilingual Next Word Predictor for a Federated Learning Mobile ApplicationPreprint
Burgos, N. A., Kiš, K., Bakaráč, P., Kvasnica, M., & Licitra, G. (2022) · doi:10.36227/techrxiv.18058682.v2 · Cited by 2
Proceedings of the 24th International Middleware Conference: Industrial Track
(2023) · doi:10.1145/3626562 · Cited by 2
Federating Dynamic Models Using Early-Exit Architectures for Automatic Speech Recognition on Heterogeneous ClientsPreprint
Ali, M. N., Falavigna, D., & Brutti, A. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4877237 · Cited by 2
Validation of ten federated learning strategies for multi-contrast image-to-image MRI data synthesis from heterogeneous sourcesPreprint
Fiszer, J., Ciupek, D., Malawski, M., & Pieciak, T. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.02.09.637305 · Cited by 2
Federated Optimization of ℓ0-norm Regularized Sparse Learning
Tong, Q., Liang, G., Ding, J., Zhu, T., Pan, M., & Bi, J. (2022) · Algorithms · doi:10.3390/a15090319 · Cited by 1
Federated Learning with Emerging New Class: A Solution Using Isolation-Based Specification
Mu, X. D., Zeng, G., & Huang, Z. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-30637-2_48 · Cited by 1
Federated Learning with Non Independent and Identically Distributed Data
Mreish, K., & Kholod, I. I. (2024) · IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering · doi:10.1109/elcon61730.2024.10468090 · Cited by 1
Application of Federated Learning in Distributed Environments: Experiments and Evaluation
Qiu, W., Shi, D., Li, Q., Zheng, Y., & Shen, X. (2023) · International Academic Exchange Conference on Science and Technology Innovation (IAECST) · doi:10.1109/iaecst60924.2023.10503135 · Cited by 1
BACA: Bandwidth and CPU-Aware Adaptive Federated Learning for Wireless Environments
Shkurti, L., & Selimi, M. (2024) · Mediterranean Conference on Embedded Computing (MECO) · doi:10.1109/meco62516.2024.10577810 · Cited by 1
ASR-FED: Agnostic Straggler Resilient Federated Algorithm for Drone Networks Security
Ihekoronye, V. U., Izuazu, U. U., Nwakanma, C. I., Lee, J. M., & Kim, D.-S. (2024) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps61880.2024.10620729 · Cited by 1
Overcoming Client Data Deficiency in Federated Learning by Exploiting Unlabeled Data on the Server
Park, J.-M., Jang, W.-J., Oh, T.-H., & Lee, S.-H. (2024) · IEEE Access · doi:10.1109/access.2024.3458911 · Cited by 1
Neural-aware Decoupling Fusion based Personalized Federated Learning for Intelligent Sensing
Gao, Y., Shen, L., Liu, L., Cao, Z., Tao, D., Ma, H., & Kato, N. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3697836 · Cited by 1
Asynchronous Federated Learning Through Online Linear Regressions
Kashima, T., Amma, A., & Nakayama, H. (2024) · IEEE Access · doi:10.1109/access.2024.3521009 · Cited by 1
Decentralised Secure Modelling of Electrolyzers with Federated and Transfer Learning
Aziza, S. B., & Trantas, A. (2024) · IEEE PES Innovative Smart Grid Technologies Europe · doi:10.1109/isgteurope62998.2024.10863775 · Cited by 1
Adaptive layer-wise personalized federated learning via dual delay update in future communication networks
Xu, H., Mao, Y., Chen, S., Yi, R. J., Muazu, T., & He, X. (2025) · Computer Communications · doi:10.1016/j.comcom.2025.108195 · Cited by 1
Collaborative edge learning-assisted interactive avatar generation framework for IoT-driven metaverse
Zainudin, A., Putra, M. A. P., Kim, D., & Lee, J. (2025) · Internet of Things · doi:10.1016/j.iot.2025.101639 · Cited by 1
Thompson Sampling Policy for Dynamic Participating Client Scenario in Federated Learning
Li, J., Yan, T., & Ding, Y. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3573796 · Cited by 1
Collaborative Intrusion Detection System for Network and Flight Security in Unmanned Aerial Vehicles Group
da Silva, L. M., Ferrão, I. G., Diniz, B. A., Carciofi, T. P., Ziliol, V. D., Dezan, C., Espès, D., & Branco, K. R. L. J. C. (2025) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas65942.2025.11007925 · Cited by 1
Exploring Federated Learning for Thermal Urban Feature Segmentation - A Comparison of Centralized and Decentralized Approaches
Duda, L., Alibabaei, K., Vollmer, E., Klug, L., Kozlov, V. Y., Berberi, L., Benz, M., Volk, R., Muriedas, J. P. G. H., Götz, M., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-97000-9_18 · Cited by 1
A federated vehicle re-identification benchmark and performance optimization using dual-phase contrastive dynamic aggregation
Huang, L., Zhu, J., Chen, Y., Zhao, Q., & Zeng, H. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107753 · Cited by 1
FedFZY: A Novel Aggregation Method for Federated Learning
Erentürk, K. (2025) · Cognitive Models and Artificial Intelligence Conference (AICCONF) · doi:10.1109/aicconf64766.2025.11064274 · Cited by 1
FLAME: Federated Learning for Attack Mitigation and Evasion
Chiaro, D., Qi, P., Prezioso, E., Guzzo, A., & Piccialli, F. (2025) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps64566.2025.00060 · Cited by 1
Bridging the Gap: Challenges and Limitations of Federated Learning in Real-World Applications
Perifanis, V., Pavlidis, N., Nikolaidou, F., Kampouri, D., & Efraimidis, P. S. (2025) · International Conference on Smart and Sustainable Technologies (SpliTech) · doi:10.23919/splitech65624.2025.11091634 · Cited by 1
Intrusion Detection in IoT Networks Using Federated Learning
Filho, N. I. M., Vitorino, A., Ahsan, M., de Souza, F. S. H., & Guidoni, D. L. (2025) · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT) · doi:10.1109/dcoss-iot65416.2025.00109 · Cited by 1
Benchmarking federated learning for semantic datasets: Federated scene graph generation
Ha, S., Lee, T., Lim, J., & Yoon, S. W. (2025) · Pattern Recognition Letters · doi:10.1016/j.patrec.2025.07.020 · Cited by 1
Transformer Based Federated Learning Framework for Heart Disease Prediction
Kaur, H. P., Kumari, P., Shelke, N. M., Kaur, S., & Naganathan, S. B. T. (2025) · International Conference on Communications and Signal Processing (ICCSP) · doi:10.1109/iccsp64183.2025.11089133 · Cited by 1
On the trustworthiness of federated learning models for 5G network intrusion detection under heterogeneous data
Lamprou, V., Doukas, G. S., Ntanos, C., & Askounis, D. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111598 · Cited by 1
HeaPS: Heterogeneity-aware participant selection for efficient federated learning
Yang, D., Hu, B., Gao, Y., Jin, A.-L., Liu, A., Yeung, K. L., & You, Y. (2025) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2025.105168 · Cited by 1
$$\textsf{OPA}$$: One-Shot Private Aggregation with Single Client Interaction and Its Applications to Federated Learning
Karthikeyan, H., & Polychroniadou, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-01913-4_10 · Cited by 1
Federated learning framework for predicting multi-drug resistant tuberculosis across regional databases
Bhute, H. A., Bhute, A. N., Waghulde, K. B., Vasgi, B. P., Sonar, R., & Deore, S. P. (2025) · Indian Journal of Tuberculosis · doi:10.1016/j.ijtb.2025.10.006 · Cited by 1
A review of federated learning: architectures, challenges, and targeted solutions
Velaei, M., Ghahramani, H., Ghaffari, A., & Derakhshanfard, N. (2026) · Cluster Computing · doi:10.1007/s10586-026-06286-4 · Cited by 1
FedMetaOpt: a comprehensive survey of metaheuristic optimization for federated learning in client selection, resource allocation, and model aggregation
Eslami, E., Fazeli, S. A. S., Abouei, J., Abbasi, E., Karbassi, S. M., & Emad, N. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08889-5 · Cited by 1
Sign Gradient Aggregation for Wireless Federated Learning Using Bussgang LMMSE Estimation
Lee, S., Park, C., & Lee, N. (2021) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc52510.2021.9620946 · Cited by 1
Non-IID Distributed Learning with Optimal Mixture Weights
Li, J., Wei, B., Liu, Y., & Wang, W. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26412-2_33 · Cited by 1
Fast Server Learning Rate Tuning for Coded Federated Dropout
Verardo, G., Barreira, D., Chiesa, M., Kostić, D., & Maguire, G. Q. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-28996-5_7 · Cited by 1
Federated Learning for Data Trust in Logistics
Koch, M., Kober, S., Straburzynski, S., Gaunitz, B., & Franczyk, B. (2023) · Annals of Computer Science and Information Systems · doi:10.15439/2023f5947 · Cited by 1
Enhancing Robustness Against Heterogeneity via Class-Difficulty Based Weights
Liu, T., Shang, M., Li, H., & Zhang, T. (2023) · International Conference on Networking and Network Applications (NaNA) · doi:10.1109/nana60121.2023.00033 · Cited by 1
Communication-efficient Preference-based Federated Multi-resource Allocation
Alam, S. E., & Shukla, D. (2023) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton58177.2023.10313434 · Cited by 1
A Comparison of Federated Aggregation Strategies and Architectures for Next-word Prediction
Sakhnovych, Y., Röttger, R., & Mayer, R. L. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386579 · Cited by 1
FedGLCD: A Federated Learning Intrusion Detection Algorithm with Combined Distillation
Liu, Z., Yao, F., Chai, S., Cui, L., Zhang, B., & Chi, C. (2023) · China Automation Congress (CAC) · doi:10.1109/cac59555.2023.10451117 · Cited by 1
Communication-Efficient Zeroth-Order Adaptive Optimization for Federated Learning
Xie, P., Gao, X., Li, F., Xing, L., Zhang, Y., & Sun, H. (2024) · Mathematics · doi:10.3390/math12081148 · Cited by 1
Enhancing Federated Learning Performance through Adaptive Client Optimization with Hyperparameter Tuning
Putra, M. A. P. (2024) · Journal of Applied Data Sciences · doi:10.47738/jads.v5i2.251 · Cited by 1
Federated Learning Models for Real-Time IoT: A Survey
Houidi, K., Said, M. S., Hakiri, A., Mellouli, N., & Ayed, H. K. B. (2024) · IEEE International Symposium on Real-Time Distributed Computing (ISORC) · doi:10.1109/isorc61049.2024.10551367 · Cited by 1
CAAFL: A Client-Level Adaptive Acceletative Federated Learning Optimization Algorithm for Heterogeneous Data Scenarios
Niu, R., Wang, Y., Yang, C., & Cao, X. (2024) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc62350.2024.10587872 · Cited by 1
Mitigation of Gradient Inversion Attacks in Federated Learning with Private Adaptive Optimization
Lewis, C., Varadharajan, V., Noman, N., Tupakula, U. K., & Li, N. (2024) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs60910.2024.00082 · Cited by 1
Network Intrusion Detection Scheme Based on Federated Learning in Heterogeneous Network Environments
Zhu, Y., Li, C., & Wang, Y. (2024) · International Conference on Communications, Circuits and Systems · doi:10.1109/icccas62034.2024.10652649 · Cited by 1
Leave No One Behind: Unleashing Stragglers’ Potential for Accurate and Realtime Asynchronous Federated Learning
Chen, C., Zhang, Z., & Zhao, Y. (2024) · International Workshop on Quality of Service · doi:10.1109/iwqos61813.2024.10682899 · Cited by 1
Communication-efficient and Decentralized Federated Minimax Optimization
Ghiasvand, S., Reisizadeh, A., Alizadeh, M., & Pedarsani, R. (2024) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton63246.2024.10735328 · Cited by 1
Prior-enhanced Semi-supervised Federated Learning for IoT Intrusion Detection: A Game Theory and Comparative Learning-Based Approach
Ma, L., He, J., Lü, K., Wang, D., Yin, L., & Li, Z. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-74443-3_21 · Cited by 1
Data-driven Synchronization Protocols for Data-parallel Neural Learning over Streaming Data
Klioumis, G., & Giatrakos, N. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825830 · Cited by 1
DeltaMask: Minimizing Communication in Federated Fine-Tuning of Vision Foundation Models
Tsouvalas, V., Asano, Y. M., & Saeed, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825398 · Cited by 1
LIFE: Leader-driven Hierarchical & Inclusive Federated Learning
Li, W., Anagnostopoulos, C., Parambath, S. P., & Bryson, K. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825646 · Cited by 1
FedERA: Framework for Federated Learning with Diversified Edge Resource Allocation
Borthakur, A., Kasliwal, A., Manna, A., Dewan, D., & Sheet, D. (2024) · International Conference on Federated Learning Technologies and Applications (FLTA) · doi:10.1109/flta63145.2024.10840072 · Cited by 1
FLARE: Availability Awareness for Resource-Efficient Federated Learning
Alosaime, S., & Jhumka, A. (2024) · IEEE Pacific Rim International Symposium on Dependable Computing (PRDC) · doi:10.1109/prdc63035.2024.00020 · Cited by 1
Decentralized learning for medical image classification with prototypical contrastive network
Cao, Z., Shi, Y., Zhang, S., Chen, H., Liu, W., Yue, G., & Lin, H. (2025) · Medical Physics · doi:10.1002/mp.17753 · Cited by 1
SVF: Support Vector Federation
Polato, M., Esposito, R., & Sciandra, L. (2025) · IEEE Access · doi:10.1109/access.2025.3562053 · Cited by 2
From continuous pre-training to alignment: A comprehensive toolkit for large language models in federated learning
Zhang, Z., Zhang, Y., Chen, G., Qu, L., Zhou, X. S., Wang, H., & Xu, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130572 · Cited by 1
HeRD: Modeling Heterogeneous Degradations for Federated Super-Resolution in Satellite Imagery
Khan, B., Mousavi, S., & Daneshtalab, M. (2025) · IEEE Access · doi:10.1109/access.2025.3590171 · Cited by 1
Analog Over-the-Air Federated Learning With Real-World Data
Chen, Z., Li, Z., & Xu, J. (2022) · IEEE International Conference on Sensing, Communication, and Networking (SECON) · doi:10.1109/seconworkshops56311.2022.9926339 · Cited by 1
CoomFL:Improving Global and Local Model Coordination Strategies for Heterogeneous Medical Image Tasks in Federated Learning
Mu, Y., & Liu, P. (2023) · Asia Symposium on Image Processing (ASIP) · doi:10.1109/asip58895.2023.00022 · Cited by 1
Hyper-parameter optimization in federated learning
Zhou, Y. X., Ram, P., Salonidis, T., Baracaldo, N., Samulowitz, H., & Ludwig, H. (2024) · Elsevier eBooks · doi:10.1016/b978-0-44-319037-7.00022-3 · Cited by 1
Rethinking the Data Heterogeneity in Federated Learning
Wang, J., Wang, S., Chen, R., & Ji, M. (2023) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf59524.2023.10476979 · Cited by 1
Double Momentum SGD for Federated Learning.Preprint
Xu, A. P., & Huang, H. (2021) · arXiv (Cornell University) · Cited by 1
A Communication-efficient Federated learning assisted by Central data: Implementation of vertical training into Horizontal Federated learning.Preprint
Wan, S., Lu, J., Fan, P., Shao, Y., Peng, C., & Letaief, K. B. (2021) · arXiv (Cornell University) · Cited by 1
Towards Understanding the Risks of Gradient Inversion in Federated LearningPreprint
Hatamizadeh, A., Yin, H., Molchanov, P. A., Myronenko, A., Li, W., Dogra, P., Feng, A., Flores, M. G., Kautz, J., Xu, D., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-1147182/v2 · Cited by 1
Exploring a Bilingual Next Word Predictor for a Federated Learning Mobile ApplicationPreprint
Burgos, N. A., Kiš, K., Bakaráč, P., Kvasnica, M., & Licitra, G. (2022) · doi:10.36227/techrxiv.18058682.v1 · Cited by 1
Exploring a Bilingual Next Word Predictor for a Federated Learning Mobile ApplicationPreprint
Burgos, N. A., Kiš, K., Bakaráč, P., Kvasnica, M., & Licitra, G. (2022) · doi:10.36227/techrxiv.18058682 · Cited by 1
Personalized Federated Learning Based on Multi-Objective OptimizationPreprint
Yang, Y., Xu, A., & Xie, T. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4685964 · Cited by 1
Proceedings of the 2nd ACM Workshop on Data Privacy and Federated Learning Technologies for Mobile Edge Network
(2023) · doi:10.1145/3615593 · Cited by 1
One Communication Round is All It Needs for Federated Fine-Tuning Foundation ModelsPreprint
Wang, Z., Tian, B., He, Y., Shen, Z., Liu, L., & Li, A. (2025) · Qeios · doi:10.32388/6ki6iz · Cited by 1
Explainable Anomaly Detection for System Logs in Distributed Environments
Gu, Z., Yue, W., & Liu, C. (2026) · Computers, Materials & Continua · doi:10.32604/cmc.2026.077388
“Sub-sequent optimizations like FedProx [24] (proximal regularization for heterogeneous data) and FedOPT [25] (adaptive optimizers for convergence) focus on training efficiency without addressing explainability or log-specific heterogeneity.”
EdgeHive: Federated Learning on IoT Clusters in Unreliable Networks
Gupta, R. (2025) · 2025 13th International Conference on Intelligent Systems and Embedded Design (ISED) · doi:10.1109/ised67359.2025.11405287
Design and Analysis of Uplink and Downlink Communications for Federated LearningPreprint
Zheng, S., Shen, C., & Chen, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04057
Dynamic Gradient Aggregation for Federated Domain AdaptationPreprint
Dimitriadis, D., Kumatani, K., Gmyr, R., Gaur, Y., & Eskimez, Ş. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07578
FeO2: Federated Learning with Opt-Out Differential PrivacyPreprint
Aldaghri, N., Mahdavifar, H., & Beirami, A. (2021) · arXiv (Cornell University)
Evaluation and Analysis of Different Aggregation and Hyperparameter Selection Methods for Federated Brain Tumor Segmentation
Isik-Polat, E., Polat, G., Koçyiğit, A., & Temizel, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-09002-8_36
Proceedings of the First Workshop on Federated Learning for Natural Language Processing (FL4NLP 2022)
(2022) · doi:10.18653/v1/2022.fl4nlp-1
Toward a generic federated learning platform optimized for computer vision applications
Zhuang, W. (2022) · doi:10.32657/10356/164712
A pipeline to collaborative AI models creation between Brazilian governmental institutions
de Souza, G. A. F., Figueredo, M., Sabino, D., & Cacho, N. (2023) · International Symposium on Autonomous Decentralized Systems · doi:10.1109/isads56919.2023.10092030
Federated Topology Preserving Domain Adaptation for Human Activity Recognition
Bukit, T. A., Pillado, E. P. B., Lee, S., & Yahya, B. N. (2023) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu59756.2023.10223939
Anarchic Convex Federated Learning
Li, D., & Gong, X. (2023) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps57453.2023.10225908
The Federated Meta-Learning with a Quartile Aggregation MethodPreprint
Wu, L. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4568337
FedERA: Framework for Federated Learning with Diversified Edge Resource AllocationPreprint
Borthakur, A., Manna, A., Kasliwal, A., Dewan, D., & Sheet, D. (2023) · doi:10.36227/techrxiv.24173898.v1
FedERA: Framework for Federated Learning with Diversified Edge Resource AllocationPreprint
Borthakur, A., Manna, A., Kasliwal, A., Dewan, D., & Sheet, D. (2023) · doi:10.36227/techrxiv.24173898
Collaboration beats heterogeneity: Improving federated learning-based waste classification
Chong, J., & Chong, J. (2023) · Journal of Emerging Investigators · doi:10.59720/22-158
FedHybrid: Hierarchical Hybrid Training for High-Performance Federated Learning
Chang, T., Li, L., Wu, M., Yu, W., & Wang, X. (2023) · IEEE International Conference on Sensing, Communication, and Networking (SECON) · doi:10.1109/secon58729.2023.10287503
Data Summarization for Federated Learning
Devillers, J., Brun, O., & Prabhu, B. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-59933-0_9
Flamingo: A User-Centric System for Fast and Energy-Efficient DNN Training on Smartphones
Singapuram, S. S. V., Hu, C., Lai, F., Zhang, C., & Chowdhury, M. (2023) · doi:10.1145/3630048.3630183
Personalized Federated Learning for Modulation Classification in Communication Systems with Differential PrivacyPreprint
Mathis, P. S., & Nguyen, D. C. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4693597
Self-supervised Federated Learning for Anomaly Detection
Eng, T.-Q., Pao, H.-K., & Liao, C.-C. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386871
FedSym: Unleashing the Power of Entropy for Benchmarking the Algorithms for Federated Learning
Kiyamousavi, S. E., Kraychev, B., & Koychev, I. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386581
Improving Communication Efficiency: A Dual Adaptive Federated Learning Framework
Zang, Y., Xue, Z., Du, J., Ou, S., & Wu, J. (2023) · Youth Academic Annual Conference of Chinese Association of Automation (YAC) · doi:10.1109/yac59482.2023.10401735
Data Transfer for Balancing Model Convergence and Training Time in Federated Learning
Tajiri, K., & Kawahara, R. (2023) · Globecom · doi:10.1109/globecom54140.2023.10437284
Multi-mode Learning
Daga, H., & Gavrilovska, A. (2023) · doi:10.1145/3615593.3615722
Quantizated Federated Learning Algorithm with Server Momentum Aggregation*
Gao, F., Li, J., & Hao, Y. (2023) · International Conference on Neuromorphic Computing (ICNC) · doi:10.1109/icnc59488.2023.10462861
Amplified Contribution Analysis for Federated Learning
Zuziak, M. K., & Rinzivillo, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-58553-1_6

Authors: Reddi, S., Charles, Z., Zaheer, M., Garrett, Z., Rush, K., Konečný, J., Kumar, S., & McMahan, H. B.
Affiliations: Google (United States) (US)
ORCID: Charles, Zachary
Zaheer, Manzil
Garrett, Zachary
Rush, Keith
Kumar, Sanjiv
McMahan, H. Brendan
Venue: arXiv
Publisher: arXiv
Published: 2020
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.2003.00295
arXiv: 2003.00295
OpenAlex: W3008187686
Cited by: 840
References: 45
Citations by year: 2026: 10 · 2025: 127 · 2024: 233 · 2023: 222 · 2022: 120 · 2021: 92 · 2020: 35
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (publishedVersion)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords: federated learning, adaptive optimization, FedAvg, AdaGrad, Adam, yogis, convergence analysis, non-convex optimization, client heterogeneity, communication efficiency, distributed learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Adaptive Federated Optimization

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks