Federated Variance-Reduced Stochastic Gradient Descent With Robustness to Byzantine Attacks
Open accessThe DOI matches its Crossref record; 47 of the 51 references it cites were found in a registry or an index.
Abstract
This paper deals with distributed finite-sum optimization for learning over multiple workers in the presence of malicious Byzantine attacks. Most resilient approaches so far combine stochastic gradient descent (SGD) with different robust aggregation rules. However, the sizeable SGD-induced stochastic gradient noise challenges discerning malicious messages sent by the Byzantine attackers from noisy stochastic gradients sent by the `honest' workers. This motivates reducing the variance of stochastic gradients as a means of robustifying SGD. To this end, a novel Byzantine attack resilient distributed (Byrd-) SAGA approach is introduced for federated learning tasks involving multiple workers. Rather than the mean employed by distributed SAGA, the novel Byrd-SAGA relies on the geometric median to aggregate the corrected stochastic gradients sent by the workers. When less than half of the workers are Byzantine attackers, Byrd-SAGA attains provably linear convergence to a neighborhood of the optimal solution, with the asymptotic learning error determined by the number of Byzantine workers. Numerical tests corroborate the robustness to various Byzantine attacks, as well as the merits of Byrd-SAGA over Byzantine attack resilient distributed SGD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To address Byzantine attacks (i.e., the faulty edge device can behave arbitrarily badly by modifying its local updates) in FL with a server-client architecture, various robust and secure model aggregation schemes (e.g., geometric median [168], trimmed mean [169], and Krum [170]) were proposed to tolerate the Byzantine corrupted edge devices.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [168]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
The Byzantine generals problem
Lamport, L., Shostak, R., & Pease, M. (1982) · ACM Transactions on Programming Languages and Systems · doi:10.1145/357172.357176 · Cited by 6,023 · cited 1×
“We will henceforth focus on the class of malicious attacks known as Byzantine attacks [8].”
BackgroundLarge-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · cited 1×
“When all workers are honest, a popular solver of (1) is SGD [34].”
BackgroundIntroductory Lectures on Convex Optimization: A Basic Course
Nesterov, Y. E. (2014) · Medical Entomology and Zoology · Cited by 3,557
Privacy-preserving data mining
Agrawal, R., & Srikant, R. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335438 · Cited by 2,961
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., & He, K. (2017) · arXiv · doi:10.48550/arxiv.1706.02677 · Cited by 2,294 · cited 2×
“In addition, other variance reduction techniques, such as minibatch [22], are also available to alleviate the gradient noise.”
BackgroundAccelerating Stochastic Gradient Descent using Predictive Variance Reduction
Johnson, R., & Zhang, T. (2013) · Cited by 1,889
Privacy-preserving data mining
Agrawal, R., & Srikant, R. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335438 · Cited by 1,719
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563
(2017) · neural information processing systems · Cited by 1,413
Research works printed but not linked: 2
- tang, 0, D2: Decentralized training over decentralized data, Proc Int Conf Mach Learn, 4855
- yang, 2019, Federated Learning
Cited by
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“, geometric median [168], trimmed mean [169], and Krum [170]) were proposed to tolerate the Byzantine corrupted edge devices.”
BackgroundRobust Aggregation for Federated Learning
Pillutla, K., Kakade, S. M., & Harchaoui, Z. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3153135 · Cited by 801
Rodríguez-Barroso, N., Jiménez-López, D., Luzón, M. V., Herrera, F., & Martínez-Cámara, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.011 · Cited by 296
Federated Learning of a Mixture of Global and Local Models
Hanzely, F., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05516 · Cited by 230
An Experimental Study of Byzantine-Robust Aggregation Schemes in Federated Learning
Li, S., Ngai, E. C. ‐., & Voigt, T. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3237397 · Cited by 176
Learning to Detect Malicious Clients for Robust Federated Learning
Li, S., Cheng, Y. J., Wang, W., Liu, Y., & Chen, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.00211 · Cited by 175
Self-citationIntegration of large language models and federated learning
Chen, C., Feng, X., Li, Y., Lyu, L., Zhou, J., Zheng, X., & Yin, J. (2024) · Patterns · doi:10.1016/j.patter.2024.101098 · Cited by 174
Deep Model Poisoning Attack on Federated Learning
Zhou, X., Xu, M., Wu, Y., & Zheng, N. (2021) · Future Internet · doi:10.3390/fi13030073 · Cited by 170
“First, because untargeted attacks reduce the overall performance of the main task, they are easier to be detected [16–19].”
BackgroundLSFL: A Lightweight and Secure Federated Learning Scheme for Edge Computing
Zhang, Z., Wu, L., Ma, C., Li, J., Wang, J., Wang, Q., & Yu, S. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3221899 · Cited by 169
RETRACTED: Personalized federated learning framework for network traffic anomaly detection
Pei, J., Zhong, K., Jan, M. A., & Li, J. (2022) · Computer Networks · doi:10.1016/j.comnet.2022.108906 · Cited by 160
RetractedByzantine-Robust Learning on Heterogeneous Datasets via BucketingPreprint
Karimireddy, S. P., He, L., & Jaggi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09365 · Cited by 156
LFighter: Defending against the label-flipping attack in federated learning
Jebreel, N., Domingo‐Ferrer, J., Sánchez, D., & Blanco-Justicia, A. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.11.019 · Cited by 151
Privacy-Preserving Federated Learning With Malicious Clients and Honest-but-Curious Servers
Le, J., Zhang, D., Lei, X., Jiao, L., Zeng, K., & Liao, X. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3295949 · Cited by 125
A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness and Privacy
Zhang, Y., Zeng, D., Luo, J., Xu, Z., & King, I. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543873.3587681 · Cited by 117
A Secure Federated Learning Framework for Residential Short-Term Load Forecasting
Husnoo, M. A., Anwar, A., Hosseinzadeh, N., Islam, S. N., Mahmood, A. N., & Doss, R. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3292382 · Cited by 112
FL-Defender: Combating targeted attacks in federated learning
Jebreel, N. M., & Domingo-Ferrer, J. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110178 · Cited by 110
Differentially Private Byzantine-Robust Federated Learning
Ma, X., Sun, X., Wu, Y., Liu, Z., Chen, X., & Dong, C. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3167434 · Cited by 109
Toward Federated Large Language Models: Motivations, Methods, and Future Directions
Cheng, Y., Zhang, W., Zhang, Z., Zhang, C., Wang, S., & Mao, S. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3503680 · Cited by 105
Byzantine-Resilient Decentralized Stochastic Optimization With Robust Aggregation Rules
Wu, Z., Chen, T., & Ling, Q. H. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3300629 · Cited by 97
Self-citationPrivacy-preserving Byzantine-robust federated learning
Ma, X., Zhou, Y., Wang, L., & Miao, M. (2021) · Computer Standards & Interfaces · doi:10.1016/j.csi.2021.103561 · Cited by 83
Federated Learning Attacks and Defenses: A Survey
Chen, Y., Gui, Y., Lin, H., Gan, W., & Wu, Y. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020431 · Cited by 81
Byzantine Machine Learning: A Primer
Guerraoui, R., Gupta, N., & Pinot, R. (2024) · ACM Computing Surveys · doi:10.1145/3616537 · Cited by 79
MESAS: Poisoning Defense for Federated Learning Resilient against Adaptive Attackers
Krauß, T., & Dmitrienko, A. (2023) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3576915.3623212 · Cited by 77
Madathil, N. T., Dankar, F. K., Gergely, M., Belkacem, A. N., & Alrabaee, S. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.06.009 · Cited by 75
Beyond Traditional Threats: A Persistent Backdoor Attack on Federated Learning
Liu, T., Zhang, Y., Zhu, F., Yang, Z. Q., Xu, C. G., Man, D., & Yang, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30131 · Cited by 74
Combating Interference for Over-the-Air Federated Learning: A Statistical Approach via RIS
Shi, W., Yao, J., Xu, W., Xu, J., You, X., Eldar, Y. C., & Zhao, C. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3536023 · Cited by 69
BlockFLow: An Accountable and Privacy-Preserving Solution for Federated LearningPreprint
Mugunthan, V., Rahman, R., & Kagal, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03856 · Cited by 67
Federated Anomaly Analytics for Local Model Poisoning Attack
Shi, S., Hu, C., Wang, D., Zhu, Y., & Han, Z. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118347 · Cited by 64
Enhanced Security and Privacy via Fragmented Federated Learning
Jebreel, N., Domingo‐Ferrer, J., Blanco-Justicia, A., & Sánchez, D. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3212627 · Cited by 60
Gupta, A., Luo, T., Ngo, M. V., & Das, S. K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17143-7_22 · Cited by 60
Liu, Y., Zhao, R., Kang, J., Yassine, A., Niyato, D. T., & Peng, J. (2021) · ACM Transactions on Internet Technology · doi:10.1145/3453169 · Cited by 59
Byzantine-robust decentralized stochastic optimization over static and time-varying networks
Peng, J., Li, W., & Ling, Q. H. (2021) · Signal Processing · doi:10.1016/j.sigpro.2021.108020 · Cited by 59
Self-citationFederated Edge Learning for 6G: Foundations, Methodologies, and Applications
Tao, M., Zhou, Y., Shi, Y., Lu, J., Cui, S. R., Lü, J., & Letaief, K. B. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3509739 · Cited by 58
Local SGD: Unified Theory and New Efficient MethodsPreprint
Gorbunov, E., Hanzely, F., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02828 · Cited by 57
Federated Optimization Under Intermittent Client Availability
Yan, Y., Niu, C., Ding, Y., Zheng, Z., Tang, S., Li, Q., Wu, F., Lyu, C., Feng, Y., & Chen, G. (2023) · INFORMS journal on computing · doi:10.1287/ijoc.2022.0057 · Cited by 53
Xu, H., Seng, K. P., Ang, L.-M., & Smith, J. (2024) · IEEE Access · doi:10.1109/access.2024.3422211 · Cited by 50
Bridging Differential Privacy and Byzantine-Robustness via Model Aggregation
Zhu, H., & Ling, Q. H. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/337 · Cited by 48
Self-citationDetecting Malicious Model Updates from Federated Learning on Conditional Variational Autoencoder
Gu, Z., & Yang, Y. (2021) · 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps49936.2021.00075 · Cited by 47
A Huber Loss Minimization Approach to Byzantine Robust Federated Learning
Zhao, P., Yu, F., & Wan, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30181 · Cited by 47
FLTracer: Accurate Poisoning Attack Provenance in Federated Learning
Zhang, X., Liu, Q., Ba, Z., Hong, Y., Zheng, T., Lin, F., Lü, L., & Ren, K. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3410014 · Cited by 46
Making federated learning robust to adversarial attacks by learning data and model association
Qayyum, A., Janjua, M. U., & Qadir, J. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102827 · Cited by 46
Automatic Adversarial Adaption for Stealthy Poisoning Attacks in Federated Learning
Krauß, T., König, J., Dmitrienko, A., & Kanzow, C. (2024) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2024.241366 · Cited by 45
A systematic review of federated learning incentive mechanisms and associated security challenges
Ali, A., Ilahi, I., Qayyum, A., Mohammed, I., Al‐Fuqaha, A., & Qadir, J. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100593 · Cited by 43
FAST: Adopting Federated Unlearning to Eliminating Malicious Terminals at Server Side
Guo, X., Wang, P., Qiu, S., Song, W., Zhang, Q., Wei, X., & Zhou, D. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3343117 · Cited by 43
Robust Federated Learning: Maximum Correntropy Aggregation Against Byzantine Attacks
Luan, Z., Li, W., Liu, M., & Chen, B. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3383294 · Cited by 43
Resource-Constrained Federated Edge Learning With Heterogeneous Data: Formulation and Analysis
Liu, Y., Zhu, Y., & Yu, J. J. Q. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3126021 · Cited by 43
Fan, X., Wang, Y., Huo, Y., & Tian, Z. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3164339 · Cited by 43
Federated Learning and Proactive Computation Reuse at the Edge of Smart Homes
Nour, B., Cherkaoui, S., & Mlika, Z. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3131246 · Cited by 42
Prigent, C., Costan, A., Antoniu, G., & Cudennec, L. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.06.043 · Cited by 41
Byzantine-robust variance-reduced federated learning over distributed non-i.i.d. data
Peng, J., Wu, Z., Ling, Q. H., & Chen, T. (2022) · Information Sciences · doi:10.1016/j.ins.2022.10.120 · Cited by 40
Self-citationFederated Robustness Propagation: Sharing Adversarial Robustness in Heterogeneous Federated Learning
Hong, J., Wang, H., Wang, Z., & Zhou, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25955 · Cited by 39
Kapoor, A., & Kumar, D. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3434510 · Cited by 39
Straub, J. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107275 · Cited by 39
Towards multi-party targeted model poisoning attacks against federated learning systems
Chen, Z., Pu, T., Liao, W., & Yu, W. (2021) · High-Confidence Computing · doi:10.1016/j.hcc.2021.100002 · Cited by 39
Threats and Defenses in the Federated Learning Life Cycle: A Comprehensive Survey and Challenges
Li, Y., Guo, Z., Yang, N., Chen, H., Yuan, D., & Ding, W. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3563537 · Cited by 38
Gorbunov, E., Horváth, S., Richtárik, P., & Gidel, G. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.00529 · Cited by 37
CrowdGuard: Federated Backdoor Detection in Federated Learning
Rieger, P., Krauß, T., Miettinen, M., Dmitrienko, A., & Sadeghi, A.-R. (2024) · Proceedings 2024 Network and Distributed System Security Symposium · doi:10.14722/ndss.2024.23233 · Cited by 36
Byzantine-Robust Distributed Learning With Compression
Zhu, H., & Ling, Q. H. (2023) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2023.3265892 · Cited by 36
Self-citationToward Federated Learning Models Resistant to Adversarial Attacks
Hu, F., Zhou, W., Liao, K., Li, H., & Tong, D. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3272334 · Cited by 34
Dong, X., Wu, Z., Ling, Q. H., & Tian, Z. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3340028 · Cited by 32
Self-citationSynergizing Foundation Models and Federated Learning: A SurveyPreprint
Li, S., Ye, F., Fang, M., Zhao, J., Chan, Y.-H., Ngai, E. C. ‐., & Voigt, T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.12844 · Cited by 32
Federify: A Verifiable Federated Learning Scheme Based on zkSNARKs and Blockchain
Keshavarzkalhori, G., Pérez‐Solà, C., Navarro‐Arribas, G., Herrera‐Joancomartí, J., & Yajam, H. A. (2023) · IEEE Access · doi:10.1109/access.2023.3347039 · Cited by 31
Yang, H., Liu, H., Yuan, X., Wu, K. M., Ni, W., Zhang, J. A., & Liu, R. P. (2025) · Applied Sciences · doi:10.3390/app15126587 · Cited by 31
Malinovsky, G., Richtárik, P., Horváth, S., & Gorbunov, E. (2024) · neural information processing systems · doi:10.52202/079017-1102 · Cited by 31
Byzantine-Resilient Federated Machine Learning via Over-the-Air Computation
Huang, S., Zhou, Y., Wang, T., & Shi, Y. (2021) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops50388.2021.9473694 · Cited by 31
Byzantine-Resilient Resource Allocation Over Decentralized Networks
Wang, R., Liu, Y., & Ling, Q. H. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3209010 · Cited by 30
Self-citationNSPFL: A Novel Secure and Privacy-Preserving Federated Learning With Data Integrity Auditing
Zhang, Z., & Li, Y. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3379852 · Cited by 30
A Byzantine-Resilient Distributed Peer-to-Peer Energy Management Approach
Chang, X., Xu, Y., Guo, Q., Sun, H., & Chan, W. K. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3185140 · Cited by 29
Blades: A Unified Benchmark Suite for Byzantine Attacks and Defenses in Federated Learning
Li, S., Ngai, E. C. ‐., Ye, F., Ju, L., Zhang, T., & Voigt, T. (2024) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1109/iotdi61053.2024.00018 · Cited by 28
Federated Robustness Propagation: Sharing Robustness in Heterogeneous Federated LearningPreprint
Hong, J., Wang, H., Wang, Z., & Zhou, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10196 · Cited by 28
Federated learning with stochastic quantization
Li, Y., Li, W., & Xue, Z. (2022) · International Journal of Intelligent Systems · doi:10.1002/int.23056 · Cited by 27
Robust Federated Learning via Over-the-Air Computation
Sifaou, H., & Li, G. Y. (2022) · Machine learning for signal processing ... · doi:10.1109/mlsp55214.2022.9943401 · Cited by 27
FLAD: Byzantine-Robust Federated Learning Based on Gradient Feature Anomaly Detection
Tang, P., Zhu, X., Qiu, W., Huang, Z. R., Mu, Z., & Li, S. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3542437 · Cited by 26
Communication-Efficient Online Federated Learning Strategies for Kernel Regression
Gogineni, V. C., Werner, S., Huang, Y.-F., & Kuh, A. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3218484 · Cited by 26
Kaheni, M., Lippi, M., Gasparri, A., & Franceschelli, M. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3350387 · Cited by 25
FedMP: A multi-pronged defense algorithm against Byzantine poisoning attacks in federated learning
Zhao, K., Wang, L., Yu, F., Zeng, B., & Pang, Z. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110990 · Cited by 24
Federated Learning Resilient to Byzantine Attacks and Data Heterogeneity
Zuo, S., Yan, X., Fan, R., Hu, H., Shan, H., Quek, T. Q. S., & Zhao, P. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3571058 · Cited by 24
Robust Distributed Optimization With Randomly Corrupted Gradients
Turan, B., Uribe, C. A., Wai, H.-T., & Alizadeh, M. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3185885 · Cited by 24
On the Pitfalls of Security Evaluation of Robust Federated Learning
Khan, M. A., Shejwalkar, V., Houmansadr, A., & Anwar, F. M. (2023) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw59333.2023.00011 · Cited by 23
Physical Trajectory Inference Attack and Defense in Decentralized POI Recommendation
Long, J., Chen, T., Ye, G., Zheng, K., Nguyen, Q. V. H., & Yin, H. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645410 · Cited by 23
Self-citationRobust Training in High Dimensions via Block Coordinate Geometric Median DescentPreprint
Acharya, A., Hashemi, A., Jain, P., Sanghavi, S., Dhillon, I. S., & Topcu, U. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08882 · Cited by 23
Byzantine Fault-Tolerance in Federated Local SGD Under $2f$-Redundancy
Gupta, N., Doan, T. T., & Vaidya, N. H. (2023) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2023.3237489 · Cited by 22
Almutairi, S., & Barnawi, A. (2024) · Results in Engineering · doi:10.1016/j.rineng.2024.103295 · Cited by 22
Defending against Poisoning Backdoor Attacks on Federated Meta-learning
Chen, C.-L., Babakniya, S., Paolieri, M., & Golubchik, L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3523062 · Cited by 22
SF-CABD: Secure Byzantine fault tolerance federated learning on Non-IID data
Lin, X., Li, Y., Xie, X., Ding, Y., Wu, X., & Ge, C. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111851 · Cited by 21
BlockFLow: Decentralized, Privacy-Preserving, and Accountable Federated Machine Learning
Mugunthan, V., Rahman, R., & Kagal, L. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-86162-9_23 · Cited by 21
Poisoning Semi-supervised Federated Learning via Unlabeled Data: Attacks and DefensesPreprint
Liu, Y., Yuan, X., Zhao, R., Wang, C., Niyato, D. T., & Zheng, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04432 · Cited by 21
Securing Federated Learning against Overwhelming Collusive Attackers
Ranjan, P., Gupta, A., Corò, F., & Das, S. K. (2022) · Globecom · doi:10.1109/globecom48099.2022.10000830 · Cited by 20
FedGuard: Selective Parameter Aggregation for Poisoning Attack Mitigation in Federated Learning
Chelli, M., Prigent, C., Schubotz, R., Costan, A., Antoniu, G., Cudennec, L., & Slusallek, P. (2023) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster52292.2023.00014 · Cited by 20
Zhou, X., & Yang, G. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120167 · Cited by 19
An Optimal Two-Step Approach for Defense Against Poisoning Attacks in Federated Learning
Ali, Y., Han, K., Majeed, A., Lim, J. S., & Hwang, S. O. (2025) · IEEE Access · doi:10.1109/access.2025.3556906 · Cited by 18
Byzantine-Resilient Over-the-Air Federated Learning Under Zero-Trust Architecture
Yao, J., Shi, W., Xu, W., Yang, Z., Swindlehurst, A. L., & Niyato, D. T. (2025) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2025.3560046 · Cited by 18
ELITE: Defending Federated Learning against Byzantine Attacks based on Information Entropy
Wang, Y., Xia, Y., & Zhan, Y. (2021) · China Automation Congress (CAC) · doi:10.1109/cac53003.2021.9727486 · Cited by 18
RC-SSFL: Towards Robust and Communication-efficient Semi-supervised Federated Learning System.Preprint
Liu, Y., Yuan, X., Zhao, R., Zheng, Y., & Zheng, Y. (2020) · arXiv (Cornell University) · Cited by 18
BPS-FL: Blockchain-Based Privacy-Preserving and Secure Federated Learning
Yu, J., Yao, H., Ouyang, K., Cao, X., & Zhang, L. (2024) · Big Data Mining and Analytics · doi:10.26599/bdma.2024.9020053 · Cited by 17
Federated Multiarmed Bandits Under Byzantine Attacks
Saday, A., Demirel, İ., Yıldırım, Y., & Tekin, C. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3524954 · Cited by 17
Large-scale machine learning with fast and stable stochastic conjugate gradient
Yang, Z. (2022) · Computers & Industrial Engineering · doi:10.1016/j.cie.2022.108656 · Cited by 17
Communication-efficient and Byzantine-robust distributed learning with statistical guarantee
Zhou, X., Chang, L., Xu, P., & Lv, S. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109312 · Cited by 17
Optimal query complexity for private sequential learning against eavesdroppingPreprint
Xu, J., Xu, K., & Yang, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09836 · Cited by 17
Metadata
- Authors
- Wu, Z., Ling, Q., Chen, T., & Giannakis, G. B.
- Affiliations
- Sun Yat-sen University (CN)
- Rensselaer Polytechnic Institute (US)
- University of Minnesota (US)
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2020
- Volume
- 68
- Pages
- 4583-4596
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W3046449784
- Cited by
- 226
- References
- 51
- Citations by year
- 2026: 22 · 2025: 45 · 2024: 41 · 2023: 40 · 2022: 38 · 2021: 32 · 2020: 8
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- NSF (61573331, 61973324, 1509040, 1508993, 1711471, 1901134)
- Fundamental Research Funds for the Central Universities
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Engineering › Control and Systems Engineering › Distributed Control Multi-Agent Systems
- Keywords
- federated learning, Byzantine attacks, variance reduction, stochastic gradient descent, sagas, geometric median, robust aggregation, distributed optimization, finite-sum optimization, linear convergence, malicious workers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.