The Impact of Adversarial Attacks on Federated Learning: A Survey
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Federated learning (FL) has emerged as a powerful machine learning technique that enables the development of models from decentralized data sources. However, the decentralized nature of FL makes it vulnerable to adversarial attacks. In this survey, we provide a comprehensive overview of the impact of malicious attacks on FL by covering various aspects such as attack budget, visibility, and generalizability, among others. Previous surveys have primarily focused on the multiple types of attacks and defenses but failed to consider the impact of these attacks in terms of their budget, visibility, and generalizability. This survey aims to fill this gap by providing a comprehensive understanding of the attacks' effect by identifying FL attacks with low budgets, low visibility, and high impact. Additionally, we address the recent advancements in the field of adversarial defenses in FL and highlight the challenges in securing FL. The contribution of this survey is threefold: first, it provides a comprehensive and up-to-date overview of the current state of FL attacks and defenses. Second, it highlights the critical importance of considering the impact, budget, and visibility of FL attacks. Finally, we provide ten case studies and potential future directions towards improving the security and privacy of FL systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks
Lee, K., Lee, K., Lee, H., & Shin, J. (2018) · arXiv · doi:10.48550/arxiv.1807.03888 · Cited by 2,450
Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400 · cited 1×
“Examples include NbAFL [146], Hu et al. [147], Triastcyn et al. [79], Pix-elDP [148], and 2DP-FL [149].”
BackgroundHow to backdoor federated learning
Bagdasaryan, E., Veit, A., Hua, Y., Estrin, D., & Shmatikov, V. (2018) · arXiv · doi:10.48550/arxiv.1807.00459 · Cited by 1,495
A survey on security and privacy of federated learning
Mothukuri, V., Parizi, R. M., Pouriyeh, S., Huang, Y., Dehghantanha, A., & Srivastava, G. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.007 · Cited by 1,480
Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
Hitaj, B., Ateniese, G., & Perez-Cruz, F. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134012 · Cited by 1,377 · cited 2×
“In HFL, clients with distinct samples but common features are vulnerable to feature inference attacks [78].”
BackgroundThe Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · arXiv · doi:10.48550/arxiv.1604.01685 · Cited by 1,174
Federated Learning for Mobile Keyboard Prediction
Hard, A., Rao, K., Mathews, R., Ramaswamy, S., Beaufays, F., Augenstein, S., Eichner, H., Kiddon, C., & Ramage, D. (2018) · arXiv · doi:10.48550/arxiv.1811.03604 · Cited by 1,148
Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
Yin, D., Chen, Y., Ramchandran, K., & Bartlett, P. (2018) · arXiv · doi:10.48550/arxiv.1803.01498 · Cited by 1,130
FLTrust: Byzantine-robust Federated Learning via Trust Bootstrapping
Cao, X., Fang, M., Liu, J., & Gong, N. Z. (2021) · Proceedings 2021 Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24434 · Cited by 999
Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning
Wang, Z., Song, M., Zhang, Z., Song, Y., Wang, Q., & Qi, H. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737416 · Cited by 881
Local Model Poisoning Attacks to Byzantine-Robust Federated Learning
Fang, M., Cao, X., Jia, J., & Gong, N. Z. (2019) · arXiv · doi:10.48550/arxiv.1911.11815 · Cited by 828
Analyzing Federated Learning through an Adversarial Lens
Bhagoji, A. N., Chakraborty, S., Mittal, P., & Calo, S. (2018) · arXiv · doi:10.48550/arxiv.1811.12470 · Cited by 703
The Hidden Vulnerability of Distributed Learning in Byzantium
Mhamdi, E. M. E., Guerraoui, R., & Rouault, S. (2018) · arXiv · doi:10.48550/arxiv.1802.07927 · Cited by 648
A secure federated transfer learning framework
Liu, Y., Kang, Y., Xing, C., Chen, T., & Yang, Q. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2988525 · Cited by 645
Secure Federated Transfer Learning
Liu, Y., Kang, Y., Xing, C., Chen, T., & Yang, Q. (2018) · arXiv · doi:10.48550/arxiv.1812.03337 · Cited by 645
Manipulating the Byzantine: Optimizing Model Poisoning Attacks and Defenses for Federated Learning
Shejwalkar, V., & Houmansadr, A. (2021) · Proceedings 2021 Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24498 · Cited by 615 · cited 1×
“In the white-box setting [17], [50], the attacker has full access to model parameters and predictions, making it vulnerable to sophisticated model poisoning attacks.”
BackgroundDistributed denial of service attacks
Lau, F., Rubin, S. H., Smith, M. H., & Trajkovic, L. (2002) · SMC 2000 Conference Proceedings. 2000 IEEE International Conference on Systems, Man and Cybernetics. 'Cybernetics Evolving to Systems, Humans, Organizations, and their Complex Interactions' (Cat. No.00CH37166) · doi:10.1109/icsmc.2000.886455 · Cited by 582
Bandi, P., Geessink, O., Manson, Q., Van Dijk, M., Balkenhol, M., Hermsen, M., Ehteshami Bejnordi, B., Lee, B., Paeng, K., Zhong, A., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2867350 · Cited by 569
Privacy and Robustness in Federated Learning: Attacks and Defenses
Lyu, L., Yu, H., Ma, X., Chen, C., Sun, L., Zhao, J., Yang, Q., & Yu, P. S. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3216981 · Cited by 548
Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data
Papernot, N., Abadi, M., Erlingsson, Ú., Goodfellow, I., & Talwar, K. (2016) · arXiv · doi:10.48550/arxiv.1610.05755 · Cited by 492
Attack of the tails: Yes, you really can backdoor federated learning
Wang, H., Sreenivasan, K., Rajput, S., Vishwakarma, H., Agarwal, S., Sohn, J.-Y., Lee, K., & Papailiopoulos, D. (2020) · arXiv · doi:10.48550/arxiv.2007.05084 · Cited by 406
Privacy preservation in federated learning: An insightful survey from the GDPR perspective
Truong, N., Sun, K., Wang, S., Guitton, F., & Guo, Y. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102402 · Cited by 399
Homomorphic Encryption-Based Privacy-Preserving Federated Learning in IoT-Enabled Healthcare System
Zhang, L., Xu, J., Vijayakumar, P., Sharma, P. K., & Ghosh, U. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3185327 · Cited by 376
ShieldFL: Mitigating Model Poisoning Attacks in Privacy-Preserving Federated Learning
Ma, Z., Ma, J., Miao, Y., Li, Y., & Deng, R. H. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3169918 · Cited by 371
Biscotti: A blockchain system for private and secure federated learning
Shayan, M., Fung, C., Yoon, C. J. M., & Beschastnikh, I. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3044223 · Cited by 354
Privacy-Enhanced Federated Learning Against Poisoning Adversaries
Liu, X., Li, H., Xu, G., Chen, Z., Huang, X., & Lu, R. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3108434 · Cited by 351
Personalized Federated Learning With Differential Privacy
Hu, R., Guo, Y., Li, H., Pei, Q., & Gong, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2991416 · Cited by 350
Data Poisoning Attacks on Federated Machine Learning
Sun, G., Cong, Y., Dong, J., Wang, Q., Lyu, L., & Liu, J. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3128646 · Cited by 310
Rodríguez-Barroso, N., Jiménez-López, D., Luzón, M. V., Herrera, F., & Martínez-Cámara, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.011 · Cited by 296
Shejwalkar, V., Houmansadr, A., Kairouz, P., & Ramage, D. (2022) · 2022 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46214.2022.9833647 · Cited by 292
PoisonGAN: Generative Poisoning Attacks Against Federated Learning in Edge Computing Systems
Zhang, J., Chen, B., Cheng, X., Binh, H. T. T., & Yu, S. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3023126 · Cited by 291 · cited 2×
“Utility-centric threats involve poi-soningdataormodelsandcompromisingtheaccuracy[11],[12], [13].”
BackgroundVulnerabilities in federated learning
Bouacida, N., & Mohapatra, P. (2021) · IEEE Access · doi:10.1109/access.2021.3075203 · Cited by 248
A Taxonomy of Attacks on Federated Learning
Jere, M. S., Farnan, T., & Koushanfar, F. (2021) · IEEE Security & Privacy · doi:10.1109/msec.2020.3039941 · Cited by 217
Poisoning attacks in federated learning: A survey
Xia, G., Chen, J., Yu, C., & Ma, J. (2023) · IEEE Access · doi:10.1109/access.2023.3238823 · Cited by 212
BaFFLe: Backdoor Detection via Feedback-based Federated Learning
Andreina, S., Marson, G. A., Mollering, H., & Karame, G. (2021) · 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs51616.2021.00086 · Cited by 205
DeepSight: Mitigating Backdoor Attacks in Federated Learning Through Deep Model Inspection
Rieger, P., Nguyen, T. D., Miettinen, M., & Sadeghi, A.-R. (2022) · Proceedings 2022 Network and Distributed System Security Symposium · doi:10.14722/ndss.2022.23156 · Cited by 202 · cited 1×
“Examples include SIREN [109], DeepSight [110], Biscotti [111], and FL-Defender [112].”
MethodPoisoning Attacks on Federated Learning-based IoT Intrusion Detection System
Nguyen, T. D., Rieger, P., Miettinen, M., & Sadeghi, A.-R. (2020) · Proceedings 2020 Workshop on Decentralized IoT Systems and Security · doi:10.14722/diss.2020.23003 · Cited by 200
Provably Secure Federated Learning against Malicious Clients
Cao, X., Jia, J., & Gong, N. Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16849 · Cited by 141
GAN Enhanced Membership Inference: A Passive Local Attack in Federated Learning
Zhang, J., Zhang, J., Chen, J., & Yu, S. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148790 · Cited by 133
Challenges and future directions of secure federated learning: a survey
Zhang, K., Song, X., Zhang, C., & Yu, S. (2022) · Frontiers of Computer Science · doi:10.1007/s11704-021-0598-z · Cited by 127
FL-Defender: Combating targeted attacks in federated learning
Jebreel, N. M., & Domingo-Ferrer, J. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110178 · Cited by 110
SCA: Sybil-Based Collusion Attacks of IIoT Data Poisoning in Federated Learning
Xiao, X., Tang, Z., Li, C., Xiao, B., & Li, K. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3172310 · Cited by 99
Towards Federated Learning against Noisy Labels via Local Self-Regularization
Jiang, X., Sun, S., Wang, Y., & Liu, M. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557475 · Cited by 65 · cited 1×
“Examples include LSR [94], ConTre [95], and Su et al. [96].”
BackgroundADFL: A Poisoning Attack Defense Framework for Horizontal Federated Learning
Guo, J., Li, H., Huang, F., Liu, Z., Peng, Y., Li, X., Ma, J., Menon, V. G., & Igorevich, K. K. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3156645 · Cited by 49 · cited 1×
“The primary challenge in HFL is ensuring that the aggregated model accurately represents the clients’ data while simultaneously upholding privacy and security concerns [45].”
BackgroundDefense against backdoor attack in federated learning
Lu, S., Li, R., Liu, W., & Chen, X. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102819 · Cited by 48 · cited 1×
“Examples include LoMar [97], Federated Reverse [98], DDaBA [99], SecFedNIDS [100], PA-SM [101], Density-based anomaly detection [102], BaFFLe [103], KPCA [104], and Mahal-nobix distance-based detection [105].”
MethodBeyond class-level privacy leakage: breaking record-level privacy in federated learning
Yuan, X., Ma, X., Zhang, L., Fang, Y., & Wu, D. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3089713 · Cited by 45
Hallaji, E., Razavi-Far, R., Saif, M., & Herrera-Viedma, E. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110384 · Cited by 41 · cited 1×
“Examples of this strategy include FAT [81], FedDynAT [82], and GALP [83].”
MethodDefense Strategies Toward Model Poisoning Attacks in Federated Learning: A Survey
Wang, Z., Kang, Q., Zhang, X., & Hu, Q. (2022) · 2022 IEEE Wireless Communications and Networking Conference (WCNC) · doi:10.1109/wcnc51071.2022.9771619 · Cited by 41
Practical Attribute Reconstruction Attack Against Federated Learning
Chen, C., Lyu, L., Yu, H., & Chen, G. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2022.3159236 · Cited by 30
Semi-Targeted Model Poisoning Attack on Federated Learning via Backward Error Analysis
Sun, Y., Ochiai, H., & Sakuma, J. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891990 · Cited by 28
Cited by
A Survey of Security Strategies in Federated Learning: Defending Models, Data, and Privacy
Manzoor, H. U., Shabbir, A., Chen, A., Flynn, D., & Zoha, A. (2024) · Future Internet · doi:10.3390/fi16100374 · Cited by 58
Threats and Defenses in the Federated Learning Life Cycle: A Comprehensive Survey and Challenges
Li, Y., Guo, Z., Yang, N., Chen, H., Yuan, D., & Ding, W. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3563537 · Cited by 38
“While all types of threats can potentially occur in FL-based applications and cause negative impacts, domain-specific heterogeneity leads to varying levels of risk, making certain attacks more critical in di ff erent fields [23], [24].”
Metadata
- Authors
- Kumar, K. N., Mohan, C. K., & Cenkeramaddi, L. R.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-05
- Volume
- 46
- Issue
- 5
- Pages
- 2672-2691
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4387449166
- Cited by
- 180
- References
- 53
- FWCI
- 15.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.