Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Open accessAbstract
Federated learning (FL), as a type of distributed machine learning, is capable of significantly preserving clients’ private data from being exposed to adversaries. Nevertheless, private information can still be divulged by analyzing uploaded parameters from clients, e.g., weights trained in deep neural networks. In this paper, to effectively prevent information leakage, we propose a novel framework based on the concept of differential privacy (DP), in which artificial noise is added to parameters at the clients’ side before aggregating, namely, noising before model aggregation FL (NbAFL). First, we prove that the NbAFL can satisfy DP under distinct protection levels by properly adapting different variances of artificial noise. Then we develop a theoretical convergence bound on the loss function of the trained FL model in the NbAFL. Specifically, the theoretical bound reveals the following three key properties: 1) there is a tradeoff between convergence performance and privacy protection levels, i.e., better convergence performance leads to a lower protection level; 2) given a fixed privacy protection level, increasing the number$N$of overall clients participating in FL can improve the convergence performance; and 3) there is an optimal number aggregation times (communication rounds) in terms of convergence performance for a given protection level. Furthermore, we propose a$K$-client random scheduling strategy, where$K$($1\leq K< N$) clients are randomly selected from the$N$overall clients to participate in each aggregation. We also develop a corresponding convergence bound for the loss function in this case and the$K$-client random scheduling strategy also retains the above three properties. Moreover, we find that there is an optimal$K$that achieves the best convergence performance at a fixed privacy level. Evaluations demonstrate that our theoretical results are consistent with simulations, thereby facilitating the design of various privacy-preserving FL algorithms with different tradeoff requirements on convergence performance and privacy levels.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Differentially private training algorithms mitigate information leakage from both collaborator model updates and global consensus aggregated models.
“Differentially private training algorithms62–64 allow for mitigation of information leakage from both the collaborator model updates and the global consensus aggregated models.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [63]
In federated learning, differential privacy is utilized by adding noise to the parameters exchanged by participants before model aggregation at the server side.
“When it comes to FL, to prevent information leakage the concept of DPis utilized by adding noise to the parameters that are exchanged by the participants before model aggregation at the server side [25].”
From A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems (2023) · cites this paper as [25]
Differential privacy-based FL methods using perceptron, SVM, and logistic regression achieve competitive accuracy compared to traditional FL schemes.
“Three ML models are employed, including perceptron, support vector machine (SVM), and logistic regression, to perform FL training, showing that a competitive accuracy performance is achieved by using differential privacy-based FL methods compared to traditional FL schemes.”
From Federated learning for smart healthcare: A survey (2023) · cites this paper as [82]
Differential privacy can protect training datasets against data breach.
“This can be done by using perturbation techniques [25] such as differential privacy can be used to protect training datasets against data breach, by constructing composition theorems with complex mathematical solutions.”
From Federated learning meets blockchain in edge computing: Opportunities and challenges (2021) · cites this paper as [25]
Differential privacy techniques degrade model performance or require additional conditions that are not suitable for IoT networks, especially high computing power.
“Although some techniques have been used to overcome this problem, including differential privacy [166], these approaches degrade model performance or require additional conditions that are not suitable for IoT networks, especially high computing power [167].”
From Federated Deep Learning for Cyber Security in the Internet of Things: Concepts, Applications, and Experimental Analysis (2021) · cites this paper as [166]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215 · see citing works
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · see citing works
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · see citing works
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210 · see citing works
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557 · see citing works
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023 · see citing works
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856 · see citing works
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766 · see citing works
Introductory Lectures on Convex Optimization: A Basic Course
Нестеров, Ю. Е. (2014) · Medical Entomology and Zoology · Cited by 3,576 · see citing works
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961 · see citing works
Privacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356 · see citing works
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232 · see citing works
RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Response
Erlingsson, Ú., Pihur, V., & Korolova, A. (2014) · Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2660267.2660348 · Cited by 1,838 · see citing works
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471 · see citing works
Differentially Private Federated Learning: A Client Level Perspective
Geyer, R. C., Klein, T., & Nabi, M. (2017) · arXiv · doi:10.48550/arxiv.1712.07557 · Cited by 1,052 · see citing works
In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030 · cited 1× · see citing works
“However, FL also poses several key challenges, such as private information leakage, expensive communication costs between servers and clients, and device variability [9]–[15].”
BackgroundA Hybrid Approach to Privacy-Preserving Federated Learning
Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., & Zhou, Y. (2019) · Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3338501.3357370 · Cited by 1,029 · see citing works
Federated Learning over Wireless Networks: Optimization Model Design and Analysis
Tran, N. H., Bao, W., Zomaya, A. Y., Nguyen, M. N. H., & Hong, C. (2019) · IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737464 · Cited by 943 · see citing works
Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning
Wang, Z., Song, M., Zhang, Z., Song, Y., Wang, Q., & Qi, H. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737416 · Cited by 881 · see citing works
Learning Differentially Private Recurrent Language Models
McMahan, H. B., Ramage, D., Talwar, K., & Zhang, L. (2017) · arXiv · doi:10.48550/arxiv.1710.06963 · Cited by 849 · see citing works
Lian, X., Zhang, C., Zhang, H., Hsieh, C., Zhang, W., & Liu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09056 · Cited by 843 · see citing works
Blum, A. L., Dwork, C., McSherry, F., & Kobbi Nissim, B. (2005) · ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS) · doi:10.1145/1065167.1065184 · Cited by 812 · see citing works
Scheduling Policies for Federated Learning in Wireless Networks
Yang, H. H., Liu, Z., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2944169 · Cited by 640 · see citing works
Self-citationCollecting and Analyzing Multidimensional Data with Local Differential Privacy
Wang, N., Xiao, X., Yang, Y., Zhao, J., Hui, S. C., Shin, H., Shin, J., & Yu, G. (2019) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2019.00063 · Cited by 408 · see citing works
Asynchronous Parallel Stochastic Gradient for Nonconvex OptimizationPreprint
Lian, X., Huang, Y., Li, Y., & Liu, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.08272 · Cited by 368 · see citing works
A generic framework for privacy preserving deep learning
Ryffel, T., Trask, A., Dahl, M., Wagner, B., Mancuso, J., Rueckert, D., & Passerat-Palmbach, J. (2018) · arXiv · doi:10.48550/arxiv.1811.04017 · Cited by 335 · see citing works
Ma, Z., Xiao, M., Xiao, Y., Pang, Z., Poor, H. V., & Vucetic, B. S. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2907245 · Cited by 324 · see citing works
Distributed delayed stochastic optimization
Agarwal, A., & Duchi, J. C. (2012) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2012.6426626 · Cited by 318 · see citing works
On Safeguarding Privacy and Security in the Framework of Federated Learning
Ma, C., Li, J., Ding, M., Yang, H. H., Shu, F., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Network · doi:10.1109/mnet.001.1900506 · Cited by 318 · see citing works
Self-citationAI-Enhanced Offloading in Edge Computing: When Machine Learning Meets Industrial IoT
Sun, W. Y., Liu, J., & Yue, Y. (2019) · IEEE Network · doi:10.1109/mnet.001.1800510 · Cited by 220 · see citing works
Towards Efficient and Privacy-Preserving Federated Deep Learning
Hao, M., Li, H., Xu, G., Liu, S., & Yang, H. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761267 · Cited by 213 · see citing works
Self-citationAge-Based Scheduling Policy for Federated Learning in Mobile Edge Networks
Yang, H., Arafa, A. M., Quek, T. Q. S., & Poor, H. (2019) · IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp40776.2020.9053740 · Cited by 190 · see citing works
Self-citationThe Value of Collaboration in Convex Machine Learning with Differential Privacy
Wu, N., Farokhi, F., Smith, D. B., & Kâafar, M. A. (2020) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40000.2020.00025 · Cited by 132 · see citing works
Self-citationDeep Learning for Distributed Optimization: Applications to Wireless Resource Management
Lee, H., Lee, S. H., & Quek, T. Q. S. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933890 · Cited by 129 · see citing works
Self-citationLocal Differential Private Data Aggregation for Discrete Distribution Estimation
Wang, S., Huang, L., Nie, Y., Zhang, X., Wang, P., Xu, H., & Yang, W. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2019.2899097 · Cited by 83 · see citing works
Differentially Private Meta-Learning
Li, J., Khodak, M., Caldas, S., & Talwalkar, A. (2019) · arXiv · doi:10.48550/arxiv.1909.05830 · Cited by 82 · see citing works
Self-citationA Hybrid Approach to Privacy-Preserving Federated LearningPreprint
Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., & Zhou, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03224 · Cited by 66 · see citing works
Contract-Based Small-Cell Caching for Data Disseminations in Ultra-Dense Cellular Networks
Li, J., Chu, S., Shu, F., Wu, J. H., & Jayakody, D. N. K. (2018) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2853746 · Cited by 48 · see citing works
Self-citationOn Safeguarding Privacy and Security in the Framework of Federated LearningPreprint
Ma, C., Li, J., Ding, M., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06512 · Cited by 17 · see citing works
Self-citationAdaptive Task Allocation for Asynchronous Federated Mobile Edge LearningPreprint
Mohammad, U., & Sorour, S. (2019) · arXiv (Cornell University) · Cited by 15 · see citing works
The Value of Collaboration in Convex Machine Learning with Differential PrivacyPreprint
Wu, N., Farokhi, F., Smith, D. B., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09679 · Cited by 6 · see citing works
Self-citationAdaptive Task Allocation for Asynchronous Federated and Parallelized Mobile Edge LearningPreprint
Mohammad, U., & Sorour, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01656 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S. & Poor, H. V. (2020). Federated Learning with Differential Privacy: Algorithms and Performance Analysis. IEEE Transactions on Information Forensics and Security, 15, pp.3454-3469. https://doi.org/10.1109/TIFS.2020.2988575. Persistent Link: http://hdl.handle.net/11343/251362 File Description: Accepted version
Cited by
Sorted by citations
A survey on security and privacy of federated learning
Mothukuri, V., Parizi, R. M., Pouriyeh, S., Huang, Y., Dehghantanha, A., & Srivastava, G. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.007 · Cited by 1,480 · see citing works
Federated learning on non-IID data: A survey
Zhu, H., Xu, J., Liu, S., & Jin, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.098 · Cited by 1,062 · see citing works
Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892 · see citing works
Federated learning for smart healthcare: A survey
Nguyen, D. C., Pham, Q.-V., Pathirana, P. N., Ding, M., Seneviratne, A., Lin, Z., Dobre, O., & Hwang, W.-J. (2023) · ACM Computing Surveys · doi:10.1145/3501296 · Cited by 827 · see citing works
Self-citationA Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774 · see citing works
Self-citationFederated learning meets blockchain in edge computing: Opportunities and challenges
Nguyen, D. C., Ding, M., Pham, Q.-V., Pathirana, P. N., Le, L. B., Seneviratne, A., Li, J., Niyato, D., & Poor, H. V. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3072611 · Cited by 661 · see citing works
Self-citationYin, X., Zhu, Y., & Hu, J. (2022) · ACM Computing Surveys · doi:10.1145/3460427 · Cited by 638 · see citing works
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612 · see citing works
“It has also been applied to single- and multi-machine computing environments, and integrated with ML models for protecting model privacy [2, 120, 349].”
MethodXu, M., Ng, W. C., Lim, W. Y. B., Kang, J., Xiong, Z., Niyato, D. T., Yang, Q., Shen, X., & Miao, C. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3221119 · Cited by 588 · see citing works
Federated learning review: Fundamentals, enabling technologies, and future applications
Banabilah, S., Aloqaily, M., Alsayed, E., Malik, N., & Jararweh, Y. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103061 · Cited by 556 · see citing works
Privacy preservation in federated learning: An insightful survey from the GDPR perspective
Truong, N., Sun, K., Wang, S., Guitton, F., & Guo, Y. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102402 · Cited by 399 · see citing works
Federated learning enables big data for rare cancer boundary detection
Pati, S., Baid, U., Edwards, B., Sheller, M., Wang, S.-H., Reina, G. A., Foley, P., Gruzdev, A., Karkada, D., Davatzikos, C., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33407-5 · Cited by 394 · see citing works
Homomorphic Encryption-Based Privacy-Preserving Federated Learning in IoT-Enabled Healthcare System
Zhang, L., Xu, J., Vijayakumar, P., Sharma, P. K., & Ghosh, U. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3185327 · Cited by 376 · see citing works
Federated Learning for 6G: Applications, Challenges, and Opportunities
Yang, Z.-H., Chen, M., Wong, K.-K., Poor, H., & Cui, S. (2021) · Engineering · doi:10.1016/j.eng.2021.12.002 · Cited by 356 · see citing works
From distributed machine learning to federated learning: a survey
Liu, J., Huang, J., Zhou, Y., Li, X., Ji, S., Xiong, H., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01664-x · Cited by 374 · see citing works
Federated Learning in Edge Computing: A Systematic Survey
Abreha, H. G., Hayajneh, M., & Serhani, M. A. (2022) · Sensors · doi:10.3390/s22020450 · Cited by 366 · see citing works
Collaborative Federated Learning for Healthcare: Multi-Modal COVID-19 Diagnosis at the Edge
Qayyum, A., Ahmad, K., Ahsan, M. A., Al-Fuqaha, A., & Qadir, J. (2022) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2022.3206407 · Cited by 345 · see citing works
Ferrag, M. A., Friha, O., Maglaras, L., Janicke, H., & Shu, L. (2021) · IEEE Access · doi:10.1109/access.2021.3118642 · Cited by 342 · see citing works
Asynchronous federated learning on heterogeneous devices: A survey
Xu, C., Qu, Y., Xiang, Y., & Gao, L. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100595 · Cited by 366 · see citing works
Blockchain-Based Federated Learning for Securing Internet of Things: A Comprehensive Survey
Issa, W., Moustafa, N., Turnbull, B., Sohrabi, N., & Tari, Z. (2022) · ACM Computing Surveys · doi:10.1145/3560816 · Cited by 338 · see citing works
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning
So, J., Guler, B., & Avestimehr, A. S. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3054610 · Cited by 318 · see citing works
VeriFL: Communication-Efficient and Fast Verifiable Aggregation for Federated Learning
Guo, X., Liu, Z., Li, J., Gao, J., Hou, B., Dong, C., & Baker, T. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3043139 · Cited by 319 · see citing works
Self-citationFederated Learning in Smart City Sensing: Challenges and Opportunities
Jiang, J. C., Kantarcı, B., Oktuğ, S., & Soyata, T. (2020) · Sensors · doi:10.3390/s20216230 · Cited by 322 · see citing works
Decentralized Federated Learning: A Survey and Perspective
Yuan, L., Wang, Z., Sun, L., Yu, P. S., & Brinton, C. G. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3407584 · Cited by 324 · see citing works
Blockchain-empowered Federated Learning: Challenges, Solutions, and Future Directions
Zhu, J., Cao, J., Saxena, D., Jiang, S., & Ferradi, H. (2023) · ACM Computing Surveys · doi:10.1145/3570953 · Cited by 309 · see citing works
Privacy-Preserving Byzantine-Robust Federated Learning via Blockchain Systems
Miao, Y., Liu, Z., Li, H., Choo, K.-K. R., & Deng, R. H. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3196274 · Cited by 303 · see citing works
Ramu, S. P., Boopalan, P., Pham, Q.-V., Maddikunta, P. K. R., Huynh-The, T., Alazab, M., Nguyen, T. T., & Gadekallu, T. R. (2022) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103663 · Cited by 301 · see citing works
User-Level Privacy-Preserving Federated Learning: Analysis and Performance Optimization
Wei, K., Li, J., Ding, M., Ma, C., Su, H., Zhang, B., & Poor, H. V. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3056991 · Cited by 300 · see citing works
Self-citationA Survey on Intelligent Internet of Things: Applications, Security, Privacy, and Future Directions
Aouedi, O., Vu, T.-H., Sacco, A., Nguyen, D. C., Piamrat, K., Marchetto, G., & Pham, Q. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3430368 · Cited by 318 · see citing works
A survey of federated learning for edge computing: Research problems and solutions
Xia, Q., Ye, W., Tao, Z., Wu, J., & Li, Q. (2021) · High-Confidence Computing · doi:10.1016/j.hcc.2021.100008 · Cited by 290 · see citing works
FedProc: Prototypical contrastive federated learning on non-IID data
Mu, X., Shen, Y., Cheng, K., Geng, X., Fu, J., Zhang, T., & Zhang, Z. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.01.019 · Cited by 288 · see citing works
Edge Intelligence: Empowering Intelligence to the Edge of Network
Xu, D., Li, T., Li, Y., Su, X. J., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 281 · see citing works
Machine Learning-Powered Encrypted Network Traffic Analysis: A Comprehensive Survey
Shen, M., Ye, K., Liu, X., Zhu, L., Kang, J., Yu, S., Li, Q. L., & Xu, K. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3208196 · Cited by 286 · see citing works
A Federated Learning Based Privacy-Preserving Smart Healthcare System
Li, J., Meng, Y., Ma, L., Du, S., Zhu, H., Pei, Q., & Shen, X. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3098010 · Cited by 265 · see citing works
Self-citationTrustworthy ai: A computational perspective
Liu, H., Wang, Y., Fan, W., Liu, X., Li, Y., Jain, S., Liu, Y., Jain, A., & Tang, J. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3546872 · Cited by 261 · see citing works
Evaluating Federated Learning for intrusion detection in Internet of Things: Review and challenges
Campos, E. M., Saura, P. F., González-Vidal, A., Hernández-Ramos, J. L., Bernabé, J. B., Baldini, G., & Skármeta, A. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108661 · Cited by 272 · see citing works
Threats, attacks and defenses to federated learning: issues, taxonomy and perspectives
Liu, P., Xu, X., & Wang, W. (2022) · Cybersecurity · doi:10.1186/s42400-021-00105-6 · Cited by 261 · see citing works
When Federated Learning Meets Privacy-Preserving Computation
Chen, J., Yan, H., Liu, Z., Zhang, M., Xiong, H., & Yu, S. (2024) · ACM Computing Surveys · doi:10.1145/3679013 · Cited by 260 · see citing works
Security and Privacy-Enhanced Federated Learning for Anomaly Detection in IoT Infrastructures
Cui, L., Qu, Y., Xie, G., Zeng, D., Li, R., Shen, S., & Yu, S. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3107783 · Cited by 243 · see citing works
Local differential privacy and its applications: A comprehensive survey
Yang, M., Guo, T., Zhu, T., Tjuawinata, I., Zhao, J., & Lam, K. (2023) · Computer Standards & Interfaces · doi:10.1016/j.csi.2023.103827 · Cited by 270 · see citing works
Privacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Liu, D., & Simeone, O. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036948 · Cited by 234 · see citing works
Li, J., Shao, Y., Wei, K., Ding, M., Ma, C., Shi, L. X., Han, Z., & Poor, H. V. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3138848 · Cited by 231 · see citing works
Self-citationFederated learning for secure IoMT-applications in smart healthcare systems: A comprehensive review
Rani, S., Kataria, A., Kumar, S., & Tiwari, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110658 · Cited by 228 · see citing works
Recent advances on federated learning: A systematic survey
Liu, B., Lv, N., Guo, Y., & Li, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128019 · Cited by 244 · see citing works
Cui, Q., You, X., Ni, W., Nan, G., Zhang, X., Zhang, J., Lyu, X., Ai, M., Tao, X., Feng, Z., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4337-1 · Cited by 244 · see citing works
Ouyang, X., Xie, Z., Zhou, J., Huang, J., & Xing, G. (2021) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3458864.3467681 · Cited by 220 · see citing works
Personalized Federated Learning With Differential Privacy and Convergence Guarantee
Wei, K., Li, J., Ma, C., Ding, M., Chen, W., Wu, J. H., Tao, M., & Poor, H. V. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3293417 · Cited by 217 · see citing works
Self-citationDifferential Privacy for Industrial Internet of Things: Opportunities, Applications, and Challenges
Jiang, B., Li, J., Yue, G., & Song, H. H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3057419 · Cited by 204 · see citing works
Self-citationFederated Neural Collaborative Filtering
Perifanis, V., & Efraimidis, P. S. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108441 · Cited by 212 · see citing works
Machine Learning for Financial Risk Management: A Survey
Mashrur, A., Luo, W., Zaidi, N. A., & Robles‐Kelly, A. (2020) · IEEE Access · doi:10.1109/access.2020.3036322 · Cited by 224 · see citing works
Xie, Q., Jiang, S., Jiang, L., Huang, Y., Zhao, Z., Khan, S., Dai, W., Liu, Z., & Wu, K. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3382875 · Cited by 209 · see citing works
Zhang, C., Zhang, S., Yu, J. J. Q., & Yu, S. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3055283 · Cited by 194 · see citing works
Yang, W., Xiang, W., Yang, Y. W., & Cheng, P. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3183465 · Cited by 192 · see citing works
The Impact of Adversarial Attacks on Federated Learning: A Survey
Kumar, K. N., Mohan, C. K., & Cenkeramaddi, L. R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3322785 · Cited by 191 · see citing works
Privacy Threat and Defense for Federated Learning With Non-i.i.d. Data in AIoT
Xiong, Z., Cai, Z., Takabi, D., & Li, W. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3073925 · Cited by 181 · see citing works
Federated Learning: A signal processing perspective
Gafni, T., Shlezinger, N., Cohen, K., Eldar, Y. C., & Poor, H. V. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3125282 · Cited by 179 · see citing works
Intrusion Detection Based on Privacy-Preserving Federated Learning for the Industrial IoT
Alcazar, P. R., Saura, P. F., Campos, E. M., González-Vidal, A., Hernández-Ramos, J. L., Bernabé, J. B., & Skármeta, A. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3126728 · Cited by 178 · see citing works
Kalapaaking, A. P., Khalil, I., Rahman, M. S., Atiquzzaman, M., Yi, X., & Almashor, M. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3170348 · Cited by 165 · see citing works
Duan, Q., Huang, J., Hu, S., Deng, R., Lu, Z., & Yu, S. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3316615 · Cited by 175 · see citing works
Blanco-Justicia, A., Domingo‐Ferrer, J., Mart́ınez, S., Sánchez, D., Flanagan, A., & Tan, K. E. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104468 · Cited by 169 · see citing works
Federated Learning in Intelligent Transportation Systems: Recent Applications and Open Problems
Zhang, S., Li, J., Shi, L. X., Ding, M., Nguyen, D. C., Tan, W., Weng, J., & Han, Z. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3324962 · Cited by 169 · see citing works
Self-citationEnabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160 · see citing works
Self-citationFederated Learning Over Wireless IoT Networks With Optimized Communication and Resources
Chen, H., Huang, S., Zhang, D., Xiao, M., Skoglund, M., & Poor, H. V. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3151193 · Cited by 156 · see citing works
Naeem, F., Ali, M., Kaddoum, G., Huang, C., & Yuen, C. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3273507 · Cited by 158 · see citing works
Moshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2023) · Electronics · doi:10.3390/electronics12102287 · Cited by 164 · see citing works
Large language models in law: A survey
Lai, J., Gan, W., Wu, J., Qi, Z., & Yu, P. S. (2024) · AI Open · doi:10.1016/j.aiopen.2024.09.002 · Cited by 182 · see citing works
Federated learning in smart cities: Privacy and security survey
Al-Huthaifi, R., Li, T., Huang, W. X., Gu, J., & Li, C. (2023) · Information Sciences · doi:10.1016/j.ins.2023.03.033 · Cited by 160 · see citing works
When the Curious Abandon Honesty: Federated Learning Is Not Private
Boenisch, F., Dziedzic, A., Schuster, R., Shamsabadi, A. S., Shumailov, I., & Papernot, N. (2023) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp57164.2023.00020 · Cited by 173 · see citing works
A Transfer Learning Approach to Breast Cancer Classification in a Federated Learning Framework
Tan, Y. N., Tinh, V. P., Lam, P. D., Nam, N. H., & Khoa, T. A. (2023) · IEEE Access · doi:10.1109/access.2023.3257562 · Cited by 149 · see citing works
Challenges, Applications and Design Aspects of Federated Learning: A Survey
Rahman, K. M. J., Ahmed, F., Akhter, N., Hasan, M., Amin, R., Aziz, K. E., Islam, A. K. M. M., Mukta, M. S. H., & Islam, A. K. M. N. (2021) · IEEE Access · doi:10.1109/access.2021.3111118 · Cited by 147 · see citing works
Short-Term Energy Consumption Forecasting at the Edge: A Federated Learning Approach
Savi, M., & Olivadese, F. (2021) · IEEE Access · doi:10.1109/access.2021.3094089 · Cited by 147 · see citing works
Privacy-Preserving Aggregation in Federated Learning: A Survey
Liu, Z., Guo, J., Yang, W., Fan, J., Lam, K., & Zhao, J. (2022) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2022.3190835 · Cited by 153 · see citing works
Kim, M., Günlü, O., & Schaefer, R. F. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413764 · Cited by 141 · see citing works
LSFL: A Lightweight and Secure Federated Learning Scheme for Edge Computing
Zhang, Z., Wu, L., Ma, C., Li, J., Wang, J., Wang, Q., & Yu, S. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3221899 · Cited by 143 · see citing works
Self-citationUAV-Enabled Covert Federated Learning
Hou, X., Wang, J., Jiang, C., Zhang, X., Ren, Y., & Debbah, M. A. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3245621 · Cited by 141 · see citing works
Incentivizing Differentially Private Federated Learning: A Multidimensional Contract Approach
Wu, M., Ye, D., Ding, J., Guo, Y., Yu, R., & Pan, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3050163 · Cited by 138 · see citing works
A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems
Gu, X., Sabrina, F., Fan, Z., & Sohail, S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20156539 · Cited by 139 · see citing works
A privacy preserving framework for federated learning in smart healthcare systems
Wang, W., Li, X., Qiu, X., Zhang, X., Brusić, V., & Zhao, J. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103167 · Cited by 140 · see citing works
Bao, G., & Guo, P. (2022) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-022-00377-4 · Cited by 131 · see citing works
A systematic review of federated learning applications for biomedical data
Crowson, M. G., Moukheiber, D., Arévalo, A. R., Lam, B. D., Mantena, S., Rana, A., Goss, D., Bates, D. W., & Celi, L. A. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000033 · Cited by 129 · see citing works
Edge Intelligence: Architectures, Challenges, and ApplicationsPreprint
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12172 · Cited by 184 · see citing works
Akter, M., Moustafa, N., Lynar, T., & Razzak, I. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3192648 · Cited by 128 · see citing works
A Decentralized Federated Learning Framework via Committee Mechanism With Convergence Guarantee
Che, C., Li, X., Chen, C., He, X., & Zheng, Z. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3202887 · Cited by 132 · see citing works
Challenges and future directions of secure federated learning: a survey
Zhang, K., Song, X., Zhang, C., & Yu, S. (2022) · Frontiers of Computer Science · doi:10.1007/s11704-021-0598-z · Cited by 127 · see citing works
Multimodal Federated Learning: A Survey
Che, L., Wang, J., Zhou, Y., & Ma, F. (2023) · Sensors · doi:10.3390/s23156986 · Cited by 127 · see citing works
Non-IID data and Continual Learning processes in Federated Learning: A long road ahead
Criado, M. F., Casado, F. E., Iglesias, R., Regueiro, C. V., & Barro, S. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.07.024 · Cited by 129 · see citing works
Javeed, D., Saeed, M. S., Ahmad, I., Adil, M., Kumar, P., & Islam, A. K. M. N. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.06.023 · Cited by 133 · see citing works
Kalapaaking, A. P., Khalil, I., & Yi, X. (2024) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2023.3268186 · Cited by 122 · see citing works
Pain-FL: Personalized Privacy-Preserving Incentive for Federated Learning
Sun, P., Che, H., Wang, Z., Wang, Y., Wang, T., Wu, L., & Shao, H. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118354 · Cited by 120 · see citing works
Federated Learning for Computationally Constrained Heterogeneous Devices: A Survey
Pfeiffer, K., Rapp, M., Khalili, R., & Henkel, J. (2023) · ACM Computing Surveys · doi:10.1145/3596907 · Cited by 121 · see citing works
Over-the-Air Computation for 6G: Foundations, Technologies, and Applications
Wang, Z., Zhao, Y., Zhou, Y., Shi, Y., Jiang, C., & Letaief, K. B. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3405448 · Cited by 121 · see citing works
Computation Offloading for Edge-Assisted Federated Learning
Ji, Z., Chen, L., Zhao, N., Chen, Y., Wei, G., & Yu, F. R. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3098022 · Cited by 117 · see citing works
Fairness and privacy preserving in federated learning: A survey
Rafi, T. H., Noor, F. A., Hussain, T., & Chae, D. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102198 · Cited by 131 · see citing works
PVD-FL: A Privacy-Preserving and Verifiable Decentralized Federated Learning Framework
Zhao, J., Zhu, H., Wang, F., Lu, R., Liu, Z., & Li, H. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3176191 · Cited by 118 · see citing works
ReFRS: Resource-efficient Federated Recommender System for Dynamic and Diversified User Preferences
Imran, M., Yin, H., Chen, T., Nguyen, Q. V. H., Zhou, A., & Zheng, K. (2022) · ACM Transactions on Information Systems · doi:10.1145/3560486 · Cited by 114 · see citing works
A Survey of Privacy Risks and Mitigation Strategies in the Artificial Intelligence Life Cycle
Shahriar, S., Allana, S., Hazratifard, S. M., & Dara, R. (2023) · IEEE Access · doi:10.1109/access.2023.3287195 · Cited by 114 · see citing works
PFLF: Privacy-Preserving Federated Learning Framework for Edge Computing
Zhou, H., Yang, G., Dai, H., & Liu, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3174394 · Cited by 112 · see citing works
Khraisat, A., Alazab, A., Singh, S., Jan, T., & Gomez, A. J. (2024) · ACM Computing Surveys · doi:10.1145/3687124 · Cited by 132 · see citing works
Privacy-Preserving Artificial Intelligence Techniques in Biomedicine
Torkzadehmahani, R., Nasirigerdeh, R., Blumenthal, D. B., Kacprowski, T., List, M., Matschinske, J., Späth, J., Wenke, N. K., & Baumbach, J. (2022) · Methods of Information in Medicine · doi:10.1055/s-0041-1740630 · Cited by 117 · see citing works
Li, X., & Zhan, D. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467254 · Cited by 111 · see citing works
- Authors
- Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H.
- Affiliations
- Nanjing University of Science and Technology (CN)
- Tomsk Polytechnic University (RU)
- Commonwealth Scientific and Industrial Research Organisation (AU)
- Singapore University of Technology and Design (SG)
- Southeast University (CN)
- Department of Electrical Engineering, Princeton University, Princeton, NJ
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2020
- Volume
- 15
- Pages
- 3454-3469
- ISSN
- 1556-6013 (ISSN-L)
- 1556-6021
- OpenAlex
- W3016632787
- Cited by
- 2,400
- References
- 40
- Citations by year
- 2026: 382 · 2025: 555 · 2024: 577 · 2023: 399 · 2022: 284 · 2021: 162 · 2020: 41
- FWCI
- 87.08
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Information Forensics and Security (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Minerva Access (University of Melbourne) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Key Research and Development Program of China (2018YFB1004800)
- National Natural Science Foundation of China (61872184, 61727802)
- SUTD Growth Plan Grant for AI
- U.S. National Science Foundation (CCF-1908308)
- Princeton Center for Statistics and Machine Learning under a Data X Grant
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
- Keywords
- federated learning, differential privacy, artificial noise, convergence bounds, privacy-utility trade-off, communication rounds, deep neural network training, information leakage
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
