Privacy Preserving Machine Learning with Homomorphic Encryption and Federated Learning
Open accessAbstract
Privacy protection has been an important concern with the great success of machine learning. In this paper, it proposes a multi-party privacy preserving machine learning framework, named PFMLP, based on partially homomorphic encryption and federated learning. The core idea is all learning parties just transmitting the encrypted gradients by homomorphic encryption. From experiments, the model trained by PFMLP has almost the same accuracy, and the deviation is less than 1%. Considering the computational overhead of homomorphic encryption, we use an improved Paillier algorithm which can speed up the training by 25–28%. Moreover, comparisons on encryption key length, the learning network structure, number of learning clients, etc. are also discussed in detail in the paper.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Federated Learning inherently safeguards data privacy at its source.
“It inherently safeguards data privacy at its source, a crucial factor in healthcare, where data confidentiality is sacrosanct [13].”
From Federated learning meets blockchain in decentralized data-sharing: Healthcare use case (2024) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Public-Key Cryptosystems Based on Composite Degree Residuosity Classes
Paillier, P. (2007) · Lecture Notes in Computer Science · doi:10.1007/3-540-48910-x_16 · Cited by 7,250 · see citing works
Fully homomorphic encryption using ideal lattices
Gentry, C. (2009) · Proceedings of the forty-first annual ACM symposium on Theory of computing · doi:10.1145/1536414.1536440 · Cited by 6,806 · see citing works
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · see citing works
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · see citing works
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557 · see citing works
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754 · see citing works
Practical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956 · see citing works
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856 · see citing works
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766 · see citing works
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,189 · see citing works
Privacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356 · see citing works
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334 · see citing works
How to generate and exchange secrets
Yao, A. (1986) · 27th Annual Symposium on Foundations of Computer Science (sfcs 1986) · doi:10.1109/sfcs.1986.25 · Cited by 2,281 · see citing works
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232 · see citing works
(1978) · Cited by 1,875 · see citing works
Fully Homomorphic Encryption over the Integers
van Dijk, M., Gentry, C., Halevi, S., & Vaikuntanathan, V. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13190-5_2 · Cited by 1,861 · see citing works
(2016) · International Conference on Machine Learning · Cited by 1,270 · see citing works
Federated Learning for Mobile Keyboard Prediction
Hard, A., Rao, K., Mathews, R., Ramaswamy, S., Beaufays, F., Augenstein, S., Eichner, H., Kiddon, C., & Ramage, D. (2018) · arXiv · doi:10.48550/arxiv.1811.03604 · Cited by 1,148 · see citing works
A Hybrid Approach to Privacy-Preserving Federated Learning
Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., & Zhou, Y. (2019) · Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3338501.3357370 · Cited by 1,029 · see citing works
SecureBoost: A Lossless Federated Learning Framework
Cheng, K., Fan, T., Jin, Y., Liu, Y., Chen, T., Papadopoulos, D., & Yang, Q. (2021) · IEEE Intelligent Systems · doi:10.1109/mis.2021.3082561 · Cited by 669 · see citing works
SecureBoost: A Lossless Federated Learning Framework
Cheng, K., Fan, T., Jin, Y., Liu, Y., Chen, T., Papadopoulos, D., & Yang, Q. (2019) · arXiv · doi:10.48550/arxiv.1901.08755 · Cited by 668 · see citing works
(2013) · Cited by 651 · see citing works
Yang (2019) · doi:10.1145/3339474 · Cited by 632 · see citing works
Sheller, M. J., Reina, G. A., Edwards, B., Martin, J., & Bakas, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_9 · Cited by 609 · see citing works
More Effective Distributed ML via a Stale Synchronous Parallel Parameter Server
Ho, Q., Cipar, J., Cui, H., Kim, J. K., Lee, S., Gibbons, P. B., Gibson, G. A., Ganger, G. R., & Xing, E. P. (2013) · PubMed · doi:10.1184/r1/6475898 · Cited by 586 · see citing works
BatchCrypt: Efficient Homomorphic Encryption for Cross-Silo Federated Learning
Zhang, C., Li, S., XIA, J., Wang, W., Yan, F., & Liu, Y. (2020) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 522 · see citing works
Applied Federated Learning: Improving Google Keyboard Query SuggestionsPreprint
Yang, T. T., Andrew, G., Eichner, H., Sun, H., Li, W., Kong, N., Ramage, D., & Beaufays, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02903 · Cited by 450 · see citing works
Huang, L., Shea, A. L., Qian, H., Masurkar, A., Deng, H., & Liu, D. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103291 · Cited by 437 · see citing works
Petuum: A New Platform for Distributed Machine Learning on Big Data
Xing, E. P., Ho, Q., Dai, W., Kim, J. K., Wei, J., Lee, S., Zheng, X., Xie, P., Kumar, A., & Yu, Y. (2015) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2015.2472014 · Cited by 388 · see citing works
Xu, R., Baracaldo, N., Zhou, Y., Anwar, A., & Ludwig, H. (2019) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3338501.3357371 · Cited by 328 · see citing works
Homomorphic Encryption and Applications
Yi, X., Paulet, R., & Bertino, E. (2014) · SpringerBriefs in computer science · doi:10.1007/978-3-319-12229-8 · Cited by 256 · see citing works
Somani, U., Lakhani, K., & Mundra, M. (2010) · International Conference on Parallel, Distributed and Grid Computing (PDGC) · doi:10.1109/pdgc.2010.5679895 · Cited by 248 · see citing works
Privacy Preserving Back-Propagation Neural Network Learning Made Practical with Cloud Computing
Yuan, J., & Yu, S. (2013) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2013.18 · Cited by 244 · see citing works
Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation SystemPreprint
Ammad-ud-din, M., Ivannikova, E., Khan, S. A., Oyomno, W., Fu, Q., Tan, K. E., & Flanagan, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09888 · Cited by 220 · see citing works
More Than Privacy: Applying Differential Privacy in Key Areas of Artificial Intelligence
Zhu, T., Ye, D., Wang, W., Zhou, W., & Yu, P. S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3014246 · Cited by 219 · see citing works
Secure multiple linear regression based on homomorphic encryption
Hall, R., Fienberg, S. E., & Nardi, Y. (2011) · Cited by 109 · see citing works
Managed communication and consistency for fast data-parallel iterative analytics
Wei, J., Dai, W., Qiao, A., Ho, Q., Cui, H., Ganger, G. R., Gibbons, P. B., Gibson, G. A., & Xing, E. P. (2015) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/2806777.2806778 · Cited by 98 · see citing works
Federated Learning Of Out-Of-Vocabulary Words
Chen, M., Mathews, R., Ouyang, T., & Beaufays, F. (2019) · arXiv · doi:10.48550/arxiv.1903.10635 · Cited by 97 · see citing works
STRADS: a distributed framework for scheduled model parallel machine learning
Kim, J. K., Ho, Q.-R., Lee, S.-H., Zheng, X., Dai, W., Gibson, G. A., & Xing, E. (2016) · European Conference on Computer Systems · doi:10.1145/2901318.2901331 · Cited by 96 · see citing works
On parallelizability of stochastic gradient descent for speech DNNS
Seide, F., Fu, H., Droppo, J., Li, G., & Yu, D. (2014) · IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.2014.6853593 · Cited by 94 · see citing works
Privacy-Preserving Ridge Regression with only Linearly-Homomorphic Encryption
Giacomelli, I., Jha, S., Jóye, M., Page, C. D., & Yoon, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93387-0_13 · Cited by 89 · see citing works
Homomorphic Encryption as a Service for Outsourced Images in Mobile Cloud Computing Environment
Mouhib, I., Driss, E. O., & Naanani, H. (2017) · International Journal of Cloud Applications and Computing · doi:10.4018/ijcac.2017040103 · Cited by 78 · see citing works
Watcharapichat, P., Morales, V. L., Fernandez, R. C., & Pietzuch, P. R. (2016) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/2987550.2987586 · Cited by 76 · see citing works
Encryption Performance Improvements of the Paillier Cryptosystem.
Jost, C., Lam, H. T., Maximov, A., & Smeets, B. (2015) · Cited by 70 · see citing works
A homomorphic-encryption-based vertical federated learning scheme for rick management
Ou, W., Zeng, J., Guo, Z., Yan, W., Liu, D., & Fuentes, S. (2020) · Computer Science and Information Systems · doi:10.2298/csis190923022o · Cited by 52 · see citing works
Fast Decryption Algorithm for Paillier Homomorphic Cryptosystem
Ogunseyi, T. B., & Tang, B. (2020) · IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS) · doi:10.1109/icpics50287.2020.9202325 · Cited by 30 · see citing works
CPP-ELM: Cryptographically Privacy-Preserving Extreme Learning Machine for Cloud Systems
Çatak, F. Ö., & Mustaçoğlu, A. F. (2017) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.11.1.3 · Cited by 28 · see citing works
Homomorphic Encryption as a Service for Outsourced Images in Mobile Cloud Computing Environment
Mouhib, I., Driss, E. O., & Naanani, H. (2019) · Cryptography · doi:10.4018/978-1-7998-1763-5.ch019 · Cited by 27 · see citing works
Makkaoui, K. E., Ezzati, A., Beni‐Hssane, A., et al. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-019-01366-3 · Cited by 26 · see citing works
Sheller, M., Reina, G. A., Edwards, B., Martin, J., & Bakas, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.04304 · Cited by 20 · see citing works
Distributed Machine Learning via Sufficient Factor BroadcastingPreprint
Xie, P., Kim, J. K., Zhou, Y. J., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08486
Flagged first, then by citations
Research works printed but not linked: 3
- Watcharapichat, P.; Morales, V.L.; Fernandez, R.C.; Pietzuch, P. Ako: Decentralised deep learning with partial gradient exchange. In Proceedings of the Seventh ACM Symposium on Cloud Computing, Santa Clara, CA, USA, 5-7 October 2016; pp. 84-97.
- Liu, Y.; Chen, T.; Yang, Q. Secure federated transfer learning. arXiv 2018, arXiv:1812.03337. · arXiv
- Xu, R.; Baracaldo, N.; Zhou, Y.; Anwar, A.; Ludwig, H. Hybridalpha: An efficient approach for privacy-preserving federated learning. In Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security, London, UK, 15 November 2019; pp. 13-23.
Cited by
Sorted by citations
Privacy-Preserving Federated Learning Using Homomorphic Encryption
Park, J., & Lim, H. (2022) · Applied Sciences · doi:10.3390/app12020734 · Cited by 223 · see citing works
Federated learning meets blockchain in decentralized data-sharing: Healthcare use case
Alsamhi, S. H., Myrzashova, R., Hawbani, A., Kumar, S., Srivastava, S., Zhao, L., Wei, X., Guizan, M., & Curry, E. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3367249 · Cited by 131 · see citing works
A robust analysis of adversarial attacks on federated learning environments
Nair, A. K., Raj, E. D., & Sahoo, J. (2023) · Computer Standards & Interfaces · doi:10.1016/j.csi.2023.103723 · Cited by 70 · see citing works
Exploring privacy measurement in federated learning
Jagarlamudi, G. K., Yazdinejad, A., Parizi, R. M., & Pouriyeh, S. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-023-05846-4 · Cited by 52 · see citing works
Federated learning‐based trajectory prediction model with privacy preserving for intelligent vehicle
Han, M., Xu, K., Ma, S., Li, A., & Jiang, H. (2022) · International Journal of Intelligent Systems · doi:10.1002/int.22987 · Cited by 37 · see citing works
Lightweight Privacy and Security Computing for Blockchained Federated Learning in IoT
Fan, M., Ji, K., Zhang, Z., Yu, H., & Sun, G. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3267112 · Cited by 37 · see citing works
- Authors
- Fang, H., & Qian, Q.
- Affiliations
- Shanghai University (CN)
- Corresponding author
- Qian, Quan
- ORCID
- Qian, Quan
- Venue
- Future Internet
- Publisher
- MDPI AG
- Published
- 2021-04-08
- Volume
- 13
- Issue
- 4
- Pages
- 94
- ISSN
- 1999-5903 (ISSN-L)
- OpenAlex
- W3140753276
- Cited by
- 424
- References
- 52
- Citations by year
- 2026: 48 · 2025: 141 · 2024: 93 · 2023: 89 · 2022: 45 · 2021: 8
- FWCI
- 20.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Future Internet (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Key Research and Development Program of China (2018YFB0704400)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Cryptography and Data Security
- Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
- Keywords
- privacy-preserving machine learning, homomorphic encryption, partially homomorphic encryption, federated learning, Paillier cryptosystem, computational overhead, key length
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review