A Hybrid Approach to Privacy-Preserving Federated Learning
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Federated learning facilitates the collaborative training of models without the sharing of raw data. However, recent attacks demonstrate that simply maintaining data locality during training processes does not provide sufficient privacy guarantees. Rather, we need a federated learning system capable of preventing inference over both the messages exchanged during training and the final trained model while ensuring the resulting model also has acceptable predictive accuracy. Existing federated learning approaches either use secure multiparty computation (SMC) which is vulnerable to inference or differential privacy which can lead to low accuracy given a large number of parties with relatively small amounts of data each. In this paper, we present an alternative approach that utilizes both differential privacy and SMC to balance these trade-offs. Combining differential privacy with secure multiparty computation enables us to reduce the growth of noise injection as the number of parties increases without sacrificing privacy while maintaining a pre-defined rate of trust. Our system is therefore a scalable approach that protects against inference threats and produces models with high accuracy. Additionally, our system can be used to train a variety of machine learning models, which we validate with experimental results on 3 different machine learning algorithms. Our experiments demonstrate that our approach out-performs state of the art solutions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the clients may infer some information about another client’s private dataset given the execution of f(w), or over the shared predictive model w [100].”
From Federated Learning for Healthcare Informatics (2021) · cites this paper as [100]
In the citing paper
“Thus, some researchers combine DP with SMC to reduce the growth of noise injection as the number of parties increases without sacrificing privacy while preserving provable privacy guarantees, protecting against extraction attacks and collusion threats [18, 100].”
From Federated Learning for Healthcare Informatics (2021) · cites this paper as [100]
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Public-Key Cryptosystems Based on Composite Degree Residuosity Classes
Paillier, P. (2007) · Lecture Notes in Computer Science · doi:10.1007/3-540-48910-x_16 · Cited by 7,250
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
Practical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Differential Privacy: A Survey of Results
Dwork, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-79228-4_1 · Cited by 3,542
Privacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356
Our Data, Ourselves: Privacy Via Distributed Noise Generation
Dwork, C., Kenthapadi, K., McSherry, F., Mironov, I., & Naor, M. (2006) · Lecture Notes in Computer Science · doi:10.1007/11761679_29 · Cited by 1,835
Nasr, M., Shokri, R., & Houmansadr, A. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00065 · Cited by 1,760
Privacy Preserving Data Mining
Lindell, Y., & Pinkas, B. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44598-6_3 · Cited by 1,077
Damgård, I., & Jurik, M. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44586-2_9 · Cited by 1,063
Scaling distributed machine learning with the parameter server
Li, M., Andersen, D. G., Park, J. W., Smola, A. J., Ahmed, A. A., Josifovski, V., Long, J. E., Shekita, E. J., & Su, B.-Y. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685095 · Cited by 1,021
MLlib: Machine Learning in Apache Spark
Meng, X., Bradley, J. K., Yavuz, B., Sparks, E., Venkataraman, S., Liu, D., Freeman, J., Tsai, D., Amde, M., Owen, S., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.06807 · Cited by 940
Induction of decision trees. Machine Learning
Quinlan, J. R. (1986) · Symposium on the Theory of Computing · Cited by 809
Practical privacy: the SuLQ framework
Blum, A., Dwork, C., McSherry, F., & Nissim, K. (2005) · Proceedings of the twenty-fourth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems · doi:10.1145/1065167.1065184 · Cited by 797
Boosting and Differential Privacy
Dwork, C., Rothblum, G. N., & Vadhan, S. (2010) · 2010 IEEE 51st Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2010.12 · Cited by 784
Differential privacy and robust statistics
Dwork, C., & Lei, J. (2009) · Proceedings of the forty-first annual ACM symposium on Theory of computing · doi:10.1145/1536414.1536466 · Cited by 611
Concentrated Differential Privacy: Simplifications, Extensions, and Lower Bounds
Bun, M., & Steinke, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-662-53641-4_24 · Cited by 584
Self-citationDifferentially private aggregation of distributed time-series with transformation and encryption
Rastogi, V., & Nath, S. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807247 · Cited by 534
Data mining with differential privacy
Friedman, A., & Schuster, A. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835868 · Cited by 461
The composition theorem for differential privacy
Kairouz, P., Oh, S., & Viswanath, P. (2017) · IEEE Transactions on Information Theory · doi:10.1109/tit.2017.2685505 · Cited by 408
I Have a DREAM! (DiffeRentially privatE smArt Metering)
Ács, G., & Castelluccia, C. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24178-9_9 · Cited by 388
(2011) · Encyclopedia of Cryptography and Security · doi:10.1007/978-1-4419-5906-5_1332 · Cited by 281
Foundations of Secure Interactive Computing
Beaver, D. (2007) · Lecture Notes in Computer Science · doi:10.1007/3-540-46766-1_31 · Cited by 277
Privacy-Preserving Stream Aggregation with Fault Tolerance
Chan, T. H. H., Shi, E., & Song, D. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-32946-3_15 · Cited by 202
Concentrated Differentially Private Gradient Descent with Adaptive per-Iteration Privacy Budget
Lee, J., & Kifer, D. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220076 · Cited by 165
Distributed Private Data Analysis: Simultaneously Solving How and What
Beimel, A., Kobbi Nissim, B., & Omri, E. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85174-5_25 · Cited by 163
A Comprehensive Comparison of Multiparty Secure Additions with Differential Privacy
Goryczka, S., & Xiong, L. (2017) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2015.2484326 · Cited by 139
A Practical Differentially Private Random Decision Tree Classifier
Jagannathan, G., Pillaipakkamnatt, K., & Wright, R. N. (2009) · 2009 IEEE International Conference on Data Mining Workshops · doi:10.1109/icdmw.2009.93 · Cited by 138
DJoin: differentially private join queries over distributed databases
Narayan, A., & Haeberlen, A. (2012) · Operating Systems Design and Implementation · doi:10.5555/2387880.2387895 · Cited by 119
Nasr, M., Shokri, R., & Houmansadr, A. (2018) · arXiv (Cornell University) · Cited by 109
Combining Differential Privacy and Secure Multiparty Computation
Pettai, M., & Laud, P. (2015) · Annual Computer Security Applications Conference · doi:10.1145/2818000.2818027 · Cited by 94
Hutchison, D., Weikum, G., Wagner, D., Vardi, M. Y., Tygar, D., Terzopoulos, D., Sudan, M., Steffen, B., Pandu Rangan, C., Nierstrasz, O., et al. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85174-5 · Cited by 90
Concentrated Differential Privacy: Simplifications, Extensions, and Lower BoundsPreprint
Bun, M., & Steinke, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.02065 · Cited by 65
Self-citationPrivate Collaborative Neural Network Learning.Preprint
Chase, M., Gilad-Bachrach, R., Laine, K., Lauter, K., & Rindal, P. (2017) · IACR Cryptology ePrint Archive · Cited by 52
Distributed Data Mining with Differential Privacy
Zhang, N., Li, M., & Lou, W. (2011) · International Conference on Communications · doi:10.1109/icc.2011.5962863 · Cited by 50
Concentrated Differentially Private Gradient Descent with Adaptive per-Iteration Privacy BudgetPreprint
Lee, J., & Kifer, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.09501 · Cited by 9
Research works printed but not linked: 9
- 10.5555/648118.746742 · doi:10.5555/648118.746742
- 10.5555/1791834.1791836 · doi:10.5555/1791834.1791836
- Cynthia Dwork and Guy N Rothblum . 2016. Concentrated differential privacy. arXiv preprint arXiv:1603.01887 ( 2016 ). Cynthia Dwork and Guy N Rothblum. 2016. Concentrated differential privacy. arXiv preprint arXiv:1603.01887 (2016). · arXiv
- Oded Goldreich . 1998. Secure multi-party computation. Manuscript. Preliminary version , Vol. 78 ( 1998 ). Oded Goldreich. 1998. Secure multi-party computation. Manuscript. Preliminary version, Vol. 78 (1998).
- 10.5555/2946645.2946679 · doi:10.5555/2946645.2946679
- 10.5555/1756123.1756146 · doi:10.5555/1756123.1756146
- Nicolas Papernot , Shuang Song , Ilya Mironov , Ananth Raghunathan , Kunal Talwar , and Úlfar Erlingsson . 2018. Scalable Private Learning with PATE. arXiv preprint arXiv:1802.08908 ( 2018 ). Nicolas Papernot, Shuang Song, Ilya Mironov, Ananth Raghunathan, Kunal Talwar, and Úlfar Erlingsson. 2018. Scalable Private Learning with PATE. arXiv preprint arXiv:1802.08908 (2018). · arXiv
- J Ross Quinlan . 1993 . C4. 5: Programming for machine learning . Morgan Kauffmann , Vol. 38 (1993), 48 . J Ross Quinlan. 1993. C4. 5: Programming for machine learning. Morgan Kauffmann, Vol. 38 (1993), 48.
- Elaine Shi , HTH Chan , Eleanor Rieffel , Richard Chow , and Dawn Song . 2011 . Privacy-preserving aggregation of time-series data . In Annual Network & Distributed System Security Symposium (NDSS). Internet Society. Elaine Shi, HTH Chan, Eleanor Rieffel, Richard Chow, and Dawn Song. 2011. Privacy-preserving aggregation of time-series data. In Annual Network & Distributed System Security Symposium (NDSS). Internet Society.
Cited by
Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400
A review of applications in federated learning
Li, L., Fan, Y., Tse, M., & Lin, K.-Y. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106854 · Cited by 1,559
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00082-4 · Cited by 1,542
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2019) · arXiv · doi:10.48550/arxiv.1911.06270 · Cited by 1,538
A survey on security and privacy of federated learning
Mothukuri, V., Parizi, R. M., Pouriyeh, S., Huang, Y., Dehghantanha, A., & Srivastava, G. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.007 · Cited by 1,480
Metadata
- Authors
- Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., & Zhou, Y.
- Affiliations
- Georgia Institute of Technology (US)
- IBM Research - Almaden (US)
- Venue
- Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security
- Publisher
- ACM
- Published
- 2019-11-11
- Pages
- 1-11
- OpenAlex
- W2970606380
- Cited by
- 1,029
- References
- 39
- Citations by year
- 2026: 93 · 2025: 180 · 2024: 205 · 2023: 184 · 2022: 148 · 2021: 136 · 2020: 74 · 2019: 9
- FWCI
- 35.11
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Workshop on Artificial Intelligence and Security (AISec) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › Cryptography and Data Security
- Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
- Keywords
- privacy-preserving federated learning, differential privacy, secure multi-party computation, inference attacks, noise injection, model privacy, data locality, scalability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.