The Algorithmic Foundations of Differential Privacy
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The problem of privacy-preserving data analysis has a long history spanning multiple disciplines. As electronic data about individuals becomes increasingly detailed, and as technology enables ever more powerful collection and curation of these data, the need increases for a robust, meaningful, and mathematically rigorous definition of privacy, together with a computationally rich class of algorithms that satisfy this definition. Differential Privacy is such a definition. After motivating and discussing the meaning of differential privacy, the preponderance of this monograph is devoted to fundamental techniques for achieving differential privacy, and application of these techniques in creative combinations, using the query-release problem as an ongoing example. A key point is that, by rethinking the computational goal, one can often obtain far better results than would be achieved by methodically replacing each step of a non-private computation with a differentially private implementation. Despite some astonishingly powerful computational results, there are still fundamental limitations — not just on what can be achieved with differential privacy but on what can be achieved with any method that protects against a complete breakdown in privacy. Virtually all the algorithms discussed herein maintain differential privacy against adversaries of arbitrary computational power. Certain algorithms are computationally intensive, others are efficient. Computational complexity for the adversary and the algorithm are both discussed. We then turn from fundamentals to applications other than queryrelease, discussing differentially private methods for mechanism design and machine learning. The vast majority of the literature on differentially private algorithms considers a single, static, database that is subject to many analyses. Differential privacy in other models, including distributed databases and computations on data streams is discussed. Finally, we note that this work is meant as a thorough introduction to the problems and techniques of differential privacy, but is not intended to be an exhaustive survey — there is by now a vast amount of work in differential privacy, and we can cover only a small portion of it.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Federated Optimization:Distributed Optimization Beyond the Datacenter
Konečný, J., McMahan, B., & Ramage, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03575 · Cited by 544
Federated Learning: Collaborative Machine Learning without Centralized Training Data
A, A. V., Binny, S., R, J. T., Raj, N., & Thomas, V. (2022) · international journal of engineering technology and management sciences · doi:10.46647/ijetms.2022.v06i05.052 · Cited by 489
Privacy-Preserving Machine Learning: Methods, Challenges and DirectionsPreprint
Xu, R., Baracaldo, N., & Joshi, J. B. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04417 · Cited by 297
Learning to Protect Communications with Adversarial Neural Cryptography
Abadi, M., & Andersen, D. G. (2016) · arXiv · doi:10.48550/arxiv.1610.06918 · Cited by 182
Chiffrement totalement homomorphe pour l'apprentissage automatique
Minelli, M. (2018) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 14
- Data Anonymization Techniques
Frank, M. J. (2013) · Auerbach Publications eBooks · doi:10.1201/b13097-20 · Cited by 2
Research works printed but not linked: 83
- Arora, 2012, The multiplicative weights update method: A meta-algorithm and applications, Theory of Computing, 8, 121, 10.4086/toc.2012.v008a006 · doi:10.4086/toc.2012.v008a006
- Balcan, 2005, Mechanism design via machine learning, Foundations of Computer Science, 2005. FOCS 2005. 46th Annual IEEE Symposium on, 605
- Beimel, 2010, Bounds on the sample complexity for private learning and private data release, Theory of Cryptography, 437
- Beimel, 2013, Characterizing the sample complexity of private learners, Proceedings of the Conference on Innovations in Theoretical Computer Science, 97
- Bhaskara, 2012, Unconditional differentially private mechanisms for linear queries, Proceedings of the Symposium on Theory of Computing Conference, Symposium on Theory of Computing, New York, NY, USA, May 19-22, 2012, 1269
- Blum, 2005, Practical privacy: the SuLQ framework, Principles of Database Systems, 128
- Blum, Practical privacy: the sulq framework, Principles of Database Systems
- Blum, 2008, A learning theory approach to noninteractive database privacy, Symposium on Theory of Computing, 609, 10.1145/1374376.1374464 · DOI · Paper page
- Blum, 2007, Learning, regret minimization, and equilibria
- Casti, Five Golden Rules: Great Theories of 20th-Century Mathematics and Why They Matter
- Hubert, 2010, Private and continual release of statistics, Automata, Languages and Programming, 405, 10.1007/978-3-642-14162-1_34 · DOI
- Chaudhuri, Sample complexity bounds for differentially private learning, Proceedings of the Annual Conference on Learning Theory (COLT 2011)
- Chaudhuri, Differentially private empirical risk minimization, Journal of machine learning research: JMLR
- Chaudhuri, 2012, Near-optimal differentially private principal components, Advances in Neural Information Processing Systems 25, 998
- Chen, 2013, Truthful mechanisms for agents that value privacy, Association for Computing Machinery Conference on Electronic Commerce
- Dandekar, 2012, Privacy auctions for recommender systems, Internet and Network Economics, 309, 10.1007/978-3-642-35311-6_23 · DOI
- De, 2012, Lower bounds in differential privacy, Theory of Cryptography Conference, 321
- Dinur, 2003, Revealing information while preserving privacy, Proceedings of the Association for Computing Machinery SIGACT- SIGMOD-SIGART Symposium on Principles of Database Systems, 202
- Duchi, 2013, Local privacy and statistical minimax rates, arXiv preprint arXiv:1302.3203 · arXiv
- Dwork, 2006, Differential privacy, Proceedings of the International Colloquium on Automata, Languages and Programming (ICALP)(2), 1
- Dwork, 2006, Our data, ourselves: Privacy via distributed noise generation, EUROCRYPT, 486
- Dwork, Differential privacy and robust statistics, Proceedings of the 2009 International Association for Computing Machinery Symposium on Theory of Computing (STOC)
- Dwork, 2006, Calibrating noise to sensitivity in private data analysis, Theory of Cryptography Conference ’06, 265
- Dwork, 2007, The price of privacy and the limits of lp decoding, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing, 85
- Dwork, 2010, On the difficulties of disclosure prevention in statistical databases or the case for differential privacy, Journal of Privacy and Confidentiality, 10.29012/jpc.v2i1.585 · DOI
- Dwork, 2010, Differential privacy under continual observation, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing, 715
- Dwork, Pan-private streaming algorithms, Proceedings of International Conference on Super Computing
- Dwork, 2009, On the complexity of differentially private data release: Efficient algorithms and hardness results, Symposium on Theory of Computing ’09, 381, 10.1145/1536414.1536467 · DOI · Paper page
- Dwork, The privacy of the analyst and the power of the state, Foundations of Computer Science
- Dwork, Efficient algorithms for privately releasing marginals via convex relaxations, Proceedings of the Annual Symposium on Computational Geometry (SoCG)
- Dwork, 2004, Privacy-preserving datamining on vertically partitioned databases, Proceedings of Cryptology 2004, 3152, 528, 10.1007/978-3-540-28628-8_32 · DOI · Paper page
- Dwork, 2010, Boosting and differential privacy, Foundations of Computer Science, 51
- Dwork, Analyze gauss: Optimal bounds for privacy-preserving pca, Symposium on Theory of Computing
- Fleischer, 2012, Approximately optimal auctions for selling privacy when costs are correlated with data, Association for Computing Machinery Conference on Electronic Commerce, 568
- Ghosh, 2013, Privacy and coordination: Computing on databases with endogenous participation, Proceedings of the fourteenth ACM conference on Electronic commerce (EC), 543, 10.1145/2482540.2482585 · DOI
- Ghosh, Selling privacy at auction, Association for Computing Machinery Conference on Electronic Commerce
- Groce, Limits of computational differential privacy in the client/server setting, Proceedings of the Theory of Cryptography Conference
- Gupta, 2011, Privately releasing conjunctions and the statistical query barrier, Symposium on Theory of Computing ’11, 803
- Gupta, 2012, Iterative constructions and private data release, Theory of Cryptography Conference, 339
- Hastad, A pseudorandom generator from any one-way function, SIAM Journal of Computing
- Hardt, 2012, A simple and practical algorithm for differentially private data release, Advances in Neural Information Processing Systems 25, 2348
- Hardt, 2012, Beating randomized response on incoherent matrices, Proceedings of the Symposium on Theory of Computing, 1255, 10.1145/2213977.2214088 · DOI
- Hardt, Beyond worst-case analysis in private singular vector computation, Proceedings of the Symposium on Theory of Computing
- Hardt, 2010, A multiplicative weights mechanism for privacy-preserving data analysis, Foundations of Computer Science, 61
- Hardt, 2010, On the geometry of differential privacy, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing, 705
- Homer, Resolving individuals contributing trace amounts of dna to highly complex mixtures using high- density snp genotyping microarrays, PLoS Genet
- Hsu, 2013, arXiv, 1311
- Hsu, 2013, Differential privacy for the analyst via private equilibrium computation, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing (STOC), 341
- Huang, 2012, The exponential mechanism for so cial welfare: Private, truthful, and nearly optimal, IEEE Annual Symposium on the Foundations of Computer Science (FOCS), 140
- Jain, Differentially private online learning, Journal of Machine Learning Research — Proceedings Track
- Kapralov, On differentially private low rank approximation, 10.1137/1.9781611973105.101 · DOI
- Kearns, 1998, Efficient noise-tolerant learning from statistical queries, Journal of the Association for Computing Machinery (JAssociation for Computing Machinery), 45, 983, 10.1145/293347.293351 · DOI · Paper page
- Kearns, 2014, Mechanism design in large games: Incentives and privacy, Proceedings of the 5th conference on Innovations in theoretical computer science (ITCS)
- Kifer, Private convex empirical risk minimization and high-dimensional regression, Journal of Machine Learning Research
- Ligett, 2012, Take it or leave it: Running a survey when privacy comes at a cost, Internet and Network Economics, 378, 10.1007/978-3-642-35311-6_28 · DOI
- Littlestone, 1989, The weighted majority algorithm, Annual Symposium on Foundations of Computer Science, 1989, 256
- McGregor, 2010, The limits of two-party differential privacy, Foundations of Computer Science, 81
- McSherry, 2007, Mechanism design via differential privacy, Foundations of Computer Science, 94
- McSherry, 2007, Mechanism design via differential privacy, Foundations of Computer Science, 94
- Mir, 2011, Pan-private algorithms via statistics on sketches, Proceedings of the Association for Computing Machinery SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, 37, 10.1145/1989284.1989290 · DOI
- Mironov, On significance of the least significant bits for differential privacy, 10.1145/2382196.2382264 · DOI · Paper page
- Mironov, 2009, Computational differential privacy, Proceedings of CRYPTOLOGY, 126
- Narayanan, Robust de-anonymization of large sparse datasets (how to break anonymity of the netflix prize dataset), Proceedings of IEEE Symposium on Security and Privacy
- Nikolov, 2013, The geometry of differential privacy: the sparse and approximate cases, Symposium on Theory of Computing
- Nissim, 2012, Privacy-aware mechanism design, Association for Computing Machinery Conference on Electronic Commerce, 774
- Nissim, 2007, Smooth sensitivity and sampling in private data analysis, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing, 75
- Nissim, 2012, Approximately optimal mechanism design via differential privacy, Innovations in Theoretical Computer Science, 203, 10.1145/2090236.2090254 · DOI
- Pai, 2013, Privacy and mechanism design, SIGecom Exchanges, 10.1145/2509013.2509016 · DOI
- Rogers, 2013, arXiv, 1311
- Roth, 2010, Differential privacy and the fat-shattering dimension of linear queries, Approximation, Randomization, and Combinatorial Optimization, Algorithms and Techniques, 683, 10.1007/978-3-642-15369-3_51 · DOI
- Roth, 2012, Buying private data at auction: the sensitive surveyor’s problem, Association for Computing Machinery SIGecom Exchanges, 11, 1, 10.1145/2325713.2325714 · DOI
- Roth, 2010, Interactive privacy via the median mechanism, Symposium on Theory of Computing ’10, 765
- Roth, Conducting truthful surveys, cheaply, Proceedings of the ACM Conference on Electronic Commerce
- Rubinstein, 2009, arXiv, 0911
- Schapire, 2003, The boosting approach to machine learning: An overview, 10.1007/978-0-387-21579-2_9 · DOI · Paper page
- Schapire, 1999, Improved boosting algorithms using confidence-rated predictions, Machine Learning, 39, 297, 10.1023/A:1007614523901 · DOI · Paper page
- Schapire, Boosting: Foundations and Algorithms
- Smith, Differentially private feature selection via stability arguments, and the robustness of the lasso, Proceedings of Conference on Learning Theory
- Sweeney, 1997, Weaving technology and policy together to maintain confidentiality, Journal of Law, Medicines Ethics, 25, 98, 10.1111/j.1748-720X.1997.tb01885.x · DOI · Paper page
- Ullman, 2013, Answering n{2+o(1)} counting queries with differential privacy is hard, Symposium on Theory of Computing, 361
- Valiant, 1984, A theory of the learnable, Communications of the Association for Computing Machinery, 27, 1134, 10.1145/1968.1972 · DOI · Paper page
- Warner, 1965, Randomized response: A survey technique for eliminating evasive answer bias, Journal of the American Statistical Association, 60, 63, 10.1080/01621459.1965.10480775 · DOI · Paper page
- Xiao, 2013, Is privacy compatible with truthfulness, Proceedings of the Conference on Innovations in Theoretical Computer Science, 67
Cited by
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
“While federated learning offers many practical privacy benefits, providing stronger guarantees via differential privacy [14, 13, 1], secure multi-party computation [18], or their combination is an interesting direction for future work.”
BackgroundTraumatic brain injury: integrated approaches to improve prevention, clinical care, and research
Maas, A. I. R., Menon, D. K., Adelson, P. D., Andelic, N., Bell, M. J., Belli, A., Bragge, P., Brazinova, A., Büki, A., Chesnut, R. M., et al. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30371-x · Cited by 2,609
Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400
“For numerical data, a Gaussian mechanism defined in [24] can be used to guarantee ( , δ)-DP.”
BackgroundMethodInfluentialPrivacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Nasr, M., Shokri, R., & Houmansadr, A. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00065 · Cited by 1,760
Privacy in the age of medical big data
Price, W. N., & Cohen, I. G. (2019) · Nature Medicine · doi:10.1038/s41591-018-0272-7 · Cited by 1,522
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
Federated learning of predictive models from federated Electronic Health Records
Brisimi, T. S., Chen, R., Mela, T., Olshevsky, A., Paschalidis, I. C., & Shi, W. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.01.007 · Cited by 997
“[ 9–11] Two well-known examples of privacy breaches are the Netflix Prize and the Massachusetts Group Insurance Commission (GIC) medical records database.”
BackgroundFederated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning
Wang, Z., Song, M., Zhang, Z., Song, Y., Wang, Q., & Qi, H. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737416 · Cited by 881
Deep Learning for Cardiac Image Segmentation: A Review
Chen, C., Qin, C., Qiu, H., Tarroni, G., Duan, J., Bai, W., & Rueckert, D. (2020) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2020.00025 · Cited by 869
Bourtoule, L., Chandrasekaran, V., Choquette-Choo, C. A., Jia, H., Travers, A., Zhang, B., Lie, D., & Papernot, N. (2021) · 2021 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40001.2021.00019 · Cited by 810
“This problem is tangential to privacy-preserving machine learning—enforcing differential privacy [12] does not solve it.”
BackgroundSecureBoost: A Lossless Federated Learning Framework
Cheng, K., Fan, T., Jin, Y., Liu, Y., Chen, T., Papadopoulos, D., & Yang, Q. (2019) · arXiv · doi:10.48550/arxiv.1901.08755 · Cited by 668
Yin, X., Zhu, Y., & Hu, J. (2022) · ACM Computing Surveys · doi:10.1145/3460427 · Cited by 638
Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence
Hao, M., Li, H., Luo, X., Xu, G., Yang, H., & Liu, S. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2945367 · Cited by 569
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
“Data Preprocessing Anomaly Detection [70, 81, 257, 316] Data Anonymozation [14, 37, 232, 232] Differential Privacy [107, 110, 177]”
Differential Privacy Techniques for Cyber Physical Systems: A Survey
Hassan, M. U., Rehmani, M. H., & Chen, J. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2944748 · Cited by 564
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
SecureBoost: A Lossless Federated Learning Framework
Cheng, K., Fan, T., Jin, Y., Liu, Y., Chen, T., Papadopoulos, D., & Yang, Q. (2021) · IEEE Intelligent Systems · doi:10.1109/mis.2021.3082561 · Cited by 669
Federated learning for medical image analysis: A survey
Guan, H., Yap, P.-T., Bozoki, A., & Liu, M. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110424 · Cited by 518
SoK: Security and Privacy in Machine Learning
Papernot, N., McDaniel, P., Sinha, A., & Wellman, M. P. (2018) · 2018 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2018.00035 · Cited by 502
“This is captured by differential privacy [88], a rigorous framework to analyze the privacy guarantees provided by algorithms.”
BackgroundLi, X., Gu, Y., Dvornek, N., Staib, L. H., Ventola, P., & Duncan, J. S. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101765 · Cited by 480
Federated Learning and Differential Privacy for Medical Image Analysis
Adnan, M., Kalra, S., Cresswell, J. C., Taylor, G. W., & Tizhoosh, H. (2021) · doi:10.21203/rs.3.rs-1005694/v1 · Cited by 464
Alkadi, O., Moustafa, N., Turnbull, B., & Choo, K.-K. R. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2996590 · Cited by 463
Machine Learning with Membership Privacy using Adversarial Regularization
Nasr, M., Shokri, R., & Houmansadr, A. (2018) · Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3243734.3243855 · Cited by 458
Local Differential Privacy-Based Federated Learning for Internet of Things
Zhao, Y., Zhao, J., Yang, M., Wang, T., Wang, N., Lyu, L., Niyato, D., & Lam, K.-Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3037194 · Cited by 456
The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networks
Zhang, Y., Jia, R., Pei, H., Wang, W., Li, B., & Song, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00033 · Cited by 449
Differential Privacy for Deep and Federated Learning: A Survey
Ouadrhiri, A. E., & Abdelhadi, A. (2022) · IEEE Access · doi:10.1109/access.2022.3151670 · Cited by 445
Security and Privacy Challenges of Large Language Models: A Survey
Das, B. C., Amini, M. H., & Wu, Y. (2025) · ACM Computing Surveys · doi:10.1145/3712001 · Cited by 445
Privacy-Preserving Machine Learning: Threats and Solutions
Al-Rubaie, M., & Chang, J. M. (2019) · IEEE Security & Privacy · doi:10.1109/msec.2018.2888775 · Cited by 444
Ekiden: A Platform for Confidentiality-Preserving, Trustworthy, and Performant Smart Contracts
Cheng, R., Zhang, F., Kos, J., He, W., Hynes, N., Johnson, N., Juels, A., Miller, A., & Song, D. (2019) · 2019 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2019.00023 · Cited by 431
Privacy-Preserving Solutions for Blockchain: Review and Challenges
Bernal Bernabe, J., Canovas, J. L., Hernandez-Ramos, J. L., Torres Moreno, R., & Skarmeta, A. (2019) · IEEE Access · doi:10.1109/access.2019.2950872 · Cited by 459
“Differential privacy [127] deals with privacy-preservation by studying whether a data analysis methodology reveals or not information about an individual.”
BackgroundPrivacy Preserving Machine Learning with Homomorphic Encryption and Federated Learning
Fang, H., & Qian, Q. (2021) · Future Internet · doi:10.3390/fi13040094 · Cited by 424
(2015) · OECD Science, Technology and Industry Policy Papers · doi:10.1787/5jrs2f963zs1-en · Cited by 419
The Roadmap to 6G Security and Privacy
Porambage, P., Gur, G., Osorio, D. P. M., Liyanage, M., Gurtov, A., & Ylianttila, M. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3078081 · Cited by 416
The composition theorem for differential privacy
Kairouz, P., Oh, S., & Viswanath, P. (2017) · IEEE Transactions on Information Theory · doi:10.1109/tit.2017.2685505 · Cited by 408
Privacy preservation in federated learning: An insightful survey from the GDPR perspective
Truong, N., Sun, K., Wang, S., Guitton, F., & Guo, Y. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102402 · Cited by 399
Thapa, C., & Camtepe, S. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104130 · Cited by 393
Real-time monitoring of construction sites: Sensors, methods, and applications
Rao, A. S., Radanovic, M., Liu, Y., Hu, S., Fang, Y., Khoshelham, K., Palaniswami, M., & Ngo, T. (2022) · Automation in Construction · doi:10.1016/j.autcon.2021.104099 · Cited by 393
Privacy-Preserving Generative Deep Neural Networks Support Clinical Data Sharing
Beaulieu-Jones, B. K., Wu, Z. S., Williams, C., Lee, R., Bhavnani, S. P., Byrd, J. B., & Greene, C. S. (2019) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.118.005122 · Cited by 390
Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networks
Golatkar, A., Achille, A., & Soatto, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00932 · Cited by 394
Collecting and Analyzing Multidimensional Data with Local Differential Privacy
Wang, N., Xiao, X., Yang, Y., Zhao, J., Hui, S. C., Shin, H., Shin, J., & Yu, G. (2019) · 2019 IEEE 35th International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2019.00063 · Cited by 381
Zhang, J., Oh, Y. J., Lange, P., Yu, Z., & Fukuoka, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/22845 · Cited by 363
Biscotti: A blockchain system for private and secure federated learning
Shayan, M., Fung, C., Yoon, C. J. M., & Beschastnikh, I. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3044223 · Cited by 354
A snapshot of the frontiers of fairness in machine learning
Chouldechova, A., & Roth, A. (2020) · Communications of the ACM · doi:10.1145/3376898 · Cited by 354
Self-citationTechnical Privacy Metrics: A Systematic Survey
Wagner, I., & Eckhoff, D. (2019) · ACM Computing Surveys · doi:10.1145/3168389 · Cited by 346
Privacy-preserving blockchain-based federated learning for traffic flow prediction
Qi, Y., Hossain, M. S., Nie, J., & Li, X. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.12.003 · Cited by 339
Generative Adversarial Networks in Time Series: A Systematic Literature Review
Brophy, E., Wang, Z., She, Q., & Ward, T. (2023) · ACM Computing Surveys · doi:10.1145/3559540 · Cited by 337
Differentially Private Data Publishing and Analysis: A Survey
Zhu, T., Li, G., Zhou, W., & Yu, P. S. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2697856 · Cited by 330
HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning
Xu, R., Baracaldo, N., Zhou, Y., Anwar, A., & Ludwig, H. (2019) · Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3338501.3357371 · Cited by 327
VeriFL: Communication-Efficient and Fast Verifiable Aggregation for Federated Learning
Guo, X., Liu, Z., Li, J., Gao, J., Hou, B., Dong, C., & Baker, T. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3043139 · Cited by 314
The reusable holdout: Preserving validity in adaptive data analysis
Dwork, C., Feldman, V., Hardt, M., Pitassi, T., Reingold, O., & Roth, A. (2015) · Science · doi:10.1126/science.aaa9375 · Cited by 307
Self-citationProchlo: Strong Privacy for Analytics in the Crowd
Bittau, A., Erlingsson, Ú., Maniatis, P., Mironov, I., Raghunathan, A., Lie, D., Rudominer, M., Kode, U., Tinnes, J., & Seefeld, B. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132769 · Cited by 378
“The analyzer, which has the most complete view of the reported data, may choose from a wide variety of differentially private mechanisms and data processing systems [27,31,38, 53, 63].”
BackgroundMethodInfluentialTrustworthy Online Controlled Experiments: A Practical Guide to A/B Testing
Kohavi, R., Tang, D., & Xu, Y. (2020) · doi:10.1017/9781108653985 · Cited by 297
Internet of Things Based Smart Grids Supported by Intelligent Edge Computing
Chen, S., Wen, H., Wu, J., Lei, W., Hou, W., Liu, W., Xu, A., & Jiang, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2920488 · Cited by 297
Rodríguez-Barroso, N., Jiménez-López, D., Luzón, M. V., Herrera, F., & Martínez-Cámara, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.011 · Cited by 296
A survey of edge computing-based designs for IoT security
Sha, K., Yang, T. A., Wei, W., & Davari, S. (2020) · Digital Communications and Networks · doi:10.1016/j.dcan.2019.08.006 · Cited by 295
Privacy-Preserving Data Mining: Methods, Metrics, and Applications
Mendes, R., & Vilela, J. P. (2017) · IEEE Access · doi:10.1109/access.2017.2706947 · Cited by 294
Differentially Private Distributed Constrained Optimization
Han, S., Topcu, U., & Pappas, G. J. (2017) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2541298 · Cited by 292
A Survey of Privacy Attacks in Machine Learning
Rigaki, M., & Garcia, S. (2024) · ACM Computing Surveys · doi:10.1145/3624010 · Cited by 285
Demystifying Membership Inference Attacks in Machine Learning as a Service
Truex, S., Liu, L., Gursoy, M. E., Yu, L., & Wei, W. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2019.2897554 · Cited by 282
Privacy and Security Issues in Deep Learning: A Survey
Liu, X., Xie, L., Wang, Y., Zou, J., Xiong, J., Ying, Z., & Vasilakos, A. V. (2021) · IEEE Access · doi:10.1109/access.2020.3045078 · Cited by 282
$\textsf{LoPub}$ : High-Dimensional Crowdsourced Data Publication With Local Differential Privacy
Ren, X., Yu, C.-M., Yu, W., Yang, S., Yang, X., McCann, J. A., & Yu, P. S. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2812146 · Cited by 282
Anonymization Through Data Synthesis Using Generative Adversarial Networks (ADS-GAN)
Yoon, J., Drumright, L. N., & van der Schaar, M. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2980262 · Cited by 281
Blockchain-enabled Federated Learning: A Survey
Qu, Y., Uddin, M. P., Gan, C., Xiang, Y., Gao, L., & Yearwood, J. (2023) · ACM Computing Surveys · doi:10.1145/3524104 · Cited by 286
DEAL: Differentially Private Auction for Blockchain based Microgrids Energy Trading
Ul Hassan, M., Rehmani, M. H., & Chen, J. (2019) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2019.2947471 · Cited by 276
A Survey of Blockchain-Based Strategies for Healthcare
De Aguiar, E. J., Faiçal, B. S., Krishnamachari, B., & Ueyama, J. (2021) · ACM Computing Surveys · doi:10.1145/3376915 · Cited by 275
Federated learning for computational pathology on gigapixel whole slide images
Lu, M. Y., Chen, R. J., Kong, D., Lipkova, J., Singh, R., Williamson, D. F. K., Chen, T. Y., & Mahmood, F. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102298 · Cited by 267
Exposed! A Survey of Attacks on Private Data
Dwork, C., Smith, A., Steinke, T., & Ullman, J. (2017) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-060116-054123 · Cited by 259
Self-citationA Federated Learning Based Privacy-Preserving Smart Healthcare System
Li, J., Meng, Y., Ma, L., Du, S., Zhu, H., Pei, Q., & Shen, X. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3098010 · Cited by 262
Trustworthy ai: A computational perspective
Liu, H., Wang, Y., Fan, W., Liu, X., Li, Y., Jain, S., Liu, Y., Jain, A., & Tang, J. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3546872 · Cited by 261
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261
Yang, Q., Liu, Y., Cheng, Y., Kang, Y., Chen, T., & Yu, H. (2019) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00960ed2v01y201910aim043 · Cited by 261
Qayyum, A., Usama, M., Qadir, J., & Al-Fuqaha, A. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2975048 · Cited by 257
“Privacy means that models should not reveal any additional information about the subjects involved in collected training data (a.k.a. differential privacy) [233].”
BackgroundAnalyzing User-Level Privacy Attack Against Federated Learning
Song, M., Wang, Z., Zhang, Z., Song, Y., Wang, Q., Ren, J., & Qi, H. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3000372 · Cited by 257
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773 · Cited by 254
New Horizons for a Data-Driven Economy
(2016) · Springer eBooks · doi:10.1007/978-3-319-21569-3 · Cited by 253
Towards Fair and Privacy-Preserving Federated Deep Models
Lyu, L., Yu, J., Nandakumar, K., Li, Y., Ma, X., Jin, J., Yu, H., & Ng, K. S. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.2996273 · Cited by 250
PPFA: Privacy Preserving Fog-Enabled Aggregation in Smart Grid
Lyu, L., Nandakumar, K., Rubinstein, B., Jin, J., Bedo, J., & Palaniswami, M. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2803782 · Cited by 240
How Can Recommender Systems Benefit from Large Language Models: A Survey
Lin, J., Dai, X., Xi, Y., Liu, W., Chen, B., Zhang, H., Liu, Y., Wu, C., Li, X., Zhu, C., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3678004 · Cited by 242
Privacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Liu, D., & Simeone, O. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036948 · Cited by 234
Subsampled Rényi Differential Privacy and Analytical Moments Accountant
Wang, Y.-X., Balle, B., & Kasiviswanathan, S. (2018) · arXiv · doi:10.48550/arxiv.1808.00087 · Cited by 224
A Taxonomy of Attacks on Federated Learning
Jere, M. S., Farnan, T., & Koushanfar, F. (2021) · IEEE Security & Privacy · doi:10.1109/msec.2020.3039941 · Cited by 217
Artificial Intelligence, Predictive Policing, and Risk Assessment for Law Enforcement
Berk, R. A. (2021) · Annual Review of Criminology · doi:10.1146/annurev-criminol-051520-012342 · Cited by 213
A review of privacy-preserving techniques for deep learning
Boulemtafes, A., Derhab, A., & Challal, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.041 · Cited by 211
When Machine Unlearning Jeopardizes Privacy
Chen, M., Zhang, Z., Wang, T., Backes, M., Humbert, M., & Zhang, Y. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3484756 · Cited by 195
Zhang, C., Zhang, S., Yu, J. J. Q., & Yu, S. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3055283 · Cited by 194
Privacy-preserving distributed linear regression on high-dimensional data
Gascón, A., Schoppmann, P., Balle, B., Raykova, M., Doerner, J., Zahur, S., & Evans, D. (2017) · Proceedings on Privacy Enhancing Technologies · doi:10.1515/popets-2017-0053 · Cited by 193
White, T., Blok, E., & Calhoun, V. D. (2022) · Human Brain Mapping · doi:10.1002/hbm.25120 · Cited by 176
Privacy Risks of General-Purpose Language Models
Pan, X., Zhang, M., Ji, S., & Yang, M. (2020) · 2020 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40000.2020.00095 · Cited by 188
“Furthermore, we also propose and evaluate four possible countermeasures against the observed threats, via quantization, differential privacy [20], adversarial training [57] and subspace projection [14].”
MethodNot Just Privacy: Improving Performance of Private Deep Learning in Mobile Cloud
Wang, J., Zhang, J., Bao, W., Zhu, X., Cao, B., & Yu, P. S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220106 · Cited by 188
Privacy and Security in Mobile Health: A Research Agenda
Kotz, D., Gunter, C. A., Kumar, S., & Weiner, J. P. (2016) · Computer · doi:10.1109/mc.2016.185 · Cited by 185
Medical imaging deep learning with differential privacy
Ziller, A., Usynin, D., Braren, R., Makowski, M., Rueckert, D., & Kaissis, G. (2021) · Scientific Reports · doi:10.1038/s41598-021-93030-0 · Cited by 172
How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy
Ponomareva, N., Hazimeh, H., Kurakin, A., Xu, Z., Denison, C., McMahan, H. B., Vassilvitskii, S., Chien, S., & Thakurta, A. G. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14649 · Cited by 166
An economic analysis of privacy protection and statistical accuracy as social choices
Abowd, J. M., & Schmutte, I. M. (2019) · American Economic Review · doi:10.1257/aer.20170627 · Cited by 162
FDML: A Collaborative Machine Learning Framework for Distributed Features
Hu, Y., Niu, D., Yang, J., & Zhou, S. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330765 · Cited by 163
Metadata
- Authors
- Dwork, C., & Roth, A.
- Affiliations
- Microsoft (United States) (US)
- University of Pennsylvania (US)
- Venue
- Foundations and Trends® in Theoretical Computer Science
- Publisher
- Emerald
- Published
- 2014-08-11
- Volume
- 9
- Issue
- 3-4
- Pages
- 211-487
- ISSN
- 1551-305X (ISSN-L)
- 1551-3068
- OpenAlex
- W4205228770
- Cited by
- 5,557
- References
- 6
- Citations by year
- 2026: 887 · 2025: 822 · 2024: 755 · 2023: 706 · 2022: 602 · 2021: 562 · 2020: 473 · 2019: 297 · 2018: 194 · 2017: 150 · 2016: 73 · 2015: 28 · 2014: 6
- FWCI
- 85.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Foundations and Trends® in Theoretical Computer Science (publishedVersion)
- ELARTU (Ternopil National Technical University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › Cryptography and Data Security
- Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
- Keywords
- differential privacy, privacy-preserving data analysis, privacy definitions, computational complexity, mechanism design, distributed databases, data streams
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.