More Than Privacy: Applying Differential Privacy in Key Areas of Artificial Intelligence
Open accessThe DOI matches its Crossref record; 151 of the 152 references it cites were found in a registry or an index.
Abstract
Artificial Intelligence (AI) has attracted a great deal of attention in recent years. However, alongside all its advancements, problems have also emerged, such as privacy violations, security issues and model fairness. Differential privacy, as a promising mathematical model, has several attractive properties that can help solve these problems, making it quite a valuable tool. For this reason, differential privacy has been broadly applied in AI but to date, no study has documented which differential privacy mechanisms can or have been leveraged to overcome its issues or the properties that make this possible. In this paper, we show that differential privacy can do more than just preserve privacy. It can also be used to improve security, stabilize learning, build fair models, and impose composition in selected areas of AI. With a focus on regular machine learning, distributed machine learning, deep learning, and multi-agent systems, the purpose of this article is to deliver a new view on many possibilities for improving AI performance with differential privacy techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The data that is collected or used by third parties, without the authorization or voluntary consent of individuals, would result in the violations of their privacy (Wu et al., 2022;Zhu et al., 2020).”
From Artificial intelligence governance: Ethical considerations and implications for social responsibility (2024) · cites this paper as Zhu et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Differential privacy [17, 18] guarantees that by looking at a model output, one cannot tell whether a sample is in the training dataset or not.”
From Machine Unlearning: A Survey (2024) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Calibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
Intelligent agents: theory and practice
Wooldridge, M., & Jennings, N. R. (1995) · The Knowledge Engineering Review · doi:10.1017/s0269888900008122 · Cited by 6,810 · cited 1×
“domain problems [99], [100].”
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · cited 1×
“Federated learning was first proposed by Google in 2017 as an additional approach to the standard centralised machine learning approaches [78], and has been applied to several real-world applications [79].”
BackgroundA Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2019) · arXiv · doi:10.48550/arxiv.1908.09635 · Cited by 5,812
Dwork, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11787006_1 · Cited by 5,291
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754 · cited 1×
“other details about that model, such as its structure [62].”
BackgroundFederated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Privacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356 · cited 3×
“[68] Distributed deep learning Sparse vector technique Preserve privacy Preserve the privacy of participants without sacrificing the accuracy of resulting models Vulnerable to Generative Adversarial Network -based attacks [90]”
BackgroundA Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235 · cited 1×
“Standard multi-agent learning approaches may need a large number of interactions between agents and an environment to learn proper behaviors [104].”
BackgroundGenerative adversarial imitation learning
Ho, J., & Ermon, S. (2016) · arXiv · doi:10.48550/arxiv.1606.03476 · Cited by 1,942
SecureML: A System for Scalable Privacy-Preserving Machine Learning
Mohassel, P., & Zhang, Y. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.12 · Cited by 1,936 · cited 1×
“A number of survey papers have discussed this field [16], [27]–[29] thoroughly.”
BackgroundRAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Response
Erlingsson, Ú., Pihur, V., & Korolova, A. (2014) · Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2660267.2660348 · Cited by 1,838
Nasr, M., Shokri, R., & Houmansadr, A. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00065 · Cited by 1,760
Privacy-Preserving Deep Learning via Additively Homomorphic Encryption
Phong, L. T., Aono, Y., Hayashi, T., Wang, L., & Moriai, S. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2787987 · Cited by 1,662
On First-Order Meta-Learning Algorithms
Nichol, A., Achiam, J., & Schulman, J. (2018) · arXiv · doi:10.48550/arxiv.1803.02999 · Cited by 1,438 · cited 1×
“trained model should be able to learn on a number of different tasks [145], [146], but this opens the risk of breaching the privacy of the different task owners [147].”
BackgroundA Survey on Deep Learning: Algorithms, Techniques, and Applications
Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M. P., Shyu, M.-L., Chen, S.-C., & Iyengar, S. S. (2019) · ACM Computing Surveys · doi:10.1145/3234150 · Cited by 1,403
Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
Hitaj, B., Ateniese, G., & Perez-Cruz, F. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134012 · Cited by 1,377
Mechanism Design via Differential Privacy
McSherry, F., & Talwar, K. (2007) · 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07) · doi:10.1109/focs.2007.66 · Cited by 1,371
Federated Learning of Deep Networks using Model AveragingPreprint
McMahan, H. B., Moore, E., Ramage, D., & y Arcas, B. A. (2016) · arXiv (Cornell University) · Cited by 1,288
An Introduction to Deep Reinforcement Learning
Vincent, F.-L., Peter, H., Riashat, I., Marc, G. B., & Joelle, P. (2018) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000071 · Cited by 1,286
Acquisti, A., Taylor, C., & Wagman, L. (2016) · Journal of Economic Literature · doi:10.1257/jel.54.2.442 · Cited by 1,283
A Survey of Deep Learning and Its Applications: A New Paradigm to Machine Learning
Dargan, S., Kumar, M., Ayyagari, M. R., & Kumar, G. (2020) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-019-09344-w · Cited by 1,198
(2013) · Cited by 1,126
A perspective view and survey of meta-learning
Vilalta, R., & Drissi, Y. (2002) · Artificial Intelligence Review · doi:10.1023/a:1019956318069 · Cited by 1,108
PATE-GAN: Generating Synthetic Data with Differential Privacy Guarantees
Jordon, J., Yoon, J., & van der Schaar, M. (2018) · International Conference on Learning Representations · Cited by 1,086
Privacy in Pharmacogenetics: An End-to-End Case Study of Personalized Warfarin Dosing.
Fredrikson, M., Lantz, E., Jha, S., Lin, S. M., Page, D., & Ristenpart, T. (2014) · PubMed · Cited by 1,085
Differentially Private Federated Learning: A Client Level Perspective
Geyer, R. C., Klein, T., & Nabi, M. (2017) · arXiv · doi:10.48550/arxiv.1712.07557 · Cited by 1,052
A Hybrid Approach to Privacy-Preserving Federated Learning
Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., & Zhou, Y. (2019) · Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3338501.3357370 · Cited by 1,029
Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting
Yeom, S., Giacomelli, I., Fredrikson, M., & Jha, S. (2018) · 2018 IEEE 31st Computer Security Foundations Symposium (CSF) · doi:10.1109/csf.2018.00027 · Cited by 1,001
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995 · cited 1×
“To address these fairness issues in machine learning, great effort has been placed on developing definitions of fairness [44]–[46] and algorithmic methods for assessing and mitigating undesirable bias in relation to these definitions [47], [48].”
Method(2011) · PubMed · Cited by 990
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777
Analyzing Federated Learning through an Adversarial Lens
Bhagoji, A. N., Chakraborty, S., Mittal, P., & Calo, S. (2018) · arXiv · doi:10.48550/arxiv.1811.12470 · Cited by 703
Fairness in Machine Learning: Lessons from Political Philosophy
Binns, R. (2017) · arXiv · doi:10.48550/arxiv.1712.03586 · Cited by 676
A survey and critique of multiagent deep reinforcement learning
Hernandez-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 671
Bousquet, O., Elisseeff, A., & Ron, D. (2001) · MPG.PuRe (Max Planck Society) · Cited by 493
Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data
Papernot, N., Abadi, M., Erlingsson, Ú., Goodfellow, I., & Talwar, K. (2016) · arXiv · doi:10.48550/arxiv.1610.05755 · Cited by 492
COLLEGE ADMISSIONS AND THE STABILITY OF MARRIAGE
GALE, D., & SHAPLEY, L. S. (1961) · doi:10.21236/ad0251958 · Cited by 486
Fair Resource Allocation in Federated Learning
Li, T., Sanjabi, M., Beirami, A., & Smith, V. (2019) · arXiv · doi:10.48550/arxiv.1905.10497 · Cited by 475
Privacy-Preserving Machine Learning: Threats and Solutions
Al-Rubaie, M., & Chang, J. M. (2019) · IEEE Security & Privacy · doi:10.1109/msec.2018.2888775 · Cited by 444
A survey on recent advances in distributed sampled-data cooperative control of multi-agent systems
Ge, X., Han, Q.-L., Ding, D., Zhang, X.-M., & Ning, B. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.10.008 · Cited by 389
Online Meta-LearningPreprint
Finn, C., Rajeswaran, A., Kakade, S. M., & Levine, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.08438 · Cited by 385
Mohri, M., Sivek, G., & Suresh, A. T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.00146 · Cited by 373
Scalable Private Learning with PATE
Papernot, N., Song, S., Mironov, I., Raghunathan, A., Talwar, K., & Erlingsson, Ú. (2018) · arXiv · doi:10.48550/arxiv.1802.08908 · Cited by 373
Metalearning: A survey of trends and technologies
Lemke, C., Budka, M., & Gabrys, B. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-013-9406-y · Cited by 365
Private and Continual Release of Statistics
Chan, T.-H. H., Shi, E., & Song, D. (2011) · ACM Transactions on Information and System Security · doi:10.1145/2043621.2043626 · Cited by 352
Technical Privacy Metrics: A Systematic Survey
Wagner, I., & Eckhoff, D. (2019) · ACM Computing Surveys · doi:10.1145/3168389 · Cited by 346
Kasiviswanathan, S. P., Lee, H. K., Nissim, K., Raskhodnikova, S., & Smith, A. (2008) · 2008 49th Annual IEEE Symposium on Foundations of Computer Science · doi:10.1109/focs.2008.27 · Cited by 334
Differentially Private Data Publishing and Analysis: A Survey
Zhu, T., Li, G., Zhou, W., & Yu, P. S. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2697856 · Cited by 330
Self-citationVanschoren, J. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_2 · Cited by 328
The reusable holdout: Preserving validity in adaptive data analysis
Dwork, C., Feldman, V., Hardt, M., Pitassi, T., Reingold, O., & Roth, A. (2015) · Science · doi:10.1126/science.aaa9375 · Cited by 307
Yoo, D., Kim, N., Park, S., Paek, A. S., & Kweon, I. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_31 · Cited by 290
A simple and practical algorithm for differentially private data release
Hardt, M., Ligett, K., & McSherry, F. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.4763 · Cited by 283
Progress in Neural NLP: Modeling, Learning, and Reasoning
Zhou, M., Duan, N., Liu, S., & Shum, H.-Y. (2020) · Engineering · doi:10.1016/j.eng.2019.12.014 · Cited by 281
A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems
Silva, F. L. D., & Costa, A. H. R. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11396 · Cited by 273 · cited 3×
“Existing agent advising approaches, however, suffer from malicious agents who may provide false advice to hinder the performance of the system, and heavy communication overheads [106], [107] because agents are allowed to broadcast”
BackgroundEvaluating Differentially Private Machine Learning in Practice
Jayaraman, B., & Evans, D. (2019) · arXiv · doi:10.48550/arxiv.1902.08874 · Cited by 265
Preserving Statistical Validity in Adaptive Data Analysis
Dwork, C., Feldman, V., Hardt, M., Pitassi, T., Reingold, O., & Roth, A. L. (2015) · Proceedings of the forty-seventh annual ACM symposium on Theory of Computing · doi:10.1145/2746539.2746580 · Cited by 248
Privacy integrated queries: an extensible platform for privacy-preserving data analysis
McSherry, F. (2010) · Communications of the ACM · doi:10.1145/1810891.1810916 · Cited by 228
The Frontiers of Fairness in Machine Learning
Chouldechova, A., & Roth, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08810 · Cited by 219
Blind analysis: Hide results to seek the truth
MacCoun, R., & Perlmutter, S. (2015) · Nature · doi:10.1038/526187a · Cited by 218 · cited 1×
“[34] believed: when deciding which results to report, the analyst interacts with a dataset that has been obfuscated through adding noise to observations, removing some data points, or switching data labels.”
BackgroundWang, R., Li, Y. F., Wang, X., Tang, H., & Zhou, X. (2009) · Proceedings of the 16th ACM conference on Computer and communications security · doi:10.1145/1653662.1653726 · Cited by 211
GANobfuscator: Mitigating Information Leakage Under GAN via Differential Privacy
Xu, C., Ren, J., Zhang, D., Zhang, Y., Qin, Z., & Ren, K. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2897874 · Cited by 210
Privacy-Preserving Collaborative Deep Learning With Unreliable Participants
Zhao, L., Wang, Q., Zou, Q., Zhang, Y., & Chen, Y. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2939713 · Cited by 209
Neural Network Inversion in Adversarial Setting via Background Knowledge Alignment
Yang, Z., Zhang, J., Chang, E.-C., & Liang, Z. (2019) · Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3319535.3354261 · Cited by 203
Distributed Learning without Distress: Privacy-Preserving Empirical Risk Minimization
Jayaraman, B., Wang, L., Evans, D., & Gu, Q. (2018) · neural information processing systems · Cited by 192
Auctions and bidding: A guide for computer scientists
Parsons, S., Rodriguez-Aguilar, J. A., & Klein, M. (2011) · ACM Computing Surveys · doi:10.1145/1883612.1883617 · Cited by 191
cpSGD: Communication-efficient and differentially-private distributed SGD
Agarwal, N., Suresh, A. T., Yu, F., Kumar, S., & McMahan, H. B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10559 · Cited by 180
Multiagent Learning: Basics, Challenges, and Prospects
Tuyls, K., & Weiss, G. (2012) · AI Magazine · doi:10.1609/aimag.v33i3.2426 · Cited by 179
A Survey of Self-Organization Mechanisms in Multiagent Systems
Ye, D., Zhang, M., & Vasilakos, A. V. (2017) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2015.2504350 · Cited by 162
Self-citationThe dMARS Architecture: A Specification of the Distributed Multi-Agent Reasoning System
D'Inverno, M., Luck, M., Georgeff, M., Kinny, D., & Wooldridge, M. (2004) · Autonomous Agents and Multi-Agent Systems · doi:10.1023/b:agnt.0000019688.11109.19 · Cited by 160
Differentially Private Empirical Risk Minimization Revisited: Faster and More GeneralPreprint
Wang, D., Ye, M., & Xu, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05251 · Cited by 160
A Self-Adaptive Sleep/Wake-Up Scheduling Approach for Wireless Sensor Networks
Ye, D., & Zhang, M. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2669996 · Cited by 139
Self-citationOn the Compatibility of Privacy and Fairness
Cummings, R., Gupta, V., Kimpara, D., & Morgenstern, J. (2019) · Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3314183.3323847 · Cited by 133 · cited 1×
“Addressing fairness and privacy preservation simultaneously is challenging because they have different aims [53], [55].”
BackgroundMechanism design in large games: incentives and privacy
Kearns, M., Pai, M., Roth, A., & Ullman, J. (2014) · Proceedings of the 5th conference on Innovations in theoretical computer science · doi:10.1145/2554797.2554834 · Cited by 112
Pai, M. M., & Roth, A. (2013) · ACM SIGecom Exchanges · doi:10.1145/2509013.2509016 · Cited by 106
Privacy-preserving PredictionPreprint
Dwork, C., & Feldman, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.10266 · Cited by 106
Achieving Differential Privacy and Fairness in Logistic Regression
Xu, D., Yuan, S., & Wu, X. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308560.3317584 · Cited by 102
Simultaneously Learning and Advising in Multiagent Reinforcement Learning
da Silva, F. L., Glatt, R., & Costa, A. H. R. (2017) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/3091125.3091280 · Cited by 101
Probabilistic Relational Reasoning for Differential Privacy
Barthe, G., Köpf, B., Olmedo, F., & Zanella-Béguelin, S. (2013) · ACM Transactions on Programming Languages and Systems · doi:10.1145/2492061 · Cited by 101
Smith, V., Chiang, C.-K., Sanjabi, M., & Talwalkar, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10467 · Cited by 101
On the Theory and Practice of Privacy-Preserving Bayesian Data AnalysisPreprint
Foulds, J. R., Geumlek, J., Welling, M., & Chaudhuri, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.07294 · Cited by 97
Learning to Teach in Cooperative Multiagent Reinforcement Learning
Omidshafiei, S., Kim, D.-K., Liu, M., Tesauro, G., Riemer, M., Amato, C., Campbell, M., & How, J. P. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016128 · Cited by 96
A Reductions Approach to Fair Classification
Agarwal, A., Beygelzimer, A., Dudı́k, M., Langford, J. C., & Wallach, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.02453 · Cited by 95
Algorithms for Differentially Private Multi-Armed Bandits
Tossou, A. C. Y., & Dimitrakakis, C. (2016) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v30i1.10212 · Cited by 94
Active Transfer Learning for Cross-System Recommendation
Zhao, L., Pan, S., Xiang, E., Zhong, E., Lu, Z., & Yang, Q. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8458 · Cited by 93
A Hybrid Multiagent Framework With Q-Learning for Power Grid Systems Restoration
Ye, D., Zhang, M., & Sutanto, D. (2011) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2011.2157180 · Cited by 92
Self-citationDwork, C., & Ilvento, C. (2019) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.itcs.2019.33 · Cited by 91 · cited 1×
“[56] explored this direction, finding that current methods seldom achieve this goal because classification decisions cannot be made independently, even by a fair classifier.”
BackgroundLearning and Efficiency in Games with Dynamic Population
Lykouris, T., Syrgkanis, V., & Tardos, E. (2015) · ACM-SIAM Symposium on Discrete Algorithms (SODA) · doi:10.1137/1.9781611974331.ch9 · Cited by 86
Differentially Private Meta-Learning
Li, J., Khodak, M., Caldas, S., & Talwalkar, A. (2019) · arXiv · doi:10.48550/arxiv.1909.05830 · Cited by 82 · cited 2×
“trained model should be able to learn on a number of different tasks [145], [146], but this opens the risk of breaching the privacy of the different task owners [147].”
BackgroundPrivacy-Preserving Distributed Multi-Task Learning with Asynchronous Updates
Xie, L., Baytaş, İ. M., Lin, K., & Zhou, J. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098152 · Cited by 81
Advanced Probabilistic Couplings for Differential Privacy
Barthe, G., Fong, N., Gaboardi, M., Grégoire, B., Hsu, J., & Strub, P.-Y. (2016) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/2976749.2978391 · Cited by 79
Preventing False Discovery in Interactive Data Analysis Is Hard
Hardt, M., & Ullman, J. (2014) · 2014 IEEE 55th Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2014.55 · Cited by 78
Private Stochastic Convex Optimization with Optimal Rates
Bassily, R., Feldman, V., Talwar, K., & Thakurta, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.09970 · Cited by 75
Gong, M., Pan, K., Xie, Y., Qin, A. K., & Tang, Z. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.02.001 · Cited by 74
Privacy-Preserving Q-Learning with Functional Noise in Continuous Spaces
Wang, B., & Hegde, N. (2019) · neural information processing systems · Cited by 71
Uncertainty-Aware Action Advising for Deep Reinforcement Learning Agents
Da Silva, F. L., Hernandez-Leal, P., Kartal, B., & Taylor, M. E. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6036 · Cited by 69 · cited 2×
“By comparison, action advising in MADRL usually allows a student agent to query a teacher agent’s knowledge base to receive action suggestions [167].”
BackgroundDifferentially Private and Fair Classification via Calibrated Functional Mechanism
Ding, J., Zhang, X., Li, X., Wang, J., Yu, R., & Pan, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5402 · Cited by 67
Applying Differential Privacy Mechanism in Artificial Intelligence
Zhu, T., & Yu, P. S. (2019) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00159 · Cited by 66
Self-citationA Hybrid Approach to Privacy-Preserving Federated Learning
Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., & Zhou, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03224 · Cited by 66
Phan, N., Vu, M. N., Liu, Y., Jin, R., Dou, D., Wu, X., & Thai, M. T. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/660 · Cited by 63
Differentially Private Fair Learning
Jagielski, M., Kearns, M., Mao, J., Oprea, A., Roth, A., Sharifi-Malvajerdi, S., & Ullman, J. (2018) · arXiv · doi:10.48550/arxiv.1812.02696 · Cited by 62
Differentially Private Bayesian Learning on Distributed Data
Heikkilä, M., Lagerspetz, E., Kaski, S., Shimizu, K., Tarkoma, S., & Honkela, A. (2017) · Helda - University of Helsinki Institutional Repository · doi:10.48550/arxiv.1703.01106 · Cited by 62
Differentially Private Bayesian Linear RegressionPreprint
Bernstein, G., & Sheldon, D. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13153 · Cited by 60
Privacy-Preserving Reinforcement Learning Design for Patient-Centric Dynamic Treatment Regimes
Liu, X., Deng, R. H., Raymond Choo, K.-K., & Yang, Y. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2019.2896325 · Cited by 58
Differentially Private Hypothesis Transfer Learning
Wang, Y., Gu, Q., & Brown, D. E. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-10928-8_48 · Cited by 58
Mechanism Design in Social Networks
Li, B., Hao, D., Zhao, D., & Zhou, T. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10605 · Cited by 56
Differentially private spectrum auction with approximate revenue maximization
Zhu, R., Li, Z., Wu, F., Shin, K., & Chen, G. (2014) · Proceedings of the 15th ACM international symposium on Mobile ad hoc networking and computing · doi:10.1145/2632951.2632974 · Cited by 55
Differentially private and strategy-proof spectrum auction with approximate revenue maximization
Zhu, R., & Shin, K. G. (2015) · doi:10.1109/infocom.2015.7218463 · Cited by 55
Asymptotically truthful equilibrium selection in large congestion games
Rogers, R., & Roth, A. (2014) · ACM Conference on Economics and Computation (EC) · doi:10.1145/2600057.2602856 · Cited by 52
Fairness in Semi-Supervised Learning: Unlabeled Data Help to Reduce Discrimination
Zhang, T., Zhu, T., Li, J., Han, M., Zhou, W., & Yu, P. S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3002567 · Cited by 51
Self-citationDifferentially Private Bayesian Inference for Exponential FamiliesPreprint
Bernstein, G., & Sheldon, D. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02188 · Cited by 46
Differential privacy for the analyst via private equilibrium computation
Hsu, J., Roth, A., & Ullman, J. (2013) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/2488608.2488651 · Cited by 43
Differentially Private Malicious Agent Avoidance in Multiagent Advising Learning
Ye, D., Zhu, T., Zhou, W., & Yu, P. S. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2906574 · Cited by 40
Self-citationDifferentially Private Double Spectrum Auction With Approximate Social Welfare Maximization
Chen, Z., Ni, T., Zhong, H., Zhang, S., & Cui, J. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2908070 · Cited by 40
Autonomously Reusing Knowledge in Multiagent Reinforcement Learning
Silva, F. L. D., Taylor, M. E., & Costa, A. H. R. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/774 · Cited by 39
Private and Truthful Aggregative Game for Large-Scale Spectrum Sharing
Zhou, P., Wei, W., Bian, K., Wu, D. O., Hu, Y., & Wang, Q. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2659099 · Cited by 39
Selling Multiple Items via Social Networks
Zhao, D., Li, B., Xu, J., Hao, D., & Jennings, N. R. (2018) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/ckis7816 · Cited by 39
Towards end-to-end speech recognition with transfer learning
Qin, C.-X., Qu, D., & Zhang, L. (2018) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-018-0141-9 · Cited by 38
Differentially Private Optimal Transport: Application to Domain Adaptation
LeTien, N., Habrard, A., & Sebban, M. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/395 · Cited by 38
Teaching on a Budget in Multi-Agent Deep Reinforcement Learning
İlhan, E., Gow, J., & Pérez-Liébana, D. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8847988 · Cited by 37
Achieving Privacy in the Adversarial Multi-Armed Bandit
Tossou, A. C. Y., & Dimitrakakis, C. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10896 · Cited by 36
Privacy-preserving reinforcement learning
Sakuma, J., Kobayashi, S., & Wright, R. N. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390265 · Cited by 32
An Agent-Based Integrated Self-Evolving Service Composition Approach in Networked Environments
Ye, D., He, Q., Wang, Y., & Yang, Y. J. (2016) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2016.2631598 · Cited by 31
Self-citationFuzzi: a three-level logic for differential privacy
Zhang, H., Roth, E., Haeberlen, A., Pierce, B. C., & Roth, A. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3341697 · Cited by 30
Testing the Lipschitz Property over Product Distributions with Applications to Data Privacy
Dixit, K., Jha, M. K., Raskhodnikova, S., & Thakurta, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-36594-2_24 · Cited by 26
Argumentation-based Negotiation with Incomplete Opponent Profiles
Dimopoulos, Y., Mailly, J.-G., & Pavlos Moraitis, A. (2019) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/bdoc4902 · Cited by 21
An Antifolk Theorem for Large Repeated Games
Pai, M. M., Roth, A., & Ullman, J. (2016) · ACM Transactions on Economics and Computation · doi:10.1145/2976734 · Cited by 20
PAC learning with stable and private predictionsPreprint
Dagan, Y., & Feldman, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10541 · Cited by 19
Distributed Private Data Analysis: Lower Bounds and Practical Constructions
Shi, E., Chan, T.-H. H., Rieffel, E. G., & Song, D. X. (2017) · ACM Transactions on Algorithms · doi:10.1145/3146549 · Cited by 18
Privacy-Preserving Federated Data Sharing
Fioretto, F., & Hentenryck, P. V. (2019) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/fldk8571 · Cited by 18
LEASGD: an Efficient and Privacy-Preserving Decentralized Algorithm for Distributed LearningPreprint
Cheng, H.-P., Yu, P., Hu, H., Yan, F., Li, S., Li, H. H., & Chen, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11124 · Cited by 17
Self-citationMore on the “anti-folk theorem”
Massó, J., & Rosenthal, R. W. (1989) · Journal of Mathematical Economics · doi:10.1016/0304-4068(89)90025-6 · Cited by 15
Zhang, Y., Mao, Y., & Zhong, S. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2605798 · Cited by 14
An approximately truthful mechanism for electric vehicle charging via joint differential privacy
Han, S., Topcu, U., & Pappas, G. J. (2015) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2015.7171102 · Cited by 13
Privacy-Preserving Stacking with Application to Cross-organizational Diabetes Prediction
Yao, Q., Guo, X., Kwok, J. T.-Y., Tu, W.-W., Chen, Y., Dai, W., & Yang, Q. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/571 · Cited by 13
A Conceptual Framework for Secrecy-preserving Reasoning in Knowledge Bases
Tao, J., Slutzki, G., & Honavar, V. (2014) · ACM Transactions on Computational Logic · doi:10.1145/2637477 · Cited by 12
PADS: Privacy-Preserving Auction Design for Allocating Dynamically Priced Cloud Resources
Xu, J., Palanisamy, B., Tang, Y., & Kumar, S. (2017) · IEEE International Conference on Collaboration and Internet Computing (CIC) · doi:10.1109/cic.2017.00023 · Cited by 11
Efficiency, Sequenceability and Deal-Optimality in Fair Division of Indivisible Goods
Beynier, A., Bouveret, S., Lemaı̂tre, M., Nicolas Maudet, B., Rey, S., & Shams, P. (2019) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/hfwo2294 · Cited by 9
Designing differentially private spectrum auction mechanisms
Wu, C., Wei, Z., Wu, F., Chen, G., & Tang, S. (2015) · Wireless Networks · doi:10.1007/s11276-015-0955-7 · Cited by 7
Using a Recommendation System to Support Problem Solving and Case-Based Reasoning Retrieval
Tawfik, A. A., Alhoori, H., Keene, C. W., Bailey, C., & Hogan, M. (2017) · Technology Knowledge and Learning · doi:10.1007/s10758-017-9335-y · Cited by 7
Differential privacy, equilibrium, and efficient allocation of resources
Roth, A. (2013) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2013.6736719 · Cited by 5
Computer Science and Game Theory
Durlauf, S. N., & Blume, L. E. (2010) · Game Theory · doi:10.1057/9780230280847_5 · Cited by 4
Privacy-Preserving Policy Iteration for Decentralized POMDPs
Wu, F., Zilberstein, S., & Chen, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11584 · Cited by 4
Research works printed but not linked: 12
- Russell, 2002, Artificial Intelligence: A Modern Approach
- 10.5555/2969033.2969125 · doi:10.5555/2969033.2969125
- Chaudhuri, 2011, Differentially private empirical risk minimization, J. Mach. Learn. Res., 12, 1069
- Nobel, 2018, Algorithms of Oppression: How Search Engines Reinforce Racism, 10.18574/nyu/9781479833641.001.0001 · DOI · Paper page
- Zemel, Learning fair representation, III-325
- Dwork, Fairness under composition, 33:1
- Zhao, Distributed deep learning under differential privacy with the teacher-student paradigm, 404
- 10.1145/3298981 · DOI · Paper page
- Bhagoji, Analyzing federated learning through an adversarial lens, 634
- 10.1145/2660267.2660348 · DOI · Paper page
- Bonanno, 2018, Game Theory
- 10.1145/2976734 · DOI
Cited by
Privacy Preserving Machine Learning with Homomorphic Encryption and Federated Learning
Fang, H., & Qian, Q. (2021) · Future Internet · doi:10.3390/fi13040094 · Cited by 424
“Besides that, differential privacy is also a privacy assurance technique used to prevent privacy leakage by adding noise to the samples [28–30].”
MethodHabbal, A., Ali, M. K., & Abuzaraida, M. A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122442 · Cited by 407
Camilleri, M. A. (2024) · Expert Systems · doi:10.1111/exsy.13406 · Cited by 331
Local differential privacy and its applications: A comprehensive survey
Yang, M., Guo, T., Zhu, T., Tjuawinata, I., Zhao, J., & Lam, K.-Y. (2024) · Computer Standards & Interfaces · doi:10.1016/j.csi.2023.103827 · Cited by 229
Self-citationDifferential Privacy for Industrial Internet of Things: Opportunities, Applications, and Challenges
Jiang, B., Li, J., Yue, G., & Song, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3057419 · Cited by 201
Metadata
- Authors
- Zhu, T., Ye, D., Wang, W., Zhou, W., & Yu, P. S.
- Affiliations
- China University of Geosciences (CN)
- University of Technology Sydney (AU)
- University of Illinois Chicago (US)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2022-06-01
- Volume
- 34
- Issue
- 6
- Pages
- 2824-2843
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3047327820
- Semantic Scholar
- 7d5b94f9d2cee5823757352155d0234454f09a0e
- Cited by
- 219
- References
- 152
- Citations by year
- 2026: 27 · 2025: 64 · 2024: 45 · 2023: 36 · 2022: 23
- FWCI
- 8.08
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- OPUS - Open Publications of UTS Scholars (University of Technology Sydney) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61972366)
- National Science Foundation (III-1526499, III-1763325, III-1909323, SaTC-1930941)
- Australian Research Council Discovery (DP190100981)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Keywords
- differential privacy, privacy preservation, machine learning security, model fairness, distributed learning, deep learning, multi-agent systems, learning stability, privacy-utility trade-off
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.