The Algorithmic Foundations of Differential Privacy
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The problem of privacy-preserving data analysis has a long history spanning multiple disciplines. As electronic data about individuals becomes increasingly detailed, and as technology enables ever more powerful collection and curation of these data, the need increases for a robust, meaningful, and mathematically rigorous definition of privacy, together with a computationally rich class of algorithms that satisfy this definition. Differential Privacy is such a definition. After motivating and discussing the meaning of differential privacy, the preponderance of this monograph is devoted to fundamental techniques for achieving differential privacy, and application of these techniques in creative combinations, using the query-release problem as an ongoing example. A key point is that, by rethinking the computational goal, one can often obtain far better results than would be achieved by methodically replacing each step of a non-private computation with a differentially private implementation. Despite some astonishingly powerful computational results, there are still fundamental limitations — not just on what can be achieved with differential privacy but on what can be achieved with any method that protects against a complete breakdown in privacy. Virtually all the algorithms discussed herein maintain differential privacy against adversaries of arbitrary computational power. Certain algorithms are computationally intensive, others are efficient. Computational complexity for the adversary and the algorithm are both discussed. We then turn from fundamentals to applications other than queryrelease, discussing differentially private methods for mechanism design and machine learning. The vast majority of the literature on differentially private algorithms considers a single, static, database that is subject to many analyses. Differential privacy in other models, including distributed databases and computations on data streams is discussed. Finally, we note that this work is meant as a thorough introduction to the problems and techniques of differential privacy, but is not intended to be an exhaustive survey — there is by now a vast amount of work in differential privacy, and we can cover only a small portion of it.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Federated Optimization:Distributed Optimization Beyond the Datacenter
Konečný, J., McMahan, B., & Ramage, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03575 · Cited by 544
Federated Learning: Collaborative Machine Learning without Centralized Training Data
A, A. V., Binny, S., R, J. T., Raj, N., & Thomas, V. (2022) · international journal of engineering technology and management sciences · doi:10.46647/ijetms.2022.v06i05.052 · Cited by 489
Privacy-Preserving Machine Learning: Methods, Challenges and DirectionsPreprint
Xu, R., Baracaldo, N., & Joshi, J. B. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04417 · Cited by 297
Learning to Protect Communications with Adversarial Neural Cryptography
Abadi, M., & Andersen, D. G. (2016) · arXiv · doi:10.48550/arxiv.1610.06918 · Cited by 182
Chiffrement totalement homomorphe pour l'apprentissage automatique
Minelli, M. (2018) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 14
- Data Anonymization Techniques
Frank, M. J. (2013) · Auerbach Publications eBooks · doi:10.1201/b13097-20 · Cited by 2
Research works printed but not linked: 83
- Arora, 2012, The multiplicative weights update method: A meta-algorithm and applications, Theory of Computing, 8, 121, 10.4086/toc.2012.v008a006 · doi:10.4086/toc.2012.v008a006
- Balcan, 2005, Mechanism design via machine learning, Foundations of Computer Science, 2005. FOCS 2005. 46th Annual IEEE Symposium on, 605
- Beimel, 2010, Bounds on the sample complexity for private learning and private data release, Theory of Cryptography, 437
- Beimel, 2013, Characterizing the sample complexity of private learners, Proceedings of the Conference on Innovations in Theoretical Computer Science, 97
- Bhaskara, 2012, Unconditional differentially private mechanisms for linear queries, Proceedings of the Symposium on Theory of Computing Conference, Symposium on Theory of Computing, New York, NY, USA, May 19-22, 2012, 1269
- Blum, 2005, Practical privacy: the SuLQ framework, Principles of Database Systems, 128
- Blum, Practical privacy: the sulq framework, Principles of Database Systems
- Blum, 2008, A learning theory approach to noninteractive database privacy, Symposium on Theory of Computing, 609, 10.1145/1374376.1374464 · DOI · Paper page
- Blum, 2007, Learning, regret minimization, and equilibria
- Casti, Five Golden Rules: Great Theories of 20th-Century Mathematics and Why They Matter
- Hubert, 2010, Private and continual release of statistics, Automata, Languages and Programming, 405, 10.1007/978-3-642-14162-1_34 · DOI
- Chaudhuri, Sample complexity bounds for differentially private learning, Proceedings of the Annual Conference on Learning Theory (COLT 2011)
- Chaudhuri, Differentially private empirical risk minimization, Journal of machine learning research: JMLR
- Chaudhuri, 2012, Near-optimal differentially private principal components, Advances in Neural Information Processing Systems 25, 998
- Chen, 2013, Truthful mechanisms for agents that value privacy, Association for Computing Machinery Conference on Electronic Commerce
- Dandekar, 2012, Privacy auctions for recommender systems, Internet and Network Economics, 309, 10.1007/978-3-642-35311-6_23 · DOI
- De, 2012, Lower bounds in differential privacy, Theory of Cryptography Conference, 321
- Dinur, 2003, Revealing information while preserving privacy, Proceedings of the Association for Computing Machinery SIGACT- SIGMOD-SIGART Symposium on Principles of Database Systems, 202
- Duchi, 2013, Local privacy and statistical minimax rates, arXiv preprint arXiv:1302.3203 · arXiv
- Dwork, 2006, Differential privacy, Proceedings of the International Colloquium on Automata, Languages and Programming (ICALP)(2), 1
- Dwork, 2006, Our data, ourselves: Privacy via distributed noise generation, EUROCRYPT, 486
- Dwork, Differential privacy and robust statistics, Proceedings of the 2009 International Association for Computing Machinery Symposium on Theory of Computing (STOC)
- Dwork, 2006, Calibrating noise to sensitivity in private data analysis, Theory of Cryptography Conference ’06, 265
- Dwork, 2007, The price of privacy and the limits of lp decoding, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing, 85
- Dwork, 2010, On the difficulties of disclosure prevention in statistical databases or the case for differential privacy, Journal of Privacy and Confidentiality, 10.29012/jpc.v2i1.585 · DOI
- Dwork, 2010, Differential privacy under continual observation, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing, 715
- Dwork, Pan-private streaming algorithms, Proceedings of International Conference on Super Computing
- Dwork, 2009, On the complexity of differentially private data release: Efficient algorithms and hardness results, Symposium on Theory of Computing ’09, 381, 10.1145/1536414.1536467 · DOI · Paper page
- Dwork, The privacy of the analyst and the power of the state, Foundations of Computer Science
- Dwork, Efficient algorithms for privately releasing marginals via convex relaxations, Proceedings of the Annual Symposium on Computational Geometry (SoCG)
- Dwork, 2004, Privacy-preserving datamining on vertically partitioned databases, Proceedings of Cryptology 2004, 3152, 528, 10.1007/978-3-540-28628-8_32 · DOI · Paper page
- Dwork, 2010, Boosting and differential privacy, Foundations of Computer Science, 51
- Dwork, Analyze gauss: Optimal bounds for privacy-preserving pca, Symposium on Theory of Computing
- Fleischer, 2012, Approximately optimal auctions for selling privacy when costs are correlated with data, Association for Computing Machinery Conference on Electronic Commerce, 568
- Ghosh, 2013, Privacy and coordination: Computing on databases with endogenous participation, Proceedings of the fourteenth ACM conference on Electronic commerce (EC), 543, 10.1145/2482540.2482585 · DOI
- Ghosh, Selling privacy at auction, Association for Computing Machinery Conference on Electronic Commerce
- Groce, Limits of computational differential privacy in the client/server setting, Proceedings of the Theory of Cryptography Conference
- Gupta, 2011, Privately releasing conjunctions and the statistical query barrier, Symposium on Theory of Computing ’11, 803
- Gupta, 2012, Iterative constructions and private data release, Theory of Cryptography Conference, 339
- Hastad, A pseudorandom generator from any one-way function, SIAM Journal of Computing
- Hardt, 2012, A simple and practical algorithm for differentially private data release, Advances in Neural Information Processing Systems 25, 2348
- Hardt, 2012, Beating randomized response on incoherent matrices, Proceedings of the Symposium on Theory of Computing, 1255, 10.1145/2213977.2214088 · DOI
- Hardt, Beyond worst-case analysis in private singular vector computation, Proceedings of the Symposium on Theory of Computing
- Hardt, 2010, A multiplicative weights mechanism for privacy-preserving data analysis, Foundations of Computer Science, 61
- Hardt, 2010, On the geometry of differential privacy, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing, 705
- Homer, Resolving individuals contributing trace amounts of dna to highly complex mixtures using high- density snp genotyping microarrays, PLoS Genet
- Hsu, 2013, arXiv, 1311
- Hsu, 2013, Differential privacy for the analyst via private equilibrium computation, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing (STOC), 341
- Huang, 2012, The exponential mechanism for so cial welfare: Private, truthful, and nearly optimal, IEEE Annual Symposium on the Foundations of Computer Science (FOCS), 140
- Jain, Differentially private online learning, Journal of Machine Learning Research — Proceedings Track
- Kapralov, On differentially private low rank approximation, 10.1137/1.9781611973105.101 · DOI
- Kearns, 1998, Efficient noise-tolerant learning from statistical queries, Journal of the Association for Computing Machinery (JAssociation for Computing Machinery), 45, 983, 10.1145/293347.293351 · DOI · Paper page
- Kearns, 2014, Mechanism design in large games: Incentives and privacy, Proceedings of the 5th conference on Innovations in theoretical computer science (ITCS)
- Kifer, Private convex empirical risk minimization and high-dimensional regression, Journal of Machine Learning Research
- Ligett, 2012, Take it or leave it: Running a survey when privacy comes at a cost, Internet and Network Economics, 378, 10.1007/978-3-642-35311-6_28 · DOI
- Littlestone, 1989, The weighted majority algorithm, Annual Symposium on Foundations of Computer Science, 1989, 256
- McGregor, 2010, The limits of two-party differential privacy, Foundations of Computer Science, 81
- McSherry, 2007, Mechanism design via differential privacy, Foundations of Computer Science, 94
- McSherry, 2007, Mechanism design via differential privacy, Foundations of Computer Science, 94
- Mir, 2011, Pan-private algorithms via statistics on sketches, Proceedings of the Association for Computing Machinery SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, 37, 10.1145/1989284.1989290 · DOI
- Mironov, On significance of the least significant bits for differential privacy, 10.1145/2382196.2382264 · DOI · Paper page
- Mironov, 2009, Computational differential privacy, Proceedings of CRYPTOLOGY, 126
- Narayanan, Robust de-anonymization of large sparse datasets (how to break anonymity of the netflix prize dataset), Proceedings of IEEE Symposium on Security and Privacy
- Nikolov, 2013, The geometry of differential privacy: the sparse and approximate cases, Symposium on Theory of Computing
- Nissim, 2012, Privacy-aware mechanism design, Association for Computing Machinery Conference on Electronic Commerce, 774
- Nissim, 2007, Smooth sensitivity and sampling in private data analysis, Proceedings of the Association for Computing Machinery Symposium on Theory of Computing, 75
- Nissim, 2012, Approximately optimal mechanism design via differential privacy, Innovations in Theoretical Computer Science, 203, 10.1145/2090236.2090254 · DOI
- Pai, 2013, Privacy and mechanism design, SIGecom Exchanges, 10.1145/2509013.2509016 · DOI
- Rogers, 2013, arXiv, 1311
- Roth, 2010, Differential privacy and the fat-shattering dimension of linear queries, Approximation, Randomization, and Combinatorial Optimization, Algorithms and Techniques, 683, 10.1007/978-3-642-15369-3_51 · DOI
- Roth, 2012, Buying private data at auction: the sensitive surveyor’s problem, Association for Computing Machinery SIGecom Exchanges, 11, 1, 10.1145/2325713.2325714 · DOI
- Roth, 2010, Interactive privacy via the median mechanism, Symposium on Theory of Computing ’10, 765
- Roth, Conducting truthful surveys, cheaply, Proceedings of the ACM Conference on Electronic Commerce
- Rubinstein, 2009, arXiv, 0911
- Schapire, 2003, The boosting approach to machine learning: An overview, 10.1007/978-0-387-21579-2_9 · DOI · Paper page
- Schapire, 1999, Improved boosting algorithms using confidence-rated predictions, Machine Learning, 39, 297, 10.1023/A:1007614523901 · DOI · Paper page
- Schapire, Boosting: Foundations and Algorithms
- Smith, Differentially private feature selection via stability arguments, and the robustness of the lasso, Proceedings of Conference on Learning Theory
- Sweeney, 1997, Weaving technology and policy together to maintain confidentiality, Journal of Law, Medicines Ethics, 25, 98, 10.1111/j.1748-720X.1997.tb01885.x · DOI · Paper page
- Ullman, 2013, Answering n{2+o(1)} counting queries with differential privacy is hard, Symposium on Theory of Computing, 361
- Valiant, 1984, A theory of the learnable, Communications of the Association for Computing Machinery, 27, 1134, 10.1145/1968.1972 · DOI · Paper page
- Warner, 1965, Randomized response: A survey technique for eliminating evasive answer bias, Journal of the American Statistical Association, 60, 63, 10.1080/01621459.1965.10480775 · DOI · Paper page
- Xiao, 2013, Is privacy compatible with truthfulness, Proceedings of the Conference on Innovations in Theoretical Computer Science, 67
Cited by
Items 101–200 of 205
Context-Aware Generative Adversarial Privacy
Huang, C., Kairouz, P., Chen, X., Sankar, L., & Rajagopal, R. (2017) · Entropy · doi:10.3390/e19120656 · Cited by 156
Ebers, M., Hoch, V. R. S., Rosenkranz, F., Ruschemeier, H., & Steinrötter, B. (2021) · J · doi:10.3390/j4040043 · Cited by 153
“In addition thereto, several privacy enhancing techniques such as differential privacy [36] intentionally introduce noise into datasets in order to prevent the unintentional disclosure of sensitive data.”
BackgroundLocal and Central Differential Privacy for Robustness and Privacy in Federated Learning
Naseri, M., Hayes, J., & De Cristofaro, E. (2022) · Proceedings 2022 Network and Distributed System Security Symposium · doi:10.14722/ndss.2022.23054 · Cited by 188
Ethical machines: The human-centric use of artificial intelligence
Lepri, B., Oliver, N., & Pentland, A. (2021) · iScience · doi:10.1016/j.isci.2021.102249 · Cited by 149
Rodríguez-Barroso, N., Stipcich, G., Jiménez-López, D., Ruiz-Millán, J. A., Martínez-Cámara, E., González-Seco, G., Luzón, M. V., Veganzones, M. A., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.009 · Cited by 148
Research issues for privacy and security of electronic health services
Yüksel, B., Küpçü, A., & Özkasap, Ö. (2017) · Future Generation Computer Systems · doi:10.1016/j.future.2016.08.011 · Cited by 147
Challenges, Applications and Design Aspects of Federated Learning: A Survey
Rahman, K. M. J., Ahmed, F., Akhter, N., Hasan, M., Amin, R., Aziz, K. E., Islam, A. K. M. M., Mukta, M. S. H., & Islam, A. K. M. N. (2021) · IEEE Access · doi:10.1109/access.2021.3111118 · Cited by 147
Clustered federated learning with adaptive local differential privacy on heterogeneous IoT data
He, Z., Wang, L., & Cai, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3299947 · Cited by 143
Transfer learning in magnetic resonance brain imaging: a systematic review
Valverde, J. M., Imani, V., Abdollahzadeh, A., De Feo, R., Prakash, M., Ciszek, R., & Tohka, J. (2021) · Journal of Imaging · doi:10.3390/jimaging7040066 · Cited by 137
Unrolling SGD: Understanding Factors Influencing Machine Unlearning
Thudi, A., Deza, G., Chandrasekaran, V., & Papernot, N. (2022) · 2022 IEEE 7th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp53844.2022.00027 · Cited by 135
“, [24]): ideally, the distribution of weights of M ′ leaks no information about x∗ as it was not trained on it (though this is not necessarily the case [15]), and so the smaller the privacy leakage of x∗ from the distribution of weights of M ′′, the closer M ′′ is to being unlearned.”
BackgroundTrustFed: A Framework for Fair and Trustworthy Cross-Device Federated Learning in IIoT
Rehman, M. H. U., Dirir, A. M., Salah, K., Damiani, E., & Svetinovic, D. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3075706 · Cited by 132
Chen, M., Zhang, Z., Wang, T., Backes, M., Humbert, M., & Zhang, Y. (2022) · Proceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3548606.3559352 · Cited by 133
Privacy in Internet of Things: From Principles to Technologies
Li, C., & Palanisamy, B. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2864168 · Cited by 130
“Theorem 2 (POST-PROCESSING [86]).”
BackgroundMethodInfluentialMixed-Privacy Forgetting in Deep Networks
Golatkar, A., Achille, A., Ravichandran, A., Polito, M., & Soatto, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00085 · Cited by 125
Preserving Privacy of Smart Meter Data in a Smart Grid Environment
Gough, M. B., Santos, S. F., AlSkaif, T., Javadi, M. S., Castro, R., & Catalao, J. P. S. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3074915 · Cited by 126
A Blockchain‐Based Federated Learning Method for Smart Healthcare
Chang, Y., Fang, C., & Sun, W. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/4376418 · Cited by 119
“Definition 1 (differential privacy [22]).”
A Survey on Differentially Private Machine Learning [Review Article]
Gong, M., Xie, Y., Pan, K., Feng, K., & Qin, A. K. (2020) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2020.2976185 · Cited by 115
A Survey of Privacy Risks and Mitigation Strategies in the Artificial Intelligence Life Cycle
Shahriar, S., Allana, S., Hazratifard, S. M., & Dara, R. (2023) · IEEE Access · doi:10.1109/access.2023.3287195 · Cited by 114
“Moreover, differential privacy can prevent several attacks on AI models, including linkage and reconstruction attacks [169].”
BackgroundMemory-aware curriculum federated learning for breast cancer classification
Jiménez-Sánchez, A., Tardy, M., González Ballester, M. A., Mateus, D., & Piella, G. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.107318 · Cited by 114
FedHAR: Semi-Supervised Online Learning for Personalized Federated Human Activity Recognition
Yu, H., Chen, Z., Zhang, X., Chen, X., Zhuang, F., Xiong, H., & Cheng, X. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3136853 · Cited by 113
Post-Quantum Era Privacy Protection for Intelligent Infrastructures
Malina, L., Dzurenda, P., Ricci, S., Hajny, J., Srivastava, G., Matulevicius, R., Affia, A.-A. O., Laurent, M., Sultan, N. H., & Tang, Q. (2021) · IEEE Access · doi:10.1109/access.2021.3062201 · Cited by 111
Preserving Privacy in the Internet of Connected Vehicles
Ghane, S., Jolfaei, A., Kulik, L., Ramamohanarao, K., & Puthal, D. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2964410 · Cited by 105
A Review of Anonymization for Healthcare Data
Olatunji, I. E., Rauch, J., Katzensteiner, M., & Khosla, M. (2024) · Big Data · doi:10.1089/big.2021.0169 · Cited by 101
Decentralized Wireless Federated Learning With Differential Privacy
Chen, S., Yu, D., Zou, Y., Yu, J., & Cheng, X. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3145010 · Cited by 100
Remember What You Want to Forget: Algorithms for Machine Unlearning
Sekhari, A., Acharya, J., Kamath, G., & Suresh, A. T. (2021) · arXiv · doi:10.48550/arxiv.2103.03279 · Cited by 99
IoT Big Data Security and Privacy Versus Innovation
Sollins, K. R. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2898113 · Cited by 97
A Survey of Generative Adversarial Networks for Synthesizing Structured Electronic Health Records
Ghosheh, G. O., Li, J., & Zhu, T. (2024) · ACM Computing Surveys · doi:10.1145/3636424 · Cited by 95
Issues Encountered Deploying Differential Privacy
Garfinkel, S. L., Abowd, J. M., & Powazek, S. (2018) · Proceedings of the 2018 Workshop on Privacy in the Electronic Society · doi:10.1145/3267323.3268949 · Cited by 112
Analyzing Information Leakage of Updates to Natural Language Models
Zanella-Béguelin, S., Wutschitz, L., Tople, S., Rühle, V., Paverd, A., Ohrimenko, O., Köpf, B., & Brockschmidt, M. (2020) · Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3372297.3417880 · Cited by 86
“Recall that an ε-DP algorithm F is kε-differentially private for groups of size k [8].”
BackgroundFederatedScope: A Flexible Federated Learning Platform for Heterogeneity
Xie, Y., Wang, Z., Gao, D., Chen, D., Yao, L., Kuang, W., Li, Y., Ding, B., & Zhou, J. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3579075.3579081 · Cited by 84
Differentially Private Meta-Learning
Li, J., Khodak, M., Caldas, S., & Talwalkar, A. (2019) · arXiv · doi:10.48550/arxiv.1909.05830 · Cited by 82
“Since any privacy mechanism that provides (ε, δ)-DP also provides (kε, ke(k−1) δ)-DP guarantees for groups of size k (Dwork and Roth, 2014), we immediately have the following corollary.”
BackgroundInfluentialPrivacy Amplification by Iteration
Feldman, V., Mironov, I., Talwar, K., & Thakurta, A. (2018) · 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS) · doi:10.1109/focs.2018.00056 · Cited by 80
Advancing COVID-19 diagnosis with privacy-preserving collaboration in artificial intelligence
Bai, X., Wang, H., Ma, L., Xu, Y., Gan, J., Fan, Z., Yang, F., Ma, K., Yang, J., Bai, S., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00421-z · Cited by 75
Information-theoretic analysis of stability and bias of learning algorithms
Raginsky, M., Rakhlin, A., Tsao, M., Wu, Y., & Xu, A. (2016) · 2016 IEEE Information Theory Workshop (ITW) · doi:10.1109/itw.2016.7606789 · Cited by 70
AI system engineering key challenges and lessons learned
Fischer, L., Ehrlinger, L., Geist, V., Ramler, R., Sobiezky, F., Zellinger, W., Brunner, D., Kumar, M., & Moser, B. (2020) · Machine Learning and Knowledge Extraction · doi:10.3390/make3010004 · Cited by 71
“Differential privacy is based on the idea to perturb the data in a way that allows statistical reasoning while reducing individually recognizable information [54].”
BackgroundCao, H., Liu, S., Zhao, R., & Xiong, X. (2020) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147720919698 · Cited by 70
Survey: Leakage and Privacy at Inference Time
Jegorova, M., Kaul, C., Mayor, C., O'Neil, A. Q., Weir, A., Murray-Smith, R., & Tsaftaris, S. A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3229593 · Cited by 77
Trustworthy AI in the Age of Pervasive Computing and Big Data
Kumar, A., Braud, T., Tarkoma, S., & Hui, P. (2020) · 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops48775.2020.9156127 · Cited by 68
A survey on differential privacy for medical data analysis
Liu, W., Zhang, Y., Yang, H., & Meng, Q. (2024) · Annals of Data Science · doi:10.1007/s40745-023-00475-3 · Cited by 66
Generating sequential electronic health records using dual adversarial autoencoder
Lee, D., Yu, H., Jiang, X., Rogith, D., Gudala, M., Tejani, M., Zhang, Q., & Xiong, L. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa119 · Cited by 66
Kerkouche, R., Ács, G., Castelluccia, C., & Genevès, P. (2021) · Proceedings of the Conference on Health, Inference, and Learning · doi:10.1145/3450439.3451859 · Cited by 65
Machine Learning and Imaging Informatics in Oncology
Tseng, H.-H., Wei, L., Cui, S., Luo, Y., Ten Haken, R. K., & El Naqa, I. (2020) · Oncology · doi:10.1159/000493575 · Cited by 64
Fog-Embedded Deep Learning for the Internet of Things
Lyu, L., Bezdek, J. C., He, X., & Jin, J. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2912465 · Cited by 61
Zhou, J., Chen, S., Wu, Y., Li, H., Zhang, B., Zhou, L., Hu, Y., Xiang, Z., Li, Z., Chen, N., et al. (2024) · Science Advances · doi:10.1126/sciadv.adh8601 · Cited by 63
A Survey of Machine Unlearning
Nguyen, T. T., Huynh, T. T., Ren, Z., Nguyen, P. L., Liew, A. W.-C., Yin, H., & Nguyen, Q. V. H. (2022) · arXiv · doi:10.48550/arxiv.2209.02299 · Cited by 193
“( ′ | 𝑤 ) is assumed to be a As a result, a candidate set of model parameters 𝑃𝑟 ( 𝑤 | 𝐷 ) is constructed by simply maximizing the posterior probability 𝑃𝑟 ( 𝑤 | 𝐷 ) , i.e.:”
Establishing and evaluating trustworthy AI: overview and research challenges
Kowald, D., Scher, S., Pammer-Schindler, V., Müllner, P., Waxnegger, K., Demelius, L., Fessl, A., Toller, M., Mendoza Estrada, I. G., Šimić, I., et al. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1467222 · Cited by 59
Froelicher, D., Troncoso-Pastoriza, J. R., Sousa, J. S., & Hubaux, J.-P. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2976612 · Cited by 59
“, relying on a Gaussian distribution, have also been proposed [66], [67].”
Foundation Models and Fair Use
Henderson, P., Li, X., Jurafsky, D., Hashimoto, T., Lemley, M. A., & Liang, P. (2023) · doi:10.2139/ssrn.4404340 · Cited by 57
Privacy-Preserving Deep Learning Based on Multiparty Secure Computation: A Survey
Zhang, Q., Xin, C., & Wu, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3058638 · Cited by 53
FEEL: A Federated Edge Learning System for Efficient and Privacy-Preserving Mobile Healthcare
Guo, Y., Liu, F., Cai, Z., Chen, L., & Xiao, N. (2020) · 49th International Conference on Parallel Processing - ICPP · doi:10.1145/3404397.3404410 · Cited by 52
Hagendorff, T. (2021) · Minds and Machines · doi:10.1007/s11023-021-09573-8 · Cited by 47
COFEL: Communication-Efficient and Optimized Federated Learning with Local Differential Privacy
Lian, Z., Wang, W., & Su, C. (2021) · ICC 2021 - IEEE International Conference on Communications · doi:10.1109/icc42927.2021.9500632 · Cited by 58
Wu, B., Zhao, S., Sun, G., Zhang, X., Su, Z., Zeng, C., & Liu, Z. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00220 · Cited by 44
Ho, T.-T., Tran, K.-D., & Huang, Y. (2022) · Sensors · doi:10.3390/s22103728 · Cited by 44
Not All Features Are Equal: Discovering Essential Features for Preserving Prediction Privacy
Mireshghallah, F., Taram, M., Jalali, A., Elthakeb, A. T., Tullsen, D., & Esmaeilzadeh, H. (2020) · arXiv · doi:10.48550/arxiv.2003.12154 · Cited by 44
LLM-PBE: Assessing Data Privacy in Large Language Models
Li, Q., Hong, J., Xie, C., Tan, J., Xin, R., Hou, J., Yin, X., Wang, Z., Hendrycks, D., Wang, Z., et al. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3681954.3681994 · Cited by 42
Wang, Y., Gao, M., Ran, X., Ma, J., & Zhang, L. Y. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119457 · Cited by 42
Neera, J., Chen, X., Aslam, N., Wang, K., & Shu, Z. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3126577 · Cited by 42
Differentially private user-based collaborative filtering recommendation based on k-means clustering
Chen, Z., Wang, Y., Zhang, S., Zhong, H., & Chen, L. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114366 · Cited by 42
LLM-PBE: Assessing Data Privacy in Large Language Models
Li, Q., Hong, J., Xie, C., Tan, J., Xin, R., Hou, J., Yin, X., Wang, Z., Hendrycks, D., Wang, Z., et al. (2024) · arXiv · doi:10.48550/arxiv.2408.12787 · Cited by 42
Secure Architectures Implementing Trusted Coalitions for Blockchained Distributed Learning (TCLearn)
Lugan, S., Desbordes, P., Brion, E., Ramos Tormo, L. X., Legay, A., & Macq, B. (2019) · IEEE Access · doi:10.1109/access.2019.2959220 · Cited by 39
“particular data point is included in the input dataset [15].”
BackgroundMNSSp3: medical big data privacy protection platform based on internet of things
Wu, X., Zhang, Y., Wang, A., Shi, M., Wang, H., & Liu, L. (2022) · Neural Computing and Applications · doi:10.1007/s00521-020-04873-z · Cited by 38
Rodríguez-Barroso, N., Martínez-Cámara, E., Luzón, M. V., & Herrera, F. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108588 · Cited by 38
Differentially private image classification using support vector machine and differential privacy
Senekane, M. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1010029 · Cited by 38
Das Swain, V., Saha, K., Abowd, G. D., & De Choudhury, M. (2020) · 2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi50398.2020.00025 · Cited by 38
Privacy and utility of private synthetic data for medical data analyses
Appenzeller, A., Leitner, M., Philipp, P., Krempel, E., & Beyerer, J. (2022) · Applied Sciences · doi:10.3390/app122312320 · Cited by 37
“A randomized algorithm K is e-differentially private if, for all S ⊆ Range(K) and for all databases D1 and D2, which differ by at most one entry, the following holds [20]:”
BackgroundHorizontal Federated Recommender System: A Survey
Wang, L., Zhou, H., Bao, Y., Yan, X., Shen, G., & Kong, X. (2024) · ACM Computing Surveys · doi:10.1145/3656165 · Cited by 37
Liu, Y., Zhou, P., Yang, L., Wu, Y., Xu, Z., Liu, K., & Wang, X. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2021.3085964 · Cited by 37
Deng, Z., Sun, R., Xue, M., Ma, W., Wen, S., Nepal, S., & Xiang, Y. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3581103 · Cited by 36
New SVD-based collaborative filtering algorithms with differential privacy
Xian, Z., Li, Q., Huang, X., & Li, L. (2017) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-162053 · Cited by 35
FORESEEN: Towards Differentially Private Deep Inference for Intelligent Internet of Things
Lyu, L., Bezdek, J. C., Jin, J., & Yang, Y. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3000374 · Cited by 34
“In particular, we formally state the improved Gaussian mechanism in Corollary 4, which removes the constraint (cid:2) 1 in the traditional Gaussian mechanism [28].”
BackgroundLiu, H., Wang, Y., Zhang, Z., Deng, J., Chen, C., & Zhang, L. Y. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103720 · Cited by 34
Federated learning vulnerabilities, threats and defenses: A systematic review and future directions
Almutairi, S., & Barnawi, A. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100947 · Cited by 35
How to Democratise and Protect AI: Fair and Differentially Private Decentralised Deep Learning
Lyu, L., Li, Y., Nandakumar, K., Yu, J., & Ma, X. (2020) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2020.3006287 · Cited by 31
A federated learning architecture for secure and private neuroimaging analysis
Stripelis, D., Gupta, U., Saleem, H., Dhinagar, N., Ghai, T., Anastasiou, C., Sánchez, R., Steeg, G. V., Ravi, S., Naveed, M., et al. (2024) · Patterns · doi:10.1016/j.patter.2024.101031 · Cited by 31
The Upworthy Research Archive, a time series of 32,487 experiments in U.S. media
Matias, J. N., Munger, K., Le Quere, M. A., & Ebersole, C. (2021) · Scientific Data · doi:10.1038/s41597-021-00934-7 · Cited by 29
Federated Learning-Based Cell-Free Massive MIMO System for Privacy-Preserving
Zhang, J., Zhang, J., Ng, D. W. K., & Ai, B. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3225812 · Cited by 30
Global and Local Differential Privacy for Collaborative Bandits
Wang, H., Zhao, Q., Wu, Q., Chopra, S., Khaitan, A., & Wang, H. (2020) · Fourteenth ACM Conference on Recommender Systems · doi:10.1145/3383313.3412254 · Cited by 28
“Because differential privacy is immune to post-processing [13], this ensures differential privacy on the algorithm’s output.”
BackgroundReuseKNN: Neighborhood Reuse for Differentially Private KNN-Based Recommendations
Müllner, P., Lex, E., Schedl, M., & Kowald, D. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3608481 · Cited by 27
Ibitoye, O., Shafiq, M. O., & Matrawy, A. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102631 · Cited by 27
On the Power of Multiple Anonymous Messages
Ghazi, B., Golowich, N., Kumar, R., Pagh, R., & Velingker, A. (2019) · arXiv · doi:10.48550/arxiv.1908.11358 · Cited by 26
“Lemma 2.1 (Post-processing, e.g., [29]) .”
InfluentialIntegrating Technical and Legal Concepts of Privacy
Sokolovska, A., & Kocarev, L. (2018) · IEEE Access · doi:10.1109/access.2018.2836184 · Cited by 24
An adaptive robust defending algorithm against backdoor attacks in federated learning
Wang, Y., Zhai, D.-H., He, Y., & Xia, Y. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.01.026 · Cited by 25
“Privacy-preserving quantum machine learning using differential privacy,”
Senekane, M., Mafu, M., & Taele, B. M. (2017) · 2017 IEEE AFRICON · doi:10.1109/afrcon.2017.8095692 · Cited by 25
Generalized genomic data sharing for differentially private federated learning
Aziz, M. M. A., Anjum, M. M., Mohammed, N., & Jiang, X. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104113 · Cited by 24
A comprehensive survey and taxonomy on privacy-preserving deep learning
Tran, A.-T., Luong, T.-D., & Huynh, V.-N. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127345 · Cited by 21
On the Detection of Shilling Attacks in Federated Collaborative Filtering
Jiang, Y., Zhou, Y., Wu, D., Li, C., & Wang, Y. (2020) · 2020 International Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds51746.2020.00026 · Cited by 22
“Differential privacy poses noises on a user’s item ratings before they are collected, which however impair the recommendation performance [21], [22].”
BackgroundAnonymization of Daily Activity Data by Using ℓ-diversity Privacy Model
Parameshwarappa, P., Chen, Z., & Koru, G. (2021) · ACM Transactions on Management Information Systems · doi:10.1145/3456876 · Cited by 19
Differentially Private Federated Learningfor Anomaly Detection in eHealth Networks
Cholakoska, A., Pfitzner, B., Gjoreski, H., Rakovic, V., Arnrich, B., & Kalendar, M. (2021) · Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers · doi:10.1145/3460418.3479365 · Cited by 20
Federated transfer learning with differential privacy for multi-omics survival analysis
Wen, G., & Li, L. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf166 · Cited by 17
Privacy Preserving Time-Series Forecasting of User Health Data Streams
Imtiaz, S., Horchidan, S.-F., Abbas, Z., Arsalan, M., Chaudhry, H. N., & Vlassov, V. (2020) · 2020 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata50022.2020.9378186 · Cited by 15
“Traditionally, for Laplace mechanism, random noise is drawn from a Laplacian distribution with mean 0 and variance S f /ε to achieve ε -differential privacy [26].”
Yang, J., Fu, C., & Lu, H. (2021) · Information Sciences · doi:10.1016/j.ins.2021.02.028 · Cited by 14
Composition Theorems for Interactive Differential Privacy
Lyu, X. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-0705 · Cited by 13
Prediction and Privacy Scheme for Traffic Flow Estimation on the Highway Road Network
Akallouch, M., Akallouch, O., Fardousse, K., Bouhoute, A., & Berrada, I. (2022) · Information · doi:10.3390/info13080381 · Cited by 13
CryptoRec: Novel Collaborative Filtering Recommender Made Privacy-Preserving Easy
Wang, J., Jin, C., Tang, Q., Liu, Z., & Aung, K. M. M. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3065752 · Cited by 9
Angelopoulos, A. N., Bates, S., Zrnic, T., & Jordan, M. I. (2022) · Harvard Data Science Review · doi:10.1162/99608f92.16c71dad · Cited by 8
Li, X., Wang, Y., Song, J., Liu, Y., Zhang, X., Zhou, K., & Li, C. (2020) · World Wide Web · doi:10.1007/s11280-019-00769-8 · Cited by 7
What Can Natural Language Processing Do for Peer Review?
Kuznetsov, I., Afzal, O. M., Dercksen, K., Dycke, N., Goldberg, A., Hope, T., Hovy, D., Kummerfeld, J. K., Lauscher, A., Leyton-Brown, K., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.06563 · Cited by 6
“…to the careful legal treatment of reviewing data and its derivatives (Section 7), privacy-preserving techniques such as differential privacy (Dwork and Roth, 2014; Klymenko et al., 2022) and anonymization (Li et al., 2007) should be explored to minimize risks to the participants of the…”
BackgroundEmotionally based strategic communications as a new tool in defensive cognitive warfare
Ćosić, K., Popović, S., & Wiederhold, B. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1751406 · Cited by 4
Automatic Discovery of Privacy–Utility Pareto Fronts
Avent, B., González, J., Diethe, T., Paleyes, A., & Balle, B. (2020) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2020-0060 · Cited by 3
Metadata
- Authors
- Dwork, C., & Roth, A.
- Affiliations
- Microsoft (United States) (US)
- University of Pennsylvania (US)
- Venue
- Foundations and Trends® in Theoretical Computer Science
- Publisher
- Emerald
- Published
- 2014-08-11
- Volume
- 9
- Issue
- 3-4
- Pages
- 211-487
- ISSN
- 1551-305X (ISSN-L)
- 1551-3068
- OpenAlex
- W4205228770
- Cited by
- 5,557
- References
- 6
- Citations by year
- 2026: 887 · 2025: 822 · 2024: 755 · 2023: 706 · 2022: 602 · 2021: 562 · 2020: 473 · 2019: 297 · 2018: 194 · 2017: 150 · 2016: 73 · 2015: 28 · 2014: 6
- FWCI
- 85.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Foundations and Trends® in Theoretical Computer Science (publishedVersion)
- ELARTU (Ternopil National Technical University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › Cryptography and Data Security
- Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
- Keywords
- differential privacy, privacy-preserving data analysis, privacy definitions, computational complexity, mechanism design, distributed databases, data streams
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.