Subsampled Rényi Differential Privacy and Analytical Moments Accountant
Open accessAbstract
We study the problem of subsampling in differential privacy (DP), a question that is the centerpiece behind many successful differentially private machine learning algorithms. Specifically, we provide a tight upper bound on the Rényi Differential Privacy (RDP) (Mironov, 2017) parameters for algorithms that: (1) subsample the dataset, and then (2) applies a randomized mechanism M to the subsample, in terms of the RDP parameters of M and the subsampling probability parameter. Our results generalize the moments accounting technique, developed by Abadi et al. (2016) for the Gaussian mechanism, to any subsampled RDP mechanism.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Client data in federated learning can be noisy (e.g., noisy features or noisy labels) even without malicious intent.
“Even if the data on a client is not intentionally malicious, it may have noisy features [350] (eg. in vision applications, a client may have a low-resolution camera whose output is scaled to a higher resolution) or noisy labels [356] (eg. if the user indicates that a recommendation by an app is not relevant accidentally).”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [350]
The citation to this paper is attached to the noisy-features part of the sentence; noisy labels has a separate citation. The Introduction (p. 1) discusses Gaussian noise added to gradients for differential privacy, not unintentionally noisy client features. Searches for low-resolution cameras, noisy features, malicious clients, and noisy labels found no passage addressing the attributed point. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Calibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272 · see citing works
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · see citing works
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557 · see citing works
RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Response
Erlingsson, Ú., Pihur, V., & Korolova, A. (2014) · Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2660267.2660348 · Cited by 1,838 · see citing works
Our Data, Ourselves: Privacy Via Distributed Noise Generation
Dwork, C., Kenthapadi, K., McSherry, F., Mironov, I., & Naor, M. (2006) · Lecture Notes in Computer Science · doi:10.1007/11761679_29 · Cited by 1,835 · see citing works
Rényi Divergence and Kullback-Leibler Divergence
van Erven, T., & Peter Harremöes, D. (2014) · IEEE Transactions on Information Theory · doi:10.1109/tit.2014.2320500 · Cited by 1,553 · see citing works
Concentrated Differential Privacy: Simplifications, Extensions, and Lower Bounds
Bun, M., & Steinke, T. (2016) · Theory of Cryptography Conference · doi:10.1007/978-3-662-53641-4_24 · Cited by 1,045 · see citing works
Kasiviswanathan, S. P., Lee, H. K., Nissim, K., Raskhodnikova, S., & Smith, A. (2011) · SIAM Journal on Computing · doi:10.1137/090756090 · Cited by 898 · see citing works
Self-citationStochastic gradient descent with differentially private updates
Song, S., Chaudhuri, K., & Sarwate, A. D. (2013) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2013.6736861 · Cited by 524 · see citing works
The composition theorem for differential privacy
Kairouz, P., Oh, S., & Viswanath, P. (2017) · IEEE Transactions on Information Theory · doi:10.1109/tit.2017.2685505 · Cited by 408 · see citing works
Concentrated Differential PrivacyPreprint
Dwork, C., & Rothblum, G. N. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.forc.2026.4 · Cited by 372 · see citing works
Privacy Amplification by Subsampling: Tight Analyses via Couplings and DivergencesPreprint
Balle, B., Barthe, G., & Gaboardi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01647 · Cited by 154 · see citing works
Self-citationOn the chi square and higher-order chi distances for approximating f-divergences
Nielsen, F., & Nock, R. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2288355 · Cited by 135 · see citing works
Composable and versatile privacy via truncated CDP
Bun, M., Dwork, C., Rothblum, G. N., & Steinke, T. (2018) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/3188745.3188946 · Cited by 121 · see citing works
Rényi divergence measures for commonly used univariate continuous distributions
Gil, M., Alajaji, F., & Linder, T. (2013) · Information Sciences · doi:10.1016/j.ins.2013.06.018 · Cited by 112 · see citing works
On the Limiting Distributions of Estimates Based on Samples from Finite Universes
Madow, W. G. (1948) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730149 · Cited by 103 · see citing works
Differentially Private Release and Learning of Threshold Functions
Bun, M., Kobbi Nissim, B., Stemmer, U., & Vadhan, S. (2015) · Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2015.45 · Cited by 103 · see citing works
Characterizing the sample complexity of private learners
Beimel, A., Kobbi Nissim, B., & Stemmer, U. (2013) · Conference on Innovations in Theoretical Computer Science · doi:10.1145/2422436.2422450 · Cited by 53 · see citing works
Rényi divergence and the central limit theorem
Bobkov, S. G., Chistyakov, G. P., & Götze, F. (2018) · The Annals of Probability · doi:10.1214/18-aop1261 · Cited by 31 · see citing works
Rényi Differential Privacy Mechanisms for Posterior SamplingPreprint
Geumlek, J., Song, S., & Chaudhuri, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.00892 · Cited by 28 · see citing works
On the Theory and Practice of Privacy-Preserving Bayesian Data AnalysisPreprint
Foulds, J. R., Geumlek, J., Welling, M., & Chaudhuri, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.07294 · Cited by 25 · see citing works
Flagged first, then by citations
1 of the 22 references couldn’t be matched to a known paper.
Research works printed but not linked: 11
- Apple, D. (2017). Learning with privacy at scale. Apple Machine Learning Journal .
- Balle, B., & Wang, Y.-X. (2018). Improving gaussian mechanism for differential privacy: Analytical calibration and optimal denoising. International Conference in Machine Learning (ICML) .
- Bassily, R., Smith, A., & Thakurta, A. (2014). Private empirical risk minimization: Efficient algorithms and tight error bounds. In Foundations of Computer Science (FOCS-14) , (pp. 464-473). IEEE.
- Dwork, C., Rothblum, G. N., & Vadhan, S. (2010). Boosting and differential privacy. In Foundations of Computer Science (FOCS), 2010 51st Annual IEEE Symposium on , (pp. 51-60). IEEE.
- European Parliament, & Council of the European Union (2016). Regulation (eu) 2016/679 of the european parliament and of the council of 27 april 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing directive 95/46/ec (general data protection regulation). Official Journal of the European Union .
- Mironov, I. (2017). Rényi differential privacy. In Computer Security Foundations Symposium (CSF), 2017 IEEE 30th , (pp. 263-275). IEEE.
- Murtagh, J., & Vadhan, S. (2016). The complexity of computing the optimal composition of differential privacy. In Theory of Cryptography Conference , (pp. 157-175). Springer.
- Vajda, I. (1973). χ α -divergence and generalized fisher information. In Prague Conference on Information Theory, Statistical Decision Functions and Random Processes , (p. 223). Academia.
- Wang, Y.-X. (2018). Per-instance differential privacy. Journal of Confidentiality and Privacy, to appear .
- Wang, Y.-X., Fienberg, S., & Smola, A. (2015). Privacy for free: Posterior sampling and stochastic gradient monte carlo. In International Conference on Machine Learning (ICML-15) , (pp. 2493-2502).
- Wang, Y.-X., Lei, J., & Fienberg, S. E. (2016). Learning with differential privacy: Stability, learnability and the sufficiency and necessity of erm principle. Journal of Machine Learning Research , 17 (183), 1-40.
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · see citing works
Dong, J., Roth, A., & Su, W. (2022) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12454 · Cited by 428 · see citing works
Rodríguez-Barroso, N., Jiménez-López, D., Luzón, M. V., Herrera, F., & Martínez-Cámara, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.011 · Cited by 296 · see citing works
Differentially Private Learning with Adaptive ClippingPreprint
Andrew, G., Thakkar, O. D., McMahan, H. B., & Ramaswamy, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03871 · Cited by 197 · see citing works
Deep Learning With Gaussian Differential Privacy
Bu, Z., Dong, J., Long, Q., & Wei-Jie, S. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.cfc5dd25 · Cited by 172 · see citing works
Fast-adapting and privacy-preserving federated recommender system
Wang, Q., Yin, H., Chen, T., Yu, J., Zhou, A., & Zhang, X. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00700-6 · Cited by 151 · see citing works
Adversary Instantiation: Lower Bounds for Differentially Private Machine Learning
Nasr, M., Song, S., Thakurta, A., Papernot, N., & Carlini, N. (2021) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40001.2021.00069 · Cited by 150 · see citing works
CTAB-GAN+: enhancing tabular data synthesis
Zhao, Z., Kunar, A., Birke, R., der Scheer, H. V., & Chen, L. Y. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2023.1296508 · Cited by 139 · see citing works
Hu, R., Guo, Y., & Gong, Y. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3343288 · Cited by 138 · see citing works
Privacy Amplification by Iteration
Feldman, V., Mironov, I., Talwar, K., & Thakurta, A. (2018) · Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2018.00056 · Cited by 118 · see citing works
Gradient-Leakage Resilient Federated Learning
Wei, W., Liu, L., Wu, Y., Su, G., & Iyengar, A. (2021) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs51616.2021.00081 · Cited by 116 · see citing works
Desfontaines, D., & Pejó, B. (2020) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2020-0028 · Cited by 7 · see citing works
Generative Models for Effective ML on Private, Decentralized Datasets
Augenstein, S., McMahan, H. B., Ramage, D., Ramaswamy, S., Kairouz, P., Chen, M., Mathews, R., & Arcas, B. A. Y. (2019) · arXiv · doi:10.48550/arxiv.1911.06679 · Cited by 103 · see citing works
Understanding Gradient Clipping in Private SGD: A Geometric PerspectivePreprint
Chen, X., Wu, Z. S., & Hong, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15429 · Cited by 95 · see citing works
Differentially Private Learning Needs Better Features (or Much More Data)Preprint
Tramèr, F., & Boneh, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.11660 · Cited by 113 · see citing works
Hiding Among the Clones: A Simple and Nearly Optimal Analysis of Privacy Amplification by Shuffling
Feldman, V., McMillan, A., & Talwar, K. (2022) · Annual Symposium on Foundations of Computer Science · doi:10.1109/focs52979.2021.00096 · Cited by 88 · see citing works
Projected federated averaging with heterogeneous differential privacy
Liu, J., Lou, J., Xiong, L., Liu, J., & Meng, X. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3503585.3503592 · Cited by 76 · see citing works
Qu, Z., Tang, Y. S., Muhammad, G., & Tiwari, P. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101824 · Cited by 72 · see citing works
Survey: Leakage and Privacy at Inference Time
Jegorova, M., Kaul, C., Mayor, C., O'Neil, A. Q., Weir, A., Murray-Smith, R., & Tsaftaris, S. A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3229593 · Cited by 77 · see citing works
Lin, Q., Jiang, S., Zhen, Z., Chen, T., Wei, C., & Lin, H. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3351648 · Cited by 62 · see citing works
Secure and robust machine learning for healthcare: A survey
Qayyum, A., Qadir, J., Bilal, M., & Al-Fuqaha, A. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.3013489 · Cited by 59 · see citing works
An Adaptive and Fast Convergent Approach to Differentially Private Deep Learning
Xu, Z., Shi, S., Liu, A. X., Zhao, J., & Chen, L. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155359 · Cited by 59 · see citing works
Private-kNN: Practical Differential Privacy for Computer Vision
Zhu, Y., Yu, X., Chandraker, M. K., & Wang, Y.-X. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01187 · Cited by 57 · see citing works
Self-citationRDP-GAN: A Rényi-Differential Privacy Based Generative Adversarial Network
Ma, C., Li, J., Ding, M., Liu, B., Wei, K., Weng, J., & Poor, H. V. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3233580 · Cited by 59 · see citing works
Shuffled Model of Federated Learning: Privacy, Accuracy and Communication Trade-Offs
Girgis, A. M., Data, D., Diggavi, S. N., Kairouz, P., & Suresh, A. T. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3056102 · Cited by 52 · see citing works
Practical and private (deep) learning without sampling or shuffling
Kairouz, P., McMahan, B., Song, S., Thakkar, O., Thakurta, A., & Xu, Z. (2021) · arXiv · doi:10.48550/arxiv.2103.00039 · Cited by 52 · see citing works
Privacy Loss Classes: The Central Limit Theorem in Differential Privacy
Sommer, D., Meiser, S., & Mohammadi, E. (2019) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2019-0029 · Cited by 48 · see citing works
Chen, L., Ding, X., Bao, Z., Zhou, P., & Jin, H. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3379001 · Cited by 50 · see citing works
Xu, J. J., Zhang, W., & Fei, W. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3107796 · Cited by 42 · see citing works
Harder, F., Adamczewski, K., & Park, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11603 · Cited by 42 · see citing works
Do Not Let Privacy Overbill Utility: Gradient Embedding Perturbation for Private LearningPreprint
Yu, D., Zhang, H., Chen, W., & Liu, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12677 · Cited by 49 · see citing works
On the Rényi Differential Privacy of the Shuffle Model
Girgis, A. M., Data, D., Diggavi, S. N., Suresh, A. T., & Kairouz, P. (2021) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3460120.3484794 · Cited by 39 · see citing works
Understanding Unintended Memorization in Language Models Under Federated Learning
Thakkar, O. D., Ramaswamy, S., Mathews, R., & Beaufays, F. (2021) · Proceedings of the Third Workshop on Privacy in Natural Language Processing · doi:10.18653/v1/2021.privatenlp-1.1 · Cited by 39 · see citing works
Three Variants of Differential Privacy: Lossless Conversion and Applications
Asoodeh, S., Liao, J., Calmon, F. P., Kosut, O., & Sankar, L. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3054692 · Cited by 37 · see citing works
Training Production Language Models without Memorizing User Data
Ramaswamy, S., Thakkar, O., Mathews, R., Andrew, G., McMahan, H. B., & Beaufays, F. (2020) · arXiv · doi:10.48550/arxiv.2009.10031 · Cited by 37 · see citing works
Mitigating Membership Inference Attacks by Self-Distillation Through a Novel Ensemble ArchitecturePreprint
Tang, X., Mahloujifar, S., Song, L., Shejwalkar, V., Nasr, M., Houmansadr, A., & Mittal, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08324 · Cited by 40 · see citing works
Rahdari, A., Keshavarz, E., Nowroozi, E., Taheri, R., Hajizadeh, M., Mohammadi, M., Sinaei, S., & Bauschert, T. (2025) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2025.3560034 · Cited by 48 · see citing works
Large Scale Private Learning via Low-rank ReparametrizationPreprint
Yu, D., Zhang, H., Chen, W., Yin, J., & Liu, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09352 · Cited by 40 · see citing works
Differential privacy model for blockchain based smart home architecture
Qashlan, A., Nanda, P., & Mohanty, M. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.08.010 · Cited by 36 · see citing works
Private Wireless Federated Learning with Anonymous Over-the-Air Computation
Hasırcıoglu, B., & Gündüz, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413624 · Cited by 34 · see citing works
Near, J. P., Darais, D., Abuah, C., Stevens, T., Gaddamadugu, P., Wang, L., Somani, N., Zhang, M., Sharma, N., Shan, A., et al. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3360598 · Cited by 34 · see citing works
P3GM: Private High-Dimensional Data Release via Privacy Preserving Phased Generative Model
Takagi, S., Takahashi, T., Cao, Y., & Yoshikawa, M. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00022 · Cited by 33 · see citing works
Zhang, C. B. C., Hu, X., Xie, Y., Gong, M., & Yu, B. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2019.00112 · Cited by 31 · see citing works
DPNAS: Neural Architecture Search for Deep Learning with Differential Privacy
Cheng, A., Wang, J., Zhang, X. S., Chen, Q., Wang, P., & Cheng, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20586 · Cited by 30 · see citing works
Zhang, P., Fang, X., Zhang, Z., Fang, X., Liu, Y., & Zhang, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103046 · Cited by 29 · see citing works
A Better Bound Gives a Hundred Rounds: Enhanced Privacy Guarantees via f-Divergences
Asoodeh, S., Liao, J., Calmon, F. P., Kosut, O., & Sankar, L. (2020) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit44484.2020.9174015 · Cited by 29 · see citing works
Yao, W., Hai, Z., & Shi, H. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3348117 · Cited by 28 · see citing works
Jiang, S., Wang, X., Que, Y., & Lin, H. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103108 · Cited by 27 · see citing works
Differentially Private Federated Learning: An Information-Theoretic Perspective
Asoodeh, S., Chen, W., Calmon, F. P., & Özgür, A. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9518124 · Cited by 25 · see citing works
Improving Deep Learning with Differential Privacy using Gradient Encoding and DenoisingPreprint
Nasr, M., Shokri, R., & Houmansadr, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.11524 · Cited by 24 · see citing works
Don't Generate Me: Training Differentially Private Generative Models with Sinkhorn DivergencePreprint
Cao, T., Bie, A., Vahdat, A., Fidler, S., & Kreis, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.01177 · Cited by 24 · see citing works
Optimal Accounting of Differential Privacy via Characteristic FunctionPreprint
Zhu, Y., Dong, J., & Wang, Y.-X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08567 · Cited by 23 · see citing works
Self-citationCross-silo Federated Learning with Record-level Personalized Differential Privacy
Liu, J., Lou, J., Xiong, L., Liu, J., & Meng, X. (2024) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3658644.3670351 · Cited by 24 · see citing works
Hossain, I., Puppala, S., & Talukder, S. K. (2023) · IEEE International Conference on AI in Cybersecurity (ICAIC) · doi:10.1109/icaic57335.2023.10044122 · Cited by 23 · see citing works
Variational Bayes In Private Settings (VIPS)
Park, M., Foulds, J. R., Chaudhuri, K., & Welling, M. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11763 · Cited by 21 · see citing works
ATLAS: GAN-Based Differentially Private Multi-Party Data Sharing
Wang, Z., Cheng, X., Su, S., Liang, J., & Yang, H.-C. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3277716 · Cited by 20 · see citing works
Communication-Efficient and Privacy-Preserving Aggregation in Federated Learning With Adaptability
Sun, X., Yuan, Z., Kong, X., Xue, L., He, L., & Ying, L. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3396217 · Cited by 20 · see citing works
Wei, J., Bao, E., Xiao, X., & Yang, Y. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3560562 · Cited by 19 · see citing works
Releasing Graph Neural Networks with Differential Privacy GuaranteesPreprint
Olatunji, I. E., Funke, T., & Khosla, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08907 · Cited by 19 · see citing works
Yu, S., Wei, Z., Sun, G., Zhou, Y., & Zang, H. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.140285 · Cited by 17 · see citing works
DPGEN: Differentially Private Generative Energy-Guided Network for Natural Image Synthesis
Chen, J., Yu, C.-M., Kao, C.-C., Pang, T.-W., & Lu, C.-S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00820 · Cited by 17 · see citing works
Differential Privacy Dynamics of Langevin Diffusion and Noisy Gradient DescentPreprint
Chourasia, R., Ye, J., & Shokri, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05855 · Cited by 17 · see citing works
Lee, D. Y., Choi, B., Kim, C., Fridgeirsson, E. A., Reps, J., Kim, M.-S., Kim, J., Jang, J., Rhee, S. Y., Seo, W., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/46165 · Cited by 16 · see citing works
Differentially Private Federated Learning With Importance Client Sampling
Chen, L., Ding, X., Li, M., & Jin, H. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3338464 · Cited by 16 · see citing works
On the Tradeoff Between Privacy Preservation and Byzantine-Robustness in Decentralized Learning
Ye, H., Zhu, H., & Ling, Q. H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447047 · Cited by 16 · see citing works
Toward Robust Differential Privacy in Adaptive Federated Learning Architectures
Jin, Z., Xu, C., Wang, Z., & Sun, C. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3525084 · Cited by 16 · see citing works
Privacy Amplification by Mixing and Diffusion MechanismsPreprint
Balle, B., Barthe, G., Gaboardi, M., & Geumlek, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12264 · Cited by 16 · see citing works
Self-citationBorgnia, E., Geiping, J., Cherepanova, V., Fowl, L., Gupta, A. K., Ghiasi, A., Huang, F., Goldblum, M., & Goldstein, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.02079 · Cited by 16 · see citing works
Koskela, A., Jälkö, J., Prediger, L., & Honkela, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07134 · Cited by 15 · see citing works
Renyi Differential Privacy of the Subsampled Shuffle Model in Distributed LearningPreprint
Girgis, A. M., Data, D., & Diggavi, S. N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.08763 · Cited by 15 · see citing works
Differentially private synthetic mixed-type data generation for unsupervised learning
Tantipongpipat, U. T., Waites, C., Boob, D., Siva, A. A., & Cummings, R. (2021) · Intelligent Decision Technologies · doi:10.3233/idt-210195 · Cited by 14 · see citing works
Differentially private federated learning with Laplacian smoothing
Liang, Z., Wang, B., Gu, Q., Osher, S., & Yao, Y. (2024) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2024.101660 · Cited by 26 · see citing works
A robust neural network for privacy-preserving heart rate estimation in remote healthcare systems
Islam, T. N., & Imtiaz, H. (2024) · Healthcare Analytics · doi:10.1016/j.health.2024.100329 · Cited by 13 · see citing works
Differentially private graph neural networks for graph classification and its adaptive optimization
Li, Y., Song, X., Gong, K., Liu, S., & Li, W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125798 · Cited by 13 · see citing works
Differentially Private Graph Neural Networks for Link Prediction
Ran, X., Ye, Q., Hu, H., Huang, X. S., Xu, J., & Fu, J. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00133 · Cited by 12 · see citing works
Muthukrishnan, G., & Kalyani, S. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3536277 · Cited by 12 · see citing works
Efficient Privacy-Preserving Stochastic Nonconvex OptimizationPreprint
Wang, L., Jayaraman, B., Evans, D., & Gu, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13659 · Cited by 12 · see citing works
Libra: High-Utility Anonymization of Event Logs for Process Mining via Subsampling
Elkoumy, G., & Dumas, M. (2022) · International Conference on Process Mining (ICPM) · doi:10.1109/icpm57379.2022.9980619 · Cited by 10 · see citing works
Multi-Message Shuffled Privacy in Federated Learning
Girgis, A. M., & Diggavi, S. N. (2024) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2024.3366225 · Cited by 10 · see citing works
Samplable Anonymous Aggregation for Private Federated Data Analysis
Talwar, K., Wang, S., McMillan, A., Feldman, V., Bansal, P., Basile, B., Cahill, Á., Chan, Y. S., Chatzidakis, M., Chen, J., et al. (2024) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3658644.3690224 · Cited by 10 · see citing works
Yuan, J., & Chen, Y. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111139 · Cited by 10 · see citing works
Federated Intrusion Detection for IoT with Heterogeneous Cohort PrivacyPreprint
Chathoth, A. K., Jagannatha, A., & Lee, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.09878 · Cited by 10 · see citing works
Dynamic Differential-Privacy Preserving SGDPreprint
Du, J. Q., Li, S., Chen, X., Chen, S., & Hong, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.00173 · Cited by 10 · see citing works
Private Image Generation with Dual-Purpose Auxiliary Classifier
Chen, C., Liu, D., Ma, S., Nepal, ., & Xu, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01950 · Cited by 9 · see citing works
Computing Tight Differential Privacy Guarantees Using FFTPreprint
Koskela, A., Jälkö, J., & Honkela, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03049 · Cited by 9 · see citing works
DTGAN: Differential Private Training for Tabular GANsPreprint
Kunar, A., Birke, R., Zhao, Z., & Chen, L. Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02521 · Cited by 9 · see citing works
Yang, J., Wu, J., & Wang, X. (2020) · IET Image Processing · doi:10.1049/iet-ipr.2020.0078 · Cited by 8 · see citing works
RetractedDistributed GAN-Based Privacy-Preserving Publication of Vertically-Partitioned Data
Jiang, X., Zhang, Y., Zhou, X., & Großklags, J. (2023) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2023-0050 · Cited by 8 · see citing works
Synthesizing Differentially Private Datasets using Random Mixing
Lee, K., Kim, H., Lee, K., Suh, C., & Ramchandran, K. (2019) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2019.8849381 · Cited by 8 · see citing works
Differentially Private Normalizing Flows for Privacy-Preserving Density Estimation
Waites, C., & Cummings, R. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462625 · Cited by 8 · see citing works
Wide Network Learning with Differential PrivacyPreprint
Zhang, H., Mironov, I., & Hejazinia, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01294 · Cited by 8 · see citing works
PEARL: Data Synthesis via Private Embeddings and Adversarial Reconstruction LearningPreprint
Liew, S. P., Takahashi, T., & Ueno, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04590 · Cited by 8 · see citing works
A Personalized Federated Learning Method Based on Knowledge Distillation and Differential Privacy
Jiang, Y., Zhao, X., Li, H., & Xue, Y. (2024) · Electronics · doi:10.3390/electronics13173538 · Cited by 7 · see citing works
Su, W. (2024) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-112723-034158 · Cited by 7 · see citing works
Chang, X., Obaidat, M. S., Xu, C., Ma, J., Xue, X., & Yu, Y. (2025) · IEEE Systems Journal · doi:10.1109/jsyst.2025.3580636 · Cited by 7 · see citing works
Zhang, T., Xu, D., Hu, Y., Vijayakumar, P., Zhu, Y., & Tolba, A. K. R. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3391662 · Cited by 7 · see citing works
Protecting Label Distribution in Cross-Silo Federated Learning
Jiang, Y.-F., Luo, X., Wu, Y., Xiao, X., & Ooi, B. C. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00113 · Cited by 7 · see citing works
Analyze and Improve Differentially Private Federated Learning: A Model Robustness Perspective
Zhang, S., Huang, J., & Li, P. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3518058 · Cited by 7 · see citing works
DPlis: Boosting Utility of Differentially Private Deep Learning via Randomized Smoothing
Wang, W., Wang, T., Wang, L., Luo, N., Zhou, P., Song, D. X., & Jia, R. (2021) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2021-0065 · Cited by 7 · see citing works
Towards practical differentially private causal graph discoveryPreprint
Wang, L., Pang, Q., & Song, D. X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08598 · Cited by 7 · see citing works
- Authors
- Wang, Y.-X., Balle, B., & Kasiviswanathan, S.
- Affiliations
- University of California, Santa Barbara (US)
- Amazon (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 10
- Issue
- 2
- ISSN
- 2575-8527 (ISSN-L)
- arXiv
- 1808.00087
- OpenAlex
- W2887654530
- Cited by
- 224
- References
- 22
- Citations by year
- 2026: 24 · 2025: 30 · 2024: 44 · 2023: 17 · 2022: 13 · 2021: 48 · 2020: 35 · 2019: 12 · 2018: 1
- FWCI
- 11.11
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by-nc-nd
- arxiv.org/licenses/nonexclusive-distrib/1.0/
- Locations
- Journal of Privacy and Confidentiality (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Cryptography and Data Security
- Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
- Keywords
- differential privacy, Rényi differential privacy, subsampling, randomized mechanisms, Gaussian mechanism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
