Cited by 1,001Privacy-Preserving Technologies in DataAdversarial Robustness in Machine LearningPrivacy, Security, and Data Protection

The DOI matches its Crossref record; 50 of the 55 references it cites were found in a registry or an index.

Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting

Open access

Yeom, Samuel, Giacomelli, Irene, Fredrikson, Matt, Jha, Somesh·2018·2018 IEEE 31st Computer Security Foundations Symposium (CSF)

DOI 10.1109/csf.2018.00027

Open this paper in CoChat — free account Open PDF

Abstract

Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to an attacker, either through the models' structure or their observable behavior. However, the underlying cause of this privacy risk is not well understood beyond a handful of anecdotal accounts that suggest overfitting and influence might play a role. This paper examines the effect that overfitting and influence have on the ability of an attacker to learn information about the training data from machine learning models, either through training set membership inference or attribute inference attacks. Using both formal and empirical analyses, we illustrate a clear relationship between these factors and the privacy risk that arises in several popular machine learning algorithms. We find that overfitting is sufficient to allow an attacker to perform membership inference and, when the target attribute meets certain conditions about its influence, attribute inference attacks. Interestingly, our formal analysis also shows that overfitting is not necessary for these attacks and begins to shed light on what other factors may be in play. Finally, we explore the connection between membership inference and attribute inference, showing that there are deep connections between the two that lead to effective new attacks.

Integrity signals

Registry

Crossref · 10.1109/csf.2018.00027

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Untitled work
(2012) · Cited by 9,062
Differential Privacy
Dwork, C. (2006) · Lecture notes in computer science · doi:10.1007/11787006_1 · Cited by 6,125
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961
Self-citation
Understanding deep learning requires rethinking generalization
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016) · arXiv · doi:10.48550/arxiv.1611.03530 · Cited by 2,838
Estimation of the Warfarin Dose with Clinical and Pharmacogenetic Data
The International Warfarin Pharmacogenetics Consortium (2009) · New England Journal of Medicine · doi:10.1056/nejmoa0809329 · Cited by 1,573

Flagged first, then by citations

Show all 55 references

5 of the 55 references couldn’t be matched to a known paper.

Research works printed but not linked: 6

goodfellow, 2016, Deep Learning
chollet, 2017, Keras Deep learning library for theano and tensorflow
2006, Netfix Prize
yeom, 2017, Privacy risk in machine learning: Analyzing the connection to overfitting, CoRR
lecun, 1998, The MNIST Database of Handwritten Digits
neuberg, 2017, Personal photos model

Sorted by citations

Items 501–600 of 998

Approximate Distance-Comparison-Preserving Symmetric Encryption
Fuchsbauer, G., Ghosal, R., Hauke, N., & O’Neill, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-14791-3_6 · Cited by 4
Unawareness detection: Discovering black-box malicious models and quantifying privacy leakage risks
Xu, J., & Tan, C. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103565 · Cited by 5
Learning-Based Difficulty Calibration for Enhanced Membership Inference Attacks
Shi, H., Ouyang, T., & Wang, A. (2024) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp60621.2024.00012 · Cited by 7
Noiseless Privacy-Preserving Decentralized Learning
Biswas, S., Even, M., Kermarrec, A.-M., Massoulié, L., Pires, R. P., Sharma, R., & de Vos, M. (2024) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2025-0043 · Cited by 11
Privacy-Preserving Collaborative Genomic Research: A Real-Life Deployment and Vision
Rahmani, Z., Shahini, N., Gat, N., Yun, Z., Jiang, Y., Farchy, O., Harel, Y., Chaudhary, V., Ayday, E., & Sharif, M. (2023) · doi:10.1145/3689942.3694747 · Cited by 8
Efficient Techniques for Differential Privacy in Deep Learning
Tendulkar, S. G. (2025) · doi:10.1109/icoact63339.2025.11005164 · Cited by 5
Efficient and privacy-preserving deep inference towards cloud–edge collaborative
Wang, Y., Zhong, G., Duan, Y., Cheng, Y., Yin, M., & Yang, R. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113381 · Cited by 5
Blind Baselines Beat Membership Inference Attacks for Foundation Models
Das, D., Zhang, J., & Tramèr, F. (2025) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw67851.2025.00016 · Cited by 17
Defining the characteristics of interferon-alpha–stimulated human genes: insight from expression data and machine learning
Chai, H., Gu, Q., Robertson, D. L., & Hughes, J. (2022) · GigaScience · doi:10.1093/gigascience/giac103 · Cited by 5
Binary and Random Inputs to Rapidly Identify Overfitting of Deep Neural Networks Trained to Output Ultrasound Images
Zhang, J., Wiacek, A., & Bell, M. A. L. (2022) · IEEE International Ultrasonics Symposium · doi:10.1109/ius54386.2022.9957314 · Cited by 5
NetGuard: Protecting Commercial Web APIs from Model Inversion Attacks using GAN-generated Fake Samples
Gong, X., Wang, Z., Chen, Y., Wang, Q., Wang, C., & Shen, C. Q. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583224 · Cited by 5
Defending Against Membership Inference Attack by Shielding Membership Signals
Miao, Y., Yu, Y., Li, X., Guo, Y., Liu, X., Choo, K. R., & Deng, R. H. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3309336 · Cited by 5
SEDMA: Self-Distillation with Model Aggregation for Membership Privacy
Nakai, T., Wang, Y., Yoshida, K., & Fujino, T. (2023) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2024-0029 · Cited by 5
ML-Based Forecasting of Temporal Dynamics in Luminescence Spectra of Ag 2 S Colloidal Quantum Dots
Malashin, I. P., Daibagya, D. S., Тынченко, В. С., Nelyub, V. A., Бородулин, А. С., Gantimurov, A., Ambrozevich, S. A., & Selyukov, А. S. (2024) · IEEE Access · doi:10.1109/access.2024.3387024 · Cited by 5
ConFUSE: Confusion-based Federated Unlearning with Salience Exploration
Meerza, S. I. A., Sadovnik, A., & Liu, J. (2024) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi61997.2024.00083 · Cited by 7
Actionability of Synthetic Data in a Heterogeneous and Rare Health Care Demographic: Adolescents and Young Adults With Cancer
Hogenboom, J., Gomes, A. L., Dekker, A. L. A. J., van der Graaf, W. T. A., Husson, O., & Wee, L. (2024) · JCO Clinical Cancer Informatics · doi:10.1200/cci.24.00056 · Cited by 5
A Unified Membership Inference Method for Visual Self-supervised Encoder via Part-aware Capability
Zhu, J., Zha, J., Li, D., & Wang, L. (2024) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3658644.3690202 · Cited by 8
Reconciling privacy and utility: an unscented Kalman filter-based framework for differentially private machine learning
Tang, K., Li, P., Song, Y., & Luo, T. Y. (2022) · Machine Learning · doi:10.1007/s10994-022-06279-5 · Cited by 5
VIsCUIT: Visual Auditor for Bias in CNN Image Classifier
Lee, S., Hoffman, J., Wang, Z. J., & Chau, D. H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02081 · Cited by 6
Unintended Memorization and Timing Attacks in Named Entity Recognition Models
Ali, R. S., Zhao, B. Z. H., Asghar, H. J., Nguyen, T. T., Wood, I. D., & Kâafar, M. A. (2023) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2023-0056 · Cited by 7
Tensions Between the Proxies of Human Values in AI
Datta, T., Nissani, D., Cembalest, M., Khanna, A., Massa, H., & Dickerson, J. P. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00049 · Cited by 7
Agnostic Label-Only Membership Inference Attack
Monreale, A., Naretto, F., & Rizzo, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-39828-5_14 · Cited by 5
Exactly Optimal and Communication-Efficient Private Estimation via Block Designs
Park, H.-Y., Nam, S.-H., & Lee, S.-H. (2024) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2024.3381195 · Cited by 5
A Security-Oriented Overview of Federated Learning Utilizing Layered Reference Model
Lu, J., Fukumoto, N., & Nakao, A. (2024) · IEEE Access · doi:10.1109/access.2024.3404948 · Cited by 5
Poster
Mo, F., Shamsabadi, A. S., Katevas, K., Cavallaro, A., & Haddadi, H. (2019) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3319535.3363279 · Cited by 5
Towards the Infeasibility of Membership Inference on Deep ModelsPreprint
Rezaei, S., & Liu, X. (2020) · arXiv (Cornell University) · Cited by 5
The Trade-Offs of Private PredictionPreprint
van der Maaten, L., & Hannun, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05089 · Cited by 5
Robustness Threats of Differential PrivacyPreprint
Tursynbek, N., Petiushko, A., & Oseledets, I. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.07828 · Cited by 20
Privacy Regularization: Joint Privacy-Utility Optimization in Language ModelsPreprint
Mireshghallah, F., Inan, H. A., Hasegawa, M., Rühle, V., Berg-Kirkpatrick, T., & Sim, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07567 · Cited by 5
Where Did You Learn That From? Surprising Effectiveness of Membership Inference Attacks Against Temporally Correlated Data in Deep Reinforcement Learning.Preprint
Gomrokchi, M., Amin, S., Aboutalebi, H., Wong, A. K. C., & Precup, D. (2021) · arXiv (Cornell University) · Cited by 5
Proceedings of the 5th workshop on Advanced tools, programming languages, and PLatforms for Implementing and Evaluating algorithms for Distributed systems
(2023) · doi:10.1145/3584684 · Cited by 5
Contrast-Then-Approximate: Analyzing Keyword Leakage of Generative Language Models
Zeng, Z., Xiang, T., Guo, S., He, J., Zhang, Q., Xu, G., & Zhang, T. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3392535 · Cited by 4
When AI reviews science: Can we trust the referee?
Wang, J., Liu, Y., Xu, H., Hu, K., Di, S., Ni, W., Yue, L., Zhang, M.-L., Ren, K., & Chen, L. (2026) · The Innovation Informatics · doi:10.59717/j.xinn-inform.2026.100030 · Cited by 7
MemDefense: Defending Against Membership Inference Attacks in IoT-Based Federated Learning via Pruning Perturbations
Shen, M., Meng, J. Y., Xu, K., Yu, S., & Zhu, L. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3403388 · Cited by 5
Re-ID-leak: Membership Inference Attacks Against Person Re-identification
Gao, J., Jiang, X., Dou, S., Li, D., Miao, D., & Zhao, C. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02115-6 · Cited by 5
On Privacy, Accuracy, and Fairness Trade-Offs in Facial Recognition
Zarei, A., Hassanpour, A., & Raja, K. B. (2025) · IEEE Access · doi:10.1109/access.2025.3536784 · Cited by 4
Revisiting Machine Unlearning with Dimensional Alignment
Seo, S., Kim, D.-W., & Han, B. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00317 · Cited by 6
RAG-leaks: difficulty-calibrated membership inference attacks on retrieval-augmented generation
Wang, G., He, J., Li, H., Zhang, M., & Feng, D. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4441-4 · Cited by 7
Membership Inference Attacks on Sequence Models
Rossi, L., Aerni, M., Zhang, J., & Tramèr, F. (2025) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw67851.2025.00014 · Cited by 5
Investigating Membership Inference Attacks Against CNN Models for BCI Systems
Cobilean, V., Mavikumbure, H. S., Drake, D., Stuart, M., & Manic, M. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3593443 · Cited by 4
Disparate privacy risks from medical AI
Knolle, M. A., Menten, M. J., Jungmann, F., Meissen, F., Glocker, B., Rueckert, D., & Kaissis, G. (2026) · Nature · doi:10.1038/s41586-026-10688-0 · Cited by 5
Learning general temporal point processes based on dynamic weight generation
Liu, S., & Li, L. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02590-1 · Cited by 4
A Review of Image Classification Algorithms in IoT
Zheng, X., & Cloutier, R. S. (2022) · EAI Endorsed Transactions on Internet of Things · doi:10.4108/eetiot.v7i28.562 · Cited by 5
FP$$^2$$-MIA: A Membership Inference Attack Free of Posterior Probability in Machine Unlearning
Lu, Z., Wang, Y., Lv, Q., Zhao, M., & Liang, T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20917-8_12 · Cited by 4
Analyzing and Defending against Membership Inference Attacks in Natural Language Processing Classification
Wang, Y., Xu, N., Huang, S., Mahmood, K., Guo, D., Ding, C., Wen, W., & Rajasekaran, S. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020711 · Cited by 6
Membership reconstruction attack in deep neural networks
Long, Y., Ying, Z., Yan, H., Fang, R., Li, X., Wang, Y., & Pan, Z. (2023) · Information Sciences · doi:10.1016/j.ins.2023.03.008 · Cited by 4
Mitigating Membership Inference Attacks via Weighted Smoothing
Tan, M., Xie, X., Sun, J., & Wang, T. (2023) · Annual Computer Security Applications Conference · doi:10.1145/3627106.3627189 · Cited by 4
Safety and Performance, Why Not Both? Bi-Objective Optimized Model Compression Against Heterogeneous Attacks Toward AI Software Deployment
Zhu, J., Wang, L., Han, X. G., Liu, A., & Xie, T. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3348515 · Cited by 4
Transpose Attack: Stealing Datasets with Bidirectional Training
Amit, G., Levy, M. Y., & Mirsky, Y. (2024) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2024.23325 · Cited by 12
Towards graph-anonymization of software analytics data: empirical study on JIT defect prediction
Malik, A., Adams, B., & Hassan, A. E. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10464-6 · Cited by 4
Differential Private Federated Learning in Geographically Distributed Public Administration Processes
Ahmadzai, M., & Nguyen, G. (2024) · Future Internet · doi:10.3390/fi16070220 · Cited by 4
Correlation inference attacks against machine learning models
Creţu, A.-M., Guépin, F., & de Montjoye, Y.-A. (2024) · Science Advances · doi:10.1126/sciadv.adj9260 · Cited by 4
On the Alignment of Group Fairness with Attribute Privacy
Aalmoes, J., Duddu, V., & Boutet, A. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0567-5_24 · Cited by 4
Overfit detection method for deep neural networks trained to beamform ultrasound images
Zhang, J., & Bell, M. A. L. (2024) · Ultrasonics · doi:10.1016/j.ultras.2024.107562 · Cited by 4
FedUNRAN: On-device Federated Unlearning via Random Labels
Mora, A., Dominici, L., & Bellavista, P. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825563 · Cited by 4
Privacy and Accuracy Implications of Model Complexity and Integration in Heterogeneous Federated Learning
Németh, G. D., Lozano, M. A., Quadrianto, N., & Oliver, N. (2025) · IEEE Access · doi:10.1109/access.2025.3546478 · Cited by 4
Reimagining the Kendall plot: using δ 15 N and δ 18 O of nitrate and advanced machine learning to improve N pollutant source classification
Samborska-Goik, K., & Wassenaar, L. I. (2025) · Isotopes in Environmental and Health Studies · doi:10.1080/10256016.2025.2467863 · Cited by 4
An Interactive Framework for Implementing Privacy-Preserving Federated Learning: Experiments on Large Language Models
Ahmadi, K., Behnia, R., Ebrahimi, R., Kermani, M. M., Birrell, J., Pacheco, J. L., & Yavuz, A. A. (2025) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw67851.2025.00035 · Cited by 4
Social Risk Early Warning of Environmental Damage of Large-Scale Construction Projects in China Based on Network Governance and LSTM Model
Fang, J., Huang, D., & Xu, J. (2020) · Complexity · doi:10.1155/2020/8863997 · Cited by 4
Forgeability and Membership Inference Attacks
Kong, Z., Chowdhury, A. R., & Chaudhuri, K. (2022) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3560830.3563731 · Cited by 4
Perceived challenges and opportunities of machine learning applications in governmental organisations: an interview-based exploration in the Netherlands
Delfos, J., Zuiderwijk, A., van Cranenburgh, S., & Chorus, C. G. (2022) · International Conference on Theory and Practice of Electronic Governance · doi:10.1145/3560107.3560122 · Cited by 6
Kernel Normalized Convolutional Networks for Privacy-Preserving Machine Learning
Nasirigerdeh, R., Torkzadehmahani, J., Rueckert, D., & Kaissis, G. A. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00016 · Cited by 5
Redactor: A Data-Centric and Individualized Defense against Inference Attacks
Heo, G., & Whang, S. E. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26737 · Cited by 4
Exploring Machine Learning Privacy/Utility Trade-Off from a Hyperparameters Lens
Arous, A., Guesmi, A., Hanif, M. A., Alouani, I., & Shafique, M. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191743 · Cited by 4
Membership inference attack on differentially private block coordinate descent
Riaz, S., Ali, S., Wang, G., Latif, M. A., & Iqbal, M. Z. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1616 · Cited by 6
SNAKE Challenge: Sanitization Algorithms under Attack
Allard, T., Béziaud, L., & Gambs, S. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614754 · Cited by 4
OPUPO: Defending Against Membership Inference Attacks With Order-Preserving and Utility-Preserving Obfuscation
Liu, Y., Li, H., Huang, G., & Hua, W. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3232111 · Cited by 4
Fingerprint membership and identity inference against generative adversarial networks
Cavasin, S., Mari, D., Milani, S., & Conti, M. (2024) · Pattern Recognition Letters · doi:10.1016/j.patrec.2024.07.018 · Cited by 4
On the Vulnerability of Data Points Under Multiple Membership Inference Attacks and Target Models
Conti, M., Li, J., & Picek, S. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3543093 · Cited by 6
Image Captions are Natural Prompts for Training Data Synthesis
Lei, S., Chen, H., Zhang, S., Zhao, B., & Tao, D. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02436-0 · Cited by 24
Reconstruction and Membership Inference Attacks against Generative ModelsPreprint
Hilprecht, B., Härterich, M., & Bernau, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03006 · Cited by 4
Reconciling Utility and Membership Privacy via Knowledge Distillation.Preprint
Shejwalkar, V., & Houmansadr, A. (2019) · arXiv (Cornell University) · Cited by 7
Policy-Based Federated LearningPreprint
Katevas, K., Bagdasaryan, E., Waterman, J., Safadieh, M. M., Birrell, E., Haddadi, H., & Estrin, D. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06612 · Cited by 6
An Extension of Fano's Inequality for Characterizing Model Susceptibility to Membership Inference AttacksPreprint
Jha, S. K., Jha, S., Ewetz, R., Raj, S., Velasquez, A., Pullum, L., & Swami, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.08097 · Cited by 4
Self-citation
Defending Medical Image Diagnostics against Privacy Attacks using Generative MethodsPreprint
Paul, W., Cao, Y., Zhang, M., & Burlina, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03078 · Cited by 4
Quantifying and Mitigating Privacy Risks of Contrastive LearningPreprint
He, X., & Zhang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04140 · Cited by 4
Privacy Inference Attacks and Defenses in Cloud-based Deep Neural Network: A SurveyPreprint
Zhang, X., Chen, C., Xie, Y., Chen, X., Zhang, J., & Xiang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.06300 · Cited by 4
Enhancing Deep Learning Model Privacy Against Membership Inference Attacks Using Privacy-Preserving Oversampling
Ghosh, S., Mandal, A. K., & Cortesi, A. (2025) · SN Computer Science · doi:10.1007/s42979-025-03845-1 · Cited by 3
Rigging the Foundation: Manipulating Pre-training for Advanced Membership Inference Attacks
Wang, Z., Zhu, R., Zhang, Z., Tang, H., & Wang, X. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00177 · Cited by 4
MUBox: A Critical Evaluation Framework of Deep Machine Unlearning [Systematization of Knowledge Paper]
Li, X., Wei, W., & Thuraisingham, B. M. (2025) · ACM Symposium on Access Control Models and Technologies (SACMAT) · doi:10.1145/3734436.3734454 · Cited by 5
LUMIA: Linear Probing for Unimodal and MultiModal Membership Inference Attacks Leveraging Internal LLM States
Ibañez-Lissen, L., González‐Manzano, L., Fuentes, J. M. D., Anciaux, N., & García-Alfaro, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-07884-1_10 · Cited by 12
Privacy Preservation with Noise in Explainable AI
Allana, S., & Dara, R. A. (2025) · Conference on Privacy, Security and Trust · doi:10.1109/pst65910.2025.11268815 · Cited by 3
Dynamic gradient noise adaptation with reinforcement learning for differential privacy deep learning
Li, X., Zhao, W., & Sun, Z. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.115159 · Cited by 3
On the Privacy Risks of Deploying Recurrent Neural Networks in Machine Learning Models
Yang, Y., Gohari, P., & Topcu, U. (2023) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2023-0005 · Cited by 6
Membership inference attack for beluga whales discrimination
Araújo, V. M., Gambs, S., Michaud, R., Lautraite, H., Schneider, L., & Chion, C. (2023) · Ecological Informatics · doi:10.1016/j.ecoinf.2023.102388 · Cited by 3
Laser-engraved holograms as entropy source for random number generators
Tselios, C., Tsakas, A., Mazzucato, S., Politi, C. T., Rizomiliotis, P., & Alexandropoulos, D. (2024) · Micro and Nano Engineering · doi:10.1016/j.mne.2024.100290 · Cited by 5
Studying Forest Species Classification Methods by Combining PolSAR and Vegetation Spectral Indices
Zhu, H., Song, W., Zhang, B., Lu, E., Dai, J., Zhao, W., & Hu, Z. (2024) · Forests · doi:10.3390/f16010015 · Cited by 3
Toward Efficient Target-Level Machine Unlearning Based on Essential Graph
Xu, H. Y., Zhu, T., Zhang, L., Zhou, W., & Zhao, W. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3514607 · Cited by 5
Continuous Verification of Catastrophic Recalling in Machine Unlearning via Adversarial Testing
Qu, Y., Ji, Z., Cui, L., Zhang, C., Liu, L., & Tian, Z. (2024) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc63484.2024.00056 · Cited by 3
Differentially Private Integrated Decision Gradients (IDG-DP) for Radar-Based Human Activity Recognition
Zakariyya, I., Tran, L., Sivangi, K. B., Henderson, P., & Deligianni, F. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00548 · Cited by 3
Range Membership Inference Attacks
Tao, J., & Shokri, R. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00026 · Cited by 4
Query Provenance Analysis: Efficient and Robust Defense Against Query-Based Black-Box Attacks
Li, S., Zhang, Z., Jia, H., Guo, Y., Chen, X., & Li, D. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00072 · Cited by 4
Has My Code Been Stolen for Model Training? A Naturalness Based Approach to Code Contamination Detection
Khan, H. A., Jiang, Y., Umer, Q., Zhang, Y., Akram, W., & Liu, H. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715765 · Cited by 3
RAGLeak: Membership Inference Attacks on RAG-Based Large Language Models
Feng, K., Zhang, G., Tian, H., Xu, H., Zhang, Y., Zhu, T., Ding, M., & Liu, B. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9101-2_8 · Cited by 3
Enhance differential privacy mechanisms for clinical data analysis using CNNs and reinforcement learning
Batchala, R., Jain, P., Gyanchandani, M., Shukla, S., & Wadhvani, R. (2025) · Journal Of Big Data · doi:10.1186/s40537-025-01215-5 · Cited by 3
KD‐GAN: An effective membership inference attacks defence framework
Zhang, Z., Lin, G., Ke, L., Peng, S., Hu, L. F., & Yan, H. (2022) · International Journal of Intelligent Systems · doi:10.1002/int.23021 · Cited by 3
Total variation distance privacy: Accurately measuring inference attacks and improving utility
Jia, J., Tan, C., Liu, Z., Li, X., Liu, Z., Lv, S., & Dong, C. (2023) · Information Sciences · doi:10.1016/j.ins.2023.01.037 · Cited by 3
Capacity Abuse Attack of Deep Learning Models Without Need of Label Encodings
Luo, W., Zhang, L., Wu, Y., Liu, C., Han, P., & Zhuang, R. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3266419 · Cited by 3
Membership inference attacks against compression models
Jin, Y., Lou, W., & Gao, Y. (2023) · Computing · doi:10.1007/s00607-023-01180-y · Cited by 3
Invited Paper: Enhancing Privacy in Federated Learning via Early Exit
Wu, Y., Chiasserini, C. F., Malandrino, F., & Levorato, M. (2023) · Workshop on Advanced Tools, Programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems (ApPLIED) · doi:10.1145/3584684.3597274 · Cited by 3

Authors: Yeom, S., Giacomelli, I., Fredrikson, M., & Jha, S.
Affiliations: Carnegie Mellon University (US)
University of Wisconsin–Madison (US)
ORCID: Fredrikson, Matt
Jha, Somesh
Venue: 2018 IEEE 31st Computer Security Foundations Symposium (CSF)
Publisher: IEEE
Published: 2018-07
Pages: 268-282
ISSN: 1063-6900 (ISSN-L)
DOI: 10.1109/csf.2018.00027
OpenAlex: W2795435272
Cited by: 1,001
References: 55
Citations by year: 2026: 114 · 2025: 176 · 2024: 141 · 2023: 155 · 2022: 144 · 2021: 137 · 2020: 81 · 2019: 43 · 2018: 8
FWCI: 27.47
Type: conference paper
Language: en
Open access: green
arxiv.org
Locations: IEEE Computer Security Foundations Workshop (CSFW) (publishedVersion)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
Keywords: machine learning privacy, overfitting, membership inference attacks, attribute inference attacks, training data leakage, sensitive data, privacy risks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks