The DOI matches its Crossref record; 50 of the 55 references it cites were found in a registry or an index.
Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting
Open accessAbstract
Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to an attacker, either through the models' structure or their observable behavior. However, the underlying cause of this privacy risk is not well understood beyond a handful of anecdotal accounts that suggest overfitting and influence might play a role. This paper examines the effect that overfitting and influence have on the ability of an attacker to learn information about the training data from machine learning models, either through training set membership inference or attribute inference attacks. Using both formal and empirical analyses, we illustrate a clear relationship between these factors and the privacy risk that arises in several popular machine learning algorithms. We find that overfitting is sufficient to allow an attacker to perform membership inference and, when the target attribute meets certain conditions about its influence, attribute inference attacks. Interestingly, our formal analysis also shows that overfitting is not necessary for these attacks and begins to shed light on what other factors may be in play. Finally, we explore the connection between membership inference and attribute inference, showing that there are deep connections between the two that lead to effective new attacks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous studies [45, 64, 75] have shown that overfitted models are more susceptible to classical membership inference attacks, while well-generalized models are almost immune to them.”
From When Machine Unlearning Jeopardizes Privacy (2021) · cites this paper as [75]
In the citing paper
“We emphasize that membership inference is the most wellestablished privacy attack and arguably constitutes a bigger privacy threat [13,28,30,37,46,48,60,66,67,75] than classlevel attacks, such as the attacks in [7, 59] and model inversion [18, 19].”
From When Machine Unlearning Jeopardizes Privacy (2021) · cites this paper as [75]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
(2012) · Cited by 9,062
Dwork, C. (2006) · Lecture notes in computer science · doi:10.1007/11787006_1 · Cited by 6,125
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961
Self-citationUnderstanding deep learning requires rethinking generalization
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016) · arXiv · doi:10.48550/arxiv.1611.03530 · Cited by 2,838
Estimation of the Warfarin Dose with Clinical and Pharmacogenetic Data
The International Warfarin Pharmacogenetics Consortium (2009) · New England Journal of Medicine · doi:10.1056/nejmoa0809329 · Cited by 1,573
Flagged first, then by citations
5 of the 55 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- goodfellow, 2016, Deep Learning
- chollet, 2017, Keras Deep learning library for theano and tensorflow
- 2006, Netfix Prize
- yeom, 2017, Privacy risk in machine learning: Analyzing the connection to overfitting, CoRR
- lecun, 1998, The MNIST Database of Handwritten Digits
- neuberg, 2017, Personal photos model
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
“This can be approached theoretically as in [425], although this often yields loose, vacuous bounds for realistic models.”
BackgroundExploiting Unintended Feature Leakage in Collaborative Learning
Melis, L., Song, C., De Cristofaro, E., & Shmatikov, V. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00029 · Cited by 1,734
Nasr, M., Shokri, R., & Houmansadr, A. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00065 · Cited by 1,760
Salem, A., Zhang, Y., Humbert, M., Berrang, P., Fritz, M., & Backes, M. (2019) · Proceedings 2019 Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23119 · Cited by 852
Extracting Training Data from Large Language Models
Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T., Song, D., Erlingsson, U., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07805 · Cited by 727
Membership Inference Attacks on Machine Learning: A Survey
Hu, H., Salcic, Z. A., Sun, L., Dobbie, G., Yu, P. S., & Zhang, X. (2022) · ACM Computing Surveys · doi:10.1145/3523273 · Cited by 662
Membership Inference Attacks From First Principles
Carlini, N., Chien, S., Nasr, M., Song, S., Terzis, A., & Tramèr, F. (2022) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46214.2022.9833649 · Cited by 728
The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networks
Zhang, Y., Jia, R., Pei, H., Wang, W., Li, B., & Song, D. X. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00033 · Cited by 519
Machine Learning with Membership Privacy using Adversarial Regularization
Nasr, M., Shokri, R., & Houmansadr, A. (2018) · Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3243734.3243855 · Cited by 458
When Machine Learning Meets Privacy: A Survey and Outlook
Liu, B., Ding, M., Shaham, S., Rahayu, W., Farokhi, F., & Lin, Z. (2022) · ACM Computing Surveys · doi:10.1145/3436755 · Cited by 455
LOGAN: Membership Inference Attacks Against Generative Models
Hayes, J., Melis, L., Danezis, G., & De Cristofaro, E. (2019) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2019-0008 · Cited by 433
Generative Adversarial Networks: A Survey Toward Private and Secure Applications
Cai, Z., Xiong, Z., Xu, H., Wang, P., Li, W., & Pan, Y. (2022) · ACM Computing Surveys · doi:10.1145/3459992 · Cited by 376
Security and Privacy Challenges of Large Language Models: A Survey
Das, B. C., Amini, M. H., & Wu, Y. (2025) · ACM Computing Surveys · doi:10.1145/3712001 · Cited by 445
Jia, J., Salem, A., Michael Backes, A., Zhang, Y., & Gong, N. Z. (2019) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3319535.3363201 · Cited by 395
Model inversion attacks against collaborative inference
He, Z., Zhang, T., & Lee, R. B. (2019) · Proceedings of the 35th Annual Computer Security Applications Conference · doi:10.1145/3359789.3359824 · Cited by 313
GAN-Leaks: A Taxonomy of Membership Inference Attacks against Generative Models
Chen, D., Yu, N., Zhang, Y., & Fritz, M. (2020) · Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3372297.3417238 · Cited by 311
Advances in Adversarial Attacks and Defenses in Computer Vision: A Survey
Akhtar, N., Mian, A. S., Kardan, N., & Shah, M. (2021) · IEEE Access · doi:10.1109/access.2021.3127960 · Cited by 353
Rodríguez-Barroso, N., Jiménez-López, D., Luzón, M. V., Herrera, F., & Martínez-Cámara, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.011 · Cited by 296
A Survey of Privacy Attacks in Machine Learning
Rigaki, M., & Garcia, S. (2024) · ACM Computing Surveys · doi:10.1145/3624010 · Cited by 285
Feature Inference Attack on Model Predictions in Vertical Federated Learning
Luo, X., Wu, Y., Xiao, X., & Ooi, B. C. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00023 · Cited by 268
Threats, attacks and defenses to federated learning: issues, taxonomy and perspectives
Liu, P., Xu, X., & Wang, W. (2022) · Cybersecurity · doi:10.1186/s42400-021-00105-6 · Cited by 261
Information Leakage in Embedding Models
Song, C., & Raghunathan, A. (2020) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3372297.3417270 · Cited by 284
Mo, F., Haddadi, H., Katevas, K., Marin, E., Perino, D., & Kourtellis, N. (2021) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3458864.3466628 · Cited by 322
FedEraser: Enabling Efficient Client-Level Data Removal from Federated Learning Models
Liu, G., Ma, X., Yang, Y., Wang, C., & Liu, J. (2021) · 2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS) · doi:10.1109/iwqos52092.2021.9521274 · Cited by 248
Privacy Risks of Securing Machine Learning Models against Adversarial Examples
Song, L., Shokri, R., & Mittal, P. (2019) · Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3319535.3354211 · Cited by 229
Dynamic Backdoor Attacks Against Machine Learning Models
Salem, A., Wen, R., Michael Backes, A., Ma, S., & Zhang, Y. (2022) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp53844.2022.00049 · Cited by 233
Differential Privacy Has Disparate Impact on Model Accuracy
Bagdasaryan, E., & Shmatikov, V. (2019) · arXiv · doi:10.48550/arxiv.1905.12101 · Cited by 219
A Taxonomy of Attacks on Federated Learning
Jere, M. S., Farnan, T., & Koushanfar, F. (2021) · IEEE Security & Privacy · doi:10.1109/msec.2020.3039941 · Cited by 217
Label-Only Membership Inference AttacksPreprint
Choquette-Choo, C. A., Tramèr, F., Carlini, N., & Papernot, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.14321 · Cited by 229
Analyzing the impact of feature selection on the accuracy of heart disease prediction
Pathan, M. S., Nag, A., Pathan, M. M., & Dev, S. (2022) · Healthcare Analytics · doi:10.1016/j.health.2022.100060 · Cited by 200
Membership Leakage in Label-Only Exposures
Li, Z., & Zhang, Y. (2021) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3460120.3484575 · Cited by 244
Mo, F., Shamsabadi, A. S., Katevas, K., Demetriou, S., Leontiadis, I., Cavallaro, A., & Haddadi, H. (2020) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3386901.3388946 · Cited by 208
Machine Learning Security: Threats, Countermeasures, and Evaluations
Xue, M., Yuan, C., Wu, H., Zhang, Y., & Liu, W. (2020) · IEEE Access · doi:10.1109/access.2020.2987435 · Cited by 215
Auditing Data Provenance in Text-Generation Models
Song, C., & Shmatikov, V. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330885 · Cited by 217
Enhanced Membership Inference Attacks against Machine Learning Models
Ye, J., Maddi, A., Murakonda, S. K., Bindschaedler, V., & Shokri, R. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3560675 · Cited by 260
Baccour, E., Mhaisen, N., Abdellatif, A. A., Erbad, A., Mohamed, A. M. S., Hamdi, M., & Guizani, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3200740 · Cited by 223
Local and Central Differential Privacy for Robustness and Privacy in Federated Learning
Naseri, M., Hayes, J., & De Cristofaro, E. (2022) · Proceedings 2022 Network and Distributed System Security Symposium · doi:10.14722/ndss.2022.23054 · Cited by 188
Privacy Risks of General-Purpose Language Models
Pan, X., Zhang, M., Ji, S., & Yang, M. (2020) · 2020 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40000.2020.00095 · Cited by 188
More Than Privacy: Applying Differential Privacy in Key Areas of Artificial Intelligence
Zhu, T., Ye, D., Wang, W., Zhou, W., & Yu, P. S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3014246 · Cited by 219
Machine Learning in Network Anomaly Detection: A Survey
Wang, S., Balarezo, J. F., Kandeepan, S., Al‐Hourani, A., Gomez, K., & Rubinstein, B. I. P. (2021) · IEEE Access · doi:10.1109/access.2021.3126834 · Cited by 181
Generation and evaluation of privacy preserving synthetic health data
Yale, A., Dash, S., Dutta, R., Guyon, I., Pavão, A., & Bennett, K. P. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.12.136 · Cited by 201
When Machine Unlearning Jeopardizes Privacy
Chen, M., Zhang, Z., Wang, T., Backes, M., Humbert, M., & Zhang, Y. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3484756 · Cited by 195
Chundawat, V. S., Tarun, A. K., Mandal, M., & Kankanhalli, M. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3265506 · Cited by 162
Adversarial machine learning :
Vassilev, A., Oprea, A., Fordyce, A. J., & Anderson, H. S. (2024) · doi:10.6028/nist.ai.100-2e2023 · Cited by 229
Certified Data Removal from Machine Learning Models
Guo, C., Goldstein, T., Hannun, A., & van der Maaten, L. (2019) · arXiv · doi:10.48550/arxiv.1911.03030 · Cited by 160
Updates-Leak: Data Set Inference and Reconstruction Attacks in Online Learning
Salem, A., Bhattacharya, A., Backes, M., Fritz, M., & Zhang, Y. (2020) · Universität des Saarlandes · doi:10.22028/d291-47370 · Cited by 157
MAZE: Data-Free Model Stealing Attack Using Zeroth-Order Gradient Estimation
Kariyappa, S., Prakash, A., & Qureshi, M. K. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01360 · Cited by 157
Xu, H., Zhu, T., Zhang, L., Zhou, W., & Yu, P. S. (2024) · ACM Computing Surveys · doi:10.1145/3603620 · Cited by 164
Membership Inference Attacks and Defenses in Federated Learning: A Survey
Bai, L., Hu, H., Ye, Q., Li, H., Wang, L., & Xu, J. (2024) · ACM Computing Surveys · doi:10.1145/3704633 · Cited by 179
Unrolling SGD: Understanding Factors Influencing Machine Unlearning
Thudi, A., Deza, G., Chandrasekaran, V., & Papernot, N. (2022) · 2022 IEEE 7th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp53844.2022.00027 · Cited by 135
Attacking and Protecting Data Privacy in Edge–Cloud Collaborative Inference Systems
He, Z., Zhang, T., & Lee, R. B.-L. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3022358 · Cited by 130
On the Privacy Risks of Model Explanations
Shokri, R., Strobel, M., & Zick, Y. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462533 · Cited by 167
A Survey of Privacy Risks and Mitigation Strategies in the Artificial Intelligence Life Cycle
Shahriar, S., Allana, S., Hazratifard, S. M., & Dara, R. (2023) · IEEE Access · doi:10.1109/access.2023.3287195 · Cited by 114
Machine unlearning: linear filtration for logit-based classifiers
Baumhauer, T., Schöttle, P., & Zeppelzauer, M. (2022) · Machine Learning · doi:10.1007/s10994-022-06178-9 · Cited by 141
From distributed machine learning to federated learning: In the view of data privacy and security
Shen, S., Zhu, T., Wu, D., Wang, W., & Zhou, W. (2020) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6002 · Cited by 134
Membership Inference Attack on Graph Neural Networks
Olatunji, I. E., Nejdl, W., & Khosla, M. (2021) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tpsisa52974.2021.00002 · Cited by 118
Privacy in Deep Learning: A Survey
Mireshghallah, F., Taram, M., Vepakomma, P., Singh, A., Raskar, R., & Esmaeilzadeh, H. (2020) · arXiv · doi:10.48550/arxiv.2004.12254 · Cited by 106
Paya, A., Arroni, S., García‐Díaz, V., & Gómez, A. G. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103546 · Cited by 114
Anonymization: The imperfect science of using data while preserving privacy
Gadotti, A., Rocher, L., Houssiau, F., Creţu, A.-M., & de Montjoye, Y.-A. (2024) · Science Advances · doi:10.1126/sciadv.adn7053 · Cited by 135
MLCapsule: Guarded Offline Deployment of Machine Learning as a Service
Hanzlik, L., Zhang, Y., Grosse, K., Salem, A., Augustin, M., Michael Backes, A., & Fritz, M. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00368 · Cited by 115
Nasr, M., Shokri, R., & Houmansadr, A. (2018) · arXiv (Cornell University) · Cited by 104
Robust Anomaly Detection and Backdoor Attack Detection Via Differential PrivacyPreprint
Du, M., Jia, R., & Song, D. X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07116 · Cited by 101
Privacy and Artificial Intelligence
Curzon, J., Kosa, T. A., Akalu, R., & El‐Khatib, K. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3088084 · Cited by 117
Membership Inference Attacks by Exploiting Loss Trajectory
Liu, Y., Zhao, Z., Michael Backes, A., & Zhang, Y. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3560684 · Cited by 106
When Machine Learning Meets Privacy: A Survey and OutlookPreprint
Liu, B., Ding, M., Shaham, S., Rahayu, W. J., Farokhi, F., & Lin, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.11819 · Cited by 99
SocInf: Membership Inference Attacks on Social Media Health Data With Machine Learning
Liu, G., Wang, C., Peng, K., Huang, H., Li, Y., & Cheng, W. (2019) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2019.2916086 · Cited by 96
A Critical Review on the Use (and Misuse) of Differential Privacy in Machine Learning
Blanco-Justicia, A., Sánchez, D., Domingo‐Ferrer, J., & Muralidhar, K. (2022) · ACM Computing Surveys · doi:10.1145/3547139 · Cited by 101
Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attacks
Mireshghallah, F., Goyal, K., Uniyal, A., Berg-Kirkpatrick, T., & Shokri, R. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.570 · Cited by 216
LINKTELLER: Recovering Private Edges from Graph Neural Networks via Influence Analysis
Wu, F., Long, Y., Zhang, C., & Li, B. (2022) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46214.2022.9833806 · Cited by 109
Practical Blind Membership Inference Attack via Differential Comparisons
Hui, B., Yang, Y., Yuan, H., Burlina, P., Gong, N. Z., & Cao, Y. (2021) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24293 · Cited by 126
Exploiting Explanations for Model Inversion Attacks
Zhao, X., Zhang, W., Xiao, X., & Lim, B. Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00072 · Cited by 109
Membership inference attacks against synthetic health data
Zhang, Z., Yan, C., & Malin, B. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103977 · Cited by 116
Membership Inference Attacks Against Adversarially Robust Deep Learning Models
Song, L., Shokri, R., & Mittal, P. (2019) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2019.00021 · Cited by 99
The Problem of Fairness in Synthetic Healthcare Data
Bhanot, K., Qi, M., Erickson, J. S., Guyon, I., & Bennett, K. P. (2021) · Entropy · doi:10.3390/e23091165 · Cited by 94
On the Privacy Risks of Algorithmic Fairness
Chang, H., & Shokri, R. (2021) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp51992.2021.00028 · Cited by 107
Long Time Series Land Cover Classification in China from 1982 to 2015 Based on Bi-LSTM Deep Learning
Wang, H., Zhao, X. H., Zhang, X., Wu, D., & Du, X. (2019) · Remote Sensing · doi:10.3390/rs11141639 · Cited by 91
Reconstructing Training Data with Informed Adversaries
Balle, B., Cherubin, G., & Hayes, J. (2022) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46214.2022.9833677 · Cited by 139
Analyzing Information Leakage of Updates to Natural Language Models
Zanella-Béguelin, S., Wutschitz, L., Tople, S., Rühle, V., Paverd, A., Ohrimenko, O., Köpf, B., & Brockschmidt, M. (2020) · Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3372297.3417880 · Cited by 86
Subpopulation Data Poisoning Attacks
Jagielski, M., Severi, G., Pousette Harger, N., & Oprea, A. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3485368 · Cited by 86
Inference Attacks Against Collaborative Learning.Preprint
Melis, L., Song, C., Cristofaro, E. D., & Shmatikov, V. (2018) · arXiv (Cornell University) · Cited by 93
Stealing Links from Graph Neural NetworksPreprint
He, X., Jia, J., Michael Backes, A., Gong, N. Z., & Zhang, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02131 · Cited by 95
Affinity Profiling and Discrimination by Association in Online Behavioural AdvertisingPreprint
Wachter, S. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3388639 · Cited by 85
Synthetic Data -- Anonymisation Groundhog DayPreprint
Stadler, T., Oprisanu, B., & Troncoso, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07018 · Cited by 150
Towards Demystifying Membership Inference AttacksPreprint
Truex, S., Liu, L., Gürsoy, M. E., Yu, L., & Wei, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.09173 · Cited by 84
From distributed machine learning to federated learning: In the view of data privacy and security
Shen, S., Zhu, T., Wu, D., Wang, W., & Zhou, W. (2021) · UTS ePRESS (University of Technology Sydney) · Cited by 82
A Survey of Machine and Deep Learning Methods for Privacy Protection in the Internet of Things
Rodríguez, E., Otero, B., & Canal, R. (2023) · Sensors · doi:10.3390/s23031252 · Cited by 82
A Pragmatic Approach to Membership Inferences on Machine Learning Models
Long, Y., Wang, L., Bu, D., Bindschaedler, V., Wang, X., Tang, H., Gunter, C. A., & Chen, K. (2020) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp48549.2020.00040 · Cited by 92
Cultivating trustworthy artificial intelligence in digital government
Harrison, T. M., & Luna-Reyes, L. F. (2022) · Social Science Computer Review · doi:10.1177/0894439320980122 · Cited by 81
Revisiting Membership Inference Under Realistic Assumptions
Jayaraman, B., Wang, L., Knipmeyer, K., Gu, Q., & Evans, D. (2021) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2021-0031 · Cited by 133
On the Difficulty of Membership Inference Attacks
Rezaei, S., & Liu, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00780 · Cited by 84
A Review on Machine Unlearning
Zhang, H., Nakamura, T., Isohara, T., & Sakurai, K. (2023) · SN Computer Science · doi:10.1007/s42979-023-01767-4 · Cited by 81
Membership Privacy for Machine Learning Models Through Knowledge Transfer
Shejwalkar, V., & Houmansadr, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17150 · Cited by 90
Cloud-based federated learning implementation across medical centers
Rajendran, S., Obeid, J. S., Binol, H., D`Agostino, R., Foley, K., Zhang, W., Austin, P., Brakefield, J., Gurcan, M. N., & Topaloglu, U. (2021) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00060 · Cited by 76
Membership Inference Attacks Against Recommender Systems
Zhang, M., Ren, Z., Wang, Z., Ren, P., Chen, Z., Hu, P., & Zhang, Y. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3484770 · Cited by 76
Securely Outsourcing Neural Network Inference to the Cloud With Lightweight Techniques
Liu, X., Zheng, Y., Yuan, X., & Yi, X. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3141391 · Cited by 79
Privacy Inference Attack and Defense in Centralized and Federated Learning: A Comprehensive Survey
Rao, B., Zhang, J., Wu, D., Zhu, C., Sun, X., & Chen, B. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3363670 · Cited by 89
Rethinking Membership Inference Attacks Against Transfer Learning
Wu, C., Chen, J., Fang, Q., He, K., Zhao, Z., Ren, H., Xu, G., Liu, Y., & Xiang, Y. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3413592 · Cited by 80
Shen, M., Wang, H., Zhang, B., Zhu, L., Xu, K., Li, Q. L., & Du, X. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3028110 · Cited by 73
Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics
Romandini, N., Mora, A., Mazzocca, C., Montanari, R., & Bellavista, P. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3478334 · Cited by 76
Adapting Membership Inference Attacks to GNN for Graph Classification: Approaches and Implications
Wu, B. Y., Yang, X., Pan, S., & Yuan, X. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00182 · Cited by 74
Metadata
- Authors
- Yeom, S., Giacomelli, I., Fredrikson, M., & Jha, S.
- Affiliations
- Carnegie Mellon University (US)
- University of Wisconsin–Madison (US)
- Venue
- 2018 IEEE 31st Computer Security Foundations Symposium (CSF)
- Publisher
- IEEE
- Published
- 2018-07
- Pages
- 268-282
- ISSN
- 1063-6900 (ISSN-L)
- OpenAlex
- W2795435272
- Cited by
- 1,001
- References
- 55
- Citations by year
- 2026: 114 · 2025: 176 · 2024: 141 · 2023: 155 · 2022: 144 · 2021: 137 · 2020: 81 · 2019: 43 · 2018: 8
- FWCI
- 27.47
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Security Foundations Workshop (CSFW) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Keywords
- machine learning privacy, overfitting, membership inference attacks, attribute inference attacks, training data leakage, sensitive data, privacy risks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
