Making Machine Learning Forget
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
(2014) · Cited by 33,419 · see citing works
Calibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272 · see citing works
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · see citing works
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479 · see citing works
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754 · see citing works
Privacy-preserving data mining
Agrawal, R., & Srikant, R. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335438 · Cited by 3,009 · see citing works
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961 · see citing works
Emmers, E. (2019) · SGEM International Multidisciplinary Scientific Conferences on Social Sciences and Arts · doi:10.5593/sgemsocial2019v/1.1 · Cited by 1,317 · see citing works
Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting
Yeom, S., Giacomelli, I., Fredrikson, M., & Jha, S. (2018) · 2018 IEEE 31st Computer Security Foundations Symposium (CSF) · doi:10.1109/csf.2018.00027 · Cited by 1,001 · see citing works
Salem, A., Zhang, Y., Humbert, M., Berrang, P., Fritz, M., & Backes, M. (2019) · Proceedings 2019 Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23119 · Cited by 852 · see citing works
Privacy preserving mining of association rules
Evfimievski, A., Srikant, R., Agrawal, R., & Gehrke, J. E. (2002) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775047.775080 · Cited by 772 · see citing works
Towards Making Systems Forget with Machine Unlearning
Cao, Y., & Yang, J. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.35 · Cited by 622 · cited 4× · see citing works
“To show how machine unlearning can be implemented in practice, we will use the example of the naive Bayes classifier [7].”
BackgroundMethodInfluentialProchlo: Strong Privacy for Analytics in the Crowd
Bittau, A., Erlingsson, Ú., Maniatis, P., Mironov, I., Raghunathan, A., Lie, D., Rudominer, M., Kode, U., Tinnes, J., & Seefeld, B. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132769 · Cited by 378 · cited 1× · see citing works
“Due to such strict privacy control, local differential privacy tends to severely limit the utility provided by the dataset, and truly massive collections of data may be required to perform even simple analysis, such as frequent itemset mining [5].”
BackgroundScalable Private Learning with PATE
Papernot, N., Song, S., Mironov, I., Raghunathan, A., Talwar, K., & Erlingsson, Ú. (2018) · arXiv · doi:10.48550/arxiv.1802.08908 · Cited by 373 · see citing works
Solutions to problematic polypharmacy: learning from the expertise of patients
Reeve, J. L., Dickenson, M., Harris, J., Ranson, E., Dohnhammer, U., Cooper, L., Krska, J., Byng, R., & Britten, N. (2015) · British Journal of General Practice · doi:10.3399/bjgp15x685465 · Cited by 361 · see citing works
The U.S. Census Bureau Adopts Differential Privacy
Abowd, J. M. (2018) · ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD) · doi:10.1145/3219819.3226070 · Cited by 294 · see citing works
Algorithms that remember: model inversion attacks and data protection law
Veale, M., Binns, R., & Edwards, L. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0083 · Cited by 278 · see citing works
Privacy preserving mining of association rules
Evfimievski, A., Srikant, R., Agrawal, R., & Gehrke, J. E. (2003) · Information Systems · doi:10.1016/j.is.2003.09.001 · Cited by 158 · see citing works
Detecting Violations of Differential Privacy
Ding, Z., Wang, Y., Wang, G., Zhang, D., & Kifer, D. (2018) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3243734.3243818 · Cited by 124 · see citing works
Differentially Private Deep Learning
Zhu, T., Li, G., Zhou, W., & Yu, P. S. (2017) · Advances in information security · doi:10.1007/978-3-319-62004-6_7 · Cited by 4 · see citing works
Flagged first, then by citations
1 of the 21 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
A Survey of Machine Unlearning
Nguyên, T. T., Huynh, T. T., Ren, Z. X., Nguyen, P. L., Liew, A. W., Yin, H., & Nguyen, Q. V. H. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3749987 · Cited by 303 · see citing works
Xu, H., Zhu, T., Zhang, L., Zhou, W., & Yu, P. S. (2024) · ACM Computing Surveys · doi:10.1145/3603620 · Cited by 164 · see citing works
“[36] analyzed the problem of privacy leakage in machine learning and briely described how the łright-to-be-forgottenž can be implemented with the potential approaches.”
BackgroundVeriFi: Towards Verifiable Federated Unlearning
Gao, X., Ma, X., Wang, J., Sun, Y., Li, B., Ji, S., Cheng, P., & Chen, J. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3382321 · Cited by 111 · see citing works
Machine Unlearning for Random Forests
Brophy, J., & Lowd, D. (2020) · arXiv · doi:10.48550/arxiv.2009.05567 · Cited by 70 · see citing works
A Survey of Machine Unlearning
Nguyen, T. T., Huynh, T. T., Ren, Z., Nguyen, P. L., Liew, A. W.-C., Yin, H., & Nguyen, Q. V. H. (2022) · arXiv · doi:10.48550/arxiv.2209.02299 · Cited by 193 · see citing works
“the problem completely due to the lack of common frameworks and resources [128, 134, 153, 154].”
FAST: Adopting Federated Unlearning to Eliminating Malicious Terminals at Server Side
Guo, X., Wang, P., Qiu, S., Song, W., Zhang, Q., Wei, X., & Zhou, D. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3343117 · Cited by 31 · see citing works
Position: LLM Unlearning Benchmarks are Weak Measures of Progress
Thaker, P., Hu, S., Kale, N., Maurya, Y., Wu, Z. S., & Smith, V. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00035 · Cited by 15 · see citing works
SSSE: Efficiently Erasing Samples from Trained Machine Learning ModelsPreprint
Peşte, A., Alistarh, D., & Lampert, C. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03860 · Cited by 14 · see citing works
Machine Unlearning Method Based On Projection Residual
Cao, Z., Wang, J., Si, S., Huang, Z., & Xiao, J. (2022) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa54385.2022.10032413 · Cited by 13 · see citing works
A Decision-Making Process to Implement the ‘Right to Be Forgotten’ in Machine Learning
Hawkins, K., Alhuwaish, N., Belguith, S., Vranaki, A., & Charlesworth, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61089-9_2 · Cited by 5 · see citing works
Why Patient Data Cannot Be Easily Forgotten?
Su, R., Liu, X., & Tsaftaris, S. A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16452-1_60 · Cited by 5 · see citing works
Predicting age and gender from network telemetry: Implications for privacy and impact on policy
Kuang, L., Pobbathi, S., Mansury, Y. S., Shapiro, M. A., & Gurbani, V. K. (2022) · PLoS ONE · doi:10.1371/journal.pone.0271714 · Cited by 5 · see citing works
DART: Data Addition and Removal Trees.Preprint
Brophy, J., & Lowd, D. (2020) · arXiv (Cornell University) · Cited by 4 · see citing works
FedScale: A Federated Unlearning Method Mimicking Human Forgetting Processes
Huang, W., Wu, H., Fang, L., & Zhou, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71464-1_37 · Cited by 1 · see citing works
Approach for Class-Wise Unlearning of Data Along with Learning of New Data
Guru, D. S., & Shivaprasad, D. L. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-18974-5_14
- Authors
- Shintre, S., Roundy, K. A., & Dhaliwal, J.
- Affiliations
- NortonLifeLock (United States) (US)
- Corresponding author
- Shintre, Saurabh
- ORCID
- Roundy, Kevin A.
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2019
- Pages
- 72-83
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W2954412990
- Cited by
- 13
- References
- 21
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 3 · 2023: 2 · 2022: 3 · 2021: 1 · 2020: 1
- FWCI
- 0.48
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Lecture notes in computer science (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- machine learning privacy, right to be forgotten, General Data Protection Regulation, membership inference attacks, data protection regulation, overfitting, personal data protection, privacy-preserving machine learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review