The DOI matches its DataCite record; 245 of the 263 references it cites were found in a registry or an index.
A Survey of Machine Unlearning
Open accessAbstract
Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it can weaken the bonds of trust between humans and AI. Recent regulations now require that, on request, private information about a user must be removed from both computer systems and from ML models, i.e. ``the right to be forgotten''). While removing data from back-end databases should be straightforward, it is not sufficient in the AI context as ML models often `remember' the old data. Contemporary adversarial attacks on trained models have proven that we can learn whether an instance or an attribute belonged to the training data. This phenomenon calls for a new paradigm, namely machine unlearning, to make ML models forget about particular data. It turns out that recent works on machine unlearning have not been able to completely solve the problem due to the lack of common frameworks and resources. Therefore, this paper aspires to present a comprehensive examination of machine unlearning's concepts, scenarios, methods, and applications. Specifically, as a category collection of cutting-edge studies, the intention behind this article is to serve as a comprehensive resource for researchers and practitioners seeking an introduction to machine unlearning and its formulations, design criteria, removal requests, algorithms, and applications. In addition, we aim to highlight the key findings, current trends, and new research areas that have not yet featured the use of machine unlearning but could benefit greatly from it. We hope this survey serves as a valuable resource for ML researchers and those seeking to innovate privacy technologies. Our resources are publicly available at https://github.com/tamlhp/awesome-machine-unlearning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Related surveys on digital forgetting and machine unlearning, such as Qu et al (2023); Xu et al (2023); Nguyen et al (2022); Shaik et al (2023), have focused on the general ML case by considering models used to classify tabular or image data.”
From Digital forgetting in large language models: a survey of unlearning methods (2025) · cites this paper as Nguyen et al 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Nguyen et al (2022) refer to two levels of guarantees, exact and approximate . Xu et al (2023) further expand approximate forgetting into strong and weak forgetting, where strong forgetting is equivalent to the definition of approximate forgetting by Nguyen et al ( 2022), and weak forgetting only applies to the outputs of the model.”
From Digital forgetting in large language models: a survey of unlearning methods (2025) · cites this paper as Nguyen et al 2022
The cited source says what the claim attributes to it.
In the citing paper
“Definitions of unlearning by Nguyen et al (2022); Xu et al (2023) include D as a parameter of the unlearning mechanism (as in F ( D,D f , A ( D )) ), but access to D is not always feasible.”
From Digital forgetting in large language models: a survey of unlearning methods (2025) · cites this paper as Nguyen et al 2022
The cited source says what the claim attributes to it.
In the citing paper
“Not surprisingly, the unlearning guarantees defined by Nguyen et al ( 2022) and Xu et al (2023 ) are heavily inspired by differential pri -vacy, and privacy attacks, such as membership inference attacks or reconstruction attacks, have been used to measure the risk of privacy leaks and to evaluate the effectiveness of unlearning.”
From Digital forgetting in large language models: a survey of unlearning methods (2025) · cites this paper as Nguyen et al (2022)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“The MNIST dataset [83] consists of 60,000 training examples and 10,000 test samples that have been standardised to 20x20 pixels, centred by centre of mass in 28x28 pixels, and sheared by horizontally shifting so that the major axis is vertical.”
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193 · cited 1×
“5 ∗ KL(Td (x) | |m), whereM is unlearned model,Td is a competent teacher, and KL is The Kullback-Leibler divergence [84],m = M (x)+Td (x) 2 .”
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899 · cited 1×
“Catastrophic forgetting is a phenomenon where deep neural networks perform badly after learning too many tasks [81].”
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · cited 1×
“tially private models suffer a significant loss in accuracy even for large ε [1, 18].”
The MovieLens Datasets: History and Context
Harper, F., & Konstan, J. (2016) · TIIS · doi:10.1145/2827872 · Cited by 5,938 · cited 1×
“Movielens [63] comprises movie ratings from MovieLens, a website that provides movie recommendations.”
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557 · cited 1×
“( ′ | 𝑤 ) is assumed to be a As a result, a candidate set of model parameters 𝑃𝑟 ( 𝑤 | 𝐷 ) is constructed by simply maximizing the posterior probability 𝑃𝑟 ( 𝑤 | 𝐷 ) , i.e.:”
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754 · cited 5×
“In [135], a set of shallow models were trained on a different training set from that used for the target model.”
InfluentialA Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
Differential Privacy: A Survey of Results
Dwork, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-79228-4_1 · Cited by 3,542
Continual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
Andrzejak, R. G., Lehnertz, K., Mormann, F., Rieke, C., David, P., & Elger, C. E. (2001) · Physical Review E · doi:10.1103/physreve.64.061907 · Cited by 3,032
The EU General Data Protection Regulation (GDPR)
Voigt, P., & von dem Bussche, A. (2017) · doi:10.1007/978-3-319-57959-7 · Cited by 3,001 · cited 1×
“However, the latter focuses only on the data perspective following the General Data Protection Regulation (GDPR) [160], while machine unlearning also addresses privacy problems from a model perspective.”
The information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the LoopPreprint
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 2,318 · cited 1×
“The objective of the Large-scale Scene Understanding (LSUN) [170] challenge is to establish a new standard for the categorization and comprehension of large-scale scenes.”
Simplifying Graph Convolutional NetworksPreprint
Wu, F., Zhang, T., Junior, A. H. D. S., Fifty, C., Yu, T., & Weinberger, K. Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07153 · Cited by 2,307
Deep learning and the information bottleneck principle
Tishby, N., & Zaslavsky, N. (2015) · Information Theory Workshop · doi:10.1109/itw.2015.7133169 · Cited by 2,170
The EU General Data Protection Regulation (GDPR)
Russell, S. (2020) · doi:10.1093/oso/9780198826491.001.0001 · Cited by 2,103
Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods
Hüllermeier, E., & Waegeman, W. (2021) · Machine Learning · doi:10.1007/s10994-021-05946-3 · Cited by 1,834 · cited 1×
“metric that measures how much we know about the optimal hypothesis in the parameter space [72] That is, are we certain that the current model parameters are optimal for a given dataset?).”
Open Graph Benchmark: Datasets for Machine Learning on GraphsPreprint
Hu, W., Fey, M., Žitnik, M., Dong, Y., Ren, H., Liu, B., Catasta, M., & Leskovec, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00687 · Cited by 1,788
Opening the Black Box of Deep Neural Networks via InformationPreprint
Shwartz-Ziv, R., & Tishby, N. (2017) · arXiv.org · doi:10.48550/arxiv.1703.00810 · Cited by 1,674
Differentially Private Empirical Risk Minimization
Chaudhuri, K., Monteleoni, C., & Sarwate, A. (2009) · Journal of machine learning research · doi:10.5555/1953048.2021036 · Cited by 1,634 · cited 1×
“𝑟 _ 𝑠𝑢𝑏 𝑢 = 𝑈 ( 𝐷,𝐷 𝑓 ,𝐴 ( 𝐷 )) by generating an approximate version of 𝐷 𝑓 .”
Neural Cleanse: Identifying and Mitigating Backdoor Attacks in Neural Networks
Wang, B., Yao, Y., Shan, S., Li, H., Viswanath, B., Zheng, H.-T., & Zhao, B. Y. (2019) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2019.00031 · Cited by 1,577
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
Deep face recognition: A survey
Wang, M., & Deng, W. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.10.081 · Cited by 1,268
GradientBased Learning Applied to Document Recognition
Haykin, S., & Kosko, B. (2009) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9780470544976.ch9 · Cited by 1,211 · cited 1×
“The MNIST dataset [85] contains over 70,000 samples that have been standardised to 20x20 pixels and sheared by horizontally shifting so that the major axis is vertical.”
New Insights and Perspectives on the Natural Gradient MethodPreprint
Martens, J. (2014) · Journal of machine learning research · doi:10.48550/arxiv.1412.1193 · Cited by 884 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
Salem, A., Zhang, Y., Humbert, M., Berrang, P., Fritz, M., & Backes, M. (2019) · Proceedings 2019 Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23119 · Cited by 852
Bourtoule, L., Chandrasekaran, V., Choquette-Choo, C. A., Jia, H., Travers, A., Zhang, B., Lie, D., & Papernot, N. (2021) · 2021 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40001.2021.00019 · Cited by 810 · cited 2×
“) is the parameterized mapping function from the input space Z to the output space (i.e., the machine weak unlearning [4].”
AI can be sexist and racist — it’s time to make it fair
Zou, J., & Schiebinger, L. (2018) · Nature · doi:10.1038/d41586-018-05707-8 · Cited by 765 · cited 1×
“more likely to consider African-American offenders to have higher risk scores than Caucasians, even though ethnicity information is not part of the input [181].”
Explainability for Large Language Models: A Survey
Zhao, H., Chen, H., Yang, F., Liu, N., Deng, H., Cai, H., Wang, S., Yin, D., & Du, M. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3639372 · Cited by 681
Efficient noise-tolerant learning from statistical queries
Kearns, M. J. (1998) · Journal of the ACM · doi:10.1145/293347.293351 · Cited by 679 · cited 1×
“More precisely, statistical query learning assumes that most of the learning algorithms can be represented as a sum of some efficiently computable transformations, called statistical queries [79].”
Adversarial Attacks and Defenses in Deep Learning
Ren, K., Zheng, T., Qin, Z., & Liu, X. (2020) · Engineering · doi:10.1016/j.eng.2019.12.012 · Cited by 678 · cited 2×
“Recently, deep learning models have been shown to be vulnerable to external attacks, especially adversarial attacks [121].”
Towards Making Systems Forget with Machine Unlearning
Cao, Y., & Yang, J. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.35 · Cited by 622
Boosting methods for multi-class imbalanced data classification: an experimental review
Tanha, J., Abdi, Y., Samadi, N., Razzaghi-Asl, N., & Asadpour, M. (2020) · Journal Of Big Data · doi:10.1186/s40537-020-00349-y · Cited by 497 · cited 1×
“However, partitioning data by class itself does not help the model’s training in the first place, as learning the differences between classes is the core of many learning algorithms [146].”
Bitansky, N., Canetti, R., Chiesa, A., & Tromer, E. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090263 · Cited by 493 · cited 1×
“2 implies the zero difference in the distribution of weights, i.e., 𝑃𝑟 ( 𝑤 ) = 𝑃𝑟 ( 𝑤 ) , where the 𝑟 ( 𝑟 ) and 𝑤 𝑢 are the parameters of the models given by 𝑈 ( .”
Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networks
Golatkar, A., Achille, A., & Soatto, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00932 · Cited by 394 · cited 10×
“overtrained deep neural networks by actively unlearning useless, obsolete, or redundant data samples that could cause catastrophic forgetting [35, 53].”
InfluentialHamilton, W. L. (2020) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s01045ed1v01y202009aim046 · Cited by 354 · cited 1×
“Graph representation learning is a well-established research direction in machine learning, specifically in deep learning [20, 64].”
Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teacher
Chundawat, V. S., Tarun, A., Mandal, M., et al. (2022) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2205.08096 · Cited by 309
Updates-Leak: Data Set Inference and Reconstruction Attacks in Online Learning
Salem, A., Bhattacharya, A., Backes, M., et al. (2019) · USENIX Security Symposium · doi:10.48550/arxiv.1904.01067 · Cited by 299
Quark: Controllable Text Generation with Reinforced UnlearningPreprint
Lu, X., Welleck, S., Jiang, L., Hessel, J., Qin, L., West, P., Ammanabrolu, P., & Choi, Y. (2022) · Neural Information Processing Systems · doi:10.48550/arxiv.2205.13636 · Cited by 299
Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigation
Wang, Z., Qinami, K., Karakozis, I. C., Genova, K., Nair, P., Hata, K., & Russakovsky, O. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00894 · Cited by 296
Machine Unlearning of Features and Labels
Warnecke, A., Pirch, L., Wressnegger, C., & Rieck, K. (2023) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2023.23087 · Cited by 278
A Survey on Graph Representation Learning Methods
Khoshraftar, S., & An, A. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3633518 · Cited by 278
Algorithms that remember: model inversion attacks and data protection law
Veale, M., Binns, R., & Edwards, L. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0083 · Cited by 278 · cited 3×
“However, it turns out that this problem cannot be completely solved due to a lack of common frameworks and resources [131, 137, 157, 159].”
Graph representation learning: a survey
Chen, F., Wang, Y.-C., Wang, B., & Kuo, C.-C. J. (2020) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2020.13 · Cited by 277
Unlearn What You Want to Forget: Efficient Unlearning for LLMs
Chen, J., & Yang, D.-Y. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2310.20150 · Cited by 274
Mantelero, A. (2013) · Computer Law & Security Review · doi:10.1016/j.clsr.2013.03.010 · Cited by 264
FedEraser: Enabling Efficient Client-Level Data Removal from Federated Learning Models
Liu, G., Ma, X., Yang, Y., Wang, C., & Liu, J. (2021) · 2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS) · doi:10.1109/iwqos52092.2021.9521274 · Cited by 248
Uncertainty in Neural Networks: Approximately Bayesian EnsemblingPreprint
Pearce, T., Leibfried, F., Brintrup, A., et al. (2018) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.1810.05546 · Cited by 239 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
MUSE: Machine Unlearning Six-Way Evaluation for Language ModelsPreprint
Shi, W., Lee, J., Huang, Y., Malladi, S., Zhao, J., Holtzman, A., Liu, D., Zettlemoyer, L., Smith, N. A., & Zhang, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.06460 · Cited by 209
Learning your identity and disease from research papers
Wang, R., Li, Y. F., Wang, X., Tang, H., & Zhou, X. (2009) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/1653662.1653726 · Cited by 209
Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models
Zhang, Y., Chen, X., Jia, J., et al. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2405.15234 · Cited by 206
Fast Yet Effective Machine Unlearning
Tarun, A. K., Chundawat, V. S., Mandal, M., & Kankanhalli, M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3266233 · Cited by 203 · cited 2×
“) has 𝑟 = 𝐶 \ 𝐶 𝑓 .”
The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining
Liu, Y., Xu, L., Yuan, X., Wang, C., & Li, B. (2022) · IEEE INFOCOM 2022 - IEEE Conference on Computer Communications · doi:10.1109/infocom48880.2022.9796721 · Cited by 202
Distilling Causal Effect of Data in Class-Incremental Learning
Hu, X., Tang, K., Miao, C., Hua, X., & Zhang, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00395 · Cited by 201 · cited 1×
“However, this requires a contradiction analysis between old and new data [69].”
Feuerriegel, S., Dolata, M., & Schwabe, G. (2020) · Business & Information Systems Engineering · doi:10.1007/s12599-020-00650-3 · Cited by 196
When Machine Unlearning Jeopardizes Privacy
Chen, M., Zhang, Z., Wang, T., Backes, M., Humbert, M., & Zhang, Y. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3484756 · Cited by 195 · cited 9×
“ShallowAttack [23] Python Pytorch Model-agnostic https://github.”
InfluentialFast Yet Effective Machine Unlearning
Tarun, A. K., Chundawat, V. S., Mandal, M., & Kankanhalli, M. (2021) · arXiv · doi:10.48550/arxiv.2111.08947 · Cited by 190
Knowledge Neurons in Pretrained Transformers
Dai, D., Dong, L., Hao, Y., Sui, Z., Chang, B., & Wei, F. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.581 · Cited by 187 · cited 1×
“com/AdityaGolatkar/SelectiveForgetting Neurons [29] Python Deep learning https://github.”
A Survey on Federated Unlearning: Challenges, Methods, and Future Directions
Liu, Z., Jiang, Y., Shen, J., Peng, M., Lam, K., Yuan, X., & Liu, X. (2024) · ACM Computing Surveys · doi:10.1145/3679014 · Cited by 182
Deep learning-based unlearning of dataset bias for mri harmonisation and confound removal
Dinsdale, N. K., Jenkinson, M., & Namburete, A. I. L. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117689 · Cited by 178
Multiple Incremental Decremental Learning of Support Vector Machines
Karasuyama, M., & Takeuchi, I. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2048039 · Cited by 176
Making AI Forget You: Data Deletion in Machine Learning
Ginart, A., Guan, M. Y., Valiant, G., & Zou, J. (2019) · arXiv · doi:10.48550/arxiv.1907.05012 · Cited by 175 · cited 9×
“Ideas similar to knowledge-adaptation priors were also investigated in [52, 171].”
InfluentialHumans forget, machines remember: Artificial intelligence and the Right to Be Forgotten
Li, T., Villaronga, E. F., & Kieseberg, P. (2017) · Computer Law and Security Review · doi:10.1016/j.clsr.2017.08.007 · Cited by 173 · cited 2×
“However, it turns out that this problem cannot be completely solved due to a lack of common frameworks and resources [131, 137, 157, 159].”
Chen, Y., Xiong, J., Xu, W., & Zuo, J. (2019) · Cluster Computing · doi:10.1007/s10586-018-1772-4 · Cited by 166 · cited 4×
“Diabetes [12, 24, 166] is dataset of diabetic patients collected from two approaches: traditional paper documents and an automated recording system.”
InfluentialInfluence Functions in Deep Learning Are FragilePreprint
Basu, S., Pope, P., & Feizi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14651 · Cited by 163
Chundawat, V. S., Tarun, A. K., Mandal, M., & Kankanhalli, M. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3265506 · Cited by 162 · cited 8×
“[26] proposed an error-minimizing noise to generated an approximate version of Dr so that the impaired model can be trained to mitigate the performance degradation.”
InfluentialCertified Data Removal from Machine Learning Models
Guo, C., Goldstein, T., Hannun, A., & van der Maaten, L. (2019) · arXiv · doi:10.48550/arxiv.1911.03030 · Cited by 160 · cited 5×
“The formula for calculating an AIN value is 𝐴𝐼𝑁 = 𝑟 𝑡 ( 𝑀 𝑢 ,𝑀 𝑜𝑟𝑖𝑔 ,𝛼 ) where I( 𝑤 ; 𝐷 ) is the FIM that determines the quantities of information ( )”
InfluentialFederated Unlearning via Class-Discriminative Pruning
Wang, J., Guo, S., Xie, X., & Qi, H. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3512222 · Cited by 157
Federated Unlearning: How to Efficiently Erase a Client in FL?Preprint
Halimi, A., Kadhe, S., Rawat, A., & Baracaldo, N. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.05521 · Cited by 157
Machine unlearning: linear filtration for logit-based classifiers
Baumhauer, T., Schöttle, P., & Zeppelzauer, M. (2022) · Machine Learning · doi:10.1007/s10994-022-06178-9 · Cited by 141
Unrolling SGD: Understanding Factors Influencing Machine Unlearning
Thudi, A., Deza, G., Chandrasekaran, V., & Papernot, N. (2022) · 2022 IEEE 7th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp53844.2022.00027 · Cited by 135
A Multi-Batch L-BFGS Method for Machine Learning
Berahas, A., Nocedal, J., & Takác, M. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1605.06049 · Cited by 135
Zero-shot Knowledge Transfer via Adversarial Belief MatchingPreprint
Micaelli, P., & Storkey, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09768 · Cited by 134 · cited 1×
“Hence, inspired by [107], Chundawat et al.”
Chen, M., Zhang, Z., Wang, T., Backes, M., Humbert, M., & Zhang, Y. (2022) · Proceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3548606.3559352 · Cited by 133
A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning
Wang, Z., Yang, E., Shen, L., & Huang, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3498346 · Cited by 132
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learning
Sattler, F., Korjakow, T., Rischke, R., & Samek, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3129371 · Cited by 131
Lifelong Anomaly Detection Through Unlearning
Du, M., Chen, Z., Liu, C., Oak, R., & Song, D. X. (2019) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3319535.3363226 · Cited by 131 · cited 6×
“overtrained deep neural networks by actively unlearning useless, obsolete, or redundant data samples that could cause catastrophic forgetting [35, 53].”
InfluentialUnlearnable Examples: Making Personal Data UnexploitablePreprint
Huang, H., Ma, X., Erfani, S., Bailey, J., & Wang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.04898 · Cited by 128 · cited 6×
“com/Hunter-DDM/knowledge-neurons Unlearnable [70] Python Deep learning https://github.”
InfluentialMixed-Privacy Forgetting in Deep Networks
Golatkar, A., Achille, A., Ravichandran, A., Polito, M., & Soatto, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00085 · Cited by 125
Federated Unlearning for On-Device Recommendation
Yuan, W., Yin, H., Wu, F., Zhang, S., He, T., & Wang, H. (2023) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3539597.3570463 · Cited by 125
Self-citationVeriFi: Towards Verifiable Federated Unlearning
Gao, X., Ma, X., Wang, J., Sun, Y., Li, B., Ji, S., Cheng, P., & Chen, J. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3382321 · Cited by 125 · cited 6×
“[46] proposes a verification mechanism that uses a few communication rounds for”
InfluentialGolatkar, A., Achille, A., & Soatto, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58526-6_23 · Cited by 122
Fair Attribute Classification through Latent Space De-biasing
Ramaswamy, V., Kim, S. S. Y., & Russakovsky, O. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00918 · Cited by 122
A geometric view of optimal transportation and generative model
Lei, N., Su, K., Cui, L., Yau, S., & Gu, X. D. (2018) · Computer Aided Geometric Design · doi:10.1016/j.cagd.2018.10.005 · Cited by 121 · cited 1×
“This is also a special case of the optimal transportation cost between two probability distributions [86].”
KGA: A General Machine Unlearning Framework Based on Knowledge Gap AlignmentPreprint
Wang, L., Chen, T., Yuan, W., et al. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2305.06535 · Cited by 121
Self-citationProof-of-Learning: Definitions and Practice
Jia, H., Yaghini, M., Choquette-Choo, C. A., Dullerud, N., Thudi, A., Chandrasekaran, V., & Papernot, N. (2021) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40001.2021.00106 · Cited by 120 · cited 1×
“( ′ | 𝑤 ) is assumed to be a As a result, a candidate set of model parameters 𝑃𝑟 ( 𝑤 | 𝐷 ) is constructed by simply maximizing the posterior probability 𝑃𝑟 ( 𝑤 | 𝐷 ) , i.e.:”
Machine Unlearning of Features and Labels
Warnecke, A., Pirch, L., Wressnegger, C., & Rieck, K. (2021) · arXiv · doi:10.48550/arxiv.2108.11577 · Cited by 119
FedRecovery: Differentially Private Machine Unlearning for Federated Learning Frameworks
Zhang, L., Zhu, T., Zhang, H., Xiong, P., & Zhou, W. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3297905 · Cited by 118
Chen, C., Sun, F., Zhang, M., & Ding, B. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3511997 · Cited by 110 · cited 3×
“[18] proposed a partitionbased retraining process (smart retraining) to unlearn the model from the removed user behavior data.”
InfluentialFast Model Debias with Machine Unlearning
Chen, R.-Z., Yang, J.-F., Xiong, H., et al. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2310.12560 · Cited by 110
Machine Unlearning: Linear Filtration for Logit-based Classifiers
Baumhauer, T., Schöttle, P., & Zeppelzauer, M. (2020) · arXiv · doi:10.48550/arxiv.2002.02730 · Cited by 110
PUMA: Performance Unchanged Model Augmentation for Training Data Removal
Wu, G., Hashemi, M., & Srinivasa, C. (2022) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2203.00846 · Cited by 108 · cited 4×
“However, influence functions depend on the current state of a learning algorithm [169].”
InfluentialA Progressive Batching L-BFGS Method for Machine LearningPreprint
Bollapragada, R., Mudigere, D., Nocedal, J. M., Shi, H.-J. M., & Tang, P. T. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05374 · Cited by 101
Remember What You Want to Forget: Algorithms for Machine Unlearning
Sekhari, A., Acharya, J., Kamath, G., & Suresh, A. T. (2021) · arXiv · doi:10.48550/arxiv.2103.03279 · Cited by 99 · cited 4×
“(Bounded/Certified Unlearning) Definition 1 ( 𝜖 -Approximate Unlearning). algorithm 𝐴 if ∀T ⊆ H ,𝐷 ∈ 𝑍 ∗ ,𝑧 ∈ 𝐷 :”
InfluentialDescent-to-Delete: Gradient-Based Methods for Machine Unlearning
Neel, S., Roth, A., & Sharifi-Malvajerdi, S. (2020) · arXiv · doi:10.48550/arxiv.2007.02923 · Cited by 96 · cited 8×
“have some privacy leak, even though some provable guarantees are provided for special cases [57, 97, 106].”
InfluentialBackdoor Defense with Machine Unlearning
Liu, Y., Fan, M., Chen, C., Liu, X., Ma, Z., Wang, L., & Ma, J. (2022) · IEEE INFOCOM 2022 - IEEE Conference on Computer Communications · doi:10.1109/infocom48880.2022.9796974 · Cited by 95 · cited 2×
“Note that, unlike using machine unlearning to mitigate adversarial attacks [89], adversarial machine unlearning is far stricter, as it concerns not only the model accuracy but also the privacy guarantees.”
DeltaGrad: Rapid retraining of machine learning modelsPreprint
Wu, Y., Dobriban, E., & Davidson, S. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14755 · Cited by 93 · cited 3×
“15, we only know that the density function of 𝑃𝑟 ( 𝑤 | 𝐷 ) is proportional to a function 𝑓 ( 𝑤 ) = 𝑃𝑟 ( 𝐷 | 𝑤 ) 𝑃𝑟 ( 𝑤 ) , which means 𝑃𝑟 ( 𝑤 | 𝐷 ) cannot be directly sampled.”
Measuring Forgetting of Memorized Training ExamplesPreprint
Jagielski, M., Thakkar, O. D., Tramèr, F., Ippolito, D., Lee, K., Carlini, N., Wallace, E., Song, S., Thakurta, A., Papernot, N., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.00099 · Cited by 92
Total variation distance and the distribution of relative information
Verdú, S. (2014) · Information Theory and Applications Workshop · doi:10.1109/ita.2014.6804281 · Cited by 91 · cited 1×
“The formula for calculating an AIN value is 𝐴𝐼𝑁 = 𝑟 𝑡 ( 𝑀 𝑢 ,𝑀 𝑜𝑟𝑖𝑔 ,𝛼 ) where I( 𝑤 ; 𝐷 ) is the FIM that determines the quantities of information ( )”
Learn to Forget: Machine Unlearning via Neuron Masking
Ma, Z., Liu, Y., Liu, X., Liu, J., Ma, J., & Ren, K. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3194884 · Cited by 90 · cited 8×
“The 20 Newsgroups dataset [90] is a collection of around 20,000 newsgroup documents (almost) equally distributed among 20 newsgroups.”
InfluentialHedgeCut: Maintaining Randomised Trees for Low-Latency Machine Unlearning
Schelter, S., Grafberger, S., & Dunning, T. (2021) · Proceedings of the 2021 International Conference on Management of Data · doi:10.1145/3448016.3457239 · Cited by 89 · cited 7×
“[132] proposed an unlearning solution for extremely randomized trees by measuring the robustness of the split decisions.”
InfluentialApproximate Data Deletion from Machine Learning ModelsPreprint
Izzo, Z., Smart, M. A., Chaudhuri, K., & Zou, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10077 · Cited by 88 · cited 8×
“They approximated a Hessian matrix computation with a project residual update [15, 73] that combines gradient methods with synthetic data.”
InfluentialAnalyzing Information Leakage of Updates to Natural Language Models
Zanella-Béguelin, S., Wutschitz, L., Tople, S., Rühle, V., Paverd, A., Ohrimenko, O., Köpf, B., & Brockschmidt, M. (2020) · Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3372297.3417880 · Cited by 86
Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning
Zhu, X., Li, G., & Hu, W. P. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583305 · Cited by 84
Incremental and decremental training for linear classification
Tsai, C.-H., Lin, C.-Y., & Lin, C. (2014) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623661 · Cited by 75 · cited 1×
“training load on the processor for support vectormachines (SVM) [16, 24, 37, 125, 154, 155] and linear classification [77, 78, 153].”
Federated Unlearning: Guarantee the Right of Clients to Forget
Wu, L., Guo, S., Wang, J., Hong, Z., Zhang, J., & Ding, Y. (2022) · IEEE Network · doi:10.1109/mnet.001.2200198 · Cited by 73
Machine Unlearning for Random Forests
Brophy, J., & Lowd, D. (2020) · arXiv · doi:10.48550/arxiv.2009.05567 · Cited by 70 · cited 6×
“com/schelterlabs/hedgecut DaRE-RF [12] Python Tree-based models https://github.”
InfluentialGupta, V., Jung, C., Neel, S., Roth, A., Sharifi-Malvajerdi, S., & Waites, C. (2021) · arXiv · doi:10.48550/arxiv.2106.04378 · Cited by 67 · cited 2×
“( ′ | 𝑤 ) is assumed to be a As a result, a candidate set of model parameters 𝑃𝑟 ( 𝑤 | 𝐷 ) is constructed by simply maximizing the posterior probability 𝑃𝑟 ( 𝑤 | 𝐷 ) , i.e.:”
Machine Unlearning for Image-to-Image Generative Models
Li, G., Hsu, H., Chen, C., et al. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2402.00351 · Cited by 65
Hard to Forget: Poisoning Attacks on Certified Machine Unlearning
Marchant, N. G., Rubinstein, B. I. P., & Alfeld, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20736 · Cited by 64 · cited 3×
“(Bounded/Certified Unlearning) Definition 1 ( 𝜖 -Approximate Unlearning). algorithm 𝐴 if ∀T ⊆ H ,𝐷 ∈ 𝑍 ∗ ,𝑧 ∈ 𝐷 :”
UnlearnCanvas: A Stylized Image Dataset to Benchmark Machine Unlearning for Diffusion Models
Zhang, Y., Zhang, Y., Yao, Y., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2402.11846 · Cited by 64
Variational Bayesian Unlearning
Nguyen, Q. P., Low, B. K. H., & Jaillet, P. (2020) · arXiv · doi:10.48550/arxiv.2010.12883 · Cited by 62 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
Self-citationDeep Unlearning via Randomized Conditionally Independent Hessians
Mehta, R., Pal, S., Singh, V. P., & Ravi, S. N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01017 · Cited by 62 · cited 2×
“Softmax classifiers [6] ✗ ✓ ✓ ✗ – ✓ – – ✓ ✗ ✓ ✗ ✗ ✓ ✗ ✗ Linear models [73, 87] ✓ ✗ ✗ – ✗ – ✓ – ✓ ✓ ✓ ✓ ✗ ✗ ✗ ✗ Tree-based models [132] ✗ – ✗ – ✗ ✗ – ✓ ✗ ✗ ✗ ✓ ✗ ✗ ✗ ✗ Bayesian models [111] – ✓ ✗ ✗ ✗ – – ✓ – ✓ – ✓ ✗ ✗ ✗ ✗ DNN-based models [5, 54, 56, 57, 67, 105, 179] ✗ ✓ ✗ ✗ ✗ - - ✓ - - - ✓ ✗ ✗ ✗ ✗”
Unlearning Bias in Language Models by Partitioning Gradients
Yu, C., Jeoung, S., Kasi, A., Yu, P., & Ji, H. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.375 · Cited by 61
Chien, E., Pan, C., & Milenkovic, O. (2022) · arXiv.org · doi:10.48550/arxiv.2206.09140 · Cited by 61 · cited 2×
“5MB Classification [21, 24, 28] https://relational.”
Retaining Data from Streams of Social Platforms with Minimal Regret
Tam, N. T., Weidlich, M., Duong, T. C., et al. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/397 · Cited by 57
Self-citationAutomating Botnet Detection with Graph Neural NetworksPreprint
Zhou, J., Xu, Z., Rush, A. M., & Yu, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06344 · Cited by 55
Athena: Probabilistic Verification of Machine Unlearning
Sommer, D. M., Song, L., Wagh, S., & Mittal, P. (2022) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2022-0072 · Cited by 51
Federated Unlearning with Knowledge Distillation
Wu, C., Zhu, S., & Mitra, P. (2022) · arXiv · doi:10.48550/arxiv.2201.09441 · Cited by 50 · cited 4×
“Federated learning gives a unique setting for machine unlearning research [87, 90, 158, 162].”
InfluentialDetection of rumor conversations in Twitter using graph convolutional networks
Lotfi, S., Mirzarezaee, M., Hosseinzadeh, M., & Seydi, V. (2021) · Applied Intelligence · doi:10.1007/s10489-020-02036-0 · Cited by 50
RevFRF: Enabling Cross-Domain Random Forest Training With Revocable Federated Learning
Liu, Y., Ma, Z., Yang, Y., Liu, X., Ma, J., & Ren, K. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3104842 · Cited by 49
Hu, X., Li, D., Zheng, Z., et al. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2308.08090 · Cited by 49
On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning
Thudi, A., Jia, H., Shumailov, I., & Papernot, N. (2021) · arXiv · doi:10.48550/arxiv.2110.11891 · Cited by 48 · cited 6×
“Existing works define unlearning as obtaining a newmodel with an accuracy as good as if the model had retrainedwithout the data to be forgotten [55, 56, 58, 149].”
InfluentialTowards Effective and General Graph Unlearning via Mutual Evolution
Li, X.-K., Zhao, Y., Wu, Z.-Y., et al. (2024) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2401.11760 · Cited by 48
Learning with Selective Forgetting
Shibata, T., Irie, G., Ikami, D., & Mitsuzumi, Y. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/137 · Cited by 47 · cited 1×
“) CIFAR 60K 163MB Classification 16+ papers ([58, 70, 136, 163], .”
How Does Data Augmentation Affect Privacy in Machine Learning?
Yu, D., Zhang, H., Chen, W., Yin, J., & Liu, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17284 · Cited by 47 · cited 3×
“Data partition [2, 11] ✓ ✗ ✓ ✗ ✓ ✓ ✗ – ✗ ✓ ✓ ✓ ✗ – ✗ – Data augmentation [70, 135, 147, 173] ✗ ✓ ✗ ✗ ✗ – – – – ✗ – – ✗ ✓ ✗ ✗ Data influence [15, 119, 177] ✗ ✓ ✗ ✓ – – ✓ – ✓ ✓ – ✓ ✗ ✗ ✗ ✗”
Verifying in the Dark: Verifiable Machine Unlearning by Using Invisible Backdoor Triggers
Guo, Y., Zhao, Y., Hou, S., Wang, C., & Jia, X. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3328269 · Cited by 47
Unlearning Protected User Attributes in Recommendations with Adversarial Training
Ganhör, C., Penz, D., Rekabsaz, N., Lesota, O., & Schedl, M. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3531820 · Cited by 47
Fraboni, Y., Waerebeke, M. V., Scaman, K., Vidal, R., Kameni, L., & Lorenzi, M. (2022) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.2211.11656 · Cited by 42 · cited 1×
“The formula for calculating an AIN value is 𝐴𝐼𝑁 = 𝑟 𝑡 ( 𝑀 𝑢 ,𝑀 𝑜𝑟𝑖𝑔 ,𝛼 ) where I( 𝑤 ; 𝐷 ) is the FIM that determines the quantities of information ( )”
ERM-KTP: Knowledge-Level Machine Unlearning via Knowledge Transfer
Lin, S., Zhang, X., Chen, C., Chen, X., & Susilo, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01929 · Cited by 41
Communication Efficient and Provable Federated Unlearning
Tao, Y., Wang, C.-L., Pan, M., et al. (2024) · Proceedings of the VLDB Endowment · doi:10.48550/arxiv.2401.11018 · Cited by 41
Qian, W., Zhao, C., Le, W., et al. (2023) · Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599526 · Cited by 40
Aldaghri, N., Mahdavifar, H., & Beirami, A. (2021) · IEEE Access · doi:10.1109/access.2021.3090019 · Cited by 39 · cited 1×
“The formula for calculating an AIN value is 𝐴𝐼𝑁 = 𝑟 𝑡 ( 𝑀 𝑢 ,𝑀 𝑜𝑟𝑖𝑔 ,𝛼 ) where I( 𝑤 ; 𝐷 ) is the FIM that determines the quantities of information ( )”
Knowledge Removal in Sampling-based Bayesian Inference
Fu, S., He, F., & Tao, D.-C. (2022) · International Conference on Learning Representations · doi:10.48550/arxiv.2203.12964 · Cited by 39 · cited 3×
“This certification can be achieved for some energy functions when formulating the evidence lower bound (ELBO) in Bayesian models [43, 44, 74].”
InfluentialTowards Probabilistic Verification of Machine Unlearning
Sommer, D. M., Song, L., Wagh, S., & Mittal, P. (2020) · arXiv · doi:10.48550/arxiv.2003.04247 · Cited by 38 · cited 4×
“Athena [139, 140] Python Model-agnostic https://github.”
InfluentialA Survey on Machine Unlearning: Techniques and New Emerged Privacy Risks
Liu, H., Xiong, P., Zhu, T.-Q., et al. (2024) · Journal of Information Security and Applications · doi:10.48550/arxiv.2406.06186 · Cited by 37
Ren, Z. X., Baird, A., Han, J., Zhang, Z., & Schuller, B. W. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054087 · Cited by 34
Self-citationFast-FedUL: A Training-Free Federated Unlearning with Provable Skew Resilience
Huynh, T. T., Nguyen, T. B., Nguyen, P. L., et al. (2024) · ECML/PKDD · doi:10.48550/arxiv.2405.18040 · Cited by 34
Self-citationBonato, J., Cotogni, M., & Sabetta, L. (2024) · European Conference on Computer Vision · doi:10.48550/arxiv.2404.12922 · Cited by 34
Guo, T., Guo, S., Zhang, J., et al. (2022) · doi:10.48550/arxiv.2202.13295 · Cited by 34
Forget-SVGD: Particle-Based Bayesian Federated UnlearningPreprint
Gong, J., Simeone, O., Kassab, R., et al. (2021) · arXiv.org · doi:10.48550/arxiv.2111.12056 · Cited by 34
Bayesian Neural Networks with Weight Sharing Using Dirichlet Processes
Roth, W., & Pernkopf, F. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2884905 · Cited by 34 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
Federated UnlearningPreprint
Liu, G., Ma, X., Yang, Y., Wang, C., & Liu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.13891 · Cited by 33 · cited 1×
“• The degradation count: is defined as the ratio between the”
Efficient Repair of Polluted Machine Learning Systems via Causal Unlearning
Cao, Y., Yu, A. F., Aday, A., Stahl, E., Merwine, J., & Yang, J. (2018) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3196494.3196517 · Cited by 33 · cited 1×
“For example, a data pollution attack might affect millions of data items, but only a few of them can be detected by human experts or SOTA detection methods [14].”
Exact-Fun: An Exact and Efficient Federated Unlearning Approach
Xiong, Z., Li, W., Li, Y., & Cai, Z. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00188 · Cited by 33
BFU: Bayesian Federated Unlearning with Parameter Self-Sharing
Wang, W., Tian, Z., Zhang, C., Liu, A., & Yu, S. (2023) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3579856.3590327 · Cited by 33
FAST: Adopting Federated Unlearning to Eliminating Malicious Terminals at Server Side
Guo, X., Wang, P., Qiu, S., Song, W., Zhang, Q., Wei, X., & Zhou, D. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3343117 · Cited by 33
FRAMU: Attention-Based Machine Unlearning Using Federated Reinforcement Learning
Shaik, T., Tao, X., Li, L., Xie, H., Cai, T., Zhu, X., & Li, Q. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3382726 · Cited by 33
Proof of Unlearning: Definitions and Instantiation
Weng, J., Yao, S., Du, Y., Huang, J., Weng, J., & Wang, C. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3358993 · Cited by 33
Incremental and Decremental Learning for Linear Support Vector Machines
Romero, E., Barrio, I., & Belanche, L. (2007) · International Conference on Artificial Neural Networks · doi:10.1007/978-3-540-74690-4_22 · Cited by 33
On Training Deep Neural Networks Using a Streaming Approach
Duda, P., Jaworski, M., Cader, A., & Wang, L. (2019) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2020-0002 · Cited by 33
Markov Chain Monte Carlo-Based Machine Unlearning
Nguyen, Q. P., Oikawa, R., Divakaran, D. M., Chan, M. C., & Low, B. K. H. (2022) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3488932.3517406 · Cited by 32
Self-citationEfficiently Forgetting What You Have Learned in Graph Representation Learning via Projection
Cong, W., & Mahdavi, M. (2023) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.2302.08990 · Cited by 32
Digital forgetting in large language models: a survey of unlearning methods
Blanco-Justicia, A., Jebreel, N., Manzanares-Salor, B., Sánchez, D., Domingo-Ferrer, J., Collell, G., & Eeik Tan, K. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11078-6 · Cited by 31
Deep Autoencoding Topic Model With Scalable Hybrid Bayesian Inference
Zhang, H., Chen, B., Cong, Y., Guo, D., Liu, H., & Zhou, M. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3003660 · Cited by 31 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
Few-Shot Unlearning by Model Inversion
Yoon, Y., Nam, J., Yun, H., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2205.15567 · Cited by 31
MU-Bench: A Multitask Multimodal Benchmark for Machine UnlearningPreprint
Cheng, J., & Amiri, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.14796 · Cited by 31
Unlearning Graph Classifiers with Limited Data Resources
Pan, C., Chien, E., & Milenković, O. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583547 · Cited by 30
Right to Be Forgotten in the Age of Machine Learning
Dang, Q.-V. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-71782-7_35 · Cited by 30 · cited 2×
“Many privacy-preserving regulations have been enacted recently that involve the right to be forgotten” [11, 31], such as the European Union’s General Data Protection Regulation (GDPR) [97] and the California Consumer Privacy Act [115].”
Learn to Unlearn: Insights Into Machine Unlearning
Qu, Y., Yuan, X., Ding, M., Ni, W., Rakotoarivelo, T., & Smith, D. B. (2024) · Computer · doi:10.1109/mc.2023.3333319 · Cited by 30
Kim, H., Lee, S., & Woo, S. S. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2312.16823 · Cited by 30
Prototype Learning for Interpretable Respiratory Sound Analysis
Ren, Z. X., Nguyên, T. T., & Nejdl, W. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747014 · Cited by 29
Self-citationPrIU: A Provenance-Based Approach for Incrementally Updating Regression Models
Wu, Y., Tannen, V., & Davidson, S. B. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3380571 · Cited by 28
To be forgotten or to be fair: unveiling fairness implications of machine unlearning methods
Zhang, D., Pan, S., Hoang, T., Xing, Z., Staples, M., Xu, X., Yao, L., Lu, Q., & Zhu, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00398-y · Cited by 28
Online Forgetting Process for Linear Regression Models
Li, Y., Wang, C., & Cheng, G. (2020) · International Conference on Artificial Intelligence and Statistics · doi:10.48550/arxiv.2012.01668 · Cited by 28 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
Learning Parameter Distributions to Detect Concept Drift in Data Streams
Haug, J., & Kasneci, G. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412499 · Cited by 28
Deletion inference, reconstruction, and compliance in machine (un)learning
Gao, J., Garg, S., Mahmoody, M., & Vasudevan, P. N. (2022) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2022-0079 · Cited by 27
JUDO: Just-in-time rumour detection in streaming social platforms
Nguyen, T. T., Nguyên, T. T., Nguyen, T. T., Vo, B., Jo, J. H., & Nguyen, Q. V. H. (2021) · Information Sciences · doi:10.1016/j.ins.2021.04.018 · Cited by 27
Self-citationMachine Unlearning via Algorithmic Stability
Ullah, E., Mai, T., Rao, A., Rossi, R., & Arora, R. (2021) · arXiv · doi:10.48550/arxiv.2102.13179 · Cited by 26 · cited 4×
“Differential privacy [62] ✗ ✓ – – – ✓ ✓ – ✓ ✓ – ✓ ✗ ✗ ✗ ✓ Certified removal [55, 59, 109, 156] – ✓ ✗ ✗ – – ✓ ✓ ✓ ✓ – ✓ ✗ ✗ ✗ ✓ Statistical query learning [13] – ✓ ✗ – ✗ ✓ ✓ – ✓ – – ✓ ✗ ✗ ✗ – Decremental learning [24, 52] ✗ – ✗ – – ✗ ✓ ✓ – – – ✓ ✗ ✗ ✗ ✗ Knowledge adaptation [26] ✗ ✓ – – – – – – ✗ ✗ – ✓ – – – – Paramete…”
InfluentialMaking Users Indistinguishable: Attribute-wise Unlearning in Recommender Systems
Li, Y., Chen, C., Zheng, X., Zhang, Y., Han, Z., Meng, D., & Wang, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612418 · Cited by 26
Kassem, A. M., Mahmoud, O., & Saad, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.265 · Cited by 25
SSSE: Efficiently Erasing Samples from Trained Machine Learning ModelsPreprint
Peşte, A., Alistarh, D., & Lampert, C. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03860 · Cited by 25 · cited 1×
“The formula for calculating an AIN value is 𝐴𝐼𝑁 = 𝑟 𝑡 ( 𝑀 𝑢 ,𝑀 𝑜𝑟𝑖𝑔 ,𝛼 ) where I( 𝑤 ; 𝐷 ) is the FIM that determines the quantities of information ( )”
Example-based Explanations with Adversarial Attacks for Respiratory Sound Analysis
Chang, Y., Ren, Z., NGUYEN, T. V., et al. (2022) · Interspeech · doi:10.48550/arxiv.2203.16141 · Cited by 25
Self-citationMulticategory Incremental Proximal Support Vector Classifiers
Tveit, A., & Hetland, M. L. (2003) · International Conference on Knowledge-Based Intelligent Information & Engineering Systems · doi:10.1007/978-3-540-45224-9_54 · Cited by 22
An Introduction to Machine Unlearning
Mercuri, S., Khraishi, R., Okhrati, R., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2209.00939 · Cited by 21 · cited 1×
“[103] ✓ ✗ ✓ ✗ ✓ ✗ ✓ ✓ ✗ ✗ ✗ ✓ ✗ ✗ ✗ ✗ ✗ ✗ ✗ ✗”
Thudi, A., Shumailov, I., Boenisch, F., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2202.12232 · Cited by 21
In-Context Unlearning: Language Models as Few Shot Unlearners
Pawelczyk, M., Neel, S., & Lakkaraju, H. (2023) · arXiv · doi:10.48550/arxiv.2310.07579 · Cited by 20
DeltaBoost: Gradient Boosting Decision Trees with Efficient Machine Unlearning
Wu, Z., Zhu, J., Li, Q., & He, B. (2023) · Proceedings of the ACM on Management of Data · doi:10.1145/3589313 · Cited by 20 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
Machine Unlearning: Its Nature, Scope, and Importance for a “Delete Culture”
Floridi, L. (2023) · Philosophy & Technology · doi:10.1007/s13347-023-00644-5 · Cited by 20
Who's Harry Potter? Approximate Unlearning in LLMs
Eldan, R., & Russinovich, M. (2023) · arXiv · doi:10.48550/arxiv.2310.02238 · Cited by 19
Get Rid of Your Trail : Remotely Erasing Backdoors in Federated Learning
Alam, M., Lamri, H., & Maniatakos, M. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3465441 · Cited by 19
Towards efficient and effective unlearning of large language models for recommendation
Wang, H., Lin, J., Chen, B., Yang, Y., Tang, R., Zhang, W., & Yu, Y. H. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40044-2 · Cited by 19
Incremental and Decremental Proximal Support Vector Classification using Decay Coefficients
Tveit, A., Hetland, M. L., & Engum, H. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45228-7_42 · Cited by 19
Ren, Z., Han, J., Cummins, N., et al. (2020) · Interspeech · doi:10.21437/interspeech.2020-1869 · Cited by 19
Self-citationMachine Unlearning for Image Retrieval: A Generative Scrubbing Approach
Zhang, P.-F., Bai, G., Huang, Z., & Xu, X.-S. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3548378 · Cited by 18 · cited 2×
“Softmax classifiers [6] ✗ ✓ ✓ ✗ – ✓ – – ✓ ✗ ✓ ✗ ✗ ✓ ✗ ✗ Linear models [73, 87] ✓ ✗ ✗ – ✗ – ✓ – ✓ ✓ ✓ ✓ ✗ ✗ ✗ ✗ Tree-based models [132] ✗ – ✗ – ✗ ✗ – ✓ ✗ ✗ ✗ ✓ ✗ ✗ ✗ ✗ Bayesian models [111] – ✓ ✗ ✗ ✗ – – ✓ – ✓ – ✓ ✗ ✗ ✗ ✗ DNN-based models [5, 54, 56, 57, 67, 105, 179] ✗ ✓ ✗ ✗ ✗ - - ✓ - - - ✓ ✗ ✗ ✗ ✗”
Have You Forgotten? A Method to Assess if Machine Learning Models Have Forgotten Data
Liu, X., & Tsaftaris, S. A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59710-8_10 · Cited by 18
FedCIO: Efficient Exact Federated Unlearning with Clustering, Isolation, and One-shot Aggregation
Qiu, H., Wang, Y., Xu, Y., Cui, L., & Shen, Z. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386788 · Cited by 17
Verifiable and Provably Secure Machine Unlearning
Eisenhofer, T., Riepel, D., Chandrasekaran, V., Ghosh, E., Ohrimenko, O., & Papernot, N. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00033 · Cited by 16 · cited 1×
“[41] proposed a cryptography-informed approach with verifiable proofs, i.”
Decoupling the Class Label and the Target Concept in Machine Unlearning
Zhu, J.-N., Han, B., Yao, J., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2406.08288 · Cited by 16
Towards Effective Evaluations and Comparisons for LLM Unlearning MethodsPreprint
Wang, Q., Han, B., Yang, P., Zhu, J., Liu, T., & Sugiyama, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.09179 · Cited by 16
SAFE: Machine Unlearning With Shard Graphs
Dukler, Y., Bowman, B., Achille, A., Golatkar, A., Swaminathan, A. D., & Soatto, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01569 · Cited by 15 · cited 1×
“The formula for calculating an AIN value is 𝐴𝐼𝑁 = 𝑟 𝑡 ( 𝑀 𝑢 ,𝑀 𝑜𝑟𝑖𝑔 ,𝛼 ) where I( 𝑤 ; 𝐷 ) is the FIM that determines the quantities of information ( )”
FairSISA: Ensemble Post-Processing to Improve Fairness of Unlearning in LLMs
Kadhe, S., Halimi, A., Rawat, A., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2312.07420 · Cited by 15
Tiwary, P., Guha, A., Panda, S., et al. (2023) · Trans. Mach. Learn. Res. · doi:10.48550/arxiv.2309.14054 · Cited by 15
Knowledge-Adaptation PriorsPreprint
Khan, M. E., & Swaroop, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08769 · Cited by 14
VeriFi: Towards Verifiable Federated UnlearningPreprint
Gao, X., Ma, X., Wang, J., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.12709 · Cited by 14
Research works printed but not linked: 19
- [15][15] Gert Cauwenberghs et al. 2000. Incremental and decremental support vector machine learning. NIPS 13 (2000). -
- [22][22] Min Chen, Zhikun Zhang, Tianhao Wang, Michael Backes, Mathias Humbert, and Yang Zhang. 2021. Graph unlearning. arXiv preprint arXiv:2103.14991 (2021). - · arXiv
- [26][26] Jiali Cheng, George Dasoulas, Huan He, Chirag Agarwal, and Marinka Zitnik. 2023. GNNDelete: A General Strategy for Unlearning in Graph Neural Networks. In ICLR . -
- [36][36] Nicola K Dinsdale, Mark Jenkinson, et al. 2020. Unlearning scanner bias for mri harmonisation. In MICCAI . 369-378. -
- [46][46] Stefan Feuerriegel, Mateusz Dolata, and Gerhard Schwabe. 2020. Fair AI. Business & information systems engineering 62, 4 (2020), 379-384. -
- [48][48] Matthew Fredrikson, Eric Lantz, Somesh Jha, Simon Lin, David Page, and Thomas Ristenpart. 2014. Privacy in pharmacogenetics: An { End-to-End } case study of personalized warfarin dosing. In USENIX Security . 17-32. -
- [55][55] Johannes Gasteiger, Aleksandar Bojchevski, and Stephan Günnemann. 2019. Combining Neural Networks with Personalized PageRank for Classification on Graphs. In ICLR . -
- [65][65] Ruocheng Guo, Lu Cheng, Jundong Li, P Richard Hahn, and Huan Liu. 2020. A survey of learning causality with data: Problems and methods. CSUR 53, 4 (2020), 1-37. -
- [69][69] William L Hamilton. 2020. Graph representation learning. Synthesis Lectures on Artifical Intelligence and Machine Learning 14, 3 (2020), 1-159. -
- [85][85] Masayuki Karasuyama and Ichiro Takeuchi. 2010. Multiple incremental decremental learning of support vector machines. IEEE Transactions on Neural Networks 21, 7 (2010), 1048-1059. -
- [123][123] Salvatore Mercuri, Raad Khraishi, Ramin Okhrati, Devesh Batra, Conor Hamill, Taha Ghasempour, and Andrew Nowlan. 2022. An introduction to machine unlearning. arXiv preprint arXiv:2209.00939 (2022). - · arXiv
- [125][125] Junhyun Nam, Hyuntak Cha, Sungsoo Ahn, Jaeho Lee, and Jinwoo Shin. 2020. Learning from failure: De-biasing classifier from biased classifier. NIPS 33 (2020), 20673-20684. -
- [130][130] Thanh Tam Nguyen, Thanh Trung Huynh, Phi Le Nguyen, Alan Wee-Chung Liew, Hongzhi Yin, and Quoc Viet Hung Nguyen. 2022. A Survey of Machine Unlearning. arXiv preprint arXiv:2209.02299 (2022). , , -
- [134][134] Stuart L Pardau. 2018. The California consumer privacy act: Towards a Europeanstyle privacy regime in the United States. J. Tech. L. & Pol'y 23 (2018), 68. -
- [157][157] S Shan, E Wenger, J Zhang, H Li, H Zheng, and BY Zhao. 2020. Protecting Personal Privacy against Una uthorized Deep Learning Models. In USENIX Security . 1-16. -
- [163][163] Abhijeet Singh and Abhineet Anand. 2017. Data leakage detection using cloud computing. IJECS 6, 4 (2017). -
- [165][165] Yash Sinha, Murari Mandal, and Mohan Kankanhalli. 2024. Multi-Modal Recommendation Unlearning. arXiv preprint arXiv:2405.15328 (2024). - · arXiv
- [189][189] Cheng-Long Wang, Mengdi Huai, and Di Wang. 2023. Inductive graph unlearning. In USENIX . 3205-3222. -
- [204][204] Heng Xu, Tianqing Zhu, Lefeng Zhang, Wanlei Zhou, and Philip S. Yu. 2023. Machine Unlearning: A Survey. CSUR 56, 1 (2023), 36. -
Cited by
Sorted by citations
Longo, L., Brcic, M., Cabitza, F., Choi, J., Confalonieri, R., Ser, J. D., Guidotti, R., Hayashi, Y., Herrera, F., Holzinger, A., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102301 · Cited by 626
“While the interest in the machine unlearning paradigm [280] has been on the rise [281], it is unclear how to efficiently ensure that data owned by a particular user is unlearned by a given large-scale generative model, so that it can be ensured that no instance like that of the user claiming their…”
BackgroundXu, H., Zhu, T., Zhang, L., Zhou, W., & Yu, P. S. (2024) · ACM Computing Surveys · doi:10.1145/3603620 · Cited by 164
A Survey on Federated Unlearning: Challenges, Methods, and Future Directions
Liu, Z., Jiang, Y., Shen, J., Peng, M., Lam, K., Yuan, X., & Liu, X. (2024) · ACM Computing Surveys · doi:10.1145/3679014 · Cited by 182
“A detailed comparison of related FU surveys is summarized in Table 1.”
Generative AI in EU law: Liability, privacy, intellectual property, and cybersecurity
Novelli, C., Casolari, F., Hacker, P., Spedicato, G., & Floridi, L. (2024) · Computer Law & Security Review · doi:10.1016/j.clsr.2024.106066 · Cited by 124
FedRecovery: Differentially Private Machine Unlearning for Federated Learning Frameworks
Zhang, L., Zhu, T., Zhang, H., Xiong, P., & Zhou, W. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3297905 · Cited by 118
“It stems from the increasingly urgent requirement of individuals for data protection, and is one of the centrepieces of machine learning research [1], [2].”
Background
Metadata
- Authors
- Nguyen, T. T., Huynh, T. T., Ren, Z., Nguyen, P. L., Liew, A. W.-C., Yin, H., & Nguyen, Q. V. H.
- Affiliations
- VinUniversity (VN)
- University of Bremen (DE)
- Trường Đại học Khoa học và Công nghệ Hà Nội (VN)
- Griffith University (AU)
- The University of Queensland (AU)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Volume
- 16
- Issue
- 5
- Pages
- 1-46
- ISSN
- 2157-6904 (ISSN-L)
- arXiv
- 2209.02299
- OpenAlex
- W4412565294
- Cited by
- 193
- References
- 263
- Citations by year
- 2026: 75 · 2025: 53 · 2024: 45 · 2023: 20
- FWCI
- 51.16
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Transactions on Intelligent Systems and Technology (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Griffith Research Online (submittedVersion)
- arXiv (Cornell University)
- Funders
- Australian Research Council
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- machine unlearning, right to be forgotten, privacy, adversarial attacks, training data reconstruction, personal data protection, privacy-preserving machine learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
