The DOI matches its DataCite record; 245 of the 263 references it cites were found in a registry or an index.
A Survey of Machine Unlearning
Open accessAbstract
Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it can weaken the bonds of trust between humans and AI. Recent regulations now require that, on request, private information about a user must be removed from both computer systems and from ML models, i.e. ``the right to be forgotten''). While removing data from back-end databases should be straightforward, it is not sufficient in the AI context as ML models often `remember' the old data. Contemporary adversarial attacks on trained models have proven that we can learn whether an instance or an attribute belonged to the training data. This phenomenon calls for a new paradigm, namely machine unlearning, to make ML models forget about particular data. It turns out that recent works on machine unlearning have not been able to completely solve the problem due to the lack of common frameworks and resources. Therefore, this paper aspires to present a comprehensive examination of machine unlearning's concepts, scenarios, methods, and applications. Specifically, as a category collection of cutting-edge studies, the intention behind this article is to serve as a comprehensive resource for researchers and practitioners seeking an introduction to machine unlearning and its formulations, design criteria, removal requests, algorithms, and applications. In addition, we aim to highlight the key findings, current trends, and new research areas that have not yet featured the use of machine unlearning but could benefit greatly from it. We hope this survey serves as a valuable resource for ML researchers and those seeking to innovate privacy technologies. Our resources are publicly available at https://github.com/tamlhp/awesome-machine-unlearning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Related surveys on digital forgetting and machine unlearning, such as Qu et al (2023); Xu et al (2023); Nguyen et al (2022); Shaik et al (2023), have focused on the general ML case by considering models used to classify tabular or image data.”
From Digital forgetting in large language models: a survey of unlearning methods (2025) · cites this paper as Nguyen et al 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Nguyen et al (2022) refer to two levels of guarantees, exact and approximate . Xu et al (2023) further expand approximate forgetting into strong and weak forgetting, where strong forgetting is equivalent to the definition of approximate forgetting by Nguyen et al ( 2022), and weak forgetting only applies to the outputs of the model.”
From Digital forgetting in large language models: a survey of unlearning methods (2025) · cites this paper as Nguyen et al 2022
The cited source says what the claim attributes to it.
In the citing paper
“Definitions of unlearning by Nguyen et al (2022); Xu et al (2023) include D as a parameter of the unlearning mechanism (as in F ( D,D f , A ( D )) ), but access to D is not always feasible.”
From Digital forgetting in large language models: a survey of unlearning methods (2025) · cites this paper as Nguyen et al 2022
The cited source says what the claim attributes to it.
In the citing paper
“Not surprisingly, the unlearning guarantees defined by Nguyen et al ( 2022) and Xu et al (2023 ) are heavily inspired by differential pri -vacy, and privacy attacks, such as membership inference attacks or reconstruction attacks, have been used to measure the risk of privacy leaks and to evaluate the effectiveness of unlearning.”
From Digital forgetting in large language models: a survey of unlearning methods (2025) · cites this paper as Nguyen et al (2022)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“The MNIST dataset [83] consists of 60,000 training examples and 10,000 test samples that have been standardised to 20x20 pixels, centred by centre of mass in 28x28 pixels, and sheared by horizontally shifting so that the major axis is vertical.”
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193 · cited 1×
“5 ∗ KL(Td (x) | |m), whereM is unlearned model,Td is a competent teacher, and KL is The Kullback-Leibler divergence [84],m = M (x)+Td (x) 2 .”
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300 · cited 1×
“wrong output ( ZRF = 0) or random output ( ZRF = ( )”
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899 · cited 1×
“Catastrophic forgetting is a phenomenon where deep neural networks perform badly after learning too many tasks [81].”
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · cited 1×
“tially private models suffer a significant loss in accuracy even for large ε [1, 18].”
The MovieLens Datasets: History and Context
Harper, F., & Konstan, J. (2016) · TIIS · doi:10.1145/2827872 · Cited by 5,938 · cited 1×
“Movielens [63] comprises movie ratings from MovieLens, a website that provides movie recommendations.”
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557 · cited 1×
“( ′ | 𝑤 ) is assumed to be a As a result, a candidate set of model parameters 𝑃𝑟 ( 𝑤 | 𝐷 ) is constructed by simply maximizing the posterior probability 𝑃𝑟 ( 𝑤 | 𝐷 ) , i.e.:”
Research works printed but not linked: 19
- [15][15] Gert Cauwenberghs et al. 2000. Incremental and decremental support vector machine learning. NIPS 13 (2000). -
- [22][22] Min Chen, Zhikun Zhang, Tianhao Wang, Michael Backes, Mathias Humbert, and Yang Zhang. 2021. Graph unlearning. arXiv preprint arXiv:2103.14991 (2021). - · arXiv
- [26][26] Jiali Cheng, George Dasoulas, Huan He, Chirag Agarwal, and Marinka Zitnik. 2023. GNNDelete: A General Strategy for Unlearning in Graph Neural Networks. In ICLR . -
- [36][36] Nicola K Dinsdale, Mark Jenkinson, et al. 2020. Unlearning scanner bias for mri harmonisation. In MICCAI . 369-378. -
- [46][46] Stefan Feuerriegel, Mateusz Dolata, and Gerhard Schwabe. 2020. Fair AI. Business & information systems engineering 62, 4 (2020), 379-384. -
- [48][48] Matthew Fredrikson, Eric Lantz, Somesh Jha, Simon Lin, David Page, and Thomas Ristenpart. 2014. Privacy in pharmacogenetics: An { End-to-End } case study of personalized warfarin dosing. In USENIX Security . 17-32. -
- [55][55] Johannes Gasteiger, Aleksandar Bojchevski, and Stephan Günnemann. 2019. Combining Neural Networks with Personalized PageRank for Classification on Graphs. In ICLR . -
- [65][65] Ruocheng Guo, Lu Cheng, Jundong Li, P Richard Hahn, and Huan Liu. 2020. A survey of learning causality with data: Problems and methods. CSUR 53, 4 (2020), 1-37. -
- [69][69] William L Hamilton. 2020. Graph representation learning. Synthesis Lectures on Artifical Intelligence and Machine Learning 14, 3 (2020), 1-159. -
- [85][85] Masayuki Karasuyama and Ichiro Takeuchi. 2010. Multiple incremental decremental learning of support vector machines. IEEE Transactions on Neural Networks 21, 7 (2010), 1048-1059. -
- [123][123] Salvatore Mercuri, Raad Khraishi, Ramin Okhrati, Devesh Batra, Conor Hamill, Taha Ghasempour, and Andrew Nowlan. 2022. An introduction to machine unlearning. arXiv preprint arXiv:2209.00939 (2022). - · arXiv
- [125][125] Junhyun Nam, Hyuntak Cha, Sungsoo Ahn, Jaeho Lee, and Jinwoo Shin. 2020. Learning from failure: De-biasing classifier from biased classifier. NIPS 33 (2020), 20673-20684. -
- [130][130] Thanh Tam Nguyen, Thanh Trung Huynh, Phi Le Nguyen, Alan Wee-Chung Liew, Hongzhi Yin, and Quoc Viet Hung Nguyen. 2022. A Survey of Machine Unlearning. arXiv preprint arXiv:2209.02299 (2022). , , -
- [134][134] Stuart L Pardau. 2018. The California consumer privacy act: Towards a Europeanstyle privacy regime in the United States. J. Tech. L. & Pol'y 23 (2018), 68. -
- [157][157] S Shan, E Wenger, J Zhang, H Li, H Zheng, and BY Zhao. 2020. Protecting Personal Privacy against Una uthorized Deep Learning Models. In USENIX Security . 1-16. -
- [163][163] Abhijeet Singh and Abhineet Anand. 2017. Data leakage detection using cloud computing. IJECS 6, 4 (2017). -
- [165][165] Yash Sinha, Murari Mandal, and Mohan Kankanhalli. 2024. Multi-Modal Recommendation Unlearning. arXiv preprint arXiv:2405.15328 (2024). - · arXiv
- [189][189] Cheng-Long Wang, Mengdi Huai, and Di Wang. 2023. Inductive graph unlearning. In USENIX . 3205-3222. -
- [204][204] Heng Xu, Tianqing Zhu, Lefeng Zhang, Wanlei Zhou, and Philip S. Yu. 2023. Machine Unlearning: A Survey. CSUR 56, 1 (2023), 36. -
Cited by
Sorted by citations
Longo, L., Brcic, M., Cabitza, F., Choi, J., Confalonieri, R., Ser, J. D., Guidotti, R., Hayashi, Y., Herrera, F., Holzinger, A., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102301 · Cited by 626
“While the interest in the machine unlearning paradigm [280] has been on the rise [281], it is unclear how to efficiently ensure that data owned by a particular user is unlearned by a given large-scale generative model, so that it can be ensured that no instance like that of the user claiming their…”
BackgroundXu, H., Zhu, T., Zhang, L., Zhou, W., & Yu, P. S. (2024) · ACM Computing Surveys · doi:10.1145/3603620 · Cited by 164
A Survey on Federated Unlearning: Challenges, Methods, and Future Directions
Liu, Z., Jiang, Y., Shen, J., Peng, M., Lam, K., Yuan, X., & Liu, X. (2024) · ACM Computing Surveys · doi:10.1145/3679014 · Cited by 182
“A detailed comparison of related FU surveys is summarized in Table 1.”
Generative AI in EU law: Liability, privacy, intellectual property, and cybersecurity
Novelli, C., Casolari, F., Hacker, P., Spedicato, G., & Floridi, L. (2024) · Computer Law & Security Review · doi:10.1016/j.clsr.2024.106066 · Cited by 124
FedRecovery: Differentially Private Machine Unlearning for Federated Learning Frameworks
Zhang, L., Zhu, T., Zhang, H., Xiong, P., & Zhou, W. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3297905 · Cited by 118
“It stems from the increasingly urgent requirement of individuals for data protection, and is one of the centrepieces of machine learning research [1], [2].”
BackgroundMachine Unlearning: Solutions and Challenges
Xu, J., Wu, Z., Wang, C., & Jia, X. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3379240 · Cited by 139
“a) Data Erasure Completeness:: This metric evaluates how thoroughly the unlearning algorithm makes the model remove the target data.”
BackgroundFast Machine Unlearning without Retraining through Selective Synaptic Dampening
Foster, J. D., Schoepf, S., & Brintrup, A. M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29092 · Cited by 91
A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning
Wang, Z., Yang, E., Shen, L., & Huang, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3498346 · Cited by 132
Cognitive Architectures for Language Agents
Sumers, T. R., Yao, S., Narasimhan, K., & Griffiths, T. L. (2023) · arXiv · doi:10.48550/arxiv.2309.02427 · Cited by 72
Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics
Romandini, N., Mora, A., Mazzocca, C., Montanari, R., & Bellavista, P. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3478334 · Cited by 76
“Most published surveys primarily focus on MU [6], [11], [14], [15], [16], while FU is only covered from a general perspective with a limited amount of references.”
Training data influence analysis and estimation: a survey
Hammoudeh, Z., & Lowd, D. (2024) · Machine Learning · doi:10.1007/s10994-023-06495-7 · Cited by 136
Unlearn What You Want to Forget: Efficient Unlearning for LLMs
Chen, J., & Yang, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.738 · Cited by 52
Reproducing Whisper-Style Training Using An Open-Source Toolkit And Publicly Available Data
Peng, Y., Tian, J., Yan, B., Berrebbi, D., Chang, X., Li, X., Shi, J., Arora, S., Chen, W., Sharma, R., et al. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389676 · Cited by 55
“Fourthly, OWSM provides a valuable testbed for investigating and exploring various machine learning problems such as data imbalance, continual learning [61], adversarial robustness [62], and machine unlearning [63].”
BackgroundDigital forgetting in large language models: a survey of unlearning methods
Blanco-Justicia, A., Jebreel, N., Manzanares-Salor, B., Sánchez, D., Domingo-Ferrer, J., Collell, G., & Eeik Tan, K. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11078-6 · Cited by 31
Algorithms that forget: Machine unlearning and the right to erasure
Juliussen, B. A., Rui, J. P., & Johansen, D. (2023) · Computer law & security review · doi:10.1016/j.clsr.2023.105885 · Cited by 29
Proof of Unlearning: Definitions and Instantiation
Weng, J., Yao, S., Du, Y., Huang, J., Weng, J., & Wang, C. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3358993 · Cited by 33
“Note that the SISA framework can also be categorized as a data-driven unlearning approach according to a recent machine unlearning survey [53].”
MethodScore-VAE: Root Cause Analysis for Federated-Learning-Based IoT Anomaly Detection
Fan, J., Tang, G., Wu, K., Zhao, Z., Zhou, Y., & Huang, S. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3289814 · Cited by 27
“Third,theprocess ofacquiringnewknowledgeandself-renewaloftenrenders themodeltemporarilyinoperative[18],leadingtosignificant inconvenienceandpotentialsafetyrisksineverydaylife.”
Zhou, J., Li, H., Liao, X., Zhang, B., He, W., Li, Z., Zhou, L., & Gao, X. (2023) · Nature Communications · doi:10.1038/s41467-023-41703-x · Cited by 25
An overview of machine unlearning
Li, C., Jiang, H., Chen, J., Zhao, Y. L., Fu, S., Jing, F., & Guo, Y. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100254 · Cited by 21
HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
Gutiérrez, B. J., Shu, Y., Gu, Y., Yasunaga, M., & Su, Y. (2024) · arXiv · doi:10.48550/arxiv.2405.14831 · Cited by 152
Reclaiming the Digital Commons: A Public Data Trust for Training Data
Chan, A., Bradley, H., & Rajkumar, N. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604658 · Cited by 29
Kim, H., Lee, S. T., & Woo, S. S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30118 · Cited by 21
Adversarial Item Promotion on Visually-Aware Recommender Systems by Guided Diffusion
Chen, L., Yuan, W., Chen, T., Ye, G., Nguyen, Q. V. H., & Yin, H. (2024) · ACM Transactions on Information Systems · doi:10.1145/3666088 · Cited by 30
Self-citationWho's Harry Potter? Approximate Unlearning in LLMs
Eldan, R., & Russinovich, M. (2023) · arXiv · doi:10.48550/arxiv.2310.02238 · Cited by 19
Continual Forgetting for Pre-Trained Vision Models
Zhao, H., Ni, B., Fan, J., Wang, Y., Chen, Y., Meng, G., & Zhang, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02705 · Cited by 24
“Machine unlearning involves retraining or modifying machine learning models to diminish or eradicate the influence of previously acquired patterns or biases, aiming to enhance the models’ fairness and safety [5, 6, 19, 48, 62, 72].”
BackgroundA survey on machine unlearning: Techniques and new emerged privacy risks
Liu, H., Xiong, P., Zhu, T., & Yu, P. S. (2025) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2025.104010 · Cited by 32
FedCIO: Efficient Exact Federated Unlearning with Clustering, Isolation, and One-shot Aggregation
Qiu, H., Wang, Y., Xu, Y., Cui, L., & Shen, Z. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386788 · Cited by 17
Multiclass Unlearning for Image Classification via Weight Filtering
Poppi, S., Sarto, S., Cornia, M., Baraldi, L., & Cucchiara, R. (2024) · IEEE Intelligent Systems · doi:10.1109/mis.2024.3412742 · Cited by 14
“Among other techniques which can alter the internal knowledge representation of a model, like knowledge distillation, model pruning, or incremental learning, Machine Unlearning [2] emerges as the sole technique which can delete private training data.”
Longo, L., Brčić, M., Cabitza, F., Choi, J., Confalonieri, R., Ser, J. D., Guidotti, R., Hayashi, Y., Herrera, F., Holzinger, A., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.19775 · Cited by 14
“While the interest in the machine unlearning paradigm [280] has been on the rise [281], it is unclear how to efficiently ensure that data owned by a particular user is unlearned by a given large-scale generative model, so that it can be ensured that no instance like that of the user claiming their…”
BackgroundKumar, R., Prakash, R., Kumar, N., Chinara, S., & Mohammed, M. A. (2025) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-025-10436-z · Cited by 15
Privacy Adhering Machine Un-learning in NLP
Kumar, V. B., Gangadharaiah, R., & Roth, D. (2023) · doi:10.18653/v1/2023.findings-ijcnlp.25 · Cited by 39
GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural Networks
Wu, B. Y., Zhang, H., Yang, X., Wang, S., Xue, M., Pan, S., & Yuan, X. (2024) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2024.24441 · Cited by 18
Strategic Data Revocation in Federated Unlearning
Ding, N., Wei, E., & Berry, R. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621201 · Cited by 12
“We first introduce the objectives and process of federated learning and unlearning, and then we specify users’ strategies and payoffs, respectively.”
MethodClass-wise federated unlearning: Harnessing active forgetting with teacher–student memory generation
Li, Y., Zhang, J., Liu, Y., & Chen, C. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113353 · Cited by 12
“This requirement has spurred the development of machine unlearning techniques, which aim to remove the influence of specific data samples from trained models (Nguyen et al., 2022).”
Feature Unlearning for Pre-trained GANs and VAEs
Moon, S., Cho, S., & Kim, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30138 · Cited by 27
“Unlearning scenarios can vary depending on the requirements (Nguyen et al. 2022).”
BackgroundTask-Aware Machine Unlearning and Its Application in Load Forecasting
Xu, W., & Teng, F. (2024) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2024.3376828 · Cited by 9
“1) Unlearning Completeness vs Model Performance: Although retraining is usually not a viable option, it is broadly agreed that the golden rule for unlearning is to minimize the distance between unlearnt and retrained models [30].”
BackgroundTo See or Not to See: Understanding the Tensions of Algorithmic Curation for Visual Arts
Srinivasan, R. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658917 · Cited by 9
Navigating the Ethical Landscape: Considerations in Implementing AI-ML Systems in Human Resources
Basnet, S. (2024) · International Journal of Research Publication and Reviews · doi:10.55248/gengpi.5.0324.0755 · Cited by 9
The Right to Be Forgotten in Artificial Intelligence: Issues, Approaches, Limitations and Challenges
Lobo, J. L., Gil-López, S., & Ser, J. D. (2023) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai54212.2023.00085 · Cited by 6
“We finish this manuscript by traversing several AI research areas motivated by different aspects of the RTBF : a) Machine Unlearning: Ideally, the unlearning paradigm [2] would allow users to remove their data from the model without needing to retrain it from scratch.”
BackgroundMethodFeaUn: Feature unlearning in vertical federated learning for IIoT against feature inference attacks
Lu, Z., Zhang, X., Li, T., Wang, Y., Li, G., & Liu, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131110 · Cited by 6
The Price of Forgetting: Data Redemption Mechanism Design for Machine Unlearning
Cui, Y., & Cheung, M. H. (2024) · International Conference on Communications · doi:10.1109/icc51166.2024.10622287 · Cited by 6
“The accuracy degradation can be exponential [10] when more data is unlearned, which is referred to as catastrophic unlearning [13], and how to mitigate it naturally is still an open question [14].”
BackgroundA Decision-Making Process to Implement the ‘Right to Be Forgotten’ in Machine Learning
Hawkins, K., Alhuwaish, N., Belguith, S., Vranaki, A., & Charlesworth, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61089-9_2 · Cited by 5
A Study Regarding Machine Unlearning on Facial Attribute Data
Gündoğdu, E., Unal, A., & Ünal, G. (2024) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg59268.2024.10581972 · Cited by 4
“The current research on machine unlearning can be categorized into two main approaches: exact and approximate methods [22], each addressing the challenges posed by catastrophic unlearning and stochasticity, thereby contributing to more effective unlearning techniques.”
BackgroundToward Highly-Efficient and Accurate Services QoS Prediction via Machine Unlearning
Zeng, Y., Xu, J., Li, Y., Chen, C., Dai, Q., & Du, Z. (2023) · IEEE Access · doi:10.1109/access.2023.3291410 · Cited by 4
“To achieve this demand, the machine unlearning mechanism [3] has shown its promise.”
BackgroundLearning to Unlearn for Bayesian Personalized Ranking via Influence Function
Chen, J., Zhang, H., Li, H., & Li, Y. (2025) · Chinese Journal of Electronics · doi:10.23919/cje.2023.00.417 · Cited by 3
“Recommendation unlearning is a process designed to eliminate the impact of a specified set of training data upon request from a trained recommender model [15].”
Learning and Unlearning to Operate Profitable Secure Electric Vehicle Charging
Lee, S., & Choi, D. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3396524 · Cited by 3
“A concise review of various MuL methods was presented in [21].”
MethodFedNPC: A Federated Learning Framework for Large Language Models in Game NPCs
Hong, M., Zhang, K., Zhang, S., & He, Z. (2023) · IEEE Student Conference on Research and Development (SCOReD) · doi:10.1109/scored60679.2023.10563705 · Cited by 3
“While machine unlearning has proven to be an effective alternative compared to model retraining [24], Federated Learning can offer a more refined solution to this issue.”
BackgroundHeterogeneous Decentralized Machine Unlearning with Seed Model DistillationPreprint
Ye, G., Chen, T., Nguyen, Q. V. H., Huang, Z. H., Zhou, X., & Yin, H. (2023) · Research Square · doi:10.21203/rs.3.rs-2439540/v1 · Cited by 4
Self-citationNeuroscience-inspired continuous learning: a sustainable approach to AI energy challengePreprint
Xiao, D. (2023) · doi:10.31219/osf.io/twn9q · Cited by 3
Gao, H.-A., Geng, J., Hua, W., Hu, M., Juan, X., Liu, H., Liu, S., Qiu, J., Qi, X., Wu, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.21046 · Cited by 3
DiEvD-SF: Disruptive Event Detection Using Continual Machine Learning With Selective Forgetting
Seetha, A., Chouhan, S. S., Pilli, E. S., Raychoudhury, V., & Saha, S. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3364544 · Cited by 2
“Machine unlearning is a novel paradigm that enables the removal or forgetting of specific knowledge or patterns previously acquired by a ML model [11].”
BackgroundMethodEntUn: Mitigating the forget-retain dilemma in unlearning via entropy
Jung, D. (2025) · ICT Express · doi:10.1016/j.icte.2025.06.007 · Cited by 3
QoSEraser: A Data Erasable Framework for Web Service QoS Prediction
Zeng, Y., Li, Y., Xia, Z., Du, Z., Wang, J., Lian, R., & Xu, J. (2023) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse60056.2023.00022 · Cited by 2
“With the common forgetting frameworks, most of them [2]–[4], [26], [27] achieve suboptimal performance because of the reduced time expense obtained.”
BackgroundTran, H. N., Nguyen, N. T., Nguyen, N. V., Nguyen, H. X., & Nguyen, A. D. (2025) · Engineering Science and Technology an International Journal · doi:10.1016/j.jestch.2025.101996 · Cited by 2
Enhancing partition distinction: A contrastive policy to recommendation unlearning
Li, L., Zhuo, S., Lin, H., He, J., Qiu, W., Zhang, Q., Wang, C., & Huang, S. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107667 · Cited by 2
Federated Unlearning With Reinforcement Learning: Adaptive Privacy Preservation for Clients
Gao, K., Zhu, T., Ye, D., Gao, L., & Zhou, W. (2025) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2025.104164 · Cited by 4
Using Shadow Models to Protect Private Data on Machine Unlearning
Lin, H.-C., & Yang, S. (2023) · IEEE International Conference on Consumer Electronics - Taiwan (ICCE-Taiwan) · doi:10.1109/icce-taiwan58799.2023.10226994 · Cited by 1
When Contrastive Learning Meets Graph Unlearning: Graph Contrastive Unlearning for Link Prediction
Yang, T.-H., & Li, C. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386624 · Cited by 1
Ethical considerations for multimodal artificial intelligence in healthcare
Kostick, K. M., Wagner, J. K., Cabrera, L. Y., & Mandl, K. D. (2026) · AI and Ethics · doi:10.1007/s43681-026-01259-0 · Cited by 1
“By integrating these approaches, the scientific and policy communities can move beyond a “theater of anonymity” [61] toward substantive safeguards that better reflect the realities of multimodal AI.”
DeRDaVa: Deletion-Robust Data Valuation for Machine Learning
Xiao, T., Sim, R. H. L., Fan, J., & Low, B. K. H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29462 · Cited by 1
Generative AI for Trustworthy, Open, and Equitable Scholarship
Bourg, C., Kriegsman, S., Lindsay, N., Sardis, H., Stalberg, E., & Altman, M. (2024) · doi:10.21428/e4baedd9.567bfd15 · Cited by 1
Daten-Fairness als Daten-Gerechtigkeit by Design
Bieker, F., & Hansen, M. (2023) · Nomos Verlagsgesellschaft mbH & Co. KG eBooks · doi:10.5771/9783748938743-29
6th International Conference on Advanced Research Methods and Analytics - CARMA 2024
Conference, C., Domenech, J., Vicente, M. R., & de Pedraza, P. (2024) · doi:10.4995/carma2024.2024.19017
Class-Wise Federated Unlearning: Harnessing Active Forgetting with Teacher-Student Memory GenerationPreprint
Li, Y., Zhang, J., Liu, Y., & Chen, C. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5071728
Protection of Personal Data in Computerized Accounting Programs
Yüzbaşıoğlu, M. A. (2024) · European Journal of Formal Sciences and Engineering · doi:10.26417/sd8tfs54
ResNet34-Based Galaxy Morphology Classification with Machine UnlearningPreprint
Potdukhe, N., Sabde, P., Aaglave, P., Upadhye, M., Barmate, S., & Ratnaparkhi, S. (2026) · Research Square · doi:10.21203/rs.3.rs-9269285/v1
Approach for Class-Wise Unlearning of Data Along with Learning of New Data
Guru, D. S., & Shivaprasad, D. L. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-18974-5_14
Metadata
- Authors
- Nguyen, T. T., Huynh, T. T., Ren, Z., Nguyen, P. L., Liew, A. W.-C., Yin, H., & Nguyen, Q. V. H.
- Affiliations
- VinUniversity (VN)
- University of Bremen (DE)
- Trường Đại học Khoa học và Công nghệ Hà Nội (VN)
- Griffith University (AU)
- The University of Queensland (AU)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Volume
- 16
- Issue
- 5
- Pages
- 1-46
- ISSN
- 2157-6904 (ISSN-L)
- arXiv
- 2209.02299
- OpenAlex
- W4412565294
- Cited by
- 193
- References
- 263
- Citations by year
- 2026: 75 · 2025: 53 · 2024: 45 · 2023: 20
- FWCI
- 51.16
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Transactions on Intelligent Systems and Technology (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Griffith Research Online (submittedVersion)
- arXiv (Cornell University)
- Funders
- Australian Research Council
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- machine unlearning, right to be forgotten, privacy, adversarial attacks, training data reconstruction, personal data protection, privacy-preserving machine learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
