Making AI Forget You: Data Deletion in Machine Learning
Open accessAbstract
Intense recent discussions have focused on how to provide individuals with control over when their data can and cannot be used --- the EU's Right To Be Forgotten regulation is an example of this effort. In this paper we initiate a framework studying what to do when it is no longer permissible to deploy models derivative from specific user data. In particular, we formulate the problem of efficiently deleting individual data points from trained machine learning models. For many standard ML models, the only way to completely remove an individual's data is to retrain the whole model from scratch on the remaining data, which is often not computationally practical. We investigate algorithmic principles that enable efficient data deletion in ML. For the specific setting of k-means clustering, we propose two provably efficient deletion algorithms which achieve an average of over 100X improvement in deletion efficiency across 6 datasets, while producing clusters of comparable statistical quality to a canonical k-means++ baseline.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Machine unlearning could be used to accelerate the process of leave-one-out-crossvalidation, removing adversarial or poisoning samples, and identifying significant and valuable data samples within a model.
“For instance, it could be used to accelerate the process of leave-one-out-crossvalidation, removing adversarial or poisoning samples, and identifying significant and valuable data samples within a model [13].”
From Machine Unlearning: A Survey (2024) · cites this paper as [13]
The Introduction (p. 2) explicitly lists speeding up leave-one-out cross-validation and identifying important or valuable datapoints as possible uses of efficient data deletion. It does not list removing adversarial or poisoning samples; searches for those terms found no passage supporting that part of the claim. (LLM, conf=0.87)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 37,139 · see citing works
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505 · see citing works
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162 · see citing works
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392 · see citing works
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472 · see citing works
Least squares quantization in PCM
Lloyd, S. (1982) · IEEE Transactions on Information Theory · doi:10.1109/tit.1982.1056489 · Cited by 15,836 · see citing works
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728 · see citing works
The NumPy Array: A Structure for Efficient Numerical Computation
van der Walt, S., Colbert, S. C., & Varoquaux, G. P. (2011) · Computing in Science & Engineering · doi:10.1109/mcse.2011.37 · Cited by 10,445 · see citing works
Least Squares Support Vector Machine Classifiers
Suykens, J., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,481 · see citing works
Communication Theory of Secrecy Systems
Shannon, C. E. (1949) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1949.tb00928.x · Cited by 9,440 · cited 2× · see citing works
“Such relaxations are required for encryption algorithms because perfect secrecy can only be achieved via one-time pad [78].”
BackgroundGeurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300 · see citing works
(2007) · doi:10.5555/1283383.1283494 · Cited by 7,364 · see citing works
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · see citing works
Regression Diagnostics -- Identifying Influential Data and Sources of Collinearity
Beaumont, C. D., Belsley, D. A., Kuh, E., & Welsch, R. E. (1981) · Journal of the Operational Research Society · doi:10.2307/2581267 · Cited by 6,362 · see citing works
An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression
Altman, N. (1992) · The American Statistician · doi:10.1080/00031305.1992.10475879 · Cited by 5,721 · see citing works
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · see citing works
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408 · see citing works
Practical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956 · see citing works
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856 · see citing works
Nadaraya, E. A. (1964) · Theory of Probability & Its Applications · doi:10.1137/1109020 · Cited by 3,462 · see citing works
Random Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783 · see citing works
Extensions of Lipschitz mappings into a Hilbert space
Johnson, W. B., & Lindenstrauss, J. (1984) · Contemporary mathematics - American Mathematical Society · doi:10.1090/conm/026/737400 · Cited by 2,583 · see citing works
Nguyen, X., Epps, J., & Bailey, J. (2010) · Journal of machine learning research · doi:10.5555/1756006.1953024 · Cited by 2,471 · see citing works
Estimating regression models with unknown break‐points
Muggeo, V. M. R. (2003) · Statistics in Medicine · doi:10.1002/sim.1545 · Cited by 2,408 · see citing works
Accuracy and stability of numerical algorithms
(1996) · Choice Reviews Online · doi:10.5860/choice.34-0981 · Cited by 2,072 · see citing works
Guha, S., Rastogi, R. R., & Shim, K. (1998) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/276304.276312 · Cited by 1,913 · see citing works
segmented: An R package to Fit Regression Models with Broken-Line Relationships
Muggeo, V. M. R. (2008) · Nova Science Publishers (Nova Science Publishers, Inc.) · Cited by 1,899 · see citing works
N-BaIoT—Network-Based Detection of IoT Botnet Attacks Using Deep Autoencoders
Meidan, Y., Bohadana, M., Mathov, Y., Mirsky, Y., Shabtai, A., Breitenbacher, D., & Elovici, Y. (2018) · IEEE Pervasive Computing · doi:10.1109/mprv.2018.03367731 · Cited by 1,668 · see citing works
Mapping the Mouse Cell Atlas by Microwell-Seq
Han, X., Wang, R., Zhou, Y., Fei, L., Sun, H., Lai, S., Saadatpour, A., Zhou, Z., Chen, H., Ye, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.02.001 · Cited by 1,597 · see citing works
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N. P., Patterson, D. A., Agrawal, G., Bajwa, R. S., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080246 · Cited by 1,431 · see citing works
Incremental and Decremental Support Vector Machine Learning
Cauwenberghs, G., & Poggio, T. (2000) · Cited by 1,156 · see citing works
(2011) · PubMed · Cited by 990 · see citing works
An elementary proof of a theorem of Johnson and Lindenstrauss
Dasgupta, S., & Gupta, A. (2002) · Random Structures and Algorithms · doi:10.1002/rsa.10073 · Cited by 927 · see citing works
NP-hardness of Euclidean sum-of-squares clustering
Aloise, D., Deshpande, A., Hansen, P., & Popat, P. (2009) · Machine Learning · doi:10.1007/s10994-009-5103-0 · Cited by 883 · see citing works
Fixed Point Quantization of Deep Convolutional Networks
Lin, D. D., Talathi, S. S., & Annapureddy, V. S. (2015) · arXiv · doi:10.48550/arxiv.1511.06393 · Cited by 684 · see citing works
Machine Learning Classification over Encrypted Data
Bost, R., Popa, R. A., Tu, S., & Goldwasser, S. (2015) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2015.23241 · Cited by 683 · see citing works
Bahmani, B., Moseley, B., Vattani, A., Kumar, R., & Vassilvitskii, S. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2180912.2180915 · Cited by 651 · see citing works
Parallel K-Means Clustering Based on MapReduce
Zhao, W., Ma, H., & He, Q. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-10665-1_71 · Cited by 627 · see citing works
Towards Making Systems Forget with Machine Unlearning
Cao, Y., & Yang, J. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.35 · Cited by 622 · cited 1× · see citing works
“They include linear models [55, 27, 83, 81, 18, 74], certain types of lazy learning [88, 6, 11] techniques such as non-parametric Nadaraya-Watson kernel regressions [61] or nearest-neighbors methods [22, 74], recursive support vector machines [19, 81], and co-occurrence based collaborative filtering [74].”
MethodOn-line Learning and Stochastic Approximations
Bottou, L. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511569920.003 · Cited by 585 · see citing works
Locally Weighted Learning for Control
Atkeson, C. G., Moore, A., & Schaal, S. (1997) · Artificial Intelligence Review · doi:10.1023/a:1006511328852 · Cited by 551 · see citing works
Blackard, J. A., & Dean, D. J. (1999) · Computers and Electronics in Agriculture · doi:10.1016/s0168-1699(99)00046-0 · Cited by 507 · see citing works
Privacy-Preserving Ridge Regression on Hundreds of Millions of Records
Nikolaenko, V., Weinsberg, U., Ioannidis, S., Jóye, M., Boneh, D., & Taft, N. (2013) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2013.30 · Cited by 447 · see citing works
Data Shapley: Equitable Valuation of Data for Machine LearningPreprint
Ghorbani, A., & Zou, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02868 · Cited by 434 · see citing works
Self-citationTraining deep neural networks with low precision multiplications
Courbariaux, M., Bengio, Y., & David, J.-P. (2014) · arXiv · doi:10.48550/arxiv.1412.7024 · Cited by 407 · see citing works
Oblivious multi-party machine learning on trusted processors
Ohrimenko, O., Schuster, F., Cédric Fournet, A., Mehta, A., Nowozin, S., Vaswani, K., & Costa, M. (2016) · MPG.PuRe (Max Planck Society) · Cited by 402 · see citing works
An overview of reservoir computing: theory, applications and implementations
Schrauwen, B., Verstraeten, D., & Campenhout, J. V. (2007) · Ghent University Academic Bibliography (Ghent University) · Cited by 369 · see citing works
Qin, J., Fu, W., Gao, H., & Zheng, W. X. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2526683 · Cited by 334 · see citing works
Learnability, Stability and Uniform Convergence
Shalev‐Shwartz, S., Shamir, O., Srebro, N., & Sridharan, K. (2010) · Cited by 304 · see citing works
Algorithms that remember: model inversion attacks and data protection law
Veale, M., Binns, R., & Edwards, L. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0083 · Cited by 278 · see citing works
General conditions for predictivity in learning theory
Poggio, T., Rifkin, R. M., Mukherjee, S., & Niyogi, P. (2004) · Nature Cell Biology · doi:10.1038/nature02341 · Cited by 276 · see citing works
Gysel, P., Pimentel, J., Motamedi, M., & Ghiasi, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2808319 · Cited by 250 · see citing works
Alternative k-nearest neighbour rules in supervised pattern recognition
Coomans, D., & Massart, D. L. (1982) · Analytica Chimica Acta · doi:10.1016/s0003-2670(01)95359-0 · Cited by 240 · see citing works
Generating Private Recommendations Efficiently Using Homomorphic Encryption and Data Packing
Erkin, Z., Veugen, T., Toft, T., & Lagendijk, R. L. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190726 · Cited by 238 · see citing works
Distribution-free performance bounds for potential function rules
Devroye, L., & Wagner, T. J. (1979) · IEEE Transactions on Information Theory · doi:10.1109/tit.1979.1056087 · Cited by 233 · see citing works
DENCLUE 2.0: Fast Clustering Based on Kernel Density Estimation
Hinneburg, A., & Gabriel, H.-H. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74825-0_7 · Cited by 224 · see citing works
Alternative k-nearest neighbour rules in supervised pattern recognition
Coomans, D. H., & Massart, D. L. (1982) · Analytica Chimica Acta · doi:10.1016/s0003-2670(01)85298-3 · Cited by 217 · see citing works
Mukherjee, S., Niyogi, P., Poggio, T., & Rifkin, R. M. (2006) · Advances in Computational Mathematics · doi:10.1007/s10444-004-7634-z · Cited by 198 · see citing works
Humans forget, machines remember: Artificial intelligence and the Right to Be Forgotten
Li, T., Villaronga, E. F., & Kieseberg, P. (2017) · Computer Law and Security Review · doi:10.1016/j.clsr.2017.08.007 · Cited by 173 · see citing works
Muggeo, V. M. R. (2016) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2016.1149855 · Cited by 157 · see citing works
Normalized mutual information based registration using k-means clustering and shading correction
Knops, Z. F., Maintz, J. B. A., Viergever, M. A., & Pluim, J. P. W. (2005) · Medical Image Analysis · doi:10.1016/j.media.2005.03.009 · Cited by 140 · see citing works
A near-optimal algorithm for differentially-private principal components
Chaudhuri, K., Sarwate, A. D., & Sinha, K. P. (2013) · doi:10.5555/2567709.2567754 · Cited by 122 · see citing works
Schomm, F., Stahl, F., & Vossen, G. (2013) · ACM SIGMOD Record · doi:10.1145/2481528.2481532 · Cited by 121 · see citing works
Low precision storage for deep learningPreprint
Courbariaux, M., Bengio, Y., & David, J. (2014) · arXiv (Cornell University) · Cited by 120 · see citing works
Optimization models for reliability of modular software systems
Berman, O., & Ashrafi, N. (1993) · IEEE Transactions on Software Engineering · doi:10.1109/32.256858 · Cited by 108 · see citing works
Lazy Learning Meets the Recursive Least Squares Algorithm
Birattari, M., Bontempi, G., & Bersini, H. (1998) · Cited by 100 · see citing works
Incremental and decremental training for linear classification
Tsai, C.-H., Lin, C.-Y., & Lin, C.-J. (2014) · Knowledge Discovery and Data Mining · doi:10.1145/2623330.2623661 · Cited by 91 · see citing works
The local paradigm for modeling and control: from neuro-fuzzy to lazy learning
Bontempi, G., Bersini, H., & Birattari, M. (2001) · Fuzzy Sets and Systems · doi:10.1016/s0165-0114(99)00172-4 · Cited by 90 · see citing works
Distributed k-Means and k-Median Clustering on General TopologiesPreprint
Balcan, M.-F., Ehrlich, S., & Liang, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.0604 · Cited by 85 · see citing works
Galinsky, K. J., Loh, P., Mallick, S., Patterson, N. J., & Price, A. L. (2016) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2016.09.014 · Cited by 51 · see citing works
Measuring Distance between Unordered Sets of Different Sizes
Gardner, A., Kanno, J., Duncan, C. A., & Šelmić, R. R. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.25 · Cited by 50 · see citing works
Closed-form Expressions for the Moments of the Binomial Probability Distribution
Knoblauch, A. (2008) · SIAM Journal on Applied Mathematics · doi:10.1137/070700024 · Cited by 44 · see citing works
Kernel Approximation Methods for Speech RecognitionPreprint
May, A., Garakani, A. B., Lu, Z., Guo, D., Liu, K., Bellet, A., Fan, L., Collins, M., Hsu, D., Kingsbury, B. E. D., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.03577 · Cited by 42 · see citing works
Updating the QR factorization and the least squares problemPreprint
Hammarling, S. J., & Lucas, C. (2008) · MIMS EPrints (University of Southampton) · Cited by 38 · see citing works
Data contracts for cloud-based data marketplaces
Truong, H. L., Comerio, M., Paoli, F. D., Gangadharan, G. R., & Dustdar, S. (2012) · International Journal of Computational Science and Engineering · doi:10.1504/ijcse.2012.049749 · Cited by 29 · see citing works
Bogdanov, D., Kamm, L., Laur, S., & Sokk, V. (2018) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2018.2858818 · Cited by 28 · see citing works
Schellekens, V., & Jacques, L. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2847908 · Cited by 24 · see citing works
Distributed and Provably Good Seedings for k-Means in Constant Rounds
Bachem, O., Lučić, M., & Krause, A. (2017) · International Conference on Machine Learning · Cited by 19 · see citing works
3D hand posture recognition from small unlabeled point sets
Gardner, A., Duncan, C. A., Kanno, J., & Šelmić, R. R. (2014) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2014.6973901 · Cited by 14 · see citing works
Zeb, S., & Yousaf, M. (2017) · Journal of Inequalities and Applications · doi:10.1186/s13660-017-1547-0 · Cited by 8 · see citing works
Self-organizing reservior computing with dynamically regulated cortical neural networks
Yin, J., & Meng, Y. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252772 · Cited by 3 · see citing works
Flagged first, then by citations
2 of the 85 references couldn’t be matched to a known paper.
Research works printed but not linked: 9
- [38][38] R. M. Gray and D. L. Neuhoff. Quantization. IEEE transactions on information theory , 44(6):2325-2383, 1998. -
- [39][39] S. Guha, R. Rastogi, and K. Shim. Cure: an efficient clustering algorithm for large databases. In ACMSigmod Record , pages 73-84. ACM, 1998. -
- [47][47] M. Kearns and D. Ron. Algorithmic stability and sanity-check bounds for leave-one-out crossvalidation. Neural computation , 11(6):1427-1453, 1999. -
- [55][55] J. H. Maindonald. Statistical Computation . John Wiley & Sons, Inc., New York, NY, USA, 1984. -
- [64][64] N. Papernot, M. Abadi, U. Erlingsson, I. Goodfellow, and K. Talwar. Semi-supervised knowledge transfer for deep learning from private training data. arXiv preprint arXiv:1610.05755 , 2016. - · arXiv
- [66][66] F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research , 12:2825-2830, 2011. -
- [74][74] S. Schelter. 'amnesia'-towards machine learning models that can forget user data very fast. In 1st International Workshop on Applied AI for Database Systems and Applications (AIDB'19) , 2019. -
- [88][88] G. I. Webb. Lazy Learning , pages 571-572. Springer US, 2010. -
- [91][91] J. Zhang, A. May, T. Dao, and C. Ré. Low-precision random fourier features for memoryconstrained kernel approximation. arXiv preprint arXiv:1811.00155 , 2018. - · arXiv
Cited by
Sorted by citations
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676 · see citing works
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407 · see citing works
Bourtoule, L., Chandrasekaran, V., Choquette-Choo, C. A., Jia, H., Travers, A., Zhang, B., Lie, D., & Papernot, N. (2021) · 2021 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40001.2021.00019 · Cited by 810 · see citing works
Privacy preservation in federated learning: An insightful survey from the GDPR perspective
Truong, N., Sun, K., Wang, S., Guitton, F., & Guo, Y. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102402 · Cited by 399 · see citing works
Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networks
Golatkar, A., Achille, A., & Soatto, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00932 · Cited by 394 · see citing works
Scope of machine learning in materials research—A review
Mobarak, M. H., Mimona, M. A., Islam, M. A., Hossain, N., Zohura, F. T., Imtiaz, I., & Rimon, M. I. H. (2023) · Applied Surface Science Advances · doi:10.1016/j.apsadv.2023.100523 · Cited by 243 · see citing works
FedEraser: Enabling Efficient Client-Level Data Removal from Federated Learning Models
Liu, G., Ma, X., Yang, Y., Wang, C., & Liu, J. (2021) · 2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS) · doi:10.1109/iwqos52092.2021.9521274 · Cited by 248 · see citing works
The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining
Liu, Y., Xu, L., Yuan, X., Wang, C., & Li, B. (2022) · IEEE INFOCOM 2022 - IEEE Conference on Computer Communications · doi:10.1109/infocom48880.2022.9796721 · Cited by 202 · see citing works
Fast Yet Effective Machine Unlearning
Tarun, A. K., Chundawat, V. S., Mandal, M., & Kankanhalli, M. (2021) · arXiv · doi:10.48550/arxiv.2111.08947 · Cited by 190 · see citing works
Fast Yet Effective Machine Unlearning
Tarun, A. K., Chundawat, V. S., Mandal, M., & Kankanhalli, M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3266233 · Cited by 203 · see citing works
When Machine Unlearning Jeopardizes Privacy
Chen, M., Zhang, Z., Wang, T., Backes, M., Humbert, M., & Zhang, Y. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3484756 · Cited by 195 · see citing works
Chundawat, V. S., Tarun, A. K., Mandal, M., & Kankanhalli, M. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3265506 · Cited by 162 · see citing works
Adversarial machine learning :
Vassilev, A., Oprea, A., Fordyce, A. J., & Anderson, H. S. (2024) · doi:10.6028/nist.ai.100-2e2023 · Cited by 194 · see citing works
Certified Data Removal from Machine Learning Models
Guo, C., Goldstein, T., Hannun, A., & van der Maaten, L. (2019) · arXiv · doi:10.48550/arxiv.1911.03030 · Cited by 160 · see citing works
Xu, H., Zhu, T., Zhang, L., Zhou, W., & Yu, P. S. (2024) · ACM Computing Surveys · doi:10.1145/3603620 · Cited by 164 · see citing works
Privacy-Preserving Techniques in Generative AI and Large Language Models: A Narrative Review
Feretzakis, G., Papaspyridis, K., Gkoulalas-Divanis, A., & Verykios, V. S. (2024) · Information · doi:10.3390/info15110697 · Cited by 176 · see citing works
Ablating Concepts in Text-to-Image Diffusion Models
Kumari, N., Zhang, B., Wang, S.-Y., Shechtman, E., Zhang, R., & Zhu, J.-Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02074 · Cited by 150 · see citing works
Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher
Chundawat, V. S., Tarun, A. K., Mandal, M., & Kankanhalli, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25879 · Cited by 129 · see citing works
Mixed-Privacy Forgetting in Deep Networks
Golatkar, A., Achille, A., Ravichandran, A., Polito, M., & Soatto, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00085 · Cited by 125 · see citing works
Machine Unlearning of Features and Labels
Warnecke, A., Pirch, L., Wressnegger, C., & Rieck, K. (2023) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2023.23087 · Cited by 166 · see citing works
FedRecovery: Differentially Private Machine Unlearning for Federated Learning Frameworks
Zhang, L., Zhu, T., Zhang, H., Xiong, P., & Zhou, W. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3297905 · Cited by 118 · see citing works
Algorithmic fairness datasets: the story so far
Fabris, A., Messina, S., Silvello, G., & Susto, G. A. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00854-z · Cited by 128 · see citing works
Machine Unlearning: Solutions and Challenges
Xu, J., Wu, Z., Wang, C., & Jia, X. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3379240 · Cited by 114 · see citing works
Machine unlearning: linear filtration for logit-based classifiers
Baumhauer, T., Schöttle, P., & Zeppelzauer, M. (2022) · Machine Learning · doi:10.1007/s10994-022-06178-9 · Cited by 123 · see citing works
Chen, C., Sun, F., Zhang, M., & Ding, B. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3511997 · Cited by 110 · see citing works
VeriFi: Towards Verifiable Federated Unlearning
Gao, X., Ma, X., Wang, J., Sun, Y., Li, B., Ji, S., Cheng, P., & Chen, J. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3382321 · Cited by 111 · see citing works
ARCANE: An Efficient Architecture for Exact Machine Unlearning
Yan, H., Li, X., Guo, Z., Li, H., Li, F., & Lin, X. (2022) · Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/556 · Cited by 97 · see citing works
Operationalizing the Legal Principle of Data Minimization for Personalization
Biega, A. J., Potash, P., Daumé, H., Díaz, F., & Finck, M. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401034 · Cited by 94 · see citing works
Boundary Unlearning: Rapid Forgetting of Deep Networks via Shifting the Decision Boundary
Chen, M., Gao, W., Liu, G., Peng, K., & Wang, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00750 · Cited by 95 · see citing works
A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning
Wang, Z., Yang, E., Shen, L., & Huang, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3498346 · Cited by 101 · see citing works
Knowledge Unlearning for Mitigating Privacy Risks in Language Models
Jang, J., Yoon, D., Yang, S., Cha, S., Lee, M., Logeswaran, L., & Seo, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.805 · Cited by 135 · see citing works
Fast Machine Unlearning without Retraining through Selective Synaptic Dampening
Foster, J. D., Schoepf, S., & Brintrup, A. M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29092 · Cited by 91 · see citing works
A Review on Machine Unlearning
Zhang, H., Nakamura, T., Isohara, T., & Sakurai, K. (2023) · SN Computer Science · doi:10.1007/s42979-023-01767-4 · Cited by 81 · see citing works
Formalizing Data Deletion in the Context of the Right to Be ForgottenPreprint
Goldwasser, S., & Vasudevan, P. N. (2020) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 75 · see citing works
Federated Unlearning: Guarantee the Right of Clients to Forget
Wu, L., Guo, S., Wang, J., Hong, Z., Zhang, J., & Ding, Y. (2022) · IEEE Network · doi:10.1109/mnet.001.2200198 · Cited by 73 · see citing works
Asynchronous Federated Unlearning
Su, N., & Li, B. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10229075 · Cited by 70 · see citing works
Survey: Leakage and Privacy at Inference Time
Jegorova, M., Kaul, C., Mayor, C., O'Neil, A. Q., Weir, A., Murray-Smith, R., & Tsaftaris, S. A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3229593 · Cited by 77 · see citing works
Federated Unlearning With Momentum Degradation
Zhao, Y., Wang, P., Qi, H., Huang, J., Wei, Z., & Zhang, Q. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3321594 · Cited by 67 · see citing works
Poisoning attacks and countermeasures in intelligent networks: Status quo and prospects
Wang, C., Chen, J., Yang, Y., Ma, X., & Liu, J. (2021) · Digital Communications and Networks · doi:10.1016/j.dcan.2021.07.009 · Cited by 66 · see citing works
Hard to Forget: Poisoning Attacks on Certified Machine Unlearning
Marchant, N. G., Rubinstein, B. I. P., & Alfeld, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20736 · Cited by 64 · see citing works
“Ginart et al. (2019) were first to introduce an approximate definition of unlearning—requiring that it be statistically indistinguishable from retraining.”
InfluentialA Survey of Machine Unlearning
Nguyen, T. T., Huynh, T. T., Ren, Z., Nguyen, P. L., Liew, A. W.-C., Yin, H., & Nguyen, Q. V. H. (2022) · arXiv · doi:10.48550/arxiv.2209.02299 · Cited by 193 · see citing works
“Ideas similar to knowledge-adaptation priors were also investigated in [52, 171].”
InfluentialDeep Unlearning via Randomized Conditionally Independent Hessians
Mehta, R., Pal, S., Singh, V. P., & Ravi, S. N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01017 · Cited by 62 · see citing works
PUMA: Performance Unchanged Model Augmentation for Training Data Removal
Wu, G., Hashemi, M., & Srinivasa, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20846 · Cited by 61 · see citing works
Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy
Shaik, T., Tao, X., Xie, H., Li, L., Zhu, X., & Li, Q. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3486109 · Cited by 78 · see citing works
Learn to Forget: Machine Unlearning via Neuron Masking
Ma, Z., Liu, Y., Liu, X., Liu, J., Ma, J., & Ren, K. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3194884 · Cited by 68 · see citing works
GIF: A General Graph Unlearning Strategy via Influence Function
Wu, J., Yang, Y., Qian, Y., Sui, Y., Wang, X., & He, X. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583521 · Cited by 58 · see citing works
Athena: Probabilistic Verification of Machine Unlearning
Sommer, D. M., Song, L., Wagh, S., & Mittal, P. (2022) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2022-0072 · Cited by 51 · see citing works
On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning
Thudi, A., Jia, H., Shumailov, I., & Papernot, N. (2021) · arXiv · doi:10.48550/arxiv.2110.11891 · Cited by 48 · see citing works
Learning with Selective Forgetting
Shibata, T., Irie, G., Ikami, D., & Mitsuzumi, Y. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/137 · Cited by 47 · see citing works
Learning to Unlearn: Instance-Wise Unlearning for Pre-trained Classifiers
Cha, S., Cho, S., Hwang, D., Lee, H., Moon, T., & Lee, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.28996 · Cited by 47 · see citing works
Verifying in the Dark: Verifiable Machine Unlearning by Using Invisible Backdoor Triggers
Guo, Y., Zhao, Y., Hou, S., Wang, C., & Jia, X. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3328269 · Cited by 44 · see citing works
Making recommender systems forget: Learning and unlearning for erasable recommendation
Li, Y., Chen, C., Zheng, X., Liu, J., & Wang, J. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111124 · Cited by 55 · see citing works
Federated Unlearning and Its Privacy Threats
Fei, W., Li, B., & Li, B. (2023) · IEEE Network · doi:10.1109/mnet.004.2300056 · Cited by 40 · see citing works
Machine Unlearning via Representation Forgetting With Parameter Self-Sharing
Wang, W., Zhang, C., Tian, Z., & Yu, S. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3331239 · Cited by 36 · see citing works
No Matter How You Slice It: Machine Unlearning with SISA Comes at the Expense of Minority Classes
Koch, K., & Soll, M. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00047 · Cited by 34 · see citing works
Selective and collaborative influence function for efficient recommendation unlearning
Li, Y., Chen, C., Zheng, X., Zhang, Y., Gong, B., Wang, J., & Chen, L. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121025 · Cited by 36 · see citing works
Exact-Fun: An Exact and Efficient Federated Unlearning Approach
Xiong, Z., Li, W., Li, Y., & Cai, Z. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00188 · Cited by 33 · see citing works
Aldaghri, N., Mahdavifar, H., & Beirami, A. (2021) · IEEE Access · doi:10.1109/access.2021.3090019 · Cited by 32 · see citing works
Markov Chain Monte Carlo-Based Machine Unlearning
Nguyen, Q. P., Oikawa, R., Divakaran, D. M., Chan, M. C., & Low, B. K. H. (2022) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3488932.3517406 · Cited by 32 · see citing works
Learn to Unlearn: Insights Into Machine Unlearning
Qu, Y., Yuan, X., Ding, M., Ni, W., Rakotoarivelo, T., & Smith, D. B. (2024) · Computer · doi:10.1109/mc.2023.3333319 · Cited by 30 · see citing works
Proof of Unlearning: Definitions and Instantiation
Weng, J., Yao, S., Du, Y., Huang, J., Weng, J., & Wang, C. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3358993 · Cited by 30 · see citing works
Data-related concepts for artificial intelligence education in K-12
Olari, V., & Romeike, R. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100196 · Cited by 26 · see citing works
KGA: A General Machine Unlearning Framework Based on Knowledge Gap Alignment
Wang, L., Chen, T., Yuan, W., Zeng, X., Wong, K.-F., & Yin, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.740 · Cited by 25 · see citing works
Unlearning Backdoor Attacks in Federated Learning
Wu, C., Zhu, S., Mitra, P., & Wang, W. (2024) · IEEE Conference on Communications and Network Security · doi:10.1109/cns62487.2024.10735680 · Cited by 25 · see citing works
Deletion inference, reconstruction, and compliance in machine (un)learning
Gao, J., Garg, S., Mahmoody, M., & Vasudevan, P. N. (2022) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2022-0079 · Cited by 22 · see citing works
Zhou, J., Li, H., Liao, X., Zhang, B., He, W., Li, Z., Zhou, L., & Gao, X. (2023) · Nature Communications · doi:10.1038/s41467-023-41703-x · Cited by 22 · see citing works
An overview of machine unlearning
Li, C., Jiang, H., Chen, J., Zhao, Y. L., Fu, S., Jing, F., & Guo, Y. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100254 · Cited by 21 · see citing works
Forget-SVGD: Particle-Based Bayesian Federated Unlearning
Gong, J., Kang, J., Simeone, O., & Kassab, R. (2022) · IEEE Data Science Workshop (DSW) · doi:10.1109/dslw53931.2022.9820602 · Cited by 21 · see citing works
Fast Model Update for IoT Traffic Anomaly Detection With Machine Unlearning
Fan, J., Wu, K., Zhou, Y., Zhao, Z., & Huang, S. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3214840 · Cited by 20 · see citing works
Toward Efficient and Robust Federated Unlearning in IoT Networks
Yuan, Y., Wang, B., Zhang, C., Xiong, Z., Li, C., & Zhu, L. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3378329 · Cited by 20 · see citing works
Certified Unlearning for Federated Recommendation
Huynh, T. T., Nguyen, T. B., Nguyen, T. T., Nguyen, P. L., Yin, H., Nguyen, Q. V. H., & Nguyên, T. T. (2024) · ACM Transactions on Information Systems · doi:10.1145/3706419 · Cited by 19 · see citing works
Continual Forgetting for Pre-Trained Vision Models
Zhao, H., Ni, B., Fan, J., Wang, Y., Chen, Y., Meng, G., & Zhang, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02705 · Cited by 23 · see citing works
DeltaBoost: Gradient Boosting Decision Trees with Efficient Machine Unlearning
Wu, Z., Zhu, J., Li, Q., & He, B. (2023) · Proceedings of the ACM on Management of Data · doi:10.1145/3589313 · Cited by 18 · see citing works
Generative Unlearning for Any Identity
Seo, J., Lee, S.-H., Lee, T., Moon, S., & Park, G.-M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00874 · Cited by 17 · see citing works
A Dataset Auditing Method for Collaboratively Trained Machine Learning Models
Huang, Y., Huang, C.-Y., Li, X., & Li, K. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3220706 · Cited by 16 · see citing works
Compressed Particle-Based Federated Bayesian Learning and Unlearning
Gong, J., Simeone, O., & Kang, J. (2022) · IEEE Communications Letters · doi:10.1109/lcomm.2022.3223655 · Cited by 16 · see citing works
MUter: Machine Unlearning on Adversarially Trained Models
Liu, J., Xue, M., Lou, J., Zhang, X., Xiong, L., & Qin, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00451 · Cited by 16 · see citing works
A survey on machine unlearning: Techniques and new emerged privacy risks
Liu, H., Xiong, P., Zhu, T., & Yu, P. S. (2025) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2025.104010 · Cited by 21 · see citing works
Vertical Federated Unlearning on the Logistic Regression Model
Deng, Z., Han, Z., Ma, C., Ding, M., Yuan, L., Ge, C., & Liu, Z. (2023) · Electronics · doi:10.3390/electronics12143182 · Cited by 15 · see citing works
Machine Unlearning in Gradient Boosting Decision Trees
Lin, H., Chung, J. W., Lao, Y., & Zhao, W. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599420 · Cited by 15 · see citing works
Machine Un-learning: An Overview of Techniques, Applications, and Future Directions
Sai, S., Mittal, U., Chamola, V., Huang, K., Spinelli, I., Scardapane, S., Tan, Z., & Hussain, A. (2023) · Cognitive Computation · doi:10.1007/s12559-023-10219-3 · Cited by 15 · see citing works
SAFE: Machine Unlearning With Shard Graphs
Dukler, Y., Bowman, B., Achille, A., Golatkar, A., Swaminathan, A. D., & Soatto, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01569 · Cited by 15 · see citing works
Texture transformer super-resolution for low-dose computed tomography
Zhou, S., Yu, L., & Jin, M. (2022) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/ac9da7 · Cited by 15 · see citing works
Approximate Data Deletion from Machine Learning Models: Algorithms and Evaluations.Preprint
Izzo, Z., Smart, M. A., Chaudhuri, K., & Zou, J. (2020) · arXiv (Cornell University) · Cited by 15 · see citing works
Self-citationMulticlass Unlearning for Image Classification via Weight Filtering
Poppi, S., Sarto, S., Cornia, M., Baraldi, L., & Cucchiara, R. (2024) · IEEE Intelligent Systems · doi:10.1109/mis.2024.3412742 · Cited by 14 · see citing works
"Amnesia" - Machine Learning Models That Can Forget User Data Very Fast.
Schelter, S. (2020) · Conference on Innovative Data Systems Research · Cited by 14 · see citing works
Knowledge-Adaptation PriorsPreprint
Khan, M. E., & Swaroop, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08769 · Cited by 14 · see citing works
Inexact Unlearning Needs More Careful Evaluations to Avoid a False Sense of Privacy
Hayes, J., Shumailov, I., Triantafillou, E., Khalifa, A. M., & Papernot, N. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00034 · Cited by 14 · see citing works
Feature Unlearning for Pre-trained GANs and VAEs
Moon, S., Cho, S., & Kim, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30138 · Cited by 13 · see citing works
Goldfish: An Efficient Federated Unlearning Framework
Wang, H., Zhu, X., Chen, C., & Verı́ssimo, P. (2024) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn58291.2024.00035 · Cited by 12 · see citing works
Dang, Y., Liu, Y., Yang, E., Guo, G., Jiang, L., Zhao, J., & Wang, X. (2024) · ACM Transactions on Information Systems · doi:10.1145/3706633 · Cited by 12 · see citing works
Vertical Federated Unlearning via Backdoor Certification
Han, M., Zhu, T., Zhang, L., Huo, H., & Zhou, W. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3536312 · Cited by 12 · see citing works
FedWiper: Federated Unlearning via Universal Adapter
Zhao, S., Zhang, J., Ma, X., Jiang, Q. G., Ma, Z., Gao, S., Ying, Z., & Ma, J. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3557671 · Cited by 12 · see citing works
SoK: Managing Longitudinal Privacy of Publicly Shared Personal Online Data
Schnitzler, T., Mirza, S., Dürmuth, M., & Pöpper, C. (2020) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2021-0013 · Cited by 12 · see citing works
Hopkins, A., & Booth, S. (2021) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 12 · see citing works
Machine Learning Techniques for Accountability
Kim, B., & Doshi‐Velez, F. (2021) · AI Magazine · doi:10.1002/j.2371-9621.2021.tb00010.x · Cited by 18 · see citing works
Patient Similarity Learning with Selective Forgetting
Qian, W., Zhao, C., Shao, H., Chen, M., Wang, F., & Huai, M. (2022) · 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995016 · Cited by 11 · see citing works
Class-wise federated unlearning: Harnessing active forgetting with teacher–student memory generation
Li, Y., Zhang, J., Liu, Y., & Chen, C. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113353 · Cited by 11 · see citing works
QuickDrop: Efficient Federated Unlearning via Synthetic Data Generation
Dhasade, A., Ding, Y., Guo, S., Kermarrec, A.-M., de Vos, M., & Wu, L. (2024) · International Middleware Conference · doi:10.1145/3652892.3700764 · Cited by 10 · see citing works
Addressing unreliable local models in federated learning through unlearning
Ameen, M., Khan, R. U., Wang, P., Batool, S., & Alajmi, M. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106688 · Cited by 10 · see citing works
- Authors
- Ginart, A., Guan, M. Y., Valiant, G., & Zou, J.
- Affiliations
- Stanford University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Volume
- 32
- Pages
- 3513-3526
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1907.05012
- OpenAlex
- W2961073278
- Cited by
- 175
- References
- 85
- Citations by year
- 2026: 2 · 2025: 24 · 2024: 49 · 2023: 38 · 2022: 25 · 2021: 26 · 2020: 9 · 2019: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1704417, 1763191, 1813049)
- National Institutes of Health (R21 MD012867-01)
- National Institute on Aging (P30AG059307)
- Office of Naval Research (N00014-18, N00014-18-1-2295, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- data deletion, machine learning, K-means clustering, right to be forgotten, privacy, retraining costs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
