The DOI matches its DataCite record; 38 of the 38 references it cites were found in a registry or an index.
Remember What You Want to Forget: Algorithms for Machine Unlearning
Open accessAbstract
We study the problem of unlearning datapoints from a learnt model. The learner first receives a dataset $S$ drawn i.i.d. from an unknown distribution, and outputs a model $\widehat{w}$ that performs well on unseen samples from the same distribution. However, at some point in the future, any training datapoint $z \in S$ can request to be unlearned, thus prompting the learner to modify its output model while still ensuring the same accuracy guarantees. We initiate a rigorous study of generalization in machine unlearning, where the goal is to perform well on previously unseen datapoints. Our focus is on both computational and storage complexity. For the setting of convex losses, we provide an unlearning algorithm that can unlearn up to $O(n/d^{1/4})$ samples, where $d$ is the problem dimension. In comparison, in general, differentially private learning (which implies unlearning) only guarantees deletion of $O(n/d^{1/2})$ samples. This demonstrates a novel separation between differential privacy and machine unlearning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This approximation is usually guaranteed by differential privacy techniques, such as ( ε , δ ) -certified unlearning [41, 42].”
From Machine Unlearning: A Survey (2024) · cites this paper as [42]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Based on the guarantee provided by certified unlearning , they limit the distribution similarity between the unlearned model and the retrained model.”
From Machine Unlearning: A Survey (2024) · cites this paper as [42]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Sekhari et al. [42] proposed a more general method of reducing the loss of unseen samples after an unlearning process.”
From Machine Unlearning: A Survey (2024) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“In addition, they proposed an evaluation parameter to measure the unlearning capacity.”
From Machine Unlearning: A Survey (2024) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“Guo et al. [41], Warnecke et al. [53], and Sekhari et al. [42] provide a method of theoretical verification to verify the effectiveness of their proposed unlearning schemes.”
From Machine Unlearning: A Survey (2024) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“They also improved the data unlearning capacity of convex loss functions, which saw a quadratic improvement in terms of the dependence of d over differential privacy, where d is the problem dimension.”
From Machine Unlearning: A Survey (2024) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“They produced an unlearned model by removing the contribution of some samples from an already-trained model using a disturbance update calculated based on some cheap-to-store data statistics during training.”
From Machine Unlearning: A Survey (2024) · cites this paper as [42]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Springer eBooks · doi:10.1007/0-387-27255-0_9 · Cited by 20,333
Calibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Understanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
(2015) · Cited by 2,857
Our Data, Ourselves: Privacy Via Distributed Noise Generation
Dwork, C., Kenthapadi, K., McSherry, F., Mironov, I., & Naor, M. (2006) · Lecture Notes in Computer Science · doi:10.1007/11761679_29 · Cited by 1,835
Problem complexity and method efficiency in optimization
(1984) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(84)90101-0 · Cited by 1,456
Incremental and Decremental Support Vector Machine Learning
Cauwenberghs, G., & Poggio, T. (2000) · Cited by 1,152
Research works printed but not linked: 3
- Antonio Ginart, Melody Guan, Gregory Valiant, and James Y Zou. Making AI forget you: Data deletion in machine learning. In Advances in Neural Information Processing Systems 32 , NeurIPS '19, pages 3518-3531. Curran Associates, Inc., 2019.
- Seth Neel, Aaron Roth, and Saeed Sharifi-Malvajerdi. Descent-to-delete: Gradient-based methods for machine unlearning. In Proceedings of the 32nd International Conference on Algorithmic Learning Theory , ALT '21. JMLR, Inc., 2021.
- Shai Shalev-Shwartz, Ohad Shamir, Nathan Srebro, and Karthik Sridharan. Stochastic convex optimization. In COLT , 2009b.
Cited by
Sorted by citations
Items 101–103 of 103
Song, Q., Wang, R., Li, Y., Yan, Y., Zhu, X., & Li, H. (2025) · Journal of Information and Intelligence · doi:10.1016/j.jiixd.2024.11.001
EMMU: Efficient Information-Level Multimodal Machine Unlearning with High Model Fidelity
Zhang, J., Hou, J., Xiao, T., Huang, Y., & Li, X.-Y. (2025) · International Workshop on Quality of Service · doi:10.1109/iwqos65803.2025.11143267
Right-to-be-Forgotten by Design in Adapter-Tuned Transformers
Ranade, D., & Jaiswal, R. R. (2026) · Conference on Human Centred Artificial Intelligence - Education and Practice (HCAIep) · doi:10.1145/3777490.3777507
Metadata
- Authors
- Sekhari, A., Acharya, J., Kamath, G., & Suresh, A. T.
- Affiliations
- Cornell University (US)
- Massachusetts Institute of Technology (US)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Volume
- 34
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2103.03279
- OpenAlex
- W3135378441
- Cited by
- 99
- References
- 32
- Citations by year
- 2026: 1 · 2025: 22 · 2024: 33 · 2023: 32 · 2022: 8 · 2021: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › Cryptography and Data Security
- Keywords
- machine unlearning, generalization, convex loss functions, differential privacy, computational complexity, storage complexity, model modification, privacy-utility trade-off
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
