The DOI matches its DataCite record; 83 of the 85 references it cites were found in a registry or an index.
Making AI Forget You: Data Deletion in Machine Learning
Open accessAbstract
Intense recent discussions have focused on how to provide individuals with control over when their data can and cannot be used --- the EU's Right To Be Forgotten regulation is an example of this effort. In this paper we initiate a framework studying what to do when it is no longer permissible to deploy models derivative from specific user data. In particular, we formulate the problem of efficiently deleting individual data points from trained machine learning models. For many standard ML models, the only way to completely remove an individual's data is to retrain the whole model from scratch on the remaining data, which is often not computationally practical. We investigate algorithmic principles that enable efficient data deletion in ML. For the specific setting of k-means clustering, we propose two provably efficient deletion algorithms which achieve an average of over 100X improvement in deletion efficiency across 6 datasets, while producing clusters of comparable statistical quality to a canonical k-means++ baseline.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, it could be used to accelerate the process of leave-one-out-crossvalidation, removing adversarial or poisoning samples, and identifying significant and valuable data samples within a model [13].”
From Machine Unlearning: A Survey (2024) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 37,139
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Least squares quantization in PCM
Lloyd, S. (1982) · IEEE Transactions on Information Theory · doi:10.1109/tit.1982.1056489 · Cited by 15,836
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728
Least Squares Support Vector Machine Classifiers
Suykens, J., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,481
Communication Theory of Secrecy Systems
Shannon, C. E. (1949) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1949.tb00928.x · Cited by 9,440 · cited 2×
“Such relaxations are required for encryption algorithms because perfect secrecy can only be achieved via one-time pad [78].”
BackgroundThe NumPy Array: A Structure for Efficient Numerical Computation
van der Walt, S., Colbert, S. C., & Varoquaux, G. (2011) · Computing in Science & Engineering · doi:10.1109/mcse.2011.37 · Cited by 9,381
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
(2007) · doi:10.5555/1283383.1283494 · Cited by 7,364
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
Regression Diagnostics -- Identifying Influential Data and Sources of Collinearity
Beaumont, C. D., Belsley, D. A., Kuh, E., & Welsch, R. E. (1981) · Journal of the Operational Research Society · doi:10.2307/2581267 · Cited by 6,362
An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression
Altman, N. (1992) · The American Statistician · doi:10.1080/00031305.1992.10475879 · Cited by 5,657
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Practical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Nadaraya, E. A. (1964) · Theory of Probability & Its Applications · doi:10.1137/1109020 · Cited by 3,462
Random Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783
Extensions of Lipschitz mappings into a Hilbert space
Johnson, W. B., & Lindenstrauss, J. (1984) · Contemporary mathematics - American Mathematical Society · doi:10.1090/conm/026/737400 · Cited by 2,632
Estimating regression models with unknown break‐points
Muggeo, V. M. R. (2003) · Statistics in Medicine · doi:10.1002/sim.1545 · Cited by 2,408
Accuracy and stability of numerical algorithms
(1996) · Choice Reviews Online · doi:10.5860/choice.34-0981 · Cited by 2,072
Guha, S., Rastogi, R. R., & Shim, K. (1998) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/276304.276312 · Cited by 1,913
segmented: An R package to Fit Regression Models with Broken-Line Relationships
Muggeo, V. M. R. (2008) · Nova Science Publishers (Nova Science Publishers, Inc.) · Cited by 1,899
Vinh, N. X., Epps, J., & Bailey, J. (2010) · Journal of machine learning research · doi:10.5555/1756006.1953024 · Cited by 1,812
N-BaIoT—Network-Based Detection of IoT Botnet Attacks Using Deep Autoencoders
Meidan, Y., Bohadana, M., Mathov, Y., Mirsky, Y., Shabtai, A., Breitenbacher, D., & Elovici, Y. (2018) · IEEE Pervasive Computing · doi:10.1109/mprv.2018.03367731 · Cited by 1,668
Mapping the Mouse Cell Atlas by Microwell-Seq
Han, X., Wang, R., Zhou, Y., Fei, L., Sun, H., Lai, S., Saadatpour, A., Zhou, Z., Chen, H., Ye, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.02.001 · Cited by 1,597
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N. P., Patterson, D. A., Agrawal, G., Bajwa, R. S., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080246 · Cited by 1,541
Incremental and Decremental Support Vector Machine Learning
Cauwenberghs, G., & Poggio, T. (2000) · Cited by 1,152
(2011) · PubMed · Cited by 990
An elementary proof of a theorem of Johnson and Lindenstrauss
Dasgupta, S., & Gupta, A. (2002) · Random Structures and Algorithms · doi:10.1002/rsa.10073 · Cited by 927
NP-hardness of Euclidean sum-of-squares clustering
Aloise, D., Deshpande, A., Hansen, P., & Popat, P. (2009) · Machine Learning · doi:10.1007/s10994-009-5103-0 · Cited by 883
Fixed Point Quantization of Deep Convolutional Networks
Lin, D. D., Talathi, S. S., & Annapureddy, V. S. (2015) · arXiv · doi:10.48550/arxiv.1511.06393 · Cited by 684
Machine Learning Classification over Encrypted Data
Bost, R., Popa, R. A., Tu, S., & Goldwasser, S. (2015) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2015.23241 · Cited by 683
Bahmani, B., Moseley, B., Vattani, A., Kumar, R., & Vassilvitskii, S. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2180912.2180915 · Cited by 651
Parallel K-Means Clustering Based on MapReduce
Zhao, W., Ma, H., & He, Q. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-10665-1_71 · Cited by 627
Towards Making Systems Forget with Machine Unlearning
Cao, Y., & Yang, J. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.35 · Cited by 622 · cited 1×
“They include linear models [55, 27, 83, 81, 18, 74], certain types of lazy learning [88, 6, 11] techniques such as non-parametric Nadaraya-Watson kernel regressions [61] or nearest-neighbors methods [22, 74], recursive support vector machines [19, 81], and co-occurrence based collaborative filtering [74].”
MethodOn-line Learning and Stochastic Approximations
Bottou, L. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511569920.003 · Cited by 585
Locally Weighted Learning for Control
Atkeson, C. G., Moore, A., & Schaal, S. (1997) · Artificial Intelligence Review · doi:10.1023/a:1006511328852 · Cited by 554
Blackard, J. A., & Dean, D. J. (1999) · Computers and Electronics in Agriculture · doi:10.1016/s0168-1699(99)00046-0 · Cited by 507
Privacy-Preserving Ridge Regression on Hundreds of Millions of Records
Nikolaenko, V., Weinsberg, U., Ioannidis, S., Jóye, M., Boneh, D., & Taft, N. (2013) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2013.30 · Cited by 447
Data Shapley: Equitable Valuation of Data for Machine LearningPreprint
Ghorbani, A., & Zou, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02868 · Cited by 434
Self-citationTraining deep neural networks with low precision multiplications
Courbariaux, M., Bengio, Y., & David, J.-P. (2014) · arXiv · doi:10.48550/arxiv.1412.7024 · Cited by 407
Oblivious multi-party machine learning on trusted processors
Ohrimenko, O., Schuster, F., Fournet, C., Mehta, A., Nowozin, S., Vaswani, K., & Costa, M. (2016) · MPG.PuRe (Max Planck Society) · Cited by 390
An overview of reservoir computing: theory, applications and implementations
Schrauwen, B., Verstraeten, D., & Campenhout, J. V. (2007) · Ghent University Academic Bibliography (Ghent University) · Cited by 369
Qin, J., Fu, W., Gao, H., & Zheng, W. X. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2526683 · Cited by 334
Learnability, Stability and Uniform Convergence
Shalev‐Shwartz, S., Shamir, O., Srebro, N., & Sridharan, K. (2010) · doi:10.5555/1756006.1953019 · Cited by 328
General conditions for predictivity in learning theory
Poggio, T., Rifkin, R. M., Mukherjee, S., & Niyogi, P. (2004) · Nature Cell Biology · doi:10.1038/nature02341 · Cited by 285
Algorithms that remember: model inversion attacks and data protection law
Veale, M., Binns, R., & Edwards, L. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0083 · Cited by 278
Gysel, P., Pimentel, J., Motamedi, M., & Ghiasi, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2808319 · Cited by 250
Alternative k-nearest neighbour rules in supervised pattern recognition
Coomans, D., & Massart, D. L. (1982) · Analytica Chimica Acta · doi:10.1016/s0003-2670(01)95359-0 · Cited by 240
Generating Private Recommendations Efficiently Using Homomorphic Encryption and Data Packing
Erkin, Z., Veugen, T., Toft, T., & Lagendijk, R. L. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190726 · Cited by 238
Distribution-free performance bounds for potential function rules
Devroye, L., & Wagner, T. J. (1979) · IEEE Transactions on Information Theory · doi:10.1109/tit.1979.1056087 · Cited by 237
DENCLUE 2.0: Fast Clustering Based on Kernel Density Estimation
Hinneburg, A., & Gabriel, H.-H. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74825-0_7 · Cited by 224
Alternative k-nearest neighbour rules in supervised pattern recognition
Coomans, D. H., & Massart, D. L. (1982) · Analytica Chimica Acta · doi:10.1016/s0003-2670(01)85298-3 · Cited by 217
Mukherjee, S., Niyogi, P., Poggio, T., & Rifkin, R. M. (2006) · Advances in Computational Mathematics · doi:10.1007/s10444-004-7634-z · Cited by 198
Humans forget, machines remember: Artificial intelligence and the Right to Be Forgotten
Li, T., Villaronga, E. F., & Kieseberg, P. (2017) · Computer Law and Security Review · doi:10.1016/j.clsr.2017.08.007 · Cited by 173
Muggeo, V. M. R. (2016) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2016.1149855 · Cited by 157
Low precision storage for deep learningPreprint
Courbariaux, M., Bengio, Y., & David, J. (2014) · arXiv (Cornell University) · Cited by 142
Normalized mutual information based registration using k-means clustering and shading correction
Knops, Z. F., Maintz, J. B. A., Viergever, M. A., & Pluim, J. P. W. (2005) · Medical Image Analysis · doi:10.1016/j.media.2005.03.009 · Cited by 140
Schomm, F., Stahl, F., & Vossen, G. (2013) · ACM SIGMOD Record · doi:10.1145/2481528.2481532 · Cited by 121
A near-optimal algorithm for differentially-private principal components
Chaudhuri, K., Sarwate, A. D., & Sinha, K. P. (2013) · doi:10.5555/2567709.2567754 · Cited by 120
Optimization models for reliability of modular software systems
Berman, O., & Ashrafi, N. (1993) · IEEE Transactions on Software Engineering · doi:10.1109/32.256858 · Cited by 108
Lazy Learning Meets the Recursive Least Squares Algorithm
Birattari, M., Bontempi, G., & Bersini, H. (1998) · Cited by 100
The local paradigm for modeling and control: from neuro-fuzzy to lazy learning
Bontempi, G., Bersini, H., & Birattari, M. (2001) · Fuzzy Sets and Systems · doi:10.1016/s0165-0114(99)00172-4 · Cited by 89
Distributed k-Means and k-Median Clustering on General TopologiesPreprint
Balcan, M.-F., Ehrlich, S., & Liang, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.0604 · Cited by 85
Incremental and decremental training for linear classification
Tsai, C.-H., Lin, C.-Y., & Lin, C. (2014) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623661 · Cited by 75
Galinsky, K. J., Loh, P., Mallick, S., Patterson, N. J., & Price, A. L. (2016) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2016.09.014 · Cited by 55
Measuring Distance between Unordered Sets of Different Sizes
Gardner, A., Kanno, J., Duncan, C. A., & Šelmić, R. R. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.25 · Cited by 50
Closed-form Expressions for the Moments of the Binomial Probability Distribution
Knoblauch, A. (2008) · SIAM Journal on Applied Mathematics · doi:10.1137/070700024 · Cited by 45
Kernel Approximation Methods for Speech RecognitionPreprint
May, A., Garakani, A. B., Lu, Z., Guo, D., Liu, K., Bellet, A., Fan, L., Collins, M., Hsu, D., Kingsbury, B. E. D., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.03577 · Cited by 42
Updating the QR factorization and the least squares problemPreprint
Hammarling, S. J., & Lucas, C. (2008) · MIMS EPrints (University of Southampton) · Cited by 38
Data contracts for cloud-based data marketplaces
Truong, H. L., Comerio, M., Paoli, F. D., Gangadharan, G. R., & Dustdar, S. (2012) · International Journal of Computational Science and Engineering · doi:10.1504/ijcse.2012.049749 · Cited by 29
Bogdanov, D., Kamm, L., Laur, S., & Sokk, V. (2018) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2018.2858818 · Cited by 27
Schellekens, V., & Jacques, L. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2847908 · Cited by 24
Distributed and Provably Good Seedings for k-Means in Constant Rounds
Bachem, O., Lučić, M., & Krause, A. (2017) · International Conference on Machine Learning · Cited by 19
3D hand posture recognition from small unlabeled point sets
Gardner, A., Duncan, C. A., Kanno, J., & Šelmić, R. R. (2014) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2014.6973901 · Cited by 14
Zeb, S., & Yousaf, M. (2017) · Journal of Inequalities and Applications · doi:10.1186/s13660-017-1547-0 · Cited by 8
Self-organizing reservior computing with dynamically regulated cortical neural networks
Yin, J., & Meng, Y. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252772 · Cited by 4
Research works printed but not linked: 9
- [38][38] R. M. Gray and D. L. Neuhoff. Quantization. IEEE transactions on information theory , 44(6):2325-2383, 1998. -
- [39][39] S. Guha, R. Rastogi, and K. Shim. Cure: an efficient clustering algorithm for large databases. In ACMSigmod Record , pages 73-84. ACM, 1998. -
- [47][47] M. Kearns and D. Ron. Algorithmic stability and sanity-check bounds for leave-one-out crossvalidation. Neural computation , 11(6):1427-1453, 1999. -
- [55][55] J. H. Maindonald. Statistical Computation . John Wiley & Sons, Inc., New York, NY, USA, 1984. -
- [64][64] N. Papernot, M. Abadi, U. Erlingsson, I. Goodfellow, and K. Talwar. Semi-supervised knowledge transfer for deep learning from private training data. arXiv preprint arXiv:1610.05755 , 2016. - · arXiv
- [66][66] F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research , 12:2825-2830, 2011. -
- [74][74] S. Schelter. 'amnesia'-towards machine learning models that can forget user data very fast. In 1st International Workshop on Applied AI for Database Systems and Applications (AIDB'19) , 2019. -
- [88][88] G. I. Webb. Lazy Learning , pages 571-572. Springer US, 2010. -
- [91][91] J. Zhang, A. May, T. Dao, and C. Ré. Low-precision random fourier features for memoryconstrained kernel approximation. arXiv preprint arXiv:1811.00155 , 2018. - · arXiv
Cited by
Sorted by citations
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
Bourtoule, L., Chandrasekaran, V., Choquette-Choo, C. A., Jia, H., Travers, A., Zhang, B., Lie, D., & Papernot, N. (2021) · 2021 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40001.2021.00019 · Cited by 810
“Decremental Learning: Ginart et al. [37] consider the problem from a data-protection regulation standpoint.”
BackgroundPrivacy preservation in federated learning: An insightful survey from the GDPR perspective
Truong, N., Sun, K., Wang, S., Guitton, F., & Guo, Y. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102402 · Cited by 399
Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networks
Golatkar, A., Achille, A., & Soatto, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00932 · Cited by 394
Metadata
- Authors
- Ginart, A., Guan, M. Y., Valiant, G., & Zou, J.
- Affiliations
- Stanford University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Volume
- 32
- Pages
- 3513-3526
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1907.05012
- OpenAlex
- W2961073278
- Cited by
- 175
- References
- 85
- Citations by year
- 2026: 2 · 2025: 24 · 2024: 49 · 2023: 38 · 2022: 25 · 2021: 26 · 2020: 9 · 2019: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1704417, 1763191, 1813049)
- National Institutes of Health (R21 MD012867-01)
- National Institute on Aging (P30AG059307)
- Office of Naval Research (N00014-18, N00014-18-1-2295, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- data deletion, machine learning, K-means clustering, right to be forgotten, privacy, retraining costs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
