CoChat
Sign Up
PreprintCited by 11Privacy-Preserving Technologies in DataAdversarial Robustness in Machine LearningEthics and Social Impacts of AI

The DOI matches its DataCite record.

On the Impossible Safety of Large AI Models

Open access
El-Mhamdi, El-Mahdi, Farhadkhani, Sadegh, Guerraoui, Rachid, Gupta, Nirupam, Hoang, Lê-Nguyên, Pinot, Rafael, Rouault, Sébastien, Stephan, John·2022·arXiv
DOI 10.48550/arxiv.2209.15259arXiv 2209.15259
Open this paper in CoChat — free accountOpen PDF

Abstract

Large AI Models (LAIMs), of which large language models are the most prominent recent example, showcase some impressive performance. However they have been empirically found to pose serious security issues. This paper systematizes our knowledge about the fundamental impossibility of building arbitrarily accurate and secure machine learning models. More precisely, we identify key challenging features of many of today's machine learning settings. Namely, high accuracy seems to require memorizing large training datasets, which are often user-generated and highly heterogeneous, with both sensitive information and fake users. We then survey statistical lower bounds that, we argue, constitute a compelling case against the possibility of designing high-accuracy LAIMs with strong security guarantees.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2209.15259

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Still being checked.

Research works printed but not linked: 155

  1. [BBF + 21] Gavin Brown, Mark Bun, Vitaly Feldman, Adam D. Smith, and Kunal Talwar. When is memorization of irrelevant training data necessary for high-accuracy learning? In Samir Khuller and Virginia Vassilevska Williams, editors, STOC '21: 53rd Annual ACM SIGACT Symposium on Theory of Computing, Virtual Event, Italy, June 21-25, 2021 , pages 123-132. ACM, 2021.
  2. [BCF + 22] Romain Beylerian, B´ erang` ere Colbois, Louis Faucon, Lˆ e Nguyˆ en Hoang, Aidan Jungo, Alain Le Noac'h, and Adrien Matissart. Tournesol: Permissionless collaborative algorithmic governance with security guarantees. CoRR , abs/2211.01179, 2022. · arXiv
  3. [Bel57] Richard Ernest Bellman. Dynamic programming . Princeton University Press, 1957.
  4. [BG18] Joy Buolamwini and Timnit Gebru. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Sorelle A. Friedler and Christo Wilson, editors, Conference on Fairness, Accountability and Transparency, FAT 2018, 23-24 February 2018, New York, NY, USA , volume 81 of Proceedings of Machine Learning Research , pages 77-91. PMLR, 2018.
  5. [BGMS21] Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. On the dangers of stochastic parrots: Can language models be too big? In Madeleine Clare Elish, William Isaac, and Richard S. Zemel, editors, FAccT '21: 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event / Toronto, Canada, March 3-10, 2021 , pages 610-623. ACM, 2021.
  6. [BHMM19] Mikhail Belkin, Daniel Hsu, Siyuan Ma, and Soumik Mandal. Reconciling modern machine-learning practice and the classical bias-variance trade-off. Proceedings of the National Academy of Sciences , 116(32):15849-15854, 2019.
  7. [BHX20] Mikhail Belkin, Daniel Hsu, and Ji Xu. Two models of double descent for weak features. SIAM J. Math. Data Sci. , 2(4):1167-1180, 2020.
  8. [BKJ + 17] Maria Borge, Eleftherios Kokoris-Kogias, Philipp Jovanovic, Linus Gasser, Nicolas Gailly, and Bryan Ford. Proof-of-personhood: Redemocratizing permissionless cryptocurrencies. In 2017 IEEE European Symposium on Security and Privacy Workshops, EuroS&P Workshops 2017, Paris, France, April 26-28, 2017 , pages 23-26. IEEE, 2017.
  9. [BMGS17] Peva Blanchard, El Mahdi El Mhamdi, Rachid Guerraoui, and Julien Stainer. Machine learning with adversaries: Byzantine tolerant gradient descent. In Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett, editors, Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA , pages 119-129, 2017.
  10. [BMM18] Mikhail Belkin, Siyuan Ma, and Soumik Mandal. To understand deep learning we need to understand kernel learning. In Jennifer G. Dy and Andreas Krause, editors, Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm¨ assan, Stockholm, Sweden, July 10-15, 2018 , volume 80 of Proceedings of Machine Learning Research , pages 540-548. PMLR, 2018.
  11. [BMR + 20] Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. Language models are few-shot learners. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , 2020.
  12. [Bra08] Markus Brauer. Un ministre peut-il tomber enceinte? l'impact du g´ en´ erique masculin sur les repr´ esentations mentales. L'Ann´ ee psychologique , 108(2):243-272, 2008.
  13. [BRT19] Mikhail Belkin, Alexander Rakhlin, and Alexandre B. Tsybakov. Does data interpolation contradict statistical optimality? In Kamalika Chaudhuri and Masashi Sugiyama, editors, The 22nd International Conference on Artificial Intelligence and Statistics, AISTATS 2019, 16-18 April 2019, Naha, Okinawa, Japan , volume 89 of Proceedings of Machine Learning Research , pages 1611-1619. PMLR, 2019.
  14. [BUV18] Mark Bun, Jonathan R. Ullman, and Salil P. Vadhan. Fingerprinting codes and the price of approximate differential privacy. SIAM J. Comput. , 47(5):1888-1938, 2018.
  15. [CAS16] Paul Covington, Jay Adams, and Emre Sargin. Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems , pages 191-198, 2016.
  16. [CCM21] Kenneth Ward Church, Zeyu Chen, and Yanjun Ma. Emerging trends: A gentle introduction to fine-tuning. Nat. Lang. Eng. , 27(6):763-778, 2021.
  17. [CDG19] Yu Cheng, Ilias Diakonikolas, and Rong Ge. High-dimensional robust mean estimation in nearly-linear time. In Timothy M. Chan, editor, Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2019, San Diego, California, USA, January 6-9, 2019 , pages 2755-2771. SIAM, 2019.
  18. [Cha21] Ajay Chawla. Pegasus spyware-'a privacy killer'. Available at SSRN 3890657 , 2021.
  19. [CHC + 20] Sanyuan Chen, Yutai Hou, Yiming Cui, Wanxiang Che, Ting Liu, and Xiangzhan Yu. Recall and learn: Fine-tuning deep pretrained language models with less forgetting. In Bonnie Webber, Trevor Cohn, Yulan He, and Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020 , pages 7870-7881. Association for Computational Linguistics, 2020.
  20. [CLCY20] Yong Cheng, Yang Liu, Tianjian Chen, and Qiang Yang. Federated learning for privacy-preserving AI. Commun. ACM , 63(12):33-36, 2020.
  21. [CLE + 19] Nicholas Carlini, Chang Liu, ´ Ulfar Erlingsson, Jernej Kos, and Dawn Song. The secret sharer: Evaluating and testing unintended memorization in neural networks. In USENIX Security Symposium , volume 267, 2019.
  22. [CLL21] Kurtland Chua, Qi Lei, and Jason D. Lee. How fine-tuning allows for effective meta-learning. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual , pages 8871-8884, 2021.
  23. [CND + 22] Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, and Noah Fiedel. Palm: Scaling language modeling with pathways. CoRR , abs/2204.02311, 2022. · arXiv
  24. [Cou04] Malcolm Coulthard. Author identification, idiolect, and linguistic uniqueness. Applied linguistics , 25(4):431-447, 2004.
  25. [CTW + 20] Nicholas Carlini, Florian Tram` er, Eric Wallace, Matthew Jagielski, Ariel HerbertVoss, Katherine Lee, Adam Roberts, Tom B. Brown, Dawn Song, ´ Ulfar Erlingsson, Alina Oprea, and Colin Raffel. Extracting training data from large language models. CoRR , abs/2012.07805, 2020. · arXiv
  26. [CWZ19] T Tony Cai, Yichen Wang, and Linjun Zhang. The cost of privacy: Optimal rates of convergence for parameter estimation with differential privacy. arXiv preprint arXiv:1902.04495 , 2019. · arXiv
  27. [DD21] Deepesh Data and Suhas N. Diggavi. Byzantine-resilient SGD in high dimensions on heterogeneous data. In IEEE International Symposium on Information Theory, ISIT 2021, Melbourne, Australia, July 12-20, 2021 , pages 2310-2315. IEEE, 2021.
  28. [DJW18] John C. Duchi, Michael I. Jordan, and Martin J. Wainwright. Minimax optimal procedures for locally private estimation. Journal of the American Statistical Association , 113(521):182-201, 2018.
  29. [DK19] Ilias Diakonikolas and Daniel M. Kane. Recent advances in algorithmic highdimensional robust statistics. CoRR , abs/1911.05911, 2019. · arXiv
  30. [DK23] Ilias Diakonikolas and Daniel M. Kane. Algorithmic High-Dimensional Robust Statistics . Cambridge University Press, 2023.
  31. [DL19] Jules Depersin and Guillaume Lecu´ e. Robust subgaussian estimation of a mean vector in nearly linear time. arXiv preprint arXiv:1906.03058 , 2019. · arXiv
  32. [DM09] George Danezis and Prateek Mittal. Sybilinfer: Detecting sybil nodes using social networks. In Proceedings of the Network and Distributed System Security Symposium, NDSS 2009, San Diego, California, USA, 8th February - 11th February 2009 . The Internet Society, 2009.
  33. [DMNS06] Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam D. Smith. Calibrating noise to sensitivity in private data analysis. In Shai Halevi and Tal Rabin, editors, Theory of Cryptography, Third Theory of Cryptography Conference, TCC 2006, New York, NY, USA, March 4-7, 2006, Proceedings , volume 3876 of Lecture Notes in Computer Science , pages 265-284. Springer, 2006.
  34. [DR14] Cynthia Dwork and Aaron Roth. The algorithmic foundations of differential privacy. Found. Trends Theor. Comput. Sci. , 9(3-4):211-407, August 2014.
  35. [DRZ + 21] Ittai Dayan, Holger R Roth, Aoxiao Zhong, Ahmed Harouni, Amilcare Gentili, Anas Z Abidin, Andrew Liu, Anthony Beardsworth Costa, Bradford J Wood, ChienSung Tsai, et al. Federated learning for predicting clinical outcomes in patients with covid-19. Nature medicine , 27(10):1735-1743, 2021.
  36. [DS22] Philip Di Salvo. 'we have to act like our devices are already infected': Investigative journalists and internet surveillance. Journalism Practice , 16(9):1849-1866, 2022.
  37. [DSB21] Josep Domingo-Ferrer, David S´ anchez, and Alberto Blanco-Justicia. The limits of differential privacy (and its misuse in data release and machine learning). Commun. ACM , 64(7):33-35, 2021.
  38. [DSJ + 21] Qi Dou, Tiffany Y So, Meirui Jiang, Quande Liu, Varut Vardhanabhuti, Georgios Kaissis, Zeju Li, Weixin Si, Heather HC Lee, Kevin Yu, et al. Federated deep learning for detecting covid-19 lung abnormalities in ct: a privacy-preserving multinational validation study. NPJ digital medicine , 4(1):1-11, 2021.
  39. [DTN20] Canh T. Dinh, Nguyen H. Tran, and Tuan Dung Nguyen. Personalized federated learning with moreau envelopes. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , 2020.
  40. [EM20] El Mahdi El Mhamdi. Robust Distributed Learning . PhD thesis, EPFL, 2020.
  41. [EMGR18] El-Mahdi El-Mhamdi, Rachid Guerraoui, and S´ ebastien Rouault. The hidden vulnerability of distributed learning in byzantium. In International Conference on Machine Learning , pages 3521-3530. PMLR, 2018.
  42. [Fel20] Vitaly Feldman. Does learning require memorization? a short tale about a long tail. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing , STOC 2020, page 954-959, New York, NY, USA, 2020. Association for Computing Machinery.
  43. [FGG + 22] Sadegh Farhadkhani, Rachid Guerraoui, Nirupam Gupta, Rafael Pinot, and John Stephan. Byzantine machine learning made easy by resilient averaging of momentums. In Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesv´ ari, Gang Niu, and Sivan Sabato, editors, International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA , volume 162 of Proceedings of Machine Learning Research , pages 6246-6283. PMLR, 2022.
  44. [FGG + 23] Sadegh Farhadkhani, Rachid Guerraoui, Nirupam Gupta, Lˆ e Nguyˆ en Hoang, Rafael Pinot, and John Stephan. Robust collaborative learning with linear gradient overhead. In Proceedings of the 40th International Conference on Machine Learning, ICML , 2023.
  45. [FGHV22] Sadegh Farhadkhani, Rachid Guerraoui, Lˆ e Nguyˆ en Hoang, and Oscar Villemaud. An equivalence between data poisoning and byzantine gradient attacks. In Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesv´ ari, Gang Niu, and Sivan Sabato, editors, International Conference on Machine Learning, ICML 2022, 1723 July 2022, Baltimore, Maryland, USA , volume 162 of Proceedings of Machine Learning Research , pages 6284-6323. PMLR, 2022.
  46. [FH19] Marcus CG Friedrich and Elke Heise. Does the use of gender-fair language influence the comprehensibility of texts? an experiment using an authentic contract manipulating single role nouns and pronouns. Swiss Journal of Psychology , 78(1-2):51, 2019.
  47. [FMO20] Alireza Fallah, Aryan Mokhtari, and Asuman E. Ozdaglar. Personalized federated learning with theoretical guarantees: A model-agnostic meta-learning approach. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , 2020.
  48. [Foo67] Philippa Foot. The problem of abortion and the doctrine of the double effect. Oxford review , 5, 1967.
  49. [For20] Bryan Ford. Identity and personhood in digital democracy: Evaluating inclusion, equality, security, and privacy in pseudonym parties and other proofs of personhood. CoRR , abs/2011.02412, 2020. · arXiv
  50. [FZS21] William Fedus, Barret Zoph, and Noam Shazeer. Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity. CoRR , abs/2101.03961, 2021. · arXiv
  51. Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021.
  52. [GKVZ22] Shafi Goldwasser, Michael P. Kim, Vinod Vaikuntanathan, and Or Zamir. Planting undetectable backdoors in machine learning models. CoRR , abs/2204.06974, 2022. · arXiv
  53. [GMF + 18] Justin Gilmer, Luke Metz, Fartash Faghri, Samuel S. Schoenholz, Maithra Raghu, Martin Wattenberg, and Ian J. Goodfellow. Adversarial spheres. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Workshop Track Proceedings . OpenReview.net, 2018.
  54. [GRPM18] Christi J Guerrini, Jill O Robinson, Devan Petersen, and Amy L McGuire. Should police have access to genetic genealogy databases? capturing the golden state killer and other criminals using a controversial new forensic technique. PLoS biology , 16(10):e2006906, 2018.
  55. [GSM + 23] Josh A Goldstein, Girish Sastry, Micah Musser, Renee DiResta, Matthew Gentzel, and Katerina Sedova. Generative language models and automated influence operations: Emerging threats and potential mitigations. arXiv preprint arXiv:2301.04246 , 2023. · arXiv
  56. [GV16] Kalle Grill and Kristin Voigt. The case for banning cigarettes. Journal of Medical Ethics , 42(5):293-301, 2016.
  57. [GYA22] Yue Guo, Yi Yang, and Ahmed Abbasi. Auto-debias: Debiasing masked language models with automated biased prompts. In Smaranda Muresan, Preslav Nakov, and Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022 , pages 1012-1023. Association for Computational Linguistics, 2022.
  58. [HFEM21] Lˆ e-Nguyˆ en Hoang, Louis Faucon, and El-Mahdi El-Mhamdi. Recommendation algorithms, a neglected opportunity for public health. Revue M´ edecine et Philosophie , 4(2), 2021.
  59. [HFJ + 21a] Lˆ e-Nguyˆ en Hoang, Louis Faucon, Aidan Jungo, Sergei Volodin, Dalia Papuc, Orfeas Liossatos, Ben Crulis, Mariame Tighanimine, Isabela Constantin, Anastasiia Kucherenko, et al. Tournesol: A quest for a large, secure and trustworthy database of reliable human judgments. arXiv preprint arXiv:2107.07334 , 2021. · arXiv
  60. [HFJ + 21b] Lˆ e-Nguyˆ en Hoang, Louis Faucon, Aidan Jungo, Sergei Volodin, Dalia Papuc, Orfeas Liossatos, Ben Crulis, Mariame Tighanimine, Isabela Constantin, El-Mahdi El-Mhamdi, Anastasiia Kucherenko, Alexandre Maurer, Mithuna Yoganathan, Felix Grimberg, Vlad Nitu, Chris Vossen, and S´ ebastien Rouault. Tournesol: A quest for a large, secure and trustworthy database of reliable human judgments. ArXiV , 2021.
  61. [HH21a] Keach Hagey and Jeff Horwitz. Facebook says its rules apply to all. company documents reveal a secret elite that's exempt. The Wall Street Journal , 2021.
  62. [HH21b] Keach Hagey and Jeff Horwitz. Facebook tried to make its platform a healthier place. it got angrier instead. The Wall Street Journal , 2021.
  63. [HHHR20] Filip Hanzely, Slavom´ ır Hanzely, Samuel Horv´ ath, and Peter Richt´ arik. Lower bounds and optimal algorithms for personalized federated learning. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and HsuanTien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , 2020.
  64. [Hol21] David Holzm¨ uller. On the universality of the double descent peak in ridgeless regression. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021.
  65. [HRM + 18] Andrew Hard, Kanishka Rao, Rajiv Mathews, Fran¸ coise Beaufays, Sean Augenstein, Hubert Eichner, Chlo´ e Kiddon, and Daniel Ramage. Federated learning for mobile keyboard prediction. CoRR , abs/1811.03604, 2018. · arXiv
  66. [HY21] Reinhard Heckel and Fatih Furkan Yilmaz. Early stopping in deep networks: Double descent and how to eliminate it. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021.
  67. [IRW + 21] Huseyin A. Inan, Osman Ramadan, Lukas Wutschitz, Daniel Jones, Victor R¨ uhle, James Withers, and Robert Sim. Privacy analysis in language models via training data leakage report. CoRR , abs/2101.05405, 2021. · arXiv
  68. Chakraborty, and Yichao Zhou, editors, Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021, Online, June 6-11, 2021 , pages 37703783. Association for Computational Linguistics, 2021.
  69. [JHG18] Arthur Jacot, Cl´ ement Hongler, and Franck Gabriel. Neural tangent kernel: Convergence and generalization in neural networks. In Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicol` o Cesa-Bianchi, and Roman Garnett, editors, Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montr´ eal, Canada , pages 8580-8589, 2018.
  70. [JLZ22] Haotian Ju, Dongyue Li, and Hongyang R. Zhang. Robust fine-tuning of deep neural networks with hessian-based generalization guarantees. In Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesv´ ari, Gang Niu, and Sivan Sabato, editors, International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA , volume 162 of Proceedings of Machine Learning Research , pages 10431-10461. PMLR, 2022.
  71. [JSS + 20] Arthur Jacot, Berfin Simsek, Francesco Spadaro, Cl´ ement Hongler, and Franck Gabriel. Implicit regularization of random feature models. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event , volume 119 of Proceedings of Machine Learning Research , pages 46314640. PMLR, 2020.
  72. [KHJ21] Sai Praneeth Karimireddy, Lie He, and Martin Jaggi. Learning from history for byzantine robust optimization. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event , volume 139 of Proceedings of Machine Learning Research , pages 5311-5319. PMLR, 2021.
  73. [Kit19] Matthew Kitchen. Alexa gone bad: When a.i. assistants turn on us. The Wall Street Journal , 2019.
  74. [KKM + 20] Sai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi, Sebastian U. Stich, and Ananda Theertha Suresh. SCAFFOLD: stochastic controlled averaging for federated learning. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event , volume 119 of Proceedings of Machine Learning Research , pages 5132-5143. PMLR, 2020.
  75. [KM11] Daniel Kifer and Ashwin Machanavajjhala. No free lunch in data privacy. In Timos K. Sellis, Ren´ ee J. Miller, Anastasios Kementsietsidis, and Yannis Velegrakis, editors, Proceedings of the ACM SIGMOD International Conference on Management of Data, SIGMOD 2011, Athens, Greece, June 12-16, 2011 , pages 193-204. ACM, 2011.
  76. [KN17] Assimakis Kattis and Aleksandar Nikolov. Lower bounds for differential privacy from gaussian width. In Boris Aronov and Matthew J. Katz, editors, 33rd International Symposium on Computational Geometry, SoCG 2017, July 4-7, 2017, Brisbane, Australia , volume 77 of LIPIcs , pages 45:1-45:16. Schloss Dagstuhl - LeibnizZentrum f¨ ur Informatik, 2017.
  77. [Kol63] Andrei N Kolmogorov. On tables of random numbers. Sankhy¯ a: The Indian Journal of Statistics, Series A , pages 369-376, 1963.
  78. [KOV15] Peter Kairouz, Sewoong Oh, and Pramod Viswanath. The composition theorem for differential privacy. In Francis R. Bach and David M. Blei, editors, Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015 , volume 37 of JMLR Workshop and Conference Proceedings , pages 1376-1385. JMLR.org, 2015.
  79. [KPR17] Gary King, Jennifer Pan, and Margaret E Roberts. How the chinese government fabricates social media posts for strategic distraction, not engaged argument. American political science review , 111(3):484-501, 2017.
  80. [Kri17] Sheldon Krimsky. Sugar industry science and heart disease. Accountability in Research , 24(2):124-125, 2017.
  81. [KSG03] Sepandar D. Kamvar, Mario T. Schlosser, and Hector Garcia-Molina. The eigentrust algorithm for reputation management in P2P networks. In Guszt´ av Hencsey, Bebo White, Yih-Farn Robin Chen, L´ aszl´ o Kov´ acs, and Steve Lawrence, editors, Proceedings of the Twelfth International World Wide Web Conference, WWW 2003, Budapest, Hungary, May 20-24, 2003 , pages 640-651. ACM, 2003.
  82. [KSG16] Cristin E Kearns, Laura A Schmidt, and Stanton A Glantz. Sugar industry and coronary heart disease research: a historical analysis of internal industry documents. JAMA internal medicine , 176(11):1680-1685, 2016.
  83. [KSU20] Gautam Kamath, Vikrant Singhal, and Jonathan Ullman. Private mean estimation of heavy-tailed distributions. In Jacob Abernethy and Shivani Agarwal, editors, Proceedings of Thirty Third Conference on Learning Theory , volume 125 of Proceedings of Machine Learning Research , pages 2204-2235. PMLR, 09-12 Jul 2020.
  84. [LC20] Heejun Lee and Chang-Hoan Cho. Digital advertising: present and future prospects. International Journal of Advertising , 39(3):332-341, 2020.
  85. [LYZ + 21] Xiangru Lian, Binhang Yuan, Xuefeng Zhu, Yulong Wang, Yongjun He, Honghuan Wu, Lei Sun, Haodong Lyu, Chengjun Liu, Xing Dong, Yiqiao Liao, Mingnan Luo, Congfei Zhang, Jingru Xie, Haonan Li, Lei Chen, Renjie Huang, Jianying Lin, Chengchun Shu, Xuezhong Qiu, Zhishan Liu, Dongying Kong, Lei Yuan, Hai Yu, Sen Yang, Ce Zhang, and Ji Liu. Persia: An open, hybrid system scaling deep learning-based recommenders up to 100 trillion parameters. CoRR , abs/2111.05897, 2021. · arXiv
  86. [LZZ + 17] Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, and Ji Liu. Can decentralized algorithms outperform centralized algorithms? A case study for decentralized parallel stochastic gradient descent. In Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett, editors, Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA , pages 5330-5340, 2017.
  87. [MACN + 20] Bill Marczak, Siena Anstis, Masashi Crete-Nishihata, John Scott-Railton, and Ron Deibert. Stopping the press: New york times journalist targeted by saudi-linked pegasus spyware operator. Citizen Lab, University of Toronto , 2020.
  88. [MFG + 21] El Mahdi El Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Arsany Guirguis, Lˆ e-Nguyˆ en Hoang, and S´ ebastien Rouault. Collaborative learning in the jungle (decentralized, byzantine, heterogeneous, asynchronous and nonconvex learning). In Thirty-Fifth Conference on Neural Information Processing Systems , 2021.
  89. [MGL + 05] David Madigan, Alexander Genkin, David D Lewis, Shlomo Argamon, Dmitriy Fradkin, and Li Ye. Author identification on the large scale. In Proceedings of the 2005 Meeting of the Classification Society of North America (CSNA) , 2005.
  90. [MGR21] El Mahdi El Mhamdi, Rachid Guerraoui, and S´ ebastien Rouault. Distributed momentum for byzantine-resilient stochastic gradient descent. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021.
  91. [MMS19] Julia Misersky, Asifa Majid, and Tineke M Snijders. Grammatical gender in german influences how role-nouns are interpreted: Evidence from erps. Discourse Processes , 56(8):643-654, 2019.
  92. [MMWMC20] Nicole Martinez-Martin, Sarah Wieten, David Magnus, and Mildred K Cho. Digital contact tracing, privacy, and public health. Hastings Center Report , 50(3):43-46, 2020.
  93. [MN20] Kris McGuffie and Alex Newhouse. The radicalization risks of GPT-3 and advanced neural language models. CoRR , abs/2009.06807, 2020. · arXiv
  94. [MPR22] Nicholas Meade, Elinor Poole-Dayan, and Siva Reddy. An empirical survey of the effectiveness of debiasing techniques for pre-trained language models. In Smaranda Muresan, Preslav Nakov, and Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022 , pages 1878-1898. Association for Computational Linguistics, 2022.
  95. [MRT18] Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar. Foundations of machine learning . MIT press, 2018.
  96. [MS99] Christopher Manning and Hinrich Schutze. Foundations of statistical natural language processing . MIT press, 1999.
  97. [MVSS20] Vidya Muthukumar, Kailas Vodrahalli, Vignesh Subramanian, and Anant Sahai. Harmless interpolation of noisy data in regression. IEEE J. Sel. Areas Inf. Theory , 1(1):67-83, 2020.
  98. (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018 , pages 1587-1594. AAAI Press, 2018.
  99. [NHK19] Lisa-Maria Neudert, Philip Howard, and Bence Kollanyi. Sourcing and automation of political news and information during three european elections. Social Media+ Society , 5(3):2056305119863147, 2019.
  100. [NKB + 20] Preetum Nakkiran, Gal Kaplun, Yamini Bansal, Tristan Yang, Boaz Barak, and Ilya Sutskever. Deep double descent: Where bigger models and more data hurt. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020 . OpenReview.net, 2020.
  101. [NP82] Shmuel Nitzan and Jacob Paroush. Optimal decision rules in uncertain dichotomous choice situations. International Economic Review , pages 289-297, 1982.
  102. [NPZC19] Emmanuel Nyaletey, Reza M. Parizi, Qi Zhang, and Kim-Kwang Raymond Choo. Blockipfs -blockchain-enabled interplanetary file system for forensic and trusted data traceability. In IEEE International Conference on Blockchain, Blockchain 2019, Atlanta, GA, USA, July 14-17, 2019 , pages 18-25. IEEE, 2019.
  103. [NVKM21] Preetum Nakkiran, Prayaag Venkat, Sham M. Kakade, and Tengyu Ma. Optimal regularization can mitigate double descent. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021.
  104. [OC10] Naomi Oreskes and Erik M Conway. Defeating the merchants of doubt. Nature , 465(7299):686-687, 2010.
  105. [OC11] Naomi Oreskes and Erik M Conway. Merchants of doubt: How a handful of scientists obscured the truth on issues from tobacco smoke to global warming . Bloomsbury Publishing USA, 2011.
  106. [PFA21] Dario Pasquini, Danilo Francati, and Giuseppe Ateniese. Eluding secure aggregation in federated learning via model inconsistency. CoRR , abs/2111.07380, 2021. · arXiv
  107. [PGS + 21] Avinash Prabhu, Dipanwita Guhathakurta, Mallika Subramanian, Manvith Reddy, Shradha Sehgal, Tanvi Karandikar, Amogh Gulati, Udit Arora, Rajiv Ratn Shah, Ponnurangam Kumaraguru, et al. Capitol (pat) riots: A comparative study of twitter and parler. arXiv preprint arXiv:2101.06914 , 2021. · arXiv
  108. [PKP + 18] Vadim Popov, Mikhail A. Kudinov, Irina Piontkovskaya, Petr Vytovtov, and Alex Nevidomsky. Distributed fine-tuning of language models on private data. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings . OpenReview.net, 2018.
  109. [PMB + 22] Ashwinee Panda, Saeed Mahloujifar, Arjun Nitin Bhagoji, Supriyo Chakraborty, and Prateek Mittal. Sparsefed: Mitigating model poisoning attacks in federated learning with sparsification. In Gustau Camps-Valls, Francisco J. R. Ruiz, and Isabel Valera, editors, International Conference on Artificial Intelligence and Statistics, AISTATS 2022, 28-30 March 2022, Virtual Event , volume 151 of Proceedings of Machine Learning Research , pages 7587-7624. PMLR, 2022.
  110. [PSST21] Ouri Poupko, Gal Shahaf, Ehud Shapiro, and Nimrod Talmon. Building a sybilresilient digital community utilizing trust-graph connectivity. IEEE/ACM Trans. Netw. , 29(5):2215-2227, 2021.
  111. [PZJY20] Xudong Pan, Mi Zhang, Shouling Ji, and Min Yang. Privacy risks of general-purpose language models. In 2020 IEEE Symposium on Security and Privacy, SP 2020, San Francisco, CA, USA, May 18-21, 2020 , pages 1314-1331. IEEE, 2020.
  112. [RGM18] Natalie Ram, Christi J Guerrini, and Amy L McGuire. Genealogy databases and the future of criminal investigation. Science , 360(6393):1078-1079, 2018.
  113. [Rog21] Anna Rogers. Changing the world by changing the data. CoRR , abs/2105.13947, 2021. · arXiv
  114. [Rou22] S´ ebastien Louis Alexandre Rouault. Practical Byzantine-resilient Stochastic Gradient Descent . PhD thesis, EPFL, 2022.
  115. [RSF21] Peter Richt´ arik, Igor Sokolov, and Ilyas Fatkhullin. EF21: A new, simpler, theoretically better, and practically faster error feedback. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual , pages 4384-4396, 2021.
  116. [RWC + 19] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language models are unsupervised multitask learners. OpenAI blog , 1(8):9, 2019.
  117. [Sar22] Jayshree Sarathy. From algorithmic to institutional logics: the politics of differential privacy. Available at SSRN , 2022.
  118. [SBBC20] Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. Winogrande: An adversarial winograd schema challenge at scale. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020 , pages 8732-8740. AAAI Press, 2020.
  119. [SC00] Henry Saffer and Frank Chaloupka. The effect of tobacco advertising bans on tobacco consumption. Journal of health economics , 19(6):1117-1137, 2000.
  120. [SCL + 22] Weiyan Shi, Aiqi Cui, Evan Li, Ruoxi Jia, and Zhou Yu. Selective differential privacy for language modeling. In Marine Carpuat, Marie-Catherine de Marneffe, and Iv´ an Vladimir Meza Ru´ ız, editors, Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2022, Seattle, WA, United States, July 10-15, 2022 , pages 2848-2859. Association for Computational Linguistics, 2022.
  121. [SD21] Irene Solaiman and Christy Dennison. Process for adapting language models to society (PALMS) with values-targeted datasets. CoRR , abs/2106.10328, 2021. · arXiv
  122. [See21] Deepa Seetharaman. Facebook limits employee access to some internal discussion groups. The Wall Street Journal , 2021.
  123. [Sei21] Philip Seib. Information at War: Journalism, Disinformation, and Modern Warfare . John Wiley & Sons, 2021.
  124. [SHKR21] Virat Shejwalkar, Amir Houmansadr, Peter Kairouz, and Daniel Ramage. Back to the drawing board: A critical evaluation of poisoning attacks on federated learning. CoRR , abs/2108.10241, 2021. · arXiv
  125. [SMS + 21] Fnu Suya, Saeed Mahloujifar, Anshuman Suri, David Evans, and Yuan Tian. Modeltargeted poisoning attacks with provable convergence. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event , volume 139 of Proceedings of Machine Learning Research , pages 10000-10010. PMLR, 2021.
  126. [Soa15] Nate Soares. The value learning problem. In Ethics for Artificial Intelligence Workshop at 25th International Joint Conference on Artificial Intelligence , 2015.
  127. [Spi81] Robert L Spitzer. The diagnostic status of homosexuality in dsm-iii: a reformulation of the issues. The American Journal of Psychiatry , 1981.
  128. [SSP + 13] Jason R. Smith, Herve Saint-Amand, Magdalena Plamada, Philipp Koehn, Chris Callison-Burch, and Adam Lopez. Dirt cheap web-scale parallel text from the common crawl. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, ACL 2013, 4-9 August 2013, Sofia, Bulgaria, Volume 1: Long Papers , pages 1374-1383. The Association for Computer Linguistics, 2013.
  129. [SU17] Thomas Steinke and Jonathan Ullman. Between pure and approximate differential privacy. Journal of Privacy and Confidentiality , 7(2), Jan. 2017.
  130. [SUS21] Timo Schick, Sahana Udupa, and Hinrich Sch¨ utze. Self-diagnosis and self-debiasing: A proposal for reducing corpus-based bias in nlp. Transactions of the Association for Computational Linguistics , 9:1408-1424, 2021.
  131. [TF19] Aleksei Triastcyn and Boi Faltings. Federated learning with bayesian differential privacy. In Chaitanya K. Baru, Jun Huan, Latifur Khan, Xiaohua Hu, Ronay Ak, Yuanyuan Tian, Roger S. Barga, Carlo Zaniolo, Kisung Lee, and Yanfang Fanny Ye, editors, 2019 IEEE International Conference on Big Data (IEEE BigData), Los Angeles, CA, USA, December 9-12, 2019 , pages 2587-2596. IEEE, 2019.
  132. [Tho76] Judith Jarvis Thomson. Killing, letting die, and the trolley problem. The Monist , 59(2):204-217, 1976.
  133. [US21] Stefanie Ullmann and Danielle Saunders. Online translators are sexist - here's how we gave them a little gender sensitivity training, 2021.
  134. [Val84] Leslie G. Valiant. A theory of the learnable. Commun. ACM , 27(11):1134-1142, 1984.
  135. [VHW13] Dries Vervecken, Bettina Hannover, and Ilka Wolter. Changing (s) expectations: How gender fair job descriptions impact children's perceptions and interest regarding traditionally male occupations. Journal of Vocational Behavior , 82(3):208-220, 2013.
  136. Li, and Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021 , pages 5269-5283. Association for Computational Linguistics, 2021.
  137. [VSP + 17] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett, editors, Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA , pages 5998-6008, 2017.
  138. [Wan17] Lidong Wang. Heterogeneous data and big data analytics. Automatic Control and Information Sciences , 3(1):8-15, 2017.
  139. [WPN + 19] Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R. Bowman. Superglue: A stickier benchmark for general-purpose language understanding systems. In Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d'Alch´ e-Buc, Emily B. Fox, and Roman Garnett, editors, Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada , pages 3261-3275, 2019.
  140. [Wri17] David Wright. Using word n-grams to identify authors and idiolects: A corpus approach to a forensic linguistic problem. International Journal of Corpus Linguistics , 22(2):212-241, 2017.
  141. [WSM + 19] Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R. Bowman. GLUE: A multi-task benchmark and analysis platform for natural language understanding. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019 . OpenReview.net, 2019.
  142. [WWKTT20] Jenifer Whitten-Woodring, Mona S Kleinberg, Ardeth Thawnghmung, and Myat The Thitsar. Poison if you don't know how to use it: Facebook, democracy, and human rights in myanmar. The International Journal of Press/Politics , 25(3):407-425, 2020.
  143. [WWL + 22] Chuhan Wu, Fangzhao Wu, Lingjuan Lyu, Yongfeng Huang, and Xing Xie. Communication-efficient federated learning via knowledge distillation. Nature communications , 13(1):1-8, 2022.
  144. [Xu18] Yizhou Xu. Programmatic dreams: Technographic inquiry into censorship of chinese chatbots. Social Media+ Society , 4(4):2056305118808780, 2018.
  145. [YAE + 18] Timothy Yang, Galen Andrew, Hubert Eichner, Haicheng Sun, Wei Li, Nicholas Kong, Daniel Ramage, and Fran¸ coise Beaufays. Applied federated learning: Improving google keyboard query suggestions. CoRR , abs/1812.02903, 2018. · arXiv
  146. [YNB + 21] Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin A. Inan, Gautam Kamath, Janardhan Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, and Huishuai Zhang. Differentially private fine-tuning of language models. CoRR , abs/2110.06500, 2021. · arXiv
  147. [ZBH + 17] Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. Understanding deep learning requires rethinking generalization. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings . OpenReview.net, 2017.
  148. [ZBH + 21] Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. Understanding deep learning (still) requires rethinking generalization. Commun. ACM , 64(3):107-115, 2021.
  149. [ZKV + 19] Jingzhao Zhang, Sai Praneeth Karimireddy, Andreas Veit, Seungyeon Kim, Sashank J. Reddi, Sanjiv Kumar, and Suvrit Sra. Why ADAM beats SGD for attention models. CoRR , abs/1912.03194, 2019. · arXiv
  150. [ZSW + 19] Daniel M. Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B. Brown, Alec Radford, Dario Amodei, Paul F. Christiano, and Geoffrey Irving. Fine-tuning language models from human preferences. CoRR , abs/1909.08593, 2019. · arXiv
  151. [ZWK + 21] Tianyi Zhang, Felix Wu, Arzoo Katiyar, Kilian Q. Weinberger, and Yoav Artzi. Revisiting few-sample BERT fine-tuning. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021.
  152. [ZWLB20] Yian Zhang, Alex Warstadt, Haau-Sing Li, and Samuel R. Bowman. When do you need billions of words of pretraining data? CoRR , abs/2011.04946, 2020. · arXiv
  153. [ZXLZ15] Tianqing Zhu, Ping Xiong, Gang Li, and Wanlei Zhou. Correlated differential privacy: Hiding information in non-iid data set. IEEE Trans. Inf. Forensics Secur. , 10(2):229-242, 2015.
  154. [ZYST19] Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. Deep learning based recommender system: A survey and new perspectives. ACM Comput. Surv. , 52(1):5:1-5:38, 2019.
  155. [ZZBZ20] Yang Zou, Zhikun Zhang, Michael Backes, and Yang Zhang. Privacy analysis of deep learning in the wild: Membership inference attacks against transfer learning. CoRR , abs/2009.04872, 2020. · arXiv

Cited by

Sorted by citations

See all 11

Metadata

Authors
El-Mhamdi, E.-M., Farhadkhani, S., Guerraoui, R., Gupta, N., Hoang, L.-N., Pinot, R., Rouault, S., & Stephan, J.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2209.15259
arXiv
2209.15259
OpenAlex
W4300978714
Cited by
11
References
0
Citations by year
2025: 7 · 2024: 1 · 2023: 2 · 2022: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • HAL (submittedVersion, public-domain)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Keywords
large language models, AI security, impossibility results, memorization, training data memorization, user-generated data, sensitive data, data heterogeneity, security guarantees

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: On the Impossible Safety of Large AI Models. https://app.cochat.ai/papers/10.48550/arxiv.2209.15259
The paper
El-Mhamdi, E.-M., Farhadkhani, S., Guerraoui, R., Gupta, N., Hoang, L.-N., Pinot, R., Rouault, S., & Stephan, J. (2022). On the Impossible Safety of Large AI Models. arXiv. https://doi.org/10.48550/arxiv.2209.15259