CoChat
Sign Up
PreprintCited by 10Privacy-Preserving Technologies in DataEthics and Social Impacts of AIPrivacy, Security, and Data Protection

You Are What You Write: Preserving Privacy in the Era of Large Language Models

Open access
Plant, Richard, Giuffrida, Valerio, Gkatzia, Dimitra·2022·arXiv
DOI 10.48550/arxiv.2204.09391arXiv 2204.09391
Open this paper in CoChat — free accountOpen PDF

Abstract

Large scale adoption of large language models has introduced a new era of convenient knowledge transfer for a slew of natural language processing tasks. However, these models also run the risk of undermining user trust by exposing unwanted information about the data subjects, which may be extracted by a malicious party, e.g. through adversarial attacks. We present an empirical investigation into the extent of the personal information encoded into pre-trained representations by a range of popular models, and we show a positive correlation between the complexity of a model, the amount of data used in pre-training, and data leakage. In this paper, we present the first wide coverage evaluation and comparison of some of the most popular privacy-preserving algorithms, on a large, multi-lingual dataset on sentiment analysis annotated with demographic information (location, age and gender). The results show since larger and more complex models are more prone to leaking private information, use of privacy-preserving methods is highly desirable. We also find that highly privacy-preserving technologies like differential privacy (DP) can have serious model utility effects, which can be ameliorated using hybrid or metric-DP techniques.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2204.09391

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Privacy and data protection are major concerns as LLMs become more complex and larger, especially if trained on private data and publicly available.

    “Privacy and data protection are also major concerns as LLMs become more complex and larger in size, especially if the models are trained on private data and are publicly available (Plant et al. 2022 ).”

    From A review of LLMs and their applications in the architecture, engineering and construction industry (2025) · cites this paper as Plant et al. 2022

    The Introduction (pp. 1–2) identifies privacy risks from LLMs, and the Conclusion (p. 32) reports that more complex models trained on more data were more prone to leaking private information. The paper discusses risks involving personal training data, but the cited passages do not establish the claim’s specific qualifier that the concern is especially acute when the models themselves are publicly available. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 103

  1. Abdaoui, Amine, Camille Pradel, and Grégoire Sigel. 2020. Load What You BERT. In Proceedings of SustaiNLP: Workshop on Simple and Efficient Natural Language Processing , pages 119-123, Association for Computational
  2. Need: Smaller Versions of Mutililingual Linguistics, Online. Aho, Brett and Roberta Duffield. 2020. Beyond surveillance capitalism: Privacy, regulation and big data in Europe and China. Economy and Society , 49(2):187-212. Publisher: Routledge \_eprint: https://doi.org/10.1080/03085147.2019.1690275. Aletras, Nikolaos and Benjamin Paul Chamberlain. 2018. Predicting Twitter User Socioeconomic Attributes with Network and Language Information. In Proceedings of the 29th on Hypertext and Social Media , HT '18, pages 20-24, Association for Computing Machinery, New York, NY, USA. Alnasser, Walaa, Ghazaleh Beigi, and Huan Liu. 2021. Privacy Preserving Text Representation Learning Using BERT. In Social, Cultural, and Behavioral Modeling , Lecture Notes in Computer Science, pages 91-100, Springer International Publishing, Cham. Anwar, Mohd. 2021. Supporting Privacy, Trust, and Personalization in Online Learning. International Journal of Artificial Intelligence in Education , 31(4):769-783. Bartunov, Sergey, Anton Korshunov, Seung-taek Park, Wonho Ryu, and Hyungdong Lee. 2012. Joint Link-Attribute User Identity Resolution in Online Social Networks Categories and Subject Descriptors. In The Sixth SNA-KDD Workshop Proceedings , volume 12. Baudry, Maximilien and Christian Y. Robert. 2019. A machine learning approach for individual claims reserving in insurance. Applied Stochastic Models in Business and Industry , 35(5):1127-1155. \_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/asmb.2455. Beigi, Ghazaleh, Kai Shu, Ruocheng Guo, Suhang Wang, and Huan Liu. 2019. Privacy preserving text representation learning. In HT 2019 - Proceedings of the 30th ACM Conference on Hypertext and Social Media , pages 275-276. ArXiv: 1907.03189. Belz, Anya. 2021. Quantifying Reproducibility in NLP and ML. arXiv:2109.01211 [cs] . ArXiv: 2109.01211. · DOI
  3. Bender, Emily M. and Batya Friedman. 2018. Data Statements for Natural Language Processing: Toward Mitigating System Bias and Enabling Better Science. Transactions of the Association for Computational Linguistics , 6:587-604. Benjamin, Martin. 2018. Hard Numbers: Language Exclusion in Computational Linguistics and Natural Language Processing. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) , page 6, European Language Resources Association (ELRA), Paris, France. Biryukov, Alex, Dmitry Khovratovich, and Ivan Pustogarov. 2014. Deanonymisation of clients in bitcoin P2P network. In Proceedings of the ACM Conference on Computer and Communications Security , pages 15-29, Association for Computing Machinery. ArXiv: 1405.7418 ISSN: 15437221. Brickell, Justin and Vitaly Shmatikov. 2008. The cost of privacy: destruction of data-mining utility in anonymized data publishing. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining ,KDD '08, pages 70-78, Association for Computing Machinery, New York, NY, USA. Brown, Tom, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems , volume 33, pages 1877-1901, Curran Associates, Inc. Callanan, Cormac, Borka Jerman-Blažiˇ c, and Andrej Jerman Blažiˇ c. 2016. User tolerance of privacy abuse on mobile Internet and the country level of development. Information Development , 32(3):728-750. Publisher: SAGE Publications Ltd. · arXiv
  4. Carlini, Nicholas, Chang Liu, Úlfar Erlingsson, Jernej Kos, and Dawn Song. 2019. The secret Sharer: Evaluating and testing unintended memorization in neural networks. In Proceedings of the 28th USENIX Security Symposium , pages
  5. 267-284, USENIX Association. ArXiv: 1802.08232. Carvalho, Ricardo Silva, Theodore Vasiloudis, and Oluwaseyi Feyisetan. 2021. TEM: High Utility Metric Differential Privacy on Text. In arXiv:2107.07928 [cs] . ArXiv: 2107.07928. Central Intelligence Agency. 2021. Median age - The World Factbook. Chan, Branden, Stefan Schweter, and Timo Möller. 2020. German's Next Language Model. In Proceedings of the 28th International Conference on Computational Linguistics , pages 6788-6796, International Committee on Computational Linguistics, Barcelona, Spain (Online). Chatzikokolakis, Konstantinos, Miguel E Andrés, Nicolás E Bordenabe, and Catuscia Palamidessi. 2013. Broadening the Scope of Differential Privacy Using Metrics. In PETS 2013: Privacy Enhancing Technologies , volume 7981 of Lecture Notes in Computer Science , Springer. Chatzikokolakis, Konstantinos, Catuscia Palamidessi, and Marco Stronati. 2015. Constructing elastic distinguishability metrics for location privacy. Proceedings on Privacy Enhancing Technologies , 2015(2):156-170. Publisher: Sciendo Section: Proceedings on Privacy Enhancing Technologies. Coavoux, Maximin, Shashi Narayan, and Shay B. Cohen. 2018. Privacy-preserving Neural Representations of Text. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , pages 1-10, Association for Computational Linguistics, Brussels, Belgium. Colleoni, Elanor, Alessandro Rozza, and Adam Arvidsson. 2014. Echo Chamber or Public Sphere? Predicting Political Orientation and Measuring Political Homophily in Twitter Using Big Data. Journal of Communication , 64(2):317-332. Cormode, Graham, Somesh Jha, Tejas Kulkarni, Ninghui Li, Divesh Srivastava, and Tianhao Wang. 2018. Privacy at scale: Local differential privacy in practice. In Proceedings of the ACM SIGMOD International Conference on Management of Data , pages 1655-1658, Association for Computing Machinery, New York, New York, USA. ISSN: 07308078. · arXiv
  6. Free versus bound morphemes. Cross-linguistic Influence in Bilingualism , pages 101-126. Publisher: John Benjamins. Cummings, Rachel and Deven Desai. 2018. The Role of Differential Privacy in GDPR Compliance. In Proceedings of Workshop on Responsible Recommendation (FATREC'18) , page 2, ACM, New York, NY, USA. Daries, Jon P., Justin Reich, Jim Waldo, Elise M. Young, Jonathan Whittinghill, Andrew Dean Ho, Daniel Thomas Seaton, and Isaac Chuang. 2014. Privacy, anonymity, and big data in the social sciences. Communications of the ACM , 57(9):56-63. Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , pages 4171-4186, Association for Computational Linguistics, Minneapolis, Minnesota. Dhingra, Bhuwan, Christopher J. Shallue, Mohammad Norouzi, Andrew M. Dai, and George E. Dahl. 2018. Embedding text in hyperbolic spaces. In NAACL HLT 2018 - 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Proceedings of the Student Research Workshop , pages 59-69, Association for Computational Linguistics (ACL). ArXiv: 1806.04313. Doi, Shohei, Takayuki Mizuno, and Naoya Fujiwara. 2020. Estimation of socioeconomic attributes from location information. Journal of Computational Social Science . Publisher: Springer Science and Business Media LLC. Dwork, Cynthia, Frank McSherry, Kobbi Nissim, and Adam Smith. 2006. Calibrating noise to sensitivity in private data analysis. In Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) , volume 3876 LNCS, pages 265-284. Dwork, Cynthia and Aaron Roth. 2013. The algorithmic foundations of differential privacy. Foundations and Trends in Theoretical Computer Science , 9(3-4):211-487. Publisher: Now Publishers Inc. · arXiv
  7. Elazar, Yanai and Yoav Goldberg. 2018. Adversarial Removal of Demographic Attributes from Text Data. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , pages 11-21, Association for Computational Linguistics, Brussels, Belgium. ArXiv: 1808.06640. · arXiv
  8. Emmery, Chris, Ákos Kádár, and Grzegorz Chrupała. 2021. Adversarial Stylometry in the Wild: Transferable Lexical Substitution Attacks on Author Profiling. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume , pages 2388-2402, Association for Computational Linguistics, Online.
  9. Erlingsson, Ulfar, Vasyl Pihur, and Aleksandra Korolova. 2014. RAPPOR: Randomized aggregatable privacy-preserving ordinal response. In Proceedings of the ACM Conference on Computer and Communications Security , pages 1054-1067. ArXiv: 1407.6981 ISSN: 15437221. · arXiv
  10. Fernandes, Natasha, Mark Dras, and Annabelle McIver. 2019. Generalised Differential Privacy for Text Document Processing. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , volume 11426 LNCS, pages 123-148, Springer Verlag. ArXiv: 1811.10256 ISSN: 16113349. · arXiv
  11. Feyisetan, Oluwaseyi, Borja Balle, Thomas Drake, and Tom Diethe. 2020. PrivacyAnd utility-preserving textual analysis via calibrated multivariate perturbations. In WSDM2020 - Proceedings of the 13th International Conference on Web Search and Data Mining , pages 178-186, Association for Computing Machinery, Inc. ArXiv: 1910.08902. · arXiv
  12. Feyisetan, Oluwaseyi, Tom Diethe, and Thomas Drake. 2019. Leveraging Hierarchical Representations for Preserving Privacy and Utility in Text. In Proceedings - IEEE International Conference on Data Mining, ICDM , pages 210-219, IEEE Computer Society.
  13. Fietkiewicz, Kaja J., Elmar Lins, and Adheesh Budree. 2018. Investigating the Generation- and Gender-Dependent Differences in Social Media Use: A Cross-Cultural Study in Germany, Poland and South Africa. In Social Computing and Social Media. Technologies and Analytics , Lecture Notes in Computer Science, pages 183-200, Springer International Publishing, Cham.
  14. Frankowski, Dan, Dan Cosley, Shilad Sen, Loren Terveen, and John Riedl. 2006. You are what you say: privacy risks of public mentions. In Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval , SIGIR '06, pages 565-572, Association for Computing Machinery, New York, NY, USA.
  15. Fredrikson, Matt, Somesh Jha, and Thomas Ristenpart. 2015. Model inversion attacks that exploit confidence information and basic countermeasures. In Proceedings of the ACM Conference on Computer and Communications Security , volume for Computing Machinery, New York,
  16. 2015-Octob, pages 1322-1333, Association New York, USA. ISSN: 15437221.
  17. Ajakan, Pascal Germain, Hugo Larochelle, Victor Lempitsky. 2016. Domain-adversarial training of neural networks. The Journal of Machine Learning Research , 17(1):2096-2030.
  18. Goga, Oana, Howard Lei, Sree Hari Krishnan Parthasarathi, Gerald Friedland, Robin Sommer, and Renata Teixeira. 2013. Exploiting innocuous activity for correlating users across sites. In WWW 2013 - Proceedings of the 22nd International Conference on World Wide Web , pages 447-457.
  19. Gordon, Jeremy, David Rawlinson, and Subutai Ahmad. 2020. Long Distance Relationships Without Time Travel: Boosting the Performance of a Sparse Predictive Autoencoder in Sequence Modeling. In Artificial Neural Networks in Pattern Recognition , Lecture Notes in Computer Science, pages 52-64, Springer International Publishing, Cham.
  20. Guo, Hao, Brian Dolhansky, Eric Hsin, Phong Dinh, Song Wang, and Cristian Canton Ferrer. 2019. Deep Poisoning Functions: Towards Robust Privacy-safe Image Data Sharing. arXiv preprint . ArXiv: 1912.06895. · arXiv
  21. Horvitz, Eric and Deirdre Mulligan. 2015. Data, privacy, and the greater good. Science , 349(6245):253-255. Publisher: American Association for the Advancement of Science.
  22. Hovy, Dirk, Anders Johannsen, and Anders Søgaard. 2015. User Review Sites as a Resource for Large-Scale Sociolinguistic Studies. In WWW'15: Proceedings of the 24th International Conference on World Wide Web , pages 452-461.
  23. Iliev, Georgi and Angel Genov. 2012. Expanding Parallel Resources for Medium-Density Languages for Free. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) , page 7, Istanbul, Turkey.
  24. Iyyer, Mohit, Peter Enns, Jordan Boyd-Graber, and Philip Resnik. 2014. Political Ideology Detection Using Recursive Neural Networks. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages 1113-1122, Association for Computational Linguistics, Baltimore, Maryland.
  25. Jaiswal, Mimansa and Emily Mower Provost. 2020. Privacy Enhanced Multimodal Neural Representations for Emotion Recognition. Proceedings of the AAAI Conference on Artificial Intelligence , 34(05):7985-7993. Number: 05.
  26. Jawurek, Marek, Martin Johns, and Konrad Rieck. 2011. Smart Metering De-Pseudonymization. In Proceedings of the 27th Annual Computer Security Applications Conference on - ACSAC '11 , ACMPress, New York, New York, USA.
  27. Jorgensen, Z., T. Yu, and G. Cormode. 2015. Conservative or liberal? Personalized differential privacy. In 2015 IEEE 31st International Conference on Data Engineering , pages 1023-1034. ISSN: 2375-026X.
  28. Joshi, Pratik, Sebastin Santy, Amar Budhiraja, Kalika Bali, and Monojit Choudhury. 2020. The state and fate of linguistic diversity and inclusion in the NLP world. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , Association for Computational Linguistics. ArXiv: 2004.09095 Publication Title: arXiv. · arXiv
  29. Kairouz, Peter, Keith Bonawitz, and Daniel Ramage. 2016. Discrete distribution estimation under local privacy. In 33rd International Conference on Machine Learning, ICML 2016 , volume 5, pages 3607-3633. ArXiv: 1602.07387. · arXiv
  30. Kaneko, Masahiro and Danushka Bollegala. 2019. Gender-preserving Debiasing for Pre-trained Word Embeddings. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , pages 1641-1650, Association for Computational Linguistics, Florence, Italy.
  31. Kokovidis, Alexandra. 2015. Gendered discourse in German chatroom conversations: the use of modal particles by young adults . Ph.D. thesis, Boston University, Boston, MA. Accepted: 2016-01-13T18:28:31Z.
  32. Komninos, Alexandros and Suresh Manandhar. 2016. Dependency Based Embeddings for Sentence Classification Tasks. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , pages 1490-1500, Association for Computational Linguistics, San Diego, California.
  33. Kozyreva, Anastasia, Philipp Lorenz-Spreen, Ralph Hertwig, Stephan Lewandowsky, and Stefan M. Herzog. 2021. Public attitudes towards algorithmic personalization and use of personal data online: evidence from Germany, Great Britain, and the United States. Humanities and Social Sciences Communications , 8(1):1-11.
  34. Krasnova, Hanna and Natasha F. Veltri. 2010. Privacy Calculus on Social Networking Sites: Explorative Evidence from Germany and USA. In 2010 43rd Hawaii International Conference on System Sciences , pages 1-10. ISSN: 1530-1605.
  35. Kröger, Jacob Leon and Philip Raschke. 2019. Is My Phone Listening in? On the Feasibility and Detectability of Mobile Eavesdropping. In Data and Applications Security and Privacy XXXIII , Lecture Notes in Computer Science, pages 102-120, Springer International Publishing, Cham.
  36. Kuner, Christopher, Dan Jerker B Svantesson, Fred H Cate, Orla Lynskey, and Christopher Millard. 2017. Machine learning with personal data: Is data protection law smart enough to meet the challenge? International Data Privacy Law , 7(1):1-2.
  37. Le, Hang, Loïc Vial, Jibril Frej, Vincent Segonne, Maximin Coavoux, Benjamin Lecouteux, Alexandre Allauzen, Benoit Crabbé, Laurent Besacier, and Didier Schwab. 2020. FlauBERT: Unsupervised Language Model Pre-training for French. In Proceedings of the 12th Language Resources and Evaluation Conference , pages 2479-2490, European Language Resources Association, Marseille, France.
  38. Leino, Klas and Matt Fredrikson. 2020. Stolen memories: Leveraging model memorization for calibrated white-box membership inference. In Proceedings of the 29th USENIX Security Symposium , pages 1605-1622, USENIX Association. ArXiv: 1906.11798. · arXiv
  39. Lewis, Mike, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics .
  40. Li, Haoqi, Ming Tu, Jing Huang, Shrikanth Narayanan, and Panayiotis Georgiou. 2020a. Speaker-Invariant Affective Representation Learning via Adversarial Training. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages 7144-7148. ISSN: 2379-190X.
  41. Li, Ruizhe, Xiao Li, Guanyi Chen, and Chenghua Lin. 2020b. Improving Variational Autoencoder for Text Modelling with Timestep-Wise Regularisation. In Proceedings of the 28th International Conference on Computational Linguistics , pages 2381-2397, International Committee on Computational Linguistics, Barcelona, Spain (Online).
  42. Li, Tiancheng and Ninghui Li. 2009. On the tradeoff between privacy and utility in data publishing. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , pages 517-525. Li, Yitong, Timothy Baldwin, and Trevor Cohn. 2018. Towards robust and privacy-preserving text representations. In ACL 2018 - 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers) , volume 2, pages 25-30, Association for Computational Linguistics (ACL). ArXiv: 1805.06093. · arXiv
  43. Liu, Yinhan, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv:1907.11692 [cs] . ArXiv: 1907.11692. · arXiv
  44. Lohndal, Terje and Marit Westergaard. 2021. Grammatical Gender: Acquisition, Attrition, and Change. Journal of Germanic Linguistics , 33(1):95-121. Publisher: Cambridge University Press.
  45. Lyu, Lingjuan, Xuanli He, and Yitong Li. 2020. Differentially Private Representation for NLP: Formal Guarantee and An Empirical Study on Privacy and Fairness. In Findings of the Association for Computational Linguistics: EMNLP 2020 , pages 2355-2365. ArXiv: 2010.01285. · arXiv
  46. Maaten, Laurens van der and Geoffrey Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research , 9(86):2579-2605.
  47. Madras, David, Elliot Creager, Toniann Pitassi, and Richard Zemel. 2018. Learning Adversarially Fair and Transferable Representations. In Proceedings of the 35th International Conference on Machine Learning , volume 80 of Proceedings of Machine Learning Research , pages 3384-3393, PMLR. ArXiv: 1802.06309. · arXiv
  48. Mahawaga Arachchige, Pathum Chamikara, Peter Bertok, Ibrahim Khalil, Dongxi Liu, Seyit Camtepe, and Mohammed Atiquzzaman. 2020. Local Differential Privacy for Deep Learning. IEEE Internet of Things Journal , 7(7):5827-5842. ArXiv: 1908.02997. · arXiv
  49. Martin, Louis, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric de la Clergerie, Djamé Seddah, and Benoît Sagot. 2020. CamemBERT: a Tasty French Language Model. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pages 7203-7219, Association for Computational Linguistics, Online. Mazarura, Jocelyn, Alta de Waal, and Pieter de Villiers. 2019. Semantic representations for under-resourced languages. In Proceedings of the South African Institute of Computer Scientists and Information Technologists 2019 , SAICSIT '19, pages 1-10, Association for Computing Machinery, New York, NY, USA.
  50. Minssen, Timo, Sara Gerke, Mateo Aboy, Nicholson Price, and Glenn Cohen. 2020. Regulatory responses to medical machine learning. Journal of Law and the Biosciences , 7(1):lsaa002.
  51. Narayanan, Arvind and Vitaly Shmatikov. 2006. How To Break Anonymity of the Netflix Prize Dataset. arXiv . ArXiv: cs/0610105. · arXiv
  52. Narayanan, Arvind and Vitaly Shmatikov. 2008. Robust de-anonymization of large sparse datasets. In Proceedings - IEEE Symposium on Security and Privacy , pages 111-125. ISSN: 10816011.
  53. Narayanan, Arvind and Vitaly Shmatikov. 2009. De-anonymizing social networks. In Proceedings - IEEE Symposium on Security and Privacy , pages 173-187. ArXiv: 0903.3276 ISSN: 10816011. · arXiv
  54. Nekoto, Wilhelmina, Vukosi Marivate, Tshinondiwa Matsila, Timi Fasubaa, Tajudeen Kolawole, Taiwo Fagbohungbe, Solomon Oluwole Akinola, Shamsuddeen Hassan Muhammad, Salomon Kabongo, Salomey Osei, Sackey Freshia, Rubungo Andre Niyongabo, Ricky Macharm, Perez Ogayo, Orevaoghene Ahia, Musie Meressa, Mofe Adeyemi, Masabata Mokgesi-Selinga, Lawrence Okegbemi, Laura Jane Martinus, Kolawole Tajudeen, Kevin Degila, Kelechi Ogueji, Kathleen Siminyu, Julia Kreutzer, Jason Webster, Jamiil Toure Ali, Jade Abbott, Iroro Orife, Ignatius Ezeani, Idris Abdulkabir Dangana, Herman Kamper, Hady Elsahar, Goodness Duru, Ghollah Kioko, Espoir Murhabazi, Elan van Biljon, Daniel Whitenack, Christopher Onyefuluchi, Chris Emezue, Bonaventure Dossou, Blessing Sibanda, Blessing Itoro Bassey, Ayodele Olabiyi, Arshath Ramkilowan, Alp Öktem, Adewale Akinfaderin, and Abdallah Bashir. 2020. Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages. arXiv:2010.02353 [cs] . ArXiv: 2010.02353. Ortiz Suárez, Pedro Javier, Laurent Romary, and Benoît Sagot. 2020. A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pages 1703-1714, Association for Computational Linguistics, Online. · arXiv
  55. Ortiz Suárez, Pedro Javier, Benoît Sagot, and Laurent Romary. 2019. Asynchronous pipelines for processing huge corpora on medium to low resource infrastructures. In Proceedings of the Workshop on Challenges in the Management of Large Corpora 2019 , Proceedings of the workshop on challenges in the management of large corpora (CMLC-7) 2019. Cardiff, 22nd july 2019, pages 9 - 16, Leibniz-Institut für Deutsche Sprache, Mannheim.
  56. Paruchuri, Harish. 2020. The Impact of Machine Learning on the Future of Insurance Industry. American Journal of Trade and Policy , 7(3):85-90. Number: 3.
  57. Paullada, Amandalynne, Inioluwa Deborah Raji, Emily M. Bender, Emily Denton, and Alex Hanna. 2021. Data and its (dis)contents: A survey of dataset development and use in machine learning research. Patterns , 2(11):100336.
  58. Pennington, Jeffrey, Richard Socher, and Christopher Manning. 2014. Glove: Global Vectors for Word Representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) , pages 1532-1543, Association for Computational Linguistics, Stroudsburg, PA, USA.
  59. Peters, Matthew E., Sebastian Ruder, and Noah A. Smith. 2019. To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks. In Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019) , pages 7-14, Association for Computational Linguistics, Florence, Italy.
  60. Petroni, Fabio, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller. 2019. Language Models as Knowledge Bases? In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , pages 2463-2473, Association for Computational Linguistics, Hong Kong, China.
  61. Pfitzmann, Andreas and Marit Kohntopp. 2001. Anonymity, unobservability, and pseudonymity - A proposal for terminology. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , volume 2009, pages 1-9, Springer Verlag. ISSN: 16113349.
  62. Phan, Nhat Hai, My T. Thai, Ruoming Jin, Han Hu, and Dejing Dou. 2019. Scalable Differential Privacy with Certified Robustness in Adversarial Learning. In Proceedings of the 37th International Conference on Machine Learning , volume 119, pages 7683-7694, PMLR. Publication Title: arXiv.
  63. Pires, Telmo, Eva Schlinger, and Dan Garrette. 2019. How Multilingual is Multilingual BERT? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , pages 4996-5001, Association for Computational Linguistics, Florence, Italy.
  64. Plant, Richard, Dimitra Gkatzia, and Valerio Giuffrida. 2021. CAPE: Context-Aware Private Embeddings for Private Language Learning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pages 7970-7978, Association for Computational Linguistics, Online and Punta Cana, Dominican Republic.
  65. Soriente. 2019. There goes Wally: Anonymously sharing your location gives you away. In Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018 , pages 1218-1227, Institute of Electrical and Electronics Engineers Inc. ArXiv: 1806.02701. · arXiv
  66. Pˇ ribá ˇ n, Pavel and Josef Steinberger. 2021. Are the Multilingual Models Better? Improving Czech Sentiment with Transformers. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021) , pages 1138-1149, INCOMA Ltd., Held Online.
  67. Qi, Ye, Devendra Sachan, Matthieu Felix, Sarguna Padmanabhan, and Graham Neubig. 2018. When and Why Are Pre-Trained Word Embeddings Useful for Neural Machine Translation? In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) , pages 529-535, Association for Computational Linguistics, New Orleans, Louisiana.
  68. Qiu, XiPeng, TianXiang Sun, YiGe Xu, YunFan Shao, Ning Dai, and XuanJing Huang. 2020. Pre-trained models for natural language processing: A survey. Science China Technological Sciences , 63(10):1872-1897.
  69. Pomfret, Liam, Josephine Previte, and Len Coote. 2020. Beyond concern: socio-demographic and attitudinal influences on privacy and disclosure choices. Journal of Marketing Management , 36(5-6):519-549. Publisher: Routledge \_eprint:
  70. Rao, Josyula, Josyula Rao, and Pankaj Rohatgi. 2000. Can Pseudonymity Really Guarantee Privacy? IN PROCEEDINGS OF THE NINTH USENIX SECURITY SYMPOSIUM , pages 85-96. https://doi.org/10.1080/0267257X.2020.1715465. Pontes, Tatiana, Gabriel Magno, Marisa Vasconcelos, Aditi Gupta, Jussara Almeida, Ponnurangam Kumaraguru, and Virgilio Almeida. 2012. Beware of what you share: Inferring home location in social networks. In Proceedings - 12th IEEE International Conference on Data Mining Workshops, ICDMW 2012 , pages 571-578. · DOI
  71. Prabhumoye, Shrimai, Brendon Boldt, Ruslan Salakhutdinov, and Alan W Black. 2021. Case Study: Deontological Ethics in NLP. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , pages 3784-3798, Association for Computational Linguistics, Online.
  72. Pyrgelis, Apostolos, Nicolas Kourtellis, Ilias Leontiadis, Joan Serrà, and Claudio Rastogi, Vibhor, Dan Suciu, and Sungho Hong. 2007. The boundary between privacy and utility in data publishing. In 33rd International Conference on Very Large Data Bases, VLDB 2007 - Conference Proceedings , pages 531-542. ArXiv: cs/0612103. · arXiv
  73. Reimers, Nils and Iryna Gurevych. 2020. Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , pages 4512-4525, Association for Computational Linguistics, Online.
  74. Rodina, Yulia and Marit Westergaard. 2015. Grammatical Gender in Norwegian: Language Acquisition and Language Change. Journal of Germanic Linguistics , 27(2):145-187. Publisher: Cambridge University Press.
  75. Rose, Tony G. 1997. The Effects of Corpus Size and Homogeneity on Language Model Quality. In Fifth Workshop on Very Large Corpora .
  76. Roy, Riya and K. Thomas George. 2017. Detecting insurance claims fraud using machine learning techniques. In 2017 International Conference on Circuit ,Power and Computing Technologies (ICCPCT) , pages 1-6.
  77. Rust, Phillip, Jonas Pfeiffer, Ivan Vuli´ c, Sebastian Ruder, and Iryna Gurevych. 2021. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , pages 3118-3135, Association for Computational Linguistics, Online.
  78. Rönnqvist, Samuel, Jenna Kanerva, Tapio Salakoski, and Filip Ginter. 2019. Is Multilingual BERT Fluent in Language Generation? In Proceedings of the First NLPL Workshop on Deep Learning for Natural Language Processing , pages 29-36, Linköping University Electronic Press, Turku, Finland.
  79. Sasano, Ryohei, Daisuke Kawahara, and Sadao Kurohashi. 2009. The Effect of Corpus Size on Case Frame Acquisition for Discourse Analysis. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics , pages 521-529, Association for Computational Linguistics, Boulder, Colorado.
  80. Shadbolt, Nigel, Kieron O'Hara, David De Roure, and Wendy Hall. 2019. Privacy, Trust and Ethical Issues. In Nigel Shadbolt, Kieron O'Hara, David De Roure, and Wendy Hall, editors, The Theory and Practice of Social Machines , Lecture Notes in Social Networks. Springer International Publishing, Cham, pages 149-200. Shankar, Shiv, Vihari Piratla, Soumen Chakrabarti, Siddhartha Chaudhuri, Preethi Jyothi, and Sunita Sarawagi. 2018.
  81. Generalizing Across Domains via Cross-Gradient Training. arXiv:1804.10745 [cs, stat] . ArXiv: 1804.10745. · arXiv
  82. Shokri, Reza and Vitaly Shmatikov. 2015. Privacy-preserving deep learning. In Proceedings of the ACM Conference on Computer and Communications Security , volume 2015-Octob, pages 1310-1321. ISSN: 15437221.
  83. Shokri, Reza, Marco Stronati, Congzheng Song, and Vitaly Shmatikov. 2017. Membership Inference Attacks Against Machine Learning Models. In Proceedings IEEE Symposium on Security and Privacy , pages 3-18, Institute of Electrical and Electronics Engineers Inc. ArXiv: 1610.05820 ISSN: 10816011. · arXiv
  84. Song, Congzheng and Ananth Raghunathan. 2020. Information Leakage in Embedding Models. In Proceedings of the ACM Conference on Computer and Communications Security , pages 377-390. ArXiv: 2004.00053 ISSN: 15437221. · arXiv
  85. Song, Congzheng, Thomas Ristenpart, and Vitaly Shmatikov. 2017. Machine learning models that remember too much. In Proceedings of the ACM Conference on Computer and Communications Security , pages 587-601. ArXiv: 1709.07886 ISSN: 15437221. · arXiv
  86. Stahlberg, Dagmar, Friederike Braun, Lisa Irmen, and Sabine Sczesny. 2007. Representation of the Sexes in Language. In Klaus Fiedler, editor, Social Communication . Psychology Press. Num Pages: 25.
  87. Sun, Xiaoxun, Hua Wang, and Yanchun Zhang. 2012. On the identity anonymization of high-dimensional rating data. In Concurrency Computation Practice and Experience , volume 24, pages 1108-1122, John Wiley & Sons, Ltd. Issue: 10 ISSN: 15320626.
  88. Søgaard, Anders, Sebastian Ebert, Jasmijn Bastings, and Katja Filippova. 2021. We Need to Talk About Random Splits. arXiv:2005.00636 [cs] . ArXiv: 2005.00636. · arXiv
  89. Truex, Stacey, Ling Liu, Mehmet Emre Gursoy, Lei Yu, and Wenqi Wei. 2019. Demystifying Membership Inference Attacks in Machine Learning as a Service. IEEE Transactions on Services Computing . ArXiv: 1807.09173. · arXiv
  90. Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems , NIPS'17, Curran Associates Inc., Long Beach, California, USA. Pages: 6000-6010.
  91. Virtanen, Antti, Jenna Kanerva, Rami Ilo, Jouni Luoma, Juhani Luotolahti, Tapio Salakoski, Filip Ginter, and Sampo Pyysalo. 2019. Multilingual is not enough: BERT for Finnish. arXiv:1912.07076 [cs] . ArXiv: 1912.07076. · arXiv
  92. Wang, Ximei, Liang Li, Weirui Ye, Mingsheng Long, and Jianmin Wang. 2019. Transferable Attention for Domain Adaptation. Proceedings of the AAAI Conference on Artificial Intelligence , 33(01):5345-5352. Number: 01.
  93. Wang, Yue, Xintao Wu, and Donghui Hu. 2016. Using randomized response for differential privacy preserving data collection. In CEUR Workshop Proceedings , volume 1558. ISSN: 16130073.
  94. Woller, Lisa, Viktor Hangya, and Alexander Fraser. 2021. Do not neglect related languages: The case of low-resource Occitan cross-lingual word embeddings. In Proceedings of the 1st Workshop on Multilingual Representation Learning , pages 41-50, Association for Computational Linguistics, Punta Cana, Dominican Republic.
  95. Xu, Qiongkai, Lizhen Qu, Chenchen Xu, and Ran Cui. 2019. Privacy-aware text rewriting. In INLG 2019 - 12th International Conference on Natural Language Generation, Proceedings of the Conference , pages 247-257, Association for Computational Linguistics (ACL).
  96. Xu, Yabo, Ke Wang, Ada Wai Chee Fu, and Philip S. Yu. 2008. Anonymizing transaction databases for publication. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , pages 767-775, ACMPress, New York, New York, USA.
  97. Xu, Zekun, Abhinav Aggarwal, Oluwaseyi Feyisetan, and Nathanael Teissier. 2020. A Differentially Private Text Perturbation Method Using Regularized Mahalanobis Metric. In Proceedings of the Second Workshop on Privacy in NLP , pages 7-17. ArXiv: 2010.11947. · arXiv
  98. Chris Tar, Yun-hsuan Sung, Brian Strope, and Ray Kurzweil. 2020. Multilingual Universal Sentence Encoder for Semantic Retrieval. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations , pages 87-94, Association for Computational Linguistics, Online.
  99. Zhang, Brian Hu, Blake Lemoine, and Margaret Mitchell. 2018. Mitigating Unwanted Biases with Adversarial Learning. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society , AIES '18, pages 335-340, Association for Computing Machinery, New York, NY, USA.
  100. Zhang, Guanglin, Anqi Zhang, and Ping Zhao. 2020. LocMIA: Membership Inference Attacks against Aggregated Location Data. IEEE Internet of Things Journal , pages 1-1. Publisher: Institute of Electrical and Electronics Engineers (IEEE).
  101. Zhang, Jing, Wanqing Li, Philip Ogunbona, and Dong Xu. 2020. Recent Advances in Transfer Learning for Cross-Dataset Visual Recognition: A Problem-Oriented Perspective. ACMComputing Surveys (CSUR) , 52(1):1-38.
  102. Zhao, Jieyu, Tianlu Wang, Mark Yatskar, Ryan Cotterell, Vicente Ordonez, and Kai-Wei Chang. 2019. Gender Bias in Contextualized Word Embeddings. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , pages 629-634, Association for Computational Linguistics, Minneapolis, Minnesota.
  103. Zhao, Jieyu, Yichao Zhou, Zeyu Li, Wei Wang, and Kai-Wei Chang. 2018. Learning Gender-Neutral Word Embeddings. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , pages 4847-4853, Association for Computational Linguistics, Brussels, Belgium.

Cited by

Sorted by citations

Authors
Plant, R., Giuffrida, V., & Gkatzia, D.
Affiliations
Edinburgh Napier University (GB)
ORCID
Gkatzia, Dimitra
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2204.09391
arXiv
2204.09391
OpenAlex
W4224903276
Cited by
10
References
0
Citations by year
2026: 1 · 2025: 2 · 2024: 7
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by-sa/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
Keywords
large language models, privacy leakage, personal information extraction, pre-trained representations, differential privacy, sentiment analysis, demographic data, model utility, adversarial attacks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review