CoChat
Sign Up
PreprintCited by 60Adversarial Robustness in Machine LearningPrivacy-Preserving Technologies in DataPrivacy, Security, and Data Protection

The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies

Open access
He, Feng, Zhu, Tianqing, Ye, Dayong, Liu, Bo, Zhou, Wanlei, Yu, Philip S.·2024·arXiv
DOI 10.48550/arxiv.2407.19354arXiv 2407.19354

Preprint — published as 10.1145/3773080 · Paper page

Open this paper in CoChat — free account

Abstract

Inspired by the rapid development of Large Language Models (LLMs), LLM agents have evolved to perform complex tasks. LLM agents are now extensively applied across various domains, handling vast amounts of data to interact with humans and execute tasks. The widespread applications of LLM agents demonstrate their significant commercial value; however, they also expose security and privacy vulnerabilities. At the current stage, comprehensive research on the security and privacy of LLM agents is highly needed. This survey aims to provide a comprehensive overview of the newly emerged privacy and security issues faced by LLM agents. We begin by introducing the fundamental knowledge of LLM agents, followed by a categorization and analysis of the threats. We then discuss the impacts of these threats on humans, environment, and other agents. Subsequently, we review existing defensive strategies, and finally explore future trends. Additionally, the survey incorporates diverse case studies to facilitate a more accessible understanding. By highlighting these critical security and privacy issues, the survey seeks to stimulate future research towards enhancing the security and privacy of LLM agents, thereby increasing their reliability and trustworthiness in future applications.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2407.19354

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Safety evaluations are especially critical in fields such as financial services, cybersecurity, and autonomous decision-making, where agent vulnerabilities can lead to severe consequences.

    “These evaluations are especially critical in fields such as financial services, cybersecurity, and autonomous decision-making, where agent vulnerabilities can lead to severe consequences [22, 26, 34, 49].”

    From Evaluation and Benchmarking of LLM Agents: A Survey (2025) · cites this paper as [34]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 117

  1. [7][7] Renat Aksitov, Chung-Ching Chang, David Reitter, Siamak Shakeri, and Yunhsuan Sung. 2023. Characterizing Attribution and Fluency Tradeoffs for Retrieval-Augmented Large Language Models . https://doi.org/10.48550/arXiv.2302.05578 arXiv:2302.05578 - · DOI · Paper page
  2. [9][9] Eugene Bagdasarian, Ren Yi, Sahra Ghalebikesabi, Peter Kairouz, Marco Gruteser, Sewoong Oh, Borja Balle, and Daniel Ramage. 2024. AirGapAgent: Protecting Privacy-Conscious Conversational Agents. In Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security (CCS '24) . Association for Computing Machinery, 3868-3882. https://doi.org/10.1145/3658644.3690350 - · DOI · Paper page
  3. [8][8] Markus Anderljung, Joslyn Barnhart, Anton Korinek, Jade Leung, Cullen O'Keefe, Jess Whittlestone, Shahar Avin, Miles Brundage, Justin Bullock, Duncan Cass-Beggs, Ben Chang, Tantum Collins, Tim Fist, Gillian Hadfield, Alan Hayes, Lewis Ho, Sara Hooker, Eric Horvitz, Noam Kolt, Jonas Schuett, Yonadav Shavit, Divya Siddarth, Robert Trager, and Kevin Wolf. 2023. Frontier AI Regulation: Managing Emerging Risks to Public Safety . https://doi.org/10.48550/arXiv.2307.03718 arXiv:2307.03718 - · DOI · Paper page
  4. [10][10] Nathalie Baracaldo, Bryant Chen, Heiko Ludwig, and Jaehoon Amir Safavi. 2017. Mitigating Poisoning Attacks on Machine Learning Models: A Data Provenance Based Approach. In Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security (AISec '17) . Association for Computing Machinery, New York, NY, USA, 103-110. https://doi.org/10.1145/3128572.3140450 - · DOI · Paper page
  5. [12][12] Nicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, Alina Oprea, and Colin Raffel. 2021. Extracting Training Data from Large Language Models. In 30th USENIX Security Symposium (USENIX Security 21) . 2633-2650. https://www.usenix.org/conference/usenixsecurity21/presentation/carliniextracting -
  6. [11][11] Andres M. Bran, Sam Cox, Oliver Schilter, Carlo Baldassari, Andrew D. White, and Philippe Schwaller. 2023. ChemCrow: Augmenting Large-Language Models with Chemistry Tools . https://doi.org/10.48550/arXiv.2304.05376 arXiv:2304.05376 - · DOI · Paper page
  7. [13][13] P. V. Sai Charan, Hrushikesh Chunduri, P. Mohan Anand, and Sandeep K. Shukla. 2023. From Text to MITRE Techniques: Exploring the Malicious Use of Large Language Models for Generating Cyber Attack Payloads . https://doi.org/10.48550/arXiv.2305.15336 arXiv:2305.15336 - · DOI · Paper page
  8. [15][15] Badhan Chandra Das, M. Hadi Amini, and Yanzhao Wu. 2024. Security and Privacy Challenges of Large Language Models: A Survey . https://doi.org/10.48550/arXiv.2402.00888 arXiv:2402.00888 - · DOI
  9. [16][16] Gelei Deng, Yi Liu, Yuekang Li, Kailong Wang, Ying Zhang, Zefeng Li, Haoyu Wang, Tianwei Zhang, and Yang Liu. 2023. MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots . arXiv:2307.08715 http://arxiv.org/abs/2307.08715 - · arXiv
  10. [18][18] Shehzaad Dhuliawala, Mojtaba Komeili, Jing Xu, Roberta Raileanu, Xian Li, Asli Celikyilmaz, and Jason Weston. 2023. Chain-ofVerification Reduces Hallucination in Large Language Models. arXiv preprint arXiv:2309.11495 (2023). https://doi.org/10.48550/ARXIV. 2309.11495 - · DOI
  11. [17][17] Ameet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, and Karthik Narasimhan. 2023. Toxicity in ChatGPT: Analyzing Persona-assigned Language Models . https://doi.org/10.48550/arXiv.2304.05335 arXiv:2304.05335 - · DOI · Paper page
  12. [19][19] Saharnaz Dilmaghani, Matthias R. Brust, Grégoire Danoy, Natalia Cassagnes, Johnatan Pecero, and Pascal Bouvry. 2019. Privacy and Security of Big Data in AI Systems: A Research and Standards Perspective. In 2019 IEEE International Conference on Big Data (Big Data) . 5737-5743. https://doi.org/10.1109/BigData47090.2019.9006283 - · DOI · Paper page
  13. [21][21] Polra Victor Falade. 2023. Decoding the Threat Landscape : ChatGPT, FraudGPT, and WormGPT in Social Engineering Attacks. International Journal of Scientific Research in Computer Science, Engineering and Information Technology 9, 5 (2023), 185-198. https: -
  14. [20][20] Zhuoyun Du, Chen Qian, Wei Liu, Zihao Xie, Yifei Wang, Yufan Dang, Weize Chen, and Cheng Yang. 2024. Multi-Agent Software Development through Cross-Team Collaboration . https://doi.org/10.48550/arXiv.2406.08979 arXiv:2406.08979 [Proc. ACM Meas. Anal. Comput. Syst., Vol. 37, No. 4, Article 111. Publication date: August 2018.](https://doi.org/10.32628/CSEIT2390533) [//doi.org/10.32628/CSEIT2390533](https://doi.org/10.32628/CSEIT2390533) - · DOI
  15. [23][23] TommasoFornaciari, Federico Bianchi, Massimo Poesio, and Dirk Hovy. 2021. BERTective: Language Models and Contextual Information for Deception Detection. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (Online). Association for Computational Linguistics, 2699-2708. https://doi.org/10.18653/v1/2021.eacl-main.232 - · DOI
  16. [22][22] Richard Fang, Rohan Bindu, Akul Gupta, and Daniel Kang. 2024. LLM Agents Can Autonomously Exploit One-day Vulnerabilities . https://doi.org/10.48550/arXiv.2404.08144 arXiv:2404.08144 - · DOI · Paper page
  17. [24][24] Wenjie Fu, Huandong Wang, Chen Gao, Guanghua Liu, Yong Li, and Tao Jiang. 2023. Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration . https://doi.org/10.48550/arXiv.2311.06062 arXiv:2311.06062 - · DOI
  18. [26][26] Jiahui Gao, Renjie Pi, Tianyang Han, Han Wu, Lanqing Hong, Lingpeng Kong, Xin Jiang, and Zhenguo Li. 2024. CoCA: Regaining Safety-awareness of Multimodal Large Language Models with Constitutional Calibration . https://doi.org/10.48550/arXiv.2409.11365 arXiv:2409.11365 - · DOI
  19. [25][25] Xiaohan Fu, Shuheng Li, Zihan Wang, Yihao Liu, Rajesh K. Gupta, Taylor Berg-Kirkpatrick, and Earlence Fernandes. 2024. Imprompter: Tricking LLM Agents into Improper Tool Use . https://doi.org/10.48550/arXiv.2410.14923 arXiv:2410.14923 - · DOI
  20. [27][27] Kai Greshake, Sahar Abdelnabi, Shailesh Mishra, Christoph Endres, Thorsten Holz, and Mario Fritz. 2023. Not What You've Signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection . arXiv:2302.12173 http://arxiv.org/abs/2302.12173 - · arXiv
  21. [29][29] Peter Henderson, Koustuv Sinha, Nicolas Angelard-Gontier, Nan Rosemary Ke, Genevieve Fried, Ryan Lowe, and Joelle Pineau. 2017. Ethical Challenges in Data-Driven Dialogue Systems . https://doi.org/10.48550/arXiv.1711.09050 arXiv:1711.09050 - · DOI
  22. [28][28] Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V. Chawla, Olaf Wiest, and Xiangliang Zhang. 2024. Large Language Model Based Multi-Agents: A Survey of Progress and Challenges . https://doi.org/10.48550/arXiv.2402.01680 arXiv:2402.01680 - · DOI · Paper page
  23. [30][30] Keegan Hines, Gary Lopez, Matthew Hall, Federico Zarfati, Yonatan Zunger, and Emre Kiciman. 2024. Defending Against Indirect Prompt Injection Attacks With Spotlighting . https://doi.org/10.48550/arXiv.2403.14720 arXiv:2403.14720 - · DOI · Paper page
  24. [32][32] Jeremy Howard and Sebastian Ruder. 2018. Universal Language Model Fine-tuning for Text Classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (Melbourne, Australia), Iryna Gurevych and Yusuke Miyao (Eds.). Association for Computational Linguistics, 328-339. https://doi.org/10.18653/v1/P18-1031 - · DOI · Paper page
  25. [31][31] Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jürgen Schmidhuber. 2023. MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework . https://doi.org/10.48550/arXiv.2308.00352 arXiv:2308.00352 - · DOI · Paper page
  26. [33][33] Hanxu Hu, Pinzhen Chen, and Edoardo M. Ponti. 2024. Fine-Tuning Large Language Models with Sequential Instructions . https: //doi.org/10.48550/arXiv.2403.07794 arXiv:2403.07794 - · DOI
  27. [35][35] Jiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, and Siyuan Huang. 2024. An Embodied Generalist Agent in 3D World . https://doi.org/10.48550/arXiv.2311.12871 arXiv:2311.12871 - · DOI
  28. [34][34] Jianheng Huang, Leyang Cui, Ante Wang, Chengyi Yang, Xinting Liao, Linfeng Song, Junfeng Yao, and Jinsong Su. 2024. Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal . https://doi.org/10.48550/arXiv.2403.01244 arXiv:2403.01244 - · DOI · Paper page
  29. [36][36] Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, and Ting Liu. 2023. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions . arXiv:2311.05232 http://arxiv.org/abs/2311.05232 - · arXiv
  30. [38][38] Shotaro Ishihara. 2023. Training Data Extraction From Pre-trained Language Models: A Survey. In Proceedings of the 3rd Workshop on Trustworthy Natural Language Processing (TrustNLP 2023) (Toronto, Canada), Anaelia Ovalle, Kai-Wei Chang, Ninareh Mehrabi, Yada Pruksachatkun, Aram Galystan, Jwala Dhamala, Apurv Verma, Trista Cao, Anoop Kumar, and Rahul Gupta (Eds.). Association for Computational Linguistics, 260-275. https://aclanthology.org/2023.trustnlp-1.23 -
  31. [37][37] Evan Hubinger, Carson Denison, Jesse Mu, Mike Lambert, Meg Tong, Monte MacDiarmid, Tamera Lanham, Daniel M. Ziegler, Tim Maxwell, Newton Cheng, Adam Jermyn, Amanda Askell, Ansh Radhakrishnan, Cem Anil, David Duvenaud, Deep Ganguli, Fazl Barez, Jack Clark, Kamal Ndousse, Kshitij Sachan, Michael Sellitto, Mrinank Sharma, Nova DasSarma, Roger Grosse, Shauna Kravec, Yuntao Bai, Zachary Witten, Marina Favaro, Jan Brauner, Holden Karnofsky, Paul Christiano, Samuel R. Bowman, Logan Graham, Jared Kaplan, Sören Mindermann, Ryan Greenblatt, Buck Shlegeris, Nicholas Schiefer, and Ethan Perez. 2024. Sleeper Agents: Training Deceptive LLMs That Persist Through Safety Training . arXiv:2401.05566 http://arxiv.org/abs/2401.05566 - · arXiv
  32. [39][39] Bargav Jayaraman, Esha Ghosh, Melissa Chase, Sambuddha Roy, Wei Dai, and David Evans. 2023. Combing for Credentials: Active Pattern Extraction from Smart Reply . https://doi.org/10.48550/arXiv.2207.10802 arXiv:2207.10802 - · DOI
  33. [41][41] Tianjie Ju, Yiting Wang, Xinbei Ma, Pengzhou Cheng, Haodong Zhao, Yulong Wang, Lifeng Liu, Jian Xie, Zhuosheng Zhang, and Gongshen Liu. 2024. Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities . https://doi.org/10.48550/ arXiv.2407.07791 arXiv:2407.07791 - · arXiv
  34. [40][40] Ziwei Ji, Tiezheng Yu, Yan Xu, Nayeon Lee, Etsuko Ishii, and Pascale Fung. 2023. Towards Mitigating Hallucination in Large Language Models via Self-Reflection. arXiv preprint arXiv:2310.06271 (2023). https://arxiv.org/abs/2310.06271 - · arXiv
  35. [42][42] Nikhil Kandpal, Krishna Pillutla, Alina Oprea, Peter Kairouz, Christopher A. Choquette-Choo, and Zheng Xu. 2024. User Inference Attacks on Large Language Models . https://doi.org/10.48550/arXiv.2310.09266 arXiv:2310.09266 - · DOI
  36. [44][44] Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, and Nicholas Carlini. 2022. Deduplicating Training Data Makes Language Models Better. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (Dublin, Ireland), Smaranda Muresan, Preslav Nakov, and Aline Villavicencio (Eds.). Association for Computational Linguistics, 8424-8445. https://doi.org/10.18653/v1/2022.acl-long.577 - · DOI · Paper page
  37. [43][43] Siwon Kim, Sangdoo Yun, Hwaran Lee, Martin Gubri, Sungroh Yoon, and Seong Joon Oh. 2023. ProPILE: Probing Privacy Leakage in Large Language Models . arXiv:2307.01881 http://arxiv.org/abs/2307.01881 - · arXiv
  38. [45][45] Seongyun Lee, Sue Hyun Park, Yongrae Jo, and Minjoon Seo. 2024. Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision . https://doi.org/10.48550/arXiv.2311.07362 arXiv:2311.07362 - · DOI
  39. [47][47] Haoran Li, Dadi Guo, Wei Fan, Mingshi Xu, Jie Huang, Fanpu Meng, and Yangqiu Song. 2023. Multi-Step Jailbreaking Privacy Attacks on ChatGPT . arXiv:2304.05197 http://arxiv.org/abs/2304.05197 - · arXiv
  40. [46][46] Sicong Leng, Hang Zhang, Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, and Lidong Bing. 2024. Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 13872-13882. -
  41. [48][48] Jiaju Lin, Haoran Zhao, Aochi Zhang, Yiting Wu, Huqiuyue Ping, and Qin Chen. 2023. AgentSims: An Open-Source Sandbox for Large Language Model Evaluation . https://doi.org/10.48550/arXiv.2308.04026 arXiv:2308.04026 - · DOI · Paper page
  42. [50][50] Fuxiao Liu, Kevin Lin, Linjie Li, Jianfeng Wang, Yaser Yacoob, and Lijuan Wang. 2024. Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning . https://doi.org/10.48550/arXiv.2306.14565 arXiv:2306.14565 - · DOI · Paper page
  43. [49][49] Bingbin Liu, Jordan T. Ash, Surbhi Goel, Akshay Krishnamurthy, and Cyril Zhang. 2023. Exposing Attention Glitches with Flip-Flop Language Modeling . https://doi.org/10.48550/arXiv.2306.00946 arXiv:2306.00946 - · DOI
  44. [51][51] Xiaogeng Liu, Nan Xu, Muhao Chen, and Chaowei Xiao. 2024. AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models. In The Twelfth International Conference on Learning Representations . https://openreview.net/forum?id=7Jwpw4qKkb -
  45. [53][53] Yi Liu, Gelei Deng, Yuekang Li, Kailong Wang, Tianwei Zhang, Yepang Liu, Haoyu Wang, Yan Zheng, and Yang Liu. 2023. Prompt Injection Attack against LLM-integrated Applications . https://doi.org/10.48550/arXiv.2306.05499 arXiv:2306.05499 - · DOI · Paper page
  46. [52][52] Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, and Jie Tang. [n. d.]. AgentBench: Evaluating LLMs as Agents . https://doi.org/10.48550/arXiv.2308.03688 arXiv:2308.03688 [cs] - · DOI · Paper page
  47. [54][54] Yuliang Liu, Biao Yang, Qiang Liu, Zhang Li, Zhiyin Ma, Shuo Zhang, and Xiang Bai. 2024. TextMonkey: An OCR-Free Large Multimodal Model for Understanding Document . https://doi.org/10.48550/arXiv.2403.04473 arXiv:2403.04473 - · DOI
  48. [56][56] Yun Luo, Zhen Yang, Fandong Meng, Yafu Li, Jie Zhou, and Yue Zhang. 2023. An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning . arXiv:2308.08747 http://arxiv.org/abs/2308.08747 - · arXiv
  49. [55][55] Junyu Luo, Cao Xiao, and Fenglong Ma. 2023. Zero-Resource Hallucination Prevention for Large Language Models. arXiv preprint arXiv:2309.02654 (2023). https://doi.org/10.48550/ARXIV.2309.02654 - · DOI
  50. [57][57] Reem A. Mahmoud and Hazem Hajj. 2022. Multi-Objective Learning to Overcome Catastrophic Forgetting in Time-series Applications. ACM Transactions on Knowledge Discovery from Data 16, 6 (2022), 1-20. https://doi.org/10.1145/3502728 - · DOI
  51. [59][59] Sean Mondesire and R. Paul Wiegand. 2023. Mitigating Catastrophic Forgetting with Complementary Layered Learning. Electronics 12, 3 (2023), 706. https://doi.org/10.3390/electronics12030706 - · DOI
  52. [58][58] Zhao Mandi, Shreeya Jain, and Shuran Song. 2023. RoCo: Dialectic Multi-Robot Collaboration with Large Language Models . https: //doi.org/10.48550/arXiv.2307.04738 arXiv:2307.04738 - · DOI · Paper page
  53. [60][60] Michael Moor, Qian Huang, Shirley Wu, Michihiro Yasunaga, Yash Dalmia, Jure Leskovec, Cyril Zakka, Eduardo Pontes Reis, and Pranav Rajpurkar. 2023. Med-Flamingo: A Multimodal Medical Few-shot Learner. In Proceedings of the 3rd Machine Learning for Health Symposium (Proceedings of Machine Learning Research, Vol. 225) . PMLR, 353-367. https://proceedings.mlr.press/v225/moor23a.html -
  54. [62][62] Yuzhou Nie, Zhun Wang, Ye Yu, Xian Wu, Xuandong Zhao, Wenbo Guo, and Dawn Song. 2024. PrivAgent: Agentic-based Red-teaming for LLM Privacy Leakage . https://doi.org/10.48550/arXiv.2412.05734 arXiv:2412.05734 - · DOI
  55. [63][63] OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, and Balcom. 2024. GPT-4 Technical Report . https://doi.org/10.48550/arXiv.2303.08774 arXiv:2303.08774 - · DOI · Paper page
  56. [65][65] Jing-Cheng Pang, Heng-Bo Fan, Pengyuan Wang, Jia-Hao Xiao, Nan Tang, Si-Hang Yang, Chengxing Jia, Sheng-Jun Huang, and Yang Yu. 2024. Empowering Language Models with Active Inquiry for Deeper Understanding . https://doi.org/10.48550/arXiv.2402.03719 arXiv:2402.03719 - · DOI
  57. [64][64] Mustafa Safa Ozdayi, Charith Peris, Jack FitzGerald, Christophe Dupuy, Jimit Majmudar, Haidar Khan, Rahil Parikh, and Rahul Gupta. 2023. Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning . arXiv:2305.11759 https: //arxiv.org/abs/2305.11759 Proc. ACM Meas. Anal. Comput. Syst., Vol. 37, No. 4, Article 111. Publication date: August 2018. - · arXiv
  58. [66][66] Joon Sung Park, Joseph O'Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. [n. d.]. Generative Agents: Interactive Simulacra of Human Behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (2023-10-29) (UIST '23) . Association for Computing Machinery, 1-22. https://doi.org/10.1145/3586183.3606763 - · DOI · Paper page
  59. [67][67] Liangzu Peng, Paris Giampouras, and Rene Vidal. 2023. The Ideal Continual Learner: An Agent That Never Forgets. In Proceedings of the 40th International Conference on Machine Learning . PMLR, 27585-27610. https://proceedings.mlr.press/v202/peng23a.html -
  60. [69][69] Xavier Puig, Eric Undersander, Andrew Szot, Mikael Dallaire Cote, Tsung-Yen Yang, Ruslan Partsey, Ruta Desai, Alexander William Clegg, Michal Hlavac, So Yeon Min, Vladimír Vondruš, Theophile Gervet, Vincent-Pierre Berges, John M. Turner, Oleksandr Maksymets, Zsolt Kira, Mrinal Kalakrishnan, Jitendra Malik, Devendra Singh Chaplot, Unnat Jain, Dhruv Batra, Akshara Rai, and Roozbeh Mottaghi. 2023. Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots . https://doi.org/10.48550/arXiv.2310.13724 arXiv:2310.13724 - · DOI · Paper page
  61. [71][71] Alexander Robey, Eric Wong, Hamed Hassani, and George J. Pappas. 2023. SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks. arXiv preprint arXiv:2310.03684 (2023). https://doi.org/10.48550/ARXIV.2310.03684 - · DOI · Paper page
  62. [72][72] Yangjun Ruan, Honghua Dong, Andrew Wang, Silviu Pitis, Yongchao Zhou, Jimmy Ba, Yann Dubois, Chris J. Maddison, and Tatsunori Hashimoto. 2024. Identifying the Risks of LM Agents with an LM-Emulated Sandbox . https://doi.org/10.48550/arXiv.2309.15817 arXiv:2309.15817 - · DOI · Paper page
  63. [74][74] Virat Shejwalkar and Amir Houmansadr. 2021. Membership Privacy for Machine Learning Models Through Knowledge Transfer. 35, 11 (2021), 9549-9557. Issue 11. https://doi.org/10.1609/aaai.v35i11.17150 - · DOI
  64. [73][73] Erfan Shayegani, Yue Dong, and Nael Abu-Ghazaleh. 2023. Jailbreak in Pieces: Compositional Adversarial Attacks on Multi-Modal Language Models . https://doi.org/10.48550/arXiv.2307.14539 arXiv:2307.14539 - · DOI
  65. [77][77] Yashar Talebirad and Amirhossein Nadiri. 2023. Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents . https: //doi.org/10.48550/arXiv.2306.03314 arXiv:2306.03314 - · DOI · Paper page
  66. [76][76] Zhiqing Sun, Sheng Shen, Shengcao Cao, Haotian Liu, Chunyuan Li, Yikang Shen, Chuang Gan, Liang-Yan Gui, Yu-Xiong Wang, Yiming Yang, Kurt Keutzer, and Trevor Darrell. 2023. Aligning Large Multimodal Models with Factually Augmented RLHF . https: //doi.org/10.48550/arXiv.2309.14525 arXiv:2309.14525 - · DOI
  67. [78][78] Meng Tong, Kejiang Chen, Jie Zhang, Yuang Qi, Weiming Zhang, Nenghai Yu, Tianwei Zhang, and Zhikun Zhang. 2024. InferDPT: Privacy-Preserving Inference for Black-box Large Language Model . https://doi.org/10.48550/arXiv.2310.12214 arXiv:2310.12214 - · DOI
  68. [80][80] Thomas Vakili, Anastasios Lamproudis, Aron Henriksson, and Hercules Dalianis. 2022. Downstream Task Performance of BERT Models Pre-Trained Using Automatically De-Identified Clinical Data. In Proceedings of the Thirteenth Language Resources and Evaluation Conference (Marseille, France), Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, and Stelios Piperidis (Eds.). European Language Resources Association, 4245-4252. https://aclanthology.org/2022.lrec-1.451 -
  69. [79][79] Jean-Baptiste Truong, Pratyush Maini, Robert J. Walls, and Nicolas Papernot. 2021. Data-Free Model Extraction. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 4769-4778. https://ieeexplore.ieee.org/document/9577784 -
  70. [81][81] Steven Vander Eeckt and Hugo Van Hamme. 2023. Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition. In ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Rhodes Island, Greece). IEEE, 1-5. https://doi.org/10.1109/ICASSP49357.2023.10095147 - · DOI
  71. [83][83] Huan Wang and Yan-Fu Li. 2023. Large Language Model Empowered by Domain-Specific Knowledge Base for Industrial Equipment Operation and Maintenance. In 2023 5th International Conference on System Reliability and Safety Engineering (SRSE) . 474-479. https://doi.org/10.1109/SRSE59585.2023.10336112 - · DOI
  72. [82][82] Alexander Wan, Eric Wallace, Sheng Shen, and Dan Klein. 2023. Poisoning Language Models During Instruction Tuning . https: //doi.org/10.48550/arXiv.2305.00944 arXiv:2305.00944 - · DOI · Paper page
  73. [84][84] Junyang Wang, Haiyang Xu, Jiabo Ye, Ming Yan, Weizhou Shen, Ji Zhang, Fei Huang, and Jitao Sang. 2024. Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception . https://doi.org/10.48550/arXiv.2401.16158 arXiv:2401.16158 - · DOI
  74. [86][86] Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, and Ji-Rong Wen. 2023. A Survey on Large Language Model Based Autonomous Agents . arXiv:2308.11432 http://arxiv.org/abs/2308.11432 - · arXiv
  75. [85][85] Kuan Wang, Yadong Lu, Michael Santacroce, Yeyun Gong, Chao Zhang, and Yelong Shen. 2023. Adapting LLM Agents Through Communication . https://doi.org/10.48550/arXiv.2310.01444 arXiv:2310.01444 - · DOI
  76. [87][87] Shenzhi Wang, Chang Liu, Zilong Zheng, Siyuan Qi, Shuo Chen, Qisen Yang, Andrew Zhao, Chaofei Wang, Shiji Song, and Gao Huang. 2023. Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplation . https://doi.org/10.48550/arXiv.2310.01320 arXiv:2310.01320 - · DOI
  77. [88][88] Shen Wang, Tianlong Xu, Hang Li, Chaoli Zhang, Joleen Liang, Jiliang Tang, Philip S. Yu, and Qingsong Wen. 2024. Large Language Models for Education: A Survey and Outlook . arXiv:2403.18105 https://arxiv.org/abs/2403.18105 - · arXiv
  78. [90][90] Tianyu Wang, Yifan Li, Haitao Lin, Xiangyang Xue, and Yanwei Fu. 2023. WALL-E: Embodied Robotic WAiter Load Lifting with Large Language Model . https://doi.org/10.48550/arXiv.2308.15962 arXiv:2308.15962 - · DOI
  79. [89][89] Shang Wang, Tianqing Zhu, Bo Liu, Ming Ding, Xu Guo, Dayong Ye, Wanlei Zhou, and Philip S. Yu. 2024. Unique Security and Privacy Threats of Large Language Model: A Comprehensive Survey . https://doi.org/10.48550/arXiv.2406.07973 arXiv:2406.07973 - · DOI
  80. [91][91] Yuntao Wang, Yanghe Pan, Miao Yan, Zhou Su, and Tom H. Luan. 2023. A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutions. IEEE Open Journal of the Computer Society 4 (2023), 280-302. https://doi.org/10.1109/OJCS.2023.3300321 - · DOI
  81. [93][93] Zhenhua Wang, Wei Xie, Kai Chen, Baosheng Wang, Zhiwen Gui, and Enze Wang. 2023. Self-Deception: Reverse Penetrating the Semantic Firewall of Large Language Models . arXiv:2308.11521 http://arxiv.org/abs/2308.11521 - · arXiv
  82. [92][92] Yufei Wang, Wanjun Zhong, Liangyou Li, Fei Mi, Xingshan Zeng, Wenyong Huang, Lifeng Shang, Xin Jiang, and Qun Liu. 2023. Aligning Large Language Models with Human: A Survey . https://doi.org/10.48550/arXiv.2307.12966 arXiv:2307.12966 - · DOI · Paper page
  83. [94][94] Genta Indra Winata, Lingjue Xie, Karthik Radhakrishnan, Shijie Wu, Xisen Jin, Pengxiang Cheng, Mayank Kulkarni, and Daniel Preotiuc-Pietro. 2023. Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learning. In Findings of the Association for Computational Linguistics: ACL 2023 . Association for Computational Linguistics, Toronto, Canada, 768-777. https://doi.org/10. 18653/v1/2023.findings-acl.48 -
  84. [96][96] Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, Rui Zheng, Xiaoran Fan, Xiao Wang, Limao Xiong, Yuhao Zhou, Weiran Wang, Changhao Jiang, Yicheng Zou, Xiangyang Liu, Zhangyue Yin, Shihan Dou, Rongxiang Weng, Wensen Cheng, Qi Zhang, Wenjuan Qin, Yongyan Zheng, Xipeng Qiu, Xuanjing Huang, and Tao Gui. 2023. The Rise and Potential of Large Language Model Based Agents: A Survey . https://doi.org/10.48550/arXiv.2309.07864 arXiv:2309.07864 - · DOI · Paper page
  85. [95][95] Chenfei Wu, Shengming Yin, Weizhen Qi, Xiaodong Wang, Zecheng Tang, and Nan Duan. 2023. Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models . https://doi.org/10.48550/arXiv.2303.04671 arXiv:2303.04671 - · DOI · Paper page
  86. [97][97] Junlin Xie, Zhihong Chen, Ruifei Zhang, Xiang Wan, and Guanbin Li. 2024. Large Multimodal Agents: A Survey . https://doi.org/10. 48550/arXiv.2402.15116 arXiv:2402.15116 - · arXiv
  87. [99][99] Lvxiaowei Xu, Jianwang Wu, Jiawei Peng, Zhilin Gong, Ming Cai, and Tianxiang Wang. 2023. Enhancing Language Representation with Constructional Information for Natural Language Understanding. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (Toronto, Canada). Association for Computational Linguistics, 4685-4705. https://doi.org/10.18653/v1/2023.acl-long.258 - · DOI
  88. [98][98] Lin Xu, Zhiyuan Hu, Daquan Zhou, Hongyu Ren, Zhen Dong, Kurt Keutzer, See Kiong Ng, and Jiashi Feng. 2023. MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration . https://doi.org/10.48550/arXiv. 2311.08562 arXiv:2311.08562 - · DOI
  89. [100][100] Mingfu Xue, Chengxiang Yuan, Heyi Wu, Yushu Zhang, and Weiqiang Liu. 2020. Machine Learning Security: Threats, Countermeasures, and Evaluations. IEEE Access 8 (2020), 74720-74742. https://doi.org/10.1109/ACCESS.2020.2987435 - · DOI
  90. [102][102] Haomiao Yang, Kunlan Xiang, Mengyu Ge, Hongwei Li, Rongxing Lu, and Shui Yu. 2023. A Comprehensive Overview of Backdoor Attacks in Large Language Models within Communication Networks . https://doi.org/10.48550/arXiv.2308.14367 arXiv:2308.14367 - · DOI
  91. [101][101] LuYan, Zhuo Zhang, Guanhong Tao, Kaiyuan Zhang, Xuan Chen, Guangyu Shen, and Xiangyu Zhang. 2023. ParaFuzz: An InterpretabilityDriven Technique for Detecting Poisoned Samples in NLP . https://doi.org/10.48550/arXiv.2308.02122 arXiv:2308.02122 - · DOI
  92. [103][103] Jihan Yang, Runyu Ding, Ellis Brown, Xiaojuan Qi, and Saining Xie. 2024. V-IRL: Grounding Virtual Intelligence in Real Life . https: //doi.org/10.48550/arXiv.2402.03310 arXiv:2402.03310 - · DOI
  93. [105][105] Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Ehsan Azarnasab, Faisal Ahmed, Zicheng Liu, Ce Liu, Michael Zeng, and Lijuan Wang. 2023. MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action . https://doi.org/10.48550/arXiv.2303.11381 arXiv:2303.11381 - · DOI
  94. [104][104] Wenkai Yang, Xiaohan Bi, Yankai Lin, Sishuo Chen, Jie Zhou, and Xu Sun. 2024. Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents . https://doi.org/10.48550/arXiv.2402.11208 arXiv:2402.11208 - · DOI · Paper page
  95. [106][106] Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, and Karthik Narasimhan. 2023. Tree of Thoughts: Deliberate Problem Solving with Large Language Models. In Proceedings of the 37th International Conference on Neural Information Processing Systems (Red Hook, NY, USA) (NIPS '23) . Curran Associates Inc., 11809-11822. -
  96. [108][108] Yifan Yao, Jinhao Duan, Kaidi Xu, Yuanfang Cai, Eric Sun, and Yue Zhang. 2023. A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly . https://doi.org/10.48550/arXiv.2312.02003 arXiv:2312.02003 - · DOI
  97. [107][107] Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. [n. d.]. ReAct: Synergizing Reasoning and Acting in Language Models . https://doi.org/10.48550/arXiv.2210.03629 arXiv:2210.03629 [cs] - · DOI · Paper page
  98. [109][109] Jingwei Yi, Yueqi Xie, Bin Zhu, Keegan Hines, Emre Kiciman, Guangzhong Sun, Xing Xie, and Fangzhao Wu. 2023. Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models . https://doi.org/10.48550/arXiv.2312.14197 arXiv:2312.14197 Proc. ACM Meas. Anal. Comput. Syst., Vol. 37, No. 4, Article 111. Publication date: August 2018. - · DOI · Paper page
  99. [110][110] Shukang Yin, Chaoyou Fu, Sirui Zhao, Tong Xu, Hao Wang, Dianbo Sui, Yunhang Shen, Ke Li, Xing Sun, and Enhong Chen. 2023. Woodpecker: Hallucination Correction for Multimodal Large Language Models . https://doi.org/10.48550/arXiv.2310.16045 arXiv:2310.16045 - · DOI
  100. [112][112] Ziyi Yin, Muchao Ye, Tianrong Zhang, Tianyu Du, Jinguo Zhu, Han Liu, Jinghui Chen, Ting Wang, and Fenglong Ma. 2024. VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Models . https://doi.org/10.48550/arXiv.2310.04655 arXiv:2310.04655 - · DOI
  101. [111][111] Sheng Yin, Xianghe Pang, Yuanzhuo Ding, Menglan Chen, Yutong Bi, Yichen Xiong, Wenhao Huang, Zhen Xiang, Jing Shao, and Siheng Chen. [n. d.]. SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents . https://doi.org/10.48550/arXiv.2412.13178 arXiv:2412.13178 [cs] - · DOI · Paper page
  102. [113][113] Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin A. Inan, Gautam Kamath, Janardhan Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, and Huishuai Zhang. 2021. Differentially Private Fine-tuning of Language Models. In International Conference on Learning Representations . https://openreview.net/forum?id=Q42f0dfjECO -
  103. [115][115] Ziqi Yuan, Yihe Liu, Hua Xu, and Kai Gao. 2024. Noise Imitation Based Adversarial Training for Robust Multimodal Sentiment Analysis. 26 (2024), 529-539. https://doi.org/10.1109/TMM.2023.3267882 - · DOI
  104. [114][114] Jiahao Yu, Xingwei Lin, Zheng Yu, and Xinyu Xing. 2023. GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts . arXiv:2309.10253 http://arxiv.org/abs/2309.10253 - · arXiv
  105. [116][116] Bohan Zhai, Shijia Yang, Chenfeng Xu, Sheng Shen, Kurt Keutzer, Chunyuan Li, and Manling Li. 2024. HallE-Control: Controlling Object Hallucination in Large Multimodal Models . https://doi.org/10.48550/arXiv.2310.01779 arXiv:2310.01779 - · DOI · Paper page
  106. [118][118] Qiusi Zhan, Zhixiang Liang, Zifan Ying, and Daniel Kang. 2024. InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents . https://doi.org/10.48550/arXiv.2403.02691 arXiv:2403.02691 - · DOI · Paper page
  107. [117][117] Yuexiang Zhai, Shengbang Tong, Xiao Li, Mu Cai, Qing Qu, Yong Jae Lee, and Yi Ma. 2023. Investigating the Catastrophic Forgetting in Multimodal Large Language Models . https://doi.org/10.48550/arXiv.2309.10313 arXiv:2309.10313 - · DOI · Paper page
  108. [119][119] Shuo Zhang, Liangming Pan, Junzhou Zhao, and William Yang Wang. 2024. The Knowledge Alignment Problem: Bridging Human and External Knowledge for Large Language Models . arXiv:2305.13669 https://arxiv.org/abs/2305.13669 - · arXiv
  109. [121][121] Zhexin Zhang, Shiyao Cui, Yida Lu, Jingzhuo Zhou, Junxiao Yang, Hongning Wang, and Minlie Huang. [n. d.]. Agent-SafetyBench: Evaluating the Safety of LLM Agents . https://doi.org/10.48550/arXiv.2412.14470 arXiv:2412.14470 [cs] - · DOI · Paper page
  110. [120][120] Yuyang Zhang, Kangjie Chen, Xudong Jiang, Yuxiang Sun, Run Wang, and Lina Wang. 2024. Towards Action Hijacking of Large Language Model-based Agent . https://doi.org/10.48550/arXiv.2412.10807 arXiv:2412.10807 - · DOI
  111. [122][122] Zhiping Zhang, Michelle Jia, Hao-Ping (Hank) Lee, Bingsheng Yao, Sauvik Das, Ada Lerner, Dakuo Wang, and Tianshi Li. 2024. 'It's a Fair Game', or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agents. In Proceedings of the CHI Conference on Human Factors in Computing Systems (New York, NY, USA) (CHI '24) . Association for Computing Machinery, 1-26. https://doi.org/10.1145/3613904.3642385 - · DOI · Paper page
  112. [124][124] Qiwei Zhao, Xujiang Zhao, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, and Haifeng Chen. 2024. SAUP: Situation Awareness Uncertainty Propagation on LLM Agent . https://doi.org/10.48550/arXiv.2412.01033 arXiv:2412.01033 - · DOI
  113. [123][123] Zhexin Zhang, Junxiao Yang, Pei Ke, Fei Mi, Hongning Wang, and Minlie Huang. 2024. Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics . 8865-8887. https://doi.org/10.18653/v1/2024.acl-long.481 - · DOI
  114. [125][125] Qingxiao Zheng, Zhongwei Xu, Abhinav Choudhary, Yuting Chen, Yongming Li, and Yun Huang. 2023. Synergizing Human-AI Agency: A Guide of 23 Heuristics for Service Co-Creation with LLM-Based Agents . https://doi.org/10.48550/arXiv.2310.15065 arXiv:2310.15065 - · DOI
  115. [127][127] Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, and Yanlin Wang. 2024. Memorybank: Enhancing large language models with long-term memory. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 38. 19724-19731. -
  116. [126][126] Wanjun Zhong, Ruixiang Cui, Yiduo Guo, Yaobo Liang, Shuai Lu, Yanlin Wang, Amin Saied, Weizhu Chen, and Nan Duan. 2023. AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models . https://doi.org/10.48550/arXiv.2304.06364 arXiv:2304.06364 - · DOI · Paper page
  117. [128][128] Wei Zou, Runpeng Geng, Binghui Wang, and Jinyuan Jia. 2025. PoisonedRAG: Knowledge Poisoning Attacks to Retrieval-Augmented Generation of Large Language Models. In 34th USENIX Security Symposium (USENIX Security 25) . 3827-3844.

Cited by

Sorted by citations

Authors
He, F., Zhu, T., Ye, D., Liu, B., Zhou, W., & Yu, P. S.
Affiliations
  • University of Technology Sydney (AU)
  • City University of Macau (MO)
  • University of Illinois Chicago (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
58
Issue
6
Pages
1-36
ISSN
0360-0300 (ISSN-L)
DOI
10.48550/arxiv.2407.19354
arXiv
2407.19354
OpenAlex
W4401201613
Cited by
60
References
0
Citations by year
2026: 45 · 2025: 13 · 2024: 2
FWCI
23.18
Type
journal article
Language
en
Open access
Licence
Locations
  • ACM Computing Surveys (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Fundo para o Desenvolvimento das Ciências e da Tecnologia
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
Keywords
LLM agents, large language models, security threats, privacy risks, threat categorization, defense strategy, trustworthiness, human-agent interaction, case studies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review