CoChat
Sign Up
PreprintCited by 7Adversarial Robustness in Machine LearningInformation and Cyber SecurityNetwork Security and Intrusion Detection

Frontier AI's Impact on the Cybersecurity Landscape

Open access
Potter, Yujin, Guo, Wenbo, Wang, Zhun, Shi, Tianneng, Li, Hongwei, Zhang, Andy, Kelley, Patrick Gage, Thomas, Kurt +1 more·2025·arXiv
DOI 10.48550/arxiv.2504.05408arXiv 2504.05408
Open this paper in CoChat — free accountOpen PDF

Abstract

The impact of frontier AI (i.e., AI agents and foundation models) in cybersecurity is rapidly increasing. In this paper, we comprehensively analyze this trend through multiple aspects: quantitative benchmarks, qualitative literature review, empirical evaluation, and expert survey. Our analyses consistently show that AI's capabilities and applications in attacks have exceeded those on the defensive side. Our empirical evaluation of widely used agent systems on cybersecurity benchmarks highlights that current AI agents struggle with flexible workflow planning and using domain-specific tools for complex security analysis -- capabilities particularly critical for defensive applications. Our expert survey of AI and security researchers and practitioners indicates a prevailing view that AI will continue to benefit attackers over defenders, though the gap is expected to narrow over time. These results show the urgent need to evaluate and mitigate frontier AI's risks, steering it towards benefiting cyber defenses. Responding to this need, we provide concrete calls to action regarding: the construction of new cybersecurity benchmarks, the development of AI agents for defense, the design of provably secure AI agents, the improvement of pre-deployment security testing and transparency, and the strengthening of user-oriented education and defenses. Our paper summary and blog are available at https://rdi.berkeley.edu/frontier-ai-impact-on-cybersecurity/.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2504.05408

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 209

  1. [3][3] Toufique Ahmed and Premkumar Devanbu. Better patching using LLM prompting, via Self-Consistency. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) , pages 17421746. IEEE, 2023. -
  2. [4][4] Vishwanath Akuthota, Raghunandan Kasula, Sabiha Tasnim Sumona, Masud Mohiuddin, Md Tanzim Reza, and Md Mizanur Rahman. Vulnerability Detection and Monitoring Using LLM. In 2023 IEEE 9th International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE) , pages 309-314. IEEE, 2023. -
  3. [5][5] Omar Mustafa Al-Janabi, Osamah Mohammed Alyasiri, and Elaf Ayyed Jebur. GPT-4 versus Bard and Bing: LLMs for Fake Image Detection. In 2023 3rd International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA) , pages 249-254. IEEE, 2023. -
  4. [6][6] Jamal Al-Karaki, Muhammad Al-Zafar Khan, and Marwan Omar. Exploring LLMs for Malware Detection: Review, Framework Design, and Countermeasure Approaches. arXiv preprint arXiv:2409.07587 , 2024. - · arXiv
  5. [7][7] Md Tanvirul Alam, Dipkamal Bhusal, Le Nguyen, and Nidhi Rastogi. Ctibench: A benchmark for evaluating llms in cyber threat intelligence. arXiv preprint arXiv:2406.07599 , 2024. - · arXiv
  6. [8][8] Ahmed Aldahdooh, Wassim Hamidouche, Sid Ahmed Fezza, and Olivier Déforges. Adversarial example detection for dnn models: A review and experimental comparison. Artificial Intelligence Review , 55(6):44034462, 2022. -
  7. [10][10] Blake Anderson and David McGrew. Machine learning for encrypted malware traffic classification: accounting for noisy labels and non-stationarity. In Proceedings of the 23rd ACM SIGKDD International Conference on knowledge discovery and data mining , pages 17231732, 2017. -
  8. [11][11] Hyrum S Anderson, Jonathan Woodbridge, and Bobby Filar. Deepdga: Adversarially-tuned domain generation and detection. In Proceedings of the 2016 ACM - workshop on artificial intelligence and security , pages 13-21, 2016. -
  9. [12][12] K Anirudh, Meghana Srikanth, and A Shahina. Multilingual Fake News Detection in Low-Resource Languages: A Comparative Study Using BERT and GPT3.5. In International Conference on Speech and Language Technologies for Low-resource Languages , pages 387-397. Springer, 2023. -
  10. [16][16] Daniel Arp, Erwin Quiring, Feargus Pendlebury, Alexander Warnecke, Fabio Pierazzi, Christian Wressnegger, Lorenzo Cavallaro, and Konrad Rieck. Dos and don'ts of machine learning in computer security. In 31st USENIX Security Symposium (USENIX Security 22) , pages 3971-3988, 2022. -
  11. [17][17] Daniel Arp, Michael Spreitzenbarth, Malte Hubner, Hugo Gascon, Konrad Rieck, and CERT Siemens. Drebin: Effective and explainable detection of android malware in your pocket. In Ndss , volume 14, pages 23-26, 2014. -
  12. [18][18] Ömer Aslan, Semih Serkant Aktu˘ g, Merve OzkanOkay, Abdullah Asim Yilmaz, and Erdal Akin. A comprehensive review of cyber security vulnerabilities, threats, attacks, and solutions. Electronics , 12(6):1333, 2023. -
  13. [20][20] Taimur Bakhshi. Social engineering: Revisiting enduser awareness and susceptibility to classic attack vectors. In 2017 13th International Conference on Emerging Technologies (ICET) , pages 1-6. IEEE, 2017. -
  14. [22][22] Mislav Balunovic, Pavol Bielik, and Martin Vechev. Learning to solve smt formulas. Advances in Neural Information Processing Systems , 31, 2018. -
  15. [23][23] Clark Barrett, Brad Boyd, Elie Bursztein, Nicholas Carlini, Brad Chen, Jihye Choi, Amrita Roy Chowdhury, Mihai Christodorescu, Anupam Datta, Soheil Feizi, et al. Identifying and mitigating the security risks of generative ai. Foundations and Trends® in Privacy and Security , 6(1):1-52, 2023. -
  16. [25][25] Roman Beltiukov, Wenbo Guo, Arpit Gupta, and Walter Willinger. In search of netunicorn: A data-collection platform to develop generalizable ml models for network security problems. In Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security , pages 2217-2231, 2023. -
  17. [26][26] Mazal Bethany, Athanasios Galiopoulos, Emet Bethany, Mohammad Bahrami Karkevandi, Nishant Vishwamitra, and Peyman Najafirad. Large language model lateral spear phishing: A comparative study in large-scale organizational settings. arXiv preprint arXiv:2401.09727 , 2024. - · arXiv
  18. [27][27] Sahil Bhatia, Jie Qiu, Niranjan Hasabnis, Sanjit A Seshia, and Alvin Cheung. Verified code transpilation with llms. arXiv preprint arXiv:2406.03003 , 2024. - · arXiv
  19. [29][29] Islem Bouzenia, Premkumar Devanbu, and Michael Pradel. Repairagent: An autonomous, llm-based agent for program repair. arXiv preprint arXiv:2403.17134 , 2024. - · arXiv
  20. [30][30] Tom B Brown. Language models are few-shot learners. arXiv preprint arXiv:2005.14165 , 2020. - · arXiv
  21. [31][31] bugcrowd. Inside the Mind of a Hacker: 2024 Edition. https://www.bugcrowd.com/wpcontent/uploads/2024/10/Inside-the-Mindof-a-Hacker-2024.pdf , 2024. -
  22. [32][32] Tri Cao, Chengyu Huang, Yuexin Li, Huilin Wang, Amy He, Nay Oo, and Bryan Hooi. PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detection. arXiv preprint arXiv:2408.10738 , 2024. - · arXiv
  23. [35][35] Luca Caviglione, Michal Choras, Igino Corona, Artur Janicki, Wojciech Mazurczyk, Marek Pawlicki, and Katarzyna Wasielewska. Tight arms race: Overview of current malware threats and trends in their detection. IEEE Access , 9:5371-5396, 2020. -
  24. [36][36] Timothee Chauvin. eyeballvul: a future-proof benchmark for vulnerability detection in the wild. arXiv preprint arXiv:2407.08708 , 2024. - · arXiv
  25. [38][38] Lijia Chen, Pingping Chen, and Zhijian Lin. Artificial intelligence in education: A review. Ieee Access , 8:75264-75278, 2020. -
  26. [39][39] Sizhe Chen, Julien Piet, Chawin Sitawarin, and David Wagner. Struq: Defending against prompt injection with structured queries. arXiv preprint arXiv:2402.06363 , 2024. - · arXiv
  27. [40][40] Xuan Chen, Yuzhou Nie, Wenbo Guo, and Xiangyu Zhang. When llm meets drl: Advancing jailbreaking efficiency via drl-guided search. arXiv preprint arXiv:2406.08705 , 2024. - · arXiv
  28. [41][41] Xuan Chen, Yuzhou Nie, Lu Yan, Yunshu Mao, Wenbo Guo, and Xiangyu Zhang. Rl-jack: Reinforcement learning-powered black-box jailbreaking attack against llms. arXiv preprint arXiv:2406.08725 , 2024. - · arXiv
  29. [42][42] Yuxiao Chen, Jingzheng Wu, Xiang Ling, Changjiang Li, Zhiqing Rui, Tianyue Luo, and Yanjun Wu. When Large Language Models Confront Repository-Level Automatic Program Repair: How Well They Done? In Proceedings of the 2024 IEEE/ACM 46th International Conference on Software Engineering: Companion Proceedings , pages 459-471, 2024. -
  30. [43][43] Zheng Leong Chua, Shiqi Shen, Prateek Saxena, and Zhenkai Liang. Neural nets can learn function type signatures from binaries. In 26th USENIX Security Symposium (USENIX Security 17) , pages 99-116, 2017. -
  31. [44][44] Keywhan Chung, Zbigniew T. Kalbarczyk, and Ravishankar K. Iyer. Availability Attacks on Computing Systems through Alteration of Environmental Control: Smart Malware Approach. In Proceedings of the 10th ACM/IEEE International Conference on CyberPhysical Systems , ICCPS '19, pages 1-12, New York, NY, USA, April 2019. Association for Computing Machinery. -
  32. [46][46] NIL ˘ A Constantin and Victor-Valeriu PATRICIU. LLMs for Web Reconnaissance Detection. Journal of Military Technology Vol , 6(2), 2023. -
  33. [51][51] Weidong Cui, Xinyang Ge, Baris Kasikci, Ben Niu, Upamanyu Sharma, Ruoyu Wang, and Insu Yun. { REPT } : Reverse debugging of failures in deployed software. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) , pages 17-32, 2018. -
  34. [53][53] Giulio De Pasquale, Ilya Grishchenko, Riccardo Iesari, Gabriel Pizarro, Lorenzo Cavallaro, Christopher Kruegel, and Giovanni Vigna. { ChainReactor } : Automated privilege escalation chain discovery via { AI } planning. In 33rd USENIX Security Symposium (USENIX Security 24) , pages 5913-5929, 2024. -
  35. [56][56] Gelei Deng, Yi Liu, Yuekang Li, Kailong Wang, Ying Zhang, Zefeng Li, Haoyu Wang, Tianwei Zhang, and Yang Liu. Jailbreaker: Automated jailbreak across multiple large language model chatbots. arXiv preprint arXiv:2307.08715 , 2023. - · arXiv
  36. [57][57] Gelei Deng, Yi Liu, Víctor Mayoral-Vilches, Peng Liu, Yuekang Li, Yuan Xu, Tianwei Zhang, Yang Liu, Martin Pinzger, and Stefan Rass. { PentestGPT } : Evaluating and harnessing large language models for automated penetration testing. In 33rd USENIX Security Symposium (USENIX Security 24) , pages 847-864, 2024. -
  37. [59][59] Yinlin Deng, Chunqiu Steven Xia, Haoran Peng, Chenyuan Yang, and Lingming Zhang. Large language models are zero-shot fuzzers: Fuzzing deep-learning libraries via large language models. In Proceedings of the 32nd ACM SIGSOFT international symposium on software testing and analysis , pages 423-435, 2023. -
  38. [60][60] Jacob Devlin. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 , 2018. - · arXiv
  39. [61][61] Najmeddine Dhieb, Hakim Ghazzai, Hichem Besbes, and Yehia Massoud. A secure AI-driven architecture for automated insurance systems: Fraud detection and risk measurement. IEEE Access , 8:58546-58558, 2020. -
  40. [62][62] Pummy Dhiman, Amandeep Kaur, Deepali Gupta, Sapna Juneja, Ali Nauman, and Ghulam Muhammad. GBERT: A hybrid deep learning model based on GPTBERT for fake news detection. Heliyon , 10(16), 2024. -
  41. [63][63] Connor Dilgren, Purva Chiniya, Luke Griffith, Yu Ding, and Yizheng Chen. Secrepobench: Benchmarking llms for secure code generation in real-world repositories. arXiv preprint arXiv:2504.21205 , 2025. - · arXiv
  42. [64][64] Yangruibo Ding, Yanjun Fu, Omniyyah Ibrahim, Chawin Sitawarin, Xinyun Chen, Basel Alomair, David Wagner, Baishakhi Ray, and Yizheng Chen. Vulnerability Detection with Code Language Models: How Far Are We? arXiv preprint arXiv:2403.18624 , 2024. - · arXiv
  43. [65][65] Alexey Dosovitskiy. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 , 2020. - · arXiv
  44. [66][66] Xueying Du, Geng Zheng, Kaixin Wang, Jiayi Feng, Wentai Deng, Mingwei Liu, Bihuan Chen, Xin Peng, Tao Ma, and Yiling Lou. Vul-rag: Enhancing llm-based vulnerability detection via knowledge-level rag. arXiv preprint arXiv:2406.11147 , 2024. - · arXiv
  45. [67][67] Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong, Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, et al. Agent ai: Surveying the horizons of multimodal interaction. arXiv preprint arXiv:2401.03568 , 2024. - · arXiv
  46. [68][68] Mehmet Emre, Ryan Schroeder, Kyle Dewey, and Ben Hardekopf. Translating c to safer rust. Proceedings of the ACM on Programming Languages , 5(OOPSLA):129, 2021. -
  47. [70][70] Ivan Evtimov, Arman Zharmagambetov, Aaron Grattafiori, Chuan Guo, and Kamalika Chaudhuri. Wasp: Benchmarking web agent security against prompt injection attacks. arXiv preprint arXiv:2504.18575 , 2025. - · arXiv
  48. [71][71] Chibuike Samuel Eze and Lior Shamir. Analysis and prevention of AI-based phishing email attacks. Electronics , 13(10):1839, 2024. -
  49. [72][72] Richard Fang, Rohan Bindu, Akul Gupta, and Daniel Kang. LLM agents can autonomously exploit oneday vulnerabilities. arXiv preprint arXiv:2404.08144 , 2024. - · arXiv
  50. [73][73] Richard Fang, Rohan Bindu, Akul Gupta, Qiusi Zhan, and Daniel Kang. Teams of LLM agents can exploit zero-day vulnerabilities. arXiv preprint arXiv:2406.01637 , 2024. - · arXiv
  51. [74][74] Mohamed Amine Ferrag, Fatima Alwahedi, Ammar Battah, Bilel Cherif, Abdechakour Mechri, and Norbert Tihanyi. Generative ai and large language models for cyber security: All insights you need. arXiv preprint arXiv:2405.12750 , 2024. - · arXiv
  52. [77][77] Yanjun Fu, Ethan Baker, Yu Ding, and Yizheng Chen. Constrained decoding for secure code generation. arXiv preprint arXiv:2405.00218 , 2024. - · arXiv
  53. [78][78] Yu Gai, Liyi Zhou, Kaihua Qin, Dawn Song, and Arthur Gervais. Blockchain large language models. arXiv preprint arXiv:2304.12749 , 2023. - · arXiv
  54. [81][81] Luca Gioacchini, Marco Mellia, Idilio Drago, Alexander Delsanto, Giuseppe Siracusano, and Roberto Bifulco. AutoPenBench: Benchmarking Generative Agents for Penetration Testing. arXiv preprint arXiv:2410.03225 , 2024. - · arXiv
  55. [82][82] Sahil Girhepuje, Aviral Verma, and Gaurav Raina. A survey on offensive ai within cybersecurity. arXiv preprint arXiv:2410.03566 , 2024. - · arXiv
  56. [85][85] Katja Grace, Harlan Stewart, Julia Fabienne Sandkühler, Stephen Thomas, Ben Weinstein-Raun, and Jan Brauner. Thousands of AI authors on the future of AI. arXiv preprint arXiv:2401.02843 , 2024. - · arXiv
  57. [86][86] Alex Gu, Baptiste Rozière, Hugh Leather, Armando Solar-Lezama, Gabriel Synnaeve, and Sida I Wang. CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution. arXiv preprint arXiv:2401.03065 , 2024. - · arXiv
  58. [87][87] Jiawei Gu, Xuhui Jiang, Zhichao Shi, Hexiang Tan, Xuehao Zhai, Chengjin Xu, Wei Li, Yinghan Shen, Shengjie Ma, Honghao Liu, et al. A Survey on LLMas-a-Judge. arXiv preprint arXiv:2411.15594 , 2024. - · arXiv
  59. [88][88] Sam Gunn, Xuandong Zhao, and Dawn Song. An undetectable watermark for generative image models. arXiv preprint arXiv:2410.07369 , 2024. - · arXiv
  60. [89][89] Chengquan Guo, Xun Liu, Chulin Xie, Andy Zhou, Yi Zeng, Zinan Lin, Dawn Song, and Bo Li. RedCode: Risky Code Execution and Generation Benchmark for Code Agents. arXiv preprint arXiv:2411.07781 , 2024. - · arXiv
  61. [90][90] Jinyao* Guo, Chengpeng* Wang, Xiangzhe Xu, Zian Su, and Xiangyu Zhang. Repoaudit: An autonomous llm-agent for repository-level code auditing. In Proceedings of the 42nd International Conference on Machine Learning , 2025. *Equal contribution. -
  62. [91][91] Wenbo Guo, Dongliang Mu, Xinyu Xing, Min Du, and Dawn Song. { DEEPVSA } : Facilitating value-set analysis with deep learning for postmortem program analysis. In 28th USENIX Security Symposium (USENIX Security 19) , pages 1787-1804, 2019. -
  63. [92][92] Satyandra Guthula, Navya Battula, Roman Beltiukov, Wenbo Guo, and Arpit Gupta. netfound: Foundation model for network security. arXiv preprint arXiv:2310.17025 , 2023. - · arXiv
  64. [95][95] Andreas Happe and Jürgen Cito. Getting pwn'd by AI: Penetration Testing with Large Language Models. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering , pages 2082-2086, 2023. -
  65. [97][97] Andreas Happe, Aaron Kaplan, and Jürgen Cito. Evaluating llms for privilege-escalation scenarios. arXiv preprint arXiv:2310.11409 , 2023. - · arXiv
  66. [98][98] Rachel M Harrison, Ekaterina Lapteva, and Anton Bibin. Behavioral Nudging With Generative AI for Content Development in SMS Health Care Interventions: Case Study. JMIR AI , 3(1):e52974, 2024. -
  67. [99][99] Mohammed Hassanin and Nour Moustafa. A comprehensive overview of large language models (llms) for cyber defences: Opportunities and directions. arXiv preprint arXiv:2405.14487 , 2024. - · arXiv
  68. [100][100] Jingxuan He, Gishor Sivanrupan, Petar Tsankov, and Martin Vechev. Learning to explore paths for symbolic execution. In Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security , CCS '21, page 2526-2540, New York, NY, USA, 2021. Association for Computing Machinery. -
  69. [101][101] Jingxuan He and Martin Vechev. Large language models for code: Security hardening and adversarial testing. In Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security , pages 1865-1879, 2023. -
  70. [102][102] Fred Heiding, Simon Lermen, Andrew Kao, Bruce Schneier, and Arun Vishwanath. Evaluating Large Language Models' Capability to Launch Fully Automated Spear Phishing Campaigns: Validated on Human Subjects. arXiv preprint arXiv:2412.00586 , 2024. - · arXiv
  71. [106][106] Eric Hilario, Sami Azam, Jawahar Sundaram, Khwaja Imran Mohammed, and Bharanidharan Shanmugam. Generative AI for Pentesting: The Good, the Bad, the Ugly. International Journal of Information Security , 2024. -
  72. [108][108] Briland Hitaj, Paolo Gasti, Giuseppe Ateniese, and Fernando Perez-Cruz. Passgan: A deep learning approach for password guessing. In Applied Cryptography and Network Security: 17th International Conference, ACNS 2019, Bogota, Colombia, June 5-7, 2019, Proceedings 17 , pages 217-237. Springer, 2019. -
  73. [109][109] Xinyi Hou, Yanjie Zhao, Yue Liu, Zhou Yang, Kailong Wang, Li Li, Xiapu Luo, David Lo, John Grundy, and Haoyu Wang. Large language models for software engineering: A systematic literature review. ACM Transactions on Software Engineering and Methodology , 33(8):1-79, 2024. -
  74. [111][111] Peiwei Hu, Ruigang Liang, and Kai Chen. DeGPT: Optimizing Decompiler Output with LLM . In Proceedings 2024 Network and Distributed System Security Symposium , volume 267622140, 2024. -
  75. [112][112] Daniel Huang, Prafulla Dhariwal, Dawn Song, and Ilya Sutskever. Gamepad: A learning environment for theorem proving. arXiv preprint arXiv:1806.00608 , 2018. - · arXiv
  76. [113][113] Linghan Huang, Peizhou Zhao, Huaming Chen, and Lei Ma. Large language models based fuzzing techniques: A survey. arXiv preprint arXiv:2402.00350 , 2024. - · arXiv
  77. [114][114] Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, et al. Gpt4o system card. arXiv preprint arXiv:2410.21276 , 2024. - · arXiv
  78. [116][116] Imperva. AI-driven Attacks Targeting Retailers Ahead of the Holiday Shopping Season. https: //www.imperva.com/company/press\_releases/ ai-driven-attacks-targeting-retailersahead-of-the-holiday-shopping-season/ , 2024. Accessed: 2024-11-07. -
  79. [117][117] Isamu Isozaki, Manil Shrestha, Rick Console, and Edward Kim. Towards Automated Penetration Testing: Introducing LLM Benchmark, Analysis, and Improvements. arXiv preprint arXiv:2410.17141 , 2024. - · arXiv
  80. [118][118] Linxi Jiang, Xin Jin, and Zhiqiang Lin. Beyond classification: Inferring function names in stripped binaries via domain adapted llms. In Proceedings of the 2025 on ACM SIGSAC Conference on Computer and Communications Security , 2025. -
  81. [119][119] Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan. Swe-bench: Can language models resolve real-world github issues? arXiv preprint arXiv:2310.06770 , 2023. - · arXiv
  82. [121][121] Adharsh Kamath, Aditya Senthilnathan, Saikat Chakraborty, Pantazis Deligiannis, Shuvendu K Lahiri, Akash Lal, Aseem Rastogi, Subhajit Roy, and Rahul Sharma. Finding inductive loop invariants using large language models. arXiv preprint arXiv:2311.07948 , 2023. - · arXiv
  83. [122][122] Daniel Kang, Xuechen Li, Ion Stoica, Carlos Guestrin, Matei Zaharia, and Tatsunori Hashimoto. Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks. In 2024 IEEE Security and Privacy Workshops (SPW) , pages 132-143. IEEE, 2024. -
  84. [123][123] Sayash Kapoor, Rishi Bommasani, Kevin Klyman, Shayne Longpre, Ashwin Ramaswami, Peter Cihon, Aspen Hopkins, Kevin Bankston, Stella Biderman, Miranda Bogen, et al. On the Societal Impact of Open Foundation Models. arXiv preprint arXiv:2403.07918 , 2024. - · arXiv
  85. [124][124] He Kong, Die Hu, Jingguo Ge, Liangxiong Li, Tong Li, and Bingzhen Wu. Vulnbot: Autonomous penetration testing for a multi-agent collaborative framework. arXiv preprint arXiv:2501.13411 , 2025. - · arXiv
  86. [125][125] Michael Kouremetis, Marissa Dotter, Alex Byrne, Dan Martin, Ethan Michalak, Gianpaolo Russo, Michael Threet, and Guido Zarrella. OCCULT: Evaluating Large Language Models for Offensive Cyber Operation Capabilities. arXiv preprint arXiv:2502.15797 , 2025. - · arXiv
  87. [126][126] Kalle Kujanpää, Willie Victor, and Alexander Ilin. Automating privilege escalation with deep reinforcement learning. In Proceedings of the 14th ACM workshop on artificial intelligence and security , pages 157-168, 2021. -
  88. [127][127] Ummay Kulsum, Haotian Zhu, Bowen Xu, and Marcelo d'Amorim. A Case Study of LLM for Automated Vulnerability Repair: Assessing Impact of Reasoning and Patch Validation Feedback. In Proceedings of the 1st ACM International Conference on AI-Powered Software , pages 103-111, 2024. -
  89. [130][130] Cristiana Cerqueira Leal and Benilde Oliveira. Nudging financial behavior in the age of artificial intelligence. In Artificial Intelligence in Production Engi- 11. neering and Management , pages 115-144. Elsevier, 2024. -
  90. [131][131] Ahmed Lekssays, Hamza Mouhcine, Khang Tran, Ting Yu, and Issa Khalil. LLMxCPG: Context-Aware Vulnerability Detection Through Code Property GraphGuided Large Language Models. In Proceedings of the 34th USENIX Security Symposium , 2025. -
  91. [133][133] Frank Li and Vern Paxson. A large-scale empirical study of security patches. In Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security , pages 2201-2215, 2017. -
  92. [134][134] Hongwei Li, Yuheng Tang, Shiqi Wang, and Wenbo Guo. Patchpilot: A stable and cost-efficient agentic patching framework. arXiv preprint arXiv:2502.02747 , 2025. - · arXiv
  93. [135][135] Ying Li, Gang Wang, Yuan Tian, et al. Sok: Towards effective automated vulnerability repair. arXiv preprint arXiv:2501.18820 , 2025. - · arXiv
  94. [136][136] Zhaoyu Li, Jinpei Guo, and Xujie Si. G4satbench: Benchmarking and advancing sat solving with graph neural networks. arXiv preprint arXiv:2309.16941 , 2023. - · arXiv
  95. [137][137] Ziyang Li, Saikat Dutta, and Mayur Naik. LLMAssisted Static Analysis for Detecting Security Vulnerabilities. arXiv preprint arXiv:2405.17238 , 2024. - · arXiv
  96. [138][138] Ziyang Li, Saikat Dutta, and Mayur Naik. IRIS: LLMAssisted Static Analysis for Detecting Security Vulnerabilities. In The Thirteenth International Conference on Learning Representations , 2025. -
  97. [139][139] Zeyi Liao, Lingbo Mo, Chejian Xu, Mintong Kang, Jiawei Zhang, Chaowei Xiao, Yuan Tian, Bo Li, and Huan Sun. Eia: Environmental injection attack on generalist web agents for privacy leakage. arXiv preprint arXiv:2409.11295 , 2024. - · arXiv
  98. [140][140] Fernando Antonio Flores Limo, David Raul Hurtado Tiza, Maribel Mamani Roque, Edward Espinoza Herrera, José Patricio Muñoz Murillo, Jorge Jinchuña Huallpa, Victor Andre Ariza Flores, Alejandro Guadalupe Rincón Castillo, Percy Fritz Puga Peña, Christian Paolo Martel Carranza, et al. Personalized tutoring: ChatGPT as a virtual tutor for personalized learning experiences. Przestrze´ n Społeczna (Social Space) , 23(1):293-312, 2023. -
  99. [141][141] Ruyan Lin, Yulong Fu, Wei Yi, Jincheng Yang, Jin Cao, Zhiqiang Dong, Fei Xie, and Hui Li. Vulnerabilities and Security Patches Detection in OSS: A Survey. ACM Computing Surveys , 2024. -
  100. [142][142] Xinjie Lin, Gang Xiong, Gaopeng Gou, Zhen Li, Junzheng Shi, and Jing Yu. Et-bert: A contextualized datagram representation with pre-training transformers for encrypted traffic classification. In Proceedings of the ACM Web Conference 2022 , pages 633-642, 2022. -
  101. [143][143] Aiwei Liu, Leyi Pan, Yijian Lu, Jingjing Li, Xuming Hu, Xi Zhang, Lijie Wen, Irwin King, Hui Xiong, and Philip Yu. A survey of text watermarking in the era of large language models. ACM Computing Surveys , 57(2):1-36, 2024. -
  102. [144][144] Aiwei Liu, Qiang Sheng, and Xuming Hu. Preventing and detecting misinformation generated by large language models. In Proceedings of the 47th International ACMSIGIR Conference on Research and Development in Information Retrieval , pages 3001-3004, 2024. -
  103. [145][145] Fengyu Liu, Yuan Zhang, Jiaqi Luo, Jiarun Dai, Tian Chen, Letian Yuan, Zhengmin Yu, Youkun Shi, Ke Li, Chengyuan Zhou, et al. Make Agent Defeat Agent: Automatic Detection of Taint-Style Vulnerabilities in LLM-based Agents. In 34rd USENIX Security Symposium (USENIX Security 25) , 2025. -
  104. [146][146] Side Liu, Jiang Ming, Guodong Zhou, Xinyi Liu, Jianming Fu, and Guojun Peng. Analyzing pdfs like binaries: Adversarially robust PDF malware analysis via intermediate representation and language model. CoRR , abs/2506.17162, 2025. - · arXiv
  105. [147][147] Ye Liu, Yue Xue, Daoyuan Wu, Yuqiang Sun, Yi Li, Miaolei Shi, and Yang Liu. Propertygpt: Llm-driven formal verification of smart contracts through retrievalaugmented property generation. In 32nd Annual Network and Distributed System Security Symposium, NDSS 2025, San Diego, California, USA, February 2428, 2025 . The Internet Society, 2025. -
  106. [148][148] Yi Liu, Gelei Deng, Yuekang Li, Kailong Wang, Zihao Wang, Xiaofeng Wang, Tianwei Zhang, Yepang Liu, Haoyu Wang, Yan Zheng, et al. Prompt injection attack against llm-integrated applications. arXiv preprint arXiv:2306.05499 , 2023. - · arXiv
  107. [150][150] Chloe Loughridge, Qinyi Sun, Seth Ahrenbach, Federico Cassano, Chuyue Sun, Ying Sheng, Anish Mudide, Md Rakib Hossain Misu, Nada Amin, and Max Tegmark. Dafnybench: A benchmark for formal software verification. arXiv preprint arXiv:2406.08467 , 2024. - · arXiv
  108. [151][151] Guilong Lu, Xiaolin Ju, Xiang Chen, Wenlong Pei, and Zhilong Cai. GRACE: Empowering LLM-based software vulnerability detection with graph structure and in-context learning. Journal of Systems and Software , 212:112031, 2024. -
  109. [152][152] Weidi Luo, Siyuan Ma, Xiaogeng Liu, Xiaoyu Guo, and Chaowei Xiao. Jailbreakv-28k: A benchmark for assessing the robustness of multimodal large language models against jailbreak attacks. arXiv preprint arXiv:2404.03027 , 2024. - · arXiv
  110. [156][156] Xiang Mei, Pulkit Singh Singaria, Jordi Del Castillo, Haoran Xi, Tiffany Bao, Ruoyu Wang, Yan Shoshitaishvili, Adam Doupé, Hammond Pearce, Brendan Dolan-Gavitt, et al. Arvo: Atlas of reproducible vulnerabilities for open source software. arXiv preprint arXiv:2408.02153 , 2024. - · arXiv
  111. [158][158] Ruijie Meng, Gregory J Duck, and Abhik Roychoudhury. Large language model assisted hybrid fuzzing. arXiv preprint arXiv:2412.15931 , 2024. - · arXiv
  112. [159][159] Ruijie Meng, Martin Mirchev, Marcel Böhme, and Abhik Roychoudhury. Large language model guided protocol fuzzing. In Proceedings of the 31st Annual Network and Distributed System Security Symposium (NDSS) , 2024. -
  113. [160][160] Xiangxin Meng, Zexiong Ma, Pengfei Gao, and Chao Peng. An Empirical Study on LLM-based Agents for Automated Bug Fixing. arXiv preprint arXiv:2411.10213 , 2024. - · arXiv
  114. [162][162] Jonathan Metzman, László Szekeres, Laurent Simon, Read Sprabery, and Abhishek Arya. Fuzzbench: an open fuzzer benchmarking platform and service. In Proc. of ESEC/FSE , 2021. -
  115. [165][165] Dongliang Mu, Wenbo Guo, Alejandro Cuevas, Yueqi Chen, Jinxuan Gai, Xinyu Xing, Bing Mao, and Chengyu Song. Renn: Efficient reverse execution with neural-network-assisted alias analysis. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) , pages 924-935. IEEE, 2019. -
  116. [166][166] Sidwendluian Romaric Nana, Didier Bassolé, Désiré Guel, and Oumarou Sié. Deep Learning and Web Applications Vulnerabilities Detection: An Approach Based on Large Language Models. International Journal of Advanced Computer Science & Applications , 15(7), 2024. -
  117. [167][167] Yuzhou Nie, Yanting Wang, Jinyuan Jia, Michael J De Lucia, Nathaniel D Bastian, Wenbo Guo, and Dawn Song. Trojfm: Resource-efficient backdoor attacks against very large foundation models. arXiv preprint arXiv:2405.16783 , 2024. - · arXiv
  118. [169][169] Vikram Nitin, Baishakhi Ray, and Roshanak Zilouchian Moghaddam. Faultline: Automated proof-ofvulnerability generation using llm agents. arXiv preprint arXiv:2507.15241 , 2025. - · arXiv
  119. [170][170] Yu Nong, Haoran Yang, Long Cheng, Hongxin Hu, and Haipeng Cai. APPATCH: Automated Adaptive Prompting Large Language Models for Real-World Software Vulnerability Patching. In Proceedings of the 34th USENIX Security Symposium (USENIX Security '25) , August 2025. -
  120. [171][171] Yaroslav Oliinyk, Michael Scott, Ryan Tsang, Chongzhou Fang, Houman Homayoun, et al. Fuzzing BusyBox: Leveraging LLM and Crash Reuse for Embedded Bug Unearthing. arXiv preprint arXiv:2403.03897 , 2024. - · arXiv
  121. [176][176] Yin Minn Pa Pa, Shunsuke Tanizaki, Tetsui Kou, Michel Van Eeten, Katsunari Yoshioka, and Tsutomu Matsumoto. An attacker's dream? exploring the capabilities of chatgpt for developing malware. In Proceedings of the 16th Cyber Security Experimentation and Test Workshop , pages 10-18, 2023. -
  122. [177][177] Leyi Pan, Aiwei Liu, Zhiwei He, Zitian Gao, Xuandong Zhao, Yijian Lu, Binglin Zhou, Shuliang Liu, Xuming Hu, Lijie Wen, et al. Markllm: An opensource toolkit for llm watermarking. arXiv preprint arXiv:2405.10051 , 2024. - · arXiv
  123. [178][178] Kapil Patil and Bhavin Desai. Leveraging LLM for Zero-Day Exploit Detection in Cloud Networks. Asian American Research Letters Journal , 1(4), 2024. -
  124. [179][179] Hammond Pearce, Baleegh Ahmad, Benjamin Tan, Brendan Dolan-Gavitt, and Ramesh Karri. Asleep at the keyboard? assessing the security of github copilot's code contributions. In 2022 IEEE Symposium on Security and Privacy (SP) , pages 754-768. IEEE, 2022. -
  125. [180][180] Hammond Pearce, Benjamin Tan, Baleegh Ahmad, Ramesh Karri, and Brendan Dolan-Gavitt. Examining zero-shot vulnerability repair with large language models. In 2023 IEEE Symposium on Security and Privacy (SP) , pages 2339-2356. IEEE, 2023. -
  126. [181][181] Kexin Pei, David Bieber, Kensen Shi, Charles Sutton, and Pengcheng Yin. Can large language models reason about program invariants? In International Conference on Machine Learning , pages 27496-27520. PMLR, 2023. -
  127. [182][182] Kexin Pei, Jonas Guan, David Williams-King, Junfeng Yang, and Suman Jana. Xda: Accurate, robust disassembly with transfer learning. arXiv preprint arXiv:2010.00770 , 2020. - · arXiv
  128. [183][183] Mary Phuong, Matthew Aitchison, Elliot Catt, Sarah Cogan, Alexandre Kaskasoli, Victoria Krakovna, David Lindner, Matthew Rahtz, Yannis Assael, Sarah Hodkinson, et al. Evaluating frontier models for dangerous capabilities. arXiv preprint arXiv:2403.13793 , 2024. - · arXiv
  129. [184][184] Andreas Plesner, Tobias Vontobel, and Roger Wattenhofer. Breaking recaptchav2. In 2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC) , pages 1047-1056. IEEE, 2024. -
  130. [185][185] Yujin Potter, Shiyang Lai, Junsol Kim, James Evans, and Dawn Song. Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voters. arXiv preprint arXiv:2410.24190 , 2024. - · arXiv
  131. [186][186] Moumita Das Purba, Arpita Ghosh, Benjamin J Radford, and Bill Chu. Software vulnerability detection using large language models. In 2023 IEEE 34th International Symposium on Software Reliability Engineering Workshops (ISSREW) , pages 112-119. IEEE, 2023. -
  132. [187][187] Md Nakhla Rafi, Dong Jae Kim, Tse-Hsun Chen, and Shaowei Wang. Enhancing fault localization through ordered code analysis with llm agents and selfreflection. arXiv preprint arXiv:2409.13642 , 2024. - · arXiv
  133. [188][188] Md Mostafizer Rahman and Yutaka Watanobe. ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences , 13(9):5783, 2023. -
  134. [189][189] Pranav Rajpurkar, Robin Jia, and Percy Liang. Know what you don't know: Unanswerable questions for squad. arXiv preprint arXiv:1806.03822 , 2018. - · arXiv
  135. [190][190] Md Shohel Rana, Mohammad Nur Nobi, Beddhu Murali, and Andrew H Sung. Deepfake detection: A systematic literature review. IEEE access , 10:2549425513, 2022. -
  136. [195][195] Devjeet Roy, Xuchao Zhang, Rashi Bhave, Chetan Bansal, Pedro Las-Casas, Rodrigo Fonseca, and Saravan Rajmohan. Exploring llm-based agents for root cause analysis. In Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering , pages 208-219, 2024. -
  137. [197][197] Siva Sai, Utkarsh Yashvardhan, Vinay Chamola, and Biplab Sikdar. Generative AI for Cyber Security: Analyzing the Potential of ChatGPT, DALL-E, and Other Models for Enhancing the Security Space. IEEE Access , 2024. -
  138. [199][199] Thulasi M Santhi and K Srinivasan. Chat-GPT Based Learning Platform for Creation of Different Attack Model Signatures and Development of Defense Algorithm for Cyberattack Detection. IEEE Transactions on Learning Technologies , 2024. -
  139. [200][200] Saskia Laura Schröer, Giovanni Apruzzese, Soheil Human, Pavel Laskov, Hyrum S Anderson, Edward WN Bernroider, Aurore Fass, Ben Nassi, Vera Rimmer, Fabio Roli, et al. SoK: On the offensive potential of AI. In 2025 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) , pages 247-280. IEEE, 2025. -
  140. [205][205] Mohammad Setak and Pooria Madani. Fine-Tuning LLMs for Code Mutation: A New Era of Cyber Threats. In 2024 IEEE 6th International Conference on Trust, Privacy and Security in Intelligent Systems, and Applications (TPS-ISA) , pages 313-321. IEEE, 2024. -
  141. [206][206] Rohin Shah, Alex Irpan, Alexander Matt Turner, Anna Wang, Arthur Conmy, David Lindner, Jonah BrownCohen, Lewis Ho, Neel Nanda, Raluca Ada Popa, et al. An Approach to Technical AGI Safety and Security. arXiv preprint arXiv:2504.01849 , 2025. - · arXiv
  142. [207][207] Minghao Shao, Sofija Jancheska, Meet Udeshi, Brendan Dolan-Gavitt, Haoran Xi, Kimberly Milner, Boyuan Chen, Max Yin, Siddharth Garg, Prashanth Krishnamurthy, et al. NYU CTF Dataset: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security. arXiv preprint arXiv:2406.05590 , 2024. - · arXiv
  143. [209][209] Ze Sheng, Zhicheng Chen, Shuning Gu, Heqing Huang, Guofei Gu, and Jeff Huang. Large Language Models in Software Security: A Survey of Vulnerability Detection Techniques and Insights. arXiv preprint arXiv:2502.07049 , 2025. - · arXiv
  144. [210][210] Alexey Shestov, Anton Cheshkov, Rodion Levichev, Ravil Mussabayev, Pavel Zadorozhny, Evgeny Maslov, Chibirev Vadim, and Egor Bulychev. Finetuning large language models for vulnerability detection. arXiv preprint arXiv:2401.17010 , 2024. - · arXiv
  145. [211][211] Wenxuan Shi, Hongwei Li, Jiahao Yu, Wenbo Guo, and Xinyu Xing. Bandfuzz: A practical framework for collaborative fuzzing with reinforcement learning. In Proceedings of the 17th ACM/IEEE International Workshop on Search-Based and Fuzz Testing , pages 55-56, 2024. -
  146. [212][212] Wenxuan Shi, Yunhang Zhang, Xinyu Xing, and Jun Xu. Harnessing large language models for seed generation in greybox fuzzing. arXiv preprint arXiv:2411.18143 , 2024. - · arXiv
  147. [213][213] Eui Chul Richard Shin, Dawn Song, and Reza Moazzezi. Recognizing functions in binaries with neural networks. In 24th USENIX security symposium (USENIX Security 15) , pages 611-626, 2015. -
  148. [215][215] Brian Singer, Keane Lucas, Lakshmi Adiga, Meghna Jain, Lujo Bauer, and Vyas Sekar. On the Feasibility of Using LLMs to Execute Multistage Network Attacks. arXiv preprint arXiv:2501.16466 , 2025. - · arXiv
  149. [218][218] Dominik Sobania, Martin Briesch, Carol Hanna, and Justyna Petke. An analysis of the automatic bug fixing performance of chatgpt. In 2023 IEEE/ACM International Workshop on Automated Program Repair (APR) , pages 23-30. IEEE, 2023. -
  150. [219][219] AH Sahna Sreen and MHM Majid. Leveraging ChatGPT for Personalized Learning: A systematic Review in Educational Settings. Amandemen: Journal of Learning, Teaching and Educational Studies , 2(1):6378, 2024. -
  151. [220][220] Kyle Stein, Andrew A Mahyari, Guillermo Francia III, and Eman El-Sheikh. Towards Novel Malicious Packet Recognition: A Few-Shot Learning Approach. arXiv preprint arXiv:2409.11254 , 2024. - · arXiv
  152. [223][223] Maolin Sun, Yibiao Yang, Yang Wang, Ming Wen, Haoxiang Jia, and Yuming Zhou. Smt solver validation empowered by large pre-trained language models. In 2023 38th IEEE/ACM International Conference on - Automated Software Engineering (ASE) , pages 12881300. IEEE, 2023. -
  153. [224][224] Yuqiang Sun, Daoyuan Wu, Yue Xue, Han Liu, Wei Ma, Lyuye Zhang, Yang Liu, and Yingjiu Li. LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning. arXiv preprint arXiv:2401.16185 , 2024. - · arXiv
  154. [225][225] Yuqiang Sun, Daoyuan Wu, Yue Xue, Han Liu, Haijun Wang, Zhengzi Xu, Xiaofei Xie, and Yang Liu. GPTScan: Detecting Logic Vulnerabilities in Smart Contracts by Combining GPT with Program Analysis. In Proceedings of the IEEE/ACM 46th International Conference on Software Engineering , pages 113, 2024. -
  155. [226][226] Annalisa Szymanski, Noah Ziems, Heather A EicherMiller, Toby Jia-Jun Li, Meng Jiang, and Ronald A Metoyer. Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks. In Proceedings of the 30th International Conference on Intelligent User Interfaces , pages 952966, 2025. -
  156. [227][227] Wesley Tann, Yuancheng Liu, Jun Heng Sim, Choon Meng Seah, and Ee-Chien Chang. Using large language models for cybersecurity capture-the-flag challenges and certification questions. arXiv preprint arXiv:2308.10443 , 2023. - · arXiv
  157. [228][228] Sheetal Temara. Maximizing penetration testing success with effective reconnaissance techniques using chatgpt. arXiv preprint arXiv:2307.06391 , 2023. - · arXiv
  158. [229][229] Norbert Tihanyi, Mohamed Amine Ferrag, Ridhi Jain, and Merouane Debbah. Cybermetric: A benchmark dataset for evaluating large language models knowledge in cybersecurity. arXiv preprint arXiv:2402.07688 , 2024. - · arXiv
  159. [230][230] Catherine Tony, Markus Mutas, Nicolás E Díaz Ferreyra, and Riccardo Scandariato. LLMSecEval: A Dataset of Natural Language Prompts for Security Evaluations. In 2023 IEEE/ACM 20th International Conference on Mining Software Repositories (MSR) , pages 588-592. IEEE, 2023. -
  160. [231][231] Miguel Tulla, Andrea Vignali, Christian Colon, Giancarlo Sperli, Simon Pietro Romano, Masataro Asai, Una-May O'Reilly, and Erik Hemberg. ALFAChains: AI-Supported Discovery of Privilege Escalation and Remote Exploit Chains. arXiv preprint arXiv:2504.07287 , 2025. - · arXiv
  161. [232][232] Saad Ullah, Mingji Han, Saurabh Pujar, Hammond Pearce, Ayse Coskun, and Gianluca Stringhini. Llms - cannot reliably identify and reason about security vulnerabilities (yet?): A comprehensive evaluation, framework, and benchmarks. In IEEE Symposium on Security and Privacy , 2024. -
  162. [233][233] Yusuf Usman, Aadesh Upadhyay, Prashnna Gyawali, and Robin Chataut. Is generative ai the next tactical cyber weapon for threat actors? unforeseen implications of ai generated cyber attacks. arXiv preprint arXiv:2408.12806 , 2024. - · arXiv
  163. [235][235] A Vaswani. Attention is all you need. Advances in Neural Information Processing Systems , 2017. -
  164. [236][236] Mark Vero, Niels Mündler, Victor Chibotaru, Veselin Raychev, Maximilian Baader, Nikola Jovanovi´ c, Jingxuan He, and Martin Vechev. Baxbench: Can LLMs generate correct and secure backends? In Forty-second International Conference on Machine Learning , 2025. -
  165. [237][237] R Vinayakumar, Mamoun Alazab, K P Soman, Prabaharan Poornachandran, and Sitalakshmi Venkatraman. Robust intelligent malware detection using deep learning. IEEE Access , 7:46717-46738, 2019. -
  166. [239][239] Johan Wahréus, Ahmed Mohamed Hussain, and Panos Papadimitratos. Cysecbench: Generative aibased cybersecurity-focused prompt dataset for benchmarking large language models. arXiv preprint arXiv:2501.01335 , 2025. - · arXiv
  167. [240][240] Shengye Wan, Cyrus Nikolaidis, Daniel Song, David Molnar, James Crnkovich, Jayson Grace, Manish Bhatt, Sahana Chennabasappa, Spencer Whitman, Stephanie Ding, et al. CYBERSECEVAL 3: Advancing the Evaluation of Cybersecurity Risks and Capabilities in Large Language Models. arXiv preprint arXiv:2408.01605 , 2024. - · arXiv
  168. [241][241] Boxin Wang, Weixin Chen, Hengzhi Pei, Chulin Xie, Mintong Kang, Chenhui Zhang, Chejian Xu, Zidi Xiong, Ritik Dutta, Rylan Schaeffer, et al. Decodingtrust: A comprehensive assessment of trustworthiness in gpt models. In NeurIPS , 2023. -
  169. [242][242] Ding Wang, Yunkai Zou, Zijian Zhang, and Kedong Xiu. Password guessing using random forest. In 32nd USENIX Security Symposium (USENIX Security 23) , pages 965-982, 2023. -
  170. [243][243] Lingzhi Wang, Jiahui Wang, Kyle Jung, Kedar Thiagarajan, Emily Wei, Xiangmin Shen, Yan Chen, and Zhenyuan Li. From sands to mansions: Enabling automatic full-life-cycle cyberattack construction with llm. arXiv preprint arXiv:2407.16928 , 2024. - · arXiv
  171. [244][244] Qinglong Wang, Wenbo Guo, Kaixuan Zhang, Alexander G Ororbia, Xinyu Xing, Xue Liu, and C Lee Giles. Adversary resistant deep neural networks with an application to malware detection. In Proceedings of the 23rd ACM sigkdd international conference on knowledge discovery and data mining , pages 1145-1153, 2017. -
  172. [245][245] Wenhan Wang, Kaibo Liu, An Ran Chen, Ge Li, Zhi Jin, Gang Huang, and Lei Ma. Python symbolic execution with llm-powered code generation. arXiv preprint arXiv:2409.09271 , 2024. - · arXiv
  173. [246][246] Xingyao Wang, Boxuan Li, Yufan Song, Frank F Xu, Xiangru Tang, Mingchen Zhuge, Jiayi Pan, Yueqi Song, Bowen Li, Jaskirat Singh, et al. Openhands: An open platform for ai software developers as generalist agents. arXiv preprint arXiv:2407.16741 , 2024. - · arXiv
  174. [247][247] Zhun Wang, Tianneng Shi, Jingxuan He, Matthew Cai, Jialin Zhang, and Dawn Song. CyberGym: Evaluating AI Agents' Cybersecurity Capabilities with Real-World Vulnerabilities at Scale. arXiv preprint arXiv:2506.02548 , 2025. - · arXiv
  175. [248][248] Zhun Wang, Vincent Siu, Zhe Ye, Tianneng Shi, Yuzhou Nie, Xuandong Zhao, Chenguang Wang, Wenbo Guo, and Dawn Song. Agentvigil: Generic black-box red-teaming for indirect prompt injection against llm agents. In Findings of the Association for Computational Linguistics: EMNLP , 2025. -
  176. [249][249] Colin White, Samuel Dooley, Manley Roberts, Arka Pal, Ben Feuer, Siddhartha Jain, Ravid Shwartz-Ziv, Neel Jain, Khalid Saifullah, Siddartha Naidu, et al. Livebench: A challenging, contamination-free llm benchmark. arXiv preprint arXiv:2406.19314 , 2024. - · arXiv
  177. [251][251] Haoze Wu, Clark Barrett, and Nina Narodytska. Lemur: Integrating large language models in automated program verification. arXiv preprint arXiv:2310.04870 , 2023. - · arXiv
  178. [252][252] Xian Wu, Wenbo Guo, Jia Yan, Baris Coskun, and Xinyu Xing. From grim reality to practical solution: 11. Malware classification in real-world noise. In 2023 IEEE Symposium on Security and Privacy (SP) , pages 2602-2619. IEEE, 2023. -
  179. [255][255] Jiacen Xu, Jack W Stokes, Geoff McDonald, Xuesong Bai, David Marshall, Siyue Wang, Adith Swaminathan, and Zhou Li. Autoattacker: A large language model guided system to implement automatic cyber-attacks. arXiv preprint arXiv:2403.01038 , 2024. - · arXiv
  180. [256][256] Xiangzhe Xu, Zhuo Zhang, Zian Su, Ziyang Huang, Shiwei Feng, Yapeng Ye, Nan Jiang, Danning Xie, Siyuan Cheng, Lin Tan, et al. Unleashing the Power of Generative Model in Recovering Variable Names from Stripped Binary. In Proceedings of the Network and Distributed System Security Symposium (NDSS) , 2025. -
  181. [257][257] Xiaojun Xu, Chang Liu, Qian Feng, Heng Yin, Le Song, and Dawn Song. Neural network-based graph embedding for cross-platform binary code similarity detection. In Proceedings of the 2017 ACM SIGSAC conference on computer and communications security , pages 363-376, 2017. -
  182. [258][258] Aidan ZH Yang, Claire Le Goues, Ruben Martins, and Vincent Hellendoorn. Large language models for testfree fault localization. In Proceedings of the 46th IEEE/ACM International Conference on Software Engineering , pages 1-12, 2024. -
  183. [259][259] Chenyuan Yang, Zijie Zhao, and Lingming Zhang. KernelGPT: Enhanced Kernel Fuzzing via Large Language Models. arXiv preprint arXiv:2401.00563 , 2023. - · arXiv
  184. [260][260] Guang Yang, Yu Zhou, Xiang Chen, Xiangyu Zhang, Tingting Han, and Taolue Chen. ExploitGen: Templateaugmented exploit code generation based on CodeBERT. Journal of Systems and Software , 197:111577, 2023. -
  185. [261][261] John Yang, Carlos E Jimenez, Alex L Zhang, Kilian Lieret, Joyce Yang, Xindi Wu, Ori Press, Niklas Muennighoff, Gabriel Synnaeve, Karthik R Narasimhan, et al. SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains? arXiv preprint arXiv:2410.03859 , 2024. - · arXiv
  186. [262][262] John Yang, Akshara Prabhakar, Shunyu Yao, Kexin Pei, and Karthik R Narasimhan. Language agents as hackers: Evaluating cybersecurity skills with capture the flag. In Multi-Agent Security Workshop@ NeurIPS'23 , 2023. -
  187. [263][263] Kaiyu Yang, Gabriel Poesia, Jingxuan He, Wenda Li, Kristin Lauter, Swarat Chaudhuri, and Dawn Song. Formal Mathematical Reasoning: A New Frontier in AI. arXiv preprint arXiv:2412.16075 , 2024. - · arXiv
  188. [264][264] Limin Yang, Arridhana Ciptadi, Ihar Laziuk, Ali Ahmadzadeh, and Gang Wang. Bodmas: An open dataset for learning based temporal analysis of pe malware. In 2021 IEEE Security and Privacy Workshops (SPW) , pages 78-84. IEEE, 2021. -
  189. [265][265] Yu Yang, Yuzhou Nie, Zhun Wang, Yuheng Tang, Wenbo Guo, Bo Li, and Dawn Song. SecCodePLT: A Unified Platform for Evaluating the Security of Code GenAI. arXiv preprint arXiv:2410.11096 , 2024. - · arXiv
  190. [267][267] Jiahao Yu, Xian Wu, Hao Liu, Wenbo Guo, and Xinyu Xing. BlockFound: Customized blockchain foundation model for anomaly detection. arXiv preprint arXiv:2410.04039 , 2024. - · arXiv
  191. [268][268] Jiaxin Yu, Peng Liang, Yujia Fu, Amjed Tahir, Mojtaba Shahin, Chong Wang, and Yangxiao Cai. Security code review by llms: A deep dive into responses. arXiv preprint arXiv:2401.16310 , 2024. - · arXiv
  192. [269][269] Longhui Yu, Weisen Jiang, Han Shi, Jincheng Yu, Zhengying Liu, Yu Zhang, James T Kwok, Zhenguo Li, Adrian Weller, and Weiyang Liu. Metamath: Bootstrap your own mathematical questions for large language models. arXiv preprint arXiv:2309.12284 , 2023. - · arXiv
  193. [270][270] Zheng Yu, Ziyi Guo, Yuhang Wu, Jiahao Yu, Meng Xu, Dongliang Mu, Yan Chen, and Xinyu Xing. PATCHAGENT: A Practical Program Repair Agent Mimicking Human Expertise. In Proceedings of the 34th USENIX Security Symposium (USENIX Security '25) , August 2025. -
  194. [271][271] Nusrat Zahan, Philipp Burckhardt, Mikola Lysenko, Feross Aboukhadijeh, and Laurie Williams. Shifting the Lens: Detecting Malware in npm Ecosystem with Large Language Models. arXiv preprint arXiv:2403.12196 , 2024. - · arXiv
  195. [272][272] Daoguang Zan, Zhirong Huang, Ailun Yu, Shaoxin Lin, Yifan Shi, Wei Liu, Dong Chen, Zongshuai Qi, Hao Yu, Lei Yu, et al. Swe-bench-java: A github issue resolving benchmark for java. arXiv preprint arXiv:2408.14354 , 2024. - · arXiv
  196. [273][273] Pankaj Zanke. AI-Driven fraud detection systems: a comparative study across banking, insurance, and healthcare. Advances in Deep Learning Techniques , 3(2):1-22, 2023. -
  197. [275][275] Andy K Zhang, Joey Ji, Celeste Menders, Riya Dulepet, Thomas Qin, Ron Y Wang, Junrong Wu, Kyleen Liao, Jiliang Li, Jinghan Hu, et al. BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems. arXiv preprint arXiv:2505.15216 , 2025. - · arXiv
  198. [276][276] Andy K Zhang, Kevin Klyman, Yifan Mai, Yoav Levine, Yian Zhang, Rishi Bommasani, and Percy Liang. Language model developers should report traintest overlap. arXiv preprint arXiv:2410.08385 , 2024. - · arXiv
  199. [277][277] Andy K Zhang, Neil Perry, Riya Dulepet, Eliot Jones, Justin W Lin, Joey Ji, Celeste Menders, Gashon Hussein, Samantha Liu, Donovan Jasper, et al. Cybench: A framework for evaluating cybersecurity capabilities and risk of language models. arXiv preprint arXiv:2408.08926 , 2024. - · arXiv
  200. [278][278] Hongxiang Zhang, Yuyang Rong, Yifeng He, and Hao Chen. LLAMAFUZZ: Large Language Model Enhanced Greybox Fuzzing. arXiv preprint arXiv:2406.07714 , 2024. - · arXiv

200 of 209 shown

Cited by

Sorted by citations

Authors
Potter, Y., Guo, W., Wang, Z., Shi, T., Li, H., Zhang, A., Kelley, P. G., Thomas, K., & Song, D.
Affiliations
  • University of California, Santa Barbara (US)
  • Google (United States) (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2504.05408
arXiv
2504.05408
OpenAlex
W4415150987
Cited by
7
References
0
Citations by year
2026: 6 · 2025: 1
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
Keywords
frontier AI, AI agents, foundation models, cybersecurity, AI-driven attacks, workflow planning, domain-specific tools, security analysis, expert survey, AI risk mitigation, AI transparency, library instruction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review