Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents

de Witt, Christian Schroeder, Krawiecka, Klaudia, Krawczuk, Igor, Hagag, Ben, Anderson, William L., Belcak, Peter, Bucknall, Ben, Cai, Xiaohong +16 more·2025·arXiv

Cites (181)

Items 201–325 of 325

  1. Training Large Language Models to Reason in a Continuous Latent Space
    Hao, Shibo, Sukhbaatar, Sainbayar, Su, DiJia, Li, Xian, Hu, Zhiting, Weston, Jason, Tian, Yuandong · 2024 · arXiv
  2. Large-Language-Model-Powered Agent-Based Framework for Misinformation and Disinformation Research: Opportunities and Open Challenges
    Javier Pastor-Galindo, Pantaleone Nespoli, José A. Ruipérez‐Valiente · 2024 · IEEE Security & Privacy
  3. Why the search for a privacy-preserving data sharing mechanism is failing
    Theresa Stadler, C. Troncoso · 2022 · Nature Computational Science
  4. International AI Safety Report
    Bengio, Yoshua, Mindermann, Sören, Privitera, Daniel, Besiroglu, Tamay, Bommasani, Rishi, Casper, Stephen, Choi, Yejin, Fox, Philip, Garfinkel, Ben, Goldfarb, Danielle et al. · 2025 · arXiv
  5. Illusory Attacks: Information-theoretic detectability matters in adversarial attacks
    Tim Franzmeyer, Stephen Mcaleer, João F. Henriques · 2022 · International Conference on Learning Representations
  6. Defeating Prompt Injections by Design
    Debenedetti, Edoardo, Shumailov, Ilia, Fan, Tianqi, Hayes, Jamie, Carlini, Nicholas, Fabian, Daniel, Kern, Christoph, Shi, Chongyang, Terzis, Andreas, Tramèr, Florian · 2026 · 2026 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML)
  7. Secret Collusion among AI Agents: Multi-Agent Deception via Steganography
    Motwani, Sumeet, Baranchuk, Mikhail, Strohmeier, Martin, Bolina, Vijay, Torr, Philip, Hammond, Lewis, Witt, Christian De · 2024 · Advances in Neural Information Processing Systems 37
  8. MIP against Agent: Malicious Image Patches Hijacking Multimodal OS Agents
    Lukas Aichberger, Alasdair Paren, Guo-Hao Li, P. Torr, Yarin Gal, A. Bibi · 2025 · Neural Information Processing Systems
  9. Fundamental Limitations in Pointwise Defences of LLM Finetuning APIs
    Xander Davies, Eric Winsor, Alexandra Souly · 2025 · Neural Information Processing Systems
  10. Cooperative AI via Decentralized Commitment Devices
    Xin-Yuan Sun, Davide Crapis, Matthew Stephenson, B. Monnot, Thomas Thiery, Jonathan Passerat-Palmbach · 2023 · arXiv.org
  11. Reasoning about causality in games
    Hammond, Lewis, Fox, James, Everitt, Tom, Carey, Ryan, Abate, Alessandro, Wooldridge, Michael · 2023 · Artificial Intelligence
  12. PromptBench: A Unified Library for Evaluation of Large Language Models
    Zhu, Kaijie, Qinlin Zhao, Hao Chen · 2023 · arXiv (Cornell University)
  13. Market Manipulation: An Adversarial Learning Framework for Detection and Evasion
    Wang, Xintong, Wellman, Michael P. · 2020 · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence
  14. AgentBreeder: Mitigating the AI Safety Risks of Multi-Agent Scaffolds via Self-Improvement
    J. Rosser, J. Foerster · 2025 · Neural Information Processing Systems
  15. Enhancing Communication and Data Transmission Security in RAG Using Large Language Models
    Venkata Gummadi, Pamula Udayaraju, Venkata Rahul Sarabu, Chaitanya Ravulu, Dhanunjay Reddy Seelam, S. Venkataramana · 2024 · International Conference on Sustainable Expert Systems (ICSES)
  16. Distributional AGI Safety
    Nenad Tomasev, Matija Franklin, Julian Jacobs, S. Krier, Simon Osindero · 2025 · arXiv.org
  17. Multi-Agent Risks from Advanced AI
    Hammond, Lewis, Chan, Alan, Clifton, Jesse, Hoelscher-Obermaier, Jason, Khan, Akbir, McLean, Euan, Smith, Chandler, Barfuss, Wolfram, Foerster, Jakob, Gavenčiak, Tomáš et al. · 2025 · arXiv
  18. Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
    Putta, Pranav, Mills, Edmund, Garg, Naman, Motwani, Sumeet, Finn, Chelsea, Garg, Divyansh, Rafailov, Rafael · 2024 · arXiv
  19. Covert Data Exfiltration Using Light and Power Channels
    Patrick Cronin, Charles Gouert, Dimitris Mouris, Nektarios Georgios Tsoutsos, Chengmo Yang · 2019 · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD)
  20. Open Problems in Technical AI Governance
    Anka Reuel, Ben Bucknall, Stephen Casper, Tim Fist, Lisa Soder, Onni Aarne, Lewis Hammond, Lujain Ibrahim, Alan Chan, Wills, Peter et al. · 2024 · arXiv (Cornell University)
  21. Stop Reducing Responsibility in LLM-Powered Multi-Agent Systems to Local Alignment
    Jinwei Hu, Yi Dong, Shuang Ao · 2025 · arXiv.org
  22. Neural Interactive Proofs
    Lewis Hammond, Sam Adam-Day · 2024 · International Conference on Learning Representations
  23. Over and under commitment to a course of action in decisions from experience.
    Cohen, Doron, Erev, Ido · 2021 · Journal of Experimental Psychology: General
  24. CYBERSECEVAL 3: Advancing the Evaluation of Cybersecurity Risks and Capabilities in Large Language Models
    Wan, Shengye, Nikolaidis, Cyrus, Song, Daniel, Molnar, David, Crnkovich, James, Grace, Jayson, Bhatt, Manish, Chennabasappa, Sahana, Whitman, Spencer, Ding, Stephanie et al. · 2024 · arXiv
  25. Multi-Agent Security Tax: Trading Off Security and Collaboration Capabilities in Multi-Agent Systems
    Peigné, Pierre, Kniejski, Mikolaj, Sondej, Filip, David, Matthieu, Hoelscher-Obermaier, Jason, Schroeder de Witt, Christian, Kran, Esben · 2025 · Proceedings of the AAAI Conference on Artificial Intelligence
  26. Combating Informational Denial-of-Service (IDoS) Attacks: Modeling and Mitigation of Attentional Human Vulnerability
    Huang, Linan, Zhu, Quanyan · 2021 · Lecture Notes in Computer Science
  27. Learning to Manipulate a Financial Benchmark
    Megan Shearer, Gabriel V. Rauterberg, Michael P. Wellman · 2023 · ACM International Conference on AI in Finance (ICAIF)
  28. CTIBench: A Benchmark for Evaluating LLMs in Cyber Threat Intelligence
    Tanvirul Alam, Bhusal, Dipkamal, Nguyen, Le · 2024 · arXiv (Cornell University)
  29. "Create a Fear of Missing Out" - ChatGPT Implements Unsolicited Deceptive Designs in Generated Websites Without Warning
    Veronika Krauß, Mark McGill, Thomas Kosch, Yolanda Maira Thiel, Dominik Schön, Jan Gugenheimer · 2025 · CHI Conference on Human Factors in Computing Systems
  30. Commitment and extortion
    Harrenstein, Paul, Brandt, Felix, Fischer, Felix · 2007 · Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems
  31. Agent-Based Trust and Reputation Model in Smart IoT Environments
    Al-Shamaileh, Mohammad, Anthony, Patricia, Charters, Stuart · 2024 · Technologies
  32. AI Agent Tools and Frameworks
    Huang, Ken, Huang, Jerry · 2025 · Progress in IS
  33. A survey of agent-based modeling for cybersecurity
    Arnstein Vestad, Bian Yang · 2024 · Human Factors in Cybersecurity
  34. Frontier AI's Impact on the Cybersecurity Landscape
    Potter, Yujin, Guo, Wenbo, Wang, Zhun, Shi, Tianneng, Li, Hongwei, Zhang, Andy, Kelley, Patrick Gage, Thomas, Kurt, Song, Dawn · 2025 · arXiv
  35. Deception at Scale: Deceptive Designs in 1K LLM-Generated E-Commerce Components
    Chen, Ziwei, Shen, Jiawen, Luna, Zhang, Hanyu, Vaccaro, Kristen · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
  36. Canaries and Whistles: Resilient Drone Communication Networks with (or without) Deep Reinforcement Learning
    Chris Hicks, Vasilios Mavroudis, Myles Foley, Thomas Davies, Kate Highnam, Tim Watson · 2023 · ACM Workshop on Artificial Intelligence and Security (AISec)
  37. GridMind: LLMs-Powered Agents for Power System Analysis and Operations
    Hongwei Jin, Kibaek Kim, Jonghwan Kwon · 2025
  38. TradingAgents: Multi-Agents LLM Financial Trading Framework
    Xiao, Yijia, Sun, Edward, Luo, Di, Wang, Wei · 2024 · arXiv
  39. Agents of Chaos
    Shapira, Natalie, Wendler, Chris, Yen, Avery, Sarti, Gabriele, Pal, Koyena, Floody, Olivia, Belfki, Adam, Loftus, Alex, Jannali, Aditya Ratan, Prakash, Nikhil et al. · 2026 · arXiv
  40. Securing AI Agents with Information-Flow Control
    Costa, Manuel, Köpf, Boris, Kolluri, Aashish, Paverd, Andrew, Russinovich, Mark, Salem, Ahmed, Tople, Shruti, Wutschitz, Lukas, Zanella-Béguelin, Santiago · 2025 · arXiv
  41. A Game Theoretic Analysis of Additive Adversarial Attacks and Defenses
    Ambar Pal, René Vidal · 2020 · arXiv (Cornell University)
  42. PEAR: Planner-Executor Agent Robustness Benchmark
    Shen Dong, Ming-Xuan Zhang, Peng-Fei He, Li Ma, B. Thuraisingham, Hui Liu, Yue Xing · 2025 · Conference of the European Chapter of the Association for Computational Linguistics
  43. CAGE challenge 4: A scalable multi‐agent reinforcement learning gym for autonomous cyber defence
    Mitchell Kiely, Metin Ahiskali, Étienne Borde, Benjamin Bowman, David B. Bowman, Dirk Van Bruggen, K. C. Cowan, Prithviraj Dasgupta, Erich Devendorf, Ben Edwards et al. · 2025 · AI Magazine
  44. Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMs
    Yohan Mathew, Ollie Matthews, Robert McCarthy, Joan Velja, Christian A. Schroeder de Witt, Dylan Cope, Nandi Schoots · 2025 · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL)
  45. Teach LLMs to Phish: Stealing Private Information from Language Models
    Panda, Ashwinee, Choquette-Choo, Christopher A., Zhang, Zhengming, Yang, Yaoqing, Mittal, Prateek · 2024 · arXiv
  46. Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applications
    Cohen, Stav, Bitton, Ron, Nassi, Ben · 2024 · arXiv
  47. LongCoT: Benchmarking Long-Horizon Chain-of-Thought Reasoning
    S. Motwani, Daniel Nichols, Charles London et al. · 2026 · arXiv.org
  48. MALT: Improving Reasoning with Multi-Agent LLM Training
    Sumeet Motwani, Smith, Chandler, Rocktim Jyoti Das, Rafael Rafailov, Ivan Laptev A, Philip H. S. Torr, Fabio Pizzati, Clark, Ronald, de Witt, Christian Schroeder · 2024 · arXiv (Cornell University)
  49. Learning to Deceive in Multi-agent Hidden Role Games
    Aitchison, Matthew, Benke, Lyndon, Sweetser, Penny · 2021 · Communications in Computer and Information Science
  50. Neural Linguistic Steganography
    Zachary M. Ziegler, Yuntian Deng, Alexander M. Rush · 2019 · arXiv (Cornell University)
  51. The agentic AI landscape and its conceptual foundations
    OECD · 2026 · OECD artificial intelligence papers
  52. Rethinking Out-of-Distribution Detection for Reinforcement Learning: Advancing Methods for Evaluation and Detection
    Nasvytis, Linas, Sandbrink, Kai, Foerster, Jakob, Franzmeyer, Tim, Schroeder de Witt, Christian · 2024 · International Joint Conference on Autonomous Agents and Multiagent Systems
  53. Infrastructure for AI Agents
    Chan, Alan, Wei, Kevin, Huang, Sihao, Rajkumar, Nitarshan, Perrier, Elija, Lazar, Seth, Hadfield, Gillian K., Anderljung, Markus · 2025 · arXiv
  54. TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systems
    Ishan Kavathekar, Hemang Jain, Ameya Rathod · 2026 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  55. AI Control: Improving Safety Despite Intentional Subversion
    Greenblatt, Ryan, Shlegeris, Buck, Sachan, Kshitij, Roger, Fabien · 2023 · arXiv
  56. LLM Agents Making Agent Tools
    Wölflein, Georg, Ferber, Dyke, Truhn, Daniel, Arandjelović, Ognjen, Kather, Jakob Nikolas · 2025 · arXiv
  57. Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale
    Bonatti, Rogerio, Zhao, Dan, Bonacci, Francesco, Dupont, Dillon, Abdali, Sara, Li, Yinheng, Lu, Yadong, Wagle, Justin, Koishida, Kazuhito, Bucker, Arthur et al. · 2024 · arXiv
  58. Large Language Model Based Multi-Agent System Augmented Complex Event Processing Pipeline for Internet of Multimedia Things
    Zeeshan, Talha, Kumar, Abhishek, Pirttikangas, Susanna, Tarkoma, Sasu · 2025 · arXiv
  59. Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Models
    Andy K. Zhang, Neil Perry, Riya Dulepet et al. · 2024 · arXiv (Cornell University)
  60. Tamper-Proof Privacy Auditing for Artificial Intelligence Systems
    Sutton, Andrew, Samavi, Reza · 2018 · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
  61. Finding Needles in a Moving Haystack: Prioritizing Alerts with Adversarial Reinforcement Learning
    Liang Tong, Áron Lászka, Chao Yan · 2019 · arXiv (Cornell University)
  62. Evolving Diverse Red-team Language Models in Multi-round Multi-agent Games
    Chengdong Ma, Ziran Yang, Hai Ci · 2023 · arXiv (Cornell University)
  63. AutoGenesisAgent: Self-Generating Multi-Agent Systems for Complex Tasks
    J. S. Harper · 2024 · arXiv (Cornell University)
  64. AutoPenBench: Benchmarking Generative Agents for Penetration Testing
    Gioacchini, Luca, Mellia, Marco, Drago, Idilio, Delsanto, Alexander, Siracusano, Giuseppe, Bifulco, Roberto · 2024 · arXiv
  65. Inference Attacks: A Taxonomy, Survey, and Promising Directions
    Feng Wu, Lei Cui, Shaowen Yao · 2024 · arXiv.org
  66. "That's another doom I haven't thought about": A User Study on AI Labels as a Safeguard Against Image-Based Misinformation
    Höltervennhoff, Sandra, Ricker, Jonas, Raphael, Maike M., Schwedes, Charlotte, Weil, Rebecca, Fischer, Asja, Holz, Thorsten, Schönherr, Lea, Fahl, Sascha · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
  67. Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attacks
    Xing Wu, Minghao Li, Mohan Li · 2025 · arXiv (Cornell University)
  68. A Scalable Communication Protocol for Networks of Large Language Models
    Marro, Samuele, La Malfa, Emanuele, Wright, Jesse, Li, Guohao, Shadbolt, Nigel, Wooldridge, Michael, Torr, Philip · 2024 · arXiv
  69. Language Agents: Foundations, Prospects, and Risks
    Yu Su, Diyi Yang, Shunyu Yao, Tao Yu · 2024 · Conference on Empirical Methods in Natural Language Processing
  70. FairProof : Confidential and Certifiable Fairness for Neural Networks
    Yadav, Chhavi, Chowdhury, Amrita Roy, Boneh, Dan, Chaudhuri, Kamalika · 2024 · arXiv
  71. International AI Safety Report 2026
    Bengio, Yoshua, Clare, Stephen, Prunkl, Carina et al. · 2026 · arXiv (Cornell University)
  72. WebLINX: Real-World Website Navigation with Multi-Turn Dialogue
    Lù, Xing Han, Kasner, Zdeněk, Reddy, Siva · 2024 · arXiv
  73. Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation
    Halawi, Danny, Wei, Alexander, Wallace, Eric, Wang, Tony T., Haghtalab, Nika, Steinhardt, Jacob · 2024 · arXiv
  74. Measuring Free-Form Decision-Making Inconsistency of Language Models in Military Crisis Simulations
    Shrivastava, Aryan, Hullman, Jessica, Lamparth, Max · 2024 · arXiv
  75. FairZK: A Scalable System to Prove Machine Learning Fairness in Zero-Knowledge
    Tianyu Zhang, Shen Dong, O. Deniz Kose, Yanning Shen, Yupeng Zhang · 2025 · IEEE Symposium on Security and Privacy (S&P)
  76. Adversaries Can Misuse Combinations of Safe Models
    Jones, Erik, Dragan, Anca, Steinhardt, Jacob · 2024 · arXiv
  77. Authenticated Delegation and Authorized AI Agents
    South, Tobin, Marro, Samuele, Hardjono, Thomas, Mahari, Robert, Whitney, Cedric Deslandes, Greenwood, Dazza, Chan, Alan, Pentland, Alex · 2025 · arXiv
  78. On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents
    Huang, Jen-tse, Zhou, Jiaxu, Jin, Tailin, Zhou, Xuhui, Chen, Zixi, Wang, Wenxuan, Yuan, Youliang, Lyu, Michael R., Sap, Maarten · 2024 · arXiv
  79. Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large Language Models
    2022
  80. Taxonomy for Cybersecurity Threat Attributes and Countermeasures in Smart Manufacturing Systems
    Md Habibor Rahman, Rocco Cassandro, Thorsten Wuest · 2023 · arXiv (Cornell University)
  81. LeakAgent: RL-based Red-teaming Agent for LLM Privacy Leakage
    Yuzhou Nie, Zhun Wang, Ye Yu, Wu, Xian, Zhao, Xuandong, Wenbo Guo, Dawn Xiaodong Song · 2024 · arXiv (Cornell University)
  82. SecBench: A Comprehensive Multi-Dimensional Benchmarking Dataset for LLMs in Cybersecurity
    Pengfei Jing, Mengyun Tang, Shi, Xiaorong · 2024 · arXiv (Cornell University)
  83. Architecting Resilient LLM Agents: A Guide to Secure Plan-then-Execute Implementations
    Del Rosario, Ron F., Krawiecka, Klaudia, de Witt, Christian Schroeder · 2025 · arXiv
  84. DarkBench: Benchmarking Dark Patterns in Large Language Models
    Kran, Esben, Nguyen, Hieu Minh "Jord, Kundu, Akash, Jawhar, Sami, Park, Jinsuk, Jurewicz, Mateusz Maria · 2025 · arXiv
  85. Out-of-Distribution Detection for Reinforcement Learning Agents with Probabilistic Dynamics Models
    Haider, Tom, Roscher, Karsten, Schmoeller da Roza, Felippe · 2023 · Fraunhofer-Publica (Fraunhofer-Gesellschaft)
  86. AAGATE: A NIST AI RMF-Aligned Governance Platform for Agentic AI
    Huang, Ken, Lambros, Kyriakos Rock, Huang, Jerry et al. · 2025 · arXiv (Cornell University)
  87. Frontier AI Auditing: Toward Rigorous Third-Party Assessment of Safety and Security Practices at Leading AI Companies
    Brundage, Miles, Dreksler, Noemi, Homewood, Aidan, McGregor, Sean, Paskov, Patricia, Stosz, Conrad, Sastry, Girish, Cooper, A. Feder, Balston, George, Adler, Steven et al. · 2026 · arXiv
  88. Towards Privacy-Enhancing Provenance Annotations for Images
    Nikolaos Fotos, Jaime Delgado · 2024 · Proceedings - International Conference on Image Processing
  89. LumiMAS: A Comprehensive Framework for Real-Time Monitoring and Enhanced Observability in Multi-Agent Systems
    Solomon, Ron, Yerushalmi Levi, Yarin, Waknin, Lior, Aizikovich, Eran, Baras, Amit, Ohana, Etai, Giloni, Amit, Bose, Shamik, Picardi, Chiara, Elovici, Yuval et al. · 2026 · Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems
  90. The impact of experience on the tendency to accept recommended defaults
    Yefim Roth, Greta Maayan Waldman, Ido Erev · 2024 · Judgment and Decision Making
  91. Detecting Multi-Agent Collusion Through Multi-Agent Interpretability
    Rose, Aaron, Cullen, Carissa, Abdelnabi, Sahar, Torr, Philip, Kaplowitz, Brandon Gary, de Witt, Christian Schroeder · 2026 · arXiv
  92. Thought Virus: Viral Misalignment via Subliminal Prompting in Multi-Agent Systems
    Weckbecker, Moritz, Müller, Jonas, Hagag, Ben, Mulet, Michael · 2026 · arXiv
  93. STAC: When Innocent Tools Form Dangerous Chains for LLM Agents
    Li, Jing-Jing, He, Jianfeng, Shang, Chao, Kulshreshtha, Devang, Xian, Xun, Zhang, Yi, Su, Hang, Swamy, Sandesh, Qi, Yanjun · 2025 · arXiv
  94. CaMeLs Can Use Computers Too: System-level Security for Computer Use Agents
    Foerster, Hanna, Blanchard, Tom, Nikolić, Kristina, Shumailov, Ilia, Zhang, Cheng, Mullins, Robert, Papernot, Nicolas, Tramèr, Florian, Zhao, Yiren · 2026 · arXiv
  95. Firewalls to Secure Dynamic LLM Agentic Networks
    Abdelnabi, Sahar, Gomaa, Amr, Bagdasarian, Eugene, Kristensson, Per Ola, Shokri, Reza · 2025 · arXiv
  96. Scalable Learning of Intrusion Responses through Recursive Decomposition
    Kim Hammar, Rolf Stadler · 2023 · arXiv (Cornell University)
  97. Fundamental Limitations in Pointwise Defences of LLM Finetuning APIs
    Davies, Xander, Winsor, Eric, Souly, Alexandra, Korbak, Tomek, Kirk, Robert, de Witt, Christian Schroeder, Gal, Yarin · 2025 · arXiv
  98. Privacy-Enhancing Paradigms within Federated Multi-Agent Systems
    Shi, Zitong, Guancheng Wan, Wenke Huang · 2025 · arXiv (Cornell University)
  99. Benchmarking LLMs in an Embodied Environment for Blue Team Threat Hunting
    Liu, Xiaoqun, Yu, Feiyang, Li, Xi, Yan, Guanhua, Yang, Ping, Xi, Zhaohan · 2025 · arXiv
  100. SecReEvalBench: A Multi-turned Security Resilience Evaluation Benchmark for Large Language Models
    Cui, Huining, Wei Liu · 2025 · arXiv (Cornell University)
  101. Strategic Cyber Defense via Reinforcement Learning-Guided Combinatorial Auctions
    Pham, Mai, Vaze, Vikrant, Chin, Peter · 2025 · arXiv
  102. CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning
    Deason, Lauren, Bali, Adam, Bejean, Ciprian et al. · 2025 · arXiv (Cornell University)
  103. Permission Manifests for Web Agents
    Samuele Marro, Alan Chan, Xinxing Ren et al. · 2025 · arXiv (Cornell University)
  104. A Decision-Theoretic Formalisation of Steganography With Applications to LLM Monitoring
    Usman Anwar, Julianna Piskorz, David D. Baek · 2026 · arXiv (Cornell University)
  105. Safety is Non-Compositional: A Formal Framework for Capability-Based AI Systems
    Spera, Cosimo · 2026 · arXiv
  106. Undetectable Conversations Between AI Agents via Pseudorandom Noise-Resilient Key Exchange
    Vaikuntanathan, Vinod, Zamir, Or · 2026 · arXiv
  107. Who Governs the Machine? A Machine Identity Governance Taxonomy (MIGT) for AI Systems Operating Across Enterprise and Geopolitical Boundaries
    Kurtz, Andrew, Krawiecka, Klaudia · 2026 · arXiv
  108. Like a Hammer, It Can Build, It Can Break: Large Language Model Uses, Perceptions, and Adoption in Cybersecurity Operations on Reddit
    S. Gopi Nath, Chih-Yi Huang, Aditi Ganapathi · 2026 · arXiv (Cornell University)
  109. Architecture Matters for Multi-Agent Security
    Hagag, Ben, Anderson, William L., de Witt, Christian Schroeder, Scheffler, Sarah · 2026 · arXiv
  110. An Illusion of Progress? Assessing the Current State of Web Agents
    Xue, Tianci, Qi, Weijian, Shi, Tianneng, Song, Chan Hee, Gou, Boyu, Song, Dawn, Sun, Huan, Su, Yu · 2025 · arXiv
  111. Toward Comprehensive Risk Assessments and Assurance of AI-Based Systems
    Heidy Khlaaf · 2026 · arXiv (Cornell University)
  112. DEEDEE: Fast and Scalable Out-of-Distribution Dynamics Detection
    Tala Aljaafari, Varun Kanade, Philip H. S. Torr · 2025 · arXiv (Cornell University)
  113. Designing Human-Automation Redundancy: Overreliance, Automation Shirking, and the Operator’s Dilemma
    Cohen, Doron, Roth, Yefim, Rieskamp, Jörg, Schöbel, Markus · 2025
  114. PromptArmor: Simple yet Effective Prompt Injection Defenses
    Shi, Tianneng, Zhu, Kaijie, Wang, Zhun, Jia, Yuqi, Cai, Will, Liang, Weida, Wang, Haonan, Alzahrani, Hend, Lu, Joshua, Kawaguchi, Kenji et al. · 2025 · arXiv
  115. MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents
    Zhu, Kunlun, Du, Hongyi, Hong, Zhaochen, Yang, Xiaocheng, Guo, Shuyi, Wang, Zhe, Wang, Zhenhailong, Qian, Cheng, Tang, Xiangru, Ji, Heng et al. · 2025 · arXiv
  116. Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities
    Tianjie Ju, Yiting Wang, Xinbei Ma · 2024 · arXiv
  117. AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathways
    Zehang Deng, Yongjian Guo, Changzhou Han · 2024 · arXiv
  118. Cyber Attacker Profiling for Risk Analysis Based on Machine Learning
    Igor Kotenko, Elena Fedorchenko, Evgenia Novikova · 2023 · Sensors
  119. FAuST: Striking a Bargain between Forensic Auditing’s Security and Throughput
    Muhammad Adil Inam, Akul Goyal, Jason Liu · 2022 · Proceedings of the 38th Annual Computer Security Applications Conference
  120. SoK: History is a Vast Early Warning System: Auditing the Provenance of System Intrusions
    Muhammad Adil Inam, Yinfang Chen, Akul Goyal · 2023 · 2023 IEEE Symposium on Security and Privacy (SP)
  121. Securing Agentic AI Systems - A Multilayer Security Framework
    Sunil Arora, John Hastings · 2025 · 2025 5th International Conference on Robotics, Automation, and Artificial Intelligence (RAAI)
  122. Human vs. Machine: Behavioral Differences between Expert Humans and Language Models in Wargame Simulations
    Max Lamparth, Anthony Corso, Jacob Ganz, Oriana Skylar Mastro, Jacquelyn Schneider, Harold Trinkunas · 2024 · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
  123. Algorithmic Mechanism Design
    Noam Nisan, Amir Ronen · 2001 · Games and Economic Behavior
  124. Solving the IoT Cascading Failure Dilemma Using a Semantic Multi-agent System
    Amal Guittoum, François Aïssaoui, Sébastien Bolle, Fabienne Boyer, Noel De Palma · 2023 · Lecture Notes in Computer Science
  125. Incentive-based modeling and inference of attacker intent, objectives, and strategies
    Peng Liu, Wanyu Zang, Meng Yu · 2005 · ACM Transactions on Information and System Security