LLM Applications: Current Paradigms and the Next Frontier
Open accessAbstract
The development of large language models (LLMs) has given rise to four major application paradigms: LLM app stores, LLM agents, self-hosted LLM services, and LLM-powered devices. Each has its advantages but also shares common challenges. LLM app stores lower the barrier to development but lead to platform lock-in; LLM agents provide autonomy but lack a unified communication mechanism; self-hosted LLM services enhance control but increase deployment complexity; and LLM-powered devices improve privacy and real-time performance but are limited by hardware. This paper reviews and analyzes these paradigms, covering architecture design, application ecosystem, research progress, as well as the challenges and open problems they face. Based on this, we outline the next frontier of LLM applications, characterizing them through three interconnected layers: infrastructure, protocol, and application. We describe their responsibilities and roles of each layer and demonstrate how to mitigate existing fragmentation limitations and improve security and scalability. Finally, we discuss key future challenges, identify opportunities such as protocol-driven cross-platform collaboration and device integration, and propose a research roadmap for openness, security, and sustainability.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Generative AI tools support tasks across the empirical research lifecycle, including literature review, study design, coding, and data analysis.
“These tools now support not only writing tasks [20], but also tasks across the empirical research lifecycle from literature review and study design to coding, and data analysis [14].”
From Students' Practices and Skills in the LLM-Era: "You Can't Outsource the Struggle and Still Get the Skill" (2026) · cites this paper as [14]
The Introduction (p. 1) describes LLM code generation, and §2.3 (p. 12) lists code generation and data analysis as common applications. The paper does not establish that these tools support literature review and study design, or frame the listed applications as covering the empirical research lifecycle. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agents
Gan, Y., Yang, Y., Ma, Z., He, P., Zeng, R., Wang, Y., Li, Q., Zhou, C., Li, S., Wang, T., et al. (2024) · arXiv · doi:10.48550/arxiv.2411.09523 · Cited by 8 · cited 2× · see citing works
“Threats like prompt injection, information leakage, and ethical dilemmas in untrusted environments are surveyed by He et al. [40], Gan et al. [31], and Deng et al. [25].”
Flagged first, then by citations
Research works printed but not linked: 63
- [2][2] Amey Agrawal, Nitin Kedia, Ashish Panwar, Jayashree Mohan, Nipun Kwatra, Bhargav Gulavani, Alexey Tumanov, and Ramachandran Ramjee. 2024. Taming { Throughput-Latency } tradeoff in { LLM } inference with { Sarathi-Serve } . In 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 24) . 117-134. -
- [5][5] Renat Aksitov, Sobhan Miryoosefi, Zonglin Li, et al. 2023. ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent. In arXiv preprint . arXiv:2312.10003 - · arXiv
- [11][11] Pankaj Singh Bohra and Krishan Berwal. 2025. LLM-based AI-Powered Offline Portable Transcriptor (OPT): SURYATAC: A Tactical Speech-to-Speech Translation System. In 2025 IEEE International Conference on Computer, Electronics, Electrical Engineering & their Applications (IC2E3) . IEEE, 1-6. -
- [15][15] Wei Chen and Zhiyuan Li. 2024. Octopus v2: On-device language model for super agent. arXiv:2404.01744 [cs.CL] https://arxiv.org/abs/2404.01744 - · arXiv
- [16][16] Ying-Jung Chen and Vijay K Madisetti. 2024. Information security, ethics, and integrity in llm agent interaction. Journal of Information Security 16, 1 (2024), 184-196. -
- [25][25] Zehang Deng, Yongjian Guo, Changzhou Han, Wanlun Ma, Junwu Xiong, Sheng Wen, and Yang Xiang. 2025. AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathways. ACM Comput. Surv. 57, 7, Article 182 (Feb. 2025), 36 pages. https://doi.org/10.1145/3716628 - · DOI · Paper page
- [27][27] Qiang Duan and Zhihui Lu. 2025. Agent Communications toward Agentic AI at Edge - A Case Study of the Agent2Agent Protocol. arXiv:2508.15819 [cs.NI] https://arxiv.org/abs/2508.15819 - · arXiv
- [26][26] Hana Derouiche, Zaki Brahmi, and Haithem Mazeni. 2025. Agentic AI Frameworks: Architectures, Protocols, and Design Challenges. arXiv:2508.10146 [cs.AI] https://arxiv.org/abs/2508.10146 - · arXiv
- [28][28] Abul Ehtesham, Aditi Singh, Gaurav Kumar Gupta, and Saket Kumar. 2025. A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP). arXiv:2505.02279 [cs.AI] https://arxiv.org/abs/2505.02279 - · arXiv
- [37][37] Kai Greshake, Sahar Abdelnabi, Shailesh Mishra, Christoph Endres, Thorsten Holz, and Mario Fritz. 2023. Not What You've Signed Up For: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection. In Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security (Copenhagen, Denmark) (AISec '23) . Association for Computing Machinery, New York, NY, USA, 79-90. https://doi.org/10.1145/3605764.3623985 - · DOI · Paper page
- [39][39] Lewis Hammond, Alan Chan, Jesse Clifton, Jason Hoelscher-Obermaier, Akbir Khan, Euan McLean, Chandler Smith, Wolfram Barfuss, Jakob Foerster, Tomáš Gavenčiak, The Anh Han, Edward Hughes, Vojtěch Kovařík, Jan Kulveit, Joel Z. Leibo, Caspar Oesterheld, Christian Schroeder de Witt, Nisarg Shah, Michael Wellman, Paolo Bova, Theodor Cimpeanu, Carson Ezell, Quentin Feuillade-Montixi, Matija Franklin, Esben Kran, Igor Krawczuk, Max Lamparth, Niklas Lauffer, Alexander Meinke, Sumeet Motwani, Anka Reuel, Vincent Conitzer, Michael Dennis, Iason Gabriel, AdamGleave, Gillian Hadfield, Nika Haghtalab, Atoosa Kasirzadeh, Sébastien Krier, Kate Larson, Joel Lehman, David C. Parkes, Georgios Piliouras, and Iyad Rahwan. 2025. Multi-Agent Risks from Advanced AI. arXiv:2502.14143 [cs.MA] https://arxiv.org/abs/2502.14143 - · arXiv
- [38][38] Theodor-Radu Grumeza, Thomas-Andrei Lazăr, and Alexandra-Emilia Fortiş. 2025. A Hybrid Microservices Architecture for Smart Glasses: Integrating Cloud-Based LLMs, Containerized Services, and On-Device Functionalities. In International Conference on Advanced Information Networking and Applications . Springer, 429-438. -
- [40][40] Feng He, Tianqing Zhu, Dayong Ye, Bo Liu, Wanlei Zhou, and Philip S. Yu. 2024. The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies. CoRR abs/2407.19354 (2024). https://doi.org/10.48550/ARXIV.2407.19354 arXiv:2407.19354 - · DOI · Paper page
- [42][42] Xinyi Hou, Yanjie Zhao, and Haoyu Wang. 2024. On the (In)Security of LLM App Stores. CoRR abs/2407.08422 (2024). https://doi.org/10.48550/ARXIV.2407.08422 arXiv:2407.08422 - · DOI
- [41][41] Xinyi Hou, Jiahao Han, Yanjie Zhao, and Haoyu Wang. 2025. Unveiling the Landscape of LLM Deployment in the Wild: An Empirical Study. arXiv preprint arXiv:2505.02502 (2025). - · arXiv
- [43][43] Xinyi Hou, Yanjie Zhao, Shenao Wang, and Haoyu Wang. 2024. GPTZoo: A Large-scale Dataset of GPTs for the Research Community. In Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering (Sacramento, CA, USA) (ASE '24) . Association for Computing Machinery, New York, NY, USA, 2329-2333. https://doi.org/10.1145/3691620.3695309 - · DOI
- [44][44] Xu Huang, Weiwen Liu, Xiaolong Chen, Xingmei Wang, Hao Wang, Defu Lian, Yasheng Wang, Ruiming Tang, and Enhong Chen. 2024. Understanding the planning of LLM agents: A survey. arXiv preprint arXiv:2402.02716 (2024). - · arXiv
- [46][46] Bo Hui, Haolin Yuan, Neil Gong, Philippe Burlina, and Yinzhi Cao. 2024. PLeak: Prompt Leaking Attacks against Large Language Model Applications. In Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security (Salt Lake City, UT, USA) (CCS '24) . Association for Computing Machinery, New York, NY, USA, 3600-3614. https://doi.org/10.1145/3658644.3670370 - · DOI · Paper page
- [49][49] Umar Iqbal, Tadayoshi Kohno, and Franziska Roesner. 2025. LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins. In Proceedings of the 2024 AAAI/ACM Conference on AI, Ethics, and Society (San Jose, California, USA) (AIES '24) . AAAI Press, 611-623. -
- [50][50] Evin Jaff, Yuhao Wu, Ning Zhang, and Umar Iqbal. 2024. Data Exposure from LLM Apps: An In-depth Investigation of OpenAI's GPTs. CoRR abs/2408.13247 (2024). https://doi.org/10.48550/ARXIV.2408.13247 arXiv:2408.13247 - · DOI
- [55][55] Baolin Li, Yankai Jiang, Vijay Gadepally, and Devesh Tiwari. 2024. LLM Inference Serving: Survey of Recent Advances and Opportunities. In 2024 IEEE High Performance Extreme Computing Conference (HPEC) . 1-8. https: //doi.org/10.1109/HPEC62836.2024.10938426 - · DOI
- [56][56] Yuanchun Li, Hao Wen, Weijun Wang, Xiangyu Li, Yizhen Yuan, Guohong Liu, Jiacheng Liu, Wenxing Xu, Xiang Wang, Yi Sun, Rui Kong, Yile Wang, Hanfei Geng, Jian Luan, Xuefeng Jin, Zilong Ye, Guanjing Xiong, Fan Zhang, Xiang Li, Mengwei Xu, Zhijun Li, Peng Li, Yang Liu, Ya-Qin Zhang, and Yunxin Liu. 2024. Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security. CoRR abs/2401.05459 (2024). https://doi.org/10. 48550/ARXIV.2401.05459 arXiv:2401.05459 - · arXiv
- [58][58] Mugeng Liu, Siqi Zhong, Weichen Bi, Yixuan Zhang, Zhiyang Chen, Zhenpeng Chen, Xuanzhe Liu, and Yun Ma. 2025. A First Look at Bugs in LLM Inference Engines. arXiv:2506.09713 [cs.SE] https://arxiv.org/abs/2506.09713 - · arXiv
- [60][60] Hanjun Luo, Shenyu Dai, Chiming Ni, Xinfeng Li, Guibin Zhang, Kun Wang, Tongliang Liu, and Hanan Salam. 2025. AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents. arXiv:2506.00641 [cs.AI] https://arxiv.org/abs/2506.00641 - · arXiv
- [59][59] Tong Liu, Zizhuang Deng, Guozhu Meng, Yuekang Li, and Kai Chen. 2024. Demystifying RCE Vulnerabilities in LLM-Integrated Apps. In Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security (Salt Lake City, UT, USA) (CCS '24) . Association for Computing Machinery, New York, NY, USA, 1716-1730. https://doi.org/10.1145/3658644.3690338 - · DOI
- [61][61] Chang Ma, Junlei Zhang, Zhihao Zhu, Cheng Yang, Yujiu Yang, Yaohui Jin, Zhenzhong Lan, Lingpeng Kong, and Junxian He. 2024. AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents. arXiv:2401.13178 [cs.CL] https://arxiv.org/abs/2401.13178 - · arXiv
- [63][63] Samuele Marro, Emanuele La Malfa, Jesse Wright, Guohao Li, Nigel Shadbolt, Michael Wooldridge, and Philip Torr. 2024. A Scalable Communication Protocol for Networks of Large Language Models. https://arxiv.org/abs/2410.11905. - · arXiv
- [62][62] Rongjun Ma, Caterina Maidhof, Juan Carlos Carrillo, Janne Lindqvist, and Jose Such. 2025. Privacy Perceptions of Custom GPTs by Users and Creators. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25) . ACM, 1-18. https://doi.org/10.1145/3706598.3713540 - · DOI · Paper page
- [66][66] Bakshree Mishra. 2025. Minstrel: Application-Aware SLM Inference Optimization on Edge Devices. In Machine Learning for Computer Architecture and Systems 2025 . https://openreview.net/forum?id=hU2qsEQGYT -
- [67][67] Mateus Monteiro Santos, Aristoteles Barros, Luiz Rodrigues, Diego Dermeval, Tiago Primo, Ig Ibert, and Seiji Isotani. 2025. Near Feasibility, Distant Practicality: Empirical Analysis of Deploying and Using LLMs on ResourceConstrained Smartphones. In Proceedings of the 13th International Conference on Information & Communication Technologies and Development (ICTD '24) . Association for Computing Machinery, New York, NY, USA, 224-235. https://doi.org/10.1145/3700794.3700817 - · DOI
- [68][68] Sumeet Ramesh Motwani, Mikhail Baranchuk, Martin Strohmeier, Vijay Bolina, Philip H.S. Torr, Lewis Hammond, and Christian Schroeder de Witt. 2024. Secret Collusion among AI Agents: Multi-Agent Deception via Steganography. In Advances in Neural Information Processing Systems , A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, and C. Zhang (Eds.), Vol. 37. Curran Associates, Inc., 73439-73486. https://proceedings.neurips.cc/paper\_files/paper/ 2024/file/861f7dad098aec1c3560fb7add468d41-Paper-Conference.pdf -
- [76][76] Sihyeong Park, Sungryeol Jeon, Chaelyn Lee, Seokhun Jeon, Byung-Soo Kim, and Jemin Lee. 2025. A Survey on Inference Engines for Large Language Models: Perspectives on Optimization and Efficiency. arXiv:2505.01658 [cs.CL] https://arxiv.org/abs/2505.01658 - · arXiv
- [77][77] Rodrigo Pedro, Daniel Castro, Paulo Carreira, and Nuno Santos. 2023. From Prompt Injections to SQL Injection Attacks: How Protected is Your LLM-Integrated Web Application? CoRR abs/2308.01990 (2023). https://doi.org/10. 48550/ARXIV.2308.01990 arXiv:2308.01990 - · arXiv
- [78][78] Pierre Peigne-Lefebvre, Mikolaj Kniejski, Filip Sondej, Matthieu David, Jason Hoelscher-Obermaier, Christian Schroeder de Witt, and Esben Kran. 2025. Multi-Agent Security Tax: Trading Off Security and Collaboration Capabilities in Multi-Agent Systems. arXiv:2502.19145 [cs.AI] https://arxiv.org/abs/2502.19145 - · arXiv
- [83][83] Partha Pratim Ray. 2025. A Review on Agent-to-Agent Protocol: Concept, State-of-the-art, Challenges and Future Directions. Authorea Preprints (2025). -
- [86][86] Xinyue Shen, Yun Shen, Michael Backes, and Yang Zhang. 2025. GPTRacker: A Large-Scale Measurement of Misused GPTs. In Proceedings of the 2025 IEEE Symposium on Security and Privacy . IEEE. To appear. -
- [88][88] Dongxun Su, Yanjie Zhao, Xinyi Hou, Shenao Wang, and Haoyu Wang. 2024. GPT Store Mining and Analysis. CoRR abs/2405.10210 (2024). https://doi.org/10.48550/ARXIV.2405.10210 arXiv:2405.10210 - · DOI
- [87][87] Xinyuan Song, Zeyu Wang, Siyi Wu, Lynn Ai, et al. 2025. Gradientsys: A Multi-Agent LLM Scheduler with ReAct Orchestration. arXiv preprint (2025). arXiv:2507.06520 - · arXiv
- [89][89] Yiliu Tang, Jason Situ, Andrea Yaoyun Cui, Mengke Wu, and Yun Huang. 2025. LLM Integration in Extended Reality: A Comprehensive Review of Current Trends, Challenges, and Future Perspectives. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25) . Association for Computing Machinery, New York, NY, USA, Article 1054, 24 pages. https://doi.org/10.1145/3706598.3714224 - · DOI
- [97][97] Issatay Tokmurziyev, Miguel Altamirano Cabrera, Muhammad Haris Khan, Yara Mahmoud, Luis Moreno, and Dzmitry Tsetserukou. 2025. LLM-Glasses: GenAI-driven Glasses with Haptic Feedback for Navigation of Visually Impaired People. arXiv:2503.16475 [cs.HC] https://arxiv.org/abs/2503.16475 - · arXiv
- [96][96] Stephen Burabari Tete. 2024. Threat Modelling and Risk Analysis for Large Language Model (LLM)-Powered Applications. CoRR abs/2406.11007 (2024). https://doi.org/10.48550/ARXIV.2406.11007 arXiv:2406.11007 - · DOI
- [98][98] Khanh-Tung Tran, Dung Dao, Minh-Duong Nguyen, Quoc-Viet Pham, Barry O'Sullivan, and Hoang D. Nguyen. 2025. Multi-Agent Collaboration Mechanisms: A Survey of LLMs. arXiv:2501.06322 [cs.AI] https://arxiv.org/abs/2501.06322 - · arXiv
- [99][99] Krishna Sruthi Velaga and Yifan Guo. 2024. Optimizing Large Language Models Assisted Smart Home Assistant Systems at the Edge: An Empirical Study. In Submitted to AAAI 2025 Workshop on Artificial Intelligence for Wireless Communications and Networking (AI4WCN) . https://openreview.net/forum?id=qr2dIjQavP under review. -
- [101][101] Bo Wang, Weiyi He, Pengfei He, Shenglai Zeng, Zhen Xiang, Yue Xing, and Jiliang Tang. 2025. Unveiling Privacy Risks in LLM Agent Memory. arXiv:2502.13172 [cs.CR] https://arxiv.org/abs/2502.13172 - · arXiv
- [103][103] Yan Wang, Xinyi Hou, Yanjie Zhao, Weiguo Lin, Haoyu Wang, and Junjun Si. 2025. LaQual: A Novel Framework for Automated Evaluation of LLM App Quality. arXiv:2508.18636 [cs.SE] https://doi.org/10.48550/arXiv.2508.18636 - · DOI
- [102][102] Jingyan Wang, Yang Zhao, Haotian Mao, and Xubo Yang. 2025. Survey of Large Language Models in Extended Reality: Technical Paradigms and Application Frontiers. arXiv:2508.03014 [cs.HC] https://arxiv.org/abs/2508.03014 - · arXiv
- [104][104] Yuntao Wang, Yanghe Pan, Zhou Su, Yi Deng, Quan Zhao, Linkang Du, Tom H. Luan, Jiawen Kang, and Dusit Niyato. 2025. Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trends. arXiv:2409.14457 [cs.AI] https://arxiv.org/abs/2409.14457 - · arXiv
- [106][106] Liangxuan Wu, Chao Wang, Tianming Liu, Yanjie Zhao, and Haoyu Wang. 2025. From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents. arXiv:2505.12981 [cs.CR] https://arxiv.org/abs/2505.12981 - · arXiv
- [108][108] Yinglin Xie, Xinyi Hou, Yanjie Zhao, Kai Chen, and Haoyu Wang. 2024. LLM App Squatting and Cloning. CoRR abs/2411.07518 (2024). https://doi.org/10.48550/ARXIV.2411.07518 arXiv:2411.07518 - · DOI
- [107][107] Liangxuan Wu, Yanjie Zhao, Chao Wang, Tianming Liu, and Haoyu Wang. 2024. A First Look at LLM-powered Smartphones. In Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering Workshops (Sacramento, CA, USA) (ASEW '24) . Association for Computing Machinery, New York, NY, USA, 208-217. https://doi.org/10.1145/3691621.3694952 - · DOI
- [109][109] Chuan Yan, Bowei Guan, Yazhi Li, Mark Huasong Meng, Liuhuo Wan, and Guangdong Bai. 2025. Understanding and Detecting File Knowledge Leakage in GPT App Ecosystem. In THE WEB CONFERENCE 2025 . https://openreview.net/ forum?id=k7G42gLuab -
- [111][111] Yingxuan Yang, Huacan Chai, Yuanyi Song, Siyuan Qi, Muning Wen, Ning Li, Junwei Liao, Haoyi Hu, Jianghao Lin, Gaowei Chang, Weiwen Liu, Ying Wen, Yong Yu, and Weinan Zhang. 2025. A Survey of AI Agent Protocols. arXiv:2504.16736 [cs.AI] https://arxiv.org/abs/2504.16736 - · arXiv
- [110][110] Chuan Yan, Ruomai Ren, Mark Huasong Meng, Liuhuo Wan, Tian Yang Ooi, and Guangdong Bai. 2024. Exploring ChatGPT App Ecosystem: Distribution, Deployment and Security (ASE '24) . Association for Computing Machinery, New York, NY, USA, 1370-1382. https://doi.org/10.1145/3691620.3695510 - · DOI
- [112][112] Yingxuan Yang, Mulei Ma, Yuxuan Huang, Huacan Chai, Chenyu Gong, Haoran Geng, Yuanjian Zhou, Ying Wen, Meng Fang, Muhao Chen, Shangding Gu, Ming Jin, Costas Spanos, Yang Yang, Pieter Abbeel, Dawn Song, Weinan Zhang, and Jun Wang. 2025. Agentic Web: Weaving the Next Web with AI Agents. arXiv:2507.21206 [cs.AI] https://arxiv.org/abs/2507.21206 - · arXiv
- [114][114] Asaf Yehudai, Lilach Eden, Alan Li, Guy Uziel, Yilun Zhao, Roy Bar-Haim, Arman Cohan, and Michal Shmueli-Scheuer. 2025. Survey on evaluation of llm-based agents. arXiv preprint arXiv:2503.16416 (2025). - · arXiv
- [113][113] Zihao Ye, Lequn Chen, Ruihang Lai, Wuwei Lin, Yineng Zhang, Stephanie Wang, Tianqi Chen, Baris Kasikci, Vinod Grover, Arvind Krishnamurthy, and Luis Ceze. 2025. FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving. arXiv:2501.01005 [cs.DC] https://arxiv.org/abs/2501.01005 - · arXiv
- [115][115] Ramez Yousri, Zeyad Essam, Yehia Kareem, Youstina Sherief, Sherry Gamil, and Soha Safwat. 2024. IllusionX: An LLM-powered mixed reality personal companion. arXiv:2402.07924 [cs.HC] https://arxiv.org/abs/2402.07924 - · arXiv
- [117][117] Hanrong Zhang, Jingyuan Huang, Kai Mei, Yifei Yao, Zhenting Wang, Chenlu Zhan, Hongwei Wang, and Yongfeng Zhang. 2024. Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents. CoRR abs/2410.02644 (2024). https://doi.org/10.48550/ARXIV.2410.02644 arXiv:2410.02644 - · DOI · Paper page
- [116][116] Xiao Yu, Haoxuan Chen, Feifei Niu, Xing Hu, Jacky Wai Keung, and Xin Xia. 2025. Towards Understanding Bugs in Distributed Training and Inference Frameworks for Large Language Models. arXiv:2506.10426 [cs.SE] https: //arxiv.org/abs/2506.10426 - · arXiv
- [118][118] Zejun Zhang, Li Zhang, Xin Yuan, Anlan Zhang, Mengwei Xu, and Feng Qian. 2024. A First Look at GPT Apps: Landscape and Vulnerability. CoRR abs/2402.15105 (2024). https://doi.org/10.48550/ARXIV.2402.15105 arXiv:2402.15105 - · DOI
- [120][120] Jiachen Zhu, Menghui Zhu, Renting Rui, Rong Shan, Congmin Zheng, Bo Chen, Yunjia Xi, Jianghao Lin, Weiwen Liu, Ruiming Tang, Yong Yu, and Weinan Zhang. 2025. Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Survey. arXiv:2506.11102 [cs.CL] https://arxiv.org/abs/2506.11102 - · arXiv
- [119][119] Yanjie Zhao, Xinyi Hou, Shenao Wang, and Haoyu Wang. 2024. LLM App Store Analysis: A Vision and Roadmap. ACM Trans. Softw. Eng. Methodol. (Dec. 2024). https://doi.org/10.1145/3708530 Just Accepted. - · DOI
- [121][121] Kunlun Zhu, Hongyi Du, Zhaochen Hong, Xiaocheng Yang, Shuyi Guo, Zhe Wang, Zhenhailong Wang, Cheng Qian, Xiangru Tang, Heng Ji, and Jiaxuan You. 2025. MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents. arXiv:2503.01935 [cs.MA] https://arxiv.org/abs/2503.01935 · arXiv
Cited by
Sorted by citations
de Freitas, E. R. S., Pinto, G., & Monteiro, D. (2026) · arXiv · doi:10.48550/arxiv.2607.29519
- Authors
- Hou, X., Zhao, Y., & Wang, H.
- ORCID
- Zhao, Yanjie
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2503.04596
- OpenAlex
- W4416389101
- Cited by
- 0
- References
- 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- large language models, LLM applications, LLM agents, platform lock-in, cross-platform collaboration, device integration, LLM security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review