The DOI matches its DataCite record; 6 of the 6 references it cites were found in a registry or an index.
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Open accessAbstract
AutoGen is an open-source framework that allows developers to build LLM applications via multiple agents that can converse with each other to accomplish tasks. AutoGen agents are customizable, conversable, and can operate in various modes that employ combinations of LLMs, human inputs, and tools. Using AutoGen, developers can also flexibly define agent interaction behaviors. Both natural language and computer code can be used to program flexible conversation patterns for different applications. AutoGen serves as a generic infrastructure to build diverse applications of various complexities and LLM capacities. Empirical studies demonstrate the effectiveness of the framework in many example applications, with domains ranging from mathematics, coding, question answering, operations research, online decision-making, entertainment, etc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In this method, people use a set of diverse tasks from different domains to evaluate the agent, which can effectively measure the agent generalization capability in open-domain environments [29,80,153,163,165,166,167].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [153]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The development of medical AI agents can be approached through two primary methodologies: graphical user interface (GUI)-based frameworks and coding-based development.110,111,112”
From A foundational architecture for AI agents in healthcare (2025) · cites this paper as [110]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Each agent maintains a local memory, but the framework enforces controlled memory sharing and coordination protocols, thus allowing problem-solving behaviors that rely on distributed knowledge.”
From Memory Fabric for Conversational AI Agents: Enabling Shared and Persistent Memory Across Users (2025) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These agents exhibit human-like cognitive and metacognitive abilities, including task planning, situational assessment, progress monitoring, and collaborative efforts among agents.”
From Promises and challenges of generative artificial intelligence for human learning (2024) · cites this paper as [53]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Agentic AI systems are increasingly deployed in academic and industrial research pipelines to automate multi-stage knowledge compilation.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AutoGen [100] agents maintain scratchpads for intermediate computations, enabling stepwise task progression.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These systems are being used for literature reviews, grant preparation, and patent search pipelines, outperforming single-agent systems such as ChatGPT by enabling concurrent sub-task execution and long-context management [100].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This adaptive, memory-driven coordination exemplifies Agentic AI's potential to reduce labor costs, increase harvest efficiency, and respond to uncertainties in complex agricultural environments surpassing the rigid programming of conventional agricultural robots [100], [157].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AutoGen provides an open-source conversation framework that lets developers script arbitrary interaction graphs among tool-augmented agents [22].”
From Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLM-based agents are well-suited for creating personal assistants, such as agents capable of engaging in long-term conversations with users [94, 101, 153], as well as those tasked with automatically seeking information [164].”
From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [153]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Frameworks like AutoGen extend the above idea of summaries by providing an environment where multiple agents can communicate, delegate tasks, and specialize in roles [25].”
From Memory Fabric for Conversational AI Agents: Enabling Shared and Persistent Memory Across Users (2025) · cites this paper as [25]
The cited source says what the claim attributes to it.
In the citing paper
“This technique significantly enhances the capabilities of LLMs for managing complex tasks, including solving mathematical problems and performing retrieval-augmented code generation11–14.”
From Enhancing diagnostic capability with multi-agents conversational large language models (2025) · cites this paper as [11]
The cited source says what the claim attributes to it.
In the citing paper
“AutoGen [1] provides conversation patterns for multi-agent collaboration, while CrewAI [2] emphasizes role-based agent coordination.”
From AgentRM: An OS-Inspired Resource Manager for LLM Agent Systems (2026) · cites this paper as [1]
The cited source says what the claim attributes to it.
In the citing paper
“For example, platforms like AutoGen [100] and ChatDev [155] exemplify agentic coordination through task decomposition, role assignment, and recursive feedback loops.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“Table I, which was derived from close analysis of prominent frameworks such as AutoGen [100] and ChatDev [155].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The emergence of conventions is a foundational element to any type of LLM multi-agent system (14, 41), including but not limited to “in silico” experiments to emulate human social networks (42).”
From Emergent social conventions and collective bias in LLM populations (2025) · cites this paper as [14]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, all these past works have not used such simulators to benchmark the reliability of agents, instead focusing on showcasing the ability of LMs to enable realistic simulations.”
From $τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains (2024) · cites this paper as [21]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Across all implementations, we observe the same trend as in the main results: prompt-response verification consistently improves over single-agent and singlesided variants.”
From Verifying Intent and Harm: A Unified Defense Against LLM-Generated Threats (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“These frameworks generally assume unlimited resources and don't provide mechanisms for handling resource contention, failed agents, or context overflow.”
From AgentRM: An OS-Inspired Resource Manager for LLM Agent Systems (2026) · cites this paper as [1]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Compared to traditional rule-based security systems, this agentic model enhances decision latency, reduces false positives, and supports proactive threat containment in large-scale organizational infrastructures [100].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 28
- Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Col- lisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, et al. Guidelines for human-ai interaction. In Proceedings of the 2019 chi conference on human factors in computing systems, 2019.
- Carrie J. Cai, Samantha Winter, David F. Steiner, Lauren Wilcox, and Michael Terry. "hello ai": Uncovering the onboarding needs of medical practitioners for human-ai collaborative decision- making. Proceedings of the ACM on Human-Computer Interaction, 2019.
- Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, and Denny Zhou. Large language models as tool makers. arXiv preprint arXiv:2305.17126, 2023. · arXiv
- Victor Dibia. LIDA: A tool for automatic generation of grammar-agnostic visualizations and info- graphics using large language models. In Proceedings of the 61st Annual Meeting of the Associ- ation for Computational Linguistics (Volume 3: System Demonstrations), Toronto, Canada, July 2023. Association for Computational Linguistics.
- Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch. Improv- ing factuality and reasoning in language models through multiagent debate. arXiv preprint arXiv:2305.14325, 2023. · arXiv
- Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. Measuring mathematical problem solving with the math dataset. arXiv preprint arXiv:2103.03874, 2021. · arXiv
- Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, et al. Metagpt: Meta programming for multi-agent collaborative framework. arXiv preprint arXiv:2308.00352, 2023. · arXiv
- Eric Horvitz. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 1999.
- Geunwoo Kim, Pierre Baldi, and Stephen McAleer. Language models can solve computer tasks. arXiv preprint arXiv:2303.17491, 2023. · arXiv
- Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al. Natural questions: a benchmark for question answering research. Transactions of the Association for Computational Linguistics, 2019.
- Mike Lewis, Denis Yarats, Yann N Dauphin, Devi Parikh, and Dhruv Batra. Deal or no deal? end- to-end learning for negotiation dialogues. arXiv preprint arXiv:1706.05125, 2017. · arXiv
- Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. Retrieval-augmented gen- eration for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems, 2020.
- Beibin Li, Konstantina Mellou, Bo Zhang, Jeevan Pathuri, and Ishai Menache. Large language models for supply chain optimization. arXiv preprint arXiv:2307.03875, 2023a. · arXiv
- Evan Zheran Liu, Kelvin Guu, Panupong Pasupat, Tianlin Shi, and Percy Liang. Reinforcement learning on web interfaces using workflow-guided exploration. arXiv preprint arXiv:1802.08802, 2018. · arXiv
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wier- stra, and Martin Riedmiller. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013. · arXiv
- Roberto Navigli, Simone Conia, and Björn Ross. Biases in large language models: Origins, inven- tory and discussion. ACM Journal of Data and Information Quality, 2023.
- Md Rizwan Parvez, Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. Retrieval augmented code generation and summarization. arXiv preprint arXiv:2108.11601, 2021. · arXiv
- Shishir G. Patil, Tianjun Zhang, Xin Wang, and Joseph E. Gonzalez. Gorilla: Large language model connected with massive apis. arXiv preprint arXiv:2305.15334, 2023. · arXiv
- Nils Reimers and Iryna Gurevych. Sentence-bert: Sentence embeddings using siamese bert- networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 11 2019. URL https://arxiv.org/ abs/1908.10084. · arXiv
- Bokui Shen, Fei Xia, Chengshu Li, Roberto Martín-Martín, Linxi Fan, Guanzhi Wang, Claudia Pérez-D'Arpino, Shyamal Buch, Sanjana Srivastava, Lyne Tchapmi, et al. igibson 1.0: A simu- lation environment for interactive tasks in large realistic scenes. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021.
- Tianlin Shi, Andrej Karpathy, Linxi Fan, Jonathan Hernandez, and Percy Liang. World of bits: An open-domain platform for web-based agents. In International Conference on Machine Learning. PMLR, 2017.
- Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, Yonatan Bisk, Adam Trischler, and Matthew Hausknecht. ALFWorld: Aligning Text and Embodied Environments for Interactive Learning. In Proceedings of the International Conference on Learning Representations (ICLR), 2021. URL https://arxiv.org/abs/2010.03768. · arXiv
- Oriol Vinyals, Timo Ewalds, Sergey Bartunov, Petko Georgiev, Alexander Sasha Vezhnevets, Michelle Yeo, Alireza Makhzani, Heinrich Küttler, John Agapiou, Julian Schrittwieser, et al. Starcraft ii: A new challenge for reinforcement learning. arXiv preprint arXiv:1708.04782, 2017. · arXiv
- Chi Wang, Qingyun Wu, Markus Weimer, and Erkang Zhu. Flaml: A fast and lightweight automl library. Proceedings of Machine Learning and Systems, 2021.
- Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. Voyager: An open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291, 2023a. · arXiv
- Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. A survey on large language model based autonomous agents. arXiv preprint arXiv:2308.11432, 2023b. · arXiv
- Daniel S. Weld and Oren Etzioni. The first law of robotics (a call to arms). In AAAI Conference on Artificial Intelligence, 1994.
- Yiran Wu, Feiran Jia, Shaokun Zhang, Qingyun Wu, Hangyu Li, Erkang Zhu, Yue Wang, Yin Tat Lee, Richard Peng, and Chi Wang. An empirical study on challenging math problem solving with gpt-4. arXiv preprint arXiv:2306.01337, 2023. · arXiv
Cited by
Sorted by citations
Items 101–200 of 295
Nonomura, R., & Mori, H. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1582287 · Cited by 15
SensorMCP: A Model Context Protocol Server for Custom Sensor Tool Creation
Guo, Y., Zhu, G., Liu, K., & Xing, G. (2025) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3711875.3736687 · Cited by 8
General-Purpose Models for the Chemical Sciences: LLMs and Beyond
Alampara, N., Aneesh, A., Ríos-García, M., Mirza, A., Schilling-Wilhelmi, M., Aghajani, A. A., Sun, M., Prastalo, G., & Jablonka, K. M. (2026) · Chemical Reviews · doi:10.1021/acs.chemrev.5c00583 · Cited by 24
Operating advanced scientific instruments with AI agents that learn on the job
Vriza, A., Prince, M. H., Zhou, T., Chan, H., & Cherukara, M. J. (2026) · npj Computational Materials · doi:10.1038/s41524-026-02005-0 · Cited by 8
Transforming artificial intelligence into artificial wisdom
Jeste, D. V., Paulus, M. P., Alexopoulos, G. S., Barnard, M., Otte, W. M., Satake, Y., Na, P. J., Torous, J. B., Prodan, A., & Occhipinti, J. (2026) · Nature Mental Health · doi:10.1038/s44220-026-00640-6 · Cited by 9
$τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
Yao, S., Shinn, N., Razavi, P., & Narasimhan, K. (2024) · arXiv · doi:10.48550/arxiv.2406.12045 · Cited by 9
EcoAssistant: Using LLM Assistant More Affordably and Accurately
Zhang, J., Krishna, R., Awadallah, A. H., & Wang, C. (2023) · arXiv · doi:10.48550/arxiv.2310.03046 · Cited by 8
Self-citationExternalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
Zhou, C., Chai, H., Chen, W., Guo, Z., Shan, R., Song, Y., Xu, T., Yang, Y., Yu, A., Zhang, W., et al. (2026) · arXiv · doi:10.48550/arxiv.2604.08224 · Cited by 1
KARMA: Augmenting Embodied AI Agents with Long-and-Short Term Memory Systems
Wang, Z., Yu, B., Zhao, J., Sun, W., Hou, S., Liang, S., Hu, X., Han, Y., & Gan, Y. (2025) · 2025 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra55743.2025.11128047 · Cited by 11
Chen, H., Zhao, Q., Lu, W., Gu, S., Jin, W., Liu, G., & Lin, X. (2024) · Abu Dhabi International Petroleum Exhibition & Conference (ADIPEC) · doi:10.2118/223028-ms · Cited by 7
A multi-agent-driven robotic AI chemist enabling autonomous chemical research on demandPreprint
Song, T., Luo, M., Chen, L., Huang, Y. H., Zhu, Q. J., Liu, D., Zhang, B., Zou, G., Zhang, F., Shang, W., et al. (2024) · ChemRxiv · doi:10.26434/chemrxiv-2024-w953h-v2 · Cited by 9
Large Language Model–Based Critical Care Big Data Deployment and Extraction: Descriptive Analysis
Zhong-bao, Y., Xu, S.-S., Liu, X., Xu, N., Chen, Y., Wang, S., Miao, M.-Y., Hou, M., Liu, S., Zhou, Y., et al. (2025) · JMIR Medical Informatics · doi:10.2196/63216 · Cited by 6
Assessing the potential of generative agents in crowdsourced fact-checking
Costabile, L., Orlando, G. M., Gatta, V. L., & Moscato, V. (2025) · Online Social Networks and Media · doi:10.1016/j.osnem.2025.100326 · Cited by 9
Schömbs, S., Zhang, Y., Gonçalves, J., & Johal, W. (2025) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3765766.3765795 · Cited by 6
An LLM-based multi-agent system for remote sensing analysis
Sun, Z., Zhou, Y., & Yang, J. (2026) · Big Earth Data · doi:10.1080/20964471.2025.2600178 · Cited by 10
Demonstration of DB-GPT: Next Generation Data Interaction System Empowered by Large Language Models
Xue, S., Qi, D., Jiang, C., Cheng, F., Chen, K., Zhang, Z., Zhang, H., Wei, G., Zhao, W., Zhou, F., et al. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3685800.3685876 · Cited by 6
Naumov, V., Zagirova, D., Lin, S., Xie, Y., Gou, W., Urban, A., Tikhonova, N., Alawi, K., Durymanov, M., Galkin, F., et al. (2025) · doi:10.1101/2025.03.06.641840 · Cited by 5
Gödel Agent: A Self-Referential Agent Framework for Recursively Self-Improvement
Yin, X., Wang, X., Pan, L., Lin, L., Wan, X., & Wang, W. Y. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1354 · Cited by 105
Prompt design for medical question answering with Large Language Models
Kuligin, L., Lammert, J., Ostapenko, A., Bressem, K. K., Boeker, M., & Tschochohei, M. (2025) · Machine Learning with Applications · doi:10.1016/j.mlwa.2025.100758 · Cited by 8
Machine learning opportunities for nucleosynthesis studies
Smith, M. S., & Lu, D. (2024) · Frontiers in Astronomy and Space Sciences · doi:10.3389/fspas.2024.1494439 · Cited by 6
Chen, H., Zhao, Q., Lu, W., Jin, W., Gu, S., Li, Y., & Wang, X. (2025) · International Petroleum Technology Conference · doi:10.2523/iptc-24776-ms · Cited by 7
Enhancing REST API Handlers Organization for Node.js Microservices
Chaplia, O., Klym, H., Koņuhova, M., & Popov, A. I. (2025) · SN Computer Science · doi:10.1007/s42979-025-04311-8 · Cited by 5
Agent-as-a-Judge: Evaluate Agents with Agents
Zhuge, M., Zhao, C., Ashley, D., Wang, W., Khizbullin, D., Xiong, Y., Liu, Z., Chang, E., Krishnamoorthi, R., Tian, Y., et al. (2024) · arXiv · doi:10.48550/arxiv.2410.10934 · Cited by 5
A Review of Multi-Agent AI Systems for Biological and Clinical Data Analysis
Spieser, J., Balapour, A., Meller, J., Patra, K. C., & Shamsaei, B. (2026) · Methods and Protocols · doi:10.3390/mps9020033 · Cited by 5
Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMs
Cheng, C.-A., Nie, A., & Swaminathan, A. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-2287 · Cited by 4
Crash Scene to Resolution: LLM-based Agents Driven for Efficient Traffic Accident Handling
Huo, S., Rong, H., Zhou, Y., Zuo, H., Liu, D., Li, Z., Wang, M., & Jiang, H. (2025) · ACM Transactions on Internet of Things · doi:10.1145/3766899 · Cited by 4
Meta-X design: from tools to partners in human–machine co–creation for industry 5.0
Yu, C., Yan, T., & Chen, Y. (2025) · Journal of Engineering Design · doi:10.1080/09544828.2025.2571005 · Cited by 4
Vella, S., & Shariah, S. (2024) · Interdisciplinary Conference on Electrics and Computer (INTCEC) · doi:10.1109/intcec61833.2024.10602875 · Cited by 4
LLM-In-The-Loop: A Framework for Enhancing Drilling Data Analytics
Amin, S. T. A., Wu, K., Mathur, A., & Koritala, C. (2025) · SPE/IADC Drilling Conference · doi:10.2118/223805-ms · Cited by 6
Intelligent Agents for Data Exploration
Amer-Yahia, S. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3685800.3685913 · Cited by 6
Serverless Ai Agents in the Cloud
Chaplia, O., Klym, H., & Elsts, E. (2024) · Advances in Cyber-Physical Systems · doi:10.23939/acps2024.02.115 · Cited by 4
Privacy dilemmas and opportunities in large language models: a brief review
Li, H., Ye, J., & Wu, J. (2025) · Frontiers of Computer Science · doi:10.1007/s11704-024-40583-8 · Cited by 6
A chit-chat between Llama 2 and ChatGPT for the automated creation of exploits
Caturano, F., Ciotola, J., Romano, S. P., & Varlese, M. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111501 · Cited by 4
Advances in edge-cloud collaboration and evolution for large-small models
Wang, Y., Shen, T., Zhang, S., Wu, F., Zhao, Z., Cai, H., Lyu, C., Ma, L., Yang, C., & Wu, F. L. (2024) · Journal of Image and Graphics · doi:10.11834/jig.240011 · Cited by 8
Self-citationExploring large language models for climate forecasting
Wang, Y., & Karimi, H. A. (2025) · Applied Computing and Intelligence · doi:10.3934/aci.2025001 · Cited by 4
Flows: Building Blocks of Reasoning and Collaborating AIPreprint
Josifoski, M., Klein, L., Peyrard, M., Baldwin, N., Li, Y., Geng, S., Schnitzler, J. P., Yao, Y., Wei, J., Paul, D., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.01285 · Cited by 34
Proceedings of the Workshop on Edge and Mobile Foundation Models
(2024) · doi:10.1145/3662006 · Cited by 4
A multi-agent-driven robotic AI chemist enabling autonomous chemical research on demandPreprint
Song, T., Luo, M., Chen, L., Huang, Y. H., Zhu, Q., Liu, D., Zhang, B., Zou, G., Zhang, F., Shang, W., et al. (2024) · ChemRxiv · doi:10.26434/chemrxiv-2024-w953h · Cited by 4
Liu, Z., Xiao, Y., Su, Z. M., Ye, L., Lu, K., & Peng, X. (2025) · Scientific Data · doi:10.1038/s41597-025-04836-w · Cited by 4
Nedisan Videsjorden, A., Song, H., Goknil, A., Roman, D., & Soylu, A. (2026) · ACM Transactions on Internet of Things · doi:10.1145/3772077 · Cited by 5
Chen, Q., Ilami, S., Lore, N., & Heydari, B. (2026) · Journal of Mechanical Design · doi:10.1115/1.4070755 · Cited by 3
Language Agents as Optimizable Graphs
Zhuge, M., Wang, W., Kirsch, L., Faccio, F., Khizbullin, D., & Schmidhuber, J. (2024) · arXiv · doi:10.48550/arxiv.2402.16823 · Cited by 3
Benchmarking AutoGen with different large language models
Barbarroxa, R., Ribeiro, B., Gomes, L., & Vale, Z. (2024) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00058 · Cited by 5
Fair, Practical, and Efficient Carbon Accounting for LLM Serving
Li, Y. L., Han, L., Suh, G. E., Delimitrou, C., Kazhamiaka, F., Choukse, E., Fonseca, R., Yu, L., Mace, J., & Gupta, U. (2025) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/3764944.3764967 · Cited by 3
DialogLab: Authoring, Simulating, and Testing Dynamic Human-AI Group Conversations
Hu, E., Chen, Y., Li, M., Phadnis, V., Xu, P., Qian, X., Olwal, A., Kim, D., Heo, S., & Du, R. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747696 · Cited by 13
Applying Cognitive Design Patterns to General LLM Agents
Wray, R. E., Kirk, J. R., & Laird, J. E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-00800-8_28 · Cited by 6
Prolegomena to a Description Language for GenAI Tools in Cities
Degbelo, A. (2024) · Digital Government Research and Practice · doi:10.1145/3652952 · Cited by 3
Maya, F., & Wolf, K. D. (2024) · Advances in analytics for learning and teaching · doi:10.1007/978-3-031-56365-2_15 · Cited by 5
ChatKG: Visualizing time-series patterns aided by intelligent agents and a knowledge graph
Christino, L., & Paulovich, F. V. (2024) · Computers & Graphics · doi:10.1016/j.cag.2024.104092 · Cited by 3
Kadegaonkar, M., & Karim, K. (2025) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v6i1.36059 · Cited by 3
Integrated Design and Governance of Agentic AI Systems through Adaptive Information Modulation
Chen, Q., Ilami, S., Lore, N., & Heydari, B. (2024) · arXiv · Cited by 2
Memory Fabric for Conversational AI Agents: Enabling Shared and Persistent Memory Across Users
Tiwari, A., & Gupta, V. (2025) · TechRxiv · doi:10.36227/techrxiv.176523350.08289935/v1 · Cited by 2
Kraidia, I., Qaddara, I., Almutairi, A., Alzaben, N., & Belhouari, S. B. (2026) · Scientific Reports · doi:10.1038/s41598-026-42705-7 · Cited by 8
KUMAR, M., & Singh, D. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01373-2 · Cited by 6
Evidence-based AI: from trailblazer to trustblazer?
Luechtefeld, T., & Hartung, T. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1818128 · Cited by 4
Mobility ChatBot: supporting decision making in mobility data with chatbots
Padoan, L., Cesetti, M., Brunello, L., Antonelli, M., Zamengo, B., & Silvestri, F. (2024) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm61037.2024.00061 · Cited by 4
Enterprise Design, Operations and Computing with AI Agents: Accountability Using DSL
Milošević, Z., & Dejanović, I. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-78338-8_2 · Cited by 2
RAPID DEVELOPMENT OF CHATBOT FOR TOURISM PROMOTION IN LATGALE
Kodors, S., Kaņepe, G., Zeps, D., Zarembo, I., & Litavniece, L. (2024) · Environment Technology Resources Proceedings of the International Scientific and Practical Conference · doi:10.17770/etr2024vol2.8060 · Cited by 3
Stenzel, G., Schmid, K., Kölle, M., Altmann, P. J., Lingsch-Rosenfeld, M., Zorn, M., Bücher, T., Gabor, T., Wirsing, M., & Belzner, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-75434-0_8 · Cited by 3
Madrid, J., Diehl, P., Selig, M., Rolauffs, B., Hans, F. P., Busch, H.-J., Scheef, T., & Benning, L. (2024) · Research Square · doi:10.21203/rs.3.rs-4194579/v1 · Cited by 1
Application of Self-Evolving AI Agents in Chemical Research: A Novel Intelligent Assistance SystemPreprint
Ma, K. (2024) · ChemRxiv · doi:10.26434/chemrxiv-2024-6tv8c · Cited by 1
Symphony: Edge-powered Decentralized Multi-agent Framework for Autonomous Co-evolving IntelligencePreprint
Wang, J., Feng, Y., Ai, L., & Shi, B. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5361139 · Cited by 2
Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
Zhou, H., Chen, Y., Guo, S., Yan, X., Lee, K. H., Wang, Z., Lee, K. Y., Zhang, G., Shao, K., Yang, L., et al. (2025) · arXiv · doi:10.48550/arxiv.2508.16153 · Cited by 2
“Therefore, recent works propose multi-agent pipelines, such as AutoGen (Wu et al., 2023), OWL (Camel-AI, 2025) and DeerFlow (ByteDance, 2025) to coordinate specialised agents via dialogue.”
Wang, Z., Chen, J., Wei, Z., Lin, L., & Tong, G. (2026) · Sensors · doi:10.3390/s26113502 · Cited by 2
Preble: Efficient Distributed Prompt Scheduling for LLM Serving
Srivatsa, V., He, Z., Abhyankar, R., Li, D., & Zhang, Y. (2024) · arXiv · doi:10.48550/arxiv.2407.00023 · Cited by 1
Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
Wynn, A., Satija, H., & Hadfield, G. (2025) · arXiv · doi:10.48550/arxiv.2509.05396 · Cited by 96
“These role-based and decentralized systems often yield richer interactions (e.g. multi-turn planning) than a single LLM alone.”
A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memory
Wei, Q., Yang, T., Wang, Y., Li, X., Li, L., Yin, Z., Zhan, Y., Holz, T., Lin, Z., & Wang, X. (2025) · arXiv · doi:10.48550/arxiv.2510.02373 · Cited by 1
“The low detection rates reported by the Agent Security Bench (ASB) confirm the systemic failure of this isolated audit paradigm (Zhang et al., 2024; Luo et al., 2025).”
InfluentialFrom Prompts to Contracts: Harness Engineering for Auditable Enterprise LLM Agents
Ahn, J., & Kim, M. (2026) · arXiv · doi:10.48550/arxiv.2607.08028 · Cited by 1
Onobhayedo, P. A., Igah, C. O., & Okonkwo, A. (2024) · Journal on artificial intelligence · doi:10.32604/jai.2024.058649 · Cited by 2
Improving the Efficiency of LLM Inference Serving Systems
Papaioannou, K., & Doudali, T. D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-90203-1_39 · Cited by 1
Liu, Y., Abulawi, Z., Garimidi, A., & Lim, D. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.115989 · Cited by 7
LLMAGENTNET: A COLLABORATIVE NETWORK OF AUTONOMOUS AI AGENTS FOR COMPLEX TASK EXECUTION
Бідочко, А., & Виклюк, Я. І. (2025) · Науковий вісник НЛТУ України · doi:10.36930/40350412 · Cited by 3
Santiago, C. J. S., Shumaker, N., & Weir, A. (2025) · SPE Annual Technical Conference and Exhibition · doi:10.2118/228143-ms · Cited by 1
Opportunities of Large Language Models in the Development of Organic Electrosynthesis
Yu, Z., Yang, Q., & Mo, Y. (2025) · ACS electrochemistry. · doi:10.1021/acselectrochem.5c00377 · Cited by 2
Autonomous Analysis of Curated Patient Data Using a Large Language Model–Based Multiagent Framework
Wang, J., Swoboda, D. M., & Nazha, A. (2025) · JCO Clinical Cancer Informatics · doi:10.1200/cci-25-00176 · Cited by 1
Tumor Board–Inspired Multiagent Artificial Intelligence System for Interpreting Oncology Guidelines
Wang, J., Arora, K., Swoboda, D. M., & Nazha, A. (2026) · JCO Clinical Cancer Informatics · doi:10.1200/cci-25-00286 · Cited by 1
Yu, J. S., & Yao, Y. (2026) · Springer eBooks · doi:10.1007/978-981-95-4632-9_5 · Cited by 2
CausalAgent: A Conversational Multi-Agent System for End-to-End Causal Inference
Zhu, J., Chen, W., & Cai, R. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742414.3794777 · Cited by 1
Fang, W., Li, L., Shi, K., Yang, Y., & Zhang, J. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792976 · Cited by 1
Self-citationYue, L., Ko, C.-Y., Chen, P.-Y., Di, S., & Pan, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1820375 · Cited by 3
van Zyl, L. E. (2026) · The Journal of Positive Psychology · doi:10.1080/17439760.2026.2701096 · Cited by 2
Chen, H., Gu, S., Wang, X., Pang, F., & Lin, X. (2024) · International Conference on Educational Knowledge and Informatization (EKI) · doi:10.1145/3691720.3691807 · Cited by 1
Lac, V., & Leschik, D. (2024) · Springer eBooks · doi:10.1007/978-3-658-45132-5_15 · Cited by 1
Liu, Y., Shen, R., Zhou, L., Xiao, Q., Yuan, J., & Li, Y. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.19.594895 · Cited by 1
Pedrosa, D., & Gaspar, I. (2024) · Preprints.org · doi:10.20944/preprints202406.1554.v1 · Cited by 1
LMM Chemical Research with Document RetrievalPreprint
Kawchak, K. (2024) · ChemRxiv · doi:10.26434/chemrxiv-2024-p91gm · Cited by 1
PsychoLex: Unveiling the Psychological Mind of Large Language ModelsPreprint
Abbasi, M. A., Mirnezami, F. S., & Naderi, H. (2024) · Research Square · doi:10.21203/rs.3.rs-4920871/v1 · Cited by 1
PhysAgent: A Multi-Agent Large Language Model Framework for Physics Data Analysis and Simulation
Han, X., Gao, Z.-F., Guo, P., & Lu, Z.-Y. (2026) · Chinese Physics B · doi:10.32388/j2mxuw · Cited by 2
OmicOS: A Comprehensive Omics Ecosystem Infrastructure and Agent System for the AI EraPreprint
Zeng, Z., Meng, X., Hu, L., Li, C., Liu, P., Shi, Y., Ma, X., Gao, L., Wang, X., Luo, Z., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.11.731775 · Cited by 1
Self-citationChen, S. (2026) · arXiv · doi:10.48550/arxiv.2606.22528 · Cited by 21
“(iii) AutoGen ’s BufferedChatCompletionContext [18], which implements recency eviction, deterministically drops the policy from the agent’s context: violation reaches 100 % in the DeepSeek-V4 re-production ( n =20 ), confirming that recency-based strategies are the worst case identified in our…”
Effective Strategies for Asynchronous Software Engineering Agents
Geng, J., & Neubig, G. (2026) · arXiv · doi:10.48550/arxiv.2603.21489 · Cited by 23
“In dialogue-driven systems [Wu et al., 2024], delegation typically emerges implicitly through conversational interaction rather than explicit authority modeling, which can lead to redundant effort or delayed escalation.”
"Theater of Mind" for LLMs: A Cognitive Architecture Based on Global Workspace Theory
Shang, W. (2026) · arXiv · doi:10.48550/arxiv.2604.08206
“Role-playing methodologies, such as CAMEL [9], alongside communicative frameworks like AutoGen [10] and MetaGPT [11], facilitate decentralized task execution through sequential message passing.”
Chen, Y. (2026) · arXiv · doi:10.48550/arxiv.2606.14923 · Cited by 2
“A growing body of work places LLM agents in cooperative and competitive settings [14, 8, 18, 17], including repeated economic games [1], negotiation [13], and multi-agent debate in which agents cross-check one another [6, 10].”
Verifying Intent and Harm: A Unified Defense Against LLM-Generated Threats
Thota, P., Lei, Y., Thangaraj, S., Jonnalagadda, S. R., & Nilizadeh, S. (2026) · arXiv · doi:10.48550/arxiv.2606.26377
“We also evaluate our framework across multiple agent implementation frameworks including Autogen [33], OneTwo [53], LangChain [54], and Swarm [55], with detailed comparisons in Appendix 10.3.”
InfluentialAgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systems
Li, Y., Ping, S., Chen, X., Qi, X., Wang, Z., Luo, Y., & Zhang, X. (2025) · arXiv · doi:10.48550/arxiv.2511.00628
“The current mainstream multi-agent frameworks include LangGraph ( https://github.com/ langchain-ai/langgraph ), Agno ( https://docs.agno.com/introduction ), Autogen (Wu et al. 2024), CrewAI ( https://github.com/crewAIInc/crewAI ) and Dify ( https://github.com/ langgenius/dify ).”
Self-citationHarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry
Chen, T., Lu, S., Zhao, K., Meng, W., Teng, H., Li, T., Li, C., Liu, X., Liang, J., Zhang, Z., et al. (2026) · arXiv
“LangGraph [17] models the behavior of an agent with a stateful graph; AutoGen [39] models multi-agent interaction as structured conversation; CrewAI [26] assigns role-based identities to agents; and Letta [28] couples autonomous loops with persistent memory.”
Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks
Zheng, M., Han, K., Li, B., Xu, H., Tian, Y., He, W., Zhou, H., Guo, J., Hu, H., Ma, L., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.12344
“General-purpose harnesses [7, 29, 31] connect language models to external environments and support tool use across applications.”
Self-citationPrefillShare: A Shared Prefill Module for KV Reuse in Multi-LLM Disaggregated Serving
Woo, S., Kim, H., Shim, S., Jo, M., Jeong, H., Lee, J., Kim, J., Lee, S., Ryu, J., Park, B., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.12029
“…part of this trend, some recent works propose agentic workflows that employ multiple specialized models to collaboratively solve a complex task, leveraging different models to specialize in distinct behaviors or capabilities (Shen et al., 2023; Hong et al., 2023; Wu et al., 2024; Su et al., 2025).”
SparseX: Efficient Segment-Level KV Cache Sharing for Interleaved LLM Serving
Zhang, Q., Chen, K., Liao, N., Lin, Z., Tang, B., Xiong, F., Li, Z., & Wang, X. (2026) · arXiv · doi:10.48550/arxiv.2606.01751
“To demonstrate practical value, we integrate SparseX into existing multi-agent frameworks, including Auto-Gen [34] and MAD [35], and evaluate applicability in realistic collaborative environments.”
MAPLE-Guard: Memory-Aware Link Enforcement Against Memory-Link Poisoning in Multi-Agent Systems
Xiong, W., Zhou, Y., Wang, J., Gu, S., Tang, B., Li, Z., Xiong, F., Wen, Y., & Wen, M. (2026) · arXiv · doi:10.48550/arxiv.2608.00426 · Cited by 2
“LLM-based MAS coordinate agents through roles, workflows, and communication [15, 22, 34, 49].”
Metadata
- Authors
- Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., Jiang, L., Zhang, X., Zhang, S., Liu, J., Awadallah, A. H., White, R. W., Burger, D., & Wang, C.
- Affiliations
- Pennsylvania State University (US)
- Microsoft (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2308.08155
- OpenAlex
- W4385965642
- Cited by
- 193
- References
- 0
- Citations by year
- 2026: 61 · 2025: 71 · 2024: 58 · 2023: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (0424422)
- University of Pennsylvania
- Pennsylvania State University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- AutoGen, compilers, multi-agent systems, large language models, chatbots, LLM applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
