The DOI matches its DataCite record; 6 of the 6 references it cites were found in a registry or an index.
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Open accessAbstract
AutoGen is an open-source framework that allows developers to build LLM applications via multiple agents that can converse with each other to accomplish tasks. AutoGen agents are customizable, conversable, and can operate in various modes that employ combinations of LLMs, human inputs, and tools. Using AutoGen, developers can also flexibly define agent interaction behaviors. Both natural language and computer code can be used to program flexible conversation patterns for different applications. AutoGen serves as a generic infrastructure to build diverse applications of various complexities and LLM capacities. Empirical studies demonstrate the effectiveness of the framework in many example applications, with domains ranging from mathematics, coding, question answering, operations research, online decision-making, entertainment, etc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In this method, people use a set of diverse tasks from different domains to evaluate the agent, which can effectively measure the agent generalization capability in open-domain environments [29,80,153,163,165,166,167].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [153]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The development of medical AI agents can be approached through two primary methodologies: graphical user interface (GUI)-based frameworks and coding-based development.110,111,112”
From A foundational architecture for AI agents in healthcare (2025) · cites this paper as [110]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Each agent maintains a local memory, but the framework enforces controlled memory sharing and coordination protocols, thus allowing problem-solving behaviors that rely on distributed knowledge.”
From Memory Fabric for Conversational AI Agents: Enabling Shared and Persistent Memory Across Users (2025) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These agents exhibit human-like cognitive and metacognitive abilities, including task planning, situational assessment, progress monitoring, and collaborative efforts among agents.”
From Promises and challenges of generative artificial intelligence for human learning (2024) · cites this paper as [53]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Agentic AI systems are increasingly deployed in academic and industrial research pipelines to automate multi-stage knowledge compilation.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AutoGen [100] agents maintain scratchpads for intermediate computations, enabling stepwise task progression.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These systems are being used for literature reviews, grant preparation, and patent search pipelines, outperforming single-agent systems such as ChatGPT by enabling concurrent sub-task execution and long-context management [100].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This adaptive, memory-driven coordination exemplifies Agentic AI's potential to reduce labor costs, increase harvest efficiency, and respond to uncertainties in complex agricultural environments surpassing the rigid programming of conventional agricultural robots [100], [157].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AutoGen provides an open-source conversation framework that lets developers script arbitrary interaction graphs among tool-augmented agents [22].”
From Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLM-based agents are well-suited for creating personal assistants, such as agents capable of engaging in long-term conversations with users [94, 101, 153], as well as those tasked with automatically seeking information [164].”
From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [153]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Frameworks like AutoGen extend the above idea of summaries by providing an environment where multiple agents can communicate, delegate tasks, and specialize in roles [25].”
From Memory Fabric for Conversational AI Agents: Enabling Shared and Persistent Memory Across Users (2025) · cites this paper as [25]
The cited source says what the claim attributes to it.
In the citing paper
“This technique significantly enhances the capabilities of LLMs for managing complex tasks, including solving mathematical problems and performing retrieval-augmented code generation11–14.”
From Enhancing diagnostic capability with multi-agents conversational large language models (2025) · cites this paper as [11]
The cited source says what the claim attributes to it.
In the citing paper
“AutoGen [1] provides conversation patterns for multi-agent collaboration, while CrewAI [2] emphasizes role-based agent coordination.”
From AgentRM: An OS-Inspired Resource Manager for LLM Agent Systems (2026) · cites this paper as [1]
The cited source says what the claim attributes to it.
In the citing paper
“For example, platforms like AutoGen [100] and ChatDev [155] exemplify agentic coordination through task decomposition, role assignment, and recursive feedback loops.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The cited source says what the claim attributes to it.
In the citing paper
“Table I, which was derived from close analysis of prominent frameworks such as AutoGen [100] and ChatDev [155].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The emergence of conventions is a foundational element to any type of LLM multi-agent system (14, 41), including but not limited to “in silico” experiments to emulate human social networks (42).”
From Emergent social conventions and collective bias in LLM populations (2025) · cites this paper as [14]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, all these past works have not used such simulators to benchmark the reliability of agents, instead focusing on showcasing the ability of LMs to enable realistic simulations.”
From $τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains (2024) · cites this paper as [21]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Across all implementations, we observe the same trend as in the main results: prompt-response verification consistently improves over single-agent and singlesided variants.”
From Verifying Intent and Harm: A Unified Defense Against LLM-Generated Threats (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“These frameworks generally assume unlimited resources and don't provide mechanisms for handling resource contention, failed agents, or context overflow.”
From AgentRM: An OS-Inspired Resource Manager for LLM Agent Systems (2026) · cites this paper as [1]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Compared to traditional rule-based security systems, this agentic model enhances decision latency, reduces false positives, and supports proactive threat containment in large-scale organizational infrastructures [100].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 28
- Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Col- lisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, et al. Guidelines for human-ai interaction. In Proceedings of the 2019 chi conference on human factors in computing systems, 2019.
- Carrie J. Cai, Samantha Winter, David F. Steiner, Lauren Wilcox, and Michael Terry. "hello ai": Uncovering the onboarding needs of medical practitioners for human-ai collaborative decision- making. Proceedings of the ACM on Human-Computer Interaction, 2019.
- Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, and Denny Zhou. Large language models as tool makers. arXiv preprint arXiv:2305.17126, 2023. · arXiv
- Victor Dibia. LIDA: A tool for automatic generation of grammar-agnostic visualizations and info- graphics using large language models. In Proceedings of the 61st Annual Meeting of the Associ- ation for Computational Linguistics (Volume 3: System Demonstrations), Toronto, Canada, July 2023. Association for Computational Linguistics.
- Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch. Improv- ing factuality and reasoning in language models through multiagent debate. arXiv preprint arXiv:2305.14325, 2023. · arXiv
- Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. Measuring mathematical problem solving with the math dataset. arXiv preprint arXiv:2103.03874, 2021. · arXiv
- Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, et al. Metagpt: Meta programming for multi-agent collaborative framework. arXiv preprint arXiv:2308.00352, 2023. · arXiv
- Eric Horvitz. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 1999.
- Geunwoo Kim, Pierre Baldi, and Stephen McAleer. Language models can solve computer tasks. arXiv preprint arXiv:2303.17491, 2023. · arXiv
- Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al. Natural questions: a benchmark for question answering research. Transactions of the Association for Computational Linguistics, 2019.
- Mike Lewis, Denis Yarats, Yann N Dauphin, Devi Parikh, and Dhruv Batra. Deal or no deal? end- to-end learning for negotiation dialogues. arXiv preprint arXiv:1706.05125, 2017. · arXiv
- Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. Retrieval-augmented gen- eration for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems, 2020.
- Beibin Li, Konstantina Mellou, Bo Zhang, Jeevan Pathuri, and Ishai Menache. Large language models for supply chain optimization. arXiv preprint arXiv:2307.03875, 2023a. · arXiv
- Evan Zheran Liu, Kelvin Guu, Panupong Pasupat, Tianlin Shi, and Percy Liang. Reinforcement learning on web interfaces using workflow-guided exploration. arXiv preprint arXiv:1802.08802, 2018. · arXiv
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wier- stra, and Martin Riedmiller. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013. · arXiv
- Roberto Navigli, Simone Conia, and Björn Ross. Biases in large language models: Origins, inven- tory and discussion. ACM Journal of Data and Information Quality, 2023.
- Md Rizwan Parvez, Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. Retrieval augmented code generation and summarization. arXiv preprint arXiv:2108.11601, 2021. · arXiv
- Shishir G. Patil, Tianjun Zhang, Xin Wang, and Joseph E. Gonzalez. Gorilla: Large language model connected with massive apis. arXiv preprint arXiv:2305.15334, 2023. · arXiv
- Nils Reimers and Iryna Gurevych. Sentence-bert: Sentence embeddings using siamese bert- networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 11 2019. URL https://arxiv.org/ abs/1908.10084. · arXiv
- Bokui Shen, Fei Xia, Chengshu Li, Roberto Martín-Martín, Linxi Fan, Guanzhi Wang, Claudia Pérez-D'Arpino, Shyamal Buch, Sanjana Srivastava, Lyne Tchapmi, et al. igibson 1.0: A simu- lation environment for interactive tasks in large realistic scenes. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021.
- Tianlin Shi, Andrej Karpathy, Linxi Fan, Jonathan Hernandez, and Percy Liang. World of bits: An open-domain platform for web-based agents. In International Conference on Machine Learning. PMLR, 2017.
- Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, Yonatan Bisk, Adam Trischler, and Matthew Hausknecht. ALFWorld: Aligning Text and Embodied Environments for Interactive Learning. In Proceedings of the International Conference on Learning Representations (ICLR), 2021. URL https://arxiv.org/abs/2010.03768. · arXiv
- Oriol Vinyals, Timo Ewalds, Sergey Bartunov, Petko Georgiev, Alexander Sasha Vezhnevets, Michelle Yeo, Alireza Makhzani, Heinrich Küttler, John Agapiou, Julian Schrittwieser, et al. Starcraft ii: A new challenge for reinforcement learning. arXiv preprint arXiv:1708.04782, 2017. · arXiv
- Chi Wang, Qingyun Wu, Markus Weimer, and Erkang Zhu. Flaml: A fast and lightweight automl library. Proceedings of Machine Learning and Systems, 2021.
- Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. Voyager: An open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291, 2023a. · arXiv
- Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. A survey on large language model based autonomous agents. arXiv preprint arXiv:2308.11432, 2023b. · arXiv
- Daniel S. Weld and Oren Etzioni. The first law of robotics (a call to arms). In AAAI Conference on Artificial Intelligence, 1994.
- Yiran Wu, Feiran Jia, Shaokun Zhang, Qingyun Wu, Hangyu Li, Erkang Zhu, Yue Wang, Yin Tat Lee, Richard Peng, and Chi Wang. An empirical study on challenging math problem solving with gpt-4. arXiv preprint arXiv:2306.01337, 2023. · arXiv
Cited by
Sorted by citations
Items 201–295 of 295
Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systems
Feng, S., Wang, Z., Goyal, P., Wang, Y., Shi, W., Xia, H., Palangi, H., Zettlemoyer, L., Tsvetkov, Y., Lee, C.-Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.04510 · Cited by 18
“…generate feedback for each other’s responses to collectively self-refine [25, 7]; (multi-)agent systems could divide and conquer complex problems [98, 33, 91, 60, 118, 71, 47, 65, 55, 99, 43, 56, 92, 86, 53, 75, 68, 9, 17, 119]; multiple LLMs could debate and compete with each other to find…”
SwarmSys: Decentralized Swarm-Inspired Agents for Scalable and Adaptive Reasoning
Li, R., Liu, H., Zhao, L., Li, Z., Li, J., Jiang, J., Xu, L., Zhao, C., Fan, M., & Liang, C. (2025) · arXiv · doi:10.48550/arxiv.2510.10047 · Cited by 5
“AutoGen Studio further provides a no-code interface for designing and debugging agent workflows (Dibia et al., 2024).”
RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory
Liu, J., Kong, Z., Yang, C., Yang, F., Li, T., Dong, P., Nanjekye, J., Tang, H., Yuan, G., Niu, W., et al. (2025) · arXiv · doi:10.48550/arxiv.2508.04903
“Despite recent progress, current multi-agent LLM architectures (crewai 2025; Wu et al. 2023; Chase 2024; Elovic 2025; Gao et al. 2025) still rely on relatively simplistic context management strategies.”
InfluentialSelf-citationCollaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control
Rezazadeh, A., Li, Z., Lou, A., Zhao, Y., Wei, W., & Bao, Y. (2025) · arXiv · doi:10.48550/arxiv.2505.18279
“AutoGen provides an open-source conversation framework that lets developers script arbitrary interaction graphs among tool-augmented agents [22].”
Barbaste, P., Darrigol, T., Vu, G., & Wiltberger, T. (2026) · arXiv · doi:10.48550/arxiv.2609.00006
Multi-Agent Systems Execute Arbitrary Malicious Code
Triedman, H., Jha, R., & Shmatikov, V. (2025) · arXiv · doi:10.48550/arxiv.2503.12188 · Cited by 52
Shared Selective Persistent Memory for Agentic LLM Systems
Pedada, S., Dhavala, A., & Patil, N. (2026) · arXiv · doi:10.48550/arxiv.2607.09493
At Equal Inference Cost, Multi-Agent Structure Does Not Beat a Single Frozen Agent
Dylan, D., Brennan, A., Murphy, C., O'Sullivan, N., Kelly, C., & Walsh, S. (2026) · arXiv · doi:10.48550/arxiv.2609.04217 · Cited by 3
SMSR: Certified Defence Against Runtime Memory Poisoning in Persistent LLM Agent Systems
Sharma, T. (2026) · arXiv · doi:10.48550/arxiv.2606.12703 · Cited by 8
Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
Du, P. (2026) · arXiv · Cited by 1
AgentRoom: Concurrent Multi-Agent Coding in a CRDT-Backed Shared Workspace
Cho, S., & Lee, D. (2026) · arXiv · doi:10.48550/arxiv.2608.23740 · Cited by 2
HiveMind: Contribution-Guided Online Prompt Optimization of LLM Multi-Agent Systems
Xia, Y., Wang, T., Zhang, S., Weng, Z., Cao, B., & Liew, S. C. (2025) · arXiv · doi:10.48550/arxiv.2512.06432
Self-citationSE-Blackboard: A Shared-State Architecture for Multi-Agent Software Engineering Pipelines
Liu, E., Zhu, Q., & Dong, X. (2026) · IEEE Access · doi:10.1109/access.2026.3695435
AgentRM: An OS-Inspired Resource Manager for LLM Agent Systems
She, J. (2026) · arXiv · doi:10.48550/arxiv.2603.13110
Multi-agent Collaboration with State Management
Liu, M., Chen, T., Xu, Z., Jiang, X., & Dong, Y. (2026) · arXiv
TokenDance: Scaling Multi-Agent LLM Serving via Collective KV Cache Sharing
Bian, Z., Wu, F., Zhang, C., Dong, H., Liang, Y., & Zhuo, Y. (2026) · arXiv · doi:10.48550/arxiv.2604.03143
Raven: The Harness of Harnesses for Composable Agentic Intelligence
AI, E. (2026) · arXiv
FlowReasoner: Reinforcing Query-Level Meta-Agents
Gao, H., Liu, Y., He, Y., Dou, L., Du, C., Deng, Z., Hooi, B., Lin, M., & Pang, T. (2025) · arXiv · doi:10.48550/arxiv.2504.15257
Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies
Zhou, H., Wan, X., Sun, R., Palangi, H., Iqbal, S., Vulić, I., Korhonen, A., & Arık, S. Ö. (2025) · arXiv · doi:10.48550/arxiv.2502.02533
Mendel Gödel Machine: Recursive Self-Improving Coding Agents via Comparative Evolution
Liu, C., Liu, Y., Yan, S., Tresp, V., & Ma, Y. (2026) · arXiv · doi:10.48550/arxiv.2608.07645
GitSwarm: Decentralized Compounding Inference
Shah, V., Samanta, A., Dahal, P., Plekhanov, M., Wu, C.-J., Yih, S., Munos, R., Fergus, R., Foerster, J., Salakhutdinov, R., et al. (2026) · arXiv · doi:10.48550/arxiv.2610.04862
EvoFlow: Evolving Diverse Agentic Workflows On The Fly
Zhang, G., Chen, K., Wan, G., Chang, H., Cheng, H., Wang, K., Hu, S., & Bai, L. (2025) · arXiv · doi:10.48550/arxiv.2502.07373
Transformative Trends: A Comprehensive Review of Large Language Models (LLMs) in Healthcare
Kumari, C. (2024) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem35401
A Chit-Chat between Llama2 and Chatgpt for the Automated Creation of ExploitsPreprint
Romano, S. P., Caturano, F., & Ciotola, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4886571
Zhou, L., Fang, C., Chen, R., & Liu, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5058380
Emergent Dominance Hierarchies in Reinforcement Learning Agents
Rachum, R., Nakar, Y., Tomlinson, B., Alon, N., & Mirsky, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-82039-7_4 · Cited by 1
Jeong, M., Kim, T., Choi, K., Kim, S., Baek, S., & Kim, H. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5224792
Pathways of Machine Learning-Based Agents on Diverse Communication Structures
Purushothaman, S., Granitzer, M., Lemmerich, F., & Mitrović, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-87327-0_5
A Method for Detecting Knowledge Conflicts in Chinese Intelligent Agent Interactions
Cheng, H., Gu, Y., Xi, M., Zhong, Q., & Liu, W. (2025) · Interdisciplinary Journal of Information Knowledge and Management · doi:10.28945/5497
An LLM-centred Lens on Generative AI in Marketing
Hartleif, L. (2025) · Springer eBooks · doi:10.1007/978-3-658-47793-6_5
AGI via Multi-Agent Systems: Towards a Scalable and Adaptive Intelligence Model
Ubhe, M. P., & Samant, R. M. (2025) · International Journal of Computer Applications · doi:10.5120/ijca2025925180 · Cited by 1
SuperCode: Sustainability PER AI-driven Co-design
Broekema, P. C., & van Nieuwpoort, R. V. (2025) · ACM International Conference on Computing Frontiers: Workshops and Special Sessions (CF Companion) · doi:10.1145/3706594.3727576 · Cited by 1
Large Language Model Based Agents for Generating Industrial Dashboards
Kimmel, R., Pfeiffer, J., Zhang, J., & Wortmann, A. (2025) · Lecture notes in production engineering · doi:10.1007/978-3-031-86893-1_57
Self-citationAramideh, A., Noshary, T. F. D., & Kozegar, E. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5369767
Bogadi, C. R. (2025) · International Journal of Computer Trends and Technology · doi:10.14445/22312803/ijctt-v73i7p101
Xue, B., Jiang, R., Xue, Y., Zhang, H., Liu, S., & Gao, Y. Q. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.12.03.692218
SagaLLM: Persistent Context Management, Constraint Validation, and Transaction Guarantees
Chang, E. Y. (2025) · ACM eBooks · doi:10.1145/3749421.3749435
Schnepf, J., Schwarz, M., Scheuermann, B., & Anderer, S. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-15632-7_7
Uma, S., Ghosh, S., & Mustaqim, D. D. A. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789130
[Withdrawn] AI Agents Need Memory Control Over More ContextPreprint
Bousetouane, F. (2026) · Qeios · doi:10.32388/mzqb3t
A Software Synapse for a Multi-Agent System Based on Large Language Models
Tereshchenko, S. N., & Shchedrov, A. V. (2025) · doi:10.1145/3788149.3788219
Schömbs, S., Zhang, Y., Wang, C., & Johal, W. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3799366
Self-citationArchitectural Design Principles
Oliveira, P. R. S. D., Pereira, J. D. C., & Nováis, P. (2026) · SpringerBriefs in intelligent systems · doi:10.1007/978-3-032-24781-0_3
Oliveira, P., Pereira, J. D. C., & Nováis, P. (2026) · SpringerBriefs in intelligent systems · doi:10.1007/978-3-032-24781-0_7
From Stateless Code Generation to Living Ontologies
Gomes, A. M., Maia, P. H. M., Linhares, V. F. D. O., & Vieira, I. L. (2026) · International Workshop on Agentic Engineering · doi:10.1145/3786167.3788408 · Cited by 1
CARIBOU: Computational AI Research Interface for Bioinformatics, Omics, and Unifying AgentsPreprint
Riffle, D., Shirooni, N., Sureshkumar, P., Vijay, V., & Rose, M. F. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.25.727730
ClinAgent: AI-assisted methodology for clinical trial data processing and statistical programming
Yan, J. (2026) · Biology Methods and Protocols · doi:10.1093/biomethods/bpag032 · Cited by 1
Petridis, S., Liu, M. X., Fiannaca, A. J., Cai, C. J., & Terry, M. A. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812956 · Cited by 5
Lin, Z., Chen, S., & Sun, H. (2026) · ACM Symposium on Access Control Models and Technologies (SACMAT) · doi:10.1145/3750555.3811883
Sema Core: An Open, Embeddable AI Coding Agent Runtime for the IDE and Beyond
Wang, H., Zhou, J., Zhu, N., Zhang, S., Tu, Y., Chen, F., Wu, J., Zhou, Z., Chen, G., Liu, C., et al. (2026) · ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity (SPLASH) · doi:10.1145/3837729.3840503
Self-citationChecklist Rubric-Driven Iterative Control for Mitigating Context Drift in Deep Research Agents
Kim, M., & Jung, Y. (2026) · The Journal of Korean Institute of Information Technology · doi:10.14801/jkiit.2026.24.6.1
Intelligent Analysis of Software Team Performance: An Agentic Approach
Bishop, V., & Krause, L. (2026) · Structural integrity · doi:10.1007/978-3-032-19744-3_3
Slany, E., Buchmann, S., Föhr, T. L., Amling, J., Frummet, A., Lang, M., & Scheele, S. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-30809-2_28
HiRA: Decoupling Planning and Execution with Hierarchical Reasoning in Deep Search
Jin, J., Li, X., Zhang, Y., Dong, G., Yang, Z., Zhu, Y., & Dou, Z. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809666
Engineering Practices in Open-Source Agent Frameworks: A Large-Scale Empirical Study
Zhai, Y., Si, J., Wang, Y., & Lin, W. (2026) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3803437.3805533
A Road Map for Tamed Interactions with Large Language Models
Scotti, V., Keim, J., Hey, T., Metzger, A., Koziolek, A., & Mirandola, R. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3832776 · Cited by 2
BICA-Inspired Multiagent Model of Self-Awareness Based on LLM
Samsonovich, A. V., & Khabarov, D. L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33195-3_19
Vibe researching: can AI agents with skills replace or augment social scientists?
Zhang, Y. (2026) · Chinese Sociological Review · doi:10.1080/21620555.2026.2707167 · Cited by 2
Leng, C., Kang, X., Wang, H., Ren, S., & Zhang, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31930-2_19
Self-citationDuCCAE: A Hybrid Engine for Immersive Conversation via Collaboration, Augmentation, and Evolution
Shen, X., Jiang, Z., Yang, J., Liu, H., Wan, Y., Zhang, J., Dai, T., Xu, L., Wu, S., Qi, G., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818383
Self-citationZhao, J., Li, H., He, T., Liu, C., Xu, L., He, X. D., & Fang, G. (2026) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.6c02004
Zhou, Y., Honary, M., & Fayoumi, A. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10802-7
EvoEdge: A Traceable Agentic Workflow for IoT and Edge Security Review
Wang, X., Liao, L., Wang, F., & Ye, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36493-7_7
Vien, P. T. (2026) · International Conference on Intelligent Information Technology (ICIIT) · doi:10.1145/3805862.3805918
Qian, X., Xu, Y., Ma, C., & Chan, C. K. (2026) · Research Square · doi:10.21203/rs.3.rs-10522439/v1
Archeological theory and AI: the potential past through agentic systems
Altaweel, M. R., & Forte, M. (2026) · AI & Society · doi:10.1007/s00146-026-03287-0
Contagion on the Trading Floor: How Adversarial Signals Spread in Multi-Agent Trading Systems
Rong, S. Q., Dong, J., Thai, N. D., Wen, Y., Tan, C., & Ong, Y.-S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37673-2_12 · Cited by 1
Kumar, N. A., & Kataria, V. (2026) · Journal of Hospitality and Tourism Insights · doi:10.1108/jhti-12-2025-1458
Synth: Code as the Control Plane for Long-Horizon Agents
Gandhi, S., Jain, S., Agarwal, G., Singh, T., & Prajwala, T. R. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-35078-7_18
Liu, Z. (2026) · International Conference on Digital Society and Artificial Intelligence (DSAI) · doi:10.1145/3833541.3833805
AI Employees: A Role Programming Framework for Supervising Autonomous Systems
Zheng, S. (2026) · International Conference on Automation Control, Algorithm and Intelligent Bionics (ACAIB) · doi:10.1145/3828836.3828919
An agentic AI environment to support biomedical research in collaborative academic environmentsPreprint
Wu, T., Browne, T. S., Meawad, M., Emam, H. E., Simsam, N. H., Xia, Y., Jaafar, A., Ma, A., Kabbani, B., Gupta, V., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.24.753565
Wang, J., Wang, Q., Yang, P., Li, G., Wang, X., Sun, Y., Feng, Z., Gao, Y., Li, Y., Guo, W., et al. (2026) · npj Digital Public Health · doi:10.1038/s44482-026-00045-3
Making Enterprise AI Explainable through Calibrated Confidence and Provenance
Krstev, S., Devedžić, V., & Krneta, D. (2026) · Applied Artificial Intelligence · doi:10.1080/08839514.2026.2739513
Feng, T., Xue, M., Wang, J., & Du, Z. (2026) · doi:10.1145/3843778.3844521
LaMAR: Latent Multi-agent Collaboration via KV-Cache Communication for Automated Program Repair
Jiao, R., Zhang, Y., Feng, Z., & Li, J. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3837423
Lops, A., Ferrara, A., Narducci, F., Ragone, A., & Trizio, M. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834507
Evidence-Driven, Failure-Resilient Planning for Domain-Agnostic Multi-agent Orchestration
Osmanoglu, B. (2026) · International Workshop on Agentic AI for Next-Generation Software Development · doi:10.1145/3843282.3844428
Towards Declarative Composition of Heterogeneous AI Agents
Morais, A. M. A., Maia, P. H. M., & Manyà, F. (2026) · doi:10.1145/3843778.3844518
Chi, Y., Liu, M., Hong, Y., Li, H., & Liang, X. (2026) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3785651.3831571
Can autonomous Agentic-AI systems accelerate drug discovery and development in the next decade?
Chaturvedi, N., Haque, S., & Kumar, V. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag583
VulnPilot: A Multi-agent LLM Framework for Automated Penetration Testing
Zhang, X., & Xie, B. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-6843-6_5
Self-citationJiang, H., Sun, L., Su, T., & Li, Y. (2026) · International Conference on Intelligent Education and Computer Technology (IECT) · doi:10.1145/3845354.3845454
MARFT: Multi-Agent Reinforcement Fine-Tuning
Liao, J., Wen, M., Wang, J., & Zhang, W. (2025) · arXiv · doi:10.48550/arxiv.2504.16129
Multi-agent Architecture Search via Agentic Supernet
Zhang, G., Niu, L., Fang, J., Wang, K., Bai, L., & Wang, X. (2025) · arXiv · doi:10.48550/arxiv.2502.04180
More Capable, Less Cooperative? When LLMs Fail At Zero-Cost Collaboration
Yadav, A., Black, S., & Sourbut, O. (2026) · arXiv · doi:10.48550/arxiv.2604.07821
“Large language models (LLMs) are increasingly deployed as agents that plan, communicate, and coordinate with others (Park et al., 2023; Wu et al., 2023; Li et al., 2023).”
VADAOrchestra: Neurosymbolic Orchestration of Adaptive Reasoning Workflows
Baldazzi, T., Bellomarini, L., Coletta, A., Iezzi, M., Maple, C., Pesare, A., & Sallinger, E. (2026) · arXiv · doi:10.48550/arxiv.2606.22485
Courtis, D., Li, W., & Sanner, S. (2026) · arXiv · doi:10.48550/arxiv.2607.01531
When Parallelism Pays Off: Cohesion-Aware Task Partitioning for Multi-Agent Coding
Yang, X., Nie, L., Chandra, E., Gannutin, S., Lin, F., & Chaudhuri, S. (2026) · arXiv · doi:10.48550/arxiv.2606.00953
EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms
Yuan, S., Song, K., Chen, J., Tan, X., Li, D., & Yang, D. (2024) · arXiv · doi:10.48550/arxiv.2406.14228
Emergent social conventions and collective bias in LLM populations
Ashery, A. F., Aiello, L. M., & Baronchelli, A. (2024) · arXiv · Cited by 80
MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems
Ye, R., Tang, S., Ge, R., Du, Y., Yin, Z., Chen, S., & Shao, J. (2025) · arXiv · doi:10.48550/arxiv.2503.03686
ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents
Levy, I., Wiesel, B., Marreed, S., Oved, A., Yaeli, A., Mashkif, N., & Shlomov, S. (2024) · arXiv · doi:10.48550/arxiv.2410.06703 · Cited by 1
Metadata
- Authors
- Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., Jiang, L., Zhang, X., Zhang, S., Liu, J., Awadallah, A. H., White, R. W., Burger, D., & Wang, C.
- Affiliations
- Pennsylvania State University (US)
- Microsoft (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2308.08155
- OpenAlex
- W4385965642
- Cited by
- 193
- References
- 0
- Citations by year
- 2026: 61 · 2025: 71 · 2024: 58 · 2023: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (0424422)
- University of Pennsylvania
- Pennsylvania State University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- AutoGen, compilers, multi-agent systems, large language models, chatbots, LLM applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review