AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Open accessAbstract
AutoGen is an open-source framework that allows developers to build LLM applications via multiple agents that can converse with each other to accomplish tasks. AutoGen agents are customizable, conversable, and can operate in various modes that employ combinations of LLMs, human inputs, and tools. Using AutoGen, developers can also flexibly define agent interaction behaviors. Both natural language and computer code can be used to program flexible conversation patterns for different applications. AutoGen serves as a generic infrastructure to build diverse applications of various complexities and LLM capacities. Empirical studies demonstrate the effectiveness of the framework in many example applications, with domains ranging from mathematics, coding, question answering, operations research, online decision-making, entertainment, etc.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Multi-task evaluation uses a set of diverse tasks from different domains to evaluate agent generalization capability in open-domain environments.
“In this method, people use a set of diverse tasks from different domains to evaluate the agent, which can effectively measure the agent generalization capability in open-domain environments [29,80,153,163,165,166,167].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [153]
The Figure 4 caption reports evaluations across four applications—math, question answering, ALFWorld, and coding—supporting the use of diverse tasks. It does not say that these evaluations effectively measure agent generalization in open-domain environments; that part of the attributed claim is unsupported. (LLM, conf=0.82)
Experimental — accuracy not yet measuredThe development of medical AI agents can be approached through two primary methodologies: GUI-based frameworks and coding-based development.
“The development of medical AI agents can be approached through two primary methodologies: graphical user interface (GUI)-based frameworks and coding-based development.110,111,112”
From A foundational architecture for AI agents in healthcare (2025) · cites this paper as [110]
The Introduction and §2.2, “Conversation Programming,” describe AutoGen as a framework for developing agents using programming languages, including Python. That supports the coding-based development part, but the paper does not present GUI-based frameworks or establish these as the two primary methodologies for medical AI agents. (LLM, conf=0.84)
Experimental — accuracy not yet measuredIn AutoGen, each agent maintains a local memory, but the framework enforces controlled memory sharing and coordination protocols, allowing problem-solving behaviors that rely on distributed knowledge.
“Each agent maintains a local memory, but the framework enforces controlled memory sharing and coordination protocols, thus allowing problem-solving behaviors that rely on distributed knowledge.”
From Memory Fabric for Conversational AI Agents: Enabling Shared and Persistent Memory Across Users (2025) · cites this paper as [25]
The Expanded Discussion (section B; page unavailable) says agents can share knowledge to solve problems collectively and that information can be shared between conversations in a controlled manner. The Task description describes memory handled by a Commander agent and shared with other agents, not local memory maintained by every agent. The paper describes configurable conversation patterns rather than a framework-wide requirement that enforces controlled sharing and coordination protocols. (LLM, conf=0.84)
Experimental — accuracy not yet measuredGenerative agents exhibit human-like cognitive and metacognitive abilities.
“These agents exhibit human-like cognitive and metacognitive abilities, including task planning, situational assessment, progress monitoring, and collaborative efforts among agents.”
From Promises and challenges of generative artificial intelligence for human learning (2024) · cites this paper as [53]
Section 2.1, “Conversable Agents” (page not available), describes implicit state inference, progress-making and feedback use; “Detailed Workflow” describes an assistant generating plans and making action decisions. “B Expanded Discussion” describes agents collaborating. These support the listed activities, but the paper does not establish that the agents have human-like cognitive or metacognitive abilities. (LLM, conf=0.85)
Experimental — accuracy not yet measuredAgentic AI systems are increasingly deployed in academic and industrial research pipelines to automate multi-stage knowledge compilation.
“Agentic AI systems are increasingly deployed in academic and industrial research pipelines to automate multi-stage knowledge compilation.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The Retrieval-augmented Assistant section describes a multi-agent workflow that processes documents, retrieves relevant passages, and generates answers. But the paper presents this as an AutoGen application, not evidence that agentic systems are increasingly deployed in academic and industrial research pipelines for knowledge compilation. (LLM, conf=0.84)
Experimental — accuracy not yet measured
AutoGen agents maintain scratchpads for intermediate computations, enabling stepwise task progression.
“AutoGen [100] agents maintain scratchpads for intermediate computations, enabling stepwise task progression.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The Detailed Workflow section describes an assistant that plans and makes successive action decisions using an executor’s feedback; the MiniWobChat Figure 17 caption likewise says the assistant records feedback and continues. These passages support stepwise task progression, but our copy does not establish that AutoGen agents maintain scratchpads for intermediate computations. (LLM, conf=0.84)
Experimental — accuracy not yet measuredMulti-agent research systems are being used for literature reviews, grant preparation, and patent search pipelines, outperforming single-agent systems such as ChatGPT by enabling concurrent sub-task execution and long-context management.
“These systems are being used for literature reviews, grant preparation, and patent search pipelines, outperforming single-agent systems such as ChatGPT by enabling concurrent sub-task execution and long-context management [100].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The A1: Math Problem Solving section reports that an AutoGen system outperformed alternatives including ChatGPT with Code Interpreter or a plugin on a math benchmark. The Task description section also describes an agent retaining context from prior user interactions. Neither passage supports use in literature reviews, grant preparation, or patent searches, or attributes the performance advantage to concurrent sub-task execution and long-context management. Page numbers are not provided in our copy. (LLM, conf=0.85)
Experimental — accuracy not yet measuredAdaptive, memory-driven coordination in multi-robot Agentic AI exemplifies its potential to reduce labor costs, increase harvest efficiency, and respond to uncertainties in complex agricultural environments, surpassing the rigid programming of conventional agricultural robots.
“This adaptive, memory-driven coordination exemplifies Agentic AI's potential to reduce labor costs, increase harvest efficiency, and respond to uncertainties in complex agricultural environments surpassing the rigid programming of conventional agricultural robots [100], [157].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredAutoGen provides an open-source conversation framework that lets developers script arbitrary interaction graphs among tool-augmented agents.
“AutoGen provides an open-source conversation framework that lets developers script arbitrary interaction graphs among tool-augmented agents [22].”
From Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control (2025) · cites this paper as [22]
The Introduction describes AutoGen as a multi-agent conversation framework with agents that can use tools, and the Discussion identifies it as open-source. Section 2.2 says developers can program flexible, including dynamic, conversation flows among agents. It does not establish that the framework supports arbitrary interaction graphs; that part is stronger than the paper's stated scope. (LLM, conf=0.83)
Experimental — accuracy not yet measuredAutoGen provides an environment where multiple agents can communicate, delegate tasks, and specialize in roles.
“Frameworks like AutoGen extend the above idea of summaries by providing an environment where multiple agents can communicate, delegate tasks, and specialize in roles [25].”
From Memory Fabric for Conversational AI Agents: Enabling Shared and Persistent Memory Across Users (2025) · cites this paper as [25]
The multi-agent framework significantly enhances the capabilities of LLMs for managing complex tasks, including solving mathematical problems and performing retrieval-augmented code generation.
“This technique significantly enhances the capabilities of LLMs for managing complex tasks, including solving mathematical problems and performing retrieval-augmented code generation11–14.”
From Enhancing diagnostic capability with multi-agents conversational large language models (2025) · cites this paper as [11]
AutoGen provides conversation patterns for multi-agent collaboration.
“AutoGen [1] provides conversation patterns for multi-agent collaboration, while CrewAI [2] emphasizes role-based agent coordination.”
From AgentRM: An OS-Inspired Resource Manager for LLM Agent Systems (2026) · cites this paper as [1]
Platforms like AutoGen and ChatDev exemplify agentic coordination through task decomposition, role assignment, and recursive feedback loops.
“For example, platforms like AutoGen [100] and ChatDev [155] exemplify agentic coordination through task decomposition, role assignment, and recursive feedback loops.”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
Table I was derived from close analysis of prominent frameworks such as AutoGen and ChatDev.
“Table I, which was derived from close analysis of prominent frameworks such as AutoGen [100] and ChatDev [155].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The emergence of conventions is a foundational element to any type of LLM multi-agent system.
“The emergence of conventions is a foundational element to any type of LLM multi-agent system (14, 41), including but not limited to “in silico” experiments to emulate human social networks (42).”
From Emergent social conventions and collective bias in LLM populations (2025) · cites this paper as [14]
The Introduction describes multi-agent conversations and programmed interaction patterns as central to AutoGen, but does not say that conventions emerge or are foundational to all LLM multi-agent systems. Searches for “emergence of conventions” and for emerging norms in multi-agent systems found no passage addressing that claim; the indexed passages provide no page numbers. (LLM, conf=0.72)
Experimental — accuracy not yet measuredPast works on LM user simulation have not used such simulators to benchmark the reliability of agents, instead focusing on showcasing the ability of LMs to enable realistic simulations.
“However, all these past works have not used such simulators to benchmark the reliability of agents, instead focusing on showcasing the ability of LMs to enable realistic simulations.”
From $τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains (2024) · cites this paper as [21]
The Introduction and Multi-Agent Systems section discuss prior LLM-agent work, but do not say whether LM user simulators were used to benchmark agent reliability or what those works primarily aimed to demonstrate. Searches for user simulation, realistic simulations, and reliability benchmarking found no passage addressing that comparison. (LLM, conf=0.73)
Experimental — accuracy not yet measuredAcross all implementations (AutoGen, OneTwo, LangChain, Swarm), prompt-response verification consistently improves over single-agent and single-sided variants.
“Across all implementations, we observe the same trend as in the main results: prompt-response verification consistently improves over single-agent and singlesided variants.”
From Verifying Intent and Harm: A Unified Defense Against LLM-Generated Threats (2026) · cites this paper as [33]
The A2 results passage reports gains from interactive retrieval and multi-agent designs, but not from prompt-response verification. Searches for “prompt-response verification” and the named implementations found no comparison with single-agent and single-sided verification variants across AutoGen, OneTwo, LangChain, and Swarm. The cited paper therefore does not establish the attributed trend. (LLM, conf=0.76)
Experimental — accuracy not yet measuredThese frameworks generally assume unlimited resources and don't provide mechanisms for handling resource contention, failed agents, or context overflow.
“These frameworks generally assume unlimited resources and don't provide mechanisms for handling resource contention, failed agents, or context overflow.”
From AgentRM: An OS-Inspired Resource Manager for LLM Agent Systems (2026) · cites this paper as [1]
The Future Work section raises questions about cost-effective workflows and says fail-safes against cascading failures will be important. It does not say that multi-agent frameworks generally assume unlimited resources or lack mechanisms for resource contention, failed agents, or context overflow. Searches for those terms and related concepts found no passage establishing the attributed generalization. (LLM, conf=0.72)
Experimental — accuracy not yet measuredCompared to traditional rule-based security systems, the agentic model enhances decision latency, reduces false positives, and supports proactive threat containment in large-scale organizational infrastructures.
“Compared to traditional rule-based security systems, this agentic model enhances decision latency, reduces false positives, and supports proactive threat containment in large-scale organizational infrastructures [100].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [100]
The “Commander Safeguard Writer” section (page unavailable) describes an agent screening generated code for safety, not containing threats in organizational infrastructure. The Discussion section (page unavailable) reports general performance benefits, but the searched passages provide no comparison with rule-based security systems or findings on decision latency and false positives. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 32
- Vaibhav Adlakha, Parishad BehnamGhader, Xing Han Lu, Nicholas Meade, and Siva Reddy. Eval- uating correctness and faithfulness of instruction-following models for question answering. arXiv preprint arXiv:2307.16877, 2023. · arXiv
- Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Col- lisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, et al. Guidelines for human-ai interaction. In Proceedings of the 2019 chi conference on human factors in computing systems, 2019.
- Carrie J. Cai, Samantha Winter, David F. Steiner, Lauren Wilcox, and Michael Terry. "hello ai": Uncovering the onboarding needs of medical practitioners for human-ai collaborative decision- making. Proceedings of the ACM on Human-Computer Interaction, 2019.
- Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, and Denny Zhou. Large language models as tool makers. arXiv preprint arXiv:2305.17126, 2023. · arXiv
- Victor Dibia. LIDA: A tool for automatic generation of grammar-agnostic visualizations and info- graphics using large language models. In Proceedings of the 61st Annual Meeting of the Associ- ation for Computational Linguistics (Volume 3: System Demonstrations), Toronto, Canada, July 2023. Association for Computational Linguistics.
- Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch. Improv- ing factuality and reasoning in language models through multiagent debate. arXiv preprint arXiv:2305.14325, 2023. · arXiv
- Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. Measuring mathematical problem solving with the math dataset. arXiv preprint arXiv:2103.03874, 2021. · arXiv
- Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, et al. Metagpt: Meta programming for multi-agent collaborative framework. arXiv preprint arXiv:2308.00352, 2023. · arXiv
- Eric Horvitz. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 1999.
- Geunwoo Kim, Pierre Baldi, and Stephen McAleer. Language models can solve computer tasks. arXiv preprint arXiv:2303.17491, 2023. · arXiv
- Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al. Natural questions: a benchmark for question answering research. Transactions of the Association for Computational Linguistics, 2019.
- Mike Lewis, Denis Yarats, Yann N Dauphin, Devi Parikh, and Dhruv Batra. Deal or no deal? end- to-end learning for negotiation dialogues. arXiv preprint arXiv:1706.05125, 2017. · arXiv
- Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. Retrieval-augmented gen- eration for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems, 2020.
- Beibin Li, Konstantina Mellou, Bo Zhang, Jeevan Pathuri, and Ishai Menache. Large language models for supply chain optimization. arXiv preprint arXiv:2307.03875, 2023a. · arXiv
- Evan Zheran Liu, Kelvin Guu, Panupong Pasupat, Tianlin Shi, and Percy Liang. Reinforcement learning on web interfaces using workflow-guided exploration. arXiv preprint arXiv:1802.08802, 2018. · arXiv
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wier- stra, and Martin Riedmiller. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013. · arXiv
- Roberto Navigli, Simone Conia, and Björn Ross. Biases in large language models: Origins, inven- tory and discussion. ACM Journal of Data and Information Quality, 2023.
- Joon Sung Park, Joseph C O'Brien, Carrie J Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. arXiv preprint arXiv:2304.03442, 2023. · arXiv
- Md Rizwan Parvez, Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. Retrieval augmented code generation and summarization. arXiv preprint arXiv:2108.11601, 2021. · arXiv
- Shishir G. Patil, Tianjun Zhang, Xin Wang, and Joseph E. Gonzalez. Gorilla: Large language model connected with massive apis. arXiv preprint arXiv:2305.15334, 2023. · arXiv
- Nils Reimers and Iryna Gurevych. Sentence-bert: Sentence embeddings using siamese bert- networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 11 2019. URL https://arxiv.org/ abs/1908.10084. · arXiv
- Bokui Shen, Fei Xia, Chengshu Li, Roberto Martín-Martín, Linxi Fan, Guanzhi Wang, Claudia Pérez-D'Arpino, Shyamal Buch, Sanjana Srivastava, Lyne Tchapmi, et al. igibson 1.0: A simu- lation environment for interactive tasks in large realistic scenes. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021.
- Tianlin Shi, Andrej Karpathy, Linxi Fan, Jonathan Hernandez, and Percy Liang. World of bits: An open-domain platform for web-based agents. In International Conference on Machine Learning. PMLR, 2017.
- Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, Yonatan Bisk, Adam Trischler, and Matthew Hausknecht. ALFWorld: Aligning Text and Embodied Environments for Interactive Learning. In Proceedings of the International Conference on Learning Representations (ICLR), 2021. URL https://arxiv.org/abs/2010.03768. · arXiv
- Oriol Vinyals, Timo Ewalds, Sergey Bartunov, Petko Georgiev, Alexander Sasha Vezhnevets, Michelle Yeo, Alireza Makhzani, Heinrich Küttler, John Agapiou, Julian Schrittwieser, et al. Starcraft ii: A new challenge for reinforcement learning. arXiv preprint arXiv:1708.04782, 2017. · arXiv
- Chi Wang, Qingyun Wu, Markus Weimer, and Erkang Zhu. Flaml: A fast and lightweight automl library. Proceedings of Machine Learning and Systems, 2021.
- Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. Voyager: An open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291, 2023a. · arXiv
- Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. A survey on large language model based autonomous agents. arXiv preprint arXiv:2308.11432, 2023b. · arXiv
- Daniel S. Weld and Oren Etzioni. The first law of robotics (a call to arms). In AAAI Conference on Artificial Intelligence, 1994.
- Yiran Wu, Feiran Jia, Shaokun Zhang, Qingyun Wu, Hangyu Li, Erkang Zhu, Yue Wang, Yin Tat Lee, Richard Peng, and Chi Wang. An empirical study on challenging math problem solving with gpt-4. arXiv preprint arXiv:2306.01337, 2023. · arXiv
- Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, et al. The rise and potential of large language model based agents: A survey. arXiv preprint arXiv:2309.07864, 2023. · arXiv
- Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. React: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629, 2022. · arXiv
Cited by
Sorted by citations
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941 · see citing works
Self-citationPromises and challenges of generative artificial intelligence for human learning
Yan, L., Greiff, S., Teuber, Z., & Gašević, D. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02004-5 · Cited by 499 · see citing works
“This is enabled by advance ments in generative agents—autonomous and adaptive AI entities that operate independently, pursuing objectives without continuous user interaction, as exemplified by tools such as AutoGen 53 .”
Gudiño, J., Grandi, U., & Hidalgo, C. A. (2019) · doi:10.1098/rsta · Cited by 393 · see citing works
The Rise and Potential of Large Language Model Based Agents: A Survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.07864 · Cited by 972 · see citing works
AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103599 · Cited by 244 · see citing works
“This adaptive, memory-driven coordination exemplifies Agentic AI’s potential to reduce labor costs, increase harvest efficiency, and respond to uncertainties in complex agricultural environments surpassing the rigid programming of conventional agricultural robots [100], [157].”
InfluentialPrompting AI Art: An Investigation into the Creative Skill of Prompt Engineering
Oppenlaender, J., Linder, R., & Silvennoinen, J. M. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2431761 · Cited by 308 · see citing works
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15161 · Cited by 186 · see citing works
A Multiagent-Driven Robotic AI Chemist Enabling Autonomous Chemical Research On Demand
Song, T., Luo, M., Zhang, X., Chen, L., Huang, Y., Cao, J., Zhu, Q., Liu, D., Zhang, B., Zou, G., et al. (2025) · Journal of the American Chemical Society · doi:10.1021/jacs.4c17738 · Cited by 171 · see citing works
Self-citationHadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v4 · Cited by 173 · see citing works
MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning
Tang, X., Zou, A., Zhang, Z., Li, Z., Zhao, Y., Zhang, X., Cohan, A., & Gerstein, M. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.33 · Cited by 133 · see citing works
Self-citationHow large language models can reshape collective intelligence
Burton, J. W., Lopez-Lopez, E., Hechtlinger, S., Rahwan, Z., Aeschbach, S., Bakker, M. A., Becker, J. A., Berditchevskaia, A., Berger, J., Brinkmann, L. U. L., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01959-9 · Cited by 124 · see citing works
A Survey on the Memory Mechanism of Large Language Model-based Agents
Zhang, Z., Dai, Q., Bo, X., Ma, C., Li, R., Chen, X., Zhu, J., Dong, Z., & Wen, J.-R. (2025) · ACM Transactions on Information Systems · doi:10.1145/3748302 · Cited by 118 · see citing works
Enhancing diagnostic capability with multi-agents conversational large language models
Chen, X., Yi, H., You, M., Liu, W., Wang, L., Li, H., Zhang, X., Guo, Y., Fan, L., Chen, G., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01550-0 · Cited by 117 · see citing works
Self-citationGhafarollahi, A., & Buehler, M. J. (2024) · Digital Discovery · doi:10.1039/d4dd00013g · Cited by 122 · see citing works
Ni, B., & Buehler, M. J. (2024) · Extreme Mechanics Letters · doi:10.1016/j.eml.2024.102131 · Cited by 113 · see citing works
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
Jiang, H., Wu, Q., Luo, X., Li, D., Lin, C.-Y., Yang, Y., & Qiu, L. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.91 · Cited by 96 · see citing works
Self-citationBuehler, M. J. (2024) · ACS Engineering Au · doi:10.1021/acsengineeringau.3c00058 · Cited by 82 · see citing works
Yan, L., Martinez-Maldonado, R., Jin, Y., Echeverria, V., Milesi, M., Fan, J., Zhao, L., Alfredo, R., Li, X., & Gašević, D. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105322 · Cited by 85 · see citing works
Cognitive Architectures for Language Agents
Sumers, T. R., Yao, S., Narasimhan, K., & Griffiths, T. L. (2023) · arXiv · doi:10.48550/arxiv.2309.02427 · Cited by 72 · see citing works
Automating alloy design and discovery with physics-aware multimodal multiagent AI
Ghafarollahi, A., & Buehler, M. J. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2414074122 · Cited by 72 · see citing works
Large Language Model based Multi-Agents: A Survey of Progress and Challenges
Guo, T., Chen, X., Wang, Y., Chang, R., Pei, S., Chawla, N. V., Wiest, O., & Zhang, X. (2024) · arXiv · doi:10.48550/arxiv.2402.01680 · Cited by 70 · see citing works
Self-citationEmergent social conventions and collective bias in LLM populations
Ashery, A. F., Aiello, L. M., & Baronchelli, A. (2025) · Science Advances · doi:10.1126/sciadv.adu9368 · Cited by 81 · see citing works
Enhancing AI Systems with Agentic Workflows Patterns in Large Language Model
Singh, A., Ehtesham, A., Kumar, S., & Khoei, T. T. (2024) · 2024 IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot61789.2024.10578990 · Cited by 68 · see citing works
“Wu et al. developed AutoGen, a framework for building LLM applications through conversable agents, enabling diverse applications across several domains [11].”
BackgroundGeneAgent: self-verification language agent for gene-set analysis using domain databases
Wang, Z., Jin, Q., Wei, C.-H., Tian, S., Lai, P., Zhu, Q., Day, C., Ross, C., Leaman, R., & Lu, Z. (2025) · Nature Methods · doi:10.1038/s41592-025-02748-6 · Cited by 79 · see citing works
Ke, Y., Yang, R., Lie, S. A., Lim, T. X. Y., Ning, Y., Li, I., Abdullah, H. R., Ting, D. S. W., & Liu, N. (2024) · Journal of Medical Internet Research · doi:10.2196/59439 · Cited by 64 · see citing works
“The multi-agent framework features dialogue agents with near-human performance and could introduce an innovative paradigm in health care [22-24].”
D-Bot: Database Diagnosis System using Large Language Models
Zhou, X., Li, G., Sun, Z., Liu, Z., Chen, W., Wu, J., Liu, J., Feng, R., & Zeng, G. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3675034.3675043 · Cited by 75 · see citing works
Self-citationThe Virtual Lab: AI Agents Design New SARS-CoV-2 Nanobodies with Experimental Validation
Swanson, K., Wu, W., Bulaong, N. L., Pak, J. E., & Zou, J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.11.11.623004 · Cited by 56 · see citing works
Advancing the search frontier with AI agents
White, R. W. (2024) · Communications of the ACM · doi:10.1145/3655615 · Cited by 55 · see citing works
Self-citationLLM-Based Framework for Administrative Task Automation in Healthcare
Gebreab, S. A., Salah, K., Jayaraman, R., Rehman, M. H. U., & Ellaham, S. (2024) · International Symposium on Digital Forensics and Security (ISDFS) · doi:10.1109/isdfs60797.2024.10527275 · Cited by 56 · see citing works
A Survey of Conversational Search
Mo, F., Mao, K., Zhao, Z., Qian, H., Chen, H., Cheng, Y., Li, X., Zhu, Y., Dou, Z., & Nie, J. (2025) · ACM Transactions on Information Systems · doi:10.1145/3759453 · Cited by 51 · see citing works
Agentic AI: The age of reasoning—A review
Nisa, U., Shirazi, M., Saip, M. A., & Pozi, M. S. M. (2025) · Journal of Automation and Intelligence · doi:10.1016/j.jai.2025.08.003 · Cited by 71 · see citing works
Shi, W., Xu, R., Zhuang, Y., Yu, Y., Zhang, J., Wu, H., Zhu, Y., Ho, J. C., Yang, C., & Wang, M. D. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.1245 · Cited by 54 · see citing works
“(5) Self-Debugging and AutoGen present a notable performance gain over other baselines, as they leverage code interfaces and consider the errors from the coding environment, leading to a large improvement in the completion rate.”
BackgroundMethodResultInfluentialSelf-citationElectromagnetic metamaterial agent
Hu, S., Li, M., Xu, J., Zhang, H., Zhang, S., Cui, T. J., del Hougne, P., & Li, L. (2025) · Light Science & Applications · doi:10.1038/s41377-024-01678-w · Cited by 45 · see citing works
Self-citationXu, H., Zhang, N., Yin, Z., & Njock, P. G. A. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106257 · Cited by 43 · see citing works
Li, R., Wang, X., Berlowitz, D. R., Mez, J. B., Lin, H., & Yu, H. Z. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01940-4 · Cited by 43 · see citing works
Wu, T., Li, J., Bao, J., & Liu, Q. (2024) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2024.08.008 · Cited by 38 · see citing works
Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models
Hu, Y., Stretcu, O., Lu, C.-T., Viswanathan, K., Hata, K., Luo, E., Krishna, R., & Fuxman, A. D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00916 · Cited by 47 · see citing works
Evaluation of Open-Source Large Language Models for Metal–Organic Frameworks Research
Bai, X., Xie, Y.-B., Zhang, X., Han, H., & Li, J. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c00065 · Cited by 38 · see citing works
Self-citationAn Investigation on Utilizing Large Language Model for Industrial Computer-Aided Design Automation
Deng, H., Khan, S., & Erkoyuncu, J. A. (2024) · Procedia CIRP · doi:10.1016/j.procir.2024.07.049 · Cited by 40 · see citing works
Wickramasekara, A., Breitinger, F., & Scanlon, M. (2025) · Forensic Science International Digital Investigation · doi:10.1016/j.fsidi.2024.301859 · Cited by 48 · see citing works
A foundational architecture for AI agents in healthcare
Liu, F., Niu, Y., Zhang, Q., Wang, K., Dong, Z., Wong, I. N., Cheng, L., Li, T., Duan, L., Li, K., et al. (2025) · Cell Reports Medicine · doi:10.1016/j.xcrm.2025.102374 · Cited by 41 · see citing works
Shahin, M. H., Goswami, S., Lobentanzer, S., & Corrigan, B. (2025) · Clinical and Translational Science · doi:10.1111/cts.70188 · Cited by 37 · see citing works
AgentReview: Exploring Peer Review Dynamics with LLM Agents
Jin, Y., Zhao, Q., Wang, Y., Chen, H., Zhu, K., Xiao, Y., & Wang, J. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.70 · Cited by 33 · see citing works
Qian, K., Liu, S., Li, T., Raković, M., Li, X., Guan, R., Molenaar, I., Nawaz, S., Swiecki, Z., Yan, L., et al. (2026) · Computers & Education · doi:10.1016/j.compedu.2025.105448 · Cited by 39 · see citing works
ELLMA-T: an Embodied LLM-agent for Supporting English Language Learning in Social VR
Pan, M., Kitson, A., Wan, H., & Prpa, M. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735786 · Cited by 31 · see citing works
Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges
Chhabra, A., Datta, S., Nahin, S. K., & Mohapatra, P. (2026) · IEEE Access · doi:10.1109/access.2026.3675554 · Cited by 28 · see citing works
“Knowledge and Learning Manipulation Cross-domain multi-agent LLMs allow agents to self-improve via shared learning and distributed fine-tuning [109, 135].”
AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems
Yang, Y., Chai, H., Shao, S., Song, Y., Qi, S., Rui, R., & Zhang, W. (2025) · neural information processing systems · doi:10.52202/085713-3578 · Cited by 27 · see citing works
Multi-Agent Collaboration Mechanisms: A Survey of LLMs
Tran, K.-T., Dao, D., Nguyen, M.-D., Pham, Q.-V., O'Sullivan, B., & Nguyen, H. D. (2025) · arXiv · doi:10.48550/arxiv.2501.06322 · Cited by 26 · see citing works
“Similarly, AutoGen [134] enables developers to define flexible agent behaviors and communication patterns, allowing LLM agents to cooperate through conversation and tackle complex tasks by decomposing them into manageable subtasks.”
LLM App Store Analysis: A Vision and Roadmap
Zhao, Y., Hou, X., Wang, S., & Wang, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708530 · Cited by 35 · see citing works
PROV-AGENT: Unified Provenance for Tracking AI Agent Interactions in Agentic Workflows
de Souza, R. P., Gueroudji, A., DeWitt, S. J., Rosendo, D., Ghosal, T., Ross, R. B., Balaprakash, P., & da Silva, R. F. (2025) · IEEE International Conference on eScience · doi:10.1109/escience65000.2025.00093 · Cited by 26 · see citing works
Dong, Y., Zhan, Z., Hu, Y., Doe, D. M., & Han, Z. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106563 · Cited by 24 · see citing works
Li, J., Zhang, Q., Yu, Y., Fu, Q., & Ye, D. (2024) · arXiv · doi:10.48550/arxiv.2402.05120 · Cited by 22 · see citing works
Guthrie, E., Levy, D., & del Carmen, G. (2024) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2024.02.016 · Cited by 22 · see citing works
Engineering LLM Powered Multi-Agent Framework for Autonomous CloudOps
Parthasarathy, K., Vaidhyanathan, K., Dhar, R., Krishnamachari, V., Kakran, A., Akshathala, S., Arun, S., Karan, A., Muhammed, B., Dubey, S., et al. (2025) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain66642.2025.00031 · Cited by 25 · see citing works
FinMem: A Performance-Enhanced LLM Trading Agent With Layered Memory and Character Design
Yu, Y., Li, H., Chen, Z., Jiang, Y., Li, Y., Suchow, J. W., Zhang, D., & Khashanah, K. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3593370 · Cited by 23 · see citing works
Xu, W., Luo, G., Meng, W., Zhai, X., Zheng, K., Wu, J. Y., Li, Y., Xing, A., Li, J., Li, Z., et al. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf140 · Cited by 20 · see citing works
Hu, X., Chen, S., Chen, L., Wang, H., Zhang, X., & Zhou, Z. (2025) · National Science Review · doi:10.1093/nsr/nwaf372 · Cited by 19 · see citing works
Self-citationLarge language models (LLMs) as agents for augmented democracy
Gudiño, J., Grandi, U., & Hidalgo, C. A. (2024) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2024.0100 · Cited by 19 · see citing works
Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems
Lee, D., & Tiwari, M. (2024) · arXiv · doi:10.48550/arxiv.2410.07283 · Cited by 18 · see citing works
BioAgents: Bridging the gap in bioinformatics analysis with multi-agent systems
Mehandru, N., Hall, A. K., Melnichenko, O., Dubinina, Y., Tsirulnikov, D., Bamman, D., Alaa, A., Saponas, S., & Malladi, V. S. (2025) · Scientific Reports · doi:10.1038/s41598-025-25919-z · Cited by 19 · see citing works
Designing LLM Chains by Adapting Techniques from Crowdsourcing Workflows
Grunde-McLaughlin, M., Lam, M. S., Krishna, R., Weld, D. S., & Heer, J. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3716134 · Cited by 18 · see citing works
Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directions
Gridach, M., Nanavati, J., Abidine, K. Z. E., Mendes, L., & Mack, C. (2025) · arXiv · doi:10.48550/arxiv.2503.08979 · Cited by 18 · see citing works
Towards Message Brokers for Generative AI: Survey, Challenges, and Opportunities
Saleh, A., Morabito, R., Dustdar, S., Tarkoma, S., Pirttikangas, S., & Lovén, L. (2025) · ACM Computing Surveys · doi:10.1145/3742891 · Cited by 22 · see citing works
Mitigating the OWASP Top 10 For Large Language Models Applications using Intelligent Agents
Fasha, M., Rub, F. A., Matar, N. A., Sowan, B. I., Khaldy, M. A. A., & Barham, H. (2024) · International Conference on Cyber Resilience (ICCR) · doi:10.1109/iccr61006.2024.10532874 · Cited by 16 · see citing works
Sabbagh, V. B., Lima, C. B. D. C., & Xexeo, G. B. (2024) · SPE Journal · doi:10.2118/223612-pa · Cited by 16 · see citing works
Toward an integrated omics approach for plant biosynthetic pathway discovery in the age of AI
Reinhardt, J. K., Craft, D., & Weng, J. (2025) · Trends in Biochemical Sciences · doi:10.1016/j.tibs.2025.01.010 · Cited by 16 · see citing works
Why Do Multi-Agent LLM Systems Fail?
Cemri, M., Pan, M. Z., Yang, S., Agrawal, L. A., Chopra, B., Tiwari, R., Keutzer, K., Parameswaran, A., Klein, D., Ramchandran, K., et al. (2025) · arXiv · doi:10.48550/arxiv.2503.13657 · Cited by 15 · see citing works
“Tool-calling agents specialized to utility services (ex: GMail, Spotify, etc.) being orchestrated by a supervisor to achieve cross-service tasks AG2 [45]”
OpenHands: An Open Platform for AI Software Developers as Generalist Agents
Wang, X., Li, B., Song, Y., Xu, F. F., Tang, X., Zhuge, M., Pan, J., Song, Y., Li, B., Singh, J., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.16741 · Cited by 24 · see citing works
Self-citationRothfarb, S., Friday, M., Wang, X., Zaghi, A. E., & Li, B. (2025) · Environmental Research · doi:10.1016/j.envres.2025.121401 · Cited by 15 · see citing works
Self-citationNdum, Z. N., Tao, J., Ford, J. R., & Liu, Y. (2025) · Energy and AI · doi:10.1016/j.egyai.2025.100555 · Cited by 15 · see citing works
Iterative Prompt Refinement for Mining Gene Relationships from ChatGPT
Chen, Y., Gao, J., Petruc, M., Hammer, R., Popescu, M., & Xu, D. H. (2024) · International Journal of Artificial Intelligence and Robotics Research · doi:10.1142/s2972335324500054 · Cited by 15 · see citing works
AlphaEvolve: A coding agent for scientific and algorithmic discovery
Novikov, A., Vũ, N., Eisenberger, M., Dupont, E., Huang, P.-S., Wagner, A. Z., Shirobokov, S., Kozlovskii, B., Ruiz, F. J. R., Mehrabian, A., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.13131 · Cited by 15 · see citing works
“Other recent work [108] has also proposed the use of multiple LLM agents that converse with each other to accomplish mathematical and coding tasks.”
Amayuelas, A., Yang, X., Antoniades, A., Hua, W., Pan, L., & Wang, W. Y. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.407 · Cited by 15 · see citing works
Fuellen, G., Kulaga, A. Y., Lobentanzer, S., Unfried, M., Avelar, R. A., Palmer, D. H., & Kennedy, B. K. (2024) · Ageing Research Reviews · doi:10.1016/j.arr.2024.102617 · Cited by 15 · see citing works
Absolute Zero: Reinforced Self-play Reasoning with Zero Data
Zhao, A., Wu, Y., Yue, Y., Wu, T., Xu, Q., Yue, Y., Lin, M., Wang, S., Wu, Q., Zheng, Z., et al. (2025) · arXiv · Cited by 13 · see citing works
Self-citationShi, Z., Xin, C., Huo, T., Jiang, Y., Wu, B., Chen, X., Qin, W. D., Ma, X., Huang, G., Wang, Z., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-92337-6 · Cited by 15 · see citing works
Towards LLM-Assisted System Testing for Microservices
Almutawa, M., Ghabrah, Q., & Canini, M. (2024) · IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW) · doi:10.1109/icdcsw63686.2024.00011 · Cited by 13 · see citing works
Zhang, Y., Ren, S., Wang, J., Lu, J., Wu, C., He, M., Liu, X., Wu, R., Zhao, J., Zhan, C., et al. (2024) · Drugs · doi:10.1007/s40265-024-02124-2 · Cited by 14 · see citing works
AI agents in chemical research: GVIM – an intelligent research assistant system
Ma, K. (2025) · Digital Discovery · doi:10.1039/d4dd00398e · Cited by 14 · see citing works
ChainBuddy: An AI-assisted Agent System for Generating LLM Pipelines
Zhang, J., & Arawjo, I. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714085 · Cited by 13 · see citing works
Self-citationJuarez, M. G. J., Giret, A., & Botti, V. J. (2025) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2025.100959 · Cited by 12 · see citing works
Schorcht, S., Peters, F., & Kriegel, J. (2024) · Digital Experiences in Mathematics Education · doi:10.1007/s40751-024-00161-w · Cited by 12 · see citing works
Madrid, J., Diehl, P., Selig, M., Rolauffs, B., Hans, F. P., Busch, H.-J., Scheef, T., & Benning, L. (2024) · JMIR Medical Education · doi:10.2196/58375 · Cited by 12 · see citing works
SGLang: Efficient Execution of Structured Language Model Programs
Zheng, L., Yin, L., Xie, Z., Sun, C., Huang, J., Yu, C. H., Cao, S., Kozyrakis, C., Stoica, I., Gonzalez, J. E., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.07104 · Cited by 145 · see citing works
A Survey on the Memory Mechanism of Large Language Model based Agents
Zhang, Z., Bo, X., Ma, C., Li, R., Chen, X., Dai, Q., Zhu, J., Dong, Z., & Wen, J.-R. (2024) · arXiv · doi:10.48550/arxiv.2404.13501 · Cited by 149 · see citing works
Yang, Y., Chen, S., Zhu, Y., Liu, X., Pan, S., & Wang, X. (2024) · La Houille Blanche · doi:10.1080/27678490.2024.2397337 · Cited by 11 · see citing works
A vision of human–AI collaboration for enhanced biological collection curation and research
Stenhouse, A., Fisher, N., Lepschi, B. J., Schmidt‐Lebuhn, A. N., Rodríguez, J., Turco, F., Reeson, A. F., Paris, C. L., & Thrall, P. H. (2025) · BioScience · doi:10.1093/biosci/biaf021 · Cited by 12 · see citing works
A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents
Su, H., Luo, J., Liu, C., Yang, X., Zhang, Y., Dong, Y., & Zhu, J. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3688650 · Cited by 11 · see citing works
LLMs Get Lost In Multi-Turn Conversation
Laban, P., Hayashi, H., Zhou, Y., & Neville, J. (2025) · arXiv · Cited by 10 · see citing works
“Such processes are typically orchestrated by an agentic framework (such as Autogen [84] or LangChain [8]) that allows system builders to compose workflows with LLM calls as individual blocks.”
Evil Geniuses: Delving into the Safety of LLM-based Agents
Tian, Y., Yang, X., Zhang, J., Dong, Y., & Su, H. (2023) · arXiv · doi:10.48550/arxiv.2311.11855 · Cited by 10 · see citing works
Self-citationSchnepf, J., Engin, T., Anderer, S., & Scheuermann, B. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70239-6_2 · Cited by 10 · see citing works
LAMBDA: A Large Model Based Data Agent
Sun, M., Han, R., Jiang, B., Qi, H., Sun, D., Yuan, Y., & Huang, J. (2025) · Journal of the American Statistical Association · doi:10.1080/01621459.2025.2510000 · Cited by 15 · see citing works
Retracted: Autonomous Crowdsensing: Operating and Organizing Crowdsensing for Sensing Automation
Wu, W., Yang, W., Li, J., Zhao, Y. B., Zhu, Z., Chen, B., Qiu, S., Peng, Y., & Wang, F. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3355508 · Cited by 10 · see citing works
RetractedSmartControl: Interactive PID controller design powered by LLM agents and control system expertise
Tohma, K., OKUR, H. İ., Gürsoy-Demir, H., Aydın, M. N., & Yeroğlu, C. (2025) · SoftwareX · doi:10.1016/j.softx.2025.102194 · Cited by 10 · see citing works
Kadiyala, L., Sajja, R., Sermet, Y., Muste, M., & Demir, İ. (2025) · Journal of Hydroinformatics · doi:10.2166/hydro.2025.042 · Cited by 15 · see citing works
Automated Design of Agentic Systems
Hu, S., Lu, C., & Clune, J. (2024) · arXiv · doi:10.48550/arxiv.2408.08435 · Cited by 10 · see citing works
Bergsmann, S., Schmidt, A., Fischer, S., & Ramler, R. (2024) · doi:10.1145/3678719.3685692 · Cited by 8 · see citing works
Nonomura, R., & Mori, H. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1582287 · Cited by 9 · see citing works
SensorMCP: A Model Context Protocol Server for Custom Sensor Tool Creation
Guo, Y., Zhu, G., Liu, K., & Xing, G. (2025) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3711875.3736687 · Cited by 8 · see citing works
General-Purpose Models for the Chemical Sciences: LLMs and Beyond
Alampara, N., Aneesh, A., Ríos-García, M., Mirza, A., Schilling-Wilhelmi, M., Aghajani, A. A., Sun, M., Prastalo, G., & Jablonka, K. M. (2026) · Chemical Reviews · doi:10.1021/acs.chemrev.5c00583 · Cited by 12 · see citing works
- Authors
- Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., Jiang, L., Zhang, X., Zhang, S., Liu, J., Awadallah, A. H., White, R. W., Burger, D., & Wang, C.
- Affiliations
- Pennsylvania State University (US)
- Microsoft (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2308.08155
- OpenAlex
- W4385965642
- Cited by
- 193
- References
- 0
- Citations by year
- 2026: 61 · 2025: 71 · 2024: 58 · 2023: 2 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (0424422)
- University of Pennsylvania
- Pennsylvania State University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- AutoGen, compilers, multi-agent systems, large language models, chatbots, LLM applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review