The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey

“Solutions that use multiple agent personas to solve problems also show significant improvements compared to Chain-of-Thought (CoT) prompting where the model is asked to break down its plans step by step [28, 29].”

“Language Models have been known to exhibit bias both in terms of evaluation as well as in social or fairness terms [5].”

“For example, Plan Like a Graph (PLaG) is an approach that represents plans as directed graphs, with multiple steps being executed in parallel [15, 33].”

“Reflexion is a single-agent pattern that uses self-reflection through linguistic feedback [23].”

“In this paper, we follow the definition of agent that consists of “brain, perception, and action” [31].”

“We find that successful goal execution by agents is contingent upon proper planning and self-correction [32, 16, 23, 1].”

“Many language model benchmarks are designed to be solved in a single iteration, with no tool calls, such as MMLU or GSM8K [3, 10].”

“Many multi-agent architectures work in stages where teams of agents are created and reorganized dynamically for each planning, execution, and evaluation phase [2, 9, 18].”

“First, prior studies on AI agents reveal challenges related to accountability, reliable tool use, semantic correctness, multi-agent coordination, and economic or strategic instability [8,54–56].”

“An agent that has only the ontology of the subject area “knows” what is being discussed, but does not know how to act and by what method to respond to a specific information request [21].”

“…[5, 7, 15, 22] to our agent’s own decision boundary); agent frameworks (ReAct, Reflexion [18], AutoGen [25], Planner–Executor, Toolformer [17]) are greenfield [8, 14, 23, 27]; legacy migration (Strangler Fig, modernization surveys) [1, 2] addresses traditional software, not LLM+script workflows.”

“Multi-agent and planning-oriented systems such as AutoGPT (Yang et al., 2023), MetaGPT (Hong et al., 2024), and related agent surveys (Masterman et al., 2024) further explore online decision making and procedural decomposition.”

“To prevent catastrophic forgetting during Meta-LoRA updates, we impose a stability constraint on the generated adapters ∆ W : Intuition: Eq.”

“Em paralelo, uma linha mais ampla de pesquisa discute o uso de planeja-mento, grounding externo e avaliação funcional em aplicações técnicas de LLMs [Sumers et al. 2024, Masterman et al. 2024, Zhu et al. 2023, Chen et al. 2021].”

“More recently, agentic tool-use methods [18] formulate planning as a closed-loop decision process, where the LLM selects the next tool action based on the previous context, and execution observations, e.g., ReAct [19], AgentGym [20], and AgentFlow [21].”

“Therefore, the shift to Multi-Agent Systems (MAS) [8] is the current prevailing architectural paradigm [5], [6], [14], [15], as it provides the functional decomposition and role specialization required to manage complex, multi-stage tasks [16].”

“Nevertheless, the critics also claim that these "top-down" solutions can still have issues with the so-called semantic gap, i.e.-the gap between a principle of language (e.g. - be helpful) and its concrete, interactive implementation in a subtle context [20].”

“At the execution level, modern agents increasingly rely on tool use and environment interaction [35].”

“Architecturally, Masterman et al. [15] reviewed contemporary agent frameworks, identifying design trends such as reflection loops, tool use pipelines, and agent persona modeling.”

“Building on the proposed schema, we use an LLM as a constrained expansion tool to generate diverse yet structurally consistent scenario variations for design exploration, aligning with recent perspectives on framework-guided LLM use [7, 8].”

“This convergence of newly available unstructured data with AI’s capacity for rapid reasoning creates a path to integrate system artifacts, team communications, and tacit knowledge within a shared knowledge space, enriching both human and agent understanding of software systems [14, 20, 26].”

“The idea of an automated agent is to perform autonomous, varied, complex, and often reasoning-related tasks [16, 45].”

“The landscape of AI agent architectures has been systematically examined to understand the role of reasoning, planning, and tool calling in complex goal achievement [13].”

“Recent surveys [13, 27] highlight rapid progress in agent reasoning, planning capabilities, and the emergence of increasingly sophisticated coordination protocols.”

“Recent surveys [12] on AI agent architectures inform our design; we apply this to RAN coordination with MCP for agent interoperability [4].”

“Single-agent systems are often unable to address multi-tasking requirements because they rely on a main agent that focuses on a single objective and is enhanced only with tools to help manage it [6].”

“…are typically composed of multiple elements, such as a language model, memory, and external tools (e.g., APIs) that extend their capabilities [Masterman et al., 2024, He et al., 2025, Kraprayoon et al., 2025, Xi et al., 2025]; we simplified this architecture in our experiments by decomposing…”

“[25] Metrics for multi-agent collaboration indicate improved coordination, with fewer conflicts and optimized workload distribution, thereby enhancing the system's overall robustness.”

“图 1 AI agent 广义框架 次的任务 [29] , 由此也逐渐被研究者们引入到预测性 维护 [30] 、过程建模与控制 [31] 、人机协同 [32]”

“GeneGPT operates as a single-agent architecture[15] where an LLM is guided through carefully constructed prompts containing API documentation and examples, with inference managed sequentially through a single forward loop of API calls and result processing.”

“Currently, a highly active area of research centers around developing multi-agentic system that can understand user queries, reason, generate action plans, and execute them along with function/tool calls (Guo et al. 2024; Masterman et al. 2024; Lu et al. 2023; Hong et al. 2023; Wu et al. 2023).”

“…reasoning and planning, and performing complex tasks, and are widely used in a variety of fields such as research assistants, process automation, retrieval-augmented generation, and code generation and debugging (Dubey et al., 2024; Masterman et al., 2024; Qin et al., 2024; Singh et al., 2025).”

“The prevailing operational paradigm involves centralized cloud infrastructure hosting general-purpose LLMs that serve diverse requests through standardized API endpoints [5].”

“This role partitioning follows the growing tendency for the research of the multi-agent with an emphasis on the decomposition and partitioning of work [6][7].”

“A LLM AI agent is a system that can design workflows and interact with its environment, collect data, and use that data to perform self-directed tasks that meet predetermined goals [13].”

“Our exploration of Portfolio Artifact (PA) Collections demonstrates the feasibility of verifiable, credential-enriched representations of agent behavior and provenance.”

“The server’s response is subsequently evaluated by an interpretation module that decides whether immediate feedback can be returned to the user or whether additional tools need to be engaged [37,38] (4-8).”

“Nevertheless, even with the widespread development of AI technology, the unified and low-cost platforms needed to put together this piecemeal work into an overall product still do not exist, [1],[2].”

“This architecture takes AI Agent [11] as the core technical engine, integrating and reengineering the five key processes—“on-campus theory, enterprise practice, competition verification, certificate certification, and scientific research feedback”—through two interrelated driving mechanisms: the…”

“At the core of this transformation are the increasingly sophisticated tool-calling capabilities of LLMs [13].”

“In recent years, the evolution of LLMs has given rise to autonomous LLM agents capable of planning and executing tasks on their own [18], as well as to LLM MAS architectures in which multiple agents collaborate to solve complex problems [11].”

“Rather, it lies in the automated construction and execution of an end-to-end MAS for portfolio management using LLM-based agents.”

“…continuous improvement and wide application of the capabilities of large language models, generative artificial intelligence applications have developed rapidly, and the concept of AI agents has gradually become the core idea for building next-generation artificial intelligence applications [1].”

“More complex systems, called agents, use tools or call functions during the LLM execution Masterman et al. [2024].”

“A recent perspective [Masterman et al. 2024] describes AI agents as language model-driven entities capable of planning and executing actions across multiple iterations to achieve specific goals.”

“While single agent architectures excel when problems are well-defined and feedback from other agent-personas or the user is not needed, multi-agent architectures tend to thrive more when collaboration and multiple distinct execution paths are required [11], such as software development.”

“These capabilities position AI agents, particularly large language model (LLM) based agentic systems, as a well-suited computational framework for orchestrating complex, multi-step, and data-intensive scientific workflows (Masterman et al., 2024; Luo et al., 2025; Xi et al., 2025).”

“Recent research has advanced the design of tool-use agents, where LLMs are augmented to select, invoke, and integrate external tools into their workflows (Masterman et al., 2024; Chen et al., 2024; Wang et al., 2024).”

“This aligns naturally with the structured and iterative nature of digital forensic investigations and provides a flexible foundation that can evolve alongside emerging cybercrime patterns, forensic techniques, and AI capabilities [60], [61].”

“Generative AI now possesses several key capabilities that could help with coordination, including deep reasoning to evaluate constraints and produce plans [8, 40, 48, 49], and API tool-calling to take concrete actions [23, 43, 47].”

“Building on these foundation models [10], [11], [12], [13], a new generation of autonomous AI agents is emerging [14], [15], capable of navigating digital environments, managing tools and APIs, and executing complex multi-step workflows.”

“Tool Augmentation Augmenting AI agents with external tools is an established strategy for extending capabilities beyond pure language generation [13].”

“However, advanced agentic systems are either designed in their entirety or at least actively prompted to perform decompositions of complex problems and inputs [48, 14].”

“Common strategies for developing such agents [25, 62, 27, 6] include equipping LLMs with tools such as for code execution and web browsing [40, 41, 46, 29] and prompting strategies for better reasoning and planning such as CoT [58], ReACT [70] and few-shot prompting [79].”

“2) Build-Collaborate-Evolve framework: We analyze three interconnected dimensions of LLM agents - construction, collaboration, and evolution - offering a more holistic understanding than previous approaches [22], [23].”

“The emergence of function-calling mechanisms has enabled large language models (LLMs) to transcend their parametric boundaries, leveraging external tools, APIs, and execution environments to accomplish complex real-world tasks [14, 18, 21, 26].”

“…them to (1) Define clear objectives/goals/outcomes for the agent's actions; (2) Generate Plans and create a sequence of actions to achieve the goals; and (3) Execute the planned actions, “accomplish a task end-to-end” (Masterman et al., 2024, p.1), monitoring progress and adapting as needed.”

“A systematic literature review was conducted to gather existing research on AI agents [11], database interactions, and associated security vulnerabilities.”

“AI agents performing complex real-world tasks are often required to possess diverse capabilities [6], [7].”

“The initial pilot began with six candidate dimensions drawn from the conceptual agent architecture literature [Masterman et al., 2024]: control loop, tool interface, state management, context retrieval, execution isolation, and multi-model routing.”

“Additional surveys examine architectural patterns [38, 31] and how message-passing architectures affect coordination effectiveness [54].”

“Architectures vary widely[1], single-agent systems rely on one core LLM[1, 6], while multi-agent systems (MAS) involve collaboration between specialized agents, potentially structured vertically (with a leader) or horizontally[1, 6].”