Multi-agent Architecture Search via Agentic Supernet
Open accessAbstract
Large Language Model (LLM)-empowered multi-agent systems extend the cognitive boundaries of individual agents through disciplined collaboration and interaction, while constructing these systems often requires labor-intensive manual designs. Despite the availability of methods to automate the design of agentic workflows, they typically seek to identify a static, complex, one-size-fits-all system, which, however, fails to dynamically allocate inference resources based on the difficulty and domain of each query. To address this challenge, we shift away from the pursuit of a monolithic agentic system, instead optimizing the \textbf{agentic supernet}, a probabilistic and continuous distribution of agentic architectures. We introduce MaAS, an automated framework that samples query-dependent agentic systems from the supernet, delivering high-quality solutions and tailored resource allocation (\textit{e.g.}, LLM calls, tool calls, token cost). Comprehensive evaluation across six benchmarks demonstrates that MaAS \textbf{(I)} requires only $6\sim45\%$ of the inference costs of existing handcrafted or automated multi-agent systems, \textbf{(II)} surpasses them by $0.54\%\sim11.82\%$, and \textbf{(III)} enjoys superior cross-dataset and cross-LLM-backbone transferability.
AI snapshot
Written from the paper’s full text.
TL;DR
MaAS reframes automated multi-agent design as optimizing an “agentic supernet,” a probabilistic distribution over agentic architectures, and samples query-dependent systems at inference. Across six benchmarks it improves accuracy over handcrafted and automated baselines while using substantially fewer tokens and lower cost.
Key findings
- MaAS achieves the best average on GSM8K, MATH, MultiArith, HumanEval, and MBPP: 83.59 average, with gains over baselines of 0.54%–16.89%; e.g., MATH 51.82 vs. AFlow 51.28, HumanEval 92.85 vs. AFlow 90.93, MBPP 82.17 vs. AFlow 81.67.
- On GAIA, MaAS reaches 20.69 average vs. AFlow 8.00, AgentSquare 16.34, and GPTSwarm 16.33; Level 1 25.91, Level 2 22.01, Level 3 6.25.
- On MATH, MaAS uses $3.38 training cost vs. AFlow’s $22.50, $0.42 inference cost vs. AFlow’s $1.66, 53 min training wall-clock vs. AFlow’s 184 min and DyLAN’s 508 min, and 19 min inference wall-clock.
- Ablation: removing the textual gradient drops HumanEval from 92.85 to 90.17 and MATH from 51.82 to 48.23; removing early exit raises HumanEval cost from 1.01 to 1.67 and MATH cost from 0.86 to 1.04 (10^-3 $).
Methods
- Search space: agentic operators such as CoT, LLM-Debate, Self-Consistency, Self-Refine, Ensemble, Testing, ReAct, and early exit; a multi-agent system is a DAG, and the agentic supernet is an L-layer probabilistic distribution over operators. A controller network samples query-dependent architectures using MoE-style activation scores with threshold thres = 0.3 and an early-exit operator.
- Optimization: cost-constrained objective with trade-off λ; distribution π is updated via empirical Bayes Monte Carlo gradient with cost-aware importance weights, while operators are updated via agent-based textual gradient for prompts, temperature, and node structure. Settings include L = 4, K = 4, and λ ∈ {1e-3, 5e-3, 1e-2}.
- Evaluation: six public benchmarks—GSM8K, MATH, MultiArith, HumanEval, MBPP, and GAIA—with a 1:4 train:test split; MATH uses 617 selected problems. Base LLM is gpt-4o-mini, with Qwen-2.5-72b/70b and llama-3.1-70b for transfer tests; baselines include CoT, ComplexCoT, Self-Consistency, MultiPersona, LLM-Debate, LLM-Blender, DyLAN, AgentVerse, MacNet, AutoAgents, GPTSwarm, ADAS, AgentSquare, and AFlow.
Limitations
- Stated limitations: Not stated in the paper; the ethical statement says the framework raises no ethical concerns.
- Evident: the operator repository is manually initialized and customizable, so search quality depends on the chosen operators; the textual gradient component is adapted from ADAS and AgentSquare and relies on LLM-generated textual updates.
- Evident: evaluation covers six benchmarks and a limited set of LLM backbones; the text inconsistently says “six” and “seven” benchmarks and lists SVAMP in the introduction but MultiArith in the experiments, which may affect reproducibility and generalization claims.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
2 of 6 cited sources checked · 0 supported · 0 flagged · accuracy not yet measured
- Premisecitation§ 1. Introduction · p. 1
In the GAIA benchmark, there is no single system that is optimal for both file reading and web searching tasks.
“for instance, in the GAIA benchmark (Mialon et al., 2023), there is no single system that is optimal for both fi le reading and web searching tasks, leaving practitioners with no alternative but to split the benchmark and optimize separately (Zhuge et al., 2024).”
Quote in the paperSubstantial claim2 of 2 sources checked- cites Mialon et al., 2023 source
In the GPT4 plugins discussion (page unavailable), the paper says evaluators had to choose between a file-reading mode and third-party plugins selected for each task. Figure 5 compares scores by capability, but the text does not establish that no single system is optimal for both file-reading and web-searching tasks. The recommendation to split the benchmark is attributed to Zhuge et al., not this source. (LLM, conf=0.78)
Experimental — accuracy not yet measured - cites Zhuge et al., 2024 source
Section 3.4 (GAIA; page unavailable) reports overall benchmark accuracy for systems using different tools, including WebSearch and FileAnalyzer. It does not report which system performs best on file-reading tasks versus web-search tasks, so our copy cannot establish that no single system is optimal for both. Searches for that comparison and for separate optimization found no supporting passage. (LLM, conf=0.72)
Experimental — accuracy not yet measured
- Findingown data§ 4.4. Case Study · p. 7
For more challenging queries (c) and (d), MaAS sampled additional layers.
“For the more challenging queries (c) and (d), MaAS sampled additional layers”
Quote in the paperSubstantial claim - Findingown data§ 4.2. Performance Analysis · p. 6
MaAS achieves an average best score of 83.59% on mathematical reasoning and code generation.
“MaAS achieves an average best score of 83 . 59% , demonstrating its versatility and superiority.”
Quote in the paperSubstantial claim - Findingown data§ 4.5. Framework Analysis · p. 8
Removing the textual gradient causes the largest performance drop.
“removing the textual gradient causes the largest performance drop”
Quote in the paperSubstantial claim - Findingown data§ 4.5. Framework Analysis · p. 8
The agentic supernet optimized by MaAS transfers well to models such as Qwen-2.5-70b, with 4.98%~5.50% increase in performance.
“the agentic supernet optimized by MaAS transfers well to models such as Qwen-2.5-70b , with 4 . 98% ∼ 5 . 50% ↑ in performance”
Quote in the paperSubstantial claim
- Findingown data§ 4.2. Performance Analysis · p. 6
MaAS achieves optimal performance across all task domains.
“Obs. ❶ MaAS achieves optimal performance across all task domains.”
Quote in the paperSubstantial claim - Findingown data§ 1. Introduction · p. 2
MaAS surpasses existing handcrafted or automated multi-agent systems by 0.54%~16.89%.
“surpassing existing handcrafted or automated multi-agent systems by 0 . 54% ∼ 16 . 89%”
Quote in the paperSubstantial claim - Findingown data§ 4.4. Case Study · p. 7
MaAS learns to perform query-aware early exit from the reasoning process.
“Obs. ❹ MaAS learns to query-aware early exit from the reasoning process.”
Quote in the paperNot a substantial claim - Findingown data§ 4.4. Case Study · p. 7
For easy queries (a) and (b), MaAS exits multi-agent architecture sampling at the second layer with probabilities of 0.37 and 0.47, respectively, selecting the early-exit operator.
“when faced with the easy queries (a) and (b), MaAS exits multi-agent architecture sampling at the second layer with probabilities of 0 . 37 and 0 . 47 , respectively, selecting the early-exit operator.”
Quote in the paperSubstantial claim - Findingnone given§ 1. Introduction · p. 2
MaAS is inductive, demonstrating strong generalizability to unseen agentic operators.
“❹ inductive , demonstrating strong generalizability to unseen agentic operators.”
Quote in the paperSubstantial claim - Findingown data§ 4.4. Case Study · p. 7
The probability of O_exit becomes increasingly high as the supernet depth increases.
“the probability of O exit becomes increasingly high with the supernet depth increases.”
Quote in the paperNot a substantial claim - Findingown data§ Abstract · p. 1
MaAS requires only 6~45% of the inference costs of existing handcrafted or automated multi-agent systems.
“MaAS (I) requires only 6 ∼ 45% of the inference costs of existing handcrafted or automated multi-agent systems”
Quote in the paperSubstantial claim - Findingown data§ 4.5. Framework Analysis · p. 8
MaAS can still reasonably activate and utilize the unseen operator at an appropriate proportion.
“MaAS can still reasonably activate and utilize the unseen operator at an appropriate proportion.”
Quote in the paperSubstantial claim - Findingown data§ D. Supplementary Results · p. 18
MaAS exhibits cross-model transferability.
“Cross-model transferability of MaAS.”
Quote in the paperNot a substantial claim - Findingown data§ D. Supplementary Results · p. 19
Despite not being exposed to the Debate operator during training, MaAS can still reasonably select it during the multi-agent architecture sampling process.
“It can be observed that, despite not being exposed to this operator during training, MaAS can still reasonably select it during the multi-agent architecture sampling process.”
Quote in the paperNot a substantial claim - Findingown data§ D. Supplementary Results · p. 18
MaAS exhibits cross-dataset transferability.
“Cross-dataset transferability of MaAS.”
Quote in the paperNot a substantial claim - Interpretationreasoning§ 4.3. Cost Analysis · p. 7
MaAS's cost advantages can be attributed to the agentic supernet's ability to dynamically allocate resources based on the difficulty of the query.
“These advantages can be attributed to the agentic supernet's ability to dynamically allocate resources based on the difficulty of the query.”
Quote in the paperSubstantial claim- Rests on an assumption: The difficulty and domain of a query can be captured by the controller network from the query embedding to select an appropriate multi-agent architecture.
- Interpretationreasoning§ 1. Introduction · p. 1
The paradigm of automatically optimizing a single multi-agent architecture fails to meet the dynamic and evolving demands of agentic deployment.
“These dilemmas unveil that, the paradigm of automatically optimizing a single multi-agent architecture fails to meet the dynamic and evolving demands of agentic deployment.”
Quote in the paperSubstantial claim - Premisereasoning§ 1. Introduction · p. 3
MaAS is the first MAS searching framework leveraging an agentic supernet.
“Inspired by this, we introduce the first MAS searching framework leveraging an agentic supernet , posing new paradigms and challenges for agentic automation.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 10
- May combine two claims. 14
- The quote only partly states this claim. 1
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Findingnone given§ D. Supplementary Results · p. 17MaAS learns to avoid overly confident early stopping and instead prioritizes testing and self-refinement in deeper layers.
“MaAS learns to avoid overly confident early stopping and instead prioritizes testing and self-refinement in deeper layers.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown data§ 4.4. Case Study · p. 7Query (b) chose two agentic operators at the first layer: direct I/O and ReAct.
“query (b) chose two agentic operators at the first layer: direct I/O and ReAct”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 4.3. Cost Analysis · p. 6DyLAN takes 508 minutes and GPTSwarm takes 129 minutes, while MaAS's optimization wall-clock time requires only 53 minutes.
“DyLAN taking 508 minutes and GPTSwarm taking 129 minutes. In contrast, the optimization wall-clock time of MaAS requires only 53 minutes.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.2. Performance Analysis · p. 6The multi-agent system optimized by MaAS outperforms manually designed methods by an average of 3.90~6.40% and existing automated methods by 2.07~8.26%.
“The multi-agent system optimized by MaAS outperforms manually designed methods by an average of 3 . 90 ∼ 6 . 40% and existing automated methods by 2 . 07 ∼ 8 . 26% .”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.3. Cost Analysis · p. 7MaAS achieves the highest accuracy with an API cost of 0.42$.
“MaAS achieves the highest accuracy with an API cost of 0 . 42$ , demonstrating its high performance and token economy.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.5. Framework Analysis · p. 8Removing O_exit and C(·) results in little impact on performance, but weakens MaAS's query-dependent nature and unnecessarily increases the inference cost.
“Removing O exit and C ( · ) results in little impact on performance, but it weakens MaAS's query-dependent nature and unnecessarily increases the inference cost.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown data§ 1. Introduction · p. 2MaAS enjoys superior cross-dataset and cross-LLM-backbone transferability.
“❸ transferable across datasets and LLM-backbones”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.3. Cost Analysis · p. 6Among optimization-oriented agentic workflows, MaAS achieves the highest accuracy with the least training token consumption.
“among the various optimization-oriented agentic workflows, MaAS achieves the highest accuracy with the least training token consumption.”
Quote in the paperSubstantial claimMay combine two claims.
Findingreasoning§ 4.3. Cost Analysis · p. 7MaAS has the lowest prompt/completion token consumption, the lowest API cost, and the shortest wall-clock time during inference.
“MaAS has the lowest prompt/completion token consumption, the lowest API cost, and the shortest wall-clock time during inference.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.3. Cost Analysis · p. 6MaAS is both training and inference cost-efficient.
“we demonstrate that MaAS is both training/inference cost-efficient from the following three dimensions”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 1. Introduction · p. 2MaAS outperforms the SOTA baseline AFlow on the MATH benchmark with 15% of the training cost and 25% of the inference cost.
“❷ tokeneconomical , outperforming the SOTA baseline AFlow on the MATH benchmark with 15% of the training cost and 25% of the inference cost”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.2. Performance Analysis · p. 6On the GAIA benchmark, MaAS achieves 18.38% and 17.61% improvements on Level 1 and Level 2 tasks, respectively.
“MaAS can adaptively sample customized agentic systems for different domains, achieving 18 . 38% and 17 . 61% improvements on Level 1 and 2 tasks, respectively.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone given§ B.1. Operator Space · p. 14The selection of operators is highly customizable, allowing users the flexibility to incorporate their desired operators into the operator repository of MaAS.
“We respectfully note that the selection of these operators is highly customizable, allowing users the flexibility to incorporate their desired operators into the operator repository of MaAS.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Interpretationnone given§ B.1. Operator Space · p. 14The early exit operator interrupts the multi-agent architecture sampling process and enables the depth of the agentic supernet to be query-dependent.
“We introduce the early exit operator, which interrupts the multi-agent architecture sampling process and enables the depth of the agentic supernet to be query-dependent.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ B.1. Operator Space · p. 13LLM-Debate allows multiple LLMs to debate, leveraging diverse perspectives to identify better solutions.
“LLM-Debate (Du et al., 2023) allows multiple LLMs to debate, leveraging diverse perspectives to identify better solutions.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Du et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ B.1. Operator Space · p. 13CoT reasoning encourages the LLM to think step by step rather than directly outputting an answer.
“CoT (Wei et al., 2022) reasoning encourages the LLM to think step by step rather than directly outputting an answer.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Wei et al., 2022 source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ B.1. Operator Space · p. 13ReAct enables the agent to leverage versatile tools, including code interpreter, web searching, external knowledge database, etc., to handle diverse user demands.
“Following (Yao et al., 2023), this operator enables the agent to leverage versatile tools, including code interpreter, web searching, external knowledge database, etc. , to handle diverse user demands.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Yao et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone given§ Impact Statement · p. 9MaAS enables fine-grained resource allocation tailored to query difficulty and domain, significantly improving efficiency while maintaining high-quality outputs.
“This approach enables fine-grained resource allocation tailored to query difficulty and domain, significantly improving efficiency while maintaining high-quality outputs.”
Quote in the paperNot a substantial claimMay combine two claims.
Premisecitation§ 1. Introduction · p. 1Ph.D.-level abstract algebra may require complicated, token-heavy systems, while simple elementary-level arithmetic works well with a single zero-shot I/O.
“Ph.D.-level abstract algebra may indeed require complicated, token-heavy systems, while simple elementary-level arithmetic works well with a single zero-shot I/O.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ B.1. Operator Space · p. 13CoT enhances the LLM's capability to solve complex problems through intermediate reasoning steps, improving task handling and providing greater transparency in the decision-making process.
“This approach enhances its capability to solve complex problems through intermediate reasoning steps, improving task handling and providing greater transparency in the decision-making process.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Wei et al., 2022 source
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone given§ Impact Statement · p. 9MaAS introduces a new paradigm in multi-agent system design by replacing static, one-size-fits-all architectures with a dynamic and adaptive agentic supernet.
“MaAS introduces a new paradigm in multi-agent system design by replacing static, one-sizefits-all architectures with a dynamic and adaptive agentic supernet.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The difficulty and domain of a query can be captured by the controller network from the query embedding to select an appropriate multi-agent architecture.
“The core of MaAS lies in tailoring a customized multi-agent system for each user query, which may vary in difficulty and domain, to deliver a satisfactory solution”
The paper relies on this without support.
Token cost adequately represents the inference cost of a multi-agent system.
“C ( · ) evaluates the cost of multi-agent systems, represented by token cost”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
AFlow-to-MaAS training-cost ratio is overstated
MinorThe stated costs give a ratio of approximately 6.66, not 6.8; to one decimal place it is 6.7.
Reported 6.8 · recomputed 6.656805
“While AFlow's accuracy is comparable to that of MaAS, its training cost reaches 22 . 50$ , which is 6 . 8 × that of MaAS (merely 3 . 38$ ).”
AFlow's MATH improvement is misstated
MinorRelative to Vanilla's MATH score of 46.29, AFlow's 51.28 is an increase of 4.99 points, not 4.91.
Reported 4.91 · recomputed 4.99
“| AFlow (Zhang et al., 2024c) | 91 . 16 ↑ 3 . 71 | 51 . 28 ↑ 4 . 91 | 96 . 22 ↓ 0 . 63 | 90 . 93 ↑ 3 . 85 | 81 . 67 ↑ 9 . 84 | 82 . 25 |”
Introduction gives a different benchmark count and math dataset
MinorThe introduction says the evaluation covers seven benchmarks and names SVAMP, while the experiment setup says it covers six and names MultiArith instead. The introduction's own list also contains only six benchmarks.
“We conduct comprehensive evaluations on seven widely adopted benchmarks, covering diverse use cases in code generation (HumanEval, MBPP), mathematical reasoning (GSM8K, MATH, SVAMP), and diverse tool usage (GAIA).”
“Weevaluate MaAS on six public benchmarks covering three domains: (1) math reasoning , GSM8K (Cobbe et al., 2021), MATH (Hendrycks et al., 2021), and MultiArith (Roy & Roth, 2016)”
MaAS does not have the lowest inference completion-token count
MinorTable 3 lists 853,116 inference completion tokens for MaAS but 788,273 for GPTSwarm, contradicting the claim that MaAS has the lowest completion-token consumption.
“Table 3 further highlights that MaAS has the lowest prompt/completion token consumption, the lowest API cost, and the shortest wall-clock time during inference.”
“| GPTSwarm | 21 , 325 , 266 | 6 , 369 , 884 | 7 . 02$ | 129 | 3 , 105 , 571 | 788 , 273 | 0 . 93$ | 30 | 47 . 88 |”
T denotes tools in the method but temperature in the notation table
MinorThe method defines T as tools and n as the number of tools invoked, whereas the notation table defines T as an LLM temperature setting.
“Similarly, P and T represent prompts and tools. m and n denote the number of LLM-agents and tools invoked in the operator, respectively.”
“| T | The temperature setting of the LLM. |”
Cites
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · cited 1× · see citing works
“S is given by: ) , where v ( · ) denotes the embedding function using lightweight models like MiniLM (Wang et al., 2020) and Sentence-Bert (Reimers, 2019), and ∥ represents concatenation.”
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,091 · cited 1× · see citing works
“Core NAS techniques, such as reinforcement learning (Zoph, 2016), evolutionary algorithms (Liu et al., 2021), Bayesian optimization (BO) (White et al., 2021), and MCTS (Wang et al., 2021), have inspired analogous approaches in agentic automation, from policy gradient in (Zhuge et al., 2024) to…”
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505 · cited 4× · see citing works
“Most existing single/multi-agent workflows can be viewed as agentic operators: CoT (Wei et al., 2022) can be considered one with m = 1 and n = 0 , denoted as O CoT ; Self-RAG (Asai et al., 2023) similarly involves m = 1 agent allocation, but is equipped with n = 1 retrieval engine, denoted as O…”
InfluentialSelf-citationDARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248 · cited 1× · see citing works
“In NAS, however, these black-box methods were eventually eclipsed by efficient su-pernet training (White et al., 2023), culminating in seminal works like DARTS (Liu et al., 2018) and SNAS (Xie et al., 2018).”
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941 · cited 4× · see citing works
“Efforts to automate the design of agent-based systems can be broadly classified into the following categories: (I) Prompt Optimization , such as PromptBreeder (Fernando et al., 2023), DsPy (Khattab et al., 2023), and EvoPrompt (Guo et al., 2023); (II) Inter-agent Communication , which focuses on orchestrating interact…”
InfluentialAutoML: A survey of the state-of-the-art
He, X. J., Zhao, K., & Chu, X. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,778 · cited 2× · see citing works
“AutoML.”
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087 · see citing works
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Shazeer, N., Mirhoseini, A., Maziarz, K., Davis, A., Le, Q., Hinton, G., & Dean, J. (2017) · arXiv · doi:10.48550/arxiv.1701.06538 · Cited by 933 · cited 1× · see citing works
“We implement the sampling process π ϕ with a Mixture-of-Expert (MoE)-style network (Shazeer et al., 2017; Huang et al., 2024): where S ↓ = sort( S , desc ) , and represents the activation scores of all feasible operators w.r.t. q .”
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2203.11171 · Cited by 829 · cited 1× · see citing works
“Adopting the methodology from Wang et al. (2023a), this operator aggregates five CoT reasoning paths and determines the final answer through majority voting.”
Self-citationA Comprehensive Survey of Neural Architecture Search
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Chen, X., & Wang, X. Y. (2021) · ACM Computing Surveys · doi:10.1145/3447582 · Cited by 808 · cited 3× · see citing works
“Core NAS techniques, such as reinforcement learning (Zoph, 2016), evolutionary algorithms (Liu et al., 2021), Bayesian optimization (BO) (White et al., 2021), and MCTS (Wang et al., 2021), have inspired analogous approaches in agentic automation, from policy gradient in (Zhuge et al., 2024) to evolutionary search in (…”
Self-citationSelf-Refine: Iterative Refinement with Self-Feedback
Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., Alon, U., Dziri, N., Prabhumoye, S., Yang, Y., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2019 · Cited by 755 · see citing works
SNAS: Stochastic Neural Architecture Search
Xie, S., Zheng, H., Liu, C., & Lin, L. (2018) · arXiv · doi:10.48550/arxiv.1812.09926 · Cited by 731 · cited 1× · see citing works
“In NAS, however, these black-box methods were eventually eclipsed by efficient su-pernet training (White et al., 2023), culminating in seminal works like DARTS (Liu et al., 2018) and SNAS (Xie et al., 2018).”
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
Wang, W., Wei, F., Dong, L., Bao, H., Yang, N., & Zhou, M. (2020) · arXiv · doi:10.48550/arxiv.2002.10957 · Cited by 703 · cited 1× · see citing works
“S is given by: ) , where v ( · ) denotes the embedding function using lightweight models like MiniLM (Wang et al., 2020) and Sentence-Bert (Reimers, 2019), and ∥ represents concatenation.”
Solving General Arithmetic Word Problems
Roy, S., & Roth, D. (2016) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1202 · Cited by 702 · see citing works
A Survey on Evolutionary Neural Architecture Search
Liu, Y., Sun, Y., Xue, B., Zhang, M., Yen, G. G., & Tan, K. C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3100554 · Cited by 693 · cited 1× · see citing works
“Core NAS techniques, such as reinforcement learning (Zoph, 2016), evolutionary algorithms (Liu et al., 2021), Bayesian optimization (BO) (White et al., 2021), and MCTS (Wang et al., 2021), have inspired analogous approaches in agentic automation, from policy gradient in (Zhuge et al., 2024) to…”
Complexity-Based Prompting for Multi-Step ReasoningPreprint
Fu, Y., Peng, H.-C., Sabharwal, A., Clark, P., & Khot, T. (2022) · International Conference on Learning Representations · doi:10.48550/arxiv.2210.00720 · Cited by 673 · cited 1× · see citing works
“We compare MaAS with three series of agentic baselines: (1) single agent execution methods , including CoT (Wei et al., 2022), ComplexCoT (Fu et al., 2022 2024) and llama-3.”
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608 · cited 5× · see citing works
“The agentic supernet can be seen as a cascaded multi-layer workflow, including ❶ multiple agentic operators ( e.g. , CoT (Wei et al., 2022), Multi-agent Debate (Du et al., 2023), ReAct (Yao et al., 2023)), as well as ❷ the parameterized probability distributions of operators across layers.”
InfluentialTraining Verifiers to Solve Math Word Problems
Cobbe, K., Kosaraju, V., Bavarian, M., Chen, M., Jun, H., Kaiser, L., Plappert, M., Tworek, J., Hilton, J., Nakano, R., et al. (2021) · arXiv · doi:10.48550/arxiv.2110.14168 · Cited by 575 · see citing works
Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.21783 · Cited by 505 · cited 1× · see citing works
“1-70b ( Dubey et al., 2024)).”
Self-citationHuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Shen, Y., Song, K., Tan, X., Li, D., Lu, W., & Zhuang, Y. (2023) · arXiv · doi:10.48550/arxiv.2303.17580 · Cited by 477 · see citing works
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Shen, Y., Song, K., Tan, X., Li, D., Lu, W., & Zhuang, Y. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1657 · Cited by 475 · see citing works
Program Synthesis with Large Language Models
Austin, J., Odena, A., Nye, M., Bosma, M., Michalewski, H., Dohan, D., Jiang, E., Cai, C., Terry, M., Le, Q., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07732 · Cited by 388 · see citing works
A Dynamic LLM-Powered Agent Network for Task-Oriented Agent CollaborationPreprint
Liu, Z., Zhang, Y., Li, P., Liu, Y., & Yang, D.-Y. (2023) · arXiv.org · doi:10.48550/arxiv.2310.02170 · Cited by 385 · see citing works
AutoAgents: A Framework for Automatic Agent Generation
Chen, G., Dong, S., Shu, Y., Zhang, G., Sesay, J., Karlsson, B. F., Fu, J., & Shi, Y.-M. (2023) · International Joint Conference on Artificial Intelligence · doi:10.48550/arxiv.2309.17288 · Cited by 324 · cited 4×
“Efforts to automate the design of agent-based systems can be broadly classified into the following categories: (I) Prompt Optimization , such as PromptBreeder (Fernando et al., 2023), DsPy (Khattab et al., 2023), and EvoPrompt (Guo et al., 2023); (II) Inter-agent Communication , which focuses on orchestrating interact…”
InfluentialSelf-citationEncouraging Divergent Thinking in Large Language Models through Multi-Agent Debate
Liang, T., He, Z., Jiao, W., Wang, X., Wang, Y., Wang, R., Yang, Y., Shi, S., & Tu, Z. (2023) · arXiv · doi:10.48550/arxiv.2305.19118 · Cited by 320 · cited 1× · see citing works
“…(Zhuge et al., 2024) or competitively (Zhao et al., 2023), can surpass the cognitive and intellectual capabilities of individuals (Du et al., 2023; Liang et al., 2023; Wang et al., 2023b; Jiang et al., 2023; Wu et al., 2023; Zhang et al., 2024a), showcasing the collective intelligence in a…”
Self-citationCamel: Communicative agents for" mind" exploration of large language model society
Li, G., Hammoud, H., Itani, H., Khizbullin, D., & Ghanem, B. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2264 · Cited by 314 · see citing works
Measuring Mathematical Problem Solving With the MATH Dataset
Hendrycks, D., Burns, C., Kadavath, S., Arora, A., Basart, S., Tang, E., Song, D., & Steinhardt, J. (2021) · arXiv · doi:10.48550/arxiv.2103.03874 · Cited by 306 · cited 1× · see citing works
“However, this is far from an optimal solution: for example, in mathematical benchmarks (Hendrycks et al., 2021), Ph.D.-level abstract algebra may indeed require complicated, token-heavy systems, while simple elementary-level arithmetic works well with a single zero-shot I/O.”
BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search
White, C., Neiswanger, W., & Savani, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17233 · Cited by 287 · see citing works
Solving General Arithmetic Word Problems
Roy, S., & Roth, D. (2016) · arXiv · doi:10.48550/arxiv.1608.01413 · Cited by 275
Automatic Chain of Thought Prompting in Large Language Models
Zhang, Z., Zhang, A., Li, M., & Smola, A. (2022) · arXiv · doi:10.48550/arxiv.2210.03493 · Cited by 274 · see citing works
MemoryBank: Enhancing Large Language Models with Long-Term Memory
Zhong, W., Guo, L., Gao, Q., Ye, H., & Wang, Y. (2023) · arXiv · doi:10.48550/arxiv.2305.10250 · Cited by 253 · see citing works
Self-Refine: Iterative Refinement with Self-Feedback
Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., Alon, U., Dziri, N., Prabhumoye, S., Yang, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.17651 · Cited by 219 · cited 1× · see citing works
“Following Madaan et al. (2023), this operator initially generates an answer using CoT reasoning, then prompts the agent to self-reflect iteratively.”
MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
Hong, S., Zhuge, M., Chen, J., Zheng, X., Cheng, Y., Zhang, C., Wang, J., Wang, Z., Yau, S. K. S., Lin, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.00352 · Cited by 214 · see citing works
LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion
Jiang, D., Ren, X., & Lin, B. Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.792 · Cited by 207 · see citing works
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., Jiang, L., Zhang, X., Zhang, S., Liu, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.08155 · Cited by 193 · see citing works
(2019) · Some Glad Morning · doi:10.2307/j.ctvq4c06f.22 · Cited by 189
Neural Architecture Search: Insights from 1000 PapersPreprint
White, C., Safari, M., Sukthanker, R. S., Ru, B., Elsken, T., Zela, A., Dey, D., & Hutter, F. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.08727 · Cited by 144 · cited 1× · see citing works
“In NAS, however, these black-box methods were eventually eclipsed by efficient su-pernet training (White et al., 2023), culminating in seminal works like DARTS (Liu et al., 2018) and SNAS (Xie et al., 2018).”
LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion
Jiang, D., Ren, X., & Lin, B. Y. (2023) · arXiv · doi:10.48550/arxiv.2306.02561 · Cited by 141 · cited 2× · see citing works
“Inspired by LLM-Blender (Jiang et al., 2023), this operator involves three LLM-powered agents from different sources outputting answers to the same query.”
Empirical Bayes: Past, Present and Future
Carlin, B. P., & Louis, T. A. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474331 · Cited by 138 · cited 1× · see citing works
“Therefore, we employ an empirical Bayes Monte Carlo procedure (Carlin & Louis, 2000; Yan et al., 2021) to estimate the gradient w.r.t the distribution π : where m k denotes the cost-aware importance weights of the agentic architecture.”
Mind2Web: Towards a Generalist Agent for the Web
Deng, X., Gu, Y., Zheng, B., Chen, S., Stevens, S., Wang, B., Sun, H., & Su, Y. (2023) · arXiv · doi:10.48550/arxiv.2306.06070 · Cited by 134 · cited 1× · see citing works
“…as question answering (Zhu et al., 2024a), data analysis (Hong et al., 2024; Li et al., 2024), code generation (Shinn et al., 2023), web navigation (Deng et al., 2024), and data synthesis (Butt et al., 2024), by equipping LLMs with high-* level features, including persona (Wang et al., 2023b; Chen…”
(2023) · doi:10.52202/075280-1220 · Cited by 134 · see citing works
Qwen, :, Yang, A., Yang, B., Zhang, B., Hui, B., Zheng, B., Yu, B., Li, C., Liu, D., et al. (2024) · arXiv · doi:10.48550/arxiv.2412.15115 · Cited by 128 · cited 1× · see citing works
“0.01 0.19 0.06 0.06 0.45 0.13 0.00 0.06 0.12 0.31 0.05 0.05 0.36 0.01 0.06 0.13 0.17 0.02 0.05 0.23 0.34”
InfluentialSymbolic Learning Enables Self-Evolving Agents
Ou, Y., Zhou, W., Ding, S., et al. (2024) · AI Open · doi:10.48550/arxiv.2406.18532 · Cited by 108
Asai, A., Wu, Z., Wang, Y., Sil, A., & Hajishirzi, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.11511 · Cited by 101 · cited 7× · see citing works
“…on the success of single agents (Shen et al., 2024; Zhu et al., 2024b; Zhong et al., 2024 substantially enhance individual model capabilities (Wang et al., 2024a), as demonstrated in early attempts such as AutoGen (Wu et al., 2023), LLM-Debate (Du et al., 2023), and AgentVerse (Chen et al., 2023b).”
InfluentialImproving Factuality and Reasoning in Language Models through Multiagent Debate
Du, Y., Li, S., Torralba, A., Tenenbaum, J. B., & Mordatch, I. (2023) · arXiv · doi:10.48550/arxiv.2305.14325 · Cited by 96 · cited 12× · see citing works
“The agentic supernet can be seen as a cascaded multi-layer workflow, including ❶ multiple agentic operators ( e.g. , CoT (Wei et al., 2022), Multi-agent Debate (Du et al., 2023), ReAct (Yao et al., 2023)), as well as ❷ the parameterized probability distributions of operators across layers.”
InfluentialHarder Tasks Need More Experts: Dynamic Routing in MoE Models
Huang, Q., An, Z., Zhuang, N., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2403.07652 · Cited by 93
AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions
Li, Z.-M., Zang, Q., Ma, D., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2410.20424 · Cited by 87 · cited 1×
“…2023) have made remarkable strides in a spectrum of domains, such as question answering (Zhu et al., 2024a), data analysis (Hong et al., 2024; Li et al., 2024), code generation (Shinn et al., 2023), web navigation (Deng et al., 2024), and data synthesis (Butt et al., 2024), by equipping LLMs…”
Self-citationSentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · arXiv · doi:10.48550/arxiv.1908.10084 · Cited by 86 · see citing works
Wang, Z., Mao, S., Wu, W., Ge, T., Wei, F., & Ji, H. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.15 · Cited by 74 · see citing works
Can Graph Learning Improve Planning in LLM-based Agents?
Wu, X.-X., Shen, Y.-F., Shan, C., et al. (2024) · Neural Information Processing Systems · doi:10.52202/079017-0173 · Cited by 71
MemGPT: Towards LLMs as Operating Systems
Packer, C., Wooders, S., Lin, K., Fang, V., Patil, S. G., Stoica, I., & Gonzalez, J. E. (2023) · arXiv · doi:10.48550/arxiv.2310.08560 · Cited by 64 · cited 1× · see citing works
“…by equipping LLMs with high-* level features, including persona (Wang et al., 2023b; Chen et al., 2024), tools (Shen et al., 2024; Richards & et al., 2023), planning (Qiao et al., 2024; Wu et al., 2024; He et al., 2023), and memory (Zhong et al., 2024; Hatalis et al., 2023; Packer et al., 2023).”
DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
Khattab, O., Singhvi, A., Maheshwari, P., Zhang, Z., Santhanam, K., Vardhamanan, S., Haq, S., Sharma, A., Joshi, T. T., Moazam, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.03714 · Cited by 60 · cited 4× · see citing works
“Efforts to automate the design of agent-based systems can be broadly classified into the following categories: (I) Prompt Optimization , such as PromptBreeder (Fernando et al., 2023), DsPy (Khattab et al., 2023), and EvoPrompt (Guo et al., 2023); (II) Inter-agent Communication , which focuses on orchestrating interact…”
InfluentialData Interpreter: An LLM Agent For Data Science
Hong, S., Lin, Y., Liu, B., Liu, B., Wu, B., Zhang, C., Wei, C., Li, D., Chen, J., Zhang, J., et al. (2024) · arXiv · Cited by 60 · cited 2× · see citing works
“…Nakajima, 2023; Reworkd, 2023) have made remarkable strides in a spectrum of domains, such as question answering (Zhu et al., 2024a), data analysis (Hong et al., 2024; Li et al., 2024), code generation (Shinn et al., 2023), web navigation (Deng et al., 2024), and data synthesis (Butt et al.,…”
ChatLLM Network: More brains, More intelligencePreprint
Hao, R., Hu, L., Qi, W., et al. (2023) · AI Open · doi:10.48550/arxiv.2304.12998 · Cited by 58 · see citing works
Sample-Efficient Neural Architecture Search by Learning Actions for Monte Carlo Tree Search
Wang, L., Xie, S., Li, T., Fonseca, R., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3071343 · Cited by 53 · cited 3× · see citing works
“Core NAS techniques, such as reinforcement learning (Zoph, 2016), evolutionary algorithms (Liu et al., 2021), Bayesian optimization (BO) (White et al., 2021), and MCTS (Wang et al., 2021), have inspired analogous approaches in agentic automation, from policy gradient in (Zhuge et al., 2024) to evolutionary search in (…”
EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizers
Guo, Q., Wang, R., Guo, J., Li, B., Song, K., Tan, X., Liu, G., Bian, J., & Yang, Y. (2023) · arXiv · doi:10.48550/arxiv.2309.08532 · Cited by 50 · cited 4× · see citing works
“Efforts to automate the design of agent-based systems can be broadly classified into the following categories: (I) Prompt Optimization , such as PromptBreeder (Fernando et al., 2023), DsPy (Khattab et al., 2023), and EvoPrompt (Guo et al., 2023); (II) Inter-agent Communication , which focuses on orchestrating interact…”
InfluentialMemory Matters: The Need to Improve Long-Term Memory in LLM-Agents
Hatalis, K., Christou, D., Myers, J., Jones, S., Lambert, K., Amos-Binks, A., Dannenhauer, Z., & Dannenhauer, D. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v2i1.27688 · Cited by 42 · cited 1× · see citing works
“…by equipping LLMs with high-* level features, including persona (Wang et al., 2023b; Chen et al., 2024), tools (Shen et al., 2024; Richards & et al., 2023), planning (Qiao et al., 2024; Wu et al., 2024; He et al., 2023), and memory (Zhong et al., 2024; Hatalis et al., 2023; Packer et al., 2023).”
AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors
Chen, W., Su, Y., Zuo, J., Yang, C., Yuan, C., Chan, C.-M., Yu, H., Lu, Y., Hung, Y.-H., Qian, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.10848 · Cited by 39 · see citing works
KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents
Zhu, Y., Qiao, S., Ou, Y., Deng, S., Lyu, S., Shen, Y., Liang, L., Gu, J., Chen, H., & Zhang, N. (2024) · arXiv · doi:10.48550/arxiv.2403.03101 · Cited by 38
CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agents
Zhao, Q., Wang, J., Zhang, Y., Jin, Y., Zhu, K., Chen, H., & Xie, X. (2023) · arXiv · doi:10.48550/arxiv.2310.17512 · Cited by 37 · see citing works
AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation
Huang, D., Zhang, J. M., Luck, M., Bu, Q., Qing, Y., & Cui, H. (2023) · arXiv · doi:10.48550/arxiv.2312.13010 · Cited by 34 · cited 1× · see citing works
“Following the test designer in AgentCoder (Huang et al., 2023), this operator is used for generating test cases for the generated code.”
Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution
Fernando, C., Banarse, D., Michalewski, H., Osindero, S., & Rocktäschel, T. (2023) · arXiv · doi:10.48550/arxiv.2309.16797 · Cited by 31 · cited 2× · see citing works
“Efforts to automate the design of agent-based systems can be broadly classified into the following categories: (I) Prompt Optimization , such as PromptBreeder (Fernando et al., 2023), DsPy (Khattab et al., 2023), and EvoPrompt (Guo et al., 2023); (II) Inter-agent Communication , which focuses on orchestrating interact…”
AutoTQA: Towards Autonomous Tabular Question Answering through Multi-Agent Large Language Models
Zhu, J.-P., Cai, P., Xu, K., Li, L., Sun, Y., Zhou, S., Su, H., Liu, T., & Liu, Q. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3685800.3685816 · Cited by 30 · cited 1× · see citing works
“…agents (Richards & et al., 2023; Nakajima, 2023; Reworkd, 2023) have made remarkable strides in a spectrum of domains, such as question answering (Zhu et al., 2024a), data analysis (Hong et al., 2024; Li et al., 2024), code generation (Shinn et al., 2023), web navigation (Deng et al., 2024), and…”
FP-NAS: Fast Probabilistic Neural Architecture Search
Yan, Z., Dai, X., Zhang, P., Tian, Y., Wu, B., & Feiszli, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01489 · Cited by 24 · cited 1× · see citing works
“Therefore, we employ an empirical Bayes Monte Carlo procedure (Carlin & Louis, 2000; Yan et al., 2021) to estimate the gradient w.r.t the distribution π : where m k denotes the cost-aware importance weights of the agentic architecture.”
Sibyl: Simple yet Effective Agent Framework for Complex Real-world Reasoning
Wang, Y., Shen, T., Liu, L., & Xie, J. (2024) · arXiv.org · doi:10.48550/arxiv.2407.10718 · Cited by 20 · cited 1×
“Table 2 shows a comparison of MaAS with automated systems and three additional baselines, including Auto-GPT (Richards & et al., 2023), TapeAgent (Bahdanau et al., 2024), and Sibyl (Wang et al., 2024b) on the GAIA benchmark.”
BENCHAGENTS: Automated Benchmark Creation with Agent Interaction
Butt, N., Chandrasekaran, V., Joshi, N., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2410.22584 · Cited by 20 · cited 1×
“…data analysis (Hong et al., 2024; Li et al., 2024), code generation (Shinn et al., 2023), web navigation (Deng et al., 2024), and data synthesis (Butt et al., 2024), by equipping LLMs with high-* level features, including persona (Wang et al., 2023b; Chen et al., 2024), tools (Shen et al.,…”
From Persona to Personalization: A Survey on Role-Playing Language Agents
Chen, J., Wang, X., Xu, R., Yuan, S., Zhang, Y., Shi, W., Xie, J., Li, S., Yang, R., Zhu, T., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.18231 · Cited by 15 · cited 6× · see citing works
“…DsPy (Khattab et al., 2023) and Evo-Prompting (Guo et al., 2023) automate prompt optimization, GPTSwarm (Zhuge et al., 2024) and G-Designer (Zhang et al., 2024b) optimize inter-agent communication, and EvoAgent (Yuan et al., 2024) and AutoAgents (Chen et al., 2023a) self-evolve agent profiling.”
InfluentialSelf-citationCooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents
Piatti, G., Jin, Z., Kleiman-Weiner, M., Schölkopf, B., Sachan, M., & Mihalcea, R. (2024) · arXiv · doi:10.48550/arxiv.2404.16698 · Cited by 14 · cited 3× · see citing works
“Similarly, P and T represent prompts and tools. m and n denote the number of LLM-agents and tools invoked in the operator, respectively.”
GAIA: a benchmark for General AI Assistants
Mialon, G., Fourrier, C., Swift, C., Wolf, T., LeCun, Y., & Scialom, T. (2023) · arXiv · doi:10.48550/arxiv.2311.12983 · Cited by 12 · cited 1× · see citing works
“…paradigm becomes even more problematic when applied to benchmarks across multiple task domains ( Dilemma 2 ): for instance, in the GAIA benchmark (Mialon et al., 2023), there is no single sys-tem that is optimal for both file reading and web searching tasks, leaving practitioners with no…”
VerifAI: Verified Generative AI
Tang, N., Yang, C., Fan, J., Cao, L., Luo, Y., & Halevy, A. (2023) · arXiv · doi:10.48550/arxiv.2307.02796 · Cited by 12 · cited 1×
“This dependency significantly limits the rapid adaptation of multi-agent systems to diverse domains and application scenarios (Tang et al., 2023; Zhang et al., 2024c).”
TapeAgents: a Holistic Framework for Agent Development and OptimizationPreprint
Bahdanau, D., Gontier, N., Huang, G., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2412.08445 · Cited by 12 · cited 1× · see citing works
“Table 2 shows a comparison of MaAS with automated systems and three additional baselines, including Auto-GPT (Richards & et al., 2023), TapeAgent (Bahdanau et al., 2024), and Sibyl (Wang et al., 2024b) on the GAIA benchmark.”
Wang, Z., Mao, S., Wu, W., Ge, T., Wei, F., & Ji, H. (2023) · arXiv · doi:10.48550/arxiv.2307.05300 · Cited by 11 · cited 2× · see citing works
“…2023), web navigation (Deng et al., 2024), and data synthesis (Butt et al., 2024), by equipping LLMs with high-* level features, including persona (Wang et al., 2023b; Chen et al., 2024), tools (Shen et al., 2024; Richards & et al., 2023), planning (Qiao et al., 2024; Wu et al., 2024; He et al.,…”
Automated Design of Agentic Systems
Hu, S., Lu, C., & Clune, J. (2024) · arXiv · doi:10.48550/arxiv.2408.08435 · Cited by 10 · cited 4× · see citing works
“Subsequently, ADAS (Hu et al., 2024a), AgentSqure (Shang et al., 2024), and AFlow (Zhang et al., 2024c) broaden the design search space.”
InfluentialScaling Large Language Model-based Multi-Agent Collaboration
Qian, C., Xie, Z., Wang, Y., Liu, W., Zhu, K., Xia, H., Dang, Y., Du, Z., Chen, W., Yang, C., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.07155 · Cited by 8 · cited 1× · see citing works
“…systems, such as CAMEL (Li et al., 2023), AutoGen (Wu et al., 2023), and MetaGPT (Hong et al., 2023), while delivering specialized capacity, often heavily rely on manual configurations, including prompt engineering, agent profiling, and inter-agent communication pipelines (Qian et al., 2024).”
He, Z.-T., Cao, P., Chen, Y., Liu, K., Li, R., Sun, M., & Zhao, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.613 · Cited by 8 · cited 6× · see citing works
“…by equipping LLMs with high-* level features, including persona (Wang et al., 2023b; Chen et al., 2024), tools (Shen et al., 2024; Richards & et al., 2023), planning (Qiao et al., 2024; Wu et al., 2024; He et al., 2023), and memory (Zhong et al., 2024; Hatalis et al., 2023; Packer et al., 2023).”
InfluentialAFlow: Automating Agentic Workflow Generation
Zhang, J., Xiang, J., Yu, Z., Teng, F., Chen, X., Chen, J., Zhuge, M., Cheng, X., Hong, S., Wang, J., et al. (2024) · arXiv · doi:10.48550/arxiv.2410.10762 · Cited by 7 · cited 7× · see citing works
“Subsequently, ADAS (Hu et al., 2024a), AgentSqure (Shang et al., 2024), and AFlow (Zhang et al., 2024c) broaden the design search space.”
InfluentialCut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems
Zhang, G., Yue, Y., Li, Z., Yun, S., Wan, G., Wang, K., Cheng, D., Yu, J. X., & Chen, T. (2024) · arXiv · doi:10.48550/arxiv.2410.02506 · Cited by 4
Self-citationAgentSquare: Automatic LLM Agent Search in Modular Design Space
Shang, Y., Li, Y., Zhao, K., Ma, L., Liu, J., Xu, F., & Li, Y. (2024) · arXiv · doi:10.48550/arxiv.2410.06153 · Cited by 3 · cited 5× · see citing works
“Subsequently, ADAS (Hu et al., 2024a), AgentSqure (Shang et al., 2024), and AFlow (Zhang et al., 2024c) broaden the design search space.”
InfluentialAutoAct: Automatic Agent Learning from Scratch for QA via Self-PlanningPreprint
Qiao, S., Zhang, N., Fang, R., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.05268 · Cited by 3 · see citing works
Language Agents as Optimizable Graphs
Zhuge, M., Wang, W., Kirsch, L., Faccio, F., Khizbullin, D., & Schmidhuber, J. (2024) · arXiv · doi:10.48550/arxiv.2402.16823 · Cited by 3 · see citing works
GraphRouter: A Graph-based Router for LLM Selections
Feng, T., Shen, Y., & You, J. (2024) · arXiv · doi:10.48550/arxiv.2410.03834 · Cited by 2 · cited 2× · see citing works
“Building on the success of single agents (Shen et al., 2024; Zhu et al., 2024b; Zhong et al., 2024 substantially enhance individual model capabilities (Wang et al., 2024a), as demonstrated in early attempts such as AutoGen (Wu et al., 2023), LLM-Debate (Du et al., 2023), and AgentVerse (Chen et…”
Self-Evolving Multi-Agent Collaboration Networks for Software DevelopmentPreprint
Yue, H., Cai, Y., Du, Y., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.16946 · Cited by 2 · cited 4× · see citing works
“To address this, we utilize agent-based textual gradient (Hao et al., 2023; Liu et al., 2023; Hu et al., 2024b; Zhou et al., 2024) to approximate the backpropagation for agentic operators, as visualized in Figure 3 and formalized as follows: where T P , T T , T N represent agent-generated gradient…”
InfluentialG-Designer: Architecting Multi-agent Communication Topologies via Graph Neural NetworksPreprint
Zhang, G., Yue, Y., Sun, X., Wan, G., Yu, M., Fang, J., Wang, K., Chen, T., & Cheng, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.11782 · Cited by 1 · cited 2× · see citing works
“…the backpropagation for agentic operators, as visualized in Figure 3 and formalized as follows: where T P , T T , T N represent agent-generated gradient analyses in textual format, corresponding to updates of the prompt, model temperature, and operator node structure (such as merging,…”
Self-citationLaird, N. M. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2379.pub2 · Cited by 1 · see citing works
EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms
Yuan, S., Song, K., Chen, J., Tan, X., Li, D., & Yang, D. (2024) · arXiv · doi:10.48550/arxiv.2406.14228
Archon: An Architecture Search Framework for Inference-Time Techniques
Saad-Falcon, J., Lafuente, A. G., Natarajan, S., Maru, N., Todorov, H., Guha, E., Buchanan, E. K., Chen, M., Guha, N., Ré, C., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.15254
Flagged first, then by citations
13 of the 99 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Chen, M., Tworek, J., Jun, H., Yuan, Q., Ponde de Oliveira Pinto, H., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., Ray, A., Puri, R., Krueger, G., Petrov, M., Khlaaf, H., Sastry, G., Mishkin, P., Chan, B., Gray, S., Ryder, N., Pavlov, M., Power, A., Kaiser, L., Bavarian, M., Winter, C., Tillet, P., Petroski Such, F., Cummings, D., Plappert, M., Chantzis, F., Barnes, E., Herbert-Voss, A., Hebgen Guss, W., Nichol, A., Paino, A., Tezak, N., Tang, J., Babuschkin, I., Balaji, S., Jain, S., Saunders, W., Hesse, C., Carr, A. N., Leike, J., Achiam, J., Misra, V., Morikawa, E., Radford, A., Knight, M., Brundage, M., Murati, M., Mayer, K., Welinder, P., McGrew, B., Amodei, D., McCandlish, S., Sutskever, I., and Zaremba, W. Evaluating large language models trained on code, July 01, 2021 2021.
Cited by
Sorted by citations
Large Language Models Meet NLP: A Survey
Qin, L.-B., Chen, Q., Feng, X., Wu, Y., Zhang, Y., Li, Y.-H., Li, M., Che, W.-X., & Yu, P. S. (2024) · Frontiers Comput. Sci. · doi:10.48550/arxiv.2405.12819 · Cited by 190
AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?Preprint
Zhang, G., Wang, J., Chen, J., Zhou, W., Wang, K., & Yan, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.03312 · Cited by 2 · see citing works
“1, CRITIC consistently degrades performance ( e.g. , CRITIC+MaAS+GAIA accuracy drops by − 4 .”
Self-citationOn the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents
Huang, J.-T., Zhou, J., Jin, T., Zhou, X., Chen, Z., Wang, W., Yuan, Y., Lyu, M. R., & Sap, M. (2024) · arXiv · doi:10.48550/arxiv.2408.00989 · Cited by 1 · see citing works
G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems
Zhang, G.-M., Fu, M., Wan, G.-C., Yu, M., Wang, K., & Yan, S.-C. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2506.07398 · Cited by 124
“More recent automated MASs, such as GPTSwarm [47], ADAS [48], AFlow [49], and MaAS [50] have made it to automatically optimize inter-agent topologies or prompts, which, nevertheless, ultimately yield giant and cumbersome MAS architectures, lacking the agility to self-adjust with accumulated…”
Self-citationMemEvolve: Meta-Evolution of Agent Memory SystemsPreprint
Zhang, G., Ren, H., Zhan, C., Zhou, Z., Wang, J., Zhu, H., Zhou, W., & Yan, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.18746
“Storage can be vector databases (Zhao et al., 2024), knowledge graphs (Zhang et al., 2025b; Rasmussen et al., 2025), or others.”
InfluentialSelf-citationWang, Z., Wang, Y., Liu, X.-B., Ding, L., Zhang, M., Liu, J., & Zhang, M. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2503.18891 · Cited by 66 · see citing works
“Recently, researchers have also explored approaches that automatically generate suitable topologies for specific tasks to enhance the performance and efficiency of MAS, such as G-Designer (Zhang et al., 2024a) and MaAS (Zhang et al., 2025b).”
FLEX: Continuous Agent Evolution via Forward Learning from Experience
Cai, Z.-C., Guo, X.-Y., Pei, Y., Feng, J.-T., Su, J.-S., Chen, J.-J., Zhang, Y.-Q., Ma, W.-Y., Wang, M.-X., & Zhou, H. (2025) · arXiv.org · doi:10.48550/arxiv.2511.06449 · Cited by 55
“Another line emphasizes agents architecture evolution, such as CAMEL [114], MetaGPT [115], AgentSquare [26], MaAS [25], AutoFlow [116], and GPTSwarm [117], which orchestra multiple agents for cooperative problem solving.”
EvoAgentX: An Automated Framework for Evolving Agentic Workflows
Wang, Y., Liu, S., Fang, J., & Meng, Z. (2025) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2507.03616 · Cited by 52
“Recent work has further unified prompt and topology optimization, as in ADAS (Hu et al., 2024), FlowReasoner (Gao et al., 2025), and MaAS (Zhang et al., 2025b), which jointly optimize agent configurations, prompts, and execution graphs using meta-search, reinforcement learning, or probabilistic…”
Self-citationAGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructions
Liu, A.-S., Ying, Z.-H., Wang, L., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2506.14697 · Cited by 47
ReSo: A Reward-driven Self-organizing LLM-based Multi-Agent System for Reasoning Tasks
Zhou, H., Geng, H.-J., Xue, X., Kang, L., Yin, Z.-F., & Bai, L. (2025) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2503.02390 · Cited by 39
“A THRESHOLD = 0.6 establishes the similarity cutoff for specialized handling of certain subproblems, while EXPLORATION_CONST = 0.3 encourages periodic assignments to underutilized agents.”
InfluentialSelf-citationWe Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent SystemsPreprint
Fang, J.-F., Yao, Z., Wang, R.-P., Ma, H.-K., Wang, X., & Chua, T.-S. (2025) · arXiv.org · doi:10.48550/arxiv.2506.13666 · Cited by 39 · see citing works
“LLM-based agentic systems [23, 106, 83, 98, 97, 96] significantly enhance complex reasoning and problem-solving capabilities through the integration of specialized tools [66, 71, 87, 67], memory mechanisms [103, 81, 100, 80], and API interfaces [48, 72], as well as through the construction of both…”
Self-citationA Survey on Trustworthy LLM Agents: Threats and Countermeasures
Yu, M., Meng, F., Zhou, X., Wang, S., Mao, J., Pan, L., Chen, T., Wang, K., Li, X., Zhang, Y., et al. (2025) · Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · doi:10.1145/3711896.3736561 · Cited by 34 · see citing works
“Furthermore, the introduction of inter-agent communication gives rise to the more advanced concept of Multi-agent System (MAS), making the “hy-per LLM ecosystem” become even more intricate, interactive and intelligent [32, 101].”
Self-citationKe, Z.-X., Ming, Y., Xu, A., Chin, R., Nguyen, X.-P., Jwalapuram, P., Wang, J.-Y., Yavuz, S., Xiong, C., & Joty, S. R. (2026) · arXiv.org · doi:10.48550/arxiv.2601.14652 · Cited by 38
“MASS (Zhou et al., 2025) uses rejection sampling to select effective agent configurations, and MaAS (Zhang et al., 2025a) extends MASS with a question-wise masking mechanism to adapt subnet-works.”
DyFlow: Dynamic Workflow Framework for Agentic ReasoningPreprint
Wang, Y., Xu, Z., Huang, Y., Wang, X., Song, Z., Gao, L., Wang, C., Tang, X., Zhao, Y., Cohan, A., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.26062
“…by operator id or execution order 8: M [ k r ] ← r ▷ store output in memory dictionary 9: end for Unlike prior frameworks such as AFlow, MaAS [12, 15], which implement control structures like branching or looping via explicit edge logic in code-based graphs, DyFlow adopts a designer-centric…”
InfluentialSelf-citationDifficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflows
Su, J., Lan, Q., Xia, Y., Sun, L., Tian, W., Shi, T., & He, L. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792240 · Cited by 12 · see citing works
“We compare DAAO with three of agentic baselines: (1) single-agent approaches, including CoT [41], ComplexCoT [9], Self-Consistency [39]; (2) autonomous agentic workflows, including ADAS [14], AFlow [50] and MaAS [49].”
InfluentialAdaptive Graph Pruning for Multi-Agent Communication
Li, B., Zhao, Z., Lee, D.-H., & Wang, G. (2025) · European Conference on Artificial Intelligence · doi:10.48550/arxiv.2506.02951 · Cited by 29
“(4) Even when compared to MaAS [41], a search algorithm that explores agent architecture distributions, our method achieves higher accuracy on GSM8K while reducing prompt-token costs by over half.”
Exploring Advanced LLM Multi-Agent Systems Based on Blackboard Architecture
Han, B., & Zhang, S. (2025) · arXiv · doi:10.48550/arxiv.2507.01701 · Cited by 14 · see citing works
“Three autonomous MAS methods are implemented in accordance with the original implementation(Zhang et al., 2025d; Zhuge et al., 2024; Zhang et al., 2025a).”
VFlow: Discovering Optimal Agentic Workflows for Verilog Generation
Wei, Y., Huang, Z., He, L., Huang, L., Lin, T.-J., & Xing, W. W. (2026) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac66049.2026.11420713 · Cited by 3 · see citing works
“By reformulating workflow design as a search problem, approaches like AFLOW and MaAS [15] can systematically discover effective workflows without extensive human intervention.”
HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems
Chen, M.-J., Lv, C.-C., Zhang, G., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.01779 · Cited by 23
“We compare HarnessForge against two main baseline groups: Search-style harness baselines include AFlow (Zhang et al., 2025c), ADAS (Hu et al., 2025), AgentSquare (Shang et al., 2025), MaAS (Zhang et al., 2025a), and Mermaid-Flow (Zheng et al., 2025a).”
InfluentialSelf-citationRethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baseline
Xu, J., Koesdwiady, A., Bei, S.-S., Han, Y., Huang, B.-X., Wang, D.-K., Chen, Y.-T., Wang, Z., Wang, P., Li, P., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2601.12307 · Cited by 22
RobustFlow: Towards Robust Agentic Workflow GenerationPreprint
Xu, S., Zhang, J., Di, S., Luo, Y., Yao, L., Liu, H., Zhu, J., & Zhang, M.-L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.21834
“Following Section 3.1, we construct a benchmark dataset of 7,530 query variants and 31,889 workflows across 3 task domains and 6 benchmarks:”
InfluentialWeak-for-Strong: Training Weak Meta-Agent to Harness Strong ExecutorsPreprint
Nie, F., Feng, L., Ye, H.-T., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2504.04785 · Cited by 22 · see citing works
Darwin Gödel Machine: Open-Ended Evolution of Self-Improving Agents
Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15063 · Cited by 34 · see citing works
Failure-Driven Workflow Refinement
Zhang, J., Cai, K., Zeng, Q., Liu, N., Fan, S., Chen, Z., & Wang, K.-Z. (2025) · arXiv.org · doi:10.48550/arxiv.2510.10035 · Cited by 22
“The dominant global search paradigm, exemplified by methods like Monte Carlo Tree Search (MCTS) in systems such as MaAS (Zhang et al., 2025a) or AFlow (Zhang et al., 2025b), attempts to minimize failure mass indirectly.”
Self-citationAgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical SearchPreprint
Li, Y., Li, L., Wu, Z., Liao, Q., Hao, J., Shao, K., Xu, F., & Li, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.06017
“Extending this direction, MaAS [41] shifts from searching for a single optimal workflow to learning a query-conditioned distribution over agentic architectures, enabling adaptive deployment.”
Graph-Augmented Large Language Model Agents: Current Progress and Future Prospects
Liu, Y.-X., Zhang, G.-M., Wang, K., Li, S.-Y., Pan, S., & An, B. (2025) · IEEE Intelligent Systems · doi:10.1109/mis.2025.3642667 · Cited by 20
“Interestingly, these redundancy patterns parallel classical graph lightweight-ing phenomena: redundant inter-agent communication mirrors edge redundancy, excessive agents correspond to removable, unnecessary nodes, and diminishing returns from prolonged multi-agent interactions resemble the…”
Self-citationMermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary ProgrammingPreprint
Zheng, C., Chen, J.-D., Lyu, Y., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2505.22967 · Cited by 19 · see citing works
“We use a closed-source LLM (gpt-4o-mini-0718) as both the Optimization and Execution LLM, consistent with the setup in MaAS [28].”
InfluentialStop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systems
Lin, F.-L., Chen, S.-W., Fang, R.-S., Wang, H.-W., & Lin, T. (2025) · arXiv.org · doi:10.48550/arxiv.2510.26585 · Cited by 19
Li, S., Liu, Y., Zheng, Y., Li, M., Nguyen, Q. V. H., & Pan, S. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792537 · Cited by 1 · see citing works
EvoRoute: Experience-Driven Self-Routing LLM Agent Systems
Zhang, G.-B., Yu, H., Yang, K., Wu, B., Huang, F., Li, Y.-B., & Yan, S.-C. (2026) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2601.02695 · Cited by 18
Self-citationDynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Models
Jiang, E., Wan, G.-C., Yin, S., et al. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2510.07799 · Cited by 17
“While all systems experienced some performance degradation, GTD’s accuracy dropped by a mere 0.3 percentage points (from 94.1% to 93.8%), showcasing a remarkably graceful degradation.”
InfluentialVisual Multi-Agent System: Mitigating Hallucination Snowballing via Visual Flow
Yu, X.-L., Xu, C.-M., Zhang, G.-M., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2509.21789 · Cited by 17
Self-citationSafeMobile: Chain-level Jailbreak Detection and Automated Evaluation for Multimodal Mobile Agents
Liang, S.-Y., Fang, T.-M., Liu, Z., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2507.00841 · Cited by 17
“In recent years, with the breakthrough progress of multi-modal foundation models (VLMs) [1]–[3], intelligent agent systems [4]–[7] driven by vision-language models (mobile agents [8]–[10]) have developed rapidly and are widely applied in critical scenarios such as mobile device operations, virtual…”
JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution
Zhang, G.-B., Lu, L., Xie, F.-Z., et al. (2026) · doi:10.48550/arxiv.2608.25593 · Cited by 16
Self-citationFALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided SearchPreprint
Rafi, M. N., Ahasanuzzaman, M., Kim, D. J., Wang, Z., & Chen, T.-H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.00765
“…prompt optimization [Khattab et al., 2023, Yuksekgonul et al., 2024], routing and model selection [Chen et al., 2025, Yue et al., 2025], adaptive interaction topologies [Zhuge et al., 2024], and workflow generation [Li et al., 2025a, Zhang et al., 2024, Hu et al., 2024, Zhang et al., 2025c,d].”
Synthesizing Multi-Agent Harnesses for Vulnerability Discovery
Liu, H., Shou, C.-F., Liu, X., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2604.20801 · Cited by 15
“MaAS [45] samples agent teams from a pre-defined pool but fixes how those agents communicate and hand off control.”
AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code GenerationPreprint
Wang, S., Lu, R., Yang, Z.-H., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2602.17100 · Cited by 15 · see citing works
Zhang, Y., Liu, X., Zhou, R., et al. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2505.19108 · Cited by 15
“Large language models (LLMs) have made significant progress in recent years (Meta, 2024; Qin et al., 2024; Wang et al., 2025), driving remarkable advancements across a wide range of diverse fields and applications (Wei et al., 2022; Zhang et al., 2025).”
The Illusion of Multi-Agent Advantage
Jwalapuram, P., Lin, H.-H., Li, C., Jiao, F., Wang, S., Ming, Y., Ke, Z.-X., Qin, C.-W., Carenini, G., & Joty, S. R. (2026) · arXiv.org · doi:10.48550/arxiv.2606.13003 · Cited by 15
“Frameworks like MaAS [40] occupy a middle ground; while the underlying operator distributions are pre-optimized, the system performs inference-time routing by sampling query-dependent architectures on the fly.”
InfluentialLatentMem: Customizing Latent Memory for Multi-Agent Systems
Fu, M., Zhang, G., Xue, X., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2602.03036 · Cited by 12
Self-citationGeoFlow: Agentic Workflow Automation for Geospatial Tasks
Bhattaram, A., Chung, J., Chung, S., et al. (2025) · SIGSPATIAL/GIS · doi:10.1145/3748636.3763217 · Cited by 12 · see citing works
“Novel techniques such as Flow [6], AFlow [14], AutoFlow [4], and MaaS [13] formulate agentic workflows as Activity-on-Vertex a r X i v : 2508 .”
Huang, Q.-H., Zhou, Z.-Q., Li, Y.-Z., et al. (2025) · Neural Information Processing Systems · doi:10.52202/085713-5550 · Cited by 12
“Crucially, Multi-Agent Systems allow individual agents to process information from distinct perspectives and coordinate their outputs to Yang Wang and Zhengyang Zhou are corresponding authors. achieve a common objective [74, 57].”
Chen, B.-Y., Wang, Z.-K., Yue, Z.-R., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2511.19524 · Cited by 11
“Second, RL-based paradigm train collaborative policies by optimizing agent behaviors [2, 3, 8, 39, 49, 60, 70, 84] or interaction architectures [46, 72, 73].”
Goal-Aware Identification and Rectification of Misinformation in Multi-Agent Systems
Li, Z.-R., Mi, Y., Zhou, Z.-H., Jiang, H.-C., Zhang, G.-M., Wang, K., & Fang, J.-F. (2025) · arXiv.org · doi:10.48550/arxiv.2506.00509 · Cited by 11
“Advanced agent architectures, like Chain-of-Thought (CoT) (Wei et al., 2023) and ReAct (Yao et al., 2023), enhance the internal decision-making processes by incorporating step-by-step reasoning and environment interaction capabilities (Zhang et al., 2025a, 2024c).”
Self-citationMetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning
Wang, Y., Zhao, J.-X., Xie, H., Ma, H., Lei, Y.-Z., Liu, S.-X., Song, X., Zhang, Z.-C., & Zhang, H.-R. (2026) · arXiv.org · doi:10.48550/arxiv.2601.19290 · Cited by 10
“Graph-structured formulations are a natural fit for multi-agent collaboration, as they explicitly model information dependencies and interaction constraints among agents [ Zhang et al. , 2025b ] .”
Automated Composition of Agents: A Knapsack Approach for Agentic Component Selection
Yuan, M., Pahwa, K., Chang, S.-C., et al. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2510.16499 · Cited by 10
“Multi-agent Architecture Search [39] optimizes an agentic supernet and then will sample a multi-agent architecture in a query-dependent manner.”
Shen, X., Zhang, Q., Wang, S., Tan, Z., Zhao, X.-Y., Yao, L., Tadiparthi, V., Mahjoub, H. N., Moradi-Pari, E., Lee, K., et al. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2510.14319 · Cited by 11
“Such systems demonstrated the potential of LLM-based collaboration but required extensive manual design effort, limiting scalability and adaptability (Zhang et al., 2025b).”
PowerChain: A verifiable agentic AI system for automating distribution grid analyses
Badmus, E. O., Sang, P., Stamoulis, D., et al. (2025) · Electric power systems research · doi:10.1016/j.epsr.2026.113555 · Cited by 10
Aime: Towards Fully-Autonomous Multi-Agent Framework
Shi, Y., Wang, M., Cao, Y., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2507.11988 · Cited by 10
“More advanced approaches such as Agentic Supernet (Zhang et al., 2025a) and FlowReasoner (Gao et al., 2025) even learn to generate these workflows from predefined agentic operators.”
Scaling Discovery through Test-Time Communication
Park, J., Kontonis, V., Garg, S., Krishnamurthy, A., & Papailiopoulos, D. (2026) · doi:10.48550/arxiv.2609.21032 · Cited by 10
“Agent graphs and communication links can be optimized directly (Zhuge et al., 2024; Zhang et al., 2025c), while architecture search can adapt the system to the task (Zhang et al., 2025b; Yun et al., 2026).”
AgentAsk: Multi-Agent Systems Need to Ask
Lin, B., Yang, K., Tan, Z.-L., et al. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2510.07593 · Cited by 9
“We reveal these errors through an audit of 824 execution logs, annotating each agent-to-agent message as the unit of analysis.”
Self-citationVideoAgent: All-in-One Framework for Video Understanding and Editing
Zhou, H., Huang, L., Wang, J., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.23327 · Cited by 8
Deng, S.-G., Zhao, H.-L., Wang, Z.-Q., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2509.24380 · Cited by 8
“Classical services are passive: invoked, executed, forgotten.”
Why Search When You Can Transfer? Amortized Agentic Workflow Design from Structural Priors
Du, S.-Y., Liu, J.-Y., Du, W., Huang, Y., Li, J.-Y., Luo, Y., Zhang, X.-L., Conitzer, V., & Kingsford, C. (2026) · arXiv.org · doi:10.48550/arxiv.2604.25012 · Cited by 7
“We compare SWIFT against: (1) Single-agent paradigms (e.g., CoT (Wei et al., 2022), SC (Wang et al., 2023)); (2) Hand-crafted multi-agent workflows (e.g., DyLAN (Liu et al., 2024), AgentVerse (Chen et al., 2024b)); and (3) Automated test-time search (e.g., AFlow (Zhang et al., 2025c), MaAS (Zhang et al., 2025a)).”
InfluentialWorkflow-R1: Group Sub-sequence Policy Optimization for Multi-turn Workflow Construction
Kong, M.-Z., Qu, Z.-K., Zhou, Z.-Q., Liang, P., Li, X., Shang, Z.-W., Hong, Z., Huang, K.-Y., Wang, Z.-Y., & Dai, Z.-X. (2026) · arXiv.org · doi:10.48550/arxiv.2602.01202 · Cited by 8
“In our reproduction, we follow their official implementations: MaAS employs GPT-4o-mini (Hurst et al., 2024) and AFlow employs Claude-3.”
InfluentialLiu, S., Yuan, X.-Y., Chen, T., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2601.19793 · Cited by 7
“Secondly, while recent architectural optimizations (e.g., Agentic Supernet) address system topology, they lack the granularity to dynamically adjust resource allocation at the individual step level based on real-time task difficulty.”
Wang, J.-B., Zhao, S.-D., Liu, J.-T., Wang, H., Li, W.-T., Qin, B., & Liu, T. (2026) · arXiv.org · doi:10.48550/arxiv.2601.04861 · Cited by 9
“Furthermore, orchestration and routing methods dynamically adjust agent roles and collaboration patterns based on the evolving task context (Dang et al., 2025; Zhang et al., 2025a; Wang et al., 2025b).”
Toward a Safe Internet of Agents
Wibowo, J., & Polyzos, G. C. (2025) · arXiv.org · doi:10.48550/arxiv.2512.00520 · Cited by 7
“Subsequent frameworks like AgentSquare , MASS , and MaAS refined this by utilizing verifiers or validation set performance to guide the sub-network selection process (Shang et al. 2025; G. Zhang, Niu, et al. 2025; Zhou et al. 2025).”
Compound AI Systems Optimization: A Survey of Methods, Challenges, and Future Directions
Lee, Y.-A., Yi, G., Liu, M., et al. (2025) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2506.08234 · Cited by 7
“Despite these risks, research on compound AI system optimization that extends beyond downstream performance has so far addressed mainly execution efficiency (Zhang et al., 2025), with little attention to system-level alignment or safety (Zheng et al., 2025).”
InfluentialTopological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems
Yang, J., Zhang, M., Jin, Y., Chen, H., Wen, Q.-S., Lin, L., He, Y., Kumar, S., Xu, W., Evans, J., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2505.22467 · Cited by 8
“Future work should explore task-oriented dynamic topology synthesis that can adapt during execution to unseen test instances or evolving task requirements.”
OmniQEC: discovering practical quantum error-correcting codes by an AI scientist
Yan, G., Li, S., Ma, P., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.25865 · Cited by 6
SKILL-DISCO: Distilling and Compiling Agent Traces into Reusable Procedural Skills
Guo, Z., Qi, D., Gu, H., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.26669 · Cited by 6
“At the system level, ADAS (Hu et al., 2024), AgentSquare (Shang et al., 2024), AFlow (Zhang et al., 2024), and MaAS (Zhang et al., 2025) automate agentic-system or workflow design.”
TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems
Xu, C.-D., Hu, Y.-C., Wang, R.-Z., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.09539 · Cited by 6
“…generator once, then sample (and freeze) a fresh graph for each query: ARG-Designer (Li et al., 2026) autoregressively emits a DAG; MaAS (Zhang et al., 2025a) samples from a learned agentic supernet; MetaAgent (Zhang et al., 2025c) predicts an FSM of agent transitions; SwarmAgentic…”
InfluentialAgent Q-Mix: Selecting the Right Action for LLM Multi-Agent Systems through Reinforcement Learning
Jiang, E., Li, L., Sun, R., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2604.00344 · Cited by 6
Inefficiencies of Meta Agents for Agent Design
El, B., Yuksekgonul, M., & Zou, J. (2025) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2025.findings-emnlp.1135 · Cited by 6
“Other recent meta-agent approaches include Multi-agent Supernet (Zhang et al., 2025a), Flow (Niu et al., 2025), and AFlow (Zhang et al., 2025b).”
Fang, J., Peng, Y., Zhang, X., Wang, Y., Yi, X., Zhang, G., Xu, Y., Wu, B., Liu, S., Li, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2508.07407 · Cited by 6 · see citing works
Self-citationDarwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025) · arXiv · doi:10.48550/arxiv.2505.22954 · Cited by 5 · see citing works
Song, W., Yue, J., & Pang, Z. (2026) · arXiv.org · doi:10.48550/arxiv.2603.22791 · Cited by 5 · see citing works
Zhou, Y.-J., Lu, X.-Y., Liu, D.-R., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2601.14667 · Cited by 5 · see citing works
“However, these methods are often ill-suited for dynamic MAS environments (Liu et al., 2025; Zhang et al., 2025) and struggle to mitigate active injection attacks (Amayuelas et al., 2024; Lee and Tiwari, 2024).”
Cai, S., Yansong, N. I. N. G., & Liu, H. (2025) · arXiv.org · doi:10.48550/arxiv.2512.11426 · Cited by 5
“Experiments demonstrate that AgentBalance achieves consistent performance gains across different token-cost and latency budgets in different regimes.”
MedDCR: Learning to Design Agentic Workflows for Medical Coding
Zheng, J., Nassar, I., Vu, T., Zhong, X., Lin, Y., Liu, T.-L., Duong, L., & Li, Y.-F. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2511.13361 · Cited by 5
“Others attempt to expand the search space to work-flows (Hu et al., 2025; Zhang et al., 2025a,b), where both the definition of workflow components and their topological organisation are jointly optimised, but in practice, many components remain fixed, making discovered agents less flexible.”
Automated Multi-Agent Workflows for RTL Design
Bhattaram, A., Ramamoorthy, J., Gupta, R., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2509.20182 · Cited by 5
“We employ a cascading controller [31] that selects increasingly complex operators at each stage, following At each stage c , the controller C computes a confidence score s c indicating whether to proceed to the next operator in the cascade.”
InfluentialAccelerating Prefilling for Long-Context LLMs via Sparse Pattern SharingPreprint
Peng, D., Fu, Z., Ye, Z., Song, Z., & Wang, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.19578
“1 and Gemini 1.5 (Team et al., 2024) now support contexts up to one million tokens, advancing multi-document QA (Wang et al., 2024), code understanding (Bairi et al., 2024; Ziftci et al., 2025), and multi-turn dialogue (Zhang et al., 2025).”
InfluentialParallelized Planning-Acting for Efficient LLM-based Multi-Agent Systems
Li, Y., Liu, S., Zheng, T.-Y., & Song, M.-L. (2025) · arXiv.org · doi:10.48550/arxiv.2503.03505 · Cited by 3
GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs
Xu, Z.-X., Wang, Y.-B., Wang, C., et al. (2026) · doi:10.48550/arxiv.2609.12265 · Cited by 4
StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems
Zhu, T., Wu, Y., Jin, W., Li, Y., & Huang, G. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817991
“To address these limitations, multi-agent systems (MAS) have emerged as a superior paradigm, enabling task decomposition through role specialization and adaptive communication architectures [6, 13, 23, 38, 44, 46].”
On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows
Wang, X.-L., Liu, Z.-S., Feng, S., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.06110 · Cited by 4
“…workflow programs using task feedback (Zhang et al., 2025c), while subsequent work explores multi-agent architecture search, communication topology design, dynamic agent elimination, workflow evolution, and preference-based workflow optimization (Zhang et al., 2025a,b; Wang et al., 2025g,e,f).”
Self-citationAgentic AI-Empowered Dynamic Survey Framework
Mumcu, F., Bekit, L., Jones, M. J., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2602.04071 · Cited by 4
“[26, 16, 35, 6] In parallel, recent studies emphasize the importance of small language models within agentic systems, advocating for collections of lightweight, task-specific agents rather than reliance on a single large model [2].”
Learning Latency-Aware Orchestration for Multi-Agent Systems
Shi, X., Zheng, M., & Lou, Q. (2026) · arXiv.org · doi:10.48550/arxiv.2607.13359 · Cited by 4
“LAMaS represents the orchestrator as a policy network over an agentic supernet —a probabilistic DAG over a fixed set of candidate operators O (a formulation also adopted by Zhang et al. [2025a]).”
InfluentialPASS: Probabilistic Agentic Supernet Sampling for Interpretable and Adaptive Chest X-Ray Reasoning
Feng, Y., Du, J.-Y., Hong, Y.-T., et al. (2025) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2508.10501 · Cited by 4
MasHost Builds It All: Autonomous Multi-Agent System Directed by Reinforcement Learning
Yang, K., Yang, X., Yu, L., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2506.08507 · Cited by 4
“Following the experimental settings adopted by most baselines [43, 41], we select GPT-4o-mini-0718 [22] as the LLM executor, which is accessed via APIs.”
InfluentialSelf-citationOMAC: A Holistic Optimization Framework for LLM-Based Multi-Agent Collaboration
Li, S.-J., Hasson, H., & Ghosh, J. (2025) · doi:10.48550/arxiv.2505.11765 · Cited by 4
“For example, in the MaAS implementation, the authors directly adopt well-optimized and near-optimal agent configurations from prior work like AgentCoder (Huang et al., 2023) and ReAct (Yao et al., 2023) as fixed functional components, and only optimize the collaboration structure.”
InfluentialGao, H.-A., Geng, J., Hua, W., Hu, M., Juan, X., Liu, H., Liu, S., Qiu, J., Qi, X., Wu, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.21046 · Cited by 3 · see citing works
Rethinking the Evaluation of Efficiency Methods for Multi-Agent Systems
Zhang, J.-M., Zhang, L.-X., Lu, P.-J., et al. (2026) · doi:10.48550/arxiv.2609.05933 · Cited by 3
“As recent MAS studies (Dang et al., 2025; Zhang et al., 2025a) increasingly scale to larger LLMs, more agents, and longer interactions, the high execution costs from LLM calls and inter-agent communication make system efficiency increasingly important.”
AutoRAS: Learning Robust Agentic Systems with Primitive Representations
Yue, Y., Zhu, X., Ma, Y., Nan, G.-S., Dou, Z., Shan, J., Guo, C.-Y., Zhang, J., Wang, H., & Zhang, J.-F. (2026) · arXiv.org · doi:10.48550/arxiv.2606.21445 · Cited by 3
“Inspired by prior textual feedback methods (Hao et al., 2025; Hu et al., 2024; Zhou et al., 2024; Zhang et al., 2025a), we distill each execution into a rationale ν ( X ) that summarizes robustness issues and safety needs, and treat it as a unified textual gradient in the prompt space.”
InfluentialFlowBank: Query-Adaptive Agentic Workflows Optimization through Precompute-and-ReusePreprint
Yuan, L., Deng, C., Yu, F., Chakraborty, S., Rostami, M., & Huang, F. (2026) · arXiv.org · doi:10.48550/arxiv.2606.11290 · Cited by 3 · see citing works
“For MaAS, we follow the default configuration reported in the original paper Zhang et al. (2025b), using a four-layer query-aware controller trained for four sampling repetitions and GPT-4o mini as the TextGrad-based prompt-refinement model.”
InfluentialEvolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems
Hao, Z.-Z., Wang, T., Dong, H., Liu, Z.-Y., Wang, H., Lin, X., Lin, Q., Wang, C., Dong, H.-D., & Chen, J.-W. (2026) · arXiv.org · doi:10.48550/arxiv.2605.29790 · Cited by 4
“…a meta-level optimizer to generate, search, or refine MAS configurations based on performance metrics (e.g., pass rates or final rewards) [28, 58, 78, 80, 87]; (2) Memorization-driven strategies, which directly store MAS trajectories or interaction fragments for subsequent retrieval [39, 43, 74].”
InfluentialRUMAD: Reinforcement-Unifying Multi-Agent Debate
Wang, C., Lin, H., Tang, H.-Z., et al. (2026) · Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/cbjo8409 · Cited by 3
“This challenge shares many similarities with recent research about automatic generation of agent workflows. such as MACNET [15], AFlow [24], and MaAS [23], which primarily focus on optimizing the static workflow or agentic pipeline.”
Socially-Weighted Alignment: A Game-Theoretic Framework for Multi-Agent LLM Systems
Mumcu, F., & Yilmaz, Y. (2026) · arXiv.org · doi:10.48550/arxiv.2602.14471 · Cited by 3
BayesFlow: A Probability Inference Framework for Meta-Agent Assisted Workflow Generation
Yuan, B., Zhou, Y., Xu, Z., Ramnath, K., Feng, A., & Srinivasan, B. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2601.22305 · Cited by 3
“We also compare against three automatic workflow generation baselines: ADAS, AFlow (Zhang et al., 2024a) and MaAS (Zhang et al., 2025).”
JudgeFlow: Agentic Workflow Optimization via Block JudgePreprint
Ma, Z., Zhao, Z., Hua, C.-B., Berto, F., & Park, J. (2026) · arXiv.org · doi:10.48550/arxiv.2601.07477 · Cited by 3 · see citing works
“Building on code-represented workflows, Zhang et al. (2025b) introduce operators as modular units that encapsulate common agentic actions and propose a Monte Carlo Tree Search (MCTS) framework that employs LLMs to iteratively optimize workflows using past experience.”
InfluentialComfySearch: Autonomous Exploration and Reasoning for ComfyUI Workflows
Su, J., Lan, Q.-Z., Wang, Z., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2601.04060 · Cited by 3
Searching Meta Reasoning Skeleton to Guide LLM Reasoning
Zhang, Z., Wang, Y.-Q., & Yao, Q.-M. (2025) · arXiv.org · doi:10.48550/arxiv.2510.04116 · Cited by 3
“In terms of inference, AutoMR is slightly slower than naive reasoning process based on GRPO-trained LLM and slightly faster than MaAS, while being substantially more efficient than Meta-Reasoner, which relies on additional LLM calls to summarize reasoning progress.”
InfluentialMAS2: Self-Generative, Self-Configuring, Self-Rectifying Multi-Agent Systems
Wang, K., Zhang, G.-M., Ye, M., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2509.24323 · Cited by 3
“The baselines against which we compare MAS 2 can be broadly grouped into three categories: ■ vanilla LLMs , where single models are directly evaluated, alongside prompting strategies such as CoT (Wei et al., 2023) and Self-Consistency (Wang et al., 2023a); ■ handcrafted multi-agent systems , including MedPrompt (Nori…”
InfluentialSelf-citationChen, S.-T., Zhao, Z., & Chen, J.-S. (2025) · doi:10.48550/arxiv.2507.17442 · Cited by 3
“Routing directs inputs or subtasks to specialized models or agents to achieve better accuracy and cost trade-offs than any single static pipeline [34].”
PowerChain: Automating Distribution Grid Analysis with Agentic AI Workflows
Badmus, E. O., Sang, P., Stamoulis, D., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2508.17094 · Cited by 3
Aegis: Automated Error Generation and Identification for Multi-Agent SystemsPreprint
Kong, F.-Q., Zhang, R., Yin, H.-X., Zhang, G., Zhang, X., Chen, Z., Zhang, Z., Zhang, X., Zhu, S.-C., & Feng, X. (2025) · arXiv.org · doi:10.48550/arxiv.2509.14295 · Cited by 2 · see citing works
Self-citationCandidate supply and answer selection shape the value of LLM judging in multi-agent systems
Ji, J.-H., Li, S.-J., Cheng, J.-B., She, Z.-Y., Yu, J.-T., & Yuan, Z. (2026) · arXiv.org · doi:10.48550/arxiv.2608.25937 · Cited by 2
“When agents repeat the same plausible error, voting can suppress a less frequent correct alternative ,22 .”
Liu, D., & Li, J. (2026) · doi:10.48550/arxiv.2608.26195 · Cited by 2
“MAST identifies membership mismatch through failure-trace patterns, and MaAS resolves it by making architecture a task-dependent supernet choice that pays full-team cost only when the task requires it [5, 79].”
The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy
Zhu, C.-Z., Tian, L., Tan, B.-H., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.11175 · Cited by 2
“…graph whose edges are tuned for the task [323], DyLAN activates and prunes agents according to their contribution [155], and the agentic supernet of MaAS allocates topology and compute as a function of query difficulty so that easy cases stay cheap and hard cases recruit more structure [299].”
- Authors
- Zhang, G., Niu, L., Fang, J., Wang, K., Bai, L., & Wang, X.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2502.04180
- OpenAlex
- W4407247211
- Cited by
- 0
- References
- 99
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- multi-agent systems, architecture search, large language models, tool calls, inference cost reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-24.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-24.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
