A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems

Probably not a substantial claim: may not pass S3 (load-bearing).

In settings where labelled data or ground-truth are unavailable, LLM-based evaluators are often employed to estimate performance.

“However, in settings where labelled data or ground-truth are unavailable, LLM-based evaluators are often employed to estimate performance (Yehudai et al., 2025).”

• cites Yehudai et al., 2025 sourceSupported

May combine two claims.

Tülu 3 applies reinforcement learning with verifiable rewards across mathematical and instruction-following tasks without any learned reward model.

“Tülu 3 (Lambert et al., 2024) applies reinforcement learning with verifiable rewards across mathematical and instruction-following tasks without any learned reward model.”

• cites Lambert et al., 2024 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Graph-of-Thoughts organises intermediate thoughts as nodes in a graph and applies graph-based operations to support flexible reasoning and information flow.

“Graph-of-Thoughts (Besta et al., 2024) organises intermediate thoughts as nodes in a graph and applies graph-based operations to support flexible reasoning and information flow.”

• cites Besta et al., 2024 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

GRIPS splits instructions into phrases and applies phrase-level edit operations: delete, swap, paraphrase, and addition, to progressively improve prompt quality.

“GRIPS (Prasad et al., 2023) splits instructions into phrases and applies phrase-level edit operations: delete, swap, paraphrase, and addition, to progressively improve prompt quality.”

• cites Prasad et al., 2023 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

A critical paradigm of long-term memory optimisation is Retrieval-Augmented Generation (RAG), which incorporates relevant external memory into the reasoning process via retrieval.

“A critical paradigm of long-term memory optimisation is Retrieval-Augmented Generation (RAG), which incorporates relevant external memory into the reasoning process via retrieval (Wang et al., 2023a; Efeoglu and Paschke, 2024; Gao et al., 2025c).”

• cites Wang et al., 2023aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Efeoglu and Paschke, 2024 sourcePartly supported

  The Introduction and §3.2 describe RAG retrieving relevant information from an embedding database and adding it to a prompt for the model. The paper does not characterize RAG as a paradigm of long-term memory optimisation; its focus is relation extraction. Page numbers are unavailable in our copy. (LLM, conf=0.87)

  Experimental — accuracy not yet measured
• cites Gao et al., 2025cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Text gradient-based prompt optimisation methods generate natural language feedback ('text gradient') that guides how a prompt should be updated to optimise a given objective.

“These methods draw inspiration from gradient-based learning in neural networks, but instead of computing numerical gradients over model parameters, they generate natural language feedback, which is referred to as 'text gradient', that guides how a prompt should be updated to optimise a given objective.”

• cites Pryzant et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Yuksekgonul et al., 2024 sourceSupported

May combine two claims.

TextGrad generalises the idea to a broader framework for compound AI systems, treating textual feedback as a form of 'automatic differentiation' and using LLM-generated suggestions to iteratively improve components such as prompts, code, or other symbolic variables.

“TextGrad (Yuksekgonul et al., 2024; Yüksekgönül et al., 2025) generalises this idea to a broader framework for compound AI systems. It treats textual feedback as a form of 'automatic differentiation' and uses LLM-generated suggestions to iteratively improve components such as prompts, code, or other symbolic variables.”

• cites Yuksekgonul et al., 2024 sourceSupported
• cites Yüksekgönül et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Recent studies demonstrate that LLM-based evaluations can correlate with human judgments, in some cases reaching parity with inter-annotator agreement levels.

“Recent studies demonstrate that LLM-based evaluations can correlate with human judgments, in some cases reaching parity with inter-annotator agreement levels (Arabzadeh et al., 2024).”

• cites Arabzadeh et al., 2024 sourcePartly supported

  The paper’s ‘Using LLMs as evaluators’ discussion describes LLMs being used alongside human evaluation, and its Conclusions describe them as a possible alternative for open-ended tasks (page numbers unavailable). These passages support the general connection between LLM-based and human evaluation, but the copy does not report a correlation with human judgments or parity with inter-annotator agreement. (LLM, conf=0.78)

  Experimental — accuracy not yet measured

May combine two claims.

LLM-based evaluation methods are sensitive to prompt design and susceptible to biases introduced by subtle instructional variations.

“However, these methods are sensitive to prompt design and susceptible to biases introduced by subtle instructional variations (Arabzadeh et al., 2024; Zhao et al., 2025b).”

• cites Arabzadeh et al., 2024 sourcePartly supported

  Section 6.1 (page unavailable) reports that changing the inputs used to generate evaluation criteria changes the criteria produced, and that the QuantifierAgent's results vary across runs for one criterion. This supports a narrower concern about evaluation stability, but the paper does not establish sensitivity to subtle instructional variations or bias caused by them. (LLM, conf=0.80)

  Experimental — accuracy not yet measured
• cites Zhao et al., 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Multi-agent finetuning enables role-specific specialisation of agents and improved reasoning capabilities of the underlying backbone model.

“multi-agent finetuning (Subramaniam et al., 2025) leverages high-quality cooperative trajectories sampled from multi-agent debates for supervised fine-tuning, enabling (1) role-specific specialisation of agents and (2) improved reasoning capabilities of the underlying backbone model.”

• cites Subramaniam et al., 2025 sourcePartly supported

  The ‘Iterations of finetuning’ section says the method trains models from the same base in distinct roles and reports gains on reasoning tasks. Section 2.2 and ‘Finetuning Generation Models’ describe selecting debate-generated responses for finetuning. The reported gains concern the independently finetuned agents and their system, not an improvement to the unchanged underlying base model itself; the paper also does not establish that the selected trajectories are uniformly high-quality. (LLM, conf=0.85)

  Experimental — accuracy not yet measured

May combine two claims.

Meta-evaluation approaches position LLM agents as evaluators or safety monitors, offering scalable oversight but exposing limitations of current risk awareness.

“Meta-evaluation approaches, e.g., Agent-as-a-Judge (Zhuge et al., 2024b), AgentEval (Arabzadeh et al., 2024), and R-Judge (Yuan et al., 2024b) - position LLM agents themselves as evaluators or safety monitors, offering scalable oversight but also exposing the limitations of current 'risk awareness.'”

• cites Zhuge et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Arabzadeh et al., 2024 sourcePartly supported

  The Introduction and Conclusions describe AgentEval as an LLM-agent framework for evaluating task utility at scale, supporting its identification as an evaluator. The paper’s robustness discussion concerns the reliability of evaluation criteria, not safety monitoring or limitations in agents’ “risk awareness.” No page numbers are provided in our copy. (LLM, conf=0.87)

  Experimental — accuracy not yet measured
• cites Yuan et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The optimised context has been shown to reduce computational overhead and improve tool-use efficiency.

“The optimised context has been shown to reduce computational overhead and improve tool-use efficiency, highlighting the importance of context design in effective inference-time tool optimisation.”

• cites Wu et al., 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Multi-layer aggregation further reduces error bounds and improves robustness.

“Multi-layer aggregation further reduces error bounds and improves robustness (Zhang et al., 2025d).”

• cites Zhang et al., 2025dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Confidence-gated debate strategies demonstrate that triggering multi-agent debates only when a single model exhibits low confidence can sharply reduce inference costs without hindering performance.

“In addition, confidence-gated debate strategies demonstrate that triggering multi-agent debates only when a single model exhibits low confidence can sharply reduce inference costs without hindering performance (Eo et al., 2025).”

• cites Eo et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Self-evolving AI agents bridge the static capabilities of foundation models with the continuous adaptability required by lifelong agentic systems.

“Self-evolving AI agents bridge the static capabilities of foundation models with the continuous adaptability required by lifelong agentic systems , offering a path toward more autonomous, resilient, and sustainable AI.”

May combine two claims.

Existing surveys on AI agents either focus on general introduction of agent architectures and functionalities, or target specific components such as planning, memory, collaboration mechanism, and evaluation, or investigate domain-specific applications.

“Existing surveys on AI agents either focus on the general introduction of agent architectures and functionalities (Wang et al., 2024c; Guo et al., 2024c; Xi et al., 2025; Luo et al., 2025a; Liu et al., 2025a,d), or target specific components such as planning (Huang et al., 2024b), memory (Zhang et al., 2024d), collaboration mechanism (Tran et al., 2025), and evaluation (Yehudai et al., 2025).”

• cites Wang et al., 2024c; Guo et al., 2024c; Xi et al., 2025; Luo et al., 2025a; Liu et al., 2025a,dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Huang et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Hu et al., 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

In most cases, evaluation metrics are task-specific, such as accuracy, F1, or success rate.

“In most cases, such metrics are task-specific, e.g., accuracy, F1, or success rate, which provide quantitative measures of performance.”

Probably not a substantial claim: may not pass S4 (based).

Most existing agent systems rely on manually crafted configurations that remain static after deployment, limiting their ability to adapt to dynamic and evolving environments.

“However, most existing agent systems rely on manually crafted configurations that remain static after deployment, limiting their ability to adapt to dynamic and evolving environments.”

• Also stated in: § 1 Introduction · p. 2 · plain

  “Despite the notable progress in agent systems, most of them, whether single- or multi-agent, continue to rely extensively on manually designed configurations. Once deployed, these systems typically maintain static architectures and fixed functionalities.”

Probably not a substantial claim: may not pass S3 (load-bearing).

As a concurrent work, Gao et al. (2025b) surveys self-evolving agents organised around three foundational dimensions: what to evolve, when to evolve, and how to evolve.

“As a concurrent work, Gao et al. (2025b) surveys self-evolving agents organised around three foundational dimensions: what to evolve, when to evolve, and how to evolve.”

• cites Gao et al. (2025b)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Current systems are still far from exhibiting the full capabilities required for safe, robust and open-ended self-evolution.

“Despite self-evolving AI agents representing an ambitious vision for future AI systems, achieving this level of autonomy remains a long-term goal. Current systems are still far from exhibiting the full capabilities required for safe, robust and open-ended self-evolution.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The trajectory from MOP through MOA and MAO has steadily reduced the degree of manual configuration in LLM-based systems.

“The trajectory from Model Offline Pretraining (MOP) through Model Online Adaptation (MOA) and MultiAgent Orchestration (MAO) has steadily reduced the degree of manual configuration in LLM-based systems.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Real-world environments are dynamic and continuously evolving, with user intents, task requirements, and external tools or information sources changing over time.

“However, real-world environments are dynamic and continuously evolving, e.g., user intents shift, task requirements change, and external tools or information sources may vary over time.”

Probably not a substantial claim: may not pass S4 (based).

The evolution from MOP to MASE represents a fundamental shift in the development of LLM-based systems, from static, manually configured architectures to adaptive, data-driven systems that can evolve in response to changing requirements and environments.

“The evolution from MOP to MASE represents a fundamental shift in the development of LLM-based systems, from static, manually configured architectures to adaptive, data-driven systems that can evolve in response to changing requirements and environments.”

May combine two claims.

Manually reconfiguring agent systems in dynamic environments is time-consuming, labour-intensive, and difficult to scale.

“In such settings, manually reconfiguring the agent system is time-consuming, labour-intensive, and difficult to scale.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The most common setting in existing research focuses on improving the agent system's overall performance on a specific task.

“The most common setting in existing research focuses on improving the agent system's overall performance on a specific task.”

Probably not a substantial claim: may not pass S4 (based).

Each paradigm (MOP, MOA, MAO, MASE) builds on the previous one, moving from a static, frozen foundation model to fully autonomous, self-evolving agentic systems.

“As summarised in Figure 1 and Table 1, each paradigm builds on the previous one, moving from a static, frozen foundation model to fully autonomous, self-evolving agentic systems.”

Classified as probably not a substantial claim.

Recent research has explored agent evolution techniques that aim to automatically enhance agent systems based on interaction data and environmental feedback.

“To address this limitation, recent research has explored agent evolution techniques that aim to automatically enhance agent systems based on interaction data and environmental feedback.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

This emerging direction lays the foundation for self-evolving AI agents, which bridge the static capabilities of foundation models with the continuous adaptability required by lifelong agentic systems.

“This emerging direction lays the foundation for self-evolving AI agents , which bridge the static capabilities of foundation models with the continuous adaptability required by lifelong agentic systems .”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The emergence of self-evolving AI agents is part of a broader paradigm shift in LLM-based systems from Model Offline Pretraining (MOP) and Model Online Adaptation (MOA) to Multi-Agent Orchestration (MAO) and Multi-Agent Self-Evolving (MASE).

“We characterise the emergence of self-evolving AI agents as part of a broader paradigm shift in the development of LLM-based systems. This shift spans from early-stage Model Offline Pretraining (MOP) and Model Online Adaptation (MOA), to more recent trends in Multi-Agent Orchestration (MAO), and ultimately, to Multi-Agent Self-Evolving (MASE).”

May combine two claims.

Recent advances in agent self-evolution and continual adaptation have not been sufficiently covered by existing surveys, leaving a critical gap in the literature for a holistic understanding of the new learning paradigm underpinning adaptive and self-evolving agentic systems.

“While these surveys provide valuable insights into various aspects of agent systems, recent advances in agent self-evolution and continual adaptation have not been sufficiently covered, which corresponds to the capabilities of agents that are central to the development of lifelong, autonomous AI systems. This leaves a critical gap in the literature for researchers and practitioners seeking a holis”

May combine two claims.

Liu et al. explore self-evolving training in the multimodal setting by introducing MSTAR, a framework that leverages RL to overcome performance saturation and enhance reasoning capabilities through iterative self-improvement.

“Liu et al. (2025e) further explore self-evolving training in the multimodal setting by introducing MSTAR, a framework that leverages RL to overcome performance saturation and enhance reasoning capabilities through iterative self-improvement.”

• cites Liu et al., 2025eNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Outcome-level feedback is relatively sparse, as it evaluates only the final output.

“However, this form of feedback is relatively sparse, as it evaluates only the final output.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Buffer-of-Thoughts introduces a dynamic memory buffer to store and instantiate meta-level thoughts during reasoning.

“Buffer-of-Thoughts (Yang et al., 2024c) introduces a dynamic memory buffer to store and instantiate meta-level thoughts during reasoning.”

• cites Yang et al., 2024cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Each setting (single-agent, multi-agent, domain-specific) exhibits distinct characteristics and challenges, leading to different designs and implementations of optimisers.

“Each setting exhibits distinct characteristics and challenges, leading to different designs and implementations of optimisers.”

Probably not a substantial claim: may not pass S4 (based).

For most tasks, ground-truth is not always available at inference time.

“However, for most tasks, ground-truth is not always available at inference time.”

May combine two claims.

CoRe and Tree-of-Thoughts explicitly model the reasoning process as a tree structure, using Monte Carlo Tree Search for a balance between exploration and exploitation during searching.

“CoRe (Zhu et al., 2023) and Tree-of-Thoughts (Yao et al., 2023a) explicitly model the reasoning process as a tree structure, using Monte Carlo Tree Search (MCST) for a balance between exploration and exploitation during searching.”

• cites Zhu et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Yao et al., 2023aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Domain-specific agent optimisation presents additional challenges, where optimisers must account for specialised requirements and constraints inherent to particular domains.

“Domain-specific agent optimisation presents additional challenges, where optimisers must account for specialised requirements and constraints inherent to particular domains, leading to tailored optimiser designs.”

Probably not a substantial claim: may not pass S3 (load-bearing).

TEMPERA frames the editing process as a reinforcement learning problem, training a policy model to perform different editing techniques to construct query-dependent prompts efficiently.

“TEMPERA (Zhang et al., 2023b) further frames the editing process as a reinforcement learning problem, training a policy model to perform different editing techniques to construct query-dependent prompts efficiently.”

• cites Zhang et al., 2023bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Multi-agent optimisation extends the scope to optimising not only individual agents but also their structural designs, communication protocols, and collaboration capabilities.

“In contrast, multi-agent optimisation extends the scope to optimising not only individual agents but also their structural designs, communication protocols, and collaboration capabilities.”

Probably not a substantial claim: may not pass S3 (load-bearing).

STaR proposes an iterative fine-tuning procedure, where the model is trained on instances it has solved correctly and refines incorrect traces to generate better trajectories.

“STaR (Zelikman et al., 2022) proposes an iterative fine-tuning procedure, where the model is trained on instances it has solved correctly and refines incorrect traces to generate better trajectories.”

• cites Zelikman et al., 2022Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Xin et al. extend the idea to enhance DeepSeek-Prover by incorporating reinforcement learning from proof assistant feedback.

“Building on this direction, Xin et al. (2025) extend the idea to enhance DeepSeek-Prover by incorporating reinforcement learning from proof assistant feedback.”

• cites Xin et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Plum extends GRIPS by incorporating metaheuristic strategies such as simulated annealing, mutation, and crossover.

“Plum (Pan et al., 2024a) extends GRIPS by incorporating metaheuristic strategies such as simulated annealing, mutation, and crossover.”

• cites Pan et al., 2024aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Forest-of-Thought generalises this idea by enabling multiple trees to make independent decisions and applying a sparse activation mechanism to filter and select outputs from the most relevant trees.

“Forest-of-Thought (Bi et al., 2025) further generalises this idea by enabling multiple trees to make independent decisions and applying a sparse activation mechanism to filter and select outputs from the most relevant trees.”

• cites Bi et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

CoT-SC adopts a best-of-N approach: it generates multiple reasoning paths and selects the final answer based on the majority vote over outcomes.

“CoT-SC (Wang et al., 2023b) adopts a best-of-N approach: it generates multiple reasoning paths and selects the final answer based on the majority vote over outcomes.”

• cites Wang et al., 2023bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

By increasing the inference budget, models are able to 'think longer'.

“By increasing the inference budget, models are able to 'think longer'.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

In single-agent optimisation, the focus is on improving an individual agent's performance by tuning LLM parameters, prompts, memory mechanisms, or tool-use policies.

“In single-agent optimisation, the focus is on improving an individual agent's performance by tuning LLM parameters, prompts, memory mechanisms, or tool-use policies.”

May combine two claims.

Absolute Zero trains a single model that alternates between task proposer and solver roles, self-evolving by generating and solving its own problems.

“Absolute Zero (Zhao et al., 2025a) trains a single model that alternates between task proposer and solver roles, self-evolving by generating and solving its own problems.”

• cites Zhao et al., 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The feedback-based and search-based approaches to test-time scaling are closely related; feedback used to guide generation can serve as a verifier.

“Notably, these two approaches are in fact closely related. The feedback used to guide generation in the former can naturally serve as a verifier in the latter.”

Probably not a substantial claim: may not pass S4 (based).

Complex reasoning tasks often admit multiple valid paths leading to the correct solution.

“Complex reasoning tasks often admit multiple valid paths leading to the correct solution.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Generative prompt optimisation approaches leverage LLMs to iteratively generate entirely new prompts, conditioned on a base prompt and various optimisation signals.

“generative approaches leverage LLMs to iteratively generate entirely new prompts, conditioned on a base prompt and various optimisation signals.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

External memory can be either unstructured or organised into structured formats such as tuples, databases, or knowledge graphs, and may span a wide range of sources and modalities.

“External memory can be either unstructured or organised into structured formats such as tuples, databases, or knowledge graphs (Zeng et al., 2024b), and may span a wide range of sources and modalities.”

• cites Zeng et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

These methods significantly improve local coherence and context efficiency.

“These methods significantly improve local coherence and context efficiency.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Common strategies for short-term memory optimisation encompass summarisation, selective retention, sparse attention, and dynamic context filtering.

“Common strategies encompass summarisation, selective retention, sparse attention, and dynamic context filtering.”

Probably not a substantial claim: may not pass S3 (load-bearing).

MIPRO employs Bayesian optimisation to efficiently search for the optimal combination of instruction candidates and few-shot demonstrations.

“MIPRO (Opsahl-Ong et al., 2024) employs Bayesian optimisation to efficiently search for the optimal combination of instruction candidates and few-shot demonstrations.”

• cites Opsahl-Ong et al., 2024 sourceNot checked yet

  Checked before — its earlier verdict is held back until a new check runs.

Probably not a substantial claim: may not pass S3 (load-bearing).

StraGo leverages insights from both successful and failure cases to identify critical factors for obtaining high-quality prompts.

“StraGo (Wu et al., 2024b) leverages insights from both successful and failure cases to identify critical factors for obtaining high-quality prompts.”

• cites Wu et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Zhou et al. propose agent symbolic learning, a data-centric framework that models language agents as symbolic networks and enables them to autonomously optimise their prompts, tools, and workflows via symbolic analogues of back-propagation and gradient descent.

“Another work (Zhou et al., 2024c) proposes agent symbolic learning, a data-centric framework that models language agents as symbolic networks and enables them to autonomously optimise their prompts, tools, and workflows via symbolic analogues of back-propagation and gradient descent.”

• cites Zhou et al., 2024cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Short-term memory alone is insufficient for retaining knowledge across sessions or enabling generalisation over long horizons.

“However, short-term memory alone is insufficient for retaining knowledge across sessions or enabling generalisation over long horizons, highlighting the need for complementary long-term memory mechanisms.”

May combine two claims.

AI agents frequently face limitations arising from constrained context windows and forgetting, which can result in phenomena such as context drift and hallucination.

“AI agents frequently face limitations arising from constrained context windows and forgetting, which can result in phenomena such as context drift and hallucination (Liu et al., 2024b; Zhang et al., 2024c,d).”

• cites Liu et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Zhang et al., 2024c,dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

PromptAgent formulates prompt optimisation as a strategic planning problem and leverages MCTS to efficiently navigate the expert-level prompt space.

“PromptAgent (Wang et al., 2024i) formulates prompt optimisation as a strategic planning problem and leverages MCTS to efficiently navigate the expert-level prompt space.”

• cites Wang et al., 2024iNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Wu et al. explore prompt optimisation in compound AI systems, where the goal is to automatically optimise the configuration across a heterogeneous set of components and parameters.

“Recent work (Wu et al., 2025c) also explores the prompt optimisation in compound AI systems, where its goal is to automatically optimise the configuration across a heterogeneous set of components and parameters, e.g., model parameters, prompts, model selection choice, and hyperparameters.”

• cites Wu et al., 2025cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The structure and encoding of memory itself significantly affect system performance.

“In addition to retrieval policies and memory control mechanisms, the structure and encoding of memory itself significantly affect system performance.”

May combine two claims.

Another prominent direction in long-term memory optimisation involves agentic retrieval, where agents autonomously determine when and what to retrieve, alongside trajectory-level memory.

“Another prominent direction involves agentic retrieval, where agents autonomously determine when and what to retrieve, alongside trajectory-level memory, which utilises past interactions to inform future behaviour.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Retroformer trains a policy model to iteratively refine prompts by summarising the root cause of previous failed cases.

“Retroformer (Yao et al., 2024) trains a policy model to iteratively refine prompts by summarising the root cause of previous failed cases.”

• cites Yao et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Inference-time memory approaches dynamically decide what to retain, retrieve, and discard during the reasoning process.

“inference-time approaches dynamically decide what to retain, retrieve, and discard during the reasoning process.”

May combine two claims.

These approaches allow agents to proactively manage memory and complement short-term mechanisms.

“These approaches allow agents to proactively manage memory and complement short-term mechanisms.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Recent work has emphasised the importance of memory control mechanisms during inference, which determine what, when, and how to store, update, or discard memory.

“Recent work has also emphasised the importance of memory control mechanisms during inference (Zou et al., 2024; Chen et al., 2025d), which determine what, when, and how to store, update, or discard memory (Jin et al., 2025).”

• cites Zou et al., 2024 sourceNot checked — no full text of the source
• cites Chen et al., 2025dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Jin et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Compared to local edits, generative methods can explore a broader region of the prompt space and produce more diverse and semantically rich candidates.

“Compared to local edits, generative methods can explore a broader region of the prompt space and produce more diverse and semantically rich candidates.”

Probably not a substantial claim: may not pass S3 (load-bearing).

EvoPrompt leverages Genetic Algorithm and Differential Evolution to guide the optimisation process to find high-performing prompts.

“EvoPrompt (Guo et al., 2024b) leverages two widely used evolutionary algorithms: Genetic Algorithm (GA) and Differential Evolution (DE), to guide the optimisation process to find the high-performing prompts.”

• cites Guo et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

ORPO generates new instructions by prompting the LLM with previously generated candidates and their evaluation scores.

“ORPO (Yang et al., 2024a) generates new instructions by prompting the LLM with previously generated candidates and their evaluation scores.”

• cites Yang et al., 2024aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Various techniques have been proposed to compress, summarise, or selectively retain key information.

“To address this, various techniques have been proposed to compress, summarise, or selectively retain key information (Zhang et al., 2024d; Wang et al., 2025d).”

• cites Zhang et al., 2024dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Wang et al., 2025dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• AssumptionRests on an assumption: As context expands, memory demands increase significantly, making it impractical to retain all information within a fixed context window.

Probably not a substantial claim: may not pass S3 (load-bearing).

Short-term memory optimisation focuses on managing limited contextual information within the LLM's working memory.

“Short-term memory optimisation focuses on managing limited contextual information within the LLM's working memory (Liu et al., 2024b).”

• cites Liu et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable).

There is a need for complementary long-term memory mechanisms.

“However, short-term memory alone is insufficient for retaining knowledge across sessions or enabling generalisation over long horizons, highlighting the need for complementary long-term memory mechanisms.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A key objective in long-term memory optimisation is to manage increasingly complex and expanding memory spaces while preserving a clear separation between memory storage and the reasoning process.

“A key objective in this area is to manage increasingly complex and expanding memory spaces while preserving a clear separation between memory storage and the reasoning process (Zhang et al., 2024d).”

• cites Zhang et al., 2024dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

ProTeGi generates text gradients by criticising the current prompt and edits the prompt in the opposite semantic direction of the gradient.

“ProTeGi (Pryzant et al., 2023) generates text gradients by criticising the current prompt. Subsequently, it edits the prompt in the opposite semantic direction of the gradient.”

• cites Pryzant et al., 2023 sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

Evolutionary algorithms have been explored as a flexible and effective approach for prompt optimisation.

“evolutionary algorithms have also been explored as a flexible and effective approach for prompt optimisation (Guo et al., 2024b; Fernando et al., 2024).”

• cites Guo et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Fernando et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Recent approaches explore these spaces using a range of optimisation techniques, each offering different trade-offs.

“Recent approaches explore these spaces using a range of optimisation techniques, from evolutionary algorithms to reinforcement learning, each offering different trade-offs in balancing multiple optimisation targets (e.g., accuracy, efficiency, and safety).”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

While computational throughput scales horizontally, the engineering costs of managing coordination and consistency grow exponentially.

“However, while computational throughput scales horizontally, the engineering costs of managing coordination and consistency grow exponentially.”

Probably not a substantial claim: may not pass S3 (load-bearing).

To balance accuracy with interpretability, researchers have developed the debate paradigm.

“To balance accuracy with interpretability, researchers have developed the debate paradigm, where agents engage in adversarial-negotiation-arbitration cycles to discuss and correct reasoning errors.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

These architectures encode researchers' insights about task decomposition, agent capabilities, and coordination mechanisms into explicit interaction patterns.

“These architectures encode researchers' insights about task decomposition, agent capabilities, and coordination mechanisms into explicit interaction patterns.”

Classified as probably not a substantial claim. May combine two claims.

Effective tool use requires the agent to recognise when and how to invoke the right tools, interpret tool outputs, and integrate them into multi-step reasoning.

“Effective tool use requires the agent to recognise when and how to invoke the right tools, interpret tool outputs, and integrate them into multi-step reasoning.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The simplest form of parallel workflows involves multiple independent agents generating solutions in parallel, followed by majority voting.

“The simplest form involves multiple independent agents generating solutions in parallel, followed by majority voting to select the final output.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Another line of work focuses on enhancing tool-use capabilities during inference, without modifying LLM parameters.

“In addition to training-based approaches, another line of work focuses on enhancing tool-use capabilities during inference, without modifying LLM parameters.”

Probably not a substantial claim: may not pass S3 (load-bearing).

This evolution reframes workflow design as a search problem over three interconnected spaces: structural, semantic, and capability.

“This evolution reframes workflow design as a search problem over three interconnected spaces: the structural space of possible agent topologies, the semantic space of agent roles and instructions, and the capability space of LLM backbones.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Tool-related information is typically provided to agents through tool documentation within prompts.

“Tool-related information is typically provided to agents through tool documentation within prompts.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Early work explored symmetric debater mechanisms.

“Early work explored symmetric debater mechanisms (Li et al., 2024g).”

• cites Li et al., 2024gNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Inference-time tool optimisation methods typically operate by optimising tool-related contextual information within prompts or guiding the agent's decision-making process through structured reasoning at test time.

“These methods typically operate by optimising tool-related contextual information within prompts or guiding the agent's decision-making process through structured reasoning at test time.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The system decomposes tasks across layers, with each layer responsible for different subtasks.

“The system decomposes tasks across layers, with each layer responsible for different subtasks.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The field has witnessed a fundamental shift from manually designed agent architectures to self-evolving systems that automatically discover effective collaboration strategies.

“The field has witnessed a fundamental shift: from manually designed agent architectures, where researchers explicitly specify collaboration patterns and communication protocols, to self-evolving systems that automatically discover effective collaboration strategies.”

Classified as probably not a substantial claim.

Training-based methods aim to address this limitation by explicitly teaching the LLMs how to interact with tools, thereby embedding tool-use capabilities directly into the agent's internal policy.

“Training-based methods aim to address this limitation by explicitly teaching the LLMs how to interact with tools, thereby embedding tool-use capabilities directly into the agent's internal policy.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Hierarchical frameworks organise agents into multi-level top-down structures or sequential pipelines.

“These frameworks organise agents into multi-level top-down structures or sequential pipelines.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Training-based tool optimisation aims to enhance an agent's ability to use tools by updating the underlying LLM's parameters through learning.

“Training-based tool optimisation aims to enhance an agent's ability to use tools by updating the underlying LLM's parameters through learning.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

LLMs are pretrained purely on text generation tasks, without any exposure to tool usage or interactive execution.

“The motivation behind this approach stems from the fact that LLMs are pretrained purely on text generation tasks, without any exposure to tool usage or interactive execution.”

Probably not a substantial claim: may not pass S3 (load-bearing).

There are two major directions within inference-time tool optimisation: prompt-based methods and reasoning-based methods.

“There are two major directions within this paradigm: (1) prompt-based methods , which refine the representation of tool documentation or instructions to facilitate better understanding and utilisation of tools; (2) reasoning-based methods , which leverage test-time reasoning strategies, such as MCTS and other tree-based algorithms to enable more effective exploration and selection of tools during”

Probably not a substantial claim: may not pass S3 (load-bearing).

These approaches aim to extend the agent's action space by adapting the toolset to the task, rather than adapting the task to a fixed toolset.

“Inspired by the human practice of continuously developing tools to meet task requirements, these approaches aim to extend the agent's action space by adapting the toolset to the task, rather than adapting the task to a fixed toolset (Wang et al., 2024k).”

• cites Wang et al., 2024kNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Recent efforts have focused on optimising how tool documentation is presented.

“Recent efforts have focused on optimising how this documentation is presented, either by restructuring source documents or refining them through interactive feedback (Qu et al., 2025).”

• cites Qu et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Once tool-use trajectories are collected, they are used to fine-tune the LLM through standard language modelling objectives.

“Once the tool-use trajectories are collected, they are used to fine-tune the LLM through standard language modelling objectives, enabling the model to learn successful patterns of tool invocation and integration.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Recent research has focused on tool optimisation, which aims to enhance the agent's ability to use tools intelligently and efficiently.

“Consequently, recent research has focused on tool optimisation, which aims to enhance the agent's ability to use tools intelligently and efficiently.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

A well-crafted prompt cannot function effectively in a poor communication structure, while an elegant topology yields little benefit with poorly instructed agents.

“A well-crafted prompt cannot function effectively in a poor communication structure, while an elegant topology yields little benefit with poorly instructed agents.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

Rule grounding, modular role design, and collaborative reasoning are important in the development of robust, transparent, and legally reliable agent systems.

“These approaches highlight the importance of rule grounding, modular role design, and collaborative reasoning in the development of robust, transparent, and legally reliable agent systems.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Topology optimisation represents a paradigm shift in multi-agent system design: it recognises topology itself as a powerful optimisation target.

“Topology optimisation represents a paradigm shift in multi-agent system design: rather than treating communication structure as a fixed constraint, it recognises topology itself as a powerful optimisation target.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Various search algorithms have been introduced to navigate the search space.

“To effectively navigate the search space, various search algorithms have been introduced.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Early studies have shown that agents often overfit to specific tool schemas, exhibiting limited generalisation to previously unseen APIs.

“Early studies have shown that agents often overfit to specific tool schemas, exhibiting limited generalisation to previously unseen APIs.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Structured search-based approaches trade some flexibility for more targeted optimisation strategies.

“These structured approaches trade some flexibility for more targeted optimisation strategies.”

May combine two claims.

OPTIMA reports a 2.8× performance gain with less than 10% of the token cost on tasks demanding intensive information exchange.

“It reports a 2.8× performance gain with less than 10% of the token cost on tasks demanding intensive information exchange, which vividly demonstrates the promising potential of scaling agents' collaborative capabilities.”

• cites Chen et al., 2025hNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Iterative feedback, modular design, and interactive reasoning are essential principles for building adaptive agent-based systems for code refinement.

“These developments highlight iterative feedback, modular design, and interactive reasoning as essential principles for building adaptive agent-based systems for code refinement.”

May combine two claims.

MaAS achieves superior performance with dramatically reduced inference costs.

“Its controller network samples query-specific architectures with Monte Carlo and textual gradient optimisation, achieving superior performance with dramatically reduced inference costs.”

• cites Zhang et al., 2025fNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

These methods provide early evidence of the potential for self-improvement in multi-agent systems, though they are primarily applied in relatively simple settings.

“These methods provide early evidence of the potential for self-improvement in multi-agent systems, though they are primarily applied in relatively simple settings ( e.g. , multi-agent debate or 'generator-verifier-answerer' system).”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Despite advances in domain-specific benchmarks, inconsistencies in metric definitions and persistent gaps in generalisation remain significant challenges.

“Despite these advances, inconsistencies in metric definitions and persistent gaps in generalisation remain significant challenges.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The diversity of GUI environments makes standardisation and reproducibility difficult, and agents remain brittle when faced with interface variability.

“However, the diversity of GUI environments makes standardisation and reproducibility difficult, and agents remain brittle when faced with interface variability.”

Probably not a substantial claim: may not pass S3 (load-bearing).

One promising direction for achieving self-evolution is through prompt optimisation.

“One promising direction for achieving such self-evolution is through prompt optimisation, where prompts define both agent roles and their corresponding task instructions.”

Probably not a substantial claim: may not pass S4 (based).

The high engineering costs and limited adaptability of manually designed multi-agent workflows have motivated a shift towards automated, self-evolving systems.

“The high engineering costs and limited adaptability of manually designed multi-agent workflows have motivated a shift towards automated, self-evolving systems.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Multi-agent and generalist evaluations highlight challenges in aggregating metrics across heterogeneous tasks, risks of overfitting to narrow scenarios, and the need for unified, holistic leaderboards.

“These evaluations highlight challenges in aggregating metrics across heterogeneous tasks, risks of overfitting to narrow scenarios, and the need for unified, holistic leaderboards.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Each approach tackles the joint optimisation challenge from a unique angle, revealing different trade-offs between efficiency and performance.

“Each approach tackles the joint optimisation challenge from a unique angle, revealing different trade-offs between efficiency and performance.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Existing work on topology optimisation clusters into two complementary families: program/code-level workflow topologies and communication-graph topologies.

“Viewed through a representation-centred lens, existing work clusters into two complementary families: program/code-level workflow topologies and communication-graph topologies; this classification foregrounds what is being optimised-the chosen representation of topology.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The search space spans multiple levels, from local prompts to global topology structures.

“The search space spans multiple levels, from local prompts to global topology structures.”

May combine two claims.

Self-feedback approaches eliminate the need for task-specific retraining, providing consistent improvements in code quality.

“These approaches eliminate the need for task-specific retraining, providing consistent improvements in code quality.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The medium (topology) matters as much as the message (prompts).

“This marks not just technical progress but a conceptual shift-the medium (topology) matters as much as the message (prompts).”

Probably not a substantial claim: may not pass S3 (load-bearing).

ANN enables post-training adaptation to novel tasks.

“This approach jointly evolves agent roles, prompts, and inter-layer topologies, enabling post-training adaptation to novel tasks.”

• cites Ma et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Communication-graph topologies treat the workflow as a multi-agent communication graph whose connections are the optimisation target.

“Unlike code-level programs, this line treats the workflow as a multi-agent communication graph whose connections are the optimisation target (Liu et al., 2025i).”

• cites Liu et al., 2025iNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Prompt optimisation in multi-agent workflows often builds upon single-agent techniques but extends them to coordinate multiple agents and task dependencies.

“In fact, prompt optimisation in multi-agent workflows often builds upon the single-agent techniques discussed in Section 4.2, but extends them to coordinate multiple agents and task dependencies.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Even the best prompts cannot compensate for poor architectural choices.

“This insight emerged from a fundamental observation-even the best prompts cannot compensate for poor architectural choices.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Specialisation, multimodality, and interactive reasoning are key principles for developing agent-based systems in medical diagnosis.

“These approaches highlight specialisation, multimodality, and interactive reasoning as key principles for developing agent-based systems in medical diagnosis.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

As search capabilities advance, the core challenge shifts from finding optimal solutions to defining what optimality means in dynamic multi-agent contexts.

“This evolution reveals that as search capabilities advance, the core challenge shifts from finding optimal solutions to defining what optimality means in dynamic multi-agent contexts.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Large-scale multi-agent optimisation improves task performance but incurs significant computational cost, latency, and instability.

“Large-scale multi-agent optimisation improves task performance but incurs significant computational cost, latency, and instability.”

Probably not a substantial claim: may not pass S3 (load-bearing).

MACHIAVELLI explores whether agents develop unethical, power-seeking strategies under reward optimisation.

“Behavioural probes like MACHIAVELLI (Pan et al., 2023) explore whether agents develop unethical, power-seeking strategies under reward optimisation”

• cites Pan et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Safety is multi-dimensional, and accuracy alone is insufficient for evaluating it.

“These studies underline the multi-dimensional nature of safety, where accuracy alone is insufficient”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Stability is central to safety: even small perturbations in inputs or update rules can undermine the trustworthiness of an evolving workflow.

“Stability is central to safety: even small perturbations in inputs or update rules can undermine the trustworthiness of an evolving workflow.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Learned reward models for intermediate reasoning steps often suffer from dataset scarcity, noisy supervision, and feedback inconsistency, leading to unstable or divergent agent behaviours.

“Learned reward models for intermediate reasoning steps often suffer from dataset scarcity, noisy supervision, and feedback inconsistency, leading to unstable or divergent agent behaviours.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

In domains like biomedicine or law, reliable ground truth is often absent or disputed, complicating the construction of trustworthy feedback signals for optimisation.

“In domains like biomedicine or law, reliable ground truth is often absent or disputed, complicating the construction of trustworthy feedback signals for optimisation.”

Classified as probably not a substantial claim.

For lifelong, self-evolving agentic systems, safety is an ongoing requirement rather than a one-off certification.

“For lifelong, self-evolving agentic systems, safety is not a one-off certification but an ongoing requirement: every evolution step, from prompt updates to topology changes, must be assessed for unintended or malicious behaviours.”

Probably not a substantial claim: may not pass S3 (load-bearing).

AgentHarm measures an agent's propensity to comply with explicitly malicious multi-step requests requiring coherent tool use to execute harmful objectives such as fraud or cybercrime.

“Risk-focused benchmarks such as AgentHarm (Andriushchenko et al., 2025) measure an agent's propensity to comply with explicitly malicious multi-step requests-requiring coherent tool use to execute harmful objectives such as fraud or cybercrime”

• cites Andriushchenko et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Most optimisation pipelines prioritise task metrics over safety constraints, neglecting risks such as unintended behaviours, privacy breaches, and misaligned objectives.

“Most optimisation pipelines prioritise task metrics over safety constraints, neglecting risks such as unintended behaviours, privacy breaches, and misaligned objectives.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Optimised prompts or agent topologies are often brittle, showing poor generalisation across LLM backbones with differing reasoning abilities.

“Optimised prompts or agent topologies are often brittle, showing poor generalisation across LLM backbones with differing reasoning abilities.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Safe adaptation must not degrade core task competence.

“highlighting the interplay between Endure and Excel , safe adaptation must not degrade core task competence.”

Probably not a substantial claim: may not pass S2 (checkable).

For MASE systems, safety evaluation must become dynamic, continuously monitoring, diagnosing, and correcting behaviours as the system evolves.

“For MASE systems, safety evaluation must itself become dynamic - continuously monitoring, diagnosing, and correcting behaviours as the system evolves.”

Probably not a substantial claim: may not pass S4 (based).

Current methods typically assume a fixed toolset, overlooking the autonomous discovery, adaptation, and co-evolution of tools alongside agents.

“Current methods typically assume a fixed toolset, overlooking the autonomous discovery, adaptation, and co-evolution of tools alongside agents.”

May combine two claims.

Implementing the Agent-as-a-Judge methodology introduces additional complexity and raises challenges for generalisation to domains other than code generation.

“Nevertheless, implementing the Agent-as-a-Judge methodology introduces additional complexity and raises challenges for generalisation to domains other than code generation.”

May combine two claims.

RedCode and MobileSafetyBench stress-test agents in realistic, sandboxed environments for code security and mobile control respectively.

“Domain-specific probes such as RedCode (Guo et al., 2024a) (code security) and MobileSafetyBench (Lee et al., 2024c) (mobile control) stress-test agents in realistic, sandboxed environments.”

• cites Guo et al., 2024aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Lee et al., 2024cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

In the context of the Three Laws of Self-Evolving AI Agents, Endure, the maintenance of safety and stability during any modification, forms the primary constraint on all other forms of adaptation.

“In the context of the Three Laws of Self-Evolving AI Agents , Endure , the maintenance of safety and stability during any modification, forms the primary constraint on all other forms of adaptation.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Most optimisation algorithms are text-only, yet real-world agents must process multimodal inputs and reason in spatially grounded or continuous environments.

“Most optimisation algorithms are text-only, yet realworld agents must process multimodal inputs and reason in spatially grounded or continuous environments.”

Probably not a substantial claim: may not pass S4 (based).

The dynamic nature of evolving agents undermines existing legal frameworks (e.g., EU AI Act, GDPR), which assume static models and fixed decision logic.

“The dynamic nature of evolving agents undermines existing legal frameworks (e.g., EU AI Act, GDPR), which assume static models and fixed decision logic.”