ADIAS: Automated Design of Interactive Agentic Systems

Probably not a substantial claim: may not pass S3 (load-bearing).

Architecture-level methods search over predefined workflows, module compositions, or structured harness primitives.

“Architecture-level methods search over predefined workflows, module compositions, or structured harness primitives (Li et al., 2024;Zhang et al., 2025c;Zhuge et al., 2024;Shang et al., 2025;Chen et al., 2026).”

• cites Li et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Zhang et al., 2025cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Zhuge et al., 2024 sourceSupported

May combine two claims.

Reflection and experiential-learning methods retain lessons or heuristics derived from previous trajectories, while systems such as ACE and SkillOpt maintain editable playbooks or skill documents.

“Reflection and experiential-learning methods retain lessons or heuristics derived from previous trajectories, while systems such as ACE and SkillOpt maintain editable playbooks or skill documents (Shinn et al., 2023;Zhao et al., 2024;Zhang et al., 2026c;Yang et al., 2026).”

• cites Shinn et al., 2023 sourceSupported
• cites Zhao et al., 2024 sourceSupported
• cites Zhang et al., 2026cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

GRASP applies regression-aware acceptance to edits of a bounded skill library, while SKILL.nb uses lifecycle governance and validation gates to improve the durability of reusable workflows.

“GRASP (Moll et al., 2026) applies regression-aware acceptance to edits of a bounded skill library, while SKILL.nb(Hattami et al., 2026) uses lifecycle governance and validation gates to improve the durability of reusable workflows.”

• cites Moll et al., 2026 sourceSupported
• cites Hattami et al., 2026 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

Full-code methods directly generate or modify executable agent implementations, using iterative archives, evolutionary exploration, self-modification, or test-time feedback.

“Full-code methods directly generate or modify executable agent implementations, using iterative archives, evolutionary exploration, self-modification, or test-time feedback (Hu et al., 2025;Zhang et al., 2025b;Wang et al., 2025;Lee et al., 2026;Lou et al., 2026;Cai et al., 2026;Nie et al., 2026).”

• cites Hu et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Zhang et al., 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Wang et al., 2025 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

Prompt-level methods optimize instructions or textual modules.

“Prompt-level methods optimize instructions or textual modules (Zhou et al., 2022;Pryzant et al., 2023;Yang et al., 2024;Agrawal et al., 2026;Khattab et al., 2024).”

• cites Zhou et al., 2022 sourceSupported
• cites Pryzant et al., 2023 sourceSupported
• cites Yang et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Optimization typically returns to a high-scoring candidate or continues from the latest accepted one, and then attempts to summarize a new improvement direction from the surrounding archive, similar to the anchoring mechanism in Lee et al. (2026).

“We observe a similar anchoring mechanism as shown in Lee et al. (2026): optimization typically returns to a high-scoring candidate or continues from the latest accepted one, and then attempts to summarize a new improvement direction from the surrounding archive.”

• cites Lee et al. (2026) sourcePartly supported

  Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

  Experimental — accuracy not yet measured

May combine two claims.

Removing persistent issue state or replacing issue-centric revision with candidate-centric policies leads to performance drops of up to 40.7%.

“Controlled ablations further show that removing persistent issue state or replacing issue-centric revision with candidate-centric policies leads to performance drops of up to 40.7%.”

• Also stated in: § 1 INTRODUCTION · plain

  “Controlled ablations further illustrate the importance of issue-centric optimization: removing the persistent issue state or replacing issue-guided revision with candidate-centric policies results in performance drops of up to 40.7%.”

May combine two claims.

ADIAS benefits from three coupled properties: informative evidence, a durable issue-level representation, and the use of that representation as an optimization control state.

“We show that ADIAS benefits from three coupled properties: informative evidence, a durable issue-level representation, and the use of that representation as an optimization control state.”

May combine two claims.

Scores of ADIAS on Tau-Bench, ALFWorld, TextCraft, WebShop, and ScienceWorld are 81.3, 94.0, 91.0, 69.4, and 56.3, respectively, which consistently surpass all baselines.

“Specifically, scores of ADIAS on Tau-Bench, ALFWorld, TextCraft, WebShop, and ScienceWorld are 81.3,94.0, 91.0, 69.4, and 56.3, respectively, which consistently surpass all baselines.”

May combine two claims.

The advantage is particularly pronounced on ALFWorld and TextCraft, where ADIAS reaches efficiencies of 8.95 and 9.01, and substantially exceeds the strongest baseline results of 4.48 (AHE) and 5.98 (DGM-H), respectively.

“The advantage is particularly pronounced on ALFWorld and TextCraft, where ADIAS reaches efficiencies of 8.95 and 9.01, and substantially exceeds the strongest baseline results of 4.48 (AHE) and 5.98 (DGM-H), respectively.”

May combine two claims.

ADIAS achieves the best task performance and interaction efficiency on all five benchmarks.

“ADIAS achieves the best task performance and interaction efficiency on all five benchmarks, which demonstrates robust generalization across environments with diverse interaction patterns and task objectives.”

May combine two claims.

ADIAS identifies high-performing agent designs within the first few iterations and maintains consistently strong validation performance throughout the remaining search.

“ADIAS identifies high-performing agent designs within the first few iterations and maintains consistently strong validation performance throughout the remaining search.”

May combine two claims.

Removing either external priors or round-level diagnosis reduces both performance and interaction efficiency across all three benchmarks.

“Removing either source reduces both performance and interaction efficiency across all three benchmarks.”

May combine two claims.

ADIAS obtains identical success rates of 81.3 across the two independent evaluation passes on Tau-Bench, exceeding the strongest baseline average of 71.9 by 9.4 points.

“As shown in Table 6, ADIAS obtains identical success rates of 81.3 across the two independent evaluation passes, exceeding the strongest baseline average of 71.9 by 9.4 points.”

May combine two claims.

On the complete Tau-Bench retail distribution, ADIAS achieves a Pass-1 success rate of 81.7, outperforming the strongest baseline by 13.0 percentage points.

“It achieves a Pass-1 success rate of 81.7, outperforming the strongest baseline by 13.0 percentage points.”

May combine two claims.

In TextCraft, later optimization rounds repeatedly return to previous high-score generations 2 and 6 and explore prompt restructuring, admissible-command matching, and command-selection heuristics, but the underlying quantity missing error is never localized (get quartz vs. get 1 quartz).

“For example, in TextCraft (Figure 4), later rounds repeatedly return to previous high-score generations 2 and 6 and explore prompt restructuring, admissible-command matching, and command-selection heuristics, but the underlying quantity missing error is never localized (get quartz vs. get 1 quartz).”

May combine two claims.

ADIAS achieves a Pass^2 score of 71.9 on Tau-Bench, outperforming the strongest non-ADIAS baseline by 15.6 points.

“More importantly, ADIAS achieves a Pass 2 score of 71.9, outperforming the strongest non-ADIAS baseline by 15.6 points.”

May combine two claims.

Although the issue state recommends returning to generation 6, the fixed policy makes generation 8 inherit generation 7.

“Although the issue state recommends returning to generation 6, the fixed policy makes generation 8 inherit generation 7.”

May combine two claims.

On the complete Tau-Bench retail distribution, ADIAS's Pass^2 score reaches 68.7, outperforming the best baseline by 14.8 points.

“Its Pass 2 score reaches 68.7, outperforming the best baseline by 14.8 points, while its Pass@2 score of 92.2 indicates broad task coverage across the two executions.”

May combine two claims.

On the complete Tau-Bench retail distribution, ADIAS obtains an average success rate of 80.4 ± 1.8, exceeding the strongest baseline average of 67.8 ± 1.2 by 12.6 points.

“ADIAS obtains an average success rate of 80.4 ± 1.8, exceeding the strongest baseline average of 67.8 ± 1.2 by 12.6 points.”

May combine two claims.

Removing either the external prior or round-level diagnosis reduces the two-pass average to 75.0 and lowers Pass^2 to 59.4 and 62.5, respectively.

“Removing either the external prior or round-level diagnosis reduces the two-pass average to 75.0 and lowers Pass 2 to 59.4 and 62.5, respectively.”

May combine two claims.

Best-Candidate Revision is the strongest ablation, but remains below ADIAS by 9.4, 18.6, and 17.0 score.

“Best-Candidate Revision is the strongest ablation, but remains below ADIAS by 9.4, 18.6, and 17.0 score”

May combine two claims.

Controlled ablations and qualitative analyses show that both persistent issue-level organization and its role as an optimization control state are necessary.

“Controlled ablations and qualitative analyses further show that both persistent issue-level organization and its role as an optimization control state are necessary.”

• AssumptionRests on an assumption: Trajectory diagnosis and issue association are accurate enough for ADIAS's optimization to work.

May combine two claims.

In TextCraft, generation 7 introduces fallback exploration and reduces validation success from 60.0 to 53.3.

“For example, in TextCraft (Figure 4), generation 7 introduces fallback exploration and reduces validation success from 60.0 to 53.3.”

May combine two claims.

After generation 8 is identified as unsuccessful, the issue state recommends generation 4 as the next parent, yet generation 9 is still derived from generation 8.

“After generation 8 is identified as unsuccessful, the issue state recommends generation 4 as the next parent, yet generation 9 is still derived from generation 8.”

The quote only partly states this claim.

Replacing the persistent issue-centric state with candidate-based revision policies produces larger reductions in both average performance and consistent success than the other ablations.

“Replacing the persistent issue-centric state with candidate-based revision policies produces larger reductions in both average performance and consistent success.”

May combine two claims.

Only after several alternative revisions, generation 7 combines effective revisions and improves validation from 50.0 to 66.7.

“Only after several alternative revisions, generation 7 combines effective revisions and improves validation from 50.0 to 66.7.”

May combine two claims.

Across all benchmarks, ADIAS uses the active issue, previous interventions, and their observed outcomes to determine both where to restart and what to modify, which supports a continuous repair process.

“Across all benchmarks, ADIAS uses the active issue, previous interventions, and their observed outcomes to determine both where to restart and what to modify, which supports a continuous repair process.”

• AssumptionRests on an assumption: Trajectory diagnosis and issue association are accurate enough for ADIAS's optimization to work.

May combine two claims.

In TextCraft, early branches introduce repairs of command recovery and crafting guidance, but their validation scores remain below generation 2, causing subsequent rounds to repeatedly return to that candidate and abandon parts of the previous implementations.

“In TextCraft, early branches introduce repairs of command recovery and crafting guidance, but their validation scores remain below generation 2, causing subsequent rounds to repeatedly return to that candidate and abandon parts of the previous implementations.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

A similar process appears in ALFWorld, where optimization progresses from broad planning failures to more specific issues in action correction, planning heuristics, and target-object extraction.

“A similar process appears in ALFWorld, where optimization progresses from broad planning failures to more specific issues in action correction, planning heuristics, and target-object extraction.”

May combine two claims.

Latest-Candidate Continuation makes ineffective revisions more likely to propagate, either accumulating errors or consuming additional rounds to recover.

“Latest-Candidate Continuation makes ineffective revisions more likely to propagate, either accumulating errors or consuming additional rounds to recover.”

Probably not a substantial claim: may not pass S3 (load-bearing).

During optimization the code improver was revised to simplify how the target failure mode is extracted from the revision plan.

“The code improver is also revised to simplify how the target failure mode is extracted from the revision plan.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Reliable issue-state maintenance requires transforming heterogeneous execution trajectories and sparse outcomes into stable, evidence-grounded issue identities, while reconciling new observations with historical records and tracking the repair progress of each issue across rounds.

“First, reliable issue-state maintenance requires transforming heterogeneous execution trajectories and sparse outcomes into stable, evidence-grounded issue identities, while reconciling new observations with historical records and tracking the repair progress of each issue across rounds.”

• AssumptionRests on an assumption: Task feedback in the studied interactive environments is typically sparse: intermediate rewards are often uninformative, while the final task outcome is commonly binary.

Classified as probably not a substantial claim. May combine two claims.

These transitions distinguish temporary disappearance from reliable resolution, while making recurring failures explicit.

“These transitions distinguish temporary disappearance from reliable resolution, while making recurring failures explicit.”

Probably not a substantial claim: may not pass S3 (load-bearing).

These methods demonstrate the value of carrying information across rounds.

“These methods demonstrate the value of carrying information across rounds.”

Classified as probably not a substantial claim. May combine two claims.

This structure combines heterogeneous failure modes across rounds while tracking the outcome of the targeted issues separately from improvements or regressions observed on other issues.

“This structure combines heterogeneous failure modes across rounds while tracking the outcome of the targeted issues separately from improvements or regressions observed on other issues.”

Classified as probably not a substantial claim.

The same iteration and rollout budgets are applied to all automated methods within each benchmark.

“The same iteration and rollout budgets are applied to all automated methods within each benchmark.”

Classified as probably not a substantial claim.

We also keep decoding and inference configurations fixed across methods using the same backbone model.

“We also keep decoding and inference configurations fixed across methods using the same backbone model.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The same underlying issue may manifest differently across candidates, while a single revision may simultaneously improve some behaviors and regress others, which complicates both identity association and outcome attribution.

“The same underlying issue may manifest differently across candidates, while a single revision may simultaneously improve some behaviors and regress others, which complicates both identity association and outcome attribution.”

Probably not a substantial claim: may not pass S3 (load-bearing).

These approaches primarily govern whether an updated skill or workflow artifact should be retained.

“These approaches primarily govern whether an updated skill or workflow artifact should be retained.”

May combine two claims.

Consequently, the optimizer must reconstruct what to repair in every round, and its direction may shift before an ongoing repair is complete.

“Consequently, the optimizer must reconstruct what to repair in every round, and its direction may shift before an ongoing repair is complete.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Prior work automates agent design at increasing levels of expressiveness.

“Prior work automates agent design at increasing levels of expressiveness.”

Classified as probably not a substantial claim.

Recent work shows that iterative agent improvement is not necessarily monotonic.

“Recent work shows that iterative agent improvement is not necessarily monotonic.”

• cites Yu et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

We apply this matched-model protocol to all automated baselines and ADIAS, which ensures that performance differences are attributable to the agent-design method rather than to a stronger optimizer or controller model.

“We apply this matched-model protocol to all automated baselines and ADIAS, which ensures that performance differences are attributable to the agent-design method rather than to a stronger optimizer or controller model.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

The target issue and revision direction must be determined jointly according to the issue's current evidence and prior intervention history, and the resulting modification must remain sufficiently focused for its subsequent behavioral outcome to be attributed to the intended repair.

“The target issue and revision direction must be determined jointly according to the issue's current evidence and prior intervention history, and the resulting modification must remain sufficiently focused for its subsequent behavioral outcome to be attributed to the intended repair.”

May combine two claims.

It does not maintain the current repair objective or the progress of each failure as explicit state.

“It does not maintain the current repair objective or the progress of each failure as explicit state.”

Classified as probably not a substantial claim. May combine two claims.

The targeted intervention outcome is stored separately from lifecycle changes observed for other issues, which makes progress on the intended repair distinguishable from concurrent improvements or regressions elsewhere.

“The targeted intervention outcome is stored separately from lifecycle changes observed for other issues, which makes progress on the intended repair distinguishable from concurrent improvements or regressions elsewhere.”

Classified as probably not a substantial claim. May combine two claims.

For each method, we select the agent with the highest validation performance and evaluate it on the held-out test set.

“For each method, we select the agent with the highest validation performance and evaluate it on the held-out test set.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Joint planning makes the descriptive issue state actionable for code improvement, while focused revision improves the attribution of subsequent behavioral outcomes without restricting the agent design space.

“Joint planning makes the descriptive issue state actionable for code improvement, while focused revision improves the attribution of subsequent behavioral outcomes without restricting the agent design space.”

May combine two claims.

A persistent issue state that explicitly records each issue's current status, supporting evidence, and intervention history enables more focused repair decisions, consolidation of partial progress across rounds, and avoidance of previously ineffective interventions.

“This state directly guides the next repair target and revision direction, which enables more focused repair decisions, consolidation of partial progress across rounds, and avoidance of previously ineffective interventions.”

Classified as probably not a substantial claim.

This joint planning couples what to repair, where to resume optimization, and how to revise, which prevents these inter-related decisions from being made independently.

“This joint planning couples what to repair, where to resume optimization, and how to revise, which prevents these inter-related decisions from being made independently.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Actionable and attributable revision requires translating a dynamic, multi-issue, and primarily descriptive state into a concrete code modification.

“Second, actionable and attributable revision requires translating a dynamic, multi-issue, and primarily descriptive state into a concrete code modification.”

May combine two claims.

The improvement is not driven by a small number of isolated high-scoring candidates; rather, the optimizer can generate effective designs over time.

“Its cumulative-average score also increases steadily, which indicates that the improvement is not driven by a small number of isolated high-scoring candidates; rather, the optimizer can generate effective designs over time.”

Classified as probably not a substantial claim. May combine two claims.

All methods use the same benchmark wrappers, task splits, action interfaces, and scoring scripts.

“All methods use the same benchmark wrappers, task splits, action interfaces, and scoring scripts.”

Classified as probably not a substantial claim. May combine two claims.

No test tasks or validation trajectory feedback are exposed during optimization.

“No test tasks or validation trajectory feedback are exposed during optimization.”

Probably not a substantial claim: may not pass S3 (load-bearing).

For Tau-Bench, the user simulator is held fixed to DeepSeek-V4-Flash across all settings.

“For Tau-Bench, the user simulator is held fixed to DeepSeek-V4-Flash across all settings.”

May combine two claims.

These results indicate that the two mechanisms serve important roles: the external prior reduces cold-start uncertainty, while trajectory diagnosis provides the behavioral evidence required to ground and update the issue state.

“These results indicate that the two mechanisms serve important roles: the external prior reduces cold-start uncertainty, while trajectory diagnosis provides the behavioral evidence required to ground and update the issue state.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Recent work has increasingly shifted from manually designing agentic systems toward automatically improving them from execution feedback.

“Recent work has increasingly shifted from manually designing agentic systems toward automatically improving them from execution feedback (Madžar & Mekterović, 2026;Gao et al., 2026;Yue et al., 2026;Ning et al., 2026).”

• cites Madžar & Mekterović, 2026 sourceNot checked — no full text of the source
• cites Gao et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Yue et al., 2026 sourceNot checked — no full text of the source

Classified as probably not a substantial claim.

For each experimental setting, the same backbone model is used for both the design agent and the task agent.

“For each experimental setting, the same backbone model is used for both the design agent and the task agent.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Most existing methods maintain an optimization history H t containing the candidate agents A generated up to round t, together with their trajectories T , performance metrics M , and diagnostic reports D.

“Most existing methods maintain an optimization history H t containing the candidate agents A generated up to round t, together with their trajectories T , performance metrics M , and diagnostic reports D.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

This focused revision makes intervention attribution easier without restricting the design space available for optimization.

“This focused revision makes intervention attribution easier without restricting the design space available for optimization.”

Classified as probably not a substantial claim.

This feedback loop converts agent revision into issue-level evidence that informs subsequent optimization rounds.

“This feedback loop converts agent revision into issue-level evidence that informs subsequent optimization rounds.”

Classified as probably not a substantial claim. May combine two claims.

All methods use the same task splits, environment interfaces, optimization budgets, and benchmark-specific evaluators.

“All methods use the same task splits, environment interfaces, optimization budgets, and benchmark-specific evaluators.”

Classified as probably not a substantial claim. May combine two claims.

This issue-specific history supports more reliable outcome attribution and helps subsequent rounds reuse effective interventions while avoiding previously unsuccessful directions.

“This issue-specific history supports more reliable outcome attribution and helps subsequent rounds reuse effective interventions while avoiding previously unsuccessful directions.”

May combine two claims.

Full-code design provides the necessary expressiveness for interactive agents but must search over a much larger and less structured space of executable implementations.

“Full-code design provides the necessary expressiveness, but must search over a much larger and less structured space of executable implementations (Hu et al., 2025).”

• cites Hu et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The designer has to recover the useful insight from history and attempt a related repair again on a higher-scoring parent.

“The designer has to recover the useful insight from history and attempt a related repair again on a higher-scoring parent.”

May combine two claims.

ADIAS's advantage on Tau-Bench is not driven solely by tasks that succeed under favorable sampling; a substantially larger fraction of tasks are solved consistently across both executions.

“This indicates that its advantage is not driven solely by tasks that succeed under favorable sampling; a substantially larger fraction of tasks are solved consistently across both executions.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The evaluation is limited to text-based interactive benchmarks.

“Our evaluation is also limited to text-based interactive benchmarks and leaves multimodal and substantially longer-horizon tasks for future work.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Efficient optimization requires tracking what has been tried, what has improved or regressed, and which unresolved bottleneck should guide the next design round.

“Efficient optimization therefore requires tracking what has been tried, what has improved or regressed, and which unresolved bottleneck should guide the next design round.”

Classified as probably not a substantial claim. May combine two claims.

Diagnosis is deliberately separated from modification, which means the diagnostic agent does not propose suggestions or implement code patches.

“Diagnosis is deliberately separated from modification, which means the diagnostic agent does not propose suggestions or implement code patches.”

May combine two claims.

Interactive evaluation is expensive, which makes search efficiency critical.

“Third, interactive evaluation is expensive, which makes search efficiency critical.”

• cites Yao et al., 2022;2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Simply providing complete trajectories to an LLM is problematic, as long and heavy traces contain substantial irrelevant context and make decisive failure evidence difficult to isolate.

“Simply providing complete trajectories to an LLM is also problematic, as long and heavy traces contain substantial irrelevant context and make decisive failure evidence difficult to isolate.”

May combine two claims.

A scalar score reveals whether an agent succeeded, but rarely explains why: the failure may originate from an early misunderstanding, lost state, incorrect tool use, a policy violation, or ineffective recovery.

“A scalar score reveals whether an agent succeeded, but rarely explains why: the failure may originate from an early misunderstanding, lost state, incorrect tool use, a policy violation, or ineffective recovery.”

Classified as probably not a substantial claim.

Each method is evaluated on held-out test tasks after selecting the best agent according to validation performance.

“We evaluate each method on held-out test tasks after selecting the best agent according to validation performance.”

Classified as probably not a substantial claim.

To verify that the conclusions are not specific to return requests, the comparison is additionally repeated on the full Tau-Bench retail distribution.

“To verify that the conclusions are not specific to return requests, we additionally repeat the comparison on the full Tau-Bench retail distribution, containing 500 training, 20 validation, and 115 test tasks.”

May combine two claims.

ADIAS improves both task performance and execution consistency on the broader retail distribution.

“These results show that ADIAS improves both task performance and execution consistency on the broader retail distribution.”

May combine two claims.

Consolidation remains possible under Best-Candidate Revision, but it is slower and less direct than maintaining issue-specific intervention outcomes.

“Thus, consolidation remains possible, but it is slower and less direct than maintaining issue-specific intervention outcomes.”

Classified as probably not a substantial claim. May combine two claims.

All methods use the same task splits, environment interfaces, evaluation budgets, and benchmark-specific evaluators.

“All methods use the same task splits, environment interfaces, evaluation budgets, and benchmark-specific evaluators.”

May combine two claims.

In this case, the ineffective revision remains instead of being bypassed, which makes subsequent candidates more likely to inherit its errors.

“In this case, the ineffective revision remains instead of being bypassed, which makes subsequent candidates more likely to inherit its errors.”

May combine two claims.

These interventions remain available in the history and can eventually be reused, but their useful components must be repeatedly attributed and reimplemented across branches before they improve the aggregate score.

“These interventions remain available in the history and can eventually be reused, but their useful components must be repeatedly attributed and reimplemented across branches before they improve the aggregate score.”

Classified as probably not a substantial claim.

Restricting the optimization set to one complete intent family enables controlled comparison under a feasible and uniform budget.

“Restricting the optimization set to one complete intent family enables controlled comparison under a feasible and uniform budget.”

• AssumptionRests on an assumption: The constructed task subsets are representative of their respective benchmarks.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The external searcher is executed exactly once and is not changed during late design iterations.

“The external searcher is executed exactly once and is not changed during late design iterations.”

Classified as probably not a substantial claim. May combine two claims.

The native task structure and evaluator of each benchmark are preserved, and subsets are selected according to task semantics or trajectory complexity rather than sampling arbitrary individual episodes.

“We preserve the native task structure and evaluator of each benchmark, and select subsets according to task semantics or trajectory complexity rather than sampling arbitrary individual episodes.”

• AssumptionRests on an assumption: The constructed task subsets are representative of their respective benchmarks.

May combine two claims.

Interaction feedback is sparse, delayed, and difficult to attribute.

“Second, interaction feedback is sparse, delayed, and difficult to attribute.”

• cites Liu et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Yao et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

A prior is promoted into accumulated task experience only when supported by trajectory diagnosis, patch outcomes, runtime evidence, or score trends.

“A prior is promoted into accumulated task experience only when supported by trajectory diagnosis, patch outcomes, runtime evidence, or score trends.”

Classified as probably not a substantial claim. May combine two claims.

Retrieval is restricted to public task-level information and excludes held-out labels, instance-specific solutions, hidden evaluation data, and hard-coded benchmark outputs.

“We restrict retrieval to public task-level information and exclude held-out labels, instance-specific solutions, hidden evaluation data, and hard-coded benchmark outputs.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

External task priors are handled as provisional hypotheses: they may initialize issue records, but do not become confirmed failures unless supported by observed behavior.

“External task priors are handled as provisional hypotheses: they may initialize issue records, but do not become confirmed failures unless supported by observed behavior.”

May combine two claims.

Without a persistent view of search progress, the designer may revisit unsuccessful modifications, overlook the recurrence of previously mitigated failures, and repeatedly spend evaluation budget on already explored directions.

“Without a persistent view of search progress, however, the designer may revisit unsuccessful modifications, overlook the recurrence of previously mitigated failures, and repeatedly spend evaluation budget on already explored directions.”

May combine two claims.

ADIAS's global issue manager aggregates recurring patterns across episodes and iterations to prioritize broadly useful modifications and improve optimization efficiency.

“Finally, a global issue manager aggregates recurring patterns across episodes and iterations to prioritize broadly useful modifications and improve optimization efficiency.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The issue state E_t does not replace the candidate archive; it provides an issue-indexed control layer over candidate-level history.

“Thus, E t does not replace the archive; it provides an issue-indexed control layer over candidate-level history.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

ADIAS's diagnostic agent performs fine-grained failure analysis and precisely attributes observed errors to actionable causes.

“In addition, the diagnostic agent performs fine-grained failure analysis and precisely attributes observed errors to actionable causes.”

May combine two claims.

ADIAS preserves a high-capacity search space while using task priors to guide exploration, precise diagnosis to localize failures, and global issue state to drive efficient improvement.

“Overall, ADIAS preserves a high-capacity search space while using task priors to guide exploration, precise diagnosis to localize failures, and global issue state to drive efficient improvement.”

May combine two claims.

DGM-H's larger design space provides a higher performance ceiling, as illustrated by its strong result on ALFWorld.

“Its larger design space provides a higher performance ceiling, as illustrated by its strong result on ALFWorld.”

• cites DGM-HNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Components involved in diagnosing failures and planning subsequent revisions may also be modified, which allows the optimization process itself to become part of the search space.

“Components involved in diagnosing failures and planning subsequent revisions may also be modified, which allows the optimization process itself to become part of the search space.”

May combine two claims.

ADIAS retains a full-code design space and can introduce new agent mechanisms when required by the task.

“Similar to DGM-H, ADIAS retains a full-code design space and can introduce new agent mechanisms when required by the task.”

May combine two claims.

AHE expands the editable space to the agent harness and can modify multiple components, such as prompts, tools, skills, and memory.

“AHE expands the editable space to the agent harness and can modify multiple components, such as prompts, tools, skills, and memory.”

• cites AHENot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.