At Equal Inference Cost, Multi-Agent Structure Does Not Beat a Single Frozen Agent

May combine two claims.

The team's gain over the unevolved baseline (+0.112, p=0.018) coincides with the executor's gain (single +0.097) and not the structure's.

“the team's gain over the unevolved baseline (+0.112, p=0.018) coincides with the executor's gain (single +0.097) and not the structure's”

May combine two claims. The quote only partly states this claim.

On ALFWORLD, the full team attains the highest mean (0.769) but is not statistically separable from the single agent (0.754, ∆=+0.015, McNemar 9-7, p=0.80), while spending 1.8× the evaluation calls (32.2 vs. 18.0 per task).

“whereas the full team attains the highest mean but is not statistically separable from the single agent (0.769 vs. 0.754, ∆=+0.015,p=0.80) at 1.8× the evaluation calls.”

• Also stated in: § I. INTRODUCTION · plain

  “The full team attains the highest mean (0.769), but its margin over the single agent is only ∆=+0.015 (McNemar 9-7, p=0.80), which is not statistically separable”

May combine two claims.

The default planner and critic still fire (planner 537 times, critic 163 times across the test set) but exert low influence on the chosen action (planner 0.14, critic 0.41) and never change the executor's decision (critic restate-rate 0.00).

“The default planner and critic still fire (planner 537 times, critic 163 times across the test set) but exert low influence on the chosen action (planner 0.14, critic 0.41) and never change the executor's decision (critic restate-rate 0.00); they add cost without benefit.”

• Also stated in: § Abstract · plain

  “fire with low influence on the chosen action (planner 0.14, critic 0.41), and do not change the executor's decision.”

May combine two claims.

On dense WEBSHOP, evolution is null (single 0.245 ≈ Stock 0.242, p=0.96) and the team trends worse (0.185, ∆=-0.060 vs. single, p=0.12) at higher cost.

“On dense WEBSHOP [9] evolution is null (single 0.245 ≈ Stock 0.242, p=0.96) and the team trends worse (0.185, ∆=-0.060 vs. single, p=0.12) at higher cost.”

• Also stated in: § Abstract · plain

  “on dense WEBSHOP evolution is null and the team trends worse.”

May combine two claims.

The full Planner→Executor→Critic team reaches 0.769, the highest mean in Table II, and beats Stock significantly (+0.112, p=0.018).

“The full Planner→Executor→Critic team reaches 0.769, the highest mean in Table II, and beats Stock significantly (+0.112, p=0.018).”

May combine two claims.

The team attains the highest mean-but not a significant one over the single agent-at 1.8× the cost.

“Finding 2: The team attains the highest mean-but not a significant one over the single agent-at 1.8× the cost.”

May combine two claims.

The evolved executor prompt is concrete, not an opaque tuned string: it instructs the agent to open a closed receptacle before taking an object, to take before placing, to use the environment's exact action templates, and to confirm for cool/heat/use sub-tasks.

“The evolved prompt is concrete, not an opaque tuned string: it instructs the agent to open a closed receptacle before taking an object, to take before placing, to use the environment's exact action templates, and to confirm for cool/heat/use sub-tasks (Section A).”

• cites Section ANot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Evolution's value is realized almost entirely on the two hardest families-examine-in-light (Stock 0.111, lifted to 0.444 by single and 0.500 by the team) and heat&place (0.652 → 0.826)-whereas on the four easier families every arm already sits near ceiling and there is little room to move.

“Evolution's value is realized almost entirely on the two hardest familiesexamine-in-light (Stock 0.111, lifted to 0.444 by single and 0.500 by the team) and heat&place (0.652 → 0.826)-whereas on the four easier families every arm already sits near ceiling and there is little room to move.”

May combine two claims.

On dense WEBSHOP, the team trends worse (0.185, ∆=-0.060 vs. single, p=0.12) while again costing more calls per task.

“and the team trends worse (0.185, ∆=-0.060 vs. single, p=0.12) while again costing more calls per task.”

May combine two claims.

On ALFWorld per-task-type breakdown (n=134), the evolved gain concentrates on the hard families (examine-in-light, two-obj, heat&place); on the easy families all arms are near ceiling.

“The evolved gain concentrates on the hard families (examine-in-light, two-obj, heat&place); on the easy families all arms are near ceiling.”

• Also stated in: § TABLE IV PER-TASK-TYPE SUCCESS ON ALFWORLD TEST (n=134), BY THE SIX CANONICAL TASK FAMILIES (ORDERED HARDEST→EASIEST BY THE STOCK RATE), FOR THE THREE HEADLINE ARMS PLUS THE EXECUTOR-ONLY LEAVE-ONE-IN CELL. EACH CELL IS THE SUCCESS RATE WITHIN THAT FAMILY (nρ TASKS). THE COLUMN MEANS REPRODUCE THE AGGREGATES OF · plain

  “THE REALIZED GAIN OF EVOLUTION CONCENTRATES IN THE HARDEST FAMILIES (examine-in-light: 0.111 → 0.444; heat&place: 0.652 → 0.826), WHILE ON THE EASY FAMILIES EVERY ARM IS ALREADY NEAR-CEILING.”

May combine two claims.

LOI:exec, which adds no steering role, is the cheapest cell (16.7 calls/task, 0.93×) and still reaches 0.731.

“LOI:exec, which adds no steering role, is the cheapest cell (16.7 calls/task, 0.93×) and still reaches 0.731.”

May combine two claims.

Under the iso-call budget the team genome evolved only the Executor prompt (~420 characters of concrete control text); the Planner and Critic prompts froze empty across every clean run.

“Under the iso-call budget the team genome evolved only the Executor prompt (∼420 characters of concrete control text); the Planner and Critic prompts froze empty across every clean run (Figure 5a).”

May combine two claims.

Evolving the single executor preamble lifts held-out success from Stock's 0.657 to 0.754, a +0.097 gain that is significant (McNemar 20-7, p=0.021).

“Evolving the single executor preamble lifts held-out success from Stock's 0.657 to 0.754-a +0.097 gain that is significant (McNemar 20-7, p=0.021).”

May combine two claims.

The team versus single comparison has a margin of ∆=+0.015 with McNemar 9-7, p=0.80, and is not statistically separable.

“But the comparison that isolates the structure is team versus single, and there the margin is ∆=+0.015with McNemar 9-7, p=0.80 (Table III)-not statistically separable.”

May combine two claims.

Single-agent evolution works; the executor prompt is real.

“Finding 1: Single-agent evolution works; the executor prompt is real.”

May combine two claims.

The team spends 32.2 evaluation calls per task against the single agent's 18.0, a 1.79× cost multiplier (and 1.8× the tokens).

“Meanwhile the team spends 32.2 evaluation calls per task against the single agent's 18.0, a 1.79× cost multiplier (and 1.8× the tokens).”

May combine two claims.

WebShop is consistent-evolution null, team worse.

“Finding 3: WebShop is consistent-evolution null, team worse.”

May combine two claims.

The gain is in the hard families, and the team tracks the single agent everywhere.

“Finding 5: The gain is in the hard families, and the team tracks the single agent everywhere.”

May combine two claims.

The cost is real and uniform across arms.

“Finding 4: The cost is real and uniform across arms.”

May combine two claims.

The single agent and full team are the only two arms whose gain over Stock is significant, and they are essentially equal (+0.097 vs. +0.112, overlapping intervals).

“The single agent (evolve one prompt) and the full team are the only two arms whose gain is significant, and they are essentially equal (+0.097 vs. +0.112,overlapping intervals)”

May combine two claims.

The planner's influence rate is 0.14 and the critic's is 0.41, with a critic restate-rate of 0.00.

“their influence rate-the fraction of fires that change the Executor's chosen actionis low: 0.14 for the planner and 0.41 for the critic, with a critic restate-rate of 0.00 (the critic never rewrites the action's content).”

May combine two claims.

Only the Executor prompt evolves (non-empty, ∼420 chars); the Planner and Critic prompts froze empty.

“(a) Only the Executor prompt evolves (non-empty, ∼420 chars); the Planner and Critic prompts froze empty and fire at low influence on the chosen action (planner 0.14, critic 0.41; critic restate-rate 0.00).”

May combine two claims.

On a frozen small backbone, the cost axis dominates: the cheapest informative cell (single executor) is also the accuracy-per-call winner.

“on a frozen small backbone, the cost axis dominates-the cheapest informative cell (single executor) is also the accuracy-per-call winner”

Probably not a substantial claim: may not pass S3 (load-bearing).

On dense WEBSHOP (step cap 15), the team scores 0.185.

“On dense WEBSHOP (step cap 15), Stock scores 0.242, single 0.245 (paired-bootstrap p=0.96 vs. Stock), and the team 0.185 (∆=-0.060 vs. single, p=0.12).”

May combine two claims.

Among leave-one-in arms on ALFWORLD, only the Executor- and Critic-bearing arms separate from Stock; the Planner-only arm does not (+0.067, p=0.15).

“Among leave-one-in arms only the Executor-and Critic-bearing arms separate from Stock; the Planner-only arm does not (+0.067,p=0.15).”

May combine two claims.

The Planner and Critic fire at low influence on the chosen action (planner 0.14, critic 0.41; critic restate-rate 0.00).

“(a) Only the Executor prompt evolves (non-empty, ∼420 chars); the Planner and Critic prompts froze empty and fire at low influence on the chosen action (planner 0.14, critic 0.41; critic restate-rate 0.00).”

May combine two claims.

In the full team, the critic fires 163 times, changes the executor's chosen action 66 times (influence 0.41), with a restate-rate of 0.00.

“the critic fires 163 times changing it 66 times (influence 0.41) with a restate-rate of 0.00-it never rewrites the action's content.”

May combine two claims.

The planner and critic fire decoratively, with influence 0.14 and 0.41, restate-rate 0.00; the steering roles fire hundreds of times yet steer rarely, with the critic never rewriting content-cost without effect.

“firing decoratively (influence 0.14 and 0.41, restate-rate 0.00)”

• Also stated in: § Evolution. · plain

  “THE STEERING ROLES FIRE HUNDREDS OF TIMES YET STEER RARELY (PLANNER 0.14, CRITIC 0.41), WITH THE CRITIC NEVER REWRITING CONTENT-COST WITHOUT EFFECT.”

May combine two claims.

On dense WEBSHOP, evolution is null and the team trends worse.

“on dense WEBSHOP evolution is null and the team trends worse”

May combine two claims.

On dense WEBSHOP, evolution is null and the team is the lowest-scoring, highest-cost headline cell.

“BOLD MARKS THE BEST CELL-A baseline-adjacent ARM, NOT THE TEAM: EVOLUTION IS NULL AND THE TEAM IS THE LOWEST-SCORING, HIGHEST-COST HEADLINE CELL.”

May combine two claims.

On WEBSHOP, LOI:crit does not separate from the single agent and still costs more calls.

“The only arm that edges above Stock is LOI:crit (0.267), and it does so only because it inherits the shared executor default while adding a critic; it does not separate from the single agent and still costs more calls.”

May combine two claims.

Under the iso-call budget, the team genome evolved only the Executor prompt; the Planner and Critic prompts froze empty and no distinct planner or critic content was accepted.

“with the planner and critic freezing empty”

• Also stated in: § APPENDIX A THE EVOLVED EXECUTOR PROMPT · plain

  “Under the iso-call budget the team genome evolved only the Executor prompt p exec (the Planner and Critic prompts froze empty).”

• Also stated in: § APPENDIX A THE EVOLVED EXECUTOR PROMPT · plain

  “no distinct planner or critic content was accepted.”

May combine two claims.

The executor-only LOI arm, which makes one call per step, recovers the full 132 rollouts and is not starved.

“The executoronly LOI arm, which makes one call per step, recovers the full 132 rollouts-it is not starved”

May combine two claims.

On dense WEBSHOP (step cap 15), the team vs single difference is ∆=-0.060, p=0.12.

“On dense WEBSHOP (step cap 15), Stock scores 0.242, single 0.245 (paired-bootstrap p=0.96 vs. Stock), and the team 0.185 (∆=-0.060 vs. single, p=0.12).”

May combine two claims.

The team sits at the highest evaluation cost (+14 calls/task over the single agent) with no higher success than the single agent.

“(b) Cost without benefit: the team sits at the highest evaluation cost (+14 calls/task over the single agent) with no higher success than the single agent.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Cooperative coevolution decomposes a problem into co-adapting subpopulations.

“Cooperative coevolution decomposes a problem into co-adapting subpopulations [45]-the precise frame for a team of roles that co-adapt”

• cites [45]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Prior multi-agent/system evolution systems search structure (and sometimes prompts), frequently with a stronger model or an unbounded budget in the loop, and report that searched structure beats hand-design; none runs the iso-call, frozen-backbone head-to-head that holds total language-model calls fixed, nor decomposes the marginal value of each role.

“These systems search structure (and sometimes prompts), frequently with a stronger model or an unbounded budget in the loop, and report that searched structure beats hand-design.None runs the isocall, frozen-backbone head-to-head that holds total languagemodel calls fixed and asks whether the multi-agent structure itself-not the extra search or a bigger in-loop model-is what pays, nor decomposes”

Classified as probably not a substantial claim.

Because reflection (mutation) calls are identical per arm, they cancel in the single-versus-team comparison.

“Because reflection (mutation) calls are identical per arm, they cancel in the comparison.”

May combine two claims.

A frozen 7B has no role-differentiation headroom: the steering roles cannot evolve a function distinct from the executor's, so co-adapting roles over one shared backbone drive toward redundancy and the planner and critic prompts collapse to empty.

“A frozen 7B has no roledifferentiation headroom: the steering roles cannot evolve a function distinct from the executor's, so co-adapting roles over one shared backbone drive toward redundancy and the planner and critic prompts collapse to empty.”

• Also stated in: § C. Population, Co-Evolution, and Quality-Diversity · plain

  “we use this toolbox to ask whether evolved role diversity is load-bearing or collapses to clones, and find the latter on a frozen 7B.”

• AssumptionRests on an assumption: The reflective-evolution engine, reused unchanged, is capable of finding useful role prompts for the team genome if such prompts exist, so that the observed collapse of the planner and critic prompts to empty reflects the structure rather than a limitation of the optimizer.

Classified as probably not a substantial claim. May combine two claims.

Every cross-cell comparison carries a paired test: McNemar's exact test on per-task success for the binary ALFWORLD label, and a paired bootstrap on the dense score for WEBSHOP.

“Every cross-cell comparison carries a paired test: McNemar's exact test on per-task success for the binary ALFWORLD label, and a paired bootstrap on the dense score for WEBSHOP.”

Classified as probably not a substantial claim.

Metering every role's language-model calls makes the iso-call accounting exact and the cost of structure explicit.

“It also makes the iso-call accounting exact and the cost of structure explicit: every role's call is metered, and a team that makes N calls per step must either explore 1/N as much under a fixed search budget or pay N × the evaluation cost at deployment.”

Classified as probably not a substantial claim.

The backbone client meters cumulative LLM calls, prompt tokens, and completion tokens.

“The backbone client meters cumulative LLM calls, prompt tokens, and completion tokens.”

Classified as probably not a substantial claim.

The identical backbone, decoding, and rollout path are shared by Stock, single, team, and every LOI arm (the fairness invariant).

“The identical backbone, decoding, and rollout path are shared by Stock, single, team, and every LOI arm (the fairness invariant).”

Classified as probably not a substantial claim. May combine two claims.

Tasks are partitioned into disjoint train/validation/test sets, with a fixed seed, and no test task appears in evolution.

“Tasks are partitioned into disjoint train/validation/test sets (development tasks for search, the 134/80 held-out tasks for the reported test), with a fixed seed; no test task appears in evolution.”

Classified as probably not a substantial claim. May combine two claims.

Surveys catalog the rapid growth of multi-agent LLM work and note that the orchestration is almost always hand-designed.

“Surveys catalog the rapid growth and note that the orchestration is almost always hand-designed [21], [22], [23], [24]-precisely the gap the evolution literature attacks.”

• cites [21]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [22]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [23]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

The team is a fixed-topology pipeline of three roles around the existing reason-and-act rollout, so that the comparison to a single ReAct agent is a clean one-variable test (the number of composed calls), not a change of environment or loop.

“The team is a fixed-topology pipeline of three roles around the existing reason-and-act rollout, so that the comparison to a single ReAct agent is a clean one-variable test (the number of composed calls), not a change of environment or loop.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Goodhart's law warns that a measure under optimization ceases to be a good measure.

“Goodhart's law warns that a measure under optimization ceases to be a good measure [85]”

• cites [85]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

Freezing the backbone decouples capability (fixed in the weights) from coordination (the evolved object), so that any measured gain is attributable to the structure and its prompts rather than to a stronger model placed in one role.

“It decouples capability, fixed in the weights, from coordination, the object we evolve, so that any measured gain is attributable to the structure and its prompts rather than to a stronger model placed in one role.”

May combine two claims.

Total language-model calls, rather than environment rollouts, is the controlled budget for a single-versus-multi-agent comparison, and all three budget meters (search calls, evaluation calls per task, tokens) are reported for every arm.

“We argue for and operationalize total language-model calls, rather than environment rollouts, as the controlled budget for a single-versus-multi-agent comparison (Section III), and report all three budget meters (search calls, evaluation calls per task, tokens) for every arm so that the comparison can be re-read under any cost definition.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The env-rollouts best-case regime is produced by capping on rollouts instead of calls, granting the team its free N × compute, and is reported as the team's generous upper bound.

“The env-rollouts best-case regime is produced by instead capping on rollouts (granting the team its free N × compute) and is reported alongside, labeled as the team's generous upper bound.”

Classified as probably not a substantial claim. May combine two claims.

The evolution fitness is treated as an adversarially-pressured proxy: held-out (not training) performance is reported, role-influence and inter-role content are instrumented for collapse, and the team's highest mean is read against a significance test rather than as a leaderboard number.

“We treat the evolution fitness as an adversarially-pressured proxy: we report held-out (not training) performance, instrument role-influence and inter-role content for collapse, and read the team's highest mean against a significance test rather than as a leaderboard number”

Probably not a substantial claim: may not pass S3 (load-bearing).

Automated multi-agent design has converged on a single abstraction: the agentic system as an optimizable graph of language-model calls, with nodes as agents/roles and edges as communication.

“Automated multi-agent design has converged on a single abstraction-the agentic system as an optimizable graph of language-model calls (nodes are agents/roles, edges are communication)-pioneered by GPTSwarm and the dynamicnetwork line [25], [26] and made fully general by ADAS, which searches directly in code space [27].”

• cites [25]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [26]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

A single frozen Qwen2.5-7B model serves every role of every arm, at greedy decoding (temperature 0) for deterministic, reproducible trajectories.

“A single frozen Qwen2.5-7Bmodel [92] serves every role of every arm, at greedy decoding (temperature 0) for deterministic, reproducible trajectories.”

• cites [92]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

Using one frozen 7B for all roles removes any capability gap between roles and isolates the effect of the multi-agent structure and its prompts rather than a stronger model in some role.

“Using one frozen 7B for all roles is the deliberate stress test: it removes any capability gap between roles and isolates the effect of the multi-agent structure and its prompts rather than a stronger model in some role.”

Classified as probably not a substantial claim.

For every arm, the paper reports search calls, evaluation calls per task, and tokens, all read from the shared backbone client's usage counters.

“For every arm we report the three meters of Section III: search calls (evolution cost), evaluation calls per task (deployment cost), and tokens, all read from the shared backbone client's usage counters.”

Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing). May combine two claims.

Multi-agent debate improves factuality and reasoning.

“multi-agent debate improves factuality and reasoning [3], [15]”

• cites [3]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [15]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

A candidate child role prompt is kept only if it does not decrease validation performance.

“keeping a child only if it does not decrease validation performance”

Classified as probably not a substantial claim. May combine two claims.

The executor's information flow genuinely depends on the planner's and critic's outputs; the roles interact within one trajectory and this is not an ensemble of independent agents.

“the executor's information flow genuinely depends on the planner's and critic's outputs (the roles interact within one trajectory; this is not an ensemble of independent agents).”

Classified as probably not a substantial claim.

Multi-agent LLM pipelines (e.g., planner/executor/critic teams) routinely report gains over a single agent on complex task completion.

“Multi-agent pipelines of large language models, in which a planner, an executor, and a critic collaborate, routinely report gains over a single agent and have become a dominant design pattern for complex task completion.”

• Also stated in: § I. INTRODUCTION · boosted

  “O RCHESTRATING several language-model agents-a planner that decomposes the task, an executor that acts, and a critic that corrects-rather than prompting a single model has become a dominant design pattern, and it reliably improves factuality, reasoning, and complex task completion [1], [2], [3], [4].”

• Also stated in: § A. Multi-Agent LLM Frameworks · boosted

  “Orchestrating multiple language-model instances rather than scaling one model reliably improves complex task completion, and it defines the design space (roles, topology, protocol) this paper proposes to evolve rather than hand-craft.”

• cites [1]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [2]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [3]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

Evolution selects on validation performance; all reported numbers are on the held-out test split.

“Evolution selects on validation performance; all reported numbers are on the heldout test split.”

May combine two claims.

The structure's 1.8-2.5× call overhead starves the iso-call evolution budget, the same budget-starvation effect that afflicts component-split single-agent evolution, now amplified one level up at the multi-agent level.

“In addition, the structure's 1.8 -2.5× call overhead starves the iso-call evolution budget, the same budget-starvation effect that afflicts component-split single-agent evolution, now amplified one level up at the multi-agent level.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Reflective prompt evolution has been shown to rival reinforcement learning at far lower sample cost.

“Our per-genome optimizer is reflective prompt evolution, which has been shown to rival reinforcement learning at far lower sample cost [5]”

• cites [5]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The structure does not even reach the proxy ceiling: its added roles are inert, and the finding is an honest null on synergy rather than a story of reward hacking.

“The deflationary reading we reach is that, here, the structure does not even reach the proxy ceiling: its added roles are inert, and our finding is an honest null on synergy rather than a story of reward hacking.”

May combine two claims.

MA-EVOLVE reuses the single-agent reflective-evolution engine unchanged, so the only new ingredients are the multi-agent rollout and the iso-call mechanism.

“reusing a single-agent reflective-evolution engine unchanged so that the only new ingredients are the multi-agent rollout and the isocall mechanism.”

• Also stated in: § B. Per-Role Coordinate-Ascent · plain

  “The optimizer is reflective prompt evolution [5], reused unchanged as the per-role engine; MA-EVOLVE's only additions are the multi-agent rollout and the iso-call cap.”

• cites [5]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

For every team arm, the evolution engine's budget cap counts LLM calls rather than environment rollouts, and the wrapper terminates the search once the cumulative call count reaches B.

“For every team arm the evolution engine's budget cap counts LLM calls rather than environment rollouts: the wrapper snapshots the call counter before and after each rollout batch and terminates the search once the cumulative count reaches B.”

May combine two claims.

Because the team makes N calls per step, the iso-call budget caps the team at 1/N the rollouts the single agent used, so the structure pays for its extra calls out of its own search budget.

“Because the team makes N calls per step, this caps the team at 1/N the rollouts the single agent used-the structure pays for its extra calls out of its own search budget.”

Classified as probably not a substantial claim. May combine two claims.

The internal team-vs-single comparison is fair because every cell shares the same pipeline and rollout, and it is the internal comparison-not the absolute level-that the paper claims.

“(The multi-agent pipeline's absolute WEBSHOP level is lower than a specialized single-agent WEBSHOP agent's would be, because all cells share one pipeline and rollout; the internal team-vs-single comparison is fair because every cell shares that pipeline, and it is the internal comparison-not the absolute level-that the paper claims; see Section C.)”

• cites Section CNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The team's gain over Stock is the executor's gain; the planner and critic add +0.015 for +79% cost.

“The team's gain over Stock is thus the executor's gain (single already buys +0.097); the planner and critic add +0.015 for +79% cost.”

May combine two claims.

This is the budget-starvation pathology of component-split single-agent evolution, re-appearing one level up at the multi-agent level and amplified by the larger call overhead a team incurs.

“This is the budget-starvation pathology of component-split singleagent evolution, re-appearing one level up at the multi-agent level and amplified by the larger call overhead a team incurs.”

May combine two claims.

The role-influence and inter-role-content instruments are the diagnostic: they show the roles are inert, independent of the success metric.

“The roleinfluence and inter-role-content instruments are the diagnostic: they show the roles are inert, independent of the success metric.”

Probably not a substantial claim: may not pass S2 (checkable).

Our result is a boundary, not a verdict on multi-agent systems in general.

“Our result is a boundary, not a verdict on multi-agent systems in general.”

May combine two claims.

The team attains the highest mean but is not statistically separable from the single agent and costs 1.8×; the realized value is the Executor's, localized by the per-role decomposition, with the planner and critic adding +0.015 for +79% cost.

“The honest description is that the team attains the highest mean but is not statistically separable from the single agent and costs 1.8×; the realized value is the Executor's, localized by the per-role decomposition, with the planner and critic adding +0.015 for +79% cost.”

May combine two claims.

A planner or critic earns its keep only if it can articulate a function the executor does not already perform; on a frozen 7B shared by all roles, the executor's own prompt can absorb that function, so coordinate-ascent finds no validation-improving content for the steering roles and they freeze empty.

“A planner or critic earns its keep only if it can articulate a function the executor does not already perform; on a frozen 7B shared by all roles, the executor's own prompt can absorb that function (open before take, confirm before place), so coordinate-ascent finds no validation-improving content for the steering roles and they freeze empty.”

May combine two claims.

The direction is the same as ALFWORLD: the added structure does not pay, and on the dense benchmark it mildly hurts.

“The direction is the same as ALFWORLD: the added structure does not pay, and on the dense benchmark it mildly hurts.”

May combine two claims.

This is role-differentiation collapse-not an optimizer failure but a property of the substrate, a 7B with no headroom for a second distinct role beyond the actor.

“This is role-differentiation collapse-not an optimizer failure but a property of the substrate, a 7B with no headroom for a second distinct role beyond the actor.”

May combine two claims.

The roles are decorative: they consume the extra calls that drive the cost column of Table II without changing outcomes.

“The roles are decorative: they consume the extra calls that drive the cost column of Table II (Figure 5b shows the team at the highest cost and no higher success than the single agent) without changing outcomes.”

May combine two claims.

Because the structure spends 1.8-2.5× the calls per step, the per-role search budget is B/N, and the coarse binary fitness rarely accepts a steering-role mutation within that slice-so the steering roles are starved of the search needed to find any distinct content, and freeze empty.

“Because the structure spends 1.8-2.5× the calls per step, the per-role search budget is B/N , and the coarse binary fitness rarely accepts a steering-role mutation within that slice-so the steering roles are starved of the search needed to find any distinct content, and freeze empty.”

May combine two claims.

This is the multi-agent analog of 'structure is additive, not synergistic': here, the added roles do not even add-they contribute cost without synergy.

“This is the multi-agent analog of”

May combine two claims.

The deflationary reading is that single-executor evolution already approximately equals the full team: the value lives in the Executor, and the Planner and Critic add no separable success.

“The deflationary reading is that singleexecutor evolution already approximately equals the full team: the value lives in the Executor, and the Planner and Critic add no separable success.”

May combine two claims.

Cost without benefit, made of two parts: roles that cannot evolve a distinct function, and roles that fire without steering.

“Cost without benefit, made of two parts: roles that cannot evolve a distinct function, and roles that fire without steering.”

May combine two claims.

LOI:crit reaches significance versus Stock because the critic arm still benefits from the shared executor default; it does not beat the single executor.

“(LOI:crit reaches significance versus Stock because the critic arm still benefits from the shared executor default; it does not beat the single executor.)”

May combine two claims.

The team is the numerically best system but is not separable from a single evolved agent, and it is priced in the same row.

“We state this precisely: the team is the numerically best system but is not separable from a single evolved agent, and it is priced in the same row.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The env-rollouts per-role LOI cells were not completed because the planner's env-rollouts path hit a KeyError on the sub-goal key, so the env-rollouts regime is reported as the team-row best case only, while the controlled iso-call regime carries the full LOI decomposition.

“(For transparency, the envrollouts per-role LOI cells were not completed: the planner's env-rollouts path hit a KeyError on the sub-goal key, so the env-rollouts regime is reported as the team-row best case only, while the controlled iso-call regime carries the full LOI decomposition of Table II.)”

Classified as probably not a substantial claim. May combine two claims.

The study uses a fixed Planner→Executor→Critic pipeline; debate/ensemble or query-adaptive topologies are out of scope.

“We study a fixed Planner→Executor→Critic pipeline; debate/ensemble or query-adaptive topologies are out of scope.”

Classified as probably not a substantial claim.

The internal team-vs-single comparison is fair because every cell shares the same pipeline.

“Second, this does not threaten the claim, which is the internal team-vs-single comparison: every cell shares the same pipeline, so the comparison is fair,”

Classified as probably not a substantial claim. May combine two claims.

The evolved executor prompt is concrete, environment-grounded control-the same flavor of value single-agent evolution finds.

“This is concrete, environment-grounded control-the same flavor of value single-agent evolution finds”

Probably not a substantial claim: may not pass S4 (based).

The budget-starvation argument suggests splitting any fixed budget across more roles only worsens it.

“the budget-starvation argument suggests splitting any fixed budget across more roles only worsens it”

Classified as probably not a substantial claim. May combine two claims.

All cells share the frozen Qwen2.5-7B backbone, greedy decoding, the rollout path, and the held-out splits.

“All cells share the frozen Qwen2.5-7Bbackbone, greedy decoding, the rollout path, and the held-out splits.”

Probably not a substantial claim: may not pass S3 (load-bearing).

All trajectories are deterministic given the frozen backbone, the frozen genome, and the fixed splits (single greedy decoding).

“All trajectories are deterministic given the frozen backbone, the frozen genome, and the fixed splits (single greedy decoding).”

Classified as probably not a substantial claim. May combine two claims.

The three-meter table, the McNemar and paired-bootstrap tests, the bootstrap CIs, the per-role localization, and the role-influence/collapse meters are computed from the persisted per-task outcomes and trajectories on the held-out test splits.

“The three-meter table, the McNemar and paired-bootstrap tests, the bootstrap CIs, the per-role localization, and the role-influence/collapse meters are computed from the persisted per-task outcomes and trajectories on the held-out test splits.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The dense secondary corroborates the binary primary.

“The dense secondary thus corroborates the binary primary.”

May combine two claims.

The mechanism is a frozen backbone's lack of role-differentiation headroom compounded by the structure's call overhead starving the isocall evolution budget-the multi-agent analog of 'additive, not synergistic,' here cost without synergy.

“The mechanism is a frozen backbone's lack of role-differentiation headroom compounded by the structure's call overhead starving the isocall evolution budget-the multi-agent analog of”

Probably not a substantial claim: may not pass S3 (load-bearing).

The env-rollouts best-case regime is reported as the team row only, because its per-role LOI cells were not completed (a planner-path KeyError).

“The env-rollouts best-case regime is reported as the team row only, because its per-role LOI cells were not completed (a planner-path KeyError)”

Classified as probably not a substantial claim.

All results use one frozen Qwen2.5-7B backbone shared by all roles.

“All results use one frozen Qwen2.5-7Bbackbone shared by all roles”

Probably not a substantial claim: may not pass S3 (load-bearing).

The controlled iso-call regime carries the full decomposition.

“the controlled iso-call regime carries the full decomposition.”

Classified as probably not a substantial claim. May combine two claims.

The single-agent arm runs first and its total search calls define the iso-call budget B; each team/LOI arm caps its cumulative LLM calls at B, so the per-role search budget is B/N with N=3.

“The single-agent arm runs first and its total search calls define the iso-call budget B (rollout pool 120); each team/LOI arm caps its cumulative LLM calls at B, so the per-role search budget is B/N with N =3.”

May combine two claims.

The steering roles neither evolve distinct content nor change outcomes.

“The steering roles neither evolve distinct content nor change outcomes-structure is overhead.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The study runs one greedy evaluation per cell and bootstraps over tasks rather than replicating seeds.

“We run one greedy evaluation per cell and bootstrap over tasks rather than replicating seeds”