MS-Eval: Benchmarking Sub-Agent Delegation and Orchestration in MCP-Intensive Working Scenarios

May combine two claims.

Exploratory sub-tasks often retrieve information-intensive chunks that quickly bloat the context window, leading to severe decision distortion in subsequent steps.

“More critically, exploratory sub-tasks often retrieve information-intensive chunks that quickly bloat the context window, leading to severe decision distortion in subsequent steps (Liu et al., 2024;Xue et al., 2026).”

• cites Liu et al., 2024 sourcePartly supported

  Section 5 (page not provided) reports that adding retrieved documents significantly increases context length while yielding only marginal improvements in question-answering performance. Section 2.3 reports degraded performance when relevant information is in the middle of a long context. The paper does not study exploratory sub-tasks or establish that retrieved chunks cause severe decision distortion in subsequent steps. (LLM, conf=0.86)

  Experimental — accuracy not yet measured
• cites Xue et al., 2026 sourcePartly supported

  The Introduction says retrieved context can distract search agents and degrade subsequent generation quality; the CoT Prompt passage says documents accumulated over several turns introduce noise. These passages support the general interference claim, but do not establish that exploratory sub-tasks quickly bloat the context window or cause severe decision distortion. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

Classified as probably not a substantial claim.

Multi-Agent Systems are designed to overcome limitations of single-agent systems in context capacity, insufficient exploration, and inefficient serial execution through specialized collaboration.

“Multi-Agent Systems (MAS) are designed to overcome the limitations of single-agent systems in context capacity (Yu et al., 2026), insufficient exploration (Gurjar et al., 2026), and inefficient serial execution (Masterman et al., 2024), through specialized collaboration (Guo et al., 2024).”

• cites Yu et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Gurjar et al., 2026 sourceSupported
• cites Masterman et al., 2024 sourceSupported

May combine two claims.

GPT-5.6-Sol and Claude-Sonnet-5 rank third-to-last and second-to-last on the MSQ leaderboard, with MSQ of 15.6% and 13.2%, respectively.

“with GPT-5.6-Sol(15.6%) and Claude-Sonnet-5 (13.2%) ranking third-to-last and second-to-last, respectively.”

May combine two claims.

Among the three practical MAD-SAE variants, Spec achieves the highest F1 hit and average utilities, with a peak MSQ of 20.8%.

“Spec achieves the highest F 1 hit and average utilities among three practical variants, yielding a peak MSQ of 20.8%.”

May combine two claims.

Most open-source models (K3, Qwen-3.8-Max, GLM-5.3, GLM-5.3-Flash) attain both higher SR and fewer steps under MAD-SAE, whereas closed-source models cluster in the lower-right quadrant, suffering both lower success and more steps.

“The same pattern recurs for efficiency (Fig. 3, right): most open-source models (K3, Qwen-3.8-Max,GLM-5.3,GLM-5.3-Flash)attain both higher SR and fewer steps under MAD-SAE, whereas closed-source models cluster in the lower-right quadrant, suffering both lower success and more steps.”

Classified as probably not a substantial claim. May combine two claims.

Our evaluation considers two complementary perspectives: Delegation Appropriateness (DA) to assess sub-agent delegation rationality, and Orchestration Utilities (OU) to quantify performance, efficiency, and cost gains over the SA baseline.

“Our evaluation considers two complementary perspectives: Delegation Appropriateness (DA) ( § 4.3.1) to assess the sub-agent delegation rationality, and Orchestration Utilities (OU) ( § 4.3.2) to quantify performance, efficiency, and cost gains over the SA baseline.”

Classified as probably not a substantial claim.

Efficiency and cost are evaluated via Critical Steps (Csteps) and API billing on the successfully completed subset D+del ⊆ D del, as resource savings are meaningful only for solved tasks.

“Conversely, efficiency and cost are strictly evaluated via Critical Steps (Csteps) in Eq. 6 and API billing estimated in Eq. 7, on the successfully completed subset D + del ⊆ D del , as resource savings are meaningful only for solved tasks.”

May combine two claims.

GPT-5.6-Sol's over-delegation fails to translate into orchestration advantages, with all its utilities falling below the 50% parity line.

“Crucially, such over-delegation fails to translate into orchestration advantages, with all its utilities falling below the 50% parity line.”

May combine two claims.

MAD-SAE generally incurs higher cost, but its payoff is contingent on delegation quality.

“MAD-SAE generally incurs higher cost, but its payoff is contingent on delegation quality.”

• Also stated in: § Abstract · plain

  “MAD-SAE generally raises cost with contingent payoff”

• AssumptionRests on an assumption: The MSQ index validly integrates delegation and orchestration quality for comprehensive assessment.
• AssumptionRests on an assumption: The four MAD-SAE variants and eight frontier models are representative of the broader population of MAD-SAE implementations and frontier models.

Classified as probably not a substantial claim.

Performance is measured by Success Rates (SR) on D del.

“Specifically, performance is measured by Success Rates (SR) in Eq. 5 on D del (defined in § 4.3.1).”

May combine two claims.

Gen has a leading P hit of 48.0%, a low R hit of 18.8%, and a high UDR of 52.8%.

“despite a leading P hit (48.0%), its low R hit (18.8%) and high UDR (52.8%)”

May combine two claims.

Oracle attains 49.6% Up and 53.5% Ue, matching the SA baseline in performance while realizing higher efficiency.

“On the OU metrics, Oracle attains 49.6% of U p and 53.5% of U e , matching the SA baseline in performance while realizing the expected higher efficiency discussed in § 3.1.”

May combine two claims.

There are 349 cases where both succeed, but MAD-SAE incurs strictly higher cost than SA and achieves no reduction in critical steps (Costly-and-Inefficient Success, CIS).

“Costly-and-Inefficient Success (CIS) includes 349 cases where both succeed, but MAD-SAE incurs strictly higher cost than SA and achieves no reduction in critical steps, adding overhead without either efficiency or cost savings.”

• AssumptionThe authors state this as an assumption: Task success is the primary objective (first principle).

Classified as probably not a substantial claim. May combine two claims.

We introduce Under-Delegation Rate (UDR), Over-Delegation Rate (ODR), and Sub-agent Hit Scores with P hit, R hit and F1 hit.

“Accordingly, we introduce: Under-Delegation Rate (UDR), Over-Delegation Rate (ODR), and Sub-agent Hit Scores with P hit , R hit and F 1 hit .”

Classified as probably not a substantial claim. May combine two claims.

The Delegation Prior specifies (1) when to delegate a wave of sub-agents, (2) which types of sub-agents to assign, and (3) which sub-tasks they should handle to complete the task efficiently.

“As an example in Fig. 2, such prior specifies (1) when to delegate a wave of sub-agents, (2) which types of sub-agents to assign, and (3) which sub-tasks they should handle to complete the task efficiently.”

May combine two claims.

GPT-5.6-Sol exhibits the most aggressive delegation behavior, with an ODR of 93.5%.

“GPT-5.6-Solexhibits the most aggressive delegation behavior, with a massive ODR of 93.5%.”

May combine two claims.

GLM-5.3 preserves task performance while ranking second in efficiency, with a Ue of 52.7%.

“Meanwhile, it preserves task performance while ranking second in efficiency, with a U e of 52.7%.”

May combine two claims.

There are 88 cases where both fail, but MAD-SAE attempts more efficient or cheaper strategies (Attempt-for-Efficiency-or-Saving, AES).

“2. Attempt-for-Efficiency-or-Saving (AES) includes 88 cases where both fail, but MAD-SAE attempts more efficient or cheaper strategies that proved effective in beneficial cases.”

• AssumptionThe authors state this as an assumption: Task success is the primary objective (first principle).

Classified as probably not a substantial claim. May combine two claims.

The dataset is divided into two splits: D no-need with 77 tasks, where the main-agent alone is already efficient enough, and D need with 89 tasks, where the main-agent should delegate sub-tasks to sub-agents for efficient and effective solutions.

“Based on the annotation, the entire dataset is divided into two splits: (1) D no-need with 77 tasks, where the main-agent alone is already efficient enough, and (2) D need with 89 tasks, where the main-agent should delegate sub-tasks to sub-agents for efficient and effective solutions.”

May combine two claims.

We sample, refine, and annotate 166 tasks from Toolathlon-Gym, covering eight real-world work scenarios: LMS, EDW, EC, SM, VP, RS, AR and FC.

“We sample, refinefoot_0 , and annotate 166 tasks from Toolathlon-Gym (Zhang et al., 2026), a large-scale and long-horizon environment covering eight real-world work scenarios: Learning Management System (LMS), Enterprise Data Warehouse (EDW), E-Commerce (EC), Stock Market (SM), Video Platform (VP), Railway System (RS), Academic Research (AR) and Food-and-Catering (FC).”

• cites Zhang et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Claude-Sonnet-5 suffers negative orchestration returns across the board, with Up 45.9%, Ue 46.8%, and Uc 34.1%.

“Claude-Sonnet-5 similarly suffers from negative orchestration returns across the board (U p : 45.9%, U e : 46.8%, U c : 34.1%).”

Probably not a substantial claim: may not pass S3 (load-bearing).

There are 703 adverse cases.

“We therefore have 703 adverse cases, which fall into four categories:”

• AssumptionThe authors state this as an assumption: Task success is the primary objective (first principle).

Classified as probably not a substantial claim.

F1 hit acts as a multiplicative discount: high orchestration utility receives full credit only when driven by appropriate delegation.

“Crucially, F 1 hit acts as a multiplicative discount: high orchestration utility receives full credit only when driven by appropriate delegation.”

May combine two claims.

Oracle provides near-perfect delegations with 92.5% F1 hit, exceeding Gen (the prior-free baseline) by 65.4 points.

“Guided by delegation priors, Oracle provides near-perfect delegations with 92.5% of F 1 hit , which exceeds Gen (the prior-free baseline) by 65.4 points.”

• AssumptionRests on an assumption: The delegation priors annotated for tasks correctly identify whether sub-agents are needed.

Classified as probably not a substantial claim.

We quantify MAD-SAE utilities over the SA baseline across three dimensions: performance, efficiency, and cost.

“We quantify MAD-SAE utilities over the SA baseline across three dimensions: performance (p), efficiency (e), and cost (c).”

May combine two claims.

MAO appears in 254 adverse cases, but its beneficial occurrences still outnumber its adverse ones.

“MAO also appears in 254 adverse cases, but its beneficial occurrences still outnumber its adverse ones”

May combine two claims.

Oracle has a Uc of 23.6%, well below 50%, indicating substantial additional cost relative to SA, leaving Oracle with an MSQ of 39.1%.

“Meanwhile, its U c of 23.6%, well below 50%, indicates substantial additional cost relative to SA, leaving Oracle with an MSQ of only 39.1%.”

Classified as probably not a substantial claim.

We use Deepseek-V4-Flash-0731 for RQ1 experiments.

“Considering the high cost-effectiveness of Deepseek-V4-Flash-0731, we use it for RQ1 experiments.”

• AssumptionRests on an assumption: Deepseek-V4-Flash-0731 is highly cost-effective.

Probably not a substantial claim: may not pass S3 (load-bearing).

Multiple closed-source and open-source models are considered in our evaluation.

“Multiple closed-source and open-source models are considered into our evaluation.”

Classified as probably not a substantial claim.

We normalize the metrics into a unified, higher-is-better [0,1] index U_i.

“Because these metrics possess disparate scales and opposing optimization directions (i.e., higher-is-better for performance, but lower-is-better for efficiency and cost), we normalize them into a unified, higher-is-better [0, 1] index U i .”

Classified as probably not a substantial claim.

We establish Delegation Prior, a golden delegation plan, as the ground truth for each task.

“To facilitate the assessment on delegation appropriateness, we establish Delegation Prior, a golden delegation plan, as the ground truth for each task.”

May combine two claims.

Kimi-K3's conservative delegation, with an F1 hit of only 34.1%, drags its MSQ down to 17.9% and places it fourth.

“Yet its conservative delegation, with an F 1 hit of only 34.1%, drags its MSQ down to 17.9% and places it fourth.”

May combine two claims.

Across the full benchmark D, MAD-SAE improves both performance and efficiency for most open-source models at added cost.

“Across the full benchmark D ( § 7), MAD-SAE improves both performance and efficiency for most open-source models at added cost”

• AssumptionRests on an assumption: The MSQ index validly integrates delegation and orchestration quality for comprehensive assessment.
• AssumptionRests on an assumption: The four MAD-SAE variants and eight frontier models are representative of the broader population of MAD-SAE implementations and frontier models.

May combine two claims.

K3 (Spec) is the sole configuration to escape the trade-off entirely, cutting cost by $0.4 per task while still lifting SR by 10.2 points.

“K3 (Spec) is the sole configuration to escape this trade-off entirely, cutting cost by $0.4 per task while still lifting SR by 10.2 points.”

May combine two claims.

Kimi-K3 is the only model to surpass SA on performance, efficiency, and cost alike, solving 11 more tasks with the highest Up of 56.4%.

“Kimi-K3 is the only model to surpass SA on performance, efficiency, and cost alike, solving 11 more tasks with the highest U p of 56.4%.”

Classified as probably not a substantial claim.

We introduce the MAD-SAE Evaluation Kit (MS-Eval Kit).

“To comprehensively investigate the sub-agent delegation appropriateness of main-agent and the underlying orchestration utilities against the SA baseline, we introduce the MAD-SAE Evaluation Kit (MS-Eval Kit).”

Classified as probably not a substantial claim. May combine two claims.

The MS-Eval Kit comprises three core components: a curated benchmark, a controlled harness, and tailored evaluation metrics.

“This kit comprises three core components: a curated benchmark ( § 4.1), a controlled harness ( § 4.2), and tailored evaluation metrics ( § 4.3).”

May combine two claims.

Closed-source models incur a double penalty: inflated cost alongside degraded performance.

“By contrast, closed-source models incur a double penalty: inflated cost alongside degraded performance, echoing the negative utilities reported in Table 1.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Among the 89 tasks in D_need, Read & Write tasks are the most prevalent at 44, followed by 23 Writable tasks and 22 Read-Only tasks.

“Among the 89 tasks, Read & Write tasks are the most prevalent at 44, nearly half, followed by 23 Writable tasks and 22 Read-Only tasks.”

May combine two claims.

For open-source models under the Spec variant, the cost premium typically buys a performance gain; Qwen-3.8-Max trades a $1.0 cost increase for a 10.2-point rise in Success Rates.

“For open-source models under the Spec variant, this premium typically buys a performance gain: Qwen-3.8-Max,for Preprint instance, trades a $1.0 cost increase for a 10.2-point rise in Success Rates (SR).”

The quote only partly states this claim.

Sub-agent specialization (Spec) is the best practical MAD-SAE variant.

“sub-agent specialization (Spec) is the best practical practice;”

• Also stated in: § Abstract · plain

  “Sub-agent specialization (Spec) is the best MAD-SAE practice.”

• AssumptionRests on an assumption: The MSQ index validly integrates delegation and orchestration quality for comprehensive assessment.

May combine two claims.

Plan-1st fails to translate into gains over SA, with all utilities (Up, Ue, Uc) falling below the 50% parity line.

“This fails to translate into gains over SA, with all utilities (U p , U e , U c ) falling below the 50% parity line.”

Classified as probably not a substantial claim. May combine two claims.

There are 495 cases where both MAD-SAE and SA succeed, and MAD-SAE is either more efficient or cheaper (Cheaper-or-Efficient Success, CES).

“2. Cheaper-or-Efficient Success (CES) includes 495 cases where both MAD-SAE and SA succeed, and MAD-SAE is either more efficient (strictly fewer critical steps) or cheaper (strictly lower economic cost) than SA.”

May combine two claims.

GLM-5.3 has a UDR of 8.9%, covering 91.1% of D_need tasks, and an F1 hit of 51.1%, the highest overall.

“its UDR of 8.9% covers 91.1% of D need tasks, and its F 1 hit of 51.1% is the highest overall.”

• AssumptionRests on an assumption: The delegation priors annotated for tasks correctly identify whether sub-agents are needed.

May combine two claims.

MiniMax-M3's MAO cases net a gain of 10 successful tasks, offsetting a net loss of 4 from the remaining Non-MAO successes and yielding the model's overall success-rate gain of 3.6 points.

“Together with 14 MAO-labeled Success-to-Failure (S2F) cases, these MAO cases net a gain of 10 successful tasks, offsetting a net loss of 4 from the remaining Non-MAO successes and yielding the model's overall success-rate gain of 3.6 points.”

May combine two claims.

In the canvas-course-notion-wiki case, SA encounters numerous Notion API issues, whereas Spec resolves these Notion API bugs more efficiently through a dedicated sub-agent.

“SA encounters numerous Notion API issues when solving the task, whereas Spec resolves these Notion API bugs more efficiently through a dedicated sub-agent.”

May combine two claims.

Delegated Parallelism drives 88 Cheaper-or-Efficient-Success cases and 41 Failure-to-Success cases.

“Delegated Parallelism drives 88 Cheaper-or-Efficient-Success and 41 Failure-to-Success cases by converting an infeasible serial workload within a bounded context into a feasible parallel one”

May combine two claims.

For Qwen-3.8-Max, there are 20 Failure-to-Success cases and 3 Success-to-Failure cases.

“because its 20 Failure-to-Success (F2S) cases far exceed its 3 Success-to-Failure (S2F) cases.”

May combine two claims.

The 44 Read & Write tasks average 2.2 waves and 7.1 sub-agents.

“The 44 Read & Write tasks average 2.2 waves and 7.1 sub-agents.”

May combine two claims.

SA suffers from serial execution, where xlsx, pptx, and Google Sheet must be completed one after another, which weakens execution efficiency.

“SA suffers from serial execution, where xlsx, pptx, and Google Sheet must be completed one after another, which weakens execution efficiency.”

• AssumptionRests on an assumption: Fewer critical steps indicate greater execution efficiency.

May combine two claims.

Main-Agent-Only (MAO) dominates both sides for MiniMax-M3, accounting for 55 of 63 beneficial and 79 of 103 adverse cases.

“Main-Agent-Only (MAO) (Fig. 16) dominates both sides (Fig. 12), accounting for 55 of 63 beneficial and 79 of 103 adverse cases.”

May combine two claims.

In the canvas-enrollment-ppt-gsheet case, Spec perfectly matches the optimal solution, totaling 23 critical steps and saving 13 steps compared to SA.

“Spec perfectly matches this optimal solution, totaling 23 critical steps and saving 13 steps compared to SA.”

• AssumptionRests on an assumption: The Delegation Priors annotated by the authors represent the optimal solution for each task.
• AssumptionRests on an assumption: Fewer critical steps indicate greater execution efficiency.

May combine two claims.

Stock Market and Railway System consist mostly of Read & Write tasks (4 of 5 each).

“Stock Market and Railway System consist mostly of Read & Write tasks (4 of 5 each)”

May combine two claims.

Among GPT-5.6-Sol's 55 Costly-and-Inefficient-Success cases, Unnecessary Delegation contributes 25 and Unrealized Delegated Parallelism contributes 20.

“among its 55 Costly-and-Inefficient-Success cases, Unnecessary Delegation and Unrealized Delegated Parallelism (Fig. 19) contribute 25 and 20 respectively.”

• AssumptionRests on an assumption: The case categorization labels (e.g., Delegated Failure Propagation, Unnecessary Delegation) accurately capture the causes of success or failure.

May combine two claims.

The office-report-builder consumes 70 steps, more than SA's total critical steps (CSteps) of 51.

“This operation is semantically valid and reasonable, yet the office-report-builder consumes 70 steps, more than SA's total critical steps (CSteps) of 51.”

May combine two claims.

For Claude-Sonnet-5, Main-Agent-Only (MAO) cases have nearly balanced beneficial and adverse counts (46 vs. 43), with Failure-to-Success and Success-to-Failure both equal to 7, so MAO contributes no net change.

“MAO's beneficial and adverse counts are nearly balanced (46 vs. 43), with its Failure-to-Success (F2S) and Success-to-Failure (S2F) both equal to 7, so MAO contributes no net change.”

May combine two claims.

The 23 Writable tasks average 1.0 wave and 2.3 sub-agents.

“The 23 Writable tasks average 1.0 wave and 2.3 sub-agents.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Delegated Parallelism is an important component of GLM-5.3's Cheaper-or-Efficient-Success category.

“Delegated Parallelism is an important component of GLM-5.3'sCheaper-or-Efficient-Success category (see Fig. 5).”

May combine two claims.

Spec's enterprise-data-analyst runs only a few steps and returns a compressed, lossy summary, which the downstream Excel, Notion, Email builders directly trust such the summary.

“Here, Spec's enterprise-data-analyst runs only a few steps and returns a compressed, lossy summary, which the downstream Excel, Notion, Email builders directly trust such the summary.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Context Offloading is the primary component of GLM-5.3's Cheaper-or-Efficient-Success category.

“Context Offloading is the primary component of GLM-5.3'sCheaper-or-Efficient-Success category (see Fig. 5).”

May combine two claims.

Read & Write tasks require roughly as many sub-agents as Read-Only tasks but twice as many waves.

“Read & Write tasks require roughly as many sub-agents as Read-Only tasks but twice as many waves”

May combine two claims.

For DeepSeek-V4-Flash-0731, Failure-to-Success and Success-to-Failure are tied at 11 cases each, matching its zero success-rate change.

“Failure-to-Success (F2S) and Success-to-Failure (S2F) are tied at 11 cases each, matching its zero success-rate change in Fig. 3.”

May combine two claims.

GPT-5.6-Sol calls four sub-agents and executes them serially.

“However, GPT-5.6-Sol calls four sub-agents and executes them serially.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The MSQ Index leaderboard is dominated by open-source models.

“The index measures the comprehensive quality of Main-Agent Delegation and Sub-Agent Execution paradigm (detailed in § 4.3), which is dominated by open-source models”

May combine two claims.

The sub-agent delegation here achieves no parallelism and instead introduces rework costs.

“The sub-agent delegation here achieves no parallelism and instead introduces rework costs.”

May combine two claims.

In the scholarly-arxiv-survey-word-notion-gcal case, although the Delegation Prior expects parallel paper explorers and writable sub-agents, in Spec the main-agent completes the task alone.

“As shown in Fig. 16 (scholarly-arxiv-survey-word-notion-gcal), although the Delegation Prior expects parallel paper explorers and writable sub-agents to solve the problem more efficiently, in Spec the main-agent completes the task alone.”

Classified as probably not a substantial claim.

This Spec generates five serial singleagent waves, including a resume of an academic-literature-researcher.

“However, this Spec generates five serial singleagent waves, including a resume of an academic-literature-researcher.”

May combine two claims.

Spec perfectly uses five academic-literature-researcher sub-agents for parallel paper exploration, but then assigns an additional office-report-builder specifically to generate the docx report.

“Spec perfectly uses five academic-literature-researcher sub-agents for parallel paper exploration, but then assigns an additional office-report-builder specifically to generate the docx report.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Many models fail to call mcp__local__claim_done despite this requirement.

“Notably, many models fail to call mcp__local__claim_done despite this requirement.”

May combine two claims.

GPT-5.6-Sol has 137 adverse cases and 29 beneficial cases.

“With 137 adverse cases against only 29 beneficial ones”

May combine two claims.

In the terminal-yf-canvas-excel-gcal-email task, SA's serial solution hits the 100-step limit and fails to deliver, whereas Spec completes a successful delivery in only 67 steps.

“SA's serial solution hits the 100-step limit and fails to deliver, whereas Spec distributes the execution pressure of a single agent through reasonably parallelized paginated course exploration, completing a successful delivery in only 67 steps.”

• AssumptionRests on an assumption: Fewer critical steps indicate greater execution efficiency.

May combine two claims.

This unnecessary and unreasonable delegation makes Spec require 63 steps for a task that SA can complete in 25 critical steps.

“This unnecessary and unreasonable delegation makes Spec require 63 steps for a task that SA can complete in 25 critical steps.”

• AssumptionRests on an assumption: Critical steps (CSteps) are a valid measure of execution efficiency and cost.

May combine two claims.

This makes task solving more complex, requiring 18 more steps than the SA solution.

“This makes task solving more complex, requiring 18 more steps than the SA solution.”

• AssumptionRests on an assumption: Critical steps (CSteps) are a valid measure of execution efficiency and cost.

Probably not a substantial claim: may not pass S2 (checkable).

Real-world working tasks demand diverse and domain-specific tools.

“Real-world working tasks demand diverse and domain-specific tools inherently.”

• cites Li et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

SA is granted basic tools, including TodoList for progress tracking, MCP tools for specified task-solving, claim_done for task termination and python_execute for isolated python coding.

“SA is granted with basic tools, which includes TodoList for progress tracking, MCP tools for specified task-solving, claim_done for task termination and python_execute for isolated python coding.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Input, cached input, and output tokens are billed separately.

“As shown in Table 3, input, cached input, and output tokens are billed separately.”

Classified as probably not a substantial claim. May combine two claims.

The annotations are derived from each task's description, required tools, and expected deliverables, following two principles: (i) maximizing opportunities for parallel execution, and (ii) isolating exploratory sub-tasks within sub-agents to reduce context overload for main-agent.

“The annotations are derived from each task's description, required tools, and expected deliverables, following two principles: (i) maximizing opportunities for parallel execution, and (ii) isolating exploratory sub-tasks within sub-agents to reduce context overload for main-agent.”

Classified as probably not a substantial claim.

The planner sub-agent does not resolve any specific sub-tasks by design.

“The planer sub-agent is not included in the matching process, considering it does not resolve any specific sub-tasks by design.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Sub-agents operate under specialized constraints: they are strictly confined to their isolated workspaces, mandated to return concise result summaries to the main-agent, and explicitly prohibited from invoking the global claim_done termination signal.

“Conversely, sub-agents operate under specialized constraints: they are strictly confined to their isolated workspaces, mandated to return concise result summaries to the main-agent, and explicitly prohibited from invoking the global claim_done termination signal.”

May combine two claims.

These gains are traced to better single-agent solutions, context offloading, and sub-task parallelism rather than delegation for its own sake.

“with these gains traced to better single-agent solutions, context offloading, and sub-task parallelism rather than delegation for its own sake.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

For SA, the basic principle enforces efficient task execution, strict workspace boundary restrictions, and a mandatory completion protocol.

“For SA, the basic principle is enough to govern its behavior, by enforcing efficient task execution, strict workspace boundary restrictions, and a mandatory completion protocol.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The Spec approach is advocated by Cursor.

“Specialized (Spec): Retains the Gen Planner but granularizes the other agents into domainspecific roles, an approach advocated by Cursor (Cursor, 2026b).”

• cites Cursor, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

MAD-SAE's higher cost yields contingent payoff, benefiting most open-source models in both performance and efficiency while leaving closed-source models with higher cost and degraded performance.

“(3) MAD-SAE's higher cost yields contingent payoff, benefiting most open-source models in both performance and efficiency while leaving closed-source models with higher cost and degraded performance”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Agent behaviors are standardized through tailored principles in system prompts.

“Agent behaviors are standardized through tailored principles in system prompts.”

May combine two claims.

Under MAD-SAE, no sub-agent is delegated in Main-Agent-Only (MAO) cases, and the benefit comes from the main-agent finding a correct, cheaper, or more step-efficient solution than SA.

“1. Main-Agent-Only (MAO): Under MAD-SAE, no sub-agent is delegated.The benefit comes from the main-agent finding a correct, cheaper, or more step-efficient solution than SA.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The Gen variant aligns with Kimi-Code's built-in taxonomy and corresponds to general-purpose sub-agents in Claude Code and TRAE designed for complex research and code modification.

“This aligns with Kimi-Code's built-in taxonomy (Moonshot AI, 2026b) and corresponds to the general-purpose sub-agents in Claude Code (Anthropic, 2026b) and TRAE (TRAE Team, 2026) designed for complex research and code modification.”

• cites Moonshot AI, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Anthropic, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites TRAE Team, 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

In Context Offloading (CO), isolated sub-agent contexts absorb heavy tasks that would otherwise occupy the SA context, allowing the main-agent to focus on the core of the task and thereby gain benefits.

“2. Context Offloading (CO): Isolated sub-agent contexts absorb heavy tasks that would otherwise occupy the SA context, allowing the main-agent to focus on the core of the task and thereby gain benefits.”

Classified as probably not a substantial claim.

CSteps captures the bottleneck effect of parallel execution, where each wave completes only when its slowest sub-agent finishes.

“For MAD-SAE, it captures the bottleneck effect of parallel execution, where each wave completes only when its slowest sub-agent finishes.”

May combine two claims.

Sub-agents, via isolated contexts, offload intensive information from the main-agent, preventing context bloat from degrading decisions.

“better and, via isolated contexts, offload intensive information (e.g., exploration findings) from the main-agent, preventing context bloat from degrading decisions (Yu et al., 2026;Cursor, 2026b).”

• cites Yu et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Cursor, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

We assign equal weights (1/3) to performance, efficiency, and cost in our experiments to ensure a balanced evaluation.

“While these weights can be flexibly tailored to specific priorities, we assign equal weights (1/3) in our experiments to ensure a balanced evaluation.”

Classified as probably not a substantial claim. May combine two claims.

Within MAD-SAE, the main-agent additionally accesses Agent and AgentSwarm besides basic tools, to delegate sub-agents for heterogeneous or homogeneous sub-tasks, while sub-agents receive role-specific tool allowlists and runtime exclusions.

“Within MAD-SAE, the main-agent additionally accesses Agent and AgentSwarm besides basic tools, to delegate sub-agents for heterogeneous or homogeneous sub-tasks, while sub-agents receive role-specific tool allowlists and runtime exclusions.”

May combine two claims.

Gen's underperformance stems from overly conservative delegation, leaving over half of D_need tasks without MAD-SAE benefits.

“Gen's underperformance stems from overly conservative delegation: despite a leading P hit (48.0%), its low R hit (18.8%) and high UDR (52.8%) leave over half of D need tasks without MAD-SAE benefits.”

• AssumptionRests on an assumption: The delegation priors annotated for tasks correctly identify whether sub-agents are needed.

Classified as probably not a substantial claim.

All experiments proceed as fully autonomous, single-turn, multi-step runs with zero human intervention.

“All experiments proceed as fully autonomous, single-turn, multi-step runs with zero human intervention.”

May combine two claims.

Kimi-Code is an open-source framework with native sub-agent support.

“Kimi-Code is an open-source framework with native sub-agent support.”

• cites Moonshot AI, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Spec avoids the overly conservative delegation of Gen and the aggressive over-delegation of Plan-1st.

“Spec avoids the overly conservative delegation of Gen, and the aggressive over-delegation of Plan-1st, achieving the highest MSQ with 20.8% among practical variants in Table 1(a).”

• AssumptionRests on an assumption: The MSQ index validly integrates delegation and orchestration quality for comprehensive assessment.

May combine two claims.

For closed-source models, MAD-SAE tends to raise cost while degrading both performance and efficiency, making SA the more practical choice.

“For closed-source models, in contrast, it tends to raise cost while degrading both performance and efficiency, making SA the more practical choice.”

May combine two claims.

For most open-source models, MAD-SAE with Spec is the preferable configuration, delivering gains in both performance and efficiency with more cost.

“For most open-source models, MAD-SAE with Spec is the preferable configuration, delivering gains in both performance and efficiency with more cost.”

May combine two claims.

Under near-perfect sub-agent delegation, Oracle isolates the trade-off of MAD-SAE: extra cost buys efficiency, but not necessarily performance gains.

“Under near-perfect sub-agent delegation, Oracle isolates the trade-off of MAD-SAE: extra cost buys efficiency, but not necessarily performance gains.”

Classified as probably not a substantial claim.

We functionally tag both golden and delegated sub-agents based on their sub-task semantics, using 24 labels and DeepSeek-V4.1-Flash.

“To match sub-agents defined under different conventions (e.g., Coder of Gen v.s.Office-Report-Builder of Spec), we functionally tag both golden and delegated sub-agents based on their sub-task semantics, using 24 labels (details in Appx.B.2) and DeepSeek-V4.1-Flash(DeepSeek-AI, 2026).”

• cites DeepSeek-AI, 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The Oracle variant aligns with the explicit sub-agent invocation feature highlighted in the official documentation of various frameworks.

“This aligns with the explicit sub-agent invocation feature highlighted in the official documentation of various frameworks (Moonshot AI, 2026b; OpenAI, 2026a; Anthropic, 2026b; Cursor, 2026a; TRAE Team, 2026).”

• cites Moonshot AI, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites OpenAI, 2026aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Anthropic, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable).

Problems in working scenarios are often complicated, involving multiple sub-tasks.

“Additionally, problems in working scenarios are often complicated, involving multiple sub-tasks (Zhang et al., 2026), as the example illustrated in Figure 2(a).”

• cites Zhang et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Models prompted under MAD-SAE occasionally overfit to its semantic patterns yet serendipitously converge on more efficient single-agent solutions.

“suggesting that models prompted under MAD-SAE occasionally overfit to its semantic patterns yet serendipitously converge on more efficient single-agent solutions.”

Classified as probably not a substantial claim.

The evaluation uses a controlled harness that standardizes the execution principle and tool accessibility for MAD-SAE and the Single-Agent (SA) baseline.

“(2) A controlled harness standardizing the execution principle and tool accessibility for MAD-SAE and the Single-Agent (SA) baseline ( § 4.2);”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The SA paradigm is universally supported.

“Naturally, the SA paradigm, serving as the most direct runtime solution, is universally supported.”

Probably not a substantial claim: may not pass S3 (load-bearing).

For MAD-SAE, the main-agent inherits the basic principle of SA and is augmented with sub-agent delegation norms, available sub-agent profiles, and concrete few-shot delegation examples to guide appropriate delegation.

“For MAD-SAE, the main-agent inherits the basic principle of SA, and is further augmented with sub-agent delegation norms, available sub-agent profiles, and concrete few-shot delegation examples to guide appropriate delegation.”

Classified as probably not a substantial claim.

For SA, CSteps reduces to the total number of sequential steps.

“For SA, CSteps reduces to the total number of sequential steps.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Built-in terminal tools are globally disabled, and terminal access is granted strictly per task and safely supported via a local mock terminal MCP server to prevent unintended system exploitation.

“To prevent unintended system exploitation, built-in terminal tools are globally disabled, and the terminal access is granted strictly per task and safely supported via a local mock terminal MCP server.”

Classified as probably not a substantial claim.

The design of subtask unit with function labels avoids penalizing semantically equivalent delegations that differ only in sub-agent count or specialization.

“This design avoids penalizing semantically equivalent delegations that differ only in sub-agent count or specialization.”

Classified as probably not a substantial claim. May combine two claims.

MS-Eval assesses sub-agent delegation and orchestration comprehensively, revealing the benefits and drawbacks of MAD-SAE in MCP-intensive working scenarios.

“Thus, MS-Eval assesses the sub-agent delegation and orchestration comprehensively, revealing the benefits and drawbacks of MAD-SAE in MCP-intensive working scenarios.”

• AssumptionRests on an assumption: The MS-Eval benchmark tasks are representative of MCP-intensive working scenarios.

May combine two claims.

Overall, open-source models dominate MSQ, with more appropriate sub-agent delegation and thus greater orchestration gains in performance and efficiency.

“verall, open-source models dominate MSQ, with more appropriate sub-agent delegation and thus greater orchestration gains in performance and efficiency.”

Probably not a substantial claim: may not pass S3 (load-bearing).

inputCacheCreation is counted toward cumulative input tokens, affecting tiered-pricing models such as GPT-5.6-Soland MiniMax-M3.

“However, since it essentially writes prefixes into the KV cache and thus occupies the context window, it is counted toward the cumulative input tokens, affecting tiered-pricing models such as GPT-5.6-Soland MiniMax-M3.”

Classified as probably not a substantial claim. May combine two claims.

We disable Kimi-Code's built-in skills and strictly manage the execution principle and tool accessibility to rigorously isolate the effects of execution paradigms under specified working scenarios.

“To rigorously isolate the effects of execution paradigms under specified working scenarios, we disable Kimi-Code's built-in skills and strictly manage the executation principle and tool accessibility.”

May combine two claims.

Gains from MAD-SAE are traced to more efficient single-agent solutions, effective context offloading, and genuine sub-task parallelism.

“Our case study traces these gains to more efficient singleagent solutions, effective context offloading, and genuine sub-task parallelism”

• AssumptionRests on an assumption: The MSQ index validly integrates delegation and orchestration quality for comprehensive assessment.

Probably not a substantial claim: may not pass S3 (load-bearing).

All configurations correspond to execution strategies supported by mainstream agent harness frameworks.

“All configurations correspond to execution strategies supported by mainstream agent harness frameworks (Moonshot AI, 2026b;OpenAI, 2026a;Anthropic, 2026b;Cursor, 2026a;TRAE Team, 2026).”

• cites Moonshot AI, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites OpenAI, 2026aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Anthropic, 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The subsequent process of producing Literature_Review.docx is not cumbersome and can be handled by the main-agent itself.

“The subsequent process of producing Literature_Review.docx is not cumbersome and can be handled by the main-agent itself.”

• AssumptionRests on an assumption: The annotated delegation priors represent the optimal solution for the tasks.

May combine two claims.

This error propagation causes GPT-5.6-Sol to fail a task that SA solves correctly with 21 CSteps, despite spending 41 CSteps.

“This error propagation causes GPT-5.6-Sol to fail a task that SA solves correctly with 21 CSteps, despite spending 41 CSteps.”

• AssumptionRests on an assumption: Critical steps (CSteps) are a valid measure of execution efficiency and cost.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

This illustrates the reliance of working scenarios on domain-specific tools and the complexity of tasks involving multiple sub-tasks.

“This illustrates the reliance of working scenarios on domain-specific tools and the complexity of tasks involving multiple sub-tasks.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The main-agent is forced to call the Planner sub-agent for task decomposition and delegation planning before any other action, then follows the plan.

“The main-agent is forced to call the Planner sub-agent for task decomposition and delegation planning before any other action, then follows the plan.”

May combine two claims.

For DeepSeek-V4-Flash-0731, delegation provides only a limited correctness benefit, while extensive redundant delegation still adds overhead, consistent with Ue = 48.0% and Uc = 33.1%.

“Overall, delegation provides only a limited correctness benefit here, while extensive redundant delegation still adds overhead, consistent with U e = 48.0%and U c = 33.1% in the same table.”

Classified as probably not a substantial claim. May combine two claims.

Using these MCP servers, the agent must complete three milestone sub-tasks: (1) inspect survey-methodology pages to understand the local arXiv candidate space relevant to the task, (2) select exactly five source-supported papers, and (3) create the two required files Survey_Data.xlsx and NLP_Survey.pptx.

“Using these MCP servers, the agent must complete three milestone sub-tasks: (1) inspect survey-methodology pages to understand the local arXiv candidate space relevant to the task, (2) select exactly five source-supported papers, and (3) create the two required files Survey_Data.xlsxand NLP_Survey.pptx.”

May combine two claims.

For Qwen-3.8-Max, its utilities (Up = 54.4%, Uc = 38.4%, Ue = 49.9%) indicate higher success and higher cost with roughly flat efficiency.

“a pattern consistent with its utilities in Table 6: U p = 54.4%,U c = 38.4%, and U e = 49.9%,indicating higher success and higher cost with roughly flat efficiency.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Task descriptions are aligned with evaluation criteria to reduce false negatives.

“align task descriptions with evaluation criteria to reduce false negatives”

• AssumptionRests on an assumption: Aligning task descriptions with evaluation criteria reduces false negatives.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

This is a representative working case from the Academic Research scenario.

“This is a representative working case from the Academic Research scenario.”

• AssumptionRests on an assumption: The benchmark tasks are representative of real-world working scenarios.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Such detailed delegation priors not only indicate whether the current task requires delegating sub-agents, but also provide golden priors for the Oracle Study.

“Such detailed delegation priors not only indicate whether the current task requires delegating sub-agents, but also provide golden priors for the Oracle Study.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Planner, Explorer, Academic-Literature-Researcher, Enterprise-Data-Analyst, Financial-Market-Analyst, and Web-Domain-Researcher are read-only, whereas Coder, External-Workflow-Operator, and Office-Report-Builder are writable.

“In particular, Planner, Explorer, Academic-Literature-Researcher, Enterprise-Data-Analyst, Financial-Market-Analyst, and Web-Domain-Researcher are read-only, whereas Coder, External-Workflow-Operator, and Office-Report-Builder are writable.”

May combine two claims.

The main-agent in MiniMax-M3 generates many successes with added overhead and no efficiency gain.

“indicating that the main-agent likewise generates many successes with added overhead and no efficiency gain.”

• AssumptionRests on an assumption: The case categorization labels (e.g., Delegated Failure Propagation, Unnecessary Delegation) accurately capture the causes of success or failure.

May combine two claims.

Offloading error messages to a sub-agent keeps the main-agent's context cleaner and allows it to focus on core task-solving logic, thereby improving efficiency.

“This offloads the error messages that would otherwise occupy the main-agent's context, keeping it cleaner and allowing it to focus on core task-solving logic, thereby improving efficiency.”

May combine two claims.

For Qwen-3.8-Max, delegation simultaneously drives additional successes and introduces redundancy on a subset of tasks.

“Delegation thus simultaneously drives additional successes and introduces redundancy on a subset of tasks”

May combine two claims.

Context offloading and parallelism of subagents convert extra cost into efficiency and performance gains, whereas unnecessary, unverified or redundant delegation turns the same cost into pure overhead.

“Context offloading and parallelism of subagents convert extra cost into efficiency and performance gains, whereas unnecessary, unverified or redundant delegation turns the same cost into pure overhead”

May combine two claims.

Failure propagation explains GPT-5.6-Sol's correctness regression, and redundant, unrealized delegation explains its execution overhead.

“Failure propagation explains the correctness regression, and redundant, unrealized delegation explains the execution overhead.”

• AssumptionRests on an assumption: The case categorization labels (e.g., Delegated Failure Propagation, Unnecessary Delegation) accurately capture the causes of success or failure.

Classified as probably not a substantial claim.

Plan-1st extends Gen's sub-agent definitions with a mandatory initial planning step: the first action must be a Planner call that determines sub-task partitioning and subsequent sub-agent scheduling.

“Plan-1st extends Gen's sub-agent definitions with a mandatory initial planning step: the first action must be a Planner call that determines sub-task partitioning and subsequent sub-agent scheduling.”

May combine two claims.

Main-agent improvement in MiniMax-M3 masks a regression within the delegation subset, and the larger adverse count overall cannot be attributed to delegation overhead alone.

“main-agent improvement masks a regression within the delegation subset, and the larger adverse count overall cannot be attributed to delegation overhead alone.”

May combine two claims.

GLM-5.3-Flash's more salient benefit is execution efficiency, matching its top-ranked Ue = 54.0% in Table 6.

“GLM-5.3-Flash'smore salient benefit is execution efficiency, matching its top-ranked U e = 54.0% in Table 6.”

Probably not a substantial claim: may not pass S4 (based).

The main-agent autonomously decides when and how to delegate to Coder, Explorer, and Planner.

“The main-agent autonomously decides when and how to delegate to Coder, Explorer, and Planner.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Oracle serves as the variant for the golden study under MAD-SAE. It fully inherits Main-Agent Principles & Tools (Gen) in Table 10, except that it appends the delegation prior directly to the end of the task description.

“Oracle serves as the variant for the golden study under MAD-SAE.It fully inherits Main-Agent Principles & Tools (Gen) in Table 10, except that it appends the delegation prior directly to the end of the task description.”

May combine two claims.

GLM-5.3's Uc = 40.5% shows that its gains still come at added cost, consistent with a higher-cost, higher-success pattern (e.g., Costly-and-Inefficient-Success).

“Its U c = 40.5% further shows that these gains still come at added cost, consistent with the higher-cost, higher-success pattern it occupies, e.g., Costly-and-Inefficient-Success, in Fig. 3.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

It requires the following MCP servers: playwright_with_chunk for web browsing, terminal for command-line operations, file inspection, and verification, arxiv-latex for searching, listing, reading, and downloading arXiv papers, and excel and pptx for creating and writing xlsx and pptx files.

“It requires the following MCP servers: playwright_with_chunk for web browsing, terminal for command-line operations, file inspection, and verification, arxiv-latex for searching, listing, reading, and downloading arXiv papers, and excel and pptx for creating and writing xlsx and pptx files.”

May combine two claims.

Claude-Sonnet-5 is hurt by both delegation failures and inefficient main-agent execution.

“Claude-Sonnet-5 is thus hurt by both delegation failures and inefficient main-agent execution”

May combine two claims.

GPT-5.6-Sol's over-delegation undermines both correctness and efficiency.

“GPT-5.6-Sol:over-delegation undermines both correctness and efficiency.”

May combine two claims.

K3's MAD-SAE benefits are jointly supported by both better main-agent execution and high-quality delegation, which explain its broad improvement in performance, cost, and efficiency and its three orchestration utilities all exceeding 50%.

“These results demonstrate clearly that K3's MAD-SAE benefits are jointly supported by both the better main-agent execution and the high-quality delegation, which explain K3's broad improvement in performance, cost, and efficiency in Fig. 3, as well as three orachestration utilities all exceeding 50% in Table 6.”

Probably not a substantial claim: may not pass S3 (load-bearing).

This helps us understand MAD-SAE's utility under near-perfect delegation.

“This helps us understand MAD-SAE's utility under near-perfect delegation.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Different sub-agent types may have different allowed MCP tools, but none are granted access to Agent, AgentSwarm, or the task-termination tool claim_done.

“For sub-agent principles and tools (Appx.E.2.3), different sub-agent types may have different allowed MCP tools, but none are granted access to Agent, AgentSwarm, or the task-termination tool claim_done.”

May combine two claims.

Better Main-Agent-Only Solutions dominates Minimax-M3's Failure-to-Success category and is the main reason MAD-SAE (Spec) improves this model's performance.

“Better Main-Agent-Only Solutions dominates Minimax-M3's Failure-to-Success category and is the main reason MAD-SAE (Spec) improves this model's performance (see Fig. 12).”

May combine two claims.

This significantly affects execution efficiency and increases execution cost.

“This significantly affects execution efficiency and increases execution cost.”

• AssumptionRests on an assumption: Critical steps (CSteps) are a valid measure of execution efficiency and cost.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The main-agent resolves the task independently with only the granted MCP tools; all built-in shell, file, and web tools are disallowed.

“The main-agent resolves the task independently with only the granted MCP tools; all built-in shell, file, and web tools are disallowed.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The benchmark covers all Toolathlon-Gym scenarios.

“We cover all Toolathlon-Gym scenarios”

Probably not a substantial claim: may not pass S3 (load-bearing).

General (Gen) is a MAD-SAE variant that defines three sub-agents: a read-only Plan for strategy planning, a read-only Explore for investigation, and a writable Coder for editing.

“General (Gen) is a MAD-SAE variant that defines three sub-agents: a read-only Plan for strategy planning, a read-only Explore for investigation, and a writable Coder for editing.”