Decentralized Multi-Agent Systems with Shared Context

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

There is no universally optimal prompt across models; different model families may require tailored prompts to elicit the intended behavior.

“Third, as noted in prior work (Zhang et al., 2025), there is no universally optimal prompt across models; different model families may require tailored prompts to elicit the intended behavior.”

• cites Zhang et al., 2025 sourcePartly supported

  Appendix B (p. 17) says that using the same RLM system prompt for GPT-5 and Qwen3-Coder produced undesirable behavior, requiring a model-specific addition. This supports the need to tailor prompts in some cases, but the paper does not establish the broader claim that no prompt can be universally optimal across models. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

Classified as probably not a substantial claim.

Recursive Language Models (RLMs) process long contexts by recursively selecting context segments, issuing sub-calls, and composing the resulting partial answers.

“Recursive Language Models (RLMs) (Zhang et al., 2025) process long contexts by recursively selecting context segments, issuing sub-calls, and composing the resulting partial answers.”

• cites Zhang et al., 2025 sourceSupported

May combine two claims.

Blackboard-based multi-agent methods write raw or lightly structured messages to the board and still route coordination through a selection step or a central poster.

“the blackboard-based methods write raw or lightly structured messages to the board and still route coordination through a selection step or a central poster.”

• cites Han and Zhang, 2025 sourceNot checked — no full text of the source
• cites Salemi et al., 2025 sourcePartly supported

  Section 3 describes a main agent posting requests to the blackboard, helpers deciding whether to respond, and the main agent deciding whether to use their responses. Section 4.2 gives examples of requests and responses, but does not establish that blackboard-based methods generally use raw or lightly structured messages; the paper describes its own method rather than that broader class. (LLM, conf=0.82)

  Experimental — accuracy not yet measured

May combine two claims.

On SWE-bench Verified, DELM achieves the best performance across Avg.@1, Pass@2, and Pass@4, with gains of up to 10.5 percentage points over the strongest baseline, while reducing cost per task by roughly 50%.

“On SWE-bench Verified, DELM achieves the best performance across Avg.@1, Pass@2, and Pass@4, with gains of up to 10.5 percentage points over the strongest baseline, while reducing cost per task by roughly 50%.”

May combine two claims.

DELM improves both software-engineering test-time scaling and long-context reasoning.

“Empirically, DELM improves both software-engineering test-time scaling and long-context reasoning.”

May combine two claims.

On LongBench-v2 Multi-Doc QA, DELM achieves the highest average accuracy across four frontier model families, improving over the strongest baseline by up to 5.7 percentage points.

“On LongBench-v2 Multi-Doc QA, DELM achieves the highest average accuracy across four frontier model families, improving over the strongest baseline by up to 5.7 percentage points.”

May combine two claims.

On SWE-bench Verified, DELM achieves the strongest performance across test-time scaling metrics, reaching 77.4% pass@4 while reducing cost to $0.12 per task which is only roughly half of the baselines.

“On SWEbench Verified ( § 4.2), as shown in Table 1, DELM achieves the strongest performance across test-time scaling metrics, reaching 77.4% pass@4 while reducing cost to $0.12 per task which is only roughly half of the baselines.”

Classified as probably not a substantial claim.

The verifier rejects an unsupported damages claim in a legal question, preventing it from entering shared context.

“The verifier (an LLM) therefore rejects the update:”

• AssumptionRests on an assumption: The LLM verifier used in admission-time verification reliably identifies unsupported or distorted updates.

May combine two claims.

On LongBench-v2, DELM achieves the highest average accuracy across four frontier models, improving over the best baseline by up to 5.7 percentage points.

“On LongBench-v2 ( § 4.3), as shown in Table 2, DELM achieves the highest average accuracy across four frontier models, improving over the best baseline by up to 5.7 percentage points.”

May combine two claims.

On OOLONG, DELM underperforms RLM in both average accuracy and cost.

“On OOLONG, however, DELM underperforms RLM in both average accuracy and cost.”

May combine two claims.

DELM is largely insensitive to its gist configuration: accuracy is stable once the gist is long enough and across summarizers of varying cost.

“(b, c) DELM is largely insensitive to its gist configuration: accuracy is stable once the gist is long enough (b) and across summarizers of varying cost (c).”

May combine two claims.

DELM achieves the best or tied-best result in most domain-model combinations on LongBench-v2, suggesting that the benefit comes from a general improvement in evidence selection and reuse rather than from a single model or domain.

“DELM also achieves the best or tied-best result in most domain-model combinations, suggesting that the benefit comes from a general improvement in evidence selection and reuse rather than from a single model or domain.”

May combine two claims.

Even with Claude Opus 4.6, DELM still achieves the highest accuracy across Avg.@1, Pass@2, and Pass@4, while remaining close to the lowest-cost method, only $0.02 per task above mini-SWE-agent.

“Even so, DELM still achieves the highest accuracy across Avg.@1, Pass@2, and Pass@4, while remaining close to the lowest-cost method, only $0.02 per task above mini-SWE-agent.”

May combine two claims.

AOrchestra-Parallel improves Avg.@1 over the original AOrchestra, but performs worse on Pass@2 and Pass@4.

“AOrchestra-Parallel improves Avg.@1 over the original AOrchestra, but performs worse on Pass@2 and Pass@4.”

May combine two claims.

On LongBench-v2 Multi-Doc QA, DELM achieves higher average accuracy than RLM at roughly the same cost per task.

“On LongBench-v2, DELM achieves higher average accuracy than RLM at roughly the same cost per task.”

May combine two claims.

With Gemini 3 Flash on SWE-bench Verified, DELM reaches 65.7% Avg.@1, 72.9% Pass@2, and 77.4% Pass@4, outperforming all baselines on every metric.

“With Gemini 3 Flash, DELM reaches 65.7% Avg.@1, 72.9% Pass@2, and 77.4% Pass@4, outperforming all baselines on every metric.”

May combine two claims.

DELM reduces cost to $0.12 per task on SWE-bench Verified, roughly half the cost of the strongest agentic baselines.

“At the same time, DELM reduces cost to $0.12 per task, roughly half the cost of the strongest agentic baselines.”

May combine two claims.

On OOLONG, vanilla DELM underperforms RLM because the benchmark requires exact row-level aggregation, where code-mediated execution is especially useful; combining RLM with DELM yields the best accuracy and lowest cost.

“On OOLONG ( § 5), as shown in Table 3, vanilla DELM underperforms RLM because the benchmark requires exact row-level aggregation, where code-mediated execution is especially useful; however, combining RLM with DELM yields the best accuracy and lowest cost, showing that DELM extends beyond conversational agents to code-based reasoning workflows.”

May combine two claims.

The combined DELM+RLM method achieves the best accuracy and lowest cost on both LongBench-v2 Multi-Doc QA and OOLONG benchmarks.

“As shown in Table 3, the combined method achieves the best accuracy and lowest cost on both benchmarks, indicating that RLM and DELM are complementary rather than competing approaches.”

May combine two claims.

Removing admission-time verification on LongBench-v2 causes the largest drop, from 60.1% to 55.2%, showing that unsupported claims can corrupt downstream reasoning when they enter the shared context unchecked.

“Removing verification causes the largest drop, from 60.1% to 55.2%, showing that unsupported claims can corrupt downstream reasoning when they enter the shared context unchecked.”

May combine two claims.

On the LongBench-v2 Multi-Doc QA benchmark, DELM's accuracy improves from 58.3% at 50-token gist length to 60.1% at 100 tokens, then plateaus at 60.3% at 150 tokens.

“Accuracy improves from 58.3% at 50 tokens to 60.1% at 100 tokens, then plateaus at 60.3% with 150 tokens.”

May combine two claims.

On SWE-bench Verified, DELM achieves higher pass rates while reducing cost compared to baselines.

“On SWE-bench Verified, DELM improves test-time scaling by making discoveries and failures reusable across parallel attempts, achieving higher pass rates while reducing cost.”

Probably not a substantial claim: may not pass S4 (based).

As the number of subtasks grows, the central controller in centralized MAS becomes a communication and integration bottleneck.

“As the number of subtasks grows, this controller becomes a communication and integration bottleneck.”

May combine two claims.

DELM decentralizes coordination through parallel agents, a shared verified context, and a task queue.

“We propose Decentralized Language Models (DELM), a MAS framework that decentralizes coordination through parallel agents, a shared verified context, and a task queue.”

May combine two claims.

Coupling parallel threads through a main agent can make attempts more consistent, but may also reduce exploration diversity.

“This suggests that coupling parallel threads through a main agent can make attempts more consistent, but may also reduce exploration diversity.”

Classified as probably not a substantial claim.

Compression methods that discard fine-grained information cannot reliably recover it when later reasoning requires precise details.

“These methods reduce context length, but once fine-grained information is discarded, it cannot be reliably recovered when later reasoning requires precise details.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

These memory-augmented systems make memory persistent, but retrieval is usually flat: a memory item is either selected into context or omitted.

“These systems make memory persistent, but retrieval is usually flat: a memory item is either selected into context or omitted.”

Classified as probably not a substantial claim. May combine two claims.

In DELM, after a gist is admitted into C, later agents can build on the finding, avoid a falsified hypothesis, or reuse a partial solution without waiting for a central controller to redistribute it.

“Agents claim ready subtasks from T asynchronously; after a gist is admitted into C, later agents can build on the finding, avoid a falsified hypothesis, or reuse a partial solution without waiting for a central controller to redistribute it.”

May combine two claims.

DELM's unfolding mechanism enables coordination over the full problem while incurring detailed inspection costs only for relevant evidence.

“This coarse-to-fine access pattern enables coordination over the full problem while incurring detailed inspection costs only for relevant evidence.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

DELM inherits the decomposition quality of agents: overly coarse decompositions leave agents with under-specified subtasks, while overly aggressive decompositions can spawn unnecessary agents and overcomplicate reasoning.

“Second, DELM inherits the decomposition quality of agents.Overly coarse decompositions leave agents with under-specified subtasks, while overly aggressive decompositions can spawn unnecessary agents and overcomplicate reasoning.”

May combine two claims.

Scalable multi-agent systems require not only more parallel agents, but also a reliable communication substrate for sharing progress across them.

“These results suggest that scalable multi-agent systems require not only more parallel agents, but also a reliable communication substrate for sharing progress across them.”

Probably not a substantial claim: may not pass S4 (based).

State-based communication is useful only if the shared context remains usable as the problem grows.

“State-based communication is useful only if the shared context remains usable as the problem grows.”

Classified as probably not a substantial claim.

In DELM, each Stage-1 bullet with a reference (h, t) is accepted only if the head h and tail T both appear, in order and verbatim, in the underlying source unit u.

“Specifically, each Stage-1 bullet b with a reference (h, t) is accepted only if the head h and tail T both appear, in order and verbatim, in the underlying source unit u.”

May combine two claims.

In DELM, the write-before-publish ordering ensures that every visible label can be unfolded without a race, that later agents observe only fully verified entries, and that slow summarization or verification calls do not impose a global synchronization barrier.

“This write-before-publish ordering ensures that every visible label can be unfolded without a race, that later agents observe only fully verified entries, and that slow summarization or verification calls do not impose a global synchronization barrier.”

May combine two claims.

In DELM, unfolded content is local to the requesting call and is not written back to the shared context C, so subsequent agents still observe only the gist layer.

“Importantly, unfolded content is local to the requesting call and is not written back to the shared context C, so subsequent agents still observe only the gist layer.”

May combine two claims.

RLM's centralized aggregation is less suitable for natural-language multi-document reasoning, helping explain RLM's weaker LongBench-v2 performance.

“This centralized aggregation is less suitable for naturallanguage multi-document reasoning, helping explain RLM's weaker LongBench-v2 performance.”

May combine two claims.

Both admission-time verification and hierarchical summarization contribute to DELM's gains on LongBench-v2.

“Section 4.3.1 further shows that both admission-time verification and hierarchical summarization contribute to these gains.”

May combine two claims.

As a result, useful discoveries may remain local to one trajectory, while unsupported claims or softened constraints can propagate through later reasoning.

“As a result, useful discoveries may remain local to one trajectory, while unsupported claims or softened constraints can propagate through later reasoning.”

Classified as probably not a substantial claim.

In the DELM+RLM hybrid, each worker's output is admitted into the shared context only after passing the verification gate.

“Each worker's output is admitted into the shared context only after passing the verification gate.”

May combine two claims.

This design prevents detailed intermediate content from polluting the shared context while preserving access to fine-grained evidence when necessary.

“This design prevents detailed intermediate content from polluting the shared context while preserving access to fine-grained evidence when necessary.”

May combine two claims.

Both admission-time verification and hierarchical summarization matter for DELM on LongBench-v2, with verification contributing the larger gain.

“Thus, both components matter, with verification contributing the larger gain.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The gains with Claude Opus 4.6 are smaller, likely because the base model is already strong and leaves less room for coordination to help.

“The gains with Claude Opus 4.6 are smaller, likely because the base model is already strong and leaves less room for coordination to help.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

DELM treats the shared context as curated, verified state: agents coordinate fully asynchronously through a task queue with no central controller, every entry is admitted only after verification against its supporting evidence, and entries are stored as compact gists that unfold to finer detail on demand, keeping the shared state both reliable and scalable as the number of agents grows.

“In contrast, DELM treats the shared context as curated, verified state: agents coordinate fully asynchronously through a task queue with no central controller, every entry is admitted only after verification against its supporting evidence, and entries are stored as compact gists that unfold to finer detail on demand, keeping the shared state both reliable and scalable as the number of agents grow”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In DELM, raw retrieval is neighborhood-aware: requesting sub-chunk n returns n±1 as well, which helps absorb off-by-one citation errors.

“Additionally, raw retrieval is also neighborhood-aware: requesting sub-chunk n returns n±1 as well, which helps absorb off-by-one citation errors.”

Probably not a substantial claim: may not pass S4 (based).

Centralized MAS are largely prompt-routed: intermediate progress is passed through the main agent, rewritten into subsequent prompts, and selectively exposed to other agents.

“Centralized MAS are largely promptrouted: intermediate progress is passed through the main agent, rewritten into subsequent prompts, and selectively exposed to other agents.”

May combine two claims.

This hierarchy makes the shared context both global and recoverable.

“This hierarchy makes the shared context both global and recoverable.”

May combine two claims.

In DELM, the shared-context design improves KV-cache reuse because C is largely stable and accumulative, and consistently placed at the beginning of each model invocation, forming a persistent prefix across calls.

“Because C is largely stable and accumulative, and consistently placed at the beginning of each model invocation, it forms a persistent prefix across calls.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Sharing raw documents or full agent traces preserves maximal information, but quickly overwhelms each agent's context window and increases cost.

“Sharing raw documents or full agent traces preserves maximal information, but quickly overwhelms each agent's context window and increases cost.”

May combine two claims.

Compact sharing preserves the reusable discovery while avoiding the cost of exposing every peer to the raw trace, explaining why DELM solves the task at much lower cost.

“Thus, compact sharing preserves the reusable discovery while avoiding the cost of exposing every peer to the raw trace, explaining why DELM solves the task at much lower cost.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In DELM, only gists that pass the verification check are admitted to C; otherwise, the update is rejected, regenerated, or returned to the task queue T with a rejection reason, up to a fixed retry limit.

“Only gists that pass this check are admitted to C; otherwise, the update is rejected, regenerated, or returned to the task queue T with a rejection reason, up to a fixed retry limit.”

Classified as probably not a substantial claim. May combine two claims.

Sharing only compact summaries is cheaper, but risks losing details, qualifications, or cross-document evidence needed for reliable reasoning.

“Sharing only compact summaries is cheaper, but risks losing details, qualifications, or cross-document evidence needed for reliable reasoning.”

May combine two claims.

By admitting only compact, verified updates into shared state, DELM turns intermediate progress into reusable problem state: agents can build on prior findings, avoid repeated failures, preserve constraints, and recover detailed evidence only when needed.

“By admitting only compact, verified updates into shared state, DELM turns intermediate progress into reusable problem state: agents can build on prior findings, avoid repeated failures, preserve constraints, and recover detailed evidence only when needed.”

May combine two claims.

DELM is complementary to RLM, where decentralized validated state improves programmatic aggregation.

“We further show that DELM is complementary to RLM, where decentralized validated state improves programmatic aggregation.”

May combine two claims.

For a long source unit, direct gist-to-raw unfolding can be unreliable because the gist may not preserve enough detail to identify the exact raw span, while unfolding many candidate chunks is expensive.

“If r i is a long source unit, however, direct gist-to-raw unfolding can be unreliable: the gist may not preserve enough detail to identify the exact raw span to unfold, while unfolding many candidate chunks to compensate is expensive.”

May combine two claims.

The hierarchy G_i → S_i → raw is load-bearing for evidence localization and cost-controlled reasoning.

“This example shows why the hierarchy G i → S i → raw is load-bearing.”

May combine two claims.

A lightweight summarizer (DeepSeek-V4-Flash) is sufficient for constructing the shared context, allowing DELM to reserve stronger models for subtask reasoning without sacrificing accuracy.

“Thus, a lightweight summarizer is sufficient for constructing the shared context, allowing DELM to reserve stronger models for subtask reasoning without sacrificing accuracy.”