Context as a Tool: Context Management for Long-Horizon SWE-Agents

Most prior context management approaches rely on static compression or fixed memory policies.

“However, most rely on static compression or fixed memory policies”

• cites Li, 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Jiang et al., 2023Could not verify

  The Introduction describes Selective-Context as an earlier prompt-compression method, while the Methodology describes LLMLingua’s dynamic allocation of compression ratios. Neither passage says that most prior context-management approaches use static compression or fixed memory policies; searches for those characterizations found no supporting passage in our copy. Page numbers were not available. (LLM, conf=0.70)

  Experimental — accuracy not yet measured
• cites Pan et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Prior context compression, summarization, or multi-level memory approaches treat context management as a passively triggered heuristic mechanism, lacking flexibility to adapt compression timing and content across task phases.

“Nevertheless, previous approaches treat context management as a passively triggered heuristic mechanism, so they lack the flexibility to adapt compression timing and content across different task phases, limiting their adaptability and scalability in complex environments.”

• cites Jiang et al., 2023Partly supported

  The Introduction and Methodology sections describe limitations of earlier prompt-compression methods and propose dynamically allocating compression ratios across prompt components. They do not characterize prior context-management approaches as passively triggered, or assess whether those approaches can adapt compression timing across task phases in complex environments. No page numbers are available in our copy. (LLM, conf=0.78)

  Experimental — accuracy not yet measured
• cites Shinn et al., 2023 sourceCould not verify

  The Self-reflection section describes Reflexion’s short- and long-term memory, and §5 Limitations says its long-term memory uses a capacity-limited sliding window. Neither passage assesses prior compression, summarization, or multi-level memory approaches as passive heuristics, or discusses their ability to adapt compression timing and content across task phases. Searches for those terms found no passage addressing that comparison; page numbers were unavailable in our copy. (LLM, conf=0.76)

  Experimental — accuracy not yet measured
• cites Wang et al., 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The performance gains are substantially larger on the medium and hard subsets than on the easy subset.

“The performance gains are substantially larger on the medium and hard subsets than on the easy subset.”

The proposed CAT/SWE-Compressor substantially outperforms ReAct without context management and static compression baselines on SWE-Bench under the same model scale and interaction budget.

“Experimental results on SWE-Bench show that CAT substantially outperforms ReAct without context management and baselines with static compression strategies under the same model scale and interaction budget, demonstrating the strong context scalability in long-horizon interaction settings.”

• Also stated in: § Abstract · p. 1 · plain

  “Experiments on SWE-BenchVerified demonstrate that SWE-Compressor reaches a 57.6% solved rate and significantly outperforms ReAct-based agents and static compression baselines, while maintaining stable and scalable long-horizon reasoning under a bounded context budget.”

In the experiments, more than 40% of tasks remain interactive after 100 rounds.

“Moreover, the trajectory survival curve indicates that, in our experiments, more than 40% of tasks remain interactive after 100 rounds.”

When a larger number of interactions is allowed (500 steps), CAT achieves the highest pass rate among all methods.

“When a larger number of interactions is allowed (500 steps), CAT achieves the highest pass rate among all methods”

CAT-Instruct effectively enhances the model's context-management capability.

“This process yields a curated set of 20k supervised fine-tuning instances, referred to as CAT-Instruct, which effectively enhance the model's context-management capability.”

SWE-Compressor reaches a 57.6% solved rate on SWE-Bench Verified.

“Experiments on SWE-BenchVerified demonstrate that SWE-Compressor reaches a 57.6% solved rate and significantly outperforms ReAct-based agents and static compression baselines, while maintaining stable and scalable long-horizon reasoning under a bounded context budget.”

CAT maintains a highly compact context.

“In Figure 4, CAT maintains a highly compact context.”

Across all comparable interaction budgets, the model equipped with CAT consistently outperforms the SFT-based ReAct baseline.

“Across all comparable interaction budgets, the model equipped with CAT consistently outperforms the SFT-based ReAct baseline”

CAT continues to improve steadily with increasing interaction budgets, maintaining a clear upward trend even at 500 rounds.

“In contrast, CAT continues to improve steadily with increasing interaction budgets, maintaining a clear upward trend even at 500 rounds”

CAT delivers stable and consistent performance improvements across easy, medium, and hard instances.

“showing that CAT delivers stable and consistent performance improvements across easy, medium, and hard instances.”

CAT and CAT-GENERATOR are particularly effective for long-horizon interactive software engineering tasks such as those in SWE-Bench.

“These results indicate that CAT and CAT-GENERATOR are particularly effective for long-horizon interactive software engineering tasks such as those in SWE-Bench.”

ReAct's performance saturation and degradation are primarily due to its append-only context strategy: once the context window is filled, additional interactions fail to introduce effective information and instead hinder further reasoning.

“primarily due to its append-only context strategy: once the context window is filled, additional interactions fail to introduce effective information and instead hinder further reasoning.”

Most existing code agents based on ReAct adopt an append-only context maintenance strategy, where all past interactions are continuously concatenated into the messages.

“Most existing code agents based on paradigms such as ReAct (Yao et al., 2022) adopt an appendonly context maintenance strategy, where all past interactions are continuously concatenated into the messages.”

• cites Yao et al., 2022Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Trajectory-level supervision enables the model to learn cross-step strategic judgments, such as how different invocation timings affect downstream efficiency and stability.

“Moreover, it enables the model to learn cross-step strategic judgments, such as how different invocation timings affect downstream efficiency and stability, thereby better reflecting the decision structure of real long-horizon tasks.”

CAT is effective in preventing context explosion.

“indicating the effectiveness of CAT in preventing context explosion.”

The favorable performance-efficiency trade-off is primarily attributed to the proposed context management mechanism, which prioritizes salient information while compressing redundant history, enabling efficient reasoning within a constrained context budget.

“This favorable performance-efficiency trade-off is primarily attributed to the proposed context management mechanism, which prioritizes salient information while compressing redundant history, enabling efficient reasoning within a constrained context budget.”

CAT-GENERATOR is important.

“confirming the importance of CAT-GENERATOR.”

Append-only context maintenance in long-horizon scenarios often leads to rapid context expansion, information redundancy, semantic drift, and reasoning collapse.

“While this method may suffice for shorthorizon tasks, it often leads to rapid context expansion in long-horizon scenarios, resulting in information redundancy, semantic drift, and even reasoning collapse.”

CAT treats context management as a callable and plannable tool, on par with environment-interaction tools, integrating context maintenance into the action process as an active and learnable component.

“Motivated by this perspective, CAT treats context management as a callable and plannable tool, on par with environment-interaction tools such as code editing and command execution, which integrates context maintenance into the action process as an active and learnable component.”

• Also stated in: § Abstract · p. 1 · plain

  “We propose CAT, a new context management paradigm that elevates context maintenance to a callable tool integrated into the decision-making process of agents.”

Using CAT-Instruct for supervised fine-tuning yields SWE-Compressor, which internalizes context management as a learned model capability.

“Using CAT-Instruct for supervised fine-tuning, we obtain SWE-Compressor, which internalizes context management as a learned model capability.”

CAT indicates more efficient utilization of historical information under the same reasoning budget.

“indicating more efficient utilization of historical information under the same reasoning budget.”

The comparison between CAT and its Base SFT variant isolates the effect of CAT-GENERATOR.

“The comparison between CAT and its Base SFT variant isolates the effect of CAT-GENERATOR.”

Context management in CAT is transformed from a post hoc procedure into a self-regulating reasoning step, becoming an integral part of the agent's strategy rather than an external constraint.

“Through this design, context management is transformed from a post hoc procedure into a self-regulating reasoning step, becoming an integral part of the agent's strategy rather than an external constraint.”

Modeling context evolution as an active and learnable component of agent behavior is important.

“underscoring the importance of modeling context evolution as an active and learnable component of agent behavior.”

CAT has stronger long-horizon reasoning capability.

“indicating stronger long-horizon reasoning capability.”

When tasks require more complex reasoning processes and longer-horizon context maintenance, the training signal introduced by CAT-Instruct becomes more effective.

“This observation suggests that when tasks require more complex reasoning processes and longer-horizon context maintenance, the training signal introduced by CAT-Instruct becomes more effective.”

CAT enables the agent to proactively trigger context folding at stage boundaries, compressing redundant histories into high-fidelity and actionable long-term memory representations.

“It further enables the agent to proactively trigger context folding at stage boundaries, compressing redundant histories into high-fidelity and actionable long-term memory representations.”

CAT-GENERATOR injects context-management behaviors into complete interaction trajectories via offline reconstruction.

“Building on this design, we introduce a trajectory-level supervision framework, CAT-GENERATOR, which injects contextmanagement behaviors into complete interaction trajectories via offline reconstruction.”

CAT enables proactive and structured condensation of interaction history, overcoming the limitations of append-only contexts and passive compression.

“By integrating context management into the decision process of agent, CAT enables proactive and structured condensation of interaction history, overcoming the limitations of append-only contexts and passive compression.”