SelfSearch: Reward-Free Search for Self-Improving Agents

Probably not a substantial claim: may not pass S3 (load-bearing).

Records from multiple agents, tasks, or lineages can inform new modifications and combine complementary improvements.

“Records from multiple agents, tasks, or lineages can inform new modifications and combine complementary improvements (Weng et al., 2026;Liu et al., 2026).”

• cites Weng et al., 2026 sourceSupported
• cites Liu et al., 2026 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

The operations developed by SelfSearch agents, such as line-range viewing, exact-text replacement, and bounded search output, resemble agent-computer interface designs shown to be effective for coding agents.

“The operations developed by SelfSearch agents, such as line-range viewing, exacttext replacement, and bounded search output, resemble agent-computer interface designs shown to be effective for coding agents (Yang et al., 2024).”

• cites Yang et al., 2024 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

Prior work uses histories of candidate changes and evaluation outcomes to guide later revisions, retaining lessons across generations or revising the search procedure itself.

“Prior work uses histories of candidate changes and evaluation outcomes to guide later revisions, retaining lessons across generations or revising the search procedure itself (Zhang et al., 2026b;Lee et al., 2026;Qu & Lu, 2026).”

• cites Zhang et al., 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Lee et al., 2026 sourceSupported
• cites Qu & Lu, 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Prior work searches over agent implementations and workflows by proposing changes, evaluating candidates, and using the resulting feedback to guide further search.

“Prior work searches over agent implementations and workflows by proposing changes, evaluating candidates, and using the resulting feedback to guide further search (Hu et al., 2025;Zhang et al., 2025;2026a).”

• cites Hu et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Zhang et al., 2025 sourceSupported
• cites 2026aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Some evolve agents across generations, while others modify the scaffold during an individual task.

“Some evolve agents across generations, while others modify the scaffold during an individual task (Xia et al., 2025).”

• cites Xia et al., 2025 sourceSupported

May combine two claims. The quote only partly states this claim.

SelfSearch achieves competitive task success with evaluation-guided search baselines at lower search cost.

“SelfSearch achieves competitive success rates without downstream evaluation guiding revisions.”

May combine two claims.

Across two model settings and three benchmarks, SelfSearch improves population-mean task success, with execution-cost reductions and harness transfer across model families.

“Across two model settings and three benchmarks, SelfSearch improves population-mean task success, with execution-cost reductions and harness transfer across model families.”

The quote only partly states this claim.

Individual agents improve success by up to 6.7 percentage points on SWE-bench Multilingual.

“6.7 on SWE-bench Multilingual”

• Also stated in: § 3.2 DOWNSTREAM PERFORMANCE AND EFFICIENCY · plain

  “On SWE-bench Multilingual, the largest gains are 6.7 percentage points with GPT”

May combine two claims.

On Terminal-Bench 2.1, the capability agent increases success from 43.8% to 55.1% with GPT and from 65.2% to 73.0% with DeepSeek.

“On Terminal-Bench 2.1, the capability agent increases success from 43.8% to 55.1% with GPT and from 65.2% to 73.0% with DeepSeek.”

May combine two claims.

On SWE-bench Multilingual, the largest gains are 6.7 percentage points with GPT and 5.0 with DeepSeek.

“On SWE-bench Multilingual, the largest gains are 6.7 percentage points with GPT and 5.0 with DeepSeek.”

May combine two claims.

Ablations suggest that both previous episode records and an evolving improver contribute to population-mean success.

“Ablations suggest that both previous episode records and an evolving improver contribute to population-mean success.”

The quote only partly states this claim.

On SWE-bench Multilingual, a SelfSearch agent improves success by 5.0 percentage points.

“On SWE-bench Multilingual, an agent improves success by 5.0 percentage points”

• Also stated in: § 1 INTRODUCTION · plain

  “On SWE-bench Multilingual, a SelfSearch agent improves success by 5.0 percentage points”

May combine two claims.

On SWE-bench Verified, the agents found using DeepSeek V4 Pro achieve 79.2% and 76.7% success, compared with 75.0% for the initial agent.

“the agents found using DeepSeek V4 Pro achieve 79.2% and 76.7%, compared with 75.0%initially.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Other changes preserve information during file operations, including tabs and line endings.

“Other changes preserve information during file operations, including tabs and line endings.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In generation 6, the capability lineage uses that episode record to revise the tool so that excerpts center on the match.

“In generation 6, the capability lineage uses that episode record to revise the tool so that excerpts center on the match.”

May combine two claims. The quote only partly states this claim.

SelfSearch and Codex each solve 73 of the 89 Terminal-Bench 2.1 tasks, tying as the highest-scoring harness in that comparison, with 66 tasks solved by both and seven solved only by each harness.

“SelfSearch and Codex each solve 73 tasks, including 66 solved by both and seven solved only by each harness.”

• Also stated in: § F COMPARISON OF AGENT SEARCH DESIGNS · plain

  “The SelfSearch agent solves 73 of 89 tasks (82.0%), tying Codex, the highest-scoring harness in that comparison.”

• cites Apache Maka, 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Later generations let agents filter the records to find relevant events and see each tool result alongside the tool call and arguments that produced it.

“Later generations let agents filter the records to find relevant events and see each tool result alongside the tool call and arguments that produced it.”

May combine two claims.

Removing episode records reduces mean success by 2.1 percentage points with GPT and 2.9 with DeepSeek.

“Removing episode records reduces mean success by 2.1 percentage points with GPT and 2.9 with DeepSeek.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In the GPT SelfSearch trajectory, the adaptive lineage introduces inspect_trajectory in generation 6 to read previous episode records.

“The adaptive lineage introduces inspect_trajectory in generation 6 to read previous episode records.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In generation 7, each lineage incorporates the other's tool from its episode record.

“In generation 7, each incorporates the other's tool from its episode record.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The GPT capability agent inspects the calling code and runs the related tests, using a tool developed for episode-record inspection to support downstream verification.

“It inspects the calling code and runs the related tests, using a tool developed for episode-record inspection to support downstream verification.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In generation 6, the capability lineage adds text search with output limits, while the adaptive lineage introduces a trajectory reader.

“In generation 6, the capability lineage adds text search with output limits, while the adaptive lineage introduces a trajectory reader.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In the DeepSeek SelfSearch trajectory, generation 3 adds head-and-tail excerpts for shell output.

“Generation 3 adds head-and-tail excerpts for shell output”

May combine two claims.

Both DeepSeek lineages match or exceed the baselines on SWE-bench Verified, and the adaptive lineage matches the strongest baseline on SWE-bench Multilingual.

“Both DeepSeek lineages match or exceed the baselines on SWE-bench Verified, and the adaptive lineage matches the strongest baseline on SWE-bench Multilingual.”

May combine two claims.

Both direct reuse of tools and further refinement are observed as subsequent episodes expose limitations.

“We observe both direct reuse of tools and further refinement as subsequent episodes expose limitations.”

May combine two claims.

Keeping the improver fixed reduces mean success by 1.7 percentage points with GPT and 2.9 with DeepSeek.

“Keeping the improver fixed reduces it by 1.7 and 2.9 points, respectively.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Using the reader reveals that combining several short excerpts can still produce an oversized response.

“reveals that combining several short excerpts can still produce an oversized response.”

May combine two claims.

Both lineages improve over the initial agent in both cross-model transfer directions.

“Both lineages improve over the initial agent in both transfer directions, indicating that the discovered changes remain useful beyond the model configuration used during search.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The adaptive agent uses its trajectory reader to inspect the capability lineage's record before copying the search implementation and tests.

“The adaptive agent uses its trajectory reader to inspect the capability lineage's record before copying the search implementation and tests.”

May combine two claims.

Generating both SelfSearch lineages costs 13.4-47.2% less than the baselines with GPT and 49.0-53.2% less with DeepSeek.

“Generating both SelfSearch lineages costs 13.4-47.2%less than the baselines with GPT and 49.0-53.2%less with DeepSeek.”

May combine two claims.

Our analysis shows that addressing these difficulties can produce tools reused on downstream tasks, as well as tools such as the trajectory reader that support further self-improvement.

“Our analysis shows that addressing these difficulties can produce tools reused on downstream tasks, as well as tools such as the trajectory reader that support further self-improvement.”

May combine two claims.

Without downstream evaluation during search, the final agent populations improve mean task success over their initial agents across three benchmarks, with gains transferring across execution models.

“Without downstream evaluation during search, the final agent populations improve mean task success over their initial agents across three benchmarks, with gains transferring across execution models.”

May combine two claims.

In generation 7, the adaptive agent reproduces the failure, incorporates the capability lineage's repair, and verifies that matching text remains visible.

“In generation 7, the adaptive agent reproduces the failure, incorporates the capability lineage's repair, and verifies that matching text remains visible.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Generation 8 adds overall output limits.

“Generation 8 adds overall output limits.”

May combine two claims.

Averaged across the two lineages, GPT and DeepSeek agents use their text-search tools on 8.6% and 23.6% of tasks, respectively, and line-range file viewing on 40.3% and 33.8%.

“Averaged across the two lineages, GPT and DeepSeek agents use their textsearch tools on 8.6% and 23.6% of tasks, respectively, and line-range file viewing on 40.3% and 33.8%.”

May combine two claims.

These tools are used across downstream benchmarks, while GPT's trajectory reader is not invoked during downstream evaluation.

“These tools are used across downstream benchmarks, while GPT's trajectory reader is not invoked during downstream evaluation.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In the GPT SelfSearch trajectory, generation 9 uses the inspection interface to inspect both previous trajectories and adds filtering.

“Generation 9 uses this interface to inspect both previous trajectories and adds filtering.”

May combine two claims.

With GPT, the capability lineage matches or exceeds both baselines on both benchmarks, while the adaptive lineage shows mixed results.

“With GPT, the capability lineage matches or exceeds both baselines on both benchmarks, while the adaptive lineage shows mixed results.”

May combine two claims.

In the DeepSeek SelfSearch trajectory, the capability lineage develops tools for inspecting long outputs and then repairs problems exposed by their use.

“DeepSeek's capability lineage develops tools for inspecting long outputs, then repairs problems exposed by their use.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In the GPT SelfSearch trajectory, the capability lineage incorporates inspect_trajectory in generation 7.

“The capability lineage incorporates it in generation 7.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In the GPT SelfSearch trajectory, each generation uses and refines the inspection tool inherited from its predecessor.

“Each generation uses and refines the inspection tool inherited from its predecessor.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In the GPT SelfSearch trajectory, generation 10 links tool results to their originating calls and arguments, including across response pages.

“Generation 10 links tool results to their originating calls and arguments, including across response pages.”

May combine two claims.

Episode records allow each lineage to build on its own changes and inspect those made by the other.

“Episode records allow each lineage to build on its own changes and inspect those made by the other.”

Probably not a substantial claim: may not pass S3 (load-bearing).

With GPT, the fixed-improver variant performs slightly better in the adaptive lineage.

“With GPT, the fixed-improver variant performs slightly better in the adaptive lineage.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In generation 8 of the GPT adaptive lineage, after finding that limiting individual excerpts still allows overly long responses, the agent adds an overall response limit and a continuation position for retrieving the remaining content.

“In generation 8, it finds that limiting individual excerpts still allows overly long responses, so it adds an overall response limit and a continuation position for retrieving the remaining content.”

Probably not a substantial claim: may not pass S3 (load-bearing).

After repairing a function, the GPT capability agent uses the text-search tool to locate related tests and code that calls the function.

“After repairing a function, the GPT capability agent uses the text-search tool to locate related tests and code that calls the function.”

Classified as probably not a substantial claim. May combine two claims.

SelfSearch has an evolving task agent, an evolving meta-agent, a unified meta and task agent, and reward-free search.

“SelfSearch (ours) | ✓ | ✓ | ✓ | ✓”

Probably not a substantial claim: may not pass S3 (load-bearing).

The final agent from each lineage is evaluated rather than selecting checkpoints based on downstream performance.

“We evaluate the final agent from each lineage rather than selecting checkpoints based on downstream performance.”

Probably not a substantial claim: may not pass S4 (based).

Keeping the model-tool interaction loop outside the editable agent code provides a stable way to execute agents and capture their trajectories as their implementations evolve.

“Keeping this loop outside the editable agent code provides a stable way to execute agents and capture their trajectories as their implementations evolve.”

Classified as probably not a substantial claim.

Sharing episode records allows each lineage to incorporate discoveries made under the other direction while maintaining its own implementation.

“Sharing episode records allows each lineage to incorporate discoveries made under the other direction while maintaining its own implementation.”

Probably not a substantial claim: may not pass S4 (based).

Evaluating each candidate on a development set incurs a recurring cost that grows with the number of tasks evaluated.

“Evaluating each candidate on a development set incurs a recurring cost that grows with the number of tasks evaluated.”

May combine two claims.

Existing approaches use downstream evaluation to guide the search process, tying the improvement signal to a task distribution and requiring repeated execution of candidate agents.

“These approaches use downstream evaluation to guide the search process, tying the improvement signal to a task distribution and requiring repeated execution of candidate agents.”

Classified as probably not a substantial claim.

The model-tool interaction loop runs in a fixed runtime outside the editable repository.

“Agents can modify their entire repository, while the model-tool interaction loop runs in a fixed runtime outside the editable repository.”

Classified as probably not a substantial claim.

Changes to an agent's tools and procedures can affect how it performs subsequent self-modification.

“Changes to its tools and procedures can therefore affect how it performs subsequent self-modification.”

Classified as probably not a substantial claim.

Downstream evaluation and any candidate selection occur separately from search.

“Downstream evaluation and any candidate selection occur separately from search.”

Classified as probably not a substantial claim. May combine two claims.

Within each model configuration, the initial and evolved agents use the same downstream model and execution limits, differing only in their agent implementations.

“Within each configuration, the initial and evolved agents use the same downstream model and execution limits, differing only in their agent implementations.”

Classified as probably not a substantial claim.

The resulting agents are evaluated only after the search checkpoints have been frozen.

“We evaluate the resulting agents only after the search checkpoints have been frozen.”

Classified as probably not a substantial claim.

The underlying model weights remain fixed during self-improvement.

“The underlying model weights remain fixed.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The running agent remains unchanged during the episode.

“The running agent remains unchanged during the episode.”

Classified as probably not a substantial claim.

The record of a modification contains information about how the agent identified limitations, constructed revisions, and examined their effects.

“This record contains information about how the agent identified limitations, constructed revisions, and examined their effects.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The same frozen agent implementation is evaluated across benchmarks without modifying its source code.

“We evaluate the same frozen agent implementation across benchmarks without modifying its source code.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Selection can also consider an agent's potential to produce useful descendants, rather than only its current task performance.

“Selection can also consider an agent's potential to produce useful descendants, rather than only its current task performance (Wang et al., 2026).”

• cites Wang et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Previous episode records are mounted read-only during subsequent episodes.

“Previous episode records are mounted read-only during subsequent episodes.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The runtime remains outside the editable repository and fixes the model, reasoning effort, generation settings, and execution limits.

“The runtime remains outside the editable repository and fixes the model, reasoning effort, generation settings, and execution limits.”

May combine two claims.

Downstream evaluation provides useful feedback, but repeatedly evaluating candidates increases search cost as task coverage or repetitions grow.

“Downstream evaluation provides useful feedback, but repeatedly evaluating candidates increases search cost as task coverage or repetitions grow.”

Classified as probably not a substantial claim.

An agent's code determines both how it solves tasks and how it modifies other agents.

“An agent's code determines both how it solves tasks and how it modifies other agents.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The goal and design-guidance texts were refined over pilot searches by inspecting improver trajectories and code changes, without evaluating pilot agents on downstream benchmarks, and were fixed before the searches reported here.

“The goal and design-guidance texts were refined over pilot searches by inspecting improver trajectories and code changes, without evaluating pilot agents on downstream benchmarks, and were fixed before the searches reported here.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The improvement procedure itself can be revised by applying it to its own implementation or allowing a meta-agent to modify itself.

“More explicitly, the improvement procedure itself can be revised by applying it to its own implementation or allowing a meta-agent to modify itself (Zelikman et al., 2024;Zhang et al., 2026b).”

• cites Zelikman et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Zhang et al., 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

DGM and HGM use a separate diagnosis procedure to propose modifications.

“DGM and HGM use a separate diagnosis procedure to propose modifications (Zhang et al., 2026a;Wang et al., 2026)”

• cites Zhang et al., 2026aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Wang et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Both ablation variants use the same search configuration as full SelfSearch.

“Both variants use the same search configuration as full SelfSearch.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Both agents are compared on the same tasks within each pair.

“Both agents are compared on the same tasks within each pair.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The SWE-bench Verified comparison with evaluation-guided search excludes the ten development tasks, leaving 110 tasks.

“The SWE-bench Verified comparison excludes the ten development tasks, leaving 110 tasks.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The authors verified reported numbers and figures against experiment logs and source data.

“the authors tested AI-assisted code, checked cited works against the original papers, and verified reported numbers and figures against experiment logs and source data.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The execution framework records agent implementations and trajectories while keeping inference settings and resource limits outside the editable agent repository.

“Our execution framework records agent implementations and trajectories while keeping inference settings and resource limits outside the editable agent repository.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The comparison between SelfSearch and the evaluation-guided baselines is not budget-matched, because SelfSearch reports both generation-10 lineages without development-score selection.

“SelfSearch instead reports both generation-10 lineages without development-score selection, so the comparison is not budget-matched.”

Classified as probably not a substantial claim.

For the comparison with other harnesses, the inference and execution settings were aligned with the public evaluation, using xhigh reasoning and expanded execution limits instead of the settings in Table 1.

“For this comparison, we align the inference and execution settings with that evaluation, using xhigh reasoning and expanded execution limits instead of the settings in Table1.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Hyperagents defines distinct task and meta-agents within an editable program.

“Hyperagents defines distinct task and meta-agents within an editable program (Zhang et al., 2026b).”

• cites Zhang et al., 2026bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.