Mendel Gödel Machine: Recursive Self-Improving Coding Agents via Comparative Evolution

May combine two claims.

Purely through evolving the agent scaffold, MGM advances Qwen3.6-35B-A3B on Polyglot from 50.8% to 93.3%, surpassing closed-source GPT-5 with ~117× fewer parameters.

“Purely through evolving the agent scaffold, MGM advances Qwen3.6-35B-A3B on Polyglot from 50.8% to 93.3%, surpassing closed-source GPT-5 (Singh et al., 2026) with ∼117× fewer parameters, as Figure 2 shows.”

• cites Singh et al., 2026 sourceSupported

May combine two claims.

Experiments on SWE-bench and Polyglot confirm MGM's consistent improvement over baselines in performance, efficiency, and generalizability.

“Experiments on SWE-bench and Polyglot confirm MGM's consistent improvement in performance, efficiency, and generalizability.”

• Also stated in: § 1 INTRODUCTION · plain

  “Experiments on Polyglot (Gauthier, 2024) and SWE-bench (Jimenez et al., 2024) confirm MGM's consistent gains over baselines in both performance and efficiency.”

• Also stated in: § 7 CONCLUSION · plain

  “Experiments on SWE-bench and Polyglot confirm MGM's consistent gains over HGM in performance and efficiency under a matched budget.”

May combine two claims.

As ρ increases, MGM's advantage grows steadily, and this trend is especially pronounced at smaller d0.

“As ρ increases, MGM's advantage grows steadily, and this trend is especially pronounced at smaller d 0 , where fewer but more precise self-improvements are required and higher-quality diagnostic signals translate into clearer performance gains.”

• AssumptionThe authors state this as an assumption: The additive fitness landscape model accurately represents the relevant aspects of coding-agent self-improvement for the theoretical analysis and simulations.

May combine two claims.

Both HGM and MGM produce scaffolds that transfer across models, but MGM transfers more strongly and consistently.

“Table 3 shows that both HGM and MGM produce scaffolds that transfer across models, but MGM transfers more strongly and consistently.”

May combine two claims.

MGM consistently outperforms other baselines in both final performance and convergence speed across all d0 and ρ > 1.0 settings.

“MGM consistently outperforms other baselines in both final performance and convergence speed across all d 0 and ρ > 1.0 settings, demonstrating reliable gains across both easier and harder initial conditions.”

• AssumptionThe authors state this as an assumption: The additive fitness landscape model accurately represents the relevant aspects of coding-agent self-improvement for the theoretical analysis and simulations.

May combine two claims.

Under the original Qwen3.6-35B-A3B backbone, HGM improves the initial scaffold from 68.3% to 73.3%, whereas MGM improves it to 78.3%, giving MGM a +5.0 percentage-point advantage over HGM.

“Under the original Qwen3.6-35B-A3Bbackbone, HGM improves the initial scaffold from 68.3% to 73.3%, whereas MGM improves it to 78.3%, giving MGM a +5.0 percentage-point advantage over HGM.”

May combine two claims.

MGM achieves the lowest mean and tightest spread in final performance across seeds.

“Figure 5 additionally shows the distribution of final performance across seeds, where MGM achieves the lowest mean and tightest spread, while the broader distributions of other baselines reflect less stable budget allocation.”

• AssumptionThe authors state this as an assumption: The additive fitness landscape model accurately represents the relevant aspects of coding-agent self-improvement for the theoretical analysis and simulations.

May combine two claims.

After transferring the same scaffolds to DeepSeek-V4-Flash, HGM reaches 60.0%, while MGM further improves to 66.7%. On DeepSeek-V4-Pro, HGM reaches 70.0%, whereas MGM reaches 75.0%.

“After transferring the same scaffolds to DeepSeek-V4-Flash, HGM reaches 60.0%, while MGM further improves to 66.7%.On DeepSeek-V4-Pro, HGM reaches 70.0%, whereas MGM reaches 75.0%.”

May combine two claims.

The initial scaffold obtains 16.7% accuracy on SWE-bench Pro and 41.7% on SWE-bench Multilingual.

“As shown in Table 2, the initial scaffold obtains 16.7% accuracy on SWE-bench Pro and 41.7% on SWE-bench Multilingual.”

May combine two claims.

The HGM-evolved scaffold decreases to 13.3% on SWE-bench Pro (-3.4 pp) and slightly improves to 43.3% on SWE-bench Multilingual (+1.6 pp).

“The HGM-evolved scaffold shows limited transfer: it decreases to 13.3% on SWE-bench Pro, corresponding to a -3.4 percentage-point change, and slightly improves to 43.3% on SWE-bench Multilingual, corresponding to a +1.6 percentage-point gain.”

May combine two claims.

Under the additive fitness landscape model and sound comparative evidence, ΦRM and ΦCH have strictly higher effective fix probability than ΦCM.

“Proposition 1.Under the aforementioned model and sound comparative evidence, Φ RM and Φ CH have strictly higher effective fix probability than Φ CM :”

• AssumptionThe authors state this as an assumption: The additive fitness landscape model accurately represents the relevant aspects of coding-agent self-improvement for the theoretical analysis and simulations.
• AssumptionThe authors state this as an assumption: Each agent's genotype can be modeled as a binary vector of loci, each corresponding to a minimum scaffold-level capability or implementation choice.
• AssumptionThe authors state this as an assumption: Each task requires a fixed subset of loci to be all correct for a successful phenotype.
• AssumptionThe authors state this as an assumption: Loci are independent in the additive fitness landscape model.
• AssumptionThe authors state this as an assumption: The editor repairs an actually incorrect locus with probability s ∈ (0, 1].

May combine two claims.

The full MGM achieves the best performance, and removing ΦRM and ΦCH leads to a clear performance degradation.

“As shown in Table 4, the full MGM achieves the best performance, and removing Φ RM and Φ CH leads to a clear performance degradation.”

May combine two claims.

MGM achieves positive transfer on both target benchmarks: 26.7% on SWE-bench Pro (+10.0 pp) and 55.0% on SWE-bench Multilingual (+13.3 pp).

“In contrast, MGM achieves positive transfer on both target benchmarks.It reaches 26.7% on SWE-bench Pro, giving a +10.0 percentage-point improvement over the initial scaffold, and 55.0% on SWE-bench Multilingual, giving a +13.3 percentage-point improvement.”

May combine two claims.

Averaged over the two transferred DeepSeek backbones, MGM achieves 70.8% accuracy, compared with 65.0% for HGM and 47.5% for the initial scaffold.

“Averaged over the two transferred DeepSeek backbones, MGM achieves 70.8% accuracy, compared with 65.0% for HGM and 47.5% for the initial scaffold.”

May combine two claims.

MGM still outperforms HGM under this backbone, but the final evolved performance is substantially lower than the corresponding Qwen3.6-35B-A3B setting, where MGM reaches 61.7% on SWE-bench Verified-60.

“MGM still outperforms HGM under this backbone, but the final evolved performance is substantially lower than the corresponding Qwen3.6-35B-A3Bsetting, where MGM reaches 61.7% on SWE-bench Verified-60.”

May combine two claims.

The gains are broadly distributed across languages: the agent solves 25/26 C++ tasks, 36/39 Go tasks, 43/47 Java tasks, 46/49 JavaScript tasks, 33/34 Python tasks, and 27/30 Rust tasks.

“The gains are also broadly distributed across languages: the agent solves 25/26 C++ tasks, 36/39 Go tasks, 43/47 Java tasks, 46/49 JavaScript tasks, 33/34 Python tasks, and 27/30 Rust tasks.”

May combine two claims.

Under the same budget of 200 task evaluations and 24 self-modification expansions, HGM improves the scaffold to 40.0%, while MGM improves it to 41.7%.

“Under the same budget of 200 task evaluations and 24 self-modification expansions, HGM improves the scaffold to 40.0%, while MGM improves it to 41.7%.”

May combine two claims.

This capability is then preserved in node #8, which also solves javascript__queen-attack.

“This capability is then preserved in node #8, which also solves javascript__queen-attack.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The node #18 is selected as result, with utility 0.71 after 14 evaluations.

“The node #18 is selected as result, with utility 0.71 after 14 evaluations.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The node #19 has utility 1.00 after only 2 evaluations, and the selected result is node #6 with utility 0.88, after 16 evaluations.

“The node #19 has utility 1.00 after only 2 evaluations, and the selected result is node #6 with utility 0.88, after 16 evaluations.”

May combine two claims.

Under the same 200-evaluation budget, HGM also produces 24 nodes, but all child edges correspond to single-trajectory clonal edits.

“Under the same 200-evaluation budget, HGM also produces 24 nodes, but all child edges correspond to single-trajectory clonal edits.”

May combine two claims.

The MGM-evolved agent solves 210 out of 225 tasks on the full Polyglot benchmark, achieving an overall accuracy of 93.3%.

“As shown in Figure 7, the MGM-evolved agent solves 210 out of 225 tasks, achieving an overall accuracy of 93.3%.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The node #23 with highest utility 1.00 got only 2 evaluations, and the node #14 with utility 0.84 after 50 evaluations is selected as result.

“The node #23 with highest utility 1.00 got only 2 evaluations, and the node #14 with utility 0.84 after 50 evaluations is selected as result.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In the second patch's Phase 1, the agent extracts a structured contract_plan JSON containing exact class signatures, constructors, method definitions, and verbatim error messages from test and stub files.

“in Phase 1, the agent extracts a structured contract_plan JSON containing exact class signatures, constructors, method definitions, and verbatim error messages from test and stub files.”

Classified as probably not a substantial claim.

The modification also introduces lightweight provenance tracking for repository exploration.

“The modification also introduces lightweight provenance tracking for repository exploration.”

May combine two claims.

Qwen3.6 scores 93.3 on MMLU-Redux, compared with 91.18 for Qwen3-Coder-Next, and 85.2 on MMLU-Pro, compared with 80.52.

“Qwen3.6 scores 93.3 on MMLU-Redux, compared with 91.18 for Qwen3-Coder-Next, and 85.2 on MMLU-Pro, compared with 80.52.”

May combine two claims.

The gaps become larger on more difficult reasoning tasks: Qwen3.6 outperforms Qwen3-Coder-Next by 11.51 points on GPQA, 7.25 points on SuperGPQA, 20.49 points on HMMT Feb 2025, 13.53 points on HMMT Nov 2025, and 21.47 points on LiveCodeBench v6.

“The gaps become larger on more difficult reasoning tasks: Qwen3.6 outperforms Qwen3-Coder-Next by 11.51 points on GPQA, 7.25 points on SuperGPQA, 20.49 points on HMMT Feb 2025, 13.53 points on HMMT Nov 2025, and 21.47 points on LiveCodeBench v6.”

May combine two claims.

Some HGM changes add or wire in tools, while others propose isolated prompt phases or iterative loops.

“Some HGM changes add or wire in tools, while others propose isolated prompt phases or iterative loops.”

May combine two claims.

Although Qwen3-Coder-Next is larger and coding-oriented, Qwen3.6-35B-A3B performs substantially better on a wide range of general and reasoning-intensive benchmarks.

“Although Qwen3-Coder-Next is larger and coding-oriented, Qwen3.6-35B-A3Bperforms substantially better on a wide range of general and reasoning-intensive benchmarks.”

May combine two claims.

After the initial repair attempt, the agent further inspects the message history to identify remaining failed tests and can perform additional revision rounds conditioned on the traced failure path.

“After the initial repair attempt, the agent further inspects the message history to identify remaining failed tests and can perform additional revision rounds conditioned on the traced failure path.”

Classified as probably not a substantial claim.

By registering callbacks around the editor tool, the agent records which files were actually viewed during the debugging process.

“By registering callbacks around the editor tool, the agent records which files were actually viewed during the debugging process.”

Classified as probably not a substantial claim.

The first patch (#2, introduced via cross-lineage hybridization) adds a read-first prompt directive that requires the agent to inspect stubs, tests, and class hierarchies with the editor tool and to implement only the interfaces already defined in the repository.

“The first patch (#2, introduced via cross-lineage hybridization) adds a read-first prompt directive that requires the agent to inspect stubs, tests, and class hierarchies with the editor tool and to implement only the interfaces already defined in the repository.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In the second patch's Phase 2, the agent implements the solution under strict adherence to that plan and performs an explicit checklist-based self-audit before submission.

“In Phase 2, it implements the solution under strict adherence to that plan and performs an explicit checklist-based self-audit before submission.”

Classified as probably not a substantial claim. May combine two claims.

The agent first extracts test function names from the problem statement and test description, and then builds an explicit code-path trace before editing.

“Concretely, the agent first extracts test function names from the problem statement and test description, and then builds an explicit code-path trace before editing.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The second patch (#9, a reaction-norm mutation) replaces the single-turn workflow with a two-phase pipeline.

“The second patch (#9, a reaction-norm mutation) replaces the single-turn workflow with a two-phase pipeline:”

May combine two claims.

On SWE-bench Verified with Qwen3-Coder-Next, MGM achieves 41.7 accuracy, an absolute improvement of 8.4 percentage points over the initial agent.

“Accuracy | 33.3 | 40.0 +6.7% | 41.7 +8.4% | 68.3 | 73.3 +5.0% | 78.3 +10.0%”

The quote only partly states this claim.

The distribution of token costs for all evaluation and expansion operations lies in similar order of magnitude for HGM and MGM evolved on Polyglot.

“The distribution of token costs for all evaluation and expansion operations lies in similar order of magnitude.”

Classified as probably not a substantial claim.

This information is then used by a new diff-minimality filter, which removes patch blocks that are weakly related to the problem statement or to the files inspected by the agent.

“This information is then used by a new diff-minimality filter, which removes patch blocks that are weakly related to the problem statement or to the files inspected by the agent.”

May combine two claims.

On SWE-bench Verified with Qwen3.6-35B-A3B, MGM achieves 78.3 accuracy, an absolute improvement of 10.0 percentage points over the initial agent.

“Accuracy | 33.3 | 40.0 +6.7% | 41.7 +8.4% | 68.3 | 73.3 +5.0% | 78.3 +10.0%”

Probably not a substantial claim: may not pass S3 (load-bearing).

The full MGM system under a budget of 200 task evaluations produces an evolution tree yielding 24 nodes.

“Figure8ashows the evolution tree produced by the full MGM system under a budget of 200 task evaluations, yielding 24 nodes.”

May combine two claims.

MGM improves over HGM on SWE-bench Verified for both model backbones.

“Accuracy | 33.3 | 40.0 +6.7% | 41.7 +8.4% | 68.3 | 73.3 +5.0% | 78.3 +10.0%”

May combine two claims.

All three operators are active in the MGM evolution tree: Clonal Mutation, Reaction-norm Mutation, and Cross-lineage Hybridization.

“All three operators are active: Clonal Mutation, Reaction-norm Mutation, and Cross-lineage Hybridization.”

Classified as probably not a substantial claim.

Zhang et al. (2026a) reframe the self-improvement loop as open-ended evolution, maintaining an expanding archive of agent variants, from which at each iteration one is sampled to seed the next self-modification.

“Zhang et al. (2026a) reframe this loop as open-ended evolution, maintaining an expanding archive of agent variants, from which at each iteration one is sampled to seed the next self-modification.”

• cites Zhang et al. (2026a)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

All strategies directly operate on trajectories accumulated during routine archive evaluation and therefore incur no extra task evaluations.

“All strategies directly operate on trajectories accumulated during routine archive evaluation and therefore incur no extra task evaluations.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Wang et al. (2026) improve the sampling policy by using the aggregated performance of agents' descendants as signals guiding evaluation and expansion operations.

“Wang et al. (2026) improve the sampling policy by using the aggregated performance of agents' descendants as signals guiding evaluation and expansion operations.”

• cites Wang et al. (2026)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Conditioning edits on contrastive evidence enables targeted ability transfer across lineages and reduces redundant exploration.

“Conditioning edits on these contrastive evidence enables targeted ability transfer across lineages and reduce redundant exploration.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Robeyns et al. (2025) show that an agent equipped with basic file-editing tools can autonomously refactor its own codebase and lift its performance.

“Robeyns et al. (2025) show that an agent equipped with basic file-editing tools can autonomously refactor its own codebase and lift its performance.”

• cites Robeyns et al. (2025)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

HGM formulates the archive-based self-improvement as a fixed-budget tree-search problem.

“HGM (Wang et al., 2026) further formulates it as a fixed-budget tree-search problem.”

• cites Wang et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

MGM does not overfit to Polyglot-specific failure patterns and is more likely to acquire reusable software-engineering workflows that transfer across benchmark distributions and programming-language settings.

“The gains on both SWE-bench Pro and SWE-bench Multilingual indicate that MGM does not overfit to Polyglot-specific failure patterns and is more likely to acquire reusable software-engineering workflows that transfer across benchmark distributions and programming-language settings.”

Classified as probably not a substantial claim.

In all experiments, agents are not given access to private test cases or test results during evolution.

“In all experiments, agents are not given access to private test cases or test results during evolution.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Clonal mutation preserves the behavior of HGM-style self-modification and ensures that the search can proceed even when the archive is still small.

“This operator preserves the behavior of HGM-style self-modification and ensures that the search can proceed even when the archive is still small.”

May combine two claims.

MGM helps improve not only in-domain performance, but also the generalizability of the evolved agent scaffold across benchmarks and models.

“Together, the cross-benchmark and cross-model results demonstrate that MGM helps improve not only in-domain performance, but also the generalizability of the evolved agent scaffold across benchmarks and models.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Compared with full MGM, HGM still explores multiple branches, but it lacks the additional comparative evidence channels represented by edges with different colors.

“Compared with full MGM, HGM still explores multiple branches, but it lacks the additional comparative evidence channels represented by edges with different colors.”

Classified as probably not a substantial claim. May combine two claims.

The remaining failures are not concentrated in a single language, indicating that future improvements should likely target harder residual failure modes rather than language-specific specialization.

“The remaining failures are not concentrated in a single language, indicating that future improvements should likely target harder residual failure modes rather than language-specific specialization.”

May combine two claims.

The full Polyglot accuracy of 93.3% closely matches the 93.2% accuracy observed on Polyglot-60 in the main experiment, suggesting that the improvement is stable when moving from the subset evaluation to the full benchmark.

“This closely matches the 93.2% accuracy observed on Polyglot-60 in the main experiment, suggesting that the improvement is stable when moving from the subset evaluation to the full benchmark.”

May combine two claims.

This case shows that hybridization is not simply another mutation operator; instead it acts as a cross-archive mechanism for capability transfer, allowing a reusable skill evolved in one branch to accelerate progress in another branch that had not discovered it independently.

“This case shows that hybridization is not simply another mutation operator, instead it acts as a cross-archive mechanism for capability transfer, allowing a reusable skill evolved in one branch to accelerate progress in another branch that had not discovered it independently.”

May combine two claims.

MGM does not guarantee that the resulting edit is correct, general, or maintainable.

“MGM improves the evidence given to self-modification, but it does not guarantee that the resulting edit is correct, general, or maintainable.”

May combine two claims.

High-quality evidence need not yield a high-quality modification, and failed edits can waste budget.

“High-quality evidence therefore need not yield a high-quality modification, and failed edits can waste budget.”

May combine two claims.

Self-improvement is implemented through code editing, but the quality of the edit depends critically on preceding diagnosis steps, where the model must infer why the current scaffold failed and what general modification should be made.

“Self-improvement is indeed implemented through code editing, but the quality of the edit depends critically on preceding diagnosis steps, where the model must infer why the current scaffold failed and what general modification should be made.”

Classified as probably not a substantial claim.

To control evaluation cost, the authors follow the procedures by Zhang et al. (2026a) and utilize ChatGPT to randomly and separately choose 60 representative tasks for each benchmark.

“To control evaluation cost, instead of evaluating MGM on the full SWE-bench Pro and SWE-bench Multilingual, we follow the procedures by Zhang et al. (2026a) and utilize ChatGPT to randomly and separately choose 60 representative tasks for each benchmark.”

• cites Zhang et al. (2026a)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

For SWE-bench Pro, the selective 60-task subset is required to be representative and involve all the six Programming Languages, JavaScript, Python, Java, C++, TypeScript, Go.

“For SWE-bench Pro, the selective 60-task subset is required to be representative and involve all the six Programming Languages, JavaScript, Python, Java, C++, TypeScript, Go.”

May combine two claims.

The authors did not introduce dedicated bias or safety audits of the evolved agents, so inherited fairness and security issues may persist.

“We did not introduce dedicated bias or safety audits of the evolved agents, so inherited fairness and security issues may persist.”

May combine two claims.

The consistently high resolution rate across C++, Go, Java, JavaScript, Python, and Rust is consistent with the role of reaction-norm mutation and cross-lineage hybridization: the former identifies recurring agent-level weaknesses across tasks, while the latter transfers useful behavioral traits across lineages.

“In particular, the consistently high resolution rate across C++, Go, Java, JavaScript, Python, and Rust is consistent with the role of reaction-norm mutation and cross-lineage hybridization: the former identifies recurring agent-level weaknesses across tasks, while the latter transfers useful behavioral traits across lineages.”

May combine two claims.

The ablated variants have comparable training hours, which confirms that the gains of MGM come from the combined effect of its key components rather than from differences in computational cost.

“The ablated variants have comparable training hours, which also confirms that the gains of MGM come from the combined effect of its key components rather than from differences in computational cost.”

May combine two claims.

When the archive is small, task overlap is sparse, or informative failures have not yet appeared, MGM has little comparative evidence and may behave like single-trajectory baselines.

“When the archive is small, task overlap is sparse, or informative failures have not yet appeared, MGM has little comparative evidence and may behave like singletrajectory baselines.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

This work focuses on self-evolution of coding agents only, and the evolved agents are not equipped to act outside software engineering related repositories.

“This work focuses on self-evolution of coding agents only, and our evolved agents are not equipped to act outside softwareengineering related/ repositories.”

Classified as probably not a substantial claim.

Giving a self-modifying agent access to production systems, external APIs, or writable storage outside controlled containers could allow unintended changes to spread in ways that are hard to audit or reverse.

“Giving a self-modifying agent access to production systems, external APIs, or writable storage outside controlled containers could allow unintended changes to spread in ways that are hard to audit or reverse.”

Classified as probably not a substantial claim. May combine two claims.

In the experiments, self-modification and evaluation run inside isolated containers with no network access and with read-only mounts of the host file system.

“In our experiments, self-modification and evaluation run inside isolated containers with no network access and with read-only mounts of the host file system, following the safety protocol of prior archive-based self-improving agents.”

Classified as probably not a substantial claim.

Self-modifying agents have a different risk profile from static models because an erroneous or adversarial self-edit can persist in later descendants.

“Such systems have a different risk profile from static models because an erroneous or adversarial self-edit can persist in later descendants.”

May combine two claims.

ΦRM plays an important role in guiding the self-improvement process toward more promising agents, and ΦCH is even more critical for effective self-improvement.

“This suggests that Φ RM plays an important role in guiding the self-improvement process toward more promising agents, and that Φ CH is even more critical for effective self-improvement, likely because it helps preserve and reuse useful evolutionary information across iterations.”

May combine two claims.

The implementation matches the diagnostic role of hybridization: successful trajectories act as donors when available, and failed-failed comparisons are used to identify general weaknesses rather than task-specific patches.

“This implementation matches the diagnostic role of hybridization: successful trajectories act as donors when available, and failed-failed comparisons are used to identify general weaknesses rather than task-specific patches.”

Classified as probably not a substantial claim.

Scaffold-level self-improvement can amplify both beneficial coding assistance and harmful automation, including generation of malicious software or exploitation of vulnerable systems, if isolation is removed.

“Scaffold-level self-improvement can amplify both beneficial coding assistance and harmful automation, including generation of malicious software or exploitation of vulnerable systems, if isolation is removed.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

When the four assumptions fail, the comparative operators may provide little or no fix-quality advantage; this case is explicitly represented in the simulation by the null setting ρ = 1.

“When these assumptions fail, the comparative operators may provide little or no fix-quality advantage; this case is explicitly represented in our simulation by the null setting ρ = 1.”

May combine two claims.

The raw maximum is often attained by a sparsely evaluated node, whereas the selected result favors a high utility backed by more evaluations.

“The raw maximum is often attained by a sparsely evaluated node, whereas the selected result favors a high utility backed by more evaluations.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Public benchmark material may overlap with pretraining data, which limits how strongly offline scores should be read as evidence of robust real-world competence.

“In addition, public benchmark material may overlap with pretraining data, which limits how strongly offline scores should be read as evidence of robust real-world competence.”

May combine two claims.

MGM is history-dependent: its advantage comes from comparative evidence in the archive.

“MGM is history-dependent.Its advantage comes from comparative evidence in the archive.”

May combine two claims.

The fallback in cross-lineage hybridization preserves the archive policy's preference for promising lineages while still allowing the editor to diagnose complementary failure modes from the same-task comparison.

“This fallback preserves the archive policy's preference for promising lineages while still allowing the editor to diagnose complementary failure modes from the same-task comparison.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The claims concern coding-agent scaffolds evaluated on public software-engineering benchmarks and do not establish that the same operators would transfer unchanged to non-coding agents or open-ended real-world software maintenance.

“Finally, our claims concern coding-agent scaffolds evaluated on public software-engineering benchmarks.They do not establish that the same operators would transfer unchanged to non-coding agents or open-ended real-world software maintenance.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The benchmarks and backbone models used here may inherit harmful or biased content.

“The benchmarks and backbone models used here may also inherit harmful or biased content.”

May combine two claims.

Cumulatively, these changes transform the initial agent from a prompt-only code generator into a test-contract-guided, self-auditing, and empirically selfcorrecting coding agent capable of reducing API hallucination, enforcing exact test constraints, and recovering from runtime failures through language-agnostic test feedback.

“Cumulatively, these changes transform the initial agent from a prompt-only code generator into a test-contract-guided, self-auditing, and empirically selfcorrecting coding agent capable of reducing API hallucination, enforcing exact test constraints, and recovering from runtime failures through language-agnostic test feedback.”

Probably not a substantial claim: may not pass S2 (checkable).

This distinction is important because generalizability should not be measured only by whether a change uses broad language such as general capability.

“This distinction is important because generalizability should not be measured only by whether a change uses broad language such as general capability.”

Classified as probably not a substantial claim.

These benchmark choices are aligned with MGM's objective.

“These benchmark choices are aligned with MGM's objective.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

It requires the model to reason about the interaction between prompts, tools, control flow, repository exploration, execution feedback, and prior agent behavior.

“It requires the model to reason about the interaction between prompts, tools, control flow, repository exploration, execution feedback, and prior agent behavior.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

These are not tied to a particular programming language, benchmark instance, or repository-specific bug.

“These are not tied to a particular programming language, benchmark instance, or repository-specific bug.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

If the diagnosis is shallow or incorrect, the resulting code edit may still be syntactically valid, but it can target the wrong mechanism, overfit to superficial symptoms, or introduce brittle workflow changes.

“If the diagnosis is shallow or incorrect, the resulting code edit may still be syntactically valid, but it can target the wrong mechanism, overfit to superficial symptoms, or introduce brittle workflow changes.”

May combine two claims.

HGM also discovers useful ideas, such as iterative testing, API alignment, context discovery, and auxiliary tool utilities, but these ideas appear less consolidated into a single reusable default workflow.

“HGM also discovers useful ideas, such as iterative testing, API alignment, context discovery, and auxiliary tool utilities, but these ideas appear less consolidated into a single reusable default workflow.”

May combine two claims.

Qwen3-Coder-Next still enables both HGM and MGM to improve over the initial scaffold, showing that strong coding backbones can support meaningful self-evolution.

“Qwen3-Coder-Next still enables both HGM and MGM to improve over the initial scaffold, showing that strong coding backbones can support meaningful self-evolution.”

Probably not a substantial claim: may not pass S4 (based).

Cross-lineage hybridization requires the model to compare different agents on the same task and extract transferable scaffold-level traits.

“Cross-lineage hybridization requires the model to compare different agents on the same task and extract transferable scaffold-level traits.”

May combine two claims.

SWE-bench Verified, SWE-bench Pro, and Polyglot provide complementary evidence: standard real-world issue resolution, long-horizon robustness, and cross-language generality.

“SWE-bench Verified, SWE-bench Pro, and Polyglot therefore provide complementary evidence: standard real-world issue resolution, long-horizon robustness, and cross-language generality.”

May combine two claims.

MGM is a training-time self-evolution method, even though the training signal is not gradient-based.

“This makes MGM a training-time self-evolution method, even though the training signal is not gradient-based.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Reaction-norm mutation is intended to identify general weaknesses that recur across tasks, so it should be evaluated on settings where task diversity matters.

“Reaction-norm mutation is intended to identify general weaknesses that recur across tasks, so it should be evaluated on settings where task diversity matters.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Richer evidence is only useful if the backbone model can reason over it.

“However, richer evidence is only useful if the backbone model can reason over it.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Cross-lineage hybridization is intended to transfer useful behaviors between agents, so it should be tested on benchmarks where different strategies may solve different subsets of tasks.

“Cross-lineage hybridization is intended to transfer useful behaviors between agents, so it should be tested on benchmarks where different strategies may solve different subsets of tasks.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

This kind of skills can transfer across many programming tasks because almost all repair problems involve some form of latent contract between tests, existing code, and the expected implementation.

“This kind of skills can transfer across many programming tasks because almost all repair problems involve some form of latent contract between tests, existing code, and the expected implementation.”

May combine two claims.

HGM, by comparison, evolves a wider variety of interventions, but they are more fragmented and less clearly integrated into a stable general workflow.

“HGM, by comparison, evolves a wider variety of interventions, but they are more fragmented and less clearly integrated into a stable general workflow.”

May combine two claims.

These operations make the diagnosis stage more informative, but also more reasoning-intensive.

“These operations make the diagnosis stage more informative, but also more reasoning-intensive.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

The edit itself is a coding operation, but deciding what to edit is a diagnosis and abstraction problem.

“The edit itself is a coding operation, but deciding what to edit is a diagnosis and abstraction problem.”

May combine two claims.

MGM introduces reaction-norm mutation and cross-lineage hybridization, both of which increase the amount of comparative evidence available to the self-modification step.

“MGM introduces reaction-norm mutation and cross-lineage hybridization, both of which increase the amount of comparative evidence available to the self-modification step.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

The model must inspect the trajectory, diagnose the underlying failure, and transform that diagnosis into a robust scaffold-level edit.

“The model must inspect the trajectory, diagnose the underlying failure, and transform that diagnosis into a robust scaffold-level edit.”

Probably not a substantial claim: may not pass S4 (based).

Reaction-norm mutation requires the model to compare multiple trajectories of the same agent and identify recurring behavioral patterns.

“Reaction-norm mutation requires the model to compare multiple trajectories of the same agent and identify recurring behavioral patterns.”

May combine two claims.

Although self-evolution ultimately edits code, the quality of the edit depends on whether the model can diagnose the failure mechanism before modifying the scaffold.

“Although self-evolution ultimately edits code, the quality of the edit depends on whether the model can diagnose the failure mechanism before modifying the scaffold.”

Classified as probably not a substantial claim.

MGM's modifications are evaluated over a task distribution.

“They are evaluated over a task distribution and stored as descendants in an archive.”

Classified as probably not a substantial claim.

A more operational criterion is whether the evolved skill abstracts away from the original training instance and becomes a reusable procedure for a broad class of future tasks.

“A more operational criterion is whether the evolved skill abstracts away from the original training instance and becomes a reusable procedure for a broad class of future tasks.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Conversely, a model with stronger reasoning ability can generate more accurate diagnoses and therefore produce more reusable scaffold-level modifications.

“Conversely, a model with stronger reasoning ability can generate more accurate diagnoses and therefore produce more reusable scaffold-level modifications.”

Classified as probably not a substantial claim.

MGM's objective is to discover general capabilities-better planning, validation, context management, debugging, or tool usage-that remain useful beyond the tasks that exposed them.

“The objective is to discover general capabilities-better planning, validation, context management, debugging, or tool usage-that remain useful beyond the tasks that exposed them.”

Probably not a substantial claim: may not pass S4 (based).

MGM plays a role analogous to policy learning: it changes the inherited scaffold that future agents use.

“MGM plays a role analogous to policy learning: it changes the inherited scaffold that future agents use.”

Classified as probably not a substantial claim. May combine two claims.

In a self-evolving coding agent, the model is not only asked to write code; it is asked to reason about why the current agent failed and how the scaffold should be changed to prevent similar failures in future tasks.

“In a self-evolving coding agent, the model is not only asked to write code; it is asked to reason about why the current agent failed and how the scaffold should be changed to prevent similar failures in future tasks.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The visualization suggests that MGM produces changes that concentrate around a reusable workflow-level capability.

“The visualization 11 suggests that MGM produces changes that concentrate around a reusable workflow-level capability.”

May combine two claims.

The concrete utility added in this example focuses on tracing docstring and autodoc-style failures, but the underlying scaffold-level skill is more general: MGM discovers a workflow that first grounds the repair in failing tests, then traces the relevant code path, and finally constrains the submitted diff to files supported by the agent's own investigation.

“The concrete utility added in this example focuses on tracing docstring and autodoc-style failures, but the underlying scaffold-level skill is more general: MGM discovers a workflow that first grounds the repair in failing tests, then traces the relevant code path, and finally constrains the submitted diff to files supported by the agent's own investigation.”

May combine two claims.

As a result, the evolved scaffold encourages localized fixes and discourages broad, accidental, or speculative edits.

“As a result, the evolved scaffold encourages localized fixes and discourages broad, accidental, or speculative edits.”

May combine two claims.

MGM maintains high accuracy across C++, Go, Java, JavaScript, Python, and Rust, indicating that the evolved improvements transfer across languages rather than specializing to a single language subset.

“MGM maintains high accuracy across C++, Go, Java, JavaScript, Python, and Rust, indicating that the evolved improvements transfer across languages rather than specializing to a single language subset.”