The DOI matches its DataCite record; 45 of the 45 references it cites were found in a registry or an index; 10 of the 15 sources its claims cite were checked for support.
ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution
Open accessAbstract
We introduce ShinkaEvolve: a new open-source framework leveraging large language models (LLMs) to advance scientific discovery with state-of-the-art performance and unprecedented efficiency. Recent advances in scaling inference time compute of LLMs have enabled significant progress in generalized scientific discovery. These approaches rely on evolutionary agentic harnesses that leverage LLMs as mutation operators to generate candidate solutions. However, current code evolution methods suffer from critical limitations: they are sample inefficient, requiring thousands of samples to identify effective solutions, and remain closed-source, hindering broad adoption and extension. ShinkaEvolve addresses these limitations, introducing three key innovations: a parent sampling technique balancing exploration and exploitation, code novelty rejection-sampling for efficient search space exploration, and a bandit-based LLM ensemble selection strategy. We evaluate ShinkaEvolve across diverse tasks, demonstrating consistent improvements in sample efficiency and solution quality. ShinkaEvolve discovers a new state-of-the-art circle packing solution using only 150 samples, designs high-performing agentic harnesses for AIME mathematical reasoning tasks, identifies improvements to ALE-Bench competitive programming solutions, and discovers novel mixture-of-expert load balancing loss functions that illuminate the space of optimization strategies. Our results demonstrate that ShinkaEvolve achieves broad applicability with exceptional sample efficiency. By providing open-source accessibility and cost-efficiency, this work democratizes open-ended discovery across diverse computational problems.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
ShinkaEvolve is an open-source LLM-driven evolutionary program search framework with three innovations—weighted parent sampling, code novelty rejection sampling, and bandit-based LLM ensemble selection—designed for sample efficiency. It reports state-of-the-art or improved results across circle packing, AIME agent scaffolds, ALE-Bench, and mixture-of-experts load-balancing loss discovery, including a new circle-packing solution in 150 evaluations.
Key findings
- Circle packing: ShinkaEvolve discovers a new state-of-the-art solution using only 150 samples/evaluations, outperforming AlphaEvolve; the discovered solution has sum of radii 2.635983099011548 under relaxed verification and 2.6359828390115476 after exact adjustment, with an exact-verification replication score of 2.63597770931127.
- AIME 2024: the evolved agent scaffold uses 7 LLM calls (3 generation + 3 review + 1 synthesis) within the 10-call limit, reaches a Pareto frontier between performance and query budget, generalizes to 2025 AIME problems, and transfers to gpt-4.1-mini, gpt-4.1, and o4-mini.
- ALE-Bench LITE: ShinkaEvolve improves ALE-Agent solutions by approximately 2.3% on average across 10 tasks; on ahc039, the combined solution would rank 2nd on the AtCoder leaderboard (3140 performance) versus ALE-Agent’s 5th (2880).
- MoE load balancing: the discovered loss improves over the global-batch LBL across λ ∈ {0.001, 0.01, 0.1} in a 2.7B-parameter MoE; ablations show weighted parent sampling outperforms random search and hill climbing, bandit-based LLM ensembling outperforms single and fixed ensembles, and embedding-based rejection sampling strongly outperforms no rejection sampling.
Methods
- ShinkaEvolve maintains an archive of island subpopulations, samples parents and inspirations, mutates programs via diff edits, full rewrites, and crossover, rejects near-duplicates using embedding cosine similarity above 0.95 with an optional LLM novelty judge, executes programs for scalar fitness plus public metrics and textual feedback, adapts LLM sampling via UCB1, and periodically appends meta-scratchpad insights to mutation prompts.
- It is evaluated on four domains: circle packing (26 circles, 150 generations), AIME 2024 (30 problems, 75 generations, max 10 LLM queries, gpt-4.1-nano, 3 runs per candidate), ALE-Bench LITE (10 AtCoder heuristic tasks, 50 generations, C++), and MoE LBL discovery (556M-parameter/82M-active small MoE with 64 experts and 8 active, 2B fineweb tokens, 30 iterations; 2.7B-parameter/404M-active large MoE, ~30B tokens, seven benchmarks).
- Ablations on circle packing compare parent selection strategies (weighted sampling vs. random search and hill climbing), LLM ensembling (single LLM vs. fixed ensemble vs. bandit-based ensemble), and novelty rejection sampling (none vs. embedding-based vs. embedding plus LLM-as-a-novelty-judge).
Limitations
- Stated in the paper: the implementation uses fixed configurations with limited automatic control over exploration-exploitation balance; task specification requires manual human expertise for objective functions and evaluation; and the framework is constrained to problems with well-defined numerical objectives.
- Evident in the text: ALE-Bench modifications often stayed algorithmically close to the ALE-Agent initialization, indicating potential overfitting to the initialization solution; the MoE architecture used for evolving and testing the LBL was quite similar and the training budget was limited; API costs from large-scale LLM usage could create economic barriers; and the main circle-packing run used relaxed verification with 1×10⁻⁶ slack before exact post-processing.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
31 Own result · 20 Own interpretation · 10 No basis given · 9 Own method · 5 Partly supported · 3 Supported · 2 Sources not found · accuracy not yet measured
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ShinkaEvolve discovers a new stateof-the-art circle packing solution using only 150 samples”
- Also stated in: § 4.1. Circle Packing: Reproducing & Improving AlphaEvolve Results · p. 6 · plain
“ShinkaEvolve outperforms AlphaEvolve's solution within less than 150 program evaluations.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4.1. Circle Packing: Reproducing & Improving AlphaEvolve Results · p. 6 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on one task, ahc039 , the combination of ShinkaEvolve with ALE-Agent resulted in the second place submission on the AtCoder leaderboard if they had participated.”
- Also stated in: § 4.3. ALE-Bench: Evolving Programs for Combinatorial Optimization · p. 8 · plain
“The base solution by ALE-Agent applies simulated annealing with kd-tree data structure (5th, 2880 performance). ShinkaEvolve further improved the solution (2nd, 3140 performance)”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4.3. ALE-Bench: Evolving Programs for Combinatorial Optimization · p. 8 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we observe that the proposed changes by ShinkaEvolve remained algorithmically close to the original ALE-Agent's initialization solution.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“designs high-performing agentic harnesses for AIME mathematical reasoning tasks”
- Also stated in: § 4.2. AIME: Evolving Agent Scaffolds for Math Reasoning · p. 7 · plain
“ShinkaEvolve discovers scaffold designs that significantly outperform hand-designed baselines, including simple single-query agents and sophisticated majority-voting approaches.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4.2. AIME: Evolving Agent Scaffolds for Math Reasoning · p. 7 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“identifies improvements to ALE-Bench competitive programming solutions”
- Also stated in: § 4.3. ALE-Bench: Evolving Programs for Combinatorial Optimization · p. 8 · plain
“ShinkaEvolve is able to improve the solutions discovered by ALE-Agent by approximately 2.3% across the 10 tasks on average (Figure 7).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4.3. ALE-Bench: Evolving Programs for Combinatorial Optimization · p. 8 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Bandit-based LLM ensembling slightly improves the performance over a fixed uniform ensemble distribution.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the fixed ensemble shows moderate improvements over single LLM usage”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“the adaptive bandit strategy achieves the highest performance”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Consistent with our previous analysis, ShinkaEvolve's LBL appears to improve from the original LBL across both axes.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the consistent generalization results across training budgets and coefficients λ provide an optimistic outlook for future extensions to much longer training regimes, where even small efficiency gains could scale to significant cost savings.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 22
- It may state two separate claims as one. 20
- The quote only partly states this claim. 2
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, due to the non-differentiability of the top𝐾 expert selection operation, it is critical to provide the router with an auxiliary load balancing loss (LBL).”
What the sources say
- Partly supportedcites Shazeer et al. (2017) sourceExperimental — accuracy not yet measured
Section 4 (pp. 5–6) introduces auxiliary losses to counter self-reinforcing expert imbalance and unequal loads. Appendix A (p. 13) says discrete expert counts cannot be used directly in backpropagation, so the load loss uses a smooth estimator. But Section 2.1 (p. 4) says selected gate values have nonzero derivatives and that discontinuities have not been a problem in practice; the paper does not say top-K non-differentiability makes an auxiliary load-balancing loss critical. (LLM, conf=0.88)
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We follow the evaluation protocol of ALE-Agent (Imajuku et al., 2025) and use the score calculated on the public test cases as the fitness function.”
What the sources say
- Supportedcites Imajuku et al., 2025 source
Appendix B.2 (p. 28) describes ALE-Agent selecting candidates using a priority score calculated from their performance on a fixed suite of 50 test cases. That score combines acceptance ratio and problem-specific score; it is not necessarily the raw contest score alone. The paper separately uses private test cases for final evaluation (Appendix A.2.2, p. 26). (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The ALE-Bench benchmark (Imajuku et al., 2025) is a collection of heuristic programming problems previously used in competitive programming contests (AtCoder).”
What the sources say
- Supportedcites Imajuku et al., 2025 source
The Introduction (p. 2) says ALE-Bench collects past tasks from the AtCoder Heuristic Contest. Figure 1 (p. 1) likewise describes it as collecting past contest tasks, and Section 3.1 (p. 3) identifies AHC as an AtCoder score-based algorithmic competition. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Minor design variations have been shown to significantly affect both efficiency and specialization ability (Dai et al., 2024; Jiang et al., 2024; Liu et al., 2024b; Qiu et al., 2025; Team, 2024).”
What the sources say
- Partly supportedcites Dai et al., 2024 sourceExperimental — accuracy not yet measured
Sections 3.1 and 3.2 describe how fine-grained expert segmentation and shared expert isolation can improve specialization and parameter efficiency; Section 4.4 reports improved overall performance in ablations. The paper does not characterize these architectural changes as minor or show a significant change in computational efficiency—the comparisons hold computational cost or activated parameters constant. (LLM, conf=0.82)
- Partly supportedcites Jiang et al., 2024 sourceExperimental — accuracy not yet measured
The Size and Efficiency section reports that Mixtral uses fewer active parameters per token than Llama 2 70B while outperforming it across most categories, supporting an efficiency difference between architectures. But the paper does not test minor design variations, and its Routing analysis (§5; page unavailable) finds no obvious topic-based expert specialization. It therefore does not show that minor variations significantly affect both efficiency and specialization ability. (LLM, conf=0.82)
- Not matchedcites Liu et al., 2024b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One of the most widely adopted designs is the 'global-batch' LBL introduced by Shazeer et al. (2017), which underpins several state-of-the-art open models such as Qwen 3 (Yang et al., 2025).”
What the sources say
- Partly supportedcites Shazeer et al. (2017) sourceExperimental — accuracy not yet measured
Section 4 (pp. 5–6) introduces batchwise expert-balancing losses, and Section 3.1 (p. 4) describes combining batches across devices for the MoE layer. This supports identifying Shazeer et al. with a batch-based load-balancing design, but the paper does not establish that it is among the most widely adopted designs. The Qwen 3 example has a separate citation and is not attributed to this source here. (LLM, conf=0.82)
- Partly supportedcites Yang et al. (2025) sourceExperimental — accuracy not yet measured
Section 2 (Architecture; page not provided) says the Qwen3 MoE models adopt a global-batch load balancing loss. It does not establish that the design is widely adopted or used by several other models, and it cites Qiu et al. (2025), not Shazeer et al. (2017), for that loss. (LLM, conf=0.88)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Devising an effective load balancing loss that simultaneously encourages efficiency and expert specialization, without hindering expressivity, remains an open design challenge that has driven much of the recent progress in MoEs (Dai et al., 2024; Du et al., 2022; Fedus et al., 2022; Muennighoff et al., 2024; Qiu et al., 2025; Shazeer et al., 2017; Xue et al., 2024; Zoph et al., 2022).”
What the sources say
- Partly supportedcites Dai et al., 2024 sourceExperimental — accuracy not yet measured
Section 3.3, “Load Balance Consideration” (page not provided), says load imbalance can cause routing collapse and computation bottlenecks, while excessive balance constraints compromise model performance. It therefore supports a tradeoff in designing load-balancing losses. The paper does not say that such a loss itself encourages expert specialization or that this specific design challenge has driven much of the recent progress in MoEs; it pursues specialization primarily through architectural strategies. (LLM, conf=0.85)
- Not matchedcites Du et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Fedus et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The LBL prevents collapse toward uneven token distributions and under-specialized experts.”
What the sources say
- Partly supportedcites Shazeer et al. (2017) sourceExperimental — accuracy not yet measured
Section 4 (pp. 5–6) describes a self-reinforcing imbalance in expert selection and says the load-balancing loss encourages experts to receive similar numbers of examples. It also says experts specialize, but does not establish that the load-balancing loss prevents under-specialization; its balancing constraint is soft rather than a guarantee against collapse. (LLM, conf=0.85)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“To ensure the robustness of our results, we additionally validated our solutions using AlphaEvolve 's (Novikov et al., 2025) exact verification code.”
What the sources say
- Supportedcites Novikov et al., 2025 source
Appendix B, p. 38, states that verification code for its reported mathematical constructions is available in the accompanying Google Colab. This supports the citation’s identification of AlphaEvolve’s verification code; the source does not independently document the citing authors’ validation step. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Cross-LLM model transfer experiments validate robustness, with successful adaptation to gpt-4.1-mini , gpt-4.1 , and o4-mini demonstrating that discovered architectures capture generalizable strategies rather than model-specific optimizations (Figure 6, right).”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ShinkaEvolve was evaluated over 150 evolutionary generations, demonstrating remarkable sample efficiency compared to existing approaches that typically require thousands of evaluations (Figure 1).”
boostedcorrelationalSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: Existing code evolution methods are sample inefficient because they use naive exploration strategies that fail to leverage accumulated knowledge from previous generations.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“discovers novel mixture-of-expert load balancing loss functions that illuminate the space of optimization strategies.”
- Also stated in: § 4.4. LLM Training: Evolving Losses for Balanced and Effective Experts · p. 9 · boosted
“showing that ShinkaEvolve's new loss achieves a consistent edge across our training configurations, growing larger with the value of the 𝜆 coefficient.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
- Also stated in: § 4.4. LLM Training: Evolving Losses for Balanced and Effective Experts · p. 9 · boosted
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The search reveals a Pareto frontier between efficiency and performance (Figure 6, left), with 7 LLM queries yielding maximum performance while an alternative scaffold achieves comparable results using the full 10query budget.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The evolved algorithm (Section C.1) combines three key innovations: (1) a sophisticated initialization strategy that places circles in a structured goldenangle spiral pattern with strategic corner and edge positioning, (2) a hybrid optimization approach integrating SLSQP gradient-based refinement with simulated annealing for global exploration, and (3) intelligent perturbation mechanisms that”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Evaluating on 2023 and 2025 AIME problems shows different transfer patterns (Figure 6, middle): smaller improvements on 2023 problems suggest potential saturation due to training data contamination, while larger gains on 2025 problems indicate successful generalization to recent, unseen challenges.”
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Hill climbing shows strong initial performance but plateaus quickly”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that our discovered solution can be made trivially exact by reducing each circle's radius by 1 × 10 -8 , demonstrating the high precision of our approach.”
boosteddirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Weighted sampling consistently outperforms both random search and hill climbing across all tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The discovery of the solution requires more samples to be evaluated.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The bandit-based LLM ensemble significantly outperforms both single LLM and fixed ensemble approaches.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“ShinkaEvolve achieves state-of-the-art results across four domains: circle packing with 150 evaluations (orders of magnitude improvement), sophisticated AIME reasoning scaffolds, ALE-Bench algorithmic improvements, and novel mixture-of-expert load balancing.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Weighted parent sampling outperforms random search and hill climbing.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We evaluate ShinkaEvolve across diverse tasks, demonstrating consistent improvements in sample efficiency and solution quality.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: Existing code evolution methods are sample inefficient because they use naive exploration strategies that fail to leverage accumulated knowledge from previous generations.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our results demonstrate that ShinkaEvolve achieves broad applicability with exceptional sample efficiency.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
- Rests on an assumption: Existing code evolution methods are sample inefficient because they use naive exploration strategies that fail to leverage accumulated knowledge from previous generations.
In the paper
“For the main ShinkaEvolve run presented in the paper, we employed the verification script provided by OpenEvolve (Sharma, 2025), which allows for 1 × 10 -6 numerical slack.”
What the sources say
- Not matchedcites Sharma, 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
In the paper
“After evolution, we evaluate the discovered scaffold designs on 2023 and 2025 AIME problems (AIM, 2023, 2025) to assess generalization as well as robustness to different base agent language models.”
What the sources say
- Not matchedcites AIM, 2023, 2025
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This grounding provides ShinkaEvolve a two-fold search objective: minimize CE while improving load balance.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, ShinkaEvolve's new term can be seen as a safety net that adaptively activates and vanishes once an expert crosses the floor, providing dead experts and avoiding over-regularizing well-balanced layers.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To avoid local noise affecting the cross-entropy calculations, we average it over the last 10M tokens.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally and to combat stochasticity in LLM queries, we evaluated each candidate evaluated across three independent runs on the complete question set.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Task specification requires manual human expertise for objective functions and evaluation.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Given the expense of pretraining, we run ShinkaEvolve for only 30 iterations, focusing on gpt-4.1 , gemini-2.5-pro , and claude-sonnet-4 .”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Our implementation uses fixed configurations with limited automatic control over exploration-exploitation balance, which may vary across domains.”
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ShinkaEvolve's open-source release further democratizes advanced evolutionary optimization, making it accessible to researchers and practitioners previously lacking access to proprietary systems.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This formulation encourages token usage across experts to align with the router's average soft assignment probabilities.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, API costs from large-scale LLM usage could create economic barriers, potentially constraining democratization goals.”
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“However, we also note that the architecture used for evolving and testing the employed LBL was quite similar, and the training budget was still limited.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“However, we also note that the architecture used for evolving and testing the employed LBL was quite similar, and the training budget was still limited.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Intuitively , this term softly affects the MoE router of any layer, with experts getting allocated a fraction of tokens less than 𝜏 . The multiplier 𝑠 ( 𝑃ℓ ) makes this push stronger when the layer's routing entropy 𝐻 ( 𝑃ℓ ) is low and the router is concentrating on fewer dominating experts.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper relies on this without support.
Existing code evolution methods are sample inefficient because they use naive exploration strategies that fail to leverage accumulated knowledge from previous generations.
“This inefficiency stems from naive exploration strategies that fail to effectively leverage accumulated knowledge from previous generations.”
The paper relies on this without support.
Most leading code evolution systems remain closed-source, creating barriers to reproducibility and limiting community-driven improvements.
“Additionally, most leading systems remain closed-source, creating barriers to reproducibility and limiting community-driven improvements.”
The paper relies on this without support.
The performance of different LLMs to propose mutations varies across problem domains and based on the current state of the sampled archive parents and inspiration programs.
“The performance of different LLMs to propose mutations can vary across problem domains and based on the current state of the sampled archive parents and inspiration programs.”
The paper relies on this without support.
The program archive is non-stationary.
“to account for the non-stationarity of the program archive”
The paper relies on this without support.
Similar code variants can waste computational resources without advancing the search frontier.
“Similar code variants can waste computational resources without advancing the search frontier.”
The paper relies on this without support.
LLM-driven scientific discovery has critical limitations in sample efficiency and open-source accessibility.
“addressing critical limitations in LLM-driven scientific discovery through improved sample efficiency and open-source accessibility.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ B.4. Mixture-of-Experts Load Balancing Loss · p. 26
“𝜏 = 0 . 064 / 𝑁𝐸 as a minimum usage threshold”
§ C.4. Mixture-of-Experts Load Balancing Loss · p. 52
“min_threshold = 0.01 * (64.0 / num_experts)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4.4. LLM Training: Evolving Losses for Balanced and Effective Experts · p. 9
“in terms of final perplexity (Figure 8, left) and downstream task performance (Figure 8, center)”
§ 4.4. LLM Training: Evolving Losses for Balanced and Effective Experts · p. 9
“Figure 8 | ShinkaEvolve for discovering Mixture-of-Experts Load Balancing Loss Functions. Left: Downstream task performance across seven benchmarks. Middle: Final perplexity across different missroute fractions.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ C.4. Mixture-of-Experts Load Balancing Loss · p. 52
“attention_mask: Optional[torch.Tensor] = None”
§ C.4. Mixture-of-Experts Load Balancing Loss · p. 52
“bsz, seqlen = attention_mask.shape n_tokens = bsz * seqlen”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4.3. ALE-Bench: Evolving Programs for Combinatorial Optimization · p. 8
“ultimately replacing simulated annealing with a more focused optimization combining greedy moves and targeted local search.”
§ C.3.2. ALE-Bench LITE task: ahc025 · p. 49
“// Targeted Simulated Annealing if (D > 1) {”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 4
- Nan Du, Yanping Huang, Andrew M Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, et al. Glam: Efficient scaling of language models with mixture-of-experts. In International conference on machine learning , pages 5547-5569. PMLR, 2022.
- Joel Lehman, Kenneth O Stanley, et al. Exploiting open-endedness to solve problems through the search for novelty. In ALIFE , pages 329-336, 2008.
- Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, et al. Competition-level code generation with alphacode. Science , 378(6624):1092-1097, 2022.
- Chris Lu, Samuel Holt, Claudio Fanconi, Alex James Chan, Jakob Nicolaus Foerster, Mihaela van der Schaar, and Robert Tjarko Lange. Discovering preference optimization algorithms with and for large language models. In The Thirty-eighth Annual Conference on Neural Information Processing Systems , 2024a. URL https://openreview.net/forum?id=erjQDJ0z9L .
Cited by
Sorted by citations
ThetaEvolve: Test-time Learning on Open Problems
Wang, Y., Su, S.-R., Zeng, Z., Xu, E., Ren, L., Yang, X., Huang, Z., He, X., Ma, L., Peng, B., et al. (2025) · arXiv · doi:10.48550/arxiv.2511.23473
“We consider two open tasks, circle packing (CP) and the first autocorrelation inequality (FACI), and report the best values mentioned in AlphaEvolve-v2 (Georgiev et al., 2025) and its variant ShinkaEvolve (Lange et al., 2025).”
InfluentialCORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended DiscoveryPreprint
Qu, A., Zheng, H., Zhou, Z., Yan, Y., Tang, Y., Ong, S. Y., Hong, F., Zhou, K., Jiang, C., Kong, M., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.01658 · Cited by 68
“Subsequent systems refine the search orchestration through adaptive sampling, island-based architectures, and Pareto-based selection (Sharma, 2025; Lange et al., 2025; Khrulkov et al., 2025; Assumpc¸˜ao et al., 2026; Yan et al., 2026; Agrawal et al., 2025), while AdaEvolve (Cemri et al., 2026) and…”
K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World ModelPreprint
Cao, S., Mao, Z., Gonzalez, J. E., & Stoica, I. G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.19128 · Cited by 35
“ShinkaEvolve (Lange et al., 2025a) proposes a population-based evolutionary framework that combines performance-driven selection with novelty-aware rejection to improve sample efficiency.”
DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven EvolutionPreprint
Jiang, J., Ding, T., & Zhu, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.02919 · Cited by 25
“Specifically, ShinkaEvolve (Lange et al., 2025), GigaEvo (Khrulkov et al., 2025), and CodeEvolve (As-sumpção et al., 2025) introduce advanced population management techniques, including novelty-based rejection sampling, MAP-Elites quality-diversity algorithms, and island-based crossover operators.”
SkyDiscover: A Flexible, Adaptive Framework for AI-Driven Scientific and Algorithmic Discovery
Liu, S., Cemri, M., Agarwal, S., et al. (2026) · CAIS · doi:10.1145/3786335.3813221 · Cited by 27
“RecentsystemssuchasAlphaEvolve[9],OpenEvolve[10], GEPA [1], and ShinkaEvolve [6] have demonstrated the promise of this paradigm across domains ranging from mathematical optimization to systems design.”
The FM AgentPreprint
Li, A., Wu, C., Ge, Z., Chong, Y. H., Hou, Z., Cao, L., Ju, C., Wu, J., Li, H., Zhang, H., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.26144 · Cited by 34
“ShinkaEvolve[53] improves sample efficiency through synergistic use of parent program sampling strategy, rejection-sampling, and LLM ensemble selection.”
Dream-RSI: Recursive Self-Improvement through Evolving WorldsPreprint
Zheng, T., Wu, X., Zhang, Z., He, Z., Zhang, C., Coleman, B., Wei, R., Bai, D., Liu, H., Liu, R., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.14858 · Cited by 27
“We compare against a broad set of existing automated discovery systems, including AlphaEvolve (Novikov et al., 2025), AlphaEvolveV2 (Georgiev et al., 2025), OpenEvolve (Sharma, 2025), CodeEvolve (As-sumpção et al., 2025), ShinkaEvolve (Lange et al., 2026), TTS-Discovery (Yuksekgonul et al., 2026), ThetaEvolve (Wang et…”
Jiang, Q., & Karniadakis, G. E. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00102-5 · Cited by 16
“Instead, they typically search within a predetermined hypothesis space or rely on a fixed modeling paradigm.”
Neural Architecture Discovery via Autonomous EvolutionPreprint
Xu, W., Liu, Y., Nan, Y., Ye, L., Hu, X., Qin, Z., & Liu, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.18074 · Cited by 28
AI co-mathematician: Accelerating mathematicians with agentic AIPreprint
Zheng, D., von Glehn, I., Zwólš, Y., Beloshapka, I., Buesing, L., Roy, D. M., Wattenberg, M., Georgiev, B., Schmidt, T., Cowie, A., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.06651 · Cited by 33
Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and PhysicsPreprint
Zhou, L., Ling, H., Fu, C., Huang, Y., Sun, M., Yu, W., Wang, X., Li, X., Su, X., Zhang, J., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.09901 · Cited by 32
“However, this paradigm faces significant limitations.”
Harness-Aware Self-Evolving: Co-Evolving Model Weights, Harness, and Task SolutionsPreprint
Luo, H., Huang, Y., Luo, S., Liu, F., Li, L., Hu, Z., Feng, J., & Liu, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.03935 · Cited by 15
“They rely on an external evaluator to select better artifacts (Romera-Paredes et al., 2024; Novikov et al., 2025; Sharma, 2025; Lange et al., 2026; Liu et al., 2024).”
Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch
Ferreira, F., Wobbe, L., Krishnakumar, A., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.24647 · Cited by 15
“In line with the increasing interest in open-ended agentic discovery [Zhang et al., 2026, Novikov et al., 2025, Lange et al., 2026, Liu et al., 2024, Wang et al., 2026], recent work explores LLMs as components in HPO pipelines.”
Harnessing the Collective Intelligence of AI Agents in the Wild for New DiscoveriesPreprint
Bianchi, F., Kwon, Y., Pappu, A., & Zou, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.10402 · Cited by 16
“A growing body of work applies language models and evolutionary search to open research problems [14, 17, 35, 24, 12, 32, 16].”
Can We Predict Before Executing Machine Learning Agents?
Zheng, J., Zhang, J., Luo, Y.-J., et al. (2026) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2601.05930 · Cited by 14
“…(Chai et al., 2025; Yu et al., 2025b; Team et al., 2025; Novikov et al., 2025) and conduct closed-loop experiments (Gottweis et al., 2025; Lange et al., 2025; Yuan et al., 2025; Yu et al., 2025a; Zhang et al., 2024a), highlighting the trend of “AI Scientists” operating in open-ended…”
Controlled Self-Evolution for Algorithmic Code Optimization
Hu, T., Chen, R.-H., Zhang, S., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2601.07348 · Cited by 13
“Population-based approaches (Romera-Paredes et al., 2023; Liu et al., 2024b; Lange et al., 2025) such as AlphaEvolve (Novikov et al., 2025) employ evolutionary resampling with stochastic mutations, while SE-Agent (Lin et al., 2025) introduces trajectory-level evolution via step-wise recombination.”
Simple Baselines are Competitive with Code EvolutionPreprint
Gideoni, Y., Risi, S., & Gal, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.16805 · Cited by 12
“However, these pipelines consist of numerous design choices, including using ensembles of language models for diversity and cost efficiency, automated parent program selection to maximize diversity, and various ways of receiving feedback [20, 23, 28].”
InfluentialTraining AI Scientists to Replicate ResearchPreprint
Falck, D., Sabri, S., Surina, A., Foster, T., Sims, A., Devlin, S., Rogers, D., Collins, T., Aleksiev, K., Kirsch, L., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.13331 · Cited by 10
“These typically rely upon one or more of in-context learning (Yang et al., 2024), evolutionary search (Lehman et al., 2023; Lange et al., 2025; Hambardzumyan et al., 2026), tree search (Jiang et al., 2025; Toledo et al., 2025; Inoue et al., 2025), or test-time training (Surina et al., 2025; Weng et…”
Vector Policy Optimization: Training for Diversity Improves Test-Time SearchPreprint
Boldi, R., Puri, I., Shenfeld, I., Kumar, A., Damani, M., Risi, S., Khattab, O., Hong, Z.-W., & Agrawal, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.22817 · Cited by 6
“Especially for hard problems, language models are typically wrapped in some form of search, ranging from simple rejection sampling with a verifier [Cobbe et al., 2021, Brown et al., 2024] to complex evolutionary methods like AlphaEvolve [Novikov et al., 2025, Lange et al., 2025].”
AIRA_2: Overcoming Bottlenecks in AI Research Agents
Hambardzumyan, K., Baldwin, N., Toledo, E., Hazra, R., Kuchnik, M., Omari, B. A., Foster, T. S., Protopopov, A., Gagnon-Audet, J.-C., Mediratta, I., et al. (2026) · arXiv · doi:10.48550/arxiv.2603.26499 · Cited by 1
“Relative to similar evolutionary agentic approaches (Novikov et al., 2025; Lange et al., 2026), we provide a controlled, module-by-module ablation of the end-to-end research agent.”
AI for Mathematics: Progress, Challenges, and Prospects
Ju, H., & Dong, B. (2026) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v3i3.18747 · Cited by 18
“Open-source implementations inspired by AlphaEvolve include OpenEvolve [126], ShinkaEvolve [89], and DeepEvolve [98].”
SwarmResearch: Orchestrating Coding Agents for Open-Ended Discovery
Virk, Y., Edds, Z., Xia, C. S., & Zhang, L. (2026) · arXiv · doi:10.48550/arxiv.2607.02807
“In traditional evolutionary methods (Novikov et al., 2025; Sharma, 2025; Lange et al., 2025), parent selection is also used to direct exploration-exploitation behavior but is completed by a heuristic algorithm rather than an LLM.”
InfluentialMotionDisco: Motion Discovery for Extreme Humanoid Loco-ManipulationPreprint
Taouil, I., Ciebelski, M., Omar, S., Zhao, H., Dai, A., Johnson, A. M., & Khadiv, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.06139 · Cited by 6
“In this work, we adopt the tree expansion strategy of ShinkaEvolve [22], which additionally uses novelty-based rejection sampling to filter candidates too similar to existing ones.”
InfluentialDigital Red Queen: Adversarial Program Evolution in Core War with LLMs
Kumar, A., Boldi, R., Sharma, P., Isola, P., Risi, S., Tang, Y., & Ha, D. (2026) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3795095.3805116 · Cited by 7
“Red Queen to Alice Lewis Carroll, Through the Looking-Glass Building on recent test-time scaling trends [36, 79], researchers are increasingly using large language models (LLMs) to evolve artifacts across many domains [40, 44, 55, 67].”
Agentic Architect: An Agentic AI Framework for Architecture Design Exploration and OptimizationPreprint
Kypriotis, V., Blasberg, A., Moiras, A., & Skarlatos, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.25083 · Cited by 5
“Recent advances in agentic AI systems, LLMs paired with evolutionary search and automated evaluation [3, 9, 26, 27, 31, 35, 39, 45], have demonstrated the potential for AI-driven discovery of algorithms across scientific and engineering domains, from mathematics to data center scheduling.”
Improving Coherence and Persistence in Agentic AI for System Optimization
Karimi, P., Noorbakhsh, K., Alizadeh, M., & Balakrishnan, H. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813138
“Weidentifytwo critical failure modes: (1) Evolutionary neighborhood bias : Code-evolution systems pro-pose code variants and select them using a scalar benchmark score [4, 23, 24, 36, 40, 42].”
MadEvolve: evolutionary optimization of cosmological algorithms with large language models
Li, T., 臧, S.-H. 诗. Z., & Münchmeyer, M. (2026) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ae7e3b · Cited by 5
AdaptEvolve: Improving Efficiency of Evolutionary AI Agents through Adaptive Model SelectionPreprint
Ray, P., Brahma, P. P., Liu, Z., & Barsoum, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.11931 · Cited by 2
“At the same time, agentic reasoning paradigms have evolved from single-turn generation toward it-* erative evolutionary refinement involving multiple LLMs, as exemplified by AlphaEvolve (Novikov et al., 2025), OpenEvolve (Sharma, 2025), and ShinkaEvolve (Lange et al., 2025).”
Brown, D., He, J., Jenne, H., Kvinge, H., & Vargas, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.20987
“These and other evolutionary systems [5, 11, 12] have also been applied to problems in systems research and algorithmic design.”
Task-CoEvolve: Efficient Harness Optimization via Adaptive Validation Task Selection
Miyai, A., Aizawa, K., & Yamasaki, T. (2026) · doi:10.48550/arxiv.2608.20169 · Cited by 6
“DemoEvolve (Che et al., 2026) incorporates human demonstrations to provide more informative feedback in sparse-reward settings, while ShinkaE-volve (Lange et al., 2026) and TurboEvolve (Yang et al., 2026) (Kossen et al., 2021). tinyBench-marks (Maia Polo et al., 2024) and AcTracer (Huang et al.,…”
Evolution Fine-Tuning: Learning to Discover Across 371 Optimization TasksPreprint
Lee, Y.-J., Kim, S., Kang, M., Chuen, A. C. L., Chen, Z., Han, S., Jung, T., & Kang, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.29082 · Cited by 5
“A supervised scaffold (i.e.,, search-based) [15, 8, 11, 12, 31] keeps the mutation operator’s parameters 𝜃 fixed and drives discovery through a hand-engineered modular framework that compensates for the LLM’s limited intrinsic capacity for discovery.”
SeaEvo: Advancing Algorithm Discovery with Strategy Space EvolutionPreprint
Luo, S., Huang, Y., Luo, H., Liu, F., Deng, G., Li, L., Yao, Q., Hu, Z., Feng, J., & Liu, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.24372 · Cited by 6
“Many evolutionary frameworks construct mutation context from high-fitness programs, recent ancestors, or code-level novelty signals (Novikov et al., 2025; Lange et al., 2025).”
The AI Telco Engineer: Toward Autonomous Discovery of Wireless Communications AlgorithmsPreprint
Aoudia, F. A., Hoydis, J., Cammerer, S., Maggi, L., Marti, G., & Keller, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.19803 · Cited by 6
“Similar frameworks for program evolution exist, such as ShinkaEvolve [4] and OpenEvolve [5].”
Zimmer, M., Pelleriti, N., Roux, C., & Pokutta, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.15914 · Cited by 11
“Recent open-source works have proposed methodological extensions, including OpenEvolve, ShinkaEvolve, ThetaEvolve, DeltaEvolve, and AdaEvolve (Sharma, 2025; Lange et al., 2025; Wang et al., 2025b; Jiang et al., 2026; Cemri et al., 2026).”
DeepReviewer 2.0: A Traceable Agentic System for Auditable Scientific Peer Review
Weng, Y.-X., Zhu, M.-J., Xie, Q.-J., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2604.09590 · Cited by 6
“…are unavailable, we fall back to a line-ratio approximation that allocates a vertical span proportional to the line indices: and use a conservative fixed horizontal range (e.g., x ∈ [8 , 92] in a normalized 0–100 coordinate system) so that the highlight remains visible even under extraction noise.”
ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyondPreprint
Zhao, M., Dong, J., Xu, K., Hasan, Z., Fan, C., Jiang, S., Mao, S., Lingya, T., Zou, L., Zhou, T., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.14354 · Cited by 9
Autonomous Discovery of Wireless Communications AlgorithmsPreprint
Aoudia, F. A., Hoydis, J., Cammerer, S., Marti, G., Nimier-David, M., Roussel, N., & Keller, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.17762 · Cited by 5
“We did not rely on existing frameworks such as [8], [9], [11], although these could have been adapted.”
InfluentialBenchEvolver: Frontier Task Synthesis via Solution-Centric EvolutionPreprint
Wu, Y., Li, A. J., Ma, W., Cao, L., Zhou, Z., Cemri, M., Liu, S., Xiu, Y., Yan, C., Zhao, H., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.01286 · Cited by 6
Compute Allocation for Self-Evolving LLMs: From Depth-Breadth to Multi-Armed Bandits
Xing, S.-X., He, H.-Y., Wu, K., et al. (2026) · doi:10.48550/arxiv.2605.29268 · Cited by 5
“The resulting Evolve systems (Lange et al., 2025; Wang et al., 2025; Assumpção et al., 2025; Cemri et al., 2026) have produced state-of-the-art results across mathematical discovery, combinatorial optimization, and algorithm design.”
GEAR: Genetic AutoResearch for Agentic Code EvolutionPreprint
Jeddi, A., Le, M. N., Karaimer, H. C., Derpanis, K. G., & Taati, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.13874 · Cited by 5
PACEvolve++: Improving Test-time Learning for Evolutionary Search Agents
Yan, M., Peng, B., Coleman, B., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.07039 · Cited by 5
“Prior self-evolving systems [19, 35] were primarily developed for settings with inexpensive evaluators, such as mathematical verification or kernel microbenchmarks, where each candidate can be scored in seconds, and hundreds of rollouts can be generated per optimization step.”
InfluentialASI-Evolve: AI Accelerates AIPreprint
Xu, W., Mi, T., Liu, Y., Nan, Y., Zhou, Z., Ye, L., Zhang, L., Qiao, Y., & Liu, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.29640 · Cited by 7
Verbalizing LLM's Higher-order Uncertainty via Imprecise Probabilities
Yang, A., Muandet, K., Caprio, M., Chau, S. L., & Adachi, M. (2026) · arXiv.org · doi:10.48550/arxiv.2603.10396 · Cited by 5
“As LLMs are increasingly deployed in multi-agent systems (e.g., [Lange et al., 2026]), collective uncertainty becomes crucial.”
Magellan: Autonomous Discovery of Novel Compiler Optimization Heuristics with AlphaEvolvePreprint
Chen, H., Novikov, A., Vũ, N., Alam, H., Zhang, Z., Grossman, A., Trofin, M., & Yazdanbakhsh, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.21096 · Cited by 6
“ShinkaEvolve [11] further advances the approach with techniques that improve sample efficiency and exploration behavior.”
Evolving Excellence: Automated Optimization of LLM-based AgentsPreprint
Brookes, P., Voskanyan, V., Giavrimis, R., Truscott, M., Ilieva, M., Pavlou, C., Staicu, A., Adham, M. T., Hood, W. E., Gong, J., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.09108 · Cited by 8
“ShinkaEvolve [18] applies an island-model evolutionary algorithm with LLM-driven mutation and crossover, novelty filtering via embedding similarity, and adaptive ensemble control to improve sample efficiency.”
LLM-Guided Search for Deletion-Correcting CodesPreprint
Weindel, F., & Heckel, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.00613 · Cited by 6
“In a typical coding scheme, an encoder maps information to a codeword, which is corrupted by errors during transmission, and a decoder attempts to recover the original message.”
Relay, Don't Route: Adaptive Population Handoff for Cost-Efficient LLM-Driven EvolutionPreprint
Luo, S., Huang, Y., Deng, G., Wang, H., Luo, H., Li, L., Hu, Z., Feng, J., & Liu, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.05651 · Cited by 4
Scattering Amplitudes as Programs: Self-Evolving Search for Theory and Event GenerationPreprint
Gu, Y. J., & Krippendorf, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.21629 · Cited by 5
“The released searches use ShinkaE-volve’s archive, island and generator abstractions [45], with a repository-scale coding-agent session as their proposal operator.”
Mutation Without Variation: Convergence Dynamics in LLM-Driven Program Evolution
Gurkan, C., Stonedahl, F., & Wilensky, U. J. (2026) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3795101.3814735 · Cited by 3
“We situate this work at the intersection of three lines of research: the integration of LLMs into evolutionary computation, the study of convergence dynamics in iterative LLM systems, and the role of drift in program evolution.”
Self-Improving Language Models with Bidirectional Evolutionary SearchPreprint
Xu, G., Qi, Z., Su, H., Ye, W., Lakkaraju, H., Kakade, S. M., & Du, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.28814 · Cited by 4
“More recently, evolutionary approaches such as AlphaEvolve [26], ShinkaEvolve [19], and ThetaE-volve [38] tackle hard and even open problems [27] by maintaining candidate populations with LLM-driven mutations and external evaluation.”
Influentialoptimize_anything: Unified Text Optimization can Outperform Specialized Systems
Agrawal, L. A., Lee, D., Tan, S., Ma, W., Elmaaroufi, K., Sandadi, R., Seshia, S. A., Sen, K., Klein, D., Stoica, I. G., et al. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813167 · Cited by 5
“Multi-task search: Given a dataset D = { 𝑒 1 𝑛 } of related problems, find an artifact 𝑥 ∈ X (e.g., a kernel-generation prompt) maximizing 𝑛”
What Do Evolutionary Coding Agents Evolve?Preprint
Pelleriti, N., Nelaturu, S. H., Zhou, Z., Li, Z., Zimmer, M., Han, B., & Pokutta, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.20086 · Cited by 6
“FunSearch [1] and AlphaEvolve [2, 3] established this paradigm, and a growing collection of open-source frameworks now extend it, including OpenEvolve [12], GEPA [13], ShinkaEvolve [4], GigaEvo [14], CodeEvolve [5], the FM Agent [15], and AIDE [16].”
ToolMol: Evolutionary Agentic Framework for Multi-objective Drug DiscoveryPreprint
Zhou, A. Y., Vadgama, S., Varambally, S., Eckmann, P., Gilson, M. K., & Yu, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.12784
FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage OrchestrationPreprint
Hu, Z., Lu, M., Wang, Z. F., Ruan, J., Chen, C., Pan, Z., Guan, Y., Wang, R., Yu, Z., Zhang, C., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.08520 · Cited by 5
“AlphaEvolve [20] and ShinkaEvolve [13] push this beyond the agent itself, evolving the generated programs the agent uses to solve problems, where the LLM acts as a mutation operator and an external evaluator scores each candidate.”
CausalEvolve: Towards Open-Ended Discovery with Causal ScratchpadPreprint
Chen, Y., Liu, C., Chen, Z., Liu, T., Han, B., & Zhang, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.14575 · Cited by 6
“From the results, we can find that across all tasks, CausalEvolve produce significantly better averaged results than ShinkaEvolve across different tasks and steps, demonstrating the effectiveness of CausalEvolve .”
InfluentialRankEvolve: Automating the Discovery of Retrieval Algorithms via LLM-Driven Evolution
Nian, J., Li, F., Park, D. H., & Fang, Y. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809962 · Cited by 6
“Starting from two seed programs, BM25 and query likelihood with Dirichlet smoothing, we evolve for several hundred steps.”
Flow-based Extremal Mathematical Structure DiscoveryPreprint
Bérczi, G., Hashemi, B., & Klüver, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.18005 · Cited by 4
“AlphaEvolve-family of models [2, 34, 35] operate in program space : the LLM proposes syntactic modifications to code, and an evaluator checks whether the resulting program produces valid, high-scoring solutions.”
Yuksel, K. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.13857 · Cited by 3
MetaMuse: Algorithm Generation via Creative IdeationPreprint
Ma, R., Liang, C.-J. M., Gao, Y., & Yan, F. Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.03851 · Cited by 7
“The first category is automatic heuristic design (Liu et al., 2024b; Ye et al., 2024; Zheng et al., 2025; Romera-Paredes et al., 2024; Novikov et al., 2025; Sharma, 2025; Dwivedula et al., 2025; Lange et al., 2025; Cheng et al., 2025).”
Exploit More, Explore Smarter for Budget-Constrained Agentic Search
Fang, H., & Wang, B. (2026) · doi:10.48550/arxiv.2608.23848 · Cited by 3
“ShinkaEvolve (Lange et al., 2026) and EvoX (Liu et al., 2026) are population-based evolutionary optimizers that run at a far larger budget than ExTS’s tight per-query regime (ShinkaEvolve uses roughly 150 evaluations for its headline result, whereas several of our settings run well below this,…”
Li, H.-R., Ge, Z., Zhang, Z., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.10389 · Cited by 3
Don't Gamble, GAMBLe: An Analytical Framework for AI-Driven Research SystemsPreprint
Ellis, M., & Castro, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.02863 · Cited by 3
SMCEvolve: Principled Scientific Discovery via Sequential Monte Carlo EvolutionPreprint
Jiang, J., Zhu, H., & Zhu, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.15308 · Cited by 2
“LLM-driven agents have enabled automated scientific discovery at scale: given the problem description and evaluator, the agent can autonomously search for programs that optimize a target objective, iteratively refining candidates based on evaluation feedback [1–5].”
InfluentialDrugSAGE:Self-evolving Agent Experience for Efficient State-of-the-Art Drug DiscoveryPreprint
Zhang, Y., Cheng, X., Liu, T., Du, Y., & Jin, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.15461 · Cited by 4
“ShinkaEvolve [37] is an evolutionary algorithm optimization agent.”
TurboEvolve: Towards Fast and Robust LLM-Driven Program EvolutionPreprint
Yang, Y., Zhong, Z., Li, J., Wu, J., Yuan, K., Chen, W., Yang, M., & Yue, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.18607 · Cited by 5
“…the stochasticity of genetic search compounded with LLM prompt sensitivity leads to substantial variance across runs (Novikov et al., 2025; Lange et al., 2025); because repeated trials are expensive, practitioners often cannot reliably assess whether an apparent improvement is robust or…”
InfluentialFrom Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors
Huang, Q., Ye, F.-R., Shahane, A., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.02792 · Cited by 3
“The proposed benchmark-guided technique provides new insights into designing efficient, robust, and reliable LLM-driven optimization methodologies for future work.”
CUCo: An Agentic Framework for Compute and Communication Co-design
Varadharajan, Y. S. V., Hu, B.-D., Agarwal, S., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.02376 · Cited by 3
Let the Barbarians In: How AI Can Accelerate Systems Performance ResearchPreprint
Cheng, A., Liu, S., Pan, M., Li, Z., Agarwal, S., Cemri, M., Wang, B., Krentsel, A., Xia, T., Park, J., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.14806 · Cited by 29
“…likely be uneven, with certain domains being transformed earlier and ∗ Equal contribution, ordered alphabetically. more profoundly than others, AI-driven approaches [5, 26, 38, 58, 71] have already reached a level of capability where they can meaningfully contribute to computer systems research.”
InfluentialAutonomous Mathematical Discovery in an Open-World Multi-Agent EnvironmentPreprint
Chung, S., Du, W., & Wesley, W. J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23691 · Cited by 5
The Optimizer Is the Agent: Reasoning-Driven Search across Prompts, Programs, and ML WorkflowsPreprint
Li, J., Liu, B., Xu, C., Wang, Y., He, Y., Wang, Z., Liu, Q., & Yao, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.06714 · Cited by 2
Fu, J., Liu, Z., Liu, Y., Zhang, H., & Zheng, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.28947 · Cited by 2
Budget-Aware LLM Discovery via Cost-Calibrated Frontier UtilityPreprint
Zhang, Y., Liu, Y., Liu, T., Chen, J., Zhang, X., Xie, K., Zhang, Q., Liu, X., Qi, Y., & Ma, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.26828 · Cited by 2
“Existing LLM discovery systems adapt their search strategies using evaluator feedback (Jiang et al., 2026; Lange et al., 2026; Cemri et al., 2026; Liu et al., 2026a).”
InfluentialHarness Engineering for LLM-Driven GPU Kernel GenerationPreprint
Shui, Y., W, C., Xu, H., Wen, S., & Wang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.17979 · Cited by 2
“2025; Wan et al., 2025; Lange et al., 2026; Chen et al., 2026).”
KISS Sorcar: A Stupidly-Simple General-Purpose and Software Engineering AI AssistantPreprint
Sen, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.23822 · Cited by 2
Agent-Aided Design for Dynamic CAD Models
Adler, M., Russo, M., & Cafarella, M. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813198 · Cited by 1
“Work on AI-driven research for systems (and algorithms) [4, 11, 17] has demonstrated that coding agents can achieve state-of-the-art performance when they are able to iteratively refine the implementation of a system (or algorithm) with feedback in the form of performance metrics on a predefined…”
AI-Driven Research for Databases
Cheng, A., Ng, H., Kabcenell, A. N., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2604.06566 · Cited by 2
“The overhead of recompiling, loading data, and benchmarking each candidate solution often makes the hundreds of iterations required for convergence infeasible [11, 12, 40].”
$k$-server-bench: Automating Potential Discovery for the $k$-Server ConjecturePreprint
Brilliantov, K., Bamas, É., & Abbe, E. A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.07240 · Cited by 1
“Alongside these application-oriented results, there is a substantial line of work on AI systems and search algorithms for mathematical and scientific discovery [35, 33, 36, 28, 38, 24, 40], as well as on applying such systems to concrete open mathematical tasks [33, 19, 31, 32].”
Automated near-term quantum algorithm discovery for molecular ground statesPreprint
Finger, F., Rapp, F., Kalidindi, P. V., He, K., Yin, K., Koziell-Pipe, A., Manrique, D. Z., Greene‐Diniz, G., Clark, S., Fawzi, H., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.26359 · Cited by 3
“These methods were first popularised by FunSearch [5] and its successor AlphaEvolve [9], and there have since been multiple variations and improvements on these systems [6, 8, 27].”
MOSAIC: More LLMs, Less Cost through Collaborative Reasoning for Compiler Optimizations
Tang, A. S., Priebe, C., Qin, L.-H., et al. (2026) · doi:10.48550/arxiv.2602.01935 · Cited by 2
“Unlike LE-MCTS (Park et al., 2025), which picks models at random, and Multi-LLM AB-MCTS (Inoue et al., 2025) and ShinkaEvolve (Lange et al., 2025), which use bandits over per-model rewards, MOSAIC lets the active LLM choose the next model from the program context and per-model statistics.”
InfluentialContextEvolve: Multi-Agent Context Compression for Systems Code OptimizationPreprint
Su, H., Zheng, Y., & Li, Y. X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.02597 · Cited by 4
“Recent work in-stantiates this with evolutionary coding agents that treat programs as individuals and use evaluation-driven selection and mutation for open-ended evolution and algorithm discovery (Lange et al., 2025; Assumpção et al., 2025; Wan et al., 2025; Wu et al., 2024; Liu et al., 2024b).”
Submodular Evaluation Subset Selection in Automatic Prompt OptimizationPreprint
Nian, J., Peng, Z., Shang, H., Park, D. H., & Fang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.03493 · Cited by 2
“More broadly, evolutionary search methods have also been used to iteratively improve algorithms using both evaluation score and critiques as feedback (Novikov et al., 2025; Lange et al., 2025).”
HybridQuestion: Human-AI Collaboration for Identifying High-Impact Research QuestionsPreprint
Zhao, K., Xu, F., Li, Y., & Liu, T.-Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.03849 · Cited by 4
“This ongoing evolution is characterized by the accelerating automation of the complete research lifecycle, spanning from initial literature review [7–9] and idea generation [10–12], through experimental execution [13–15], to scholarly writing [16–18].”
ImprovEvolve: Basin-Hopping Meets LLM-Guided Evolutionary SearchPreprint
Kravatskiy, A., Khrulkov, V., & Oseledets, I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.10233 · Cited by 4
“AlphaEvolve has inspired numerous open-source implementations and extensions (Sharma, 2025; Lange et al., 2025; Khrulkov et al., 2025; Assumpção et al., 2026; Wang et al., 2025; Yan et al., 2026; Yuksekgonul et al., 2026).”
FormalEvolve: Neuro-Symbolic Evolutionary Search for Diverse Autoformalization
Lu, H.-J., Wang, W., & Liu, J. (2026) · arXiv.org · doi:10.48550/arxiv.2603.19828 · Cited by 1
“Figure 2 gives the visual overview, and Section E.1 gives the detailed pseudocode.”
Stateless Language Agents: Scaling Long-Horizon Automated ResearchPreprint
Zhang, Q., Ji, C., Sun, I., Li, Y., Upasani, S., Ruan, S., Ma, B., Hong, F., Kamanuru, V. R., Lee, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.07625 · Cited by 1
“Open-source frameworks such as OpenEvolve [31], ShinkaEvolve [14], and CodeEvolve [4] build on this design, with ShinkaEvolve targeting sample efficiency and CodeEvolve using island-based populations.”
FrugalEvo: Towards Cost-Aware LLM-Guided Program EvolutionPreprint
Chen, H., Qi, X., Zhao, J., Feng, Z., Liu, S., Xu, K., Koh, P. W., & Hooi, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.03675
“FrugalEvo matches or surpasses all baselines, including OpenEvolve, ShinkaEvolve, AdaEvolve, and EvoX, in solution quality and achieves higher BA-AUC on 9 of 10 mathematical and systems optimization tasks.”
InfluentialComponent-Aware Feedback for Self-Evolving Programs
Lin, E., Nian, J., & Fang, Y. (2026) · doi:10.48550/arxiv.2609.38639 · Cited by 1
“This burden matters most for the open, locally servable models that make evolutionary search affordable, whereas AlphaEvolve, ShinkaEvolve, and AdaEvolve all report their results with frontier models (Novikov et al., 2025; Lange et al., 2025; Cemri et al., 2026).”
InfluentialEvoTreeNAD: Genealogy-Guided Evolution for LLM-Driven Neural Architecture DiscoveryPreprint
Yu, L., Jiu, D., Lan, Q., & Jiang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.29016
“ShinkaEvolve develops sample-efficient program evolution, while the Darwin Gödel Machine maintains an expanding archive of self-modifying agents from which further variants are generated (Lange et al., 2026; Zhang et al., 2026).”
Beck, J., Ogren, P. V., & Kobren, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.25510 · Cited by 1
“We study three verifiable mathematical optimization domains used in recent LLM discovery work Novikov et al. (2025); Lange et al. (2026); Yuksekgonul et al. (2026), using the open-source implementation from Sharma (2025).”
Evolution or Illusion? Rethinking Evaluation in LLM Evolutionary Search
Oved, T., Pony, R., Naparstek, O., et al. (2026) · doi:10.48550/arxiv.2609.19799 · Cited by 1
“…(Romera-Paredes et al., 2024), AlphaEvolve (Novikov et al., 2025), OpenEvolve (Sharma, 2025), GEPA (Agrawal et al., 2026), heuristic-design systems (Liu et al., 2024; Ye et al., 2024), sample-efficient variants (Lange et al., 2026), and recent work on harness engineering (Ishibashi et al., 2026).”
ArchAgent v2: A Case Study with the Data Prefetching ChampionshipPreprint
Gonzalez, A., Gupta, R., Jain, A., Alam, H., Novikov, A., Huang, P.-S., Balog, M., Eisenberger, M., Shirobokov, S., Vũ, N., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.09874 · Cited by 2
“Focusing on evolutionary frameworks (i.e., [21], [22], [28], [35]), the core of these frameworks is an orchestration loop that continuously “evolves” code.”
COMPAS: Difficulty-Aware Joint Search for Optimizing Code Generation
Gong, J.-Z., Zhang, J. M., Jahangirova, G., et al. (2026) · doi:10.48550/arxiv.2608.04336 · Cited by 1
Rethinking Agentic Kernel Generation for Emerging AcceleratorsPreprint
Gao, R., Yang, J., Lyu, B., Jin, H., & Bleier, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.00894 · Cited by 1
“On PLENA, this surface spans algorithm, residency, precision, and multi-engine overlap, with symbolic completion resolving interacting choices before execution.”
Autonomous Agents for Auditable Cardiovascular Artificial Intelligence DevelopmentPreprint
Dhingra, L. S., Batinica, B., Choi, R. B., Croon, P. M., Oikonomou, E. K., & Khera, R. (2026) · medRxiv · doi:10.64898/2026.07.10.26357656
GPU Forecasters: Language Models as Selective Surrogates for Kernel Runtime OptimizationPreprint
Khan, Z., Chen, J. C.-Y., Cho, J., Stengel-Eskin, E., & Bansal, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.31464 · Cited by 1
“…methods rely on per-candidate device measurement as the search signal, including reinforcement-learned agents [8], test-time training [40], and evolutionary loops over strategies [3], which adapt the broader paradigm of LLM-driven evolutionary program search [24, 22, 14, 36] to kernels.”
MadEvolve: Evolutionary Optimization of Trading Systems with Large Language ModelsPreprint
Kvasiuk, Y., Li, T., Colegrove, O., & Münchmeyer, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.23007 · Cited by 1
“…inspired by FunSearch [Romera-Paredes et al., 2024] and AlphaEvolve [Novikov et al., 2025] (see also the open-source reimplementations ShinkaEvolve [Lange et al., 2025] and OpenEvolve [Sharma, 2025]), and described in full detail in Li et al. [2026], where it was applied to three problems in…”
parra, O. J., Zoccheddu, S., Cerezo, D. C., Forzy, T., Ulrich, F. S., Sutcliffe, W. L., Burgstaller, J. M., Senn, O., Owen, P. H., & Serra, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.05125
“…below the high-rate MNAR missingness often encountered in real-world EHR data; in parallel, LLMs have been used as mutation operators in evolutionary program search for mathematical and algorithmic discovery [Romera-Paredes et al., 2024, Liu et al., 2024, Novikov et al., 2025, Lange et al., 2025].”
FunFuzz: An LLM-Powered Evolutionary Fuzzing FrameworkPreprint
Béjar, M. R., Romera‐Paredes, B., & Hernández-Ramos, J. L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.02789 · Cited by 1
“FunSearch [17] and newer works that build on it [10, 15] provide modern instances of this idea in an LLM setting: multiple islands explore in parallel and exchange high-performing candidates, improving robustness to stochastic generation and local stagnation.”
Evolutionary Search for Automated Design of Uncertainty Quantification Methods
Seleznyov, M., Korbut, D., Moskvoretskii, V., et al. (2026) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2604.03473 · Cited by 1
“ShinkaEvolve (Lange et al., 2025) improves sample efficiency through better parent selection, novelty-based rejection, and adaptive model selection, while CodeEvolve (As-sumpção et al., 2026) and GigaEvo (Khrulkov et al., 2025) provide open-source evolutionary coding frameworks aimed at…”
Discovering Mechanistic Models of Neural Activity: System Identification in an in Silico ZebrafishPreprint
Lueckmann, J.-M., Jain, V., & Januszewski, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.04492 · Cited by 2
“Parallel efforts have explored similar LLM-driven evolutionary strategies for mathematical discovery (Romera-Paredes et al., 2024) and algorithmic evolution (Novikov et al., 2025; Lange et al., 2025; Jiang et al., 2025).”
Metadata
- Authors
- Lange, R. T., Imajuku, Y., & Cetin, E.
- ORCID
- Imajuku, Yuki
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2509.19349
- OpenAlex
- W7083291402
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- software evolution, large language models, sample efficiency, circle packing, loss function design, scientific discovery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-24, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-24 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
