A-Evolve-Training: Autonomous Post-Training of a 30B Model
Open accessAbstract
Post-training a frontier model is normally weeks of human work: proposing data and recipe changes, launching runs, reading evals, deciding what to keep. We report an autonomous system that runs this loop with no human in the loop, post-training a 30B Nemotron across four rounds over multiple weeks. The autonomously produced model reaches a held-out score of 0.86 against the top human submission's 0.87 on the public NVIDIA Nemotron-Reasoning Challenge leaderboard, placing 8th of ~4000 at the time of writing. More striking than the number: the loop detected that its own dev metric had stopped tracking external performance on the weakest domain -- candidates drove dev to record highs without moving the external target -- and revised its own search policy, no longer maximizing dev but seeking interventions that lowered the now-misleading proxy while improving the external target. We treat this as direct, auditable evidence that a scaled autonomous loop can produce discovery, not only optimization: it detected that its measurement frame had become misleading and changed what counted as evidence. We take the operational view that any system worth the "recursive self-improvement" label must eventually perform end-to-end post-training of a frontier-class model; this is one datapoint of that bar being cleared. We do not claim a "first autonomous match" of human researchers. The claim we make is narrower and auditable: to our knowledge, this is the first publicly reported autonomous post-training run at this scale, where prior public autonomous-ML-research demonstrations sit at GPT-2-class (~124M) budgets. The same system also post-trains the 120B and 550B Nemotron; with no public human baseline there, this shows only that the loop closes at that scale, not that its output is competitive -- infrastructure evidence, with the effectiveness claim deferred until a comparable human anchor exists.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An autonomous system ran the entire post-training loop of a 30B model-proposing data and recipe changes, launching runs, reading evaluations, deciding what to keep-across four rounds over multiple weeks with no human in the loop.
“A-EvolveTraining reports an autonomous system that ran the entire post-training loop of a 30B model proposing data and recipe changes, launching runs, reading evaluations, deciding what to keep across four rounds over multiple weeks with no human in the loop”
From Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops (2026) · cites this paper as [180]
That system reached near-parity with the top human submission on a public leaderboard (0.86 vs. 0.87, placing 8th of roughly 4,000).
“reaching near-parity with the top human submission on a public leaderboard (0.86 vs. 0.87, placing 8th of roughly 4,000”
From Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops (2026) · cites this paper as [180]
An autonomous system noticing and correcting the corruption of its own improvement signal is precisely the capability §5 identifies as the field's binding constraint, observed in the wild.
“An autonomous system noticing and correcting the corruption of its own improvement signal is precisely the capability §5 identifies as the field's binding constraint, observed in the wild.”
From Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops (2026) · cites this paper as [180]
Mid-run, the loop detected that its own development metric had decoupled from external performance and revised its own search policy to treat the now-misleading proxy as evidence against a candidate rather than for it.
“mid-run, the loop detected that its own development metric had decoupled from external performance - candidates were driving the dev metric to record highs without moving the external target - and revised its own search policy to treat the now-misleading proxy as evidence against a candidate rather than for it.”
From Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops (2026) · cites this paper as [180]
A-EvolveTraining is the closest published system to Anthropic's 'closing the loop' stage: not an agent improving its outputs or skills, but an AI system executing AI model development end to end.
“This is, to our knowledge, the closest published system to Anthropic's 'closing the loop' stage: not an agent improving its outputs or skills, but an AI system executing AI model development end to end.”
From Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops (2026) · cites this paper as [180]
Nearly everything surveyed here is scenario-2 machinery-bounded loops with human-specified objectives-with A-Evolve-Training as the most scenario-3-shaped published artifact.
“nearly everything surveyed here is scenario-2 machinery - bounded loops with human-specified objectives - with A-Evolve-Training [180] as the most scenario-3-shaped published artifact.”
From Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops (2026) · cites this paper as [180]
The A-Evolve-Training episode is the first field observation suggesting escape from the self-confirming loop is possible.
“the A-Evolve-Training episode (§6.2), where a loop detected its own proxy's corruption and revised its search policy, is the first field observation suggesting escape is possible.”
From Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops (2026) · cites this paper as [180]
Cited by
Sorted by citations
Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops
Chen, M., Wang, L., & Qu, B. (2026) · arXiv
“…loop’s own objective : work reframing scientific discovery as meta-optimization argues that evolving the evaluation criteria is as important as evolving candidates [163] — an explicit acknowledgment, from within the paradigm, that a fixed evaluator eventually becomes the binding constraint (§5).”
- Authors
- Shi, Z., He, B., Sang, Y., Dumoulin, B., & Lu, H.
- Affiliations
- Amazon (United States) (US)
- ORCID
- Sang, Yisi
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2606.20657
- OpenAlex
- W7165636148
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- autonomous machine learning, post-training, large language models, recursive self-improvement, proxy metrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
