Memento 3: Model-Based Recursive Self-Improvement through Reflective Rulebooks

May combine two claims.

The other four leave games unfinished: OPINE-World leaves 5, NOOA 6, DreamTeam 19 and Continual Harness 22.

“The other four leave games unfinished: OPINE-World leaves 5, NOOA 6, DreamTeam 19 and Continual Harness 22.”

May combine two claims.

Among the systems in Table 2, baseline1 is the only other system to finish every game, using 8,347 actions (0.49 of the human budget).

“Among the systems in Table 2, baseline1 is the only other system to finish every game, using 8,347 actions (0.49 of the human budget).”

May combine two claims.

CODE-AS-MODEL reaches the 100 ceiling on all 25 games, yielding a mean RHAE of 100.0.

“CODE-AS-MODEL reaches the 100 ceiling on all 25 games, yielding a mean RHAE of 100.0.”

May combine two claims.

Among the systems compared in Table 1, the closest is baseline1 at 99.0, which also clears every game; NOOA reaches 85.1 having cleared 19 of the 25 games, OPINE-World 78.4 with 20, DreamTeam 38.1 with 6, and Continual Harness 20.5 with 3.

“Among the systems compared in Table 1, the closest is baseline1 at 99.0, which also clears every game; NOOA reaches 85.1 having cleared 19 of the 25 games, OPINE-World 78.4 with 20, DreamTeam 38.1 with 6, and Continual Harness 20.5 with 3.”

May combine two claims.

A centre hit refutes the initial four-band bounce hypothesis and prompts a centred-deflection formula; further contacts lead to an asymmetric band map.

“Figure 9 illustrates this process: a centre hit refutes the initial four-band bounce hypothesis and prompts a centreddeflection formula; further contacts lead to an asymmetric band map.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Openings 1, 2 and 3 require 3,358, 4,014 and 5,039 actions, respectively.

“Openings 1, 2 and 3 require 3,358, 4,014 and 5,039 actions, respectively.”

May combine two claims.

The reduction in actions is consistent across all three games, while the largest reductions in agent turns occur on ft09 and cn04.

“The reduction in actions is consistent across all three games, while the largest reductions in agent turns occur on ft09 and cn04.”

May combine two claims.

Every run clears every level and reaches RHAE 100, so Table 3 compares the cost of convergence.

“Every run clears every level and reaches RHAE 100, so Table 3 compares the cost of convergence.”

May combine two claims.

Across the three games, it uses 617 rather than 677 actions, a reduction of 9%, and 678 rather than 830 agent turns, a reduction of 18%.

“Across the three games, it uses 617 rather than 677 actions, a reduction of 9%, and 678 rather than 830 agent turns, a reduction of 18%.”

May combine two claims.

It wins 21 : 0 in all three, achieving the maximum episode score of 21.

“It wins 21 : 0 in all three, achieving the maximum episode score of 21.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Full-frame replay retains residual rendering and paddle-motion errors.

“Full-frame replay retains residual rendering and paddle-motion errors.”

May combine two claims.

In the reported runs, the rulebook variant uses fewer actions and fewer agent turns in every difficulty band.

“In the reported runs, the rulebook variant uses fewer actions and fewer agent turns in every difficulty band.”

May combine two claims.

On ARC-AGI-3, the single-model agent clears every level of all 25 public games and reaches the RHAE ceiling, using 7,518 actions, or 44% of the human action count.

“On ARC-AGI-3, the single-model agent clears every level of all 25 public games and reaches the RHAE ceiling, using 7,518 actions, or 44% of the human action count.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The three green curves show the learned controller under three different openings.

“The three green curves show the learned controller under three different openings.”

May combine two claims.

In Atari Pong, the learned model supports a feedback controller that wins 21 : 0 in three evaluated episodes with different openings, without LLM calls during execution.

“In Atari Pong, the learned model supports a feedback controller that wins 21 : 0 in three evaluated episodes with different openings, without LLM calls during execution.”

May combine two claims.

The same LLM without a world model finishes with a score of -19, and the random-policy episode shown here finishes at -20.

“The same LLM without a world model finishes with a score of -19, and the random-policy episode shown here finishes at -20.”

May combine two claims.

Compared with the verified single-model trajectory, the population reduces the total from 899 to 597 scored actions and matches or improves per-level action efficiency on eight of the nine levels.

“Compared with the verified single-model trajectory, the population reduces the total from 899 to 597 scored actions and matches or improves per-level action efficiency on eight of the nine levels.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Three of the eleven rulebook versions from one run on game tr87, each paired with the observation that prompted the revision.

“Three of the eleven rulebook versions from one run on game tr87, each paired with the observation that prompted the revision.”

May combine two claims.

Both arms clear all nine levels and score RHAE 100 when replayed against the live server.

“Both arms clear all nine levels and score RHAE 100 when replayed against the live server.”

May combine two claims.

Reflection yields a clockwise-rotation rule, which is recorded in the rulebook and compiled into code.

“Reflection yields a clockwise-rotation rule, which is recorded in the rulebook and compiled into code.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In this example, an observed badge change contradicts a mirror hypothesis.

“In this example, an observed badge change contradicts a mirror hypothesis.”

Classified as probably not a substantial claim. May combine two claims.

A ceiling score requires every level to be cleared and the level-weighted mean of e l in Eq. (36) to be at least 1.

“A ceiling score requires every level to be cleared and the level-weighted mean of e ℓ in Eq. ( 36) to be at least 1.”

Classified as probably not a substantial claim. May combine two claims.

Updated code is accepted only when the LLM judges it faithful to the rulebook and cell-exact replay reproduces the observed transitions.

“Updated code is accepted only when the LLM judges it faithful to the rulebook and cell-exact replay reproduces the observed transitions.”

• AssumptionRests on an assumption: The frozen LLM can reliably assess whether an executable faithfully implements its rulebook.

Probably not a substantial claim: may not pass S3 (load-bearing).

Every baseline is an entry on the ARC-AGI-3 community leaderboard that links to a paper: baseline1, NOOA, OPINE-World, DreamTeam and Continual Harness.

“Every baseline is an entry on the ARC-AGI-3 community leaderboard that links to a paper: baseline1 [30], NOOA [13], OPINE-World [7], DreamTeam [33] and Continual Harness [17].”

• cites [30]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [13]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [7]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

They share H t rather than interacting with separate environment copies.

“They share H t rather than interacting with separate environment copies.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In Code as Model, the rulebooks make each member's rule hypotheses explicit, so differences in predictions and plans can be examined at the level of environment rules.

“In Code as Model, the rulebooks make each member's rule hypotheses explicit, so differences in predictions and plans can be examined at the level of environment rules.”

Classified as probably not a substantial claim.

Conditional on the selected model and state, future transitions and observations are deterministic.

“Conditional on this selected model and state, future transitions and observations are deterministic.”

Probably not a substantial claim: may not pass S4 (based).

These models may encode different hypotheses about the same environment.

“These models may encode different hypotheses about the same environment.”

Classified as probably not a substantial claim.

Without version control, each revision destructively overwrites the rulebook or implementation it replaces.

“Without version control, each revision destructively overwrites the rulebook or implementation it replaces.”

Classified as probably not a substantial claim.

Each proposed simplification is checked for rulebook fidelity and replay consistency.

“Each proposed simplification is checked again for rulebook fidelity and replay consistency.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The N = 1 case recovers the single-model formulation.

“The N = 1 case recovers the formulation above.”

Probably not a substantial claim: may not pass S3 (load-bearing).

For action selection, the rule samples uniformly over distinct nonempty plans, giving retained alternatives opportunities to generate new evidence.

“For action selection, the rule below samples uniformly over distinct nonempty plans, giving retained alternatives opportunities to generate new evidence.”

May combine two claims.

The population is designed to broaden model-guided exploration and reduce the dependence of an entire run on one early draw.

“The population is therefore designed to broaden model-guided exploration and reduce the dependence of an entire run on one early draw.”

May combine two claims.

The agent can therefore recall hypotheses it has already tested, examine the consequences of a past revision, or restore an executable that a later edit broke.

“The agent can therefore recall hypotheses it has already tested, examine the consequences of a past revision, or restore an executable that a later edit broke.”

Classified as probably not a substantial claim.

Actions affect both the environment and the evidence available for subsequent decisions.

“Actions affect both the environment and the evidence available for subsequent decisions.”

Classified as probably not a substantial claim.

This feedback loop underlies the model-based approach to recursive self-improvement.

“This feedback loop underlies our model-based approach to RSI.”

Classified as probably not a substantial claim. The quote only partly states this claim.

The fidelity check compares the executable source with the rulebook.

“Its fidelity check compares the source with the rulebook.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Model-based reinforcement learning represents uncertainty in environment dynamics through probabilistic models or ensembles.

“Model-based reinforcement learning represents uncertainty in environment dynamics through probabilistic models or ensembles [6,19].”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [19]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Execution stops at the first prediction mismatch so that the new counterexample can be incorporated before planning continues.

“Execution stops at the first prediction mismatch so that the new counterexample can be incorporated before planning continues.”

Classified as probably not a substantial claim.

For N > 1, the system maintains N world models in parallel, each comprising a rulebook and its executable realisation.

“For N > 1, the system maintains N world models in parallel, each comprising a rulebook and its executable realisation.”

Classified as probably not a substantial claim.

All members are checked against the same complete set of recorded trajectories.

“All members are checked against the same complete set of recorded trajectories.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A trajectory that never reaches the goal, including one trapped in a cycle under an improper policy, has infinite cost.

“A trajectory that never reaches the goal, including one trapped in a cycle under an improper policy, has infinite cost.”

Probably not a substantial claim: may not pass S4 (based).

Every real interaction extends the common record.

“Every real interaction extends this common record.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The equal weights describe the empirical distribution over retained members; N = 1 recovers Eq. (9).

“The equal weights describe the empirical distribution over retained members; N = 1 recovers Eq. ( 9).”

May combine two claims.

MEMENTO 3 uses a natural-language rulebook as persistent semantic memory, compiles it into executable code, and refines both through a continual loop of observation, reflection, rule revision, compilation, and verification.

“The agent maintains a natural-language rulebook as persistent semantic memory, recording revisable hypotheses about environment dynamics while leaving unknown aspects underspecified.”

• Also stated in: § Abstract · plain

  “Through a continual loop of observation, reflection, rule revision, compilation, and verification, the agent uses prediction errors to refine both the rulebook and its code.”

May combine two claims.

Every baseline number, including per-game RHAE, actions and levels cleared, comes from that system's official ARC Prize scorecard, as does the human action baseline, so all columns are counted the same way.

“Every baseline number, including per-game RHAE, actions and levels cleared, comes from that system's official ARC Prize scorecard, as does the human action baseline, so all columns are counted the same way.”

Classified as probably not a substantial claim.

Rendered predictions must match all 64 × 64 cells of every subsequent frame within the trajectory before the executable is made available to the planner.

“Rendered predictions must match all 64 × 64 cells of every subsequent frame within the trajectory before the executable is made available to the planner.”

Classified as probably not a substantial claim. May combine two claims.

Here, every ψ and every θ the run has held remains addressable, together with when it was written.

“Here, every ψ and every θ the run has held remains addressable, together with when it was written.”

May combine two claims.

It can inspect earlier iterations, diff two versions of the rulebook or of a module, and recover their contents at any previous commit.

“It can inspect earlier iterations, diff two versions of the rulebook or of a module, and recover their contents at any previous commit.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Posterior sampling and related methods retain a sampled model or value function across an episode to support temporally coherent exploration.

“Posterior sampling and related methods retain a sampled model or value function across an episode to support temporally coherent exploration [23,26,27].”

• cites [23]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [26]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The observed record removes contradicted models while preserving the prior odds among survivors.

“The observed record removes contradicted models while preserving the prior odds among survivors.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Later levels can introduce new mechanics, so the agent must be able to revise its rulebook and executable throughout the game.

“Later levels can introduce new mechanics, so the agent must be able to revise its rulebook and executable throughout the game.”

May combine two claims.

Acceptance combines an LLM assessment of semantic fidelity with an exact execution check; it is not based on language-model confidence alone.

“Acceptance therefore combines an LLM assessment of semantic fidelity with an exact execution check; it is not based on language-model confidence alone.”

• AssumptionRests on an assumption: The frozen LLM can reliably assess whether an executable faithfully implements its rulebook.

Probably not a substantial claim: may not pass S4 (based).

An executable is falsified when its prediction contradicts the new observation.

“An executable is falsified when its prediction contradicts the new observation.”

Classified as probably not a substantial claim.

The selection objective in Eq. (23) favours the shortest combined description among admissible rulebook-executable pairs.

“The objective favours the shortest combined description among admissible rulebook-executable pairs.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The observation-based posterior in Eq. (24) makes the remaining ambiguity explicit.

“The observation-based posterior in Eq. ( 24) makes the remaining ambiguity explicit.”

Probably not a substantial claim: may not pass S3 (load-bearing).

AutoManual induces and organises environment rules into reusable manuals.

“AutoManual induces and organises environment rules into reusable manuals [4].”

• cites [4]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Compilation makes each revised rule available to the controller as an executable function.

“Compilation makes each revised rule available to the controller as an executable function.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Code-as-World extends executable modelling to physical reasoning through a loop of program proposal, execution, rendering, and verification.

“Code-as-World extends executable modelling to physical reasoning through a loop of program proposal, execution, rendering, and verification [41].”

• cites [41]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Dyna combines real interaction with model-generated experience for planning and learning.

“Dyna combines real interaction with model-generated experience for planning and learning [38].”

• cites [38]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Twin similarly gates model-based action on replay of the interaction history.

“Twin similarly gates model-based action on replay of the interaction history [37].”

• cites [37]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

This leaves a code world model while keeping the harness, the replay verifier, the plan executor, the backbone and the reasoning effort byte-identical.

“This leaves a code world model while keeping the harness, the replay verifier, the plan executor, the backbone and the reasoning effort byte-identical.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Neural world models support imagined rollouts, model-predictive control, and tree search, while Dynalang incorporates language as a predictive modality in a multimodal latent model.

“Neural world models support imagined rollouts, model-predictive control, and tree search [6,14,35], while Dynalang incorporates language as a predictive modality in a multimodal latent model [22].”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [14]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [35]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [22]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

These approaches encode learned dynamics in neural parameters and latent representations.

“These approaches encode learned dynamics in neural parameters and latent representations.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

LASER is an off-policy actor-critic method with shared experience replay, while IMPALA uses distributed actor-critic learning with V-trace correction.

“LASER [34] is an off-policy actor-critic method with shared experience replay, while IMPALA [9] uses distributed actor-critic learning with V-trace correction.”

• cites [34]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [9]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Reflexion stores linguistic reflections on task feedback to improve later decisions.

“Reflexion stores linguistic reflections on task feedback to improve later decisions [36].”

• cites [36]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

World models support decision making by predicting the consequences of actions.

“World models support decision making by predicting the consequences of actions.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Rainbow combines several improvements to the deep Q-network (DQN) algorithm.

“Rainbow [15] combines several improvements to the deep Q-network (DQN) algorithm.”

• cites [15]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Programs provide an alternative representation that exposes transitions as functions a planner can execute and test directly.

“Programs provide an alternative representation that exposes transitions as functions a planner can execute and test directly.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Rodionov's baseline1 maintains, simplifies, and verifies a persistent Python model before planning through it.

“Rodionov's baseline1 maintains, simplifies, and verifies a persistent Python model before planning through it [30].”

• cites [30]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

WALL-E updates and prunes symbolic rules by comparing predicted and observed trajectories, using those rules to align an LLM world model with its environment.

“WALL-E updates and prunes symbolic rules by comparing predicted and observed trajectories, using those rules to align an LLM world model with its environment [50].”

• cites [50]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

OPINE-World maintains natural-language hypotheses, synthesises an object-centric executable, and uses ontology error to direct exploration; candidate programs must reproduce recorded transitions exactly.

“OPINE-World maintains natural-language hypotheses, synthesises an object-centric executable, and uses ontology error to direct exploration; candidate programs must reproduce recorded transitions exactly [7].”

• cites [7]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Together, these works establish language-guided construction and execution-based refinement as useful mechanisms for learning explicit models.

“Together, these works establish languageguided construction and execution-based refinement as useful mechanisms for learning explicit models.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Among the model-free RL baselines, GDI optimises both policy learning and the distribution of training data.

“Among the model-free RL baselines, GDI [11] optimises both policy learning and the distribution of training data.”

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Language-guided program induction provides a foundation for constructing such models.

“Language-guided program induction provides a foundation for constructing such models.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Parsel combines natural-language decompositions with execution-based testing, and Hypothesis Search translates language hypotheses into programs verified on input-output examples.

“Parsel combines natural-language decompositions with execution-based testing [47], and Hypothesis Search translates language hypotheses into programs verified on input-output examples [43].”

• cites [47]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [43]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The executable world model supports a planner that searches for a finite action sequence to complete the current level.

“The executable world model supports a planner that searches for a finite action sequence to complete the current level.”

Probably not a substantial claim: may not pass S2 (checkable).

These results motivate examining how a learned model is maintained and used, alongside its predictive accuracy.

“These results motivate examining how a learned model is maintained and used, alongside its predictive accuracy.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Code World Models for General Game Playing constructs transition, legality, and termination functions from rules and trajectories to support Monte Carlo tree search.

“Code World Models for General Game Playing constructs transition, legality, and termination functions from rules and trajectories to support Monte Carlo tree search [21].”

• cites [21]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

For interactive environments, WorldCoder learns Python dynamics models and repairs them against observed counterexamples; GIF-MCTS searches over candidate models through generation, improvement, and repair guided by descriptions, tests, and trajectories.

“For interactive environments, WorldCoder learns Python dynamics models and repairs them against observed counterexamples [39]; GIF-MCTS searches over candidate models through generation, improvement, and repair guided by descriptions, tests, and trajectories [8].”

• cites [39]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [8]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Their reported scores, alongside human and random-policy scores, are taken from Fan.

“Their reported scores, alongside human and random-policy scores, are taken from Fan [10].”

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Its subsequent component study finds exact verification consistently useful within the tested configurations, but does not find that requiring an executable model uniformly improves action performance.

“Its subsequent component study finds exact verification consistently useful within the tested configurations, but does not find that requiring an executable model uniformly improves action performance [29].”

• cites [29]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Each revision updates the bounce rule for both paddles and changes its predictions at unobserved contact offsets.

“Each revision updates the bounce rule for both paddles and changes its predictions at unobserved contact offsets.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Tycho examines when an agent should construct, repair, use, or bypass an executable model, showing that better transition replay need not yield better decisions when objectives are misidentified or models are used inappropriately.

“Tycho examines when an agent should construct, repair, use, or bypass an executable model, showing that better transition replay need not yield better decisions when objectives are misidentified or models are used inappropriately [20].”

• cites [20]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The model-based RL baselines, EfficientZero and EfficientZero V2, learn latent dynamics and use tree search for action selection, with a training budget of 100,000 actions, equivalent to 400,000 emulator frames.

“The model-based RL baselines, EfficientZero [46] and EfficientZero V2 [44], learn latent dynamics and use tree search for action selection, with a training budget of 100,000 actions, equivalent to 400,000 emulator frames.”

• cites [46]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [44]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Textual memory offers another way for frozen LLM agents to learn from interaction.

“Textual memory offers another way for frozen LLM agents to learn from interaction.”

• cites [36]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [4]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [50]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Validation in this feedback-control setting combines replay diagnostics with evaluation of the learned controller.

“Validation in this feedback-control setting combines replay diagnostics with evaluation of the learned controller.”

May combine two claims.

The agent records environment hypotheses in a natural-language rulebook, compiles them into code for prediction and planning, and revises both through interaction while keeping the underlying LLM fixed.

“The agent records environment hypotheses in a natural-language rulebook, compiles them into code for prediction and planning, and revises both through interaction while keeping the underlying LLM fixed.”

• AssumptionRests on an assumption: The natural-language rulebook can express environment rules with sufficient precision for compilation into executable code.

Classified as probably not a substantial claim. May combine two claims.

Each member pairs a rulebook with an executable, and all members are checked against shared interaction evidence.

“Each member pairs a rulebook with an executable, and all members are checked against shared interaction evidence.”

Classified as probably not a substantial claim. May combine two claims.

Version spaces formalise the ambiguity left by finite evidence, and minimum description length provides a simplicity preference among consistent hypotheses.

“Version spaces formalise the ambiguity left by finite evidence [24,25], and minimum description length provides a simplicity preference among consistent hypotheses [28].”

• cites [24]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [25]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [28]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Workspace Optimization instantiates this view in DreamTeam, whose specialised agents build models, probe hypotheses, and plan.

“Workspace Optimization instantiates this view in DreamTeam, whose specialised agents build models, probe hypotheses, and plan [33].”

• cites [33]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Model-based reinforcement learning represents uncertainty through probabilistic dynamics models or ensembles.

“Model-based reinforcement learning represents uncertainty through probabilistic dynamics models or ensembles [6,19].”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [19]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

NOOA combines a Python objectoriented agent interface with persistent executable modules, prediction-error-driven refinement, and cross-level memory in ARC-AGI-3.

“NOOA combines a Python objectoriented agent interface with persistent executable modules, prediction-error-driven refinement, and cross-level memory in ARC-AGI-3 [13].”

• cites [13]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The population is a computational approximation to the remaining version space, rather than a calibrated Bayesian posterior; its purpose is to reduce dependence on a single early model construction.

“The population is a computational approximation to the remaining version space, rather than a calibrated Bayesian posterior; its purpose is to reduce dependence on a single early model construction.”

Probably not a substantial claim: may not pass S3 (load-bearing).

It also supports alternatives such as graph-based exploration, which records observed transitions and prioritises untested actions without a generative world model.

“It also supports alternatives such as graph-based exploration, which records observed transitions and prioritises untested actions without a generative world model [32].”

• cites [32]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

ARC-AGI-3 provides a shared setting for studying these approaches under unfamiliar rules and a human-derived action budget.

“ARC-AGI-3 provides a shared setting for studying these approaches under unfamiliar rules and a human-derived action budget [1].”

• cites [1]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Posterior sampling and related methods retain a sampled hypothesis or value function across an episode to support temporally coherent exploration.

“Posterior sampling and related methods retain a sampled hypothesis or value function across an episode to support temporally coherent exploration [23,26,27].”

• cites [23]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [26]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

The LLM assesses code-rulebook fidelity, and replay checks the executable against recorded transitions.

“The LLM assesses code-rulebook fidelity, and replay checks the executable against recorded transitions.”

• AssumptionRests on an assumption: The LLM can reliably assess the fidelity between the code and the rulebook.
• AssumptionRests on an assumption: Replay checking against recorded transitions is sufficient to verify that the executable correctly implements the rulebook.

May combine two claims.

Together, these results suggest that maintaining a population can make world-model-guided exploration more action-efficient and less sensitive to any single initial hypothesis.

“Together, these results suggest that maintaining a population can make world-model-guided exploration more action-efficient and less sensitive to any single initial hypothesis.”

• AssumptionRests on an assumption: The improvement in action efficiency from N=1 to N=2 is due to maintaining a population of world models rather than to the increased computational resources.

Classified as probably not a substantial claim. May combine two claims.

Language rules, executable artefacts, reflection, and replay are established components; we organise them around a persistent environment specification supporting both semantic revision and implementation repair.

“Language rules, executable artefacts, reflection, and replay are established components; we organise them around a persistent environment specification supporting both semantic revision and implementation repair.”

Classified as probably not a substantial claim.

The accepted model then guides further interaction, producing evidence for the next revision.

“The accepted model then guides further interaction, producing evidence for the next revision.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Broader approaches to agent adaptation treat external software and workspaces as editable learning state.

“Broader approaches to agent adaptation treat external software and workspaces as editable learning state.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

These approaches range from retaining advice about past decisions to maintaining explicit descriptions of environment behaviour, establishing language as an editable medium for both experience and rule knowledge.

“These approaches range from retaining advice about past decisions to maintaining explicit descriptions of environment behaviour, establishing language as an editable medium for both experience and rule knowledge.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Its model guides edits to the agent, whereas Code as Model predicts transitions within the environment to support planning and control.

“Its model guides edits to the agent, whereas Code as Model predicts transitions within the environment to support planning and control.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Continual Harness supports reset-free revision of prompts, subagents, skills, and memory.

“Continual Harness supports reset-free revision of prompts, subagents, skills, and memory [17].”

• cites [17]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Belief-Calibrated Optimization maintains a language world model of how evaluation responds to changes in an agent's prompt and scaffolding.

“Belief-Calibrated Optimization maintains a language world model of how evaluation responds to changes in an agent's prompt and scaffolding [5].”

• cites [5]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Results are from the same runs and scorecards as Table1.

“Results are from the same runs and scorecards as Table1.”

Classified as probably not a substantial claim. May combine two claims.

We hold the backbone, the reasoning effort and the harness fixed at their single-model settings, so only the number of retained pairs changes.

“We hold the backbone, the reasoning effort and the harness fixed at their single-model settings, so only the number of retained pairs changes.”

Probably not a substantial claim: may not pass S4 (based).

All baseline numbers come from the official ARC Prize scorecards.

“All baseline numbers come from the official ARC Prize scorecards.”

Probably not a substantial claim: may not pass S3 (load-bearing).

These models support complementary forms of agent improvement.

“These models support complementary forms of agent improvement.”

Classified as probably not a substantial claim. May combine two claims.

The Memento series develops reflective memory from episodic adaptation to stateful reflective learning, which links memory writing and reading to policy evaluation and improvement, and then to reusable executable skills.

“The Memento series develops reflective memory from episodic adaptation [48] to stateful reflective learning, which links memory writing and reading to policy evaluation and improvement [42], and then to reusable executable skills [49].”

• cites [48]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [42]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [49]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Code as Model extends this progression to model-side semantic memory: a persistent rulebook and its executable realisation jointly represent a world-model hypothesis.

“Code as Model extends this progression to model-side semantic memory: a persistent rulebook and its executable realisation jointly represent a world-model hypothesis.”

• AssumptionRests on an assumption: The natural-language rulebook can express environment rules with sufficient precision for compilation into executable code.

Classified as probably not a substantial claim.

Verification checks the executable against the interaction history and the rulebook.

“Verification checks the executable against the interaction history and the rulebook.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The executable is checked by cell-exact replay before it is used for planning.

“The executable is checked by cell-exact replay before it is used for planning.”