Twin: Playing an Unknown Game with a Test-Time Digital Twin

Probably not a substantial claim: may not pass S3 (load-bearing).

WorldCoder introduced the core pattern of using an LLM to synthesize an executable transition and reward model from interaction, plan through it, and repair it from counterexamples.

“WorldCoder introduced the core pattern of using an LLM to synthesize an executable transition and reward model from interaction, plan through it, and repair it from counterexamples”

• cites Tang, Key, and Ellis 2024 sourceSupported
• cites Tang et al. 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

Goal discovery is a Go-Explore-style novelty search serving WorldCoder's optimism constraint: propose a reward believed to be reachable, then use it to direct exploration.

“Goal discovery is a Go-Explore-style novelty search (Ecoffet et al. 2021) serving WorldCoder's optimism constraint (Tang, Key, and Ellis 2024): propose a reward believed to be reachable, then use it to direct exploration.”

• cites Ecoffet et al. 2021 sourceSupported
• cites Tang, Key, and Ellis 2024 sourceSupported

May combine two claims.

sp80 stalls goal-limited at 92.3% dynamics accuracy, while sc25 is mixed at 83.7% with costly timer-driven tests.

“sp80 stalls goal-limited at 92.3% dynamics accuracy, while sc25 is mixed at 83.7% with costly timer-driven tests.”

May combine two claims.

Of the scored actions, 92.9% execute plans tested in simulation, while 7.1% are deliberate probes chosen to improve the model.

“Of the scored actions, 92.9% execute plans tested in simulation, while 7.1% are deliberate probes chosen to improve the model.”

Probably not a substantial claim: may not pass S3 (load-bearing).

For sc25, dc22, and tn36 the replay diverges partway, so only the prefix ending at the last matching frame is kept.

“For sc25, dc22, and tn36 it diverges partway, so we keep only the prefix ending at the last matching frame.”

May combine two claims.

Twin reaches the 100.0 ceiling on bp35 and lf52, where OPINE-World scores 2.6 and 4.2.

“Twin reaches the 100.0 ceiling on bp35 and lf52, where OPINE-World scores 2.6 and 4.2”

May combine two claims.

Although cd82 misses 43.3% of its next frames on unobserved pairs, only 11 of 4,096 cells account for 90% of its total disagreement, all within the one-cell progress bar along the bottom edge.

“although cd82 misses 43.3% of its next frames on unobserved pairs, only 11 of 4,096 cells account for 90% of its total disagreement, all within the one-cell progress bar along the bottom edge.”

May combine two claims.

Twin pays 224k processed tokens per scored action, the notwin ablation 48k, and EWM 715k.

“Twin pays 224k processed tokens per scored action, the notwin ablation 48k, and EWM 715k.”

May combine two claims.

Repairs persist: 31 previously mispredicted situations recur later, and the repaired twin predicts all 31 correctly.

“Repairs persist: 31 previously mispredicted situations recur later, and the repaired twin predicts all 31 correctly.”

May combine two claims.

Compared with EWM, Twin improves the score by 29.5 percentage points on 7.7× fewer processed tokens.

“Compared with EWM, Twin improves the score by 29.5 percentage points on 7.7× fewer processed tokens (Table 4 and Figure 8).”

May combine two claims.

wa30 is the diffuse exception, with errors spread across the playfield and no row above 2.5% of the mass.

“wa30 is the diffuse exception, with errors spread across the playfield and no row above 2.5% of the mass.”

May combine two claims.

Prime Agent scores 78.3 and clears 164 levels.

“Prime Agent, run on Twin's own base model, scores 78.3 and clears 164 levels.”

May combine two claims.

Probes account for 7.1% of the 11,562 actions the agent chose, and the remaining 92.9% execute plans tested in the twin.

“Probes account for 7.1% of the 11,562 actions the agent chose, and the remaining 92.9% execute plans tested in the twin.”

May combine two claims.

In the five light-blue cells only the twin's search returns a plan, and every one fails in the engine, a route the twin believes and the game contradicts.

“In the five light-blue cells only the twin's search returns a plan, and every one fails in the engine, a route the twin believes and the game contradicts.”

May combine two claims.

Two levels favor the twin outright: re86 L1 and su15 L2 execute its 20- and 12-action plans exactly, while the engine's search finds nothing because it merges identical frames.

“Two levels favor the twin outright: re86 L1 and su15 L2 execute its 20and 12-action plans exactly, while the engine's search finds nothing because it merges identical frames.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Per-game usage ranged from 5.1 million to 625 million tokens.

“Per-game usage ranged from 5.1 million to 625 million tokens.”

May combine two claims.

Twin reaches a mean score of 93.3 out of 100 on previously unseen games, clearing 23 of 25 and reaching the 100.0 ceiling on 18.

“Twin reaches a mean score of 93.3 out of 100 on previously unseen games, clearing 23 of 25 and reaching the 100.0 ceiling on 18 (Table 1, Figure 2).”

May combine two claims.

OPINE-World scores 78.4, and EWM scores 63.8.

“OPINE-World scores 78.4, and EWM scores 63.8 (Table 7, Appendix H).”

May combine two claims.

Depth becomes limiting: levels solved by either search take a median of 17 recorded actions, whereas the 111 solved by neither take 46; 35 engine searches also hit the wall-clock limit.

“Depth becomes limiting: levels solved by either search take a median of 17 recorded actions, whereas the 111 solved by neither take 46; 35 engine searches also hit the wall-clock limit.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The comparison covers 174 of the 179 completed levels.

“The comparison covers 174 of the 179 completed levels.”

May combine two claims.

The 23 non-optimal levels add 1,291 actions over the human baselines, and five levels account for 71% of that cost.

“The cost is concentrated: the 23 non-optimal levels add 1,291 actions over the human baselines, and five levels account for 71%.”

May combine two claims.

Twin matches or beats the human action count on 21 of its 23 cleared games and uses 0.61× as many actions as humans on average.

“Twin also matches or beats the human action count on 21 of its 23 cleared games and uses 0.61× as many actions as humans on average (Figure 3).”

May combine two claims.

wa30 reproduces its recorded interaction history but reaches only 9.9% on previously unobserved pairs.

“tu93, sp80, bp35, and ar25 exceed 91%, indicating reusable rules, whereas wa30 reproduces its recorded interaction history but reaches only 9.9% on previously unobserved pairs.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Cached-context reads account for over 98% of processed tokens, with ka59 alone contributing 24% of the total.

“Cached-context reads account for over 98% of processed tokens, with ka59 alone contributing 24% of the total (Table 5).”

May combine two claims.

Across the 174 analyzed levels: 107 plans, 82 wins, all 82 certified, 80 exactly optimal.

“Across the 174 analyzed levels: 107 plans, 82 wins, all 82 certified, 80 exactly optimal.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Each comparison of the twin's next frame with the engine's next frame counts as one branch evaluation, yielding 20,790 evaluations across all 25 games.

“Each comparison of the twin's next frame with the engine's next frame counts as one branch evaluation, yielding 20,790 evaluations across all 25 games.”

May combine two claims.

Twin scores 93.3 of 100 on the benchmark's action efficiency metric, clearing 23 of 25 public games (179 of 183 levels).

“Twin scores 93.3 of 100 on the benchmark's actionefficiency metric, clearing 23 of 25 public games (179 of 183 levels).”

May combine two claims.

sc25 is Twin's worst score, 32.7 against OPINE-World's 84.0.

“sc25 is Twin's worst score, 32.7 against OPINE-World's 84.0.”

May combine two claims.

The engine finds a finish the twin misses on 57 levels, and the causes are the model failures Appendix A already profiled: sc25's twin never sees its goal, wa30's memorizes its history, and sk48's and bp35's searches exhaust on boards their mechanics rewrite wholesale.

“The engine finds a finish the twin misses on 57 levels, and the causes are the model failures Appendix A already profiled: sc25's twin never sees its goal, wa30's memorizes its history, and sk48's and bp35's searches exhaust on boards their mechanics rewrite wholesale.”

May combine two claims.

From 150 engine-generated detour states absent from its run, the twin returns 84 plans; 65 win in the engine, and 57 of 59 certified plans are exactly optimal.

“From 150 engine-generated detour states absent from its run, the twin returns 84 plans; 65 win in the engine, and 57 of 59 certified plans are exactly optimal.”

May combine two claims.

From the start, the engine finishes 61 levels and the twin 47, but 31 of the twin's 32 wins are certified shortest.

“From the start, the engine finishes 61 levels and the twin 47, but 31 of the twin's 32 wins are certified shortest.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

tu93, lp85, and cd82 improve on their acting-time accuracy because later repairs also correct rules needed at earlier states.

“tu93, lp85, and cd82 improve on their acting-time accuracy because later repairs also correct rules needed at earlier states.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Games take between 80 and 1,219 scored actions.

“Games take between 80 and 1,219 scored actions.”

May combine two claims.

The twin world model increases the same base model to 93.3%, clearing 23 out of 25 games.

“our twin world model increases the same base model to 93.3%, clearing 23 out of 25 games”

• AssumptionThe authors state this as an assumption: Each game is an unknown deterministic world.

May combine two claims.

Compared with the no-twin ablation using an off-the-shelf coding agent, Twin uses 2.4× as many total tokens and 4.7× as many tokens per scored action, while improving the score by 32 percentage points.

“Compared with the no-twin ablation using an off-the-shelf coding agent, Twin uses 2.4× as many total tokens and 4.7× as many tokens per scored action, while improving the score by 32 percentage points.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The summary box aggregates all 25 runs: 2.60B processed tokens, 47.8M of them non-cached, over 91.4 hours.

“The summary box aggregates all 25 runs: 2.60B processed tokens, 47.8M of them noncached, over 91.4 hours.”

May combine two claims.

On tn36's three levels the engine search merges states that draw the same frame, and tn36 keeps hidden state its frames do not show.

“On tn36's three the engine search merges states that draw the same frame, and tn36 keeps hidden state its frames do not show.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Every disagreement in the block has a named cause.

“Every disagreement in the block has a named cause.”

May combine two claims.

Over the 174 levels, the engine finds a finish at 159, the twin at 107, and both at 102.

“Over the 174 that remain, the engine finds a finish at 159, the twin at 107, and both at 102.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Across the 25 runs, Twin used 2.60 billion processed tokens and 91.4 hours of wall-clock inference, averaging roughly 224,000 tokens per scored action.

“Across the 25 runs, Twin used 2.60 billion processed tokens and 91.4 hours of wall-clock inference, averaging roughly 224,000 tokens per scored action.”

May combine two claims.

On dc22, Twin clears all six levels in 1,219 actions, whereas EWM uses 1,842 actions and clears four.

“On dc22, Twin clears all six levels in 1,219 actions, whereas EWM uses 1,842 actions and clears four.”

May combine two claims.

Twin clears all 9 bp35 levels under the human count by buying the hidden map one probe per place.

“Yet bp35 hides most of each level behind a scrolling camera, and Twin clears all 9 levels under the human count by buying the hidden map one probe per place (Appendix G), so this class of partial observability is handled too.”

May combine two claims.

The same off-the-shelf Codex without the validate-explore-plan loop scores 61.1 and acts without predictions validated against the interaction history.

“The same off-the-shelf Codex without the validateexplore-plan loop scores 61.1 and acts without predictions validated against the interaction history.”

May combine two claims.

The twin predicts 8,210 of 10,392 first-seen pairs exactly (79.0%), compared with 602 of 635 recurring pairs (94.8%).

“The twin predicts 8,210 of 10,392 first-seen pairs exactly (79.0%), compared with 602 of 635 recurring pairs (94.8%).”

• Also stated in: § Conclusion · plain

  “Twins predict 79% of first-seen state-action pairs exactly, showing reusable rules rather than transition replay.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The ka59 run consumed 24% of all tokens for less than 10% of all scored actions.

“the ka59 run consumed 24% of all tokens for less than 10% of all scored actions.”

May combine two claims.

Disabling the Twin harness reduces the mean score from 93.3 to 61.1 and the number of fully cleared games from 23 to 13.

“Disabling the Twin harness reduces the mean score from 93.3 to 61.1 and the number of fully cleared games from 23 to 13 (Table 1).”

Probably not a substantial claim: may not pass S3 (load-bearing).

Processed tokens run from 5.1M on sb26 to 625.3M on ka59.

“Processed tokens run from 5.1M on sb26 to 625.3M on ka59, the two labeled points.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

ls20 is the extreme, its final window collapsing while the run still reads 75% and finishes.

“ls20 is the extreme, its final window collapsing while the run still reads 75% and finishes.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

sc25 claims twice and is never right.

“sc25 claims twice and is never right.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The 305 lines of the ft09 model.py hold everything the run learned: visual parsing, action dynamics, goal recognition, and planning.

“The 305 lines hold everything the run learned: visual parsing, action dynamics, goal recognition, and planning.”

May combine two claims.

The log splits bp35's run in two, 65 false claims and then 6 completed levels with no claim at all.

“The log splits bp35's run in two, 65 false claims and then 6 completed levels with no claim at all.”

May combine two claims.

Exploration is frontloaded, 19.1% of first-level actions and 5.3% of second-level, and probes reappear in deeper levels when new mechanics create fresh uncertainty.

“Exploration is frontloaded, 19.1% of first-level actions and 5.3% of second-level, and probes reappear in deeper levels when new mechanics create fresh uncertainty.”

May combine two claims.

Dips arrive with new levels, where fresh mechanics make the current rules wrong again.

“Dips arrive with new levels, where fresh mechanics make the current rules wrong again.”

May combine two claims.

The curves never flatten into a solved model; prediction and repair never stop.

“The curves never flatten into a solved model; prediction and repair never stop.”

Probably not a substantial claim: may not pass S3 (load-bearing).

sk48 claims 38 times and is right once across its 8 levels.

“sk48 claims 38 times and is right once across its 8 levels.”

May combine two claims.

On 122 of the 169 level cells where at least one rival system also reached the level, Twin spent the fewest actions or tied for fewest, 92 of them outright.

“on 122 of the 169 level cells where at least one rival system also reached the level, Twin spent the fewest actions or tied for fewest, 92 of them outright.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The original goal predicate matches one finished board and accepts the unsolved level-1 board; the rewrite states a constraint and rejects it.

“The original predicate matches one finished board and accepts the unsolved level-1 board; the rewrite states a constraint and rejects it.”

May combine two claims.

Pooled over the 54 camera moves that needed the cache, the sky guesses land 55% of pixels but 0.1% of the geometry, and 50 of the 54 hold not one platform, hazard, or exit.

“Pooled over the 54 camera moves that needed the cache, the sky guesses land 55% of pixels but 0.1% of the geometry, and 50 of the 54 hold not one platform, hazard, or exit.”

May combine two claims.

Every scored action labels the dynamics, so the log supplies 11,557 dynamics examples.

“Every scored action labels the dynamics, so the log supplies 11,557 dynam-ics examples.”

May combine two claims.

The spread is wide, 29% on lp85 to 98% on lf52 over whole runs, and both games were cleared.

“The spread is wide, 29% on lp85 to 98% on lf52 over whole runs, and both games were cleared.”

Probably not a substantial claim: may not pass S3 (load-bearing).

MOVES records that each arrow moves the token by three pixels.

“MOVES records that each arrow moves the token by three pixels.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The 11,557 graded actions are the runs' 11,614 scored actions less 52 automatic resets, which write no log entry, and 5 entries that share a step index.

“The 11,557 graded actions are the runs' 11,614 scored actions less 52 automatic resets, which write no log entry, and 5 entries that share a step index.”

May combine two claims.

The subtlest bad signal is the healthiest looking one: sp80 and sc25 end on long red stretches under high curves, the model fine, the goal missing.

“The subtlest bad signal is the healthiest looking one: sp80 and sc25 end on long red stretches under high curves, the model fine, the goal missing.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

sk48's tail collapses and stays down, its last levels sliding red.

“sk48's tail collapses and stays down, its last levels sliding red.”

May combine two claims.

Figure 16 shows false claims spread almost evenly across the level, with no crowding near the finish.

“Figure 16 shows them spread almost evenly across the level, with no crowding near the finish.”

Probably not a substantial claim: may not pass S3 (load-bearing).

ka59 and sk48 never settle, interleaving successful plans with counterexamples to the end.

“ka59 and sk48 never settle, interleaving successful plans with counterexamples to the end.”

May combine two claims.

Recall is 138/179 = 0.771, precision is 138/646 = 0.214, and the false-alarm rate over non-winning actions is 508/11,378 = 0.045.

“Recall is 138/179 = 0.771, precision 138/646 = 0.214, and the false-alarm rate over non-winning actions 508/11,378 = 0.045.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The second pair in Listing 3 shows the goal predicate before and after the level-0 boundary at scored action 3.

“The second pair shows the goal predicate before and after the level-0 boundary at scored action 3.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

lf52, ar25, sb26, re86, and bp35 all hold above 90% and win every level at or near human pace, each miss repaired the moment it appears.

“lf52, ar25, sb26, re86, and bp35 all hold above 90% and win every level at or near human pace, each miss repaired the moment it appears.”

Probably not a substantial claim: may not pass S3 (load-bearing).

bp35 is the one twin that gives up: it ends the run with a predicate that returns false for every frame.

“bp35 is the one twin that gives up: it ends the run with a predicate that returns false for every frame.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Three actions later level 0 ends, the unsolved level-1 board appears, and the goal predicate fires on it anyway.

“Three actions later level 0 ends, the unsolved level-1 board appears, and the goal predicate fires on it anyway.”

May combine two claims.

The submission log reproduces that diagnosis on its own: five false claims, each sitting one step before a level ends.

“the submission log reproduces that diagnosis on its own: five false claims, each sitting one step before a level ends.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A corner-pocket counterexample left only three rim cells visible, so the agent lowered the rim threshold from four to three.

“A corner-pocket counterexample left only three rim cells visible, so the agent lowered the threshold from four.”

May combine two claims.

The revealed strip is pasted into model.py under a hash of the frame it was seen from, 56 entries by the run's end, and that place never costs again.

“The revealed strip is pasted into model.pyunder a hash of the frame it was seen from, 56 entries by the run's end, and that place never costs again.”

May combine two claims.

cd82, lp85, and m0r0 run at 37%, 29%, and 52% and still score 100, because a miss is cheap by construction: the plan halts, one action is spent, and the miss returns as a counterexample.

“cd82, lp85, and m0r0 run at 37%, 29%, and 52% and still score 100, because a miss is cheap by construction: the plan halts, one action is spent, and the miss returns as a counterexample.”

May combine two claims.

Most curves start rough, because a fresh twin knows nothing, and climb as each miss becomes a repair.

“Most curves start rough, because a fresh twin knows nothing, and climb as each miss becomes a repair.”

May combine two claims.

The bp35 run clears 9 of 9 levels in 529 actions against the 651-action human baseline, seeing about a third of the map at a time.

“The run clears 9 of 9 levels in 529 actions against the 651-action human baseline, seeing about a third of the map at a time.”

May combine two claims.

sp80 holds 92% and never finishes.

“sp80 holds 92% and never finishes.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Asked what sits above the seen windows, the twin answers empty sky.

“Asked what sits above the seen windows, the twin answers empty sky.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Twin spent 647 actions on sc25 L4 and 928 on sp80 L6 before those runs ended.

“Twin spent 647 actions on sc25 L4 and 928 on sp80 L6 before those runs ended.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Every action lands in one of four cells: 138 right, 508 wrong, 41 missed, and 10,870 correctly quiet.

“If goal_reached claimed a win and the level completed, the claim was right, 138 times.If it claimed a win and nothing completed, the claim was wrong, 508 times.If it claimed nothing and the level completed, it missed a win, 41 times.If it claimed nothing and nothing completed, it was correctly quiet, 10,870 times.”

May combine two claims.

Of the probes, nineteen in twenty distinguish between competing dynamics hypotheses; only one in twenty searches for the goal directly.

“Of the probes, nineteen in twenty distinguish between competing dynamics hypotheses; only one in twenty searches for the goal directly.”

May combine two claims.

In bp35, the screen shows 10.7 rows of a 28-row map, the camera scrolls with the player, and the exit sits 16 rows above the opening frame in space the agent has no pixel of.

“the screen shows 10.7 rows of a 28-row map, the camera scrolls with the player, and the exit sits 16 rows above the opening frame, in space the agent has no pixel of.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Recall stays high everywhere.

“Recall asks whether the wins were announced, and it stays high everywhere.”

May combine two claims.

dc22 is the exception that proves the mechanism, pairing precision 0.074 with 4 valid plans out of 4.

“dc22 is the exception that proves the mechanism, pairing precision 0.074 with 4 valid plans out of 4.”

May combine two claims.

The no-twin ablation runs cheaper, 48k tokens per scored action and 1.06B in total; the twin's action efficiency is bought with compute.

“The no-twin ablation runs cheaper, 48k tokens per scored action and 1.06B in total; the twin's action efficiency is bought with compute.”

May combine two claims.

Deleting all 56 strips breaks only 54 of the 407 unique recorded transitions; learned physics carries the other 353.

“Deleting all 56 strips breaks only 54 of the 407 unique recorded transitions; learned physics carries the other 353.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A later counterexample exposes a perception edge case: with the token in the corner pocket of a plus, only three rim cells stay visible, so the repair lowers the detector's threshold from four cells to three.

“A later counterexample exposes a perception edge case.With the token in the corner pocket of a plus, only three rim cells stay visible, so the repair lowers the detector's threshold from four cells to three.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The first pair in Listing 3 shows the dynamics rule before and after the counterexample at scored action 0, which exposed two wrong cells in the bottom action-budget bar.

“The first pair shows the dynamics rule before and after the counterexample at scored action 0, which exposed two wrong cells in the bottom action-budget bar.”

May combine two claims.

Across the 25 runs, the share of a curve's windows at 90% or higher has no correlation with the game's score, because the same flat-high shape sits on the two worst panels.

“Across the 25 runs, the share of a curve's windows at 90% or higher has no correlation with the game's score, because the same flat-high shape sits on the two worst panels.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

tn36 holds 95% and scores 69.7.

“tn36 holds 95% and scores 69.7.”

May combine two claims.

ka59's dips never recover, its curve spending a median of 241 actions below 80% after each new level, repairs that do not stick.

“ka59's dips never recover, its curve spending a median of 241 actions below 80% after each new level, repairs that do not stick.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Precision runs from 0.00 to 1.00, failing differently at the low end in each case.

“Precision asks how often a claim is right, and it runs from 0.00 to 1.00, failing differently at the low end in each case.”

May combine two claims.

Six actions out, both searches broadly agree, both finishing on 102 levels; from the start the engine finds 61 and the twin 47, agreeing on 33.

“Six actions out the searches broadly agree, both finishing on 102 levels; from the start the engine finds 61 and the twin 47, agreeing on 33.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

tn36 claims 96 times and is right 7 times, once per completed level.

“tn36 claims 96 times and is right 7 times, once per completed level.”

May combine two claims.

False claims do not crowd the finish: the median lands 0.533 through a level, and the final tenth holds 12.6% against the uniform 10%.

“They do not: the median lands 0.533 through a level, and the final tenth holds 12.6% against the uniform 10%.”

May combine two claims.

Twin won 23 games with mean score 93.3; OPINE-World won 20 with 78.4; EWM won 14 with 63.8; Codex won 13 with 61.1.

“Won / mean | | | 23 | 93.3 | | 20 | 78.4 | | 14 | 63.8 | | 13 | 61.1”

• AssumptionRests on an assumption: The ARC-AGI-3 benchmark score depends only on level completion and counts nothing else.

May combine two claims.

The 25 runs total 2.60B processed tokens and 91.4 hours, with non-cached tokens under 2% of the total: the twin's thinking runs almost entirely on cached context.

“The 25 runs total 2.60B processed tokens and 91.4 hours, with non-cached tokens under 2% of the total: the twin's thinking runs almost entirely on cached context.”

May combine two claims.

Humans completely clear these games, whereas frontier models fail at most games.

“Humans completely clear these games, whereas frontier models fail at most games.”

• cites ARC Prize Foundation 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Most cells are unchanged background, which inflates the cell-match fraction even when an important object is wrong; the paper therefore relies on exact-frame accuracy.

“First, most cells are unchanged background, which inflates the cell-match fraction even when an important object is wrong.We therefore rely on exact-frame accuracy.”

May combine two claims.

These fixed signals are visual-change heuristics used only to rank candidate states; they do not encode game-specific objects, actions, or goals.

“These fixed signals are visualchange heuristics used only to rank candidate states; they do not encode game-specific objects, actions, or goals.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The public games, released March 2026, are after the base model's GPT 5.6 Sol, February 2026 training cutoff, so every rule in a twin is learned from interaction.

“the public games, released March 2026, are after the base model's GPT 5.6 Sol, February 2026 training cutoff, so every rule in a twin is learned from interaction.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The hints follow the self-debugging pattern inside a counterexample-guided loop in the CEGIS line.

“The hints follow the self-debugging pattern (Chen et al. 2024) inside a counterexample-guided loop in the CEGIS line (Solar-Lezama 2008).”

• cites Chen et al. 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Solar-Lezama 2008Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The released harness enforces the green check as a hard constraint, refusing any predicate that fails it; during the reported runs the UpdateGoal prompt asked the agent to apply the same check.

“The released harness enforces the green check as a hard constraint, refusing any predicate that fails it; during the reported runs the UpdateGoal prompt asked the agent to apply the same check.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The grouping operates over object-level abstractions rather than game-specific rules, so nothing in it is hard-coded to ARC-AGI-3.

“The grouping operates over object-level abstractions rather than game-specific rules, so nothing in it is hard-coded to ARC-AGI-3.”

Classified as probably not a substantial claim. May combine two claims.

An empty c with no plan means the twin is right and the goal is missing, so the query proposes a goal candidate.

“An empty c with no plan means the twin is right and the goal is missing, so the query proposes a goal candidate.”

May combine two claims.

The invariant is sound because ARC-AGI-3 replaces the winning frame when reporting completion, so a true goal frame never enters the record and every recorded frame is a certified negative.

“The invariant is sound because ARC-AGI-3 replaces the winning frame when reporting completion, so a true goal frame never enters the record and every recorded frame is a certified negative.”

• AssumptionRests on an assumption: ARC-AGI-3 replaces the winning frame when reporting completion, so a true goal frame never enters the record and every recorded frame is a certified negative.

Classified as probably not a substantial claim.

The ablation keeps the identical agent, base model, file bridge, and sandbox, with the entire Twin harness disabled.

“The ablation keeps the identical agent, base model, file bridge, and sandbox, with the entire Twin harness disabled.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Truly latent state, a variable no frame ever shows, stays out of scope.

“Truly latent state, a variable no frame ever shows, stays out of scope.”

Classified as probably not a substantial claim. May combine two claims.

Only submit.py issues a scored action, and it demands three things first: a rationale tag, a twin that validates against the complete recorded history, and a next-frame prediction committed before the outcome is observed.

“Only submit.pyissues a scored action, the red node of Figure 9, and it demands three things first: a rationale tag, a twin that validates against the complete recorded history, and a next-frame prediction committed before the outcome is observed.”

May combine two claims.

Building the twin puts nearly five times the thought behind each action and halves the actions the harness takes.

“Building the twin puts nearly five times the thought behind each action and halves the actions the harness takes.”

Probably not a substantial claim: may not pass S3 (load-bearing).

step reads one frame, so mechanics driven by long temporal context, history the grid does not show, are beyond this scope.

“step reads one frame, so mechanics driven by long temporal context, history the grid does not show, are beyond this scope.”

Classified as probably not a substantial claim.

A transition mismatch is the reverse: the physics get repaired and the goal candidate stays tentative.

“A transition mismatch is the reverse: the physics get repaired and the goal candidate stays tentative.”

May combine two claims.

Replay establishes consistency with observed transitions, but a model that merely memorizes them would also pass.

“Replay establishes consistency with observed transitions, but a model that merely memorizes them would also pass.”

May combine two claims.

Each submitted action becomes planned progress, a concrete counterexample for model repair, or a deliberate probe.

“Each submitted action therefore becomes planned progress, a concrete counterexample for model repair, or a deliberate probe.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Trial and error pays no per-hypothesis price.

“Trial and error pays no per-hypothesis price.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Tests begin only from visited states, and rates include only tests where the twin returns a frame.

“Tests begin only from visited states, and rates include only tests where the twin returns a frame.”

Classified as probably not a substantial claim. May combine two claims.

A nonempty c means the dynamics are wrong, so the query targets the worst gap: the action and object pair the twin mispredicts most.

“A nonempty c means the dynamics are wrong, so the query targets the worst gap: the action and object pair the twin mispredicts most.”

May combine two claims.

Against the ablation it is a trade: the twin does not save compute; it front-loads the compute offline so the actions it submits online are well-thought and few.

“Against the ablation it is a trade: the twin does not save compute; it front-loads the compute offline so the actions it submits online are well-thought and few.”

Classified as probably not a substantial claim. May combine two claims.

Web search is disabled, and an integrity audit scans the transcript and raw agent log for web-tool use or reads of deny-listed groundtruth sources, so a run that cheats is invalidated rather than scored.

“Web search is disabled, and an integrity audit scans the transcript and raw agent log for web-tool use or reads of deny-listed groundtruth sources, so a run that cheats is invalidated rather than scored.”

May combine two claims.

Novelty costs 15.8 percentage points, yet nearly four of five unseen pairs remain cell-exact.

“Novelty therefore costs 15.8 percentage points, yet nearly four of five unseen pairs remain cell-exact.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Planning and goal discovery run under fixed search budgets, so a goal beyond the horizon goes unfound.

“Planning and goal discovery run under fixed search budgets, so a goal beyond the horizon goes unfound.”

May combine two claims.

OPINE-World fits its predicate only after a first level is cleared and Schema infers is_goal alongside its dynamics.

“OPINE-World fits its predicate only after a first level is cleared and Schema infers is_goal alongside its dynamics.”

Probably not a substantial claim: may not pass S4 (based).

A level boundary encountered along the cheapest route to a top-scoring state provides the first positive example for goal_reached.

“A level boundary encountered along the cheapest route to a top-scoring state provides the first positive example for goal_reached.”

May combine two claims.

The twin stays 92.3% accurate while the sixth level's goal resists, a goal wall rather than a dynamics wall.

“the twin stays 92.3% accurate while the sixth level's goal resists, a goal wall rather than a dynamics wall.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The Method named the two ways a run gets stuck: the dynamics wall when the twin fails to replay the past, the goal wall when it replays everything yet reaches no goal.

“The Method named the two ways a run gets stuck, the dynamics wall when the twin fails to replay the past, the goal wall when it replays everything yet reaches no goal.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

The unfinished games mark the frontier: accurate dynamics, unresolved goals.

“The unfinished games mark the frontier: accurate dynamics, unresolved goals.”

May combine two claims.

Against EWM, Twin wins on both counts.

“Against EWM that wins on both counts.”

May combine two claims.

Replay validation certifies all logged transitions but does not guarantee predictions in unseen situations.

“Replay validation certifies all logged transitions but does not guarantee predictions in unseen situations.”

• AssumptionThe authors state this as an assumption: Replay validation assumes deterministic dynamics representable by the twin.

Classified as probably not a substantial claim.

The Twin harness requires the world model to reproduce every transition in the recorded interaction history before issuing a scored action.

“The Twin harness requires the world model to reproduce every transition in the recorded interaction history before issuing a scored action.”

• AssumptionThe authors state this as an assumption: Replay validation assumes deterministic dynamics representable by the twin.

May combine two claims.

wa30 replays its recorded run almost perfectly yet fails on pairs it never took: exact replay does not guarantee generalization.

“wa30 replays its recorded run almost perfectly yet fails on pairs it never took: exact replay does not guarantee generalization.”

May combine two claims.

Every test starts from a visited state and uses an action type or click coordinate observed in that run; the experiment measures generalization near the agent's experience, not on arbitrary states or actions.

“Second, every test starts from a visited state and uses an action type or click coordinate observed in that run.The experiment therefore measures generalization near the agent's experience, not on arbitrary states or actions.”

Classified as probably not a substantial claim. May combine two claims.

A level boundary confirms the candidate and becomes the first reward example.

“A level boundary confirms the candidate and becomes the first reward example.”

May combine two claims.

The difficulty is neither knowledge nor perception: these games hide both how the world behaves and what counts as winning.

“The difficulty is neither knowledge nor perception: these games hide both how the world behaves and what counts as winning.”

May combine two claims.

Building a usable world model is simpler than anticipated, whereas the harder problem is inferring the right goal.

“Building a usable world model is simpler than anticipated, whereas the harder problem is inferring the right goal.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Claude Opus 5 reports a verified 30.2% on the semi-private evaluation set.

“Claude Opus 5 (Anthropic 2026) reports a verified 30.2% on the semi-private evaluation set”

• cites Anthropic 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The submission log keeps the split, so every scored action is auditable after the fact as either exploitation or evidence-buying.

“The submission log keeps that split, so every scored action is auditable after the fact as either exploitation or evidence-buying.”

Classified as probably not a substantial claim.

Each predicted next frame is hashed and committed before the outcome is observed, so it cannot be revised after seeing the result.

“Each predicted next frame is hashed and committed before the outcome is observed, so it cannot be revised after seeing the result.”

Classified as probably not a substantial claim. May combine two claims.

The predicted goal reached without a boundary retires it: the physics were right and the objective was wrong.

“The predicted goal reached without a boundary retires it: the physics were right and the objective was wrong.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The tag is the agent's own reasoning, declared at submission rather than checked by the harness, which enforces only the validation and the committed prediction.

“The tag is the agent's own reasoning, declared at submission rather than checked by the harness, which enforces only the validation and the committed prediction.”

Classified as probably not a substantial claim.

Goal inference is the exploration problem of reinforcement learning.

“Goal inference is the exploration problem of reinforcement learning (Dearden, Friedman, and Russell 1998)”

• cites Dearden, Friedman, and Russell 1998Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Twin solves the same games with fewer interactions, consistent with replay validation and planning within the world model reducing unnecessary moves.

“Thus, Twin solves the same games with fewer interactions, consistent with replay validation and planning within the world model reducing unnecessary moves.”

May combine two claims.

Goal proposal and temporal state modeling are the main targets for improvement.

“Goal proposal and temporal state modeling are therefore the main targets for improvement.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

EWM established the recipe with a single coding agent, scoring 63.8.

“EWM (Rodionov 2026) established the recipe with a single coding agent, scoring 63.8.”

• cites Rodionov 2026 sourceNot checked yet

  Checked before — its earlier verdict is held back until a new check runs.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

OPINE-World splits acting and synthesis across two cooperating agents, steers exploration by a Bayesian ontology error, and scores 78.4.

“OPINE-World (Courtis, Li, and Sanner 2026) splits acting and synthesis across two cooperating agents, steers exploration by a Bayesian ontology error, and scores 78.4”

• cites Courtis, Li, and Sanner 2026 sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

sp80's twin stores a call counter, so each of its probes is graded under the counter state a log-order replay produces at that state; this makes its grading order-independent, and sp80 joins every measurement below.

“sp80's twin stores a call counter, so each of its probes is graded under the counter state a log-order replay produces at that state; this makes its grading order-independent, and sp80 joins every measurement below.”

May combine two claims.

The hard constraint of replay validation keeps model errors from compounding across long games and may explain why Twin alone clears bp35, lf52, and sk48.

“This hard constraint keeps model errors from compounding across long games and may explain why Twin alone clears bp35, lf52, and sk48.”

Classified as probably not a substantial claim.

The paper evaluates each final twin on previously unobserved state-action pairs.

“We therefore evaluate each final twin on previously unobserved state-action pairs.”

May combine two claims.

The other three world-model systems also test models or plans against past experience, but they do not require a model to match the entire history before every real action.

“The other three world-model systems also test models or plans against past experience, but they do not require a model to match the entire history before every real action.”

Classified as probably not a substantial claim. May combine two claims.

Before every MODEL-tagged action the twin predicts the full next frame, and the harness stamps the prediction's hash before the action is sent, so the claim cannot be revised.

“Before every MODEL-tagged action the twin predicts the full next frame, and the harness stamps the prediction's hash before the action is sent, so the claim cannot be revised.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Human, EWM, and OPINE-World counts are their published values, and Twin counts come from the paper's recorded action histories.

“Human, EWM, and OPINE-World counts are their published values, and Twin counts come from our recorded action histories.”

May combine two claims.

Height says how much the twin knows; recovery says how fast it learns; only the tint says whether what the twin learned turned into benchmark score.

“Height says how much the twin knows.Recovery says how fast it learns.Only the tint says whether what the twin learned turned into benchmark score, and the benchmark counts nothing”

Classified as probably not a substantial claim. May combine two claims.

Reproducibility rests on the audit trail: one scored run per game, a hash-committed prediction before every action the agent submitted, and complete action histories.

“Reproducibility rests instead on the audit trail: one scored run per game, a hash-committed prediction before every action the agent submitted, and complete action histories.”

• AssumptionRests on an assumption: The ARC-AGI-3 environments and harness are deterministic.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

If goal_reached returns true, the twin is claiming that this action ends the level, and the claim is logged before the outcome arrives so it cannot be revised.

“If goal_reached returns true, the twin is claiming that this action ends the level.The claim is logged before the outcome arrives, so it cannot be revised.”

May combine two claims.

A plan halts at its first wrong prediction, so one bad rule wastes at most one action and hands back a counterexample.

“A plan halts at its first wrong prediction, so one bad rule wastes at most one action and hands back a counterexample.”

Classified as probably not a substantial claim.

Each submission-log entry records goal_reached applied to the twin's predicted next frame, committed before the outcome arrives, so revision after the fact is impossible.

“Each entry records goal_reached applied to the twin's predicted next frame, committed before the outcome arrives, so revision after the fact is impossible.”

May combine two claims.

The predicate finds most wins and also accepts many states that complete nothing.

“It finds most wins and also accepts many states that complete nothing.”

May combine two claims.

In bp35, the camera is a pure function of the player's row and nothing latent moves on its own, so the unseen part of the level is a static piece of the transition function, learnable once and checkable forever.

“The camera is a pure function of the player's row and nothing latent moves on its own, so the unseen part of the level is a static piece of the transition function, learnable once and then checkable forever.”

May combine two claims.

Twin does not wait for a globally accurate model: the halt-on-mismatch guard runs each plan until its first wrong prediction, and that prediction becomes the next repair.

“Twin does not wait for a globally accurate model: the halt-on-mismatch guard runs each plan until its first wrong prediction, and that prediction becomes the next repair.”

May combine two claims.

Twin handles fully observed deterministic games, and bp35 is evidence it stretches to a class of partially observed ones.

“Twin handles fully observed deterministic games, and bp35 is the evidence it stretches to a class of partially observed ones”

May combine two claims.

Most wins are claimed, and most claims are wrong.

“Most wins are claimed, and most claims are wrong.”

May combine two claims.

Managing that state carries the base model from 7.8 to 78.3, and the final 15.0 points to Twin's 93.3 are what a validated world model adds.

“Managing that state carries the base model from 7.8 to 78.3, and the final 15.0 points to Twin's 93.3 are what a validated world model adds (Table 6).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

gpt-5.6-sol is accessed through a hosted service without an exposed random seed, so its exact token sequences are not reproducible.

“gpt-5.6-sol is accessed through a hosted service without an exposed random seed, so its exact token sequences are not reproducible.”

• AssumptionRests on an assumption: The ARC-AGI-3 environments and harness are deterministic.

Probably not a substantial claim: may not pass S3 (load-bearing).

The figure separates good training signals from bad ones.

“Putting each curve beside its background scores, the figure separates good training signals from bad ones.”

May combine two claims.

The cost lands on the planner, which searches for the first state the predicate accepts, so a wrong accept ends the search early and the plan stops short of the level.

“The cost lands on the planner, which searches for the first state the predicate accepts, so a wrong accept ends the search early and the plan stops short of the level.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Every setting was fixed before the first run and held constant across the 25 games.

“Every setting was fixed before the first run and held constant across the 25 games.”

• AssumptionRests on an assumption: The ARC-AGI-3 environments and harness are deterministic.

May combine two claims.

OpenAI reported two memory settings for this same model, retaining private reasoning across moves and compacting older history; on OpenAI's own evaluation, the two settings together reach 38.3 on roughly six times fewer output tokens.

“in July 2026 OpenAI reported two memory settings for this same model: retaining its private reasoning across moves, and compacting older history (OpenAI 2026).On OpenAI's own evaluation, where direct play starts higher at 13.3, the two settings together reach 38.3 on roughly six times fewer output tokens.”

• cites OpenAI 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The agent has no vision channel, though a few runs parsed the image's pixels with code.

“the agent has no vision channel, though a few runs parsed the image's pixels with code.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Every artifact is public.

“Every artifact is public.”

Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

No source line in Listing 1 is omitted or changed.

“No source line is omitted or changed.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The final goal predicate in Listing 1 is the one confirmed through interaction.

“The final goal predicate is the one confirmed through interaction.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A single miss moves the running-average curve by ten percentage points, so no error hides.

“A single miss moves it by ten percentage points, so no error hides.”

May combine two claims.

A false claim carries no penalty of its own, because the harness only records it.

“A false claim carries no penalty of its own, because the harness only records it.”

May combine two claims.

What the twin learned is not hidden in weights: every rule it believes, and the reasoning behind each repair, reads as source and docstring.

“What the twin learned is not hidden in weights: every rule it believes, and the reasoning behind each repair, reads as source and docstring.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The three direct-play scores in Table 6 are as published, not rescored here.

“The three direct-play scores are as published, not rescored here.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Every line and comment in Listing 1 is the agent's, so the listing is the model that did the planning, not a reconstruction written after the run.

“Every line and comment is the agent's, so the listing is the model that did the planning, not a reconstruction written after the run.”

May combine two claims.

Each twin accepts whatever its wins had in common, and those features recur throughout a level rather than near its end.

“Each twin accepts whatever its wins had in common, and those features recur throughout a level rather than near its end.”