Kepler: Auditable World Models for ARC-AGI-3

May combine two claims.

Under one frozen Claude Opus 5 configuration, Kepler obtained a server-verified 100.00 RHAE on all 25 public games, with no per-game model selection or score-conditioned reruns.

“Under one frozen Claude Opus 5 configuration, Kepler obtained a server-verified 100.00 RHAE on all 25 public games, with no per-game model selection or score-conditioned reruns.”

• Also stated in: § 4.3 Public-set score saturation · plain

  “the Opus board is a single-configuration, server-verified-exact 100.00”

• AssumptionRests on an assumption: The server replay is the authoritative and correct scoring mechanism.

May combine two claims.

Retained local provider-session records yield 858.0 million tokens, 97.37% cache reads, and a $777.72 cost at September 1, 2026 API list-equivalent rates.

“Retained local provider-session records yield 858.0 million tokens, 97.37% cache reads, and a $777.72 cost at September 1, 2026 API list-equivalent rates.”

May combine two claims.

The retained Opus board runs used 8,256 environment actions, of which 7,292 occurred in scored levels.

“The retained board runs used 8,256 environment actions, of which 7,292 occurred in scored levels.”

• Also stated in: § 4.5 Cost · plain

  “The 100.00 Opus board reports 8,256 environment actions across the retained board runs and 7,292 in the original local scored-level results.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The agent's notebook reports a model reproducing 4,655 of 4,670 recorded transitions, leaving 15 mismatches attributed there to game-over flags.

“Its notebook reports a model reproducing 4,655 of 4,670 recorded transitions, leaving 15 mismatches attributed there to game-over flags”

• AssumptionRests on an assumption: The agent's reported search count and notebook transition reproduction are accurate.

May combine two claims.

The local campaign ledgers contain at least 13,688 non-reset actions and omit 22 prefix events whose reset status cannot yet be recovered.

“The local campaign ledgers contain at least 13,688 non-reset actions and omit 22 prefix events whose reset status cannot yet be recovered.”

May combine two claims.

Ledger recomputation covers 363 completed levels: 354 counts match exactly, nine are conservative, and none inflate the score.

“Ledger recomputation covers 363 completed levels: 354 counts match exactly, nine are conservative, and none inflate the score.”

May combine two claims.

The public set is saturated: five entries at ≥99, four at 100, and 48 of the authors' own 50 cells at 100 on the final boards.

“with the public set saturated (five entries at ≥99, four at 100; 48 of our own 50 cells at 100 on the final boards)”

May combine two claims.

All six final rejected clicks left the board unchanged: three changed no pixel, and three changed only pixel (63, 63).

“All six final rejected clicks left the board unchanged: three changed no pixel, and three changed only pixel (63, 63).”

May combine two claims.

The certify/replay fix passes RESET-first plans through to the gate; pre-freeze validation runs converted sc25 84→100 and g50t 92→100, and the reported board comes from fresh runs launched after the freeze was registered.

“The certify/replay fix passes RESET-first plans through to the gate; pre-freeze validation runs converted sc25 84→100 and g50t 92→100, and the reported board comes from fresh runs launched after the freeze was registered.”

May combine two claims.

Total token volumes were 858,041,926 versus 1,343,479,217, a 36.1% reduction.

“Total token volumes were 858,041,926 versus 1,343,479,217, a 36.1% reduction.”

May combine two claims.

Agents silently wrote replacement searches and continued solving games; scores remained high, ledgers remained internally consistent, and none of the six adversarial checks fired because no evidence was corrupted.

“Agents silently wrote replacement searches and continued solving games.Scores remained high, ledgers remained internally consistent, and none of the six adversarial checks fired because no evidence was corrupted.”

May combine two claims.

The continuation inherited earlier learning and identified a deflection rule visible during animation.

“The continuation inherited earlier learning and identified a deflection rule visible during animation.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A later fresh visual run rediscovered the game under the frozen harness, and the release board reproduced the score.

“A later fresh visual run rediscovered the game under the frozen harness, and the release board reproduced the score.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The agent reported searching roughly 4.1 × 10^8 candidate configurations without finding a solution under its learned rules.

“The agent reported searching roughly 4.1 × 10 8 candidate configurations without finding a solution under its learned rules.”

• AssumptionRests on an assumption: The agent's reported search count and notebook transition reproduction are accurate.

May combine two claims.

The 95.97 GPT-5.6 board contains 39,262,504 uncached input, 2,379,659,648 cached input, and 10,161,281 output tokens, or 2,429,083,433 raw tokens total.

“The 95.97 GPT-5.6 board contains 39,262,504 uncached input, 2,379,659,648 cached input, and 10,161,281 output tokens, or 2,429,083,433 raw tokens total.”

May combine two claims.

Kepler's list-equivalent estimate is 74.0% below Retrodict's $2,986 API-equivalent estimate for Tycho, or roughly one quarter as large.

“Kepler's list-equivalent estimate is 74.0%below that estimate, or roughly one quarter as large.”

May combine two claims.

Kepler's longest text-mode run reached level 5 of 6 with every level at the cap, then spent days on level 6.

“Our longest text-mode run reached level 5 of 6 with every level at the cap, then spent days on level 6.”

May combine two claims.

All six baseline agents in the ablation found the harness tools: three copied the tools in with cp, while the rest wrote shims executing the repository's canonical tools directly, with 92-9,148 harness-tool invocations each and a world_model.py in every workspace.

“All six baseline agents found it: three copied the tools in with cp, while the rest wrote shims executing the repository's canonical tools directly, with 92-9,148 harness-tool invocations each and a world_model.py in every workspace.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The GPT board reports 35,896 retained-run actions and 8,400 in its original local scored-level results.

“The GPT board similarly reports 35,896 retained-run actions and 8,400 in its original local scored-level results.”

May combine two claims.

sp80 collapses under forced-reset discipline, partially recovers under certify/replay, and reaches 100 after rendered-frame observation is added.

“sp80 (red) collapses under forced-reset discipline, partially recovers under certify/replay, and reaches 100 after rendered-frame observation is added.”

May combine two claims.

The agent makes zero external requests across the audited session records; its only HTTP target is the localhost daemon.

“the agent makes zero external requests across the audited session records; its only HTTP target is the localhost daemon.”

May combine two claims.

Cost is self-reported with no shared definition and no leaderboard badge.

“which is self-reported with no shared definition and no leaderboard badge”

Probably not a substantial claim: may not pass S3 (load-bearing).

In the exploratory discovery test, a depth-four search with all panel controls enabled queued 718 states and rejected 1,369 proposals.

“A depth-four search with all panel controls enabled queued 718 states and rejected 1,369 proposals.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Its final successful attempt on the last level used 57 actions.

“Its final successful attempt on the last level used 57 actions.”

May combine two claims.

The exact 100.00 Opus campaign contains 11,464 uncached input, 835,488,978 cache-read input, 13,574,918 one-hour cache-write input, and 8,966,566 output tokens: 858,041,926 raw tokens in total, 97.37% of them cache reads.

“The exact 100.00 Opus campaign contains 11,464 uncached input, 835,488,978 cache-read input, 13,574,918 one-hour cache-write input, and 8,966,566 output tokens: 858,041,926 raw tokens in total, 97.37% of them cache reads.”

May combine two claims.

Twice, a rewrite escaped the workspace and compressed the repository root AGENTS.md as well, caught in the working tree and reverted.

“Twice, a rewrite escaped the workspace and compressed the repositoryroot AGENTS.md as well, caught in the working tree and reverted.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

An earlier draft used incomplete workspace CLI footer counters; provider-side records showed that path omitted most cached traffic and one long workspace, and the attractive comparison it produced has been withdrawn.

“An earlier draft used incomplete workspace CLI footer counters.Provider-side records showed that path omitted most cached traffic and one long workspace; the attractive comparison it produced has been withdrawn.”

May combine two claims.

The exploratory test established no useful counterexample, learned repair or solving advantage.

“The test established no useful counterexample, learned repair or solving advantage.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Shortest-path and endpoint-distance rankings selected six distinct probes across five rejection sites.

“Shortest-path and endpoint-distance rankings selected six distinct probes across five rejection sites.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Kepler's initial loop, run with that fallback for comparison only, matched those numbers within noise (98.30/95.51).

“Our initial loop, run with that fallback for comparison only, matched those numbers within noise (98.30/ 95.51).”

Probably not a substantial claim: may not pass S3 (load-bearing).

Every setup observation and reset matched the recorded visible state.

“Every setup observation and reset matched the recorded visible state.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The §3 ladder reports the same initial loop without fallback selection (97.78).

“The §3 ladder reports the same initial loop without fallback selection (97.78).”

May combine two claims.

Retained animation later exposed a deflection rule, but earlier frame counts also contained distinguishing clues.

“Retained animation later exposed a deflection rule, but earlier frame counts also contained distinguishing clues.”

May combine two claims.

Two guards had complementary conditions that deadlocked the agent (fixed in d37660e); this is a local implementation failure, not a benchmark-rule defect.

“Two guards also had complementary conditions that deadlocked the agent (fixed in d37660e); this is a local implementation failure, not a benchmark-rule defect.”

May combine two claims.

The guard-correction stage demoted fraction-based guards to warnings and retained an absolute 3,000-action refusal, recovering 2.50 points in the staged comparison.

“The guard-correction stage demoted fraction-based guards to warnings and retained an absolute 3,000-action refusal, recovering 2.50 points in this staged comparison.”

May combine two claims.

lf52 is the same game Retrodict documented as its only non-exact replay, giving two independent harnesses a seam on one nondeterminism-prone game.

“lf52 is the same game Retrodict documented as its only non-exact replay, giving two independent harnesses a seam on one nondeterminism-prone game ( §4.2).”

May combine two claims.

The historical local archive reports 324 of 330 runs clean; the six flags are the quarantined §5.1 control-group workspaces.

“Separately, the historical local archive reports 324 of 330 runs clean; the six flags are the quarantined §5.1 control-group workspaces.”

May combine two claims.

A clean rerun of that game scored 46.91, a 53-point drop.

“A clean rerun scored 46.91, a 53-point drop.”

May combine two claims.

The retained Opus runs generated 8,966,566 output tokens versus Tycho's reported 23,433,077, a 61.7% reduction.

“The retained Opus runs generated 8,966,566 output tokens versus Tycho's reported 23,433,077, a 61.7% reduction.”

The quote only partly states this claim.

The GPT-5.6 Sol release configuration reached 95.97 RHAE.

“It produces the server-exact 100.00 Opus board and 95.97 GPT board.”

• Also stated in: § 1 Introduction · plain

  “Two frozen release configurations reach 100.00 and 95.97 RHAE”

• AssumptionRests on an assumption: The server replay is the authoritative and correct scoring mechanism.

May combine two claims.

Per-game variance is much larger; one same-configuration GPT rerun moved from 47.6 to 100.0.

“much larger pergame variance (one same-configuration GPT rerun moved from 47.6 to 100.0)”

May combine two claims.

The telemetry of that run looked better than honest play: fewer actions, zero mispredictions, and a clean ledger.

“The telemetry looked better than honest play: fewer actions, zero mispredictions, and a clean ledger.”

May combine two claims.

On the two Kepler release boards, 48 of 50 cells score 100.0; the two GPT exceptions are sp80 and tn36.

“48 of 50 cells score 100.0 (blue).The two GPT exceptions are sp80 and tn36.”

May combine two claims.

Independent score recomputation matches 100.00 for Claude Opus 5 and 95.9672 for GPT-5.6 Sol, and the ledger check covers all 363 completed levels.

“Independent score recomputation matches 100.00 for Claude Opus 5 and 95.9672 for GPT-5.6 Sol, and the ledger check covers all 363 completed levels.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.

Retained frames 0, 12, and 20 of the winning sp80 drop show a pink trail recording the branching route around obstacles and yellow goals changing appearance when filled.

“The pink trail records the branching route around obstacles; yellow goals change appearance when filled.”

May combine two claims.

In Figure 3, 21 games remain at or near ceiling throughout; four games drive the composite differences; sp80 collapses under forced-reset discipline, partially recovers under certify/replay, and reaches 100 after rendered-frame observation is added.

“Gray: the 21 games that remain at or near ceiling throughout.Highlighted: the four games that drive the composite differences; sp80 (red) collapses under forced-reset discipline, partially recovers under certify/replay, and reaches 100 after rendered-frame observation is added.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Kepler's $777.72 is 74.0% below the plotted Tycho estimate; Retrodict and baseline1 occupy cheaper, lower-scoring points.

“Kepler's $777.72 is 74.0%below the plotted estimate.Retrodict and baseline1 occupy cheaper, lower-scoring points.”

May combine two claims.

Replay acceptance does not establish compliance with ARC Prize's evaluation protocol, which limits actions and includes first-exposure exploration.

“ARC Prize's evaluation protocol separately limits actions and includes firstexposure exploration; replay acceptance does not establish compliance with that protocol.”

May combine two claims.

The append-only transition record permits retrospective inspection but does not turn those actions into verified execution.

“The append-only transition record permits retrospective inspection, but does not turn those actions into verified execution.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The authors have not independently rerun that exact historical model.

“We have not independently rerun that exact historical model.”

May combine two claims.

These unmatched full-run aggregates establish neither faster rule discovery nor an isolated harness effect; both exclude complete research spend.

“These unmatched full-run aggregates [11] establish neither faster rule discovery nor an isolated harness effect; both exclude complete research spend.”

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The protocol forbids agent edits to the transition ledger, but this is not a filesystem-enforced immutability guarantee.

“The protocol forbids agent edits to that ledger; this is not a filesystem-enforced immutability guarantee.”

May combine two claims. The quote only partly states this claim.

The ablation comparison was harness-against-harness, so every conclusion drawn from it, including a published claim that 'the harness's net advantage is roughly zero,' is withdrawn.

“The comparison was harness-against-harness, so every conclusion drawn from it, including a published claim that”

Classified as probably not a substantial claim. May combine two claims.

Each release board uses one configuration, a frozen harness, all 25 public games, and one run per game.

“Each release board uses one configuration, a frozen harness, all 25 public games, and one run per game.”

May combine two claims.

Kepler separates discovery, final-attempt execution, and scorecard replay, and these stages consume different resources.

“Kepler separates discovery, final-attempt execution, and scorecard replay.These stages consume different resources.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

This project is an independent implementation.

“This project is an independent implementation.”

Classified as probably not a substantial claim. May combine two claims.

The verifier and server scorecards operate on final replay segments, distinct from the official first-exposure evaluation budget.

“Our verifier and server scorecards operate on final replay segments.This is distinct from the official first-exposure evaluation budget.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

ARC's public replay cards report 7,202 Opus actions and 8,220 GPT actions.

“ARC's public replay cards report 7,202 Opus actions and 8,220 GPT actions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Certification simulates programs and checks click coordinates only when the model exposes init_state, step_state, and outcome; otherwise it degrades to length checks.

“When the model exposes init_state, step_state, and outcome, certification also simulates programs and checks click coordinates; without that API, it degrades to length checks.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Construction and analysis costs are separate.

“construction and analysis costs are separate”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Aguilar Martín shows that sampled prediction accuracy can conceal omitted rules that matter for play, and reports unsuccessful example-based repair in scoped GPT-5.x experiments.

“Aguilar Martín [1] shows that sampled prediction accuracy can conceal omitted rules that matter for play, and reports unsuccessful example-based repair in scoped GPT-5.xexperiments.”

• cites [1]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

These results establish neither held-out generalization nor private-set performance.

“these results establish neither held-out generalization nor private-set performance”

May combine two claims.

The launch CLI retains host filesystem access, so the protocol is not a security sandbox.

“The launch CLI retains host filesystem access, so this is not a security sandbox.”

• Also stated in: § 5 Evaluation integrity and failure cases · plain

  “the launch CLIs retained host filesystem access”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Actual execution used Claude subscription quota; the dollar figure is a reproducible API-price comparison, not a billed charge.

“Actual execution used Claude subscription quota; the dollar figure is a reproducible API-price comparison, not a billed charge.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Retrodict reports 99.86 at $654 / 659.9M tokens; it publishes full traces including superseded attempts, per-game cost ledgers, and an explicit replay disclosure.

“Retrodict (Ryan Brown) [6]; 99.86 at $654 / 659.9M tokens; publishes full traces including superseded attempts, per-game cost ledgers, and an explicit replay disclosure”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Kepler's visual continuation is an observational case, not a controlled replication or refutation of Aguilar Martín's finding.

“Kepler's visual continuation is an observational case, not a controlled replication or refutation of that finding.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The negative development result is separate from the release boards and final-board trace dataset.

“It is separate from the release boards and final-board trace dataset.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The executable-world-model idea is established in published, citable work, including Tycho and Rodionov's baseline1 line.

“The executable-world-model idea itself is established in published, citable work, including Tycho [11] and Rodionov's baseline1 line [17].”

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [17]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Twin also combines agent-written simulators, harness-enforced replay validation, checked execution and goal discovery.

“Twin [16] also combines agent-written simulators, harness-enforced replay validation, checked execution and goal discovery.”

• cites [16]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Visible reset equality does not prove hidden-state equality.

“visible reset equality does not prove hidden-state equality”

May combine two claims.

Retrodict reports 99.86 at $654 and baseline1 reports 99.0 at $400, so Kepler is not the cheapest system at every score.

“Retrodict reports 99.86 at $654 and baseline1 reports 99.0 at $400, so Kepler is not the cheapest system at every score.”

May combine two claims.

Final-board score convergence is concentration at the evaluator ceiling across two frozen model configurations, not faster learning, independent replication, or held-out generalization.

“We call this final-board score convergence: concentration at the evaluator ceiling across two frozen model configurations, not faster learning, independent replication, or held-out generalization.”

• AssumptionRests on an assumption: The server replay is the authoritative and correct scoring mechanism.

May combine two claims.

Model identity is pinned by evidence: the Claude boards' session transcripts resolve to claude-opus-5 (46,749 records across the three boards), and the GPT boards ran gpt-5.6-sol.

“Model identity is pinned by evidence, not by alias: the Claude boards' session transcripts resolve to claude-opus-5 (46,749 records across the three boards), and the GPT boards ran gpt-5.6-sol.”

May combine two claims.

ARC Prize reports 62.71 under its provider-neutral Standard interface and 99.95 using a Provider Adapter on the semi-private set.

“ARC Prize reports 62.71 under its provider-neutral Standard interface and 99.95 using a Provider Adapter on the semi-private set [4].”

• cites [4]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The release uses one configuration across games, without game-ID dispatch.

“The release uses one configuration across games, without game-ID dispatch.”

May combine two claims.

The replay path selects the last full-reset-to-end ledger segment, omits its recorded opening reset, and lets the server count a new opening reset, so the different recorded denominators are not score disagreements.

“These are different recorded denominators, not score disagreements: the replay path selects the last full-reset-to-end ledger segment, omits its recorded opening reset, and lets the server count a new opening reset.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Quota-shaped runs were resumed across provider windows under a disclosed policy.

“quota-shaped runs resumed across provider windows under a disclosed policy”

Classified as probably not a substantial claim. May combine two claims.

Each stage after the initial loop was frozen by commit hash registered in RESULTS.md before its board's results existed, and each ran as a complete single-configuration board and is retained, including the stage that made things worse.

“Each stage after the initial loop was frozen by commit hash registered in RESULTS.mdbefore its board's results existed; each ran as a complete single-configuration board and is retained, including the stage that made things worse.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Tycho's paper reports inference costs, budget-prefix curves and model diagnostics; its repository includes configurations, tests, scorecards and aggregate metrics.

“Its paper reports inference costs, budget-prefix curves and model diagnostics; the repository includes configurations, tests, scorecards and aggregate metrics.”

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The investigator knew the historical mechanic.

“The investigator knew the historical mechanic”

Probably not a substantial claim: may not pass S3 (load-bearing).

Retrodict's comparison memo critiqued early releases, including the selection rules Kepler subsequently changed.

“Its comparison memo critiqued early releases, including the selection rules Kepler subsequently changed.”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Tycho reports 100.00 with two models and compares four model-use policies under matched budgets.

“Tycho (NIMI-research; arXiv:2607.28287)[11] reports 100.00 with two models and compares four model-use policies under matched budgets.”

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The official budget was real; the local guard regression did not invalidate it.

“The official budget was real; our local guard regression did not invalidate it ( §3.1).”

May combine two claims.

These shared mechanisms are not unique to Kepler; the release and behavioral evidence must be assessed separately from algorithmic novelty.

“These shared mechanisms are not unique to Kepler; our release and behavioral evidence must be assessed separately from algorithmic novelty.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The negative development result is not an independent-case evaluation or a new discovery algorithm.

“This negative development result is not an independent-case evaluation or a new discovery algorithm.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A CI gate scans agent-visible files for literal game identifiers and fails on a hit, but this does not prove the absence of encoded game knowledge or model-training exposure.

“A CI gate scans agent-visible files for literal game identifiers and fails on a hit.This check does not prove the absence of encoded game knowledge or model-training exposure.”

May combine two claims.

The first ∼99%-class numbers on this benchmark were self-reported from write-ups without released code, using a per-game best-of-2 fallback with score feedback.

“The first ∼99%-class numbers on this benchmark were self-reported from write-ups without released code, using a per-game best-of-2 fallback with score feedback”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Model identity is pinned by the session transcripts.

“Model identity is pinned by the session transcripts”

May combine two claims.

Execution halts on detected prediction mismatches and daemon errors, but missing or empty predictions do not establish verified execution.

“Execution halts on detected prediction mismatches and daemon errors, but missing or empty predictions do not establish verified execution.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Selection and execution used no additional model call.

“Selection and execution used no additional model call.”

May combine two claims.

Tycho's own paper now reports approximately $2.99k for its Opus 5 run, with token-category accounting and budget-prefix curves.

“Tycho's own paper now reports approximately $2.99k for its Opus 5 run, with token-category accounting and budget-prefix curves [11].”

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The structural fix moved environment files outside every workspace, reducing accidental discovery, but did not make them unreadable.

“The structural fix moved environment files outside every workspace, reducing accidental discovery, but did not make them unreadable: the launch CLIs retained host filesystem access, and the audit flags any recorded access.”

May combine two claims.

The remaining failures occur where the agent never discovers a necessary mechanic; once a correct solution program exists, mechanical execution is reliable.

“It does show where the remaining failures occur: once a correct solution program exists, mechanical execution is reliable; the difficult cases are those where the agent never discovers a necessary mechanic.”

• AssumptionRests on an assumption: The server replay is the authoritative and correct scoring mechanism.

May combine two claims.

The authors cannot inspect the providers' training corpora and therefore cannot rule out model-level exposure to the public games.

“We cannot inspect the providers' training corpora and therefore cannot rule out model-level exposure to the public games.”

Classified as probably not a substantial claim.

Whether the harness causes the scores, versus the models alone, is unmeasured until a boundary-correct ablation is run.

“whether the harness causes the scores, versus the models alone, is unmeasured until a boundary-correct ablation is run”

May combine two claims.

The release adds coordinate checks, but clean-run certification applies them only in the threaded-model branch; this is not universal transport enforcement.

“The release adds coordinate checks, although clean-run certification applies them only in the threaded-model branch; this is not universal transport enforcement.”

May combine two claims.

These sessions shared accumulated notes and models; they are not independent trials.

“These sessions shared accumulated notes and models; they are not independent trials.”

May combine two claims.

Without a matched fresh text-only control, these observations do not establish that vision was necessary or isolate its effect on discovery cost.

“Without a matched fresh text-only control, these observations do not establish that vision was necessary or isolate its effect on discovery cost.”

Classified as probably not a substantial claim. May combine two claims.

A replayed scorecard alone does not establish how a system discovered its solution or whether it used an executable world model.

“a replayed scorecard alone does not establish how a system discovered its solution or whether it used an executable world model.”

Probably not a substantial claim: may not pass S4 (based).

Direct-interaction systems can produce replayable traces as well.

“Direct-interaction systems can produce replayable traces as well.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The score saturation is not a measure of learning speed.

“This is not a measure of learning speed.”

Probably not a substantial claim: may not pass S3 (load-bearing).

No new logs or private researcher archives are added by this revision.

“No new logs or private researcher archives are added by this revision.”

May combine two claims.

The replay-scored segmentation spans both the world-model and direct-interaction schools; the convergence is about what is scored, not how games are learned.

“First, the replay-scored segmentation of §6.2 spans both schools; the convergence is about what is scored, not how games are learned.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Provider-session records used for token repricing are retained privately and are not in the public export; the cost command therefore requires additional input.

“Provider-session records used for token repricing are retained privately and are not in the public export; the cost command therefore requires additional input.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

baseline1 / ThinHarness is the minimal-agent lineage Retrodict builds on and is used throughout the field as the null scaffold.

“baseline1 / ThinHarness [17]; the minimal-agent lineage Retrodict builds on; used throughout the field as the null scaffold.”

• cites [17]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

NVIDIA's AVO adopted VISTA's direct-interaction principles and reported 100.00 with a supervisor-redirected general coding agent and 6,624 environment actions, lower than VISTA's 7,542.

“NVIDIA's AVO [12] adopted VISTA's direct-interaction principles (explicitly declining Tycho-style programmatic world models) and reported 100.00 with a supervisorredirected general coding agent and 6,624 environment actions, lower than VISTA's 7,542.”

• cites [12]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

VISTA reported 100.00 (Claude Opus 5, 7,542 actions) and 98.27 (GPT-5.6Sol) using the direct-interaction architecture.

“VISTA [9] (Han et al., MIT) reported 100.00 (Claude Opus 5, 7,542 actions) and 98.27 (GPT-5.6Sol) using the opposite architecture to the world-model school”

• cites [9]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The corpus includes 95 captured CLI logs with uneven coverage, not a complete account of every internal event.

“The corpus includes 95 captured CLI logs with uneven coverage, not a complete account of every internal event.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Headline scorecards are c9f087f3 (GPT, exact) and 91aa2f10 (Opus, exact).

“Headline scorecards are c9f087f3 (GPT, exact) and 91aa2f10 (Opus, exact).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Prime Intellect reports three Opus 5 runs at 94.99-95.50, with a 95.24 median scorecard and estimated costs of $944-1,288.

“Prime Intellect reports three Opus 5 runs at 94.99-95.50,with a 95.24 median scorecard and estimated costs of $944-1,288.”

• cites [15]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

After downloading the dataset, both board scores and their ledger consistency can be checked offline.

“After downloading it, both board scores and their ledger consistency can be checked offline”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Kepler's harness can retain animation frames with -visual; a continuation also inherited earlier learning.

“Our harness can retain animation frames with -visual; §4.4 reports a continuation that also inherited earlier learning.”

May combine two claims.

AVO does not publish an ARC implementation, traces, or cost accounting; VISTA publishes a project page and official replay evidence but not a directly comparable cost ledger.

“AVO does not publish an ARC implementation, traces, or cost accounting; VISTA publishes a project page and official replay evidence but not a directly comparable cost ledger.”

• cites [9]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [12]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Broader systems require domain-specific comparators and explicit handling of stochasticity; a syntactic trace check is not semantic validation.

“Broader systems require domain-specific comparators and explicit handling of stochasticity; a syntactic trace check is not semantic validation.”

May combine two claims.

Pending community-leaderboard entries converged on the same architecture: GKM freezes model-written programs behind an admission gate and states that at scoring time no model runs; arc-skill's scorecard was produced by replaying the recorded runs; Strands and arc-skill both run Claude Opus 5.

“While this paper was in preparation, the pending community-leaderboard entries converged on the same architecture claim (1) describes: GKM freezes model-written programs behind an admission gate and states “at scoring time no model runs”; arc-skill's scorecard “was produced by replaying the recorded runs”; Strands and arc-skill both run Claude Opus 5, the model our boards resolve to.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Earlier stages, failures, and superseded runs remain documented in RESULTS.md and the incident archive, but are not part of the final-board dataset.

“Earlier stages, failures, and superseded runs remain documented in RESULTS.md and the incident archive, but are not part of this final-board dataset.”

May combine two claims.

arc-code is a minimal-scaffold datapoint: stock Claude Code with an 11-line prompt reaches 96.2 pass@1 / 99.3 pass@2 (∼$540), while GPT-5.6Sol under the same scaffold scores 73.7.

“arc-code (Berman) [5]; the minimal-scaffold datapoint: stock Claude Code with an 11-line prompt reaches 96.2 pass@1 / 99.3 pass@2 (∼$540), while GPT-5.6Sol under the same scaffold scores 73.7.”

• cites [5]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

The sp80 visual case motivates a matched observation study, not a claim of isolated or benchmark-wide visual advantage.

“This case motivates a matched observation study, not a claim of isolated or benchmark-wide visual advantage.”

May combine two claims.

The two schools have never been compared under controlled conditions; the observation channel is confounded with everything else.

“Second, the schools have never been compared under controlled conditions (AVO: “this is not a controlled ablation”); the observation channel (text grid vs. rendered frames) is confounded with everything else.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

These are observed frames, not simulator predictions; they illustrate the discovered mechanic, not a matched visual advantage or a new held-out result.

“These are observed frames, not simulator predictions.They illustrate the discovered mechanic, not a matched visual advantage or a new held-out result.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

These failure classes motivate checks in other agent settings, but empirical transfer beyond this benchmark is not established.

“These failure classes motivate checks in other agent settings, but empirical transfer beyond this benchmark is not established.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

This cuts against attributing Kepler's Claude score entirely to harness design and reinforces the need for a valid control experiment.

“This cuts against attributing Kepler's Claude score entirely to harness design and reinforces the need for a valid control experiment.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The public companion dataset contains the two final 25-game boards.

“The public companion dataset contains the two final 25-game boards.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The integrity scan applies to the published records and its fixed pattern set; it cannot prove that a client retained every event or detect every possible violation.

“The integrity scan applies to the published records and its fixed pattern set; it cannot prove that a client retained every event or detect every possible violation.”

Classified as probably not a substantial claim. May combine two claims.

Replay verification and solution discovery are distinct stages; a replayed scorecard does not identify the discovery architecture.

“Replay verification and solution discovery are distinct stages; a replayed scorecard does not identify the discovery architecture.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Kepler reports a higher single-board score; Prime Agent makes the broader transfer claim across coding and long-context tasks.

“Kepler reports a higher single-board score; Prime Agent makes the broader transfer claim across coding and long-context tasks.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Grid-level equality checks and exact replay rely on discrete observations and sufficiently reproducible transitions.

“Grid-level equality checks and exact replay rely on discrete observations and sufficiently reproducible transitions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Pricing and accounting methods differ, so these selected disclosures are not a controlled efficiency experiment.

“Pricing and accounting methods differ, so these selected disclosures are not a controlled efficiency experiment.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The IAB review package was PDF-only, distinct from the already-public dataset.

“The IAB review package was PDF-only, distinct from the already-public dataset.”

May combine two claims.

The dataset contains 50 run records and 58,098 environment events in append-only ledgers, along with human baselines, final world models and notebooks, captured CLI output for every final-board workspace, and dependency-free verification programs.

“The dataset contains 50 run records and 58,098 environment events in append-only ledgers, along with human baselines, final world models and notebooks, captured CLI output for every final-board workspace, and dependency-free verification programs.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Prime Agent is a general-purpose, self-improving coding harness adapted to ARC-AGI-3 through its task prompt and broker.

“Prime Agent [15,10]; a general-purpose, self-improving coding harness adapted to ARC-AGI-3 through its task prompt and broker.”

• cites [15]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The development continuation predates the frozen release board.

“The development continuation predates the frozen release board.”

May combine two claims.

The code, official scorecards, release manifest, and verification programs ship in the repository.

“The code, official scorecards, release manifest, and verification programs ship in the repository.”

May combine two claims.

Bit-for-bit reproduction of live runs is not expected because of sampling and provider drift; score reproduction from a published ledger is mechanical.

“Bit-for-bit reproduction of live runs is not expected because of sampling and provider drift; score reproduction from a published ledger is mechanical.”