The ARC of Progress towards AGI: A Living Survey of Abstraction and Reasoning

ARC tasks are designed to be solvable by humans without specialized knowledge, using only core knowledge priors.

“Crucially, tasks are designed to be solvable by humans without specialized knowledge, using only core knowledge priors”

• cites Chollet 2019 sourceSupported
• cites Chollet et al. 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

ARC-AGI has become a key benchmark for fluid intelligence in AI.

“The Abstraction and Reasoning Corpus (ARC-AGI) has become a key benchmark for fluid intelligence in AI.”

• cites Chollet 2019 sourcePartly supported

  The Abstract (p. 1) presents ARC as a benchmark designed to measure a human-like form of general fluid intelligence, and §III.1.3 (p. 50) says it assesses fluid intelligence through reasoning and abstraction. The paper introduces ARC as a new benchmark; it does not establish that ARC had become a key benchmark in AI. (LLM, conf=0.83)

  Experimental — accuracy not yet measured

The original ARC-AGI-1 corpus comprises 1,000 tasks divided into 400 training, 400 evaluation, and 200 private test tasks.

“The original corpus of 1,000 program-induction tasks (400 training, 400 evaluation, 200 test) established the benchmark [Chollet 2019].”

• cites Chollet 2019 sourceSupported

ARC-AGI measures fluid intelligence, the ability to solve novel problems using minimal prior knowledge and few examples.

“ARC-AGI addresses this by measuring fluid intelligence, the ability to solve novel problems using minimal prior knowledge and few examples.”

• cites Chollet 2019 sourceSupported

Wang's hierarchical neural approach shows the sharpest decline from 40.3% on ARC-AGI-1 to 5% on ARC-AGI-2.

“Wang's hierarchical neural approach shows the sharpest decline (40.3% → 5%), suggesting that pure neural methods fail earliest as compositional demands increase [Wang et al. 2025].”

• cites Wang et al. 2025 sourceSupported

Pure neural methods fail earliest as compositional demands increase.

“suggesting that pure neural methods fail earliest as compositional demands increase [Wang et al. 2025].”

• cites Wang et al. 2025 sourcePartly supported

  Section 3.1 describes ARC-AGI-2 as demanding deeper compositional reasoning than ARC-AGI-1, and the paper’s reported results show the direct-prediction Transformer baseline falling from 21.0% to 0.0% accuracy. That supports the narrower point that one neural baseline struggles as compositional demands increase. The paper does not establish that pure neural methods generally fail earliest; its own HRM is a neural model that retains some performance on ARC-AGI-2. Page numbers are unavailable in our copy. (LLM, conf=0.83)

  Experimental — accuracy not yet measured

The top AI system (StochasticGoose, CNN-based reinforcement learning) achieved 12.58% action efficiency on ARC-AGI-3.

“The top AI system (Stochas-ticGoose, CNN-based reinforcement learning) achieved 12.58% action efficiency”

• cites Kamradt 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The Tiny Recursive Model (TRM) achieved 45% on ARC-AGI-1 with only 7M parameters through recursive latent refinement.

“the Tiny Recursive Model (TRM) by Jolicoeur-Martineau achieved 45% on ARC-AGI-1 with only 7M parameters through recursive latent refinement [Jolicoeur-Martineau 2025]”

• cites Jolicoeur-Martineau 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

GPT-5.2Pro reaches 90.5% on ARC-AGI-1 at $11.64/task.

“GPT-5.2Pro at 90.5% ($11.64/task)”

• cites ARC Prize Foundation 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Analysis of consistently failing approaches reveals anti-patterns that predict poor performance regardless of implementation quality.

“Conversely, analysis of consistently failing approaches reveals anti-patterns that predict poor performance regardless of implementation quality (Table 5).”

Frontier models narrow the ARC-AGI-1 to ARC-AGI-2 gap only through orders-of-magnitude cost increases.

“frontier models narrow the ARC-AGI-1 to ARC-AGI-2 gap only through orders-of-magnitude cost increases”

Even the most efficient frontier models remain 20-40× more expensive than human cognitive effort.

“even the most efficient frontier models remain 20-40× more expensive than human cognitive effort (Section 4.2)”

• AssumptionRests on an assumption: Human cognitive effort cost is a valid comparator for AI cost per task.

An NYU study found that an average Mechanical Turk worker solves 77% of the ARC-AGI-1 public evaluation tasks.

“NYU published a study assessing Mechanical Turk workers, which showed an average worker solves 77% of the ARC-AGI-1 public evaluation tasks [ARC Prize Foundation 2025a;LeGris et al. 2024].”

• cites ARC Prize Foundation 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites LeGris et al. 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Each breakthrough on one ARC-AGI version has substantially lower performance on a higher version.

“Each breakthrough on one version has substantially lower performance on a higher version”

ARC Prize 2025 winners needed hundreds of thousands of synthetic examples to reach 24% on ARC-AGI-2.

“ARC Prize 2025 winners needed hundreds of thousands of synthetic examples to reach 24% on ARC-AGI-2”

Kaggle-constrained entries (660M-8B) achieve competitive results.

“while Kaggle-constrained entries (660M-8B) achieve competitive results”

Under Kaggle resource constraints the best systems drop to 16-24% on ARC-AGI-2.

“while under Kaggle resource constraints the best systems drop to 16-24% on ARC-AGI-2”

Program synthesis, neuro-symbolic, and neural approaches all exhibit 2-3× drops from ARC-AGI-1 to ARC-AGI-2.

“program synthesis, neuro-symbolic, and neural approaches all exhibit 2-3× drops from ARC-AGI-1 to ARC-AGI-2”

Test-time adaptation and refinement loops are critical success factors.

“Test-time adaptation and refinement loops emerge as critical success factors”

Performance degradation across ARC-AGI versions is consistent across all paradigms.

“Our central finding is that performance degradation across versions is consistent across all paradigms: program synthesis, neuro-symbolic, and neural approaches all exhibit 2-3× drops from ARC-AGI-1 to ARC-AGI-2, indicating fundamental limitations in compositional generalization.”

Opus 4.6 reaches 93.0% on ARC-AGI-1.

“systems now reach 93.0% on ARC-AGI-1 (Opus 4.6)”

• cites ARC Prize Foundation 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Under Kaggle resource constraints, the best system (NVARC) achieved only 24% on ARC-AGI-2.

“under Kaggle resource constraints the best system (NVARC) achieved only 24% [ARC Prize Foundation 2025b]”

• cites ARC Prize Foundation 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Cost per task spans five orders of magnitude across systems.

“Cost per task spans five orders of magnitude across systems”

Cost efficiency varies dramatically and non-monotonically with performance.

“Second, cost efficiency varies dramatically and non-monotonically with performance (Table 3).”

CompressARC reached 20-34% with merely 76K parameters using MDL-based compression.

“CompressARC by Liao and Gu reached 20-34% with merely 76K parameters using MDL-based compression [Liao and Gu 2025a].”

• cites Liao and Gu 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The performance cliff occurs consistently across all paradigms.

“This performance cliff is particularly significant because it occurs consistently across all paradigms.”

Each ARC-AGI-2 task is solved by roughly 75% of individual participants.

“each ARC-AGI-2 task is solved by roughly 75% of individual participants [Chollet et al. 2025b]”

• cites Chollet et al. 2025b sourceNot checked — no full text of the source

Opus 4.6 performance falls to 68.8% on ARC-AGI-2.

“performance falls to 68.8% on ARC-AGI-2”

• cites ARC Prize Foundation 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Gemini 3 Deep Think leads ARC-AGI-2 at 84.6% ($13.62/task).

“Gemini 3 Deep Think leads at 84.6% ($13.62/task)”

• cites ARC Prize Foundation 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Analysis of systems exceeding 70% on ARC-AGI-1 reveals six empirically-observed characteristics that correlate strongly with high performance.

“Analysis of systems exceeding 70% on ARC-AGI-1 reveals six empirically-observed characteristics that correlate strongly with high performance (Table 4).”

These patterns are not strict requirements but recur across all top-performing architectures regardless of paradigm.

“These patterns are not strict requirements but recur across all top-performing architectures regardless of paradigm.”

Within-paradigm variance often exceeds between-paradigm differences.

“However, within-paradigm variance often exceeds between-paradigm differences.”

Performance falls to 13% on ARC-AGI-3.

“13% on ARC-AGI-3”

• cites Kamradt 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

For five years, ARC-AGI-1 resisted most AI approaches, with performance remaining below 20% until 2024.

“For five years, ARC-AGI-1 successfully resisted most AI approaches, with performance remaining below 20% until 2024.”

The top open-source system (ARChitects) achieved 53.5% through test-time training.

“The top open-source system (ARChitects) achieved 53.5% through test-time training”

• cites Kamradt 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The ARC-AGI-3 preview released six games (three public, three private holdout).

“The preview released six games (three public, three private holdout).”

• cites Kamradt 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Systems evaluated comprehensively on ≥100 tasks show mean performance approximately 27 percentage points lower than those evaluated on <100 tasks (38.8% vs 65.6%).

“Systems evaluated comprehensively on ≥100 tasks show mean performance approximately 27 percentage points lower than those evaluated on <100 tasks (38.8% vs 65.6%).”

GPT-5.2Pro drops to 54.2% on ARC-AGI-2.

“GPT-5.2Pro drops to 54.2% on ARC-AGI-2”

Opus 4.6 shows the smallest single-model drop (-26%, from 93.0% to 68.8%), compared to Opus 4.5 (-53%) and GPT-5.2Pro (-40%).

“Notably, Opus 4.6 shows the smallest single-model drop (-26%, from 93.0% to 68.8%), compared to its predecessor Opus 4.5 (-53%) and GPT-5.2Pro (-40%).”

ARC-AGI-2, introduced in late 2024, has seen its best rigorous score reach 68.8% (Opus 4.6, 2026).

“ARC-AGI-2, introduced in late 2024, has seen its best rigorous score reach 68.8% (Opus 4.6, 2026).”

Limited transparency in reporting practices prevents reproducibility.

“limited transparency in reporting practices that prevents reproducibility”

Berman's shift from code to natural language evolution achieved 26 percentage point gains with minimal cost increase.

“Berman's shift from code to natural language evolution achieved 26 percentage point gains with minimal cost increase.”

TRM reaches 6.3% on ARC-AGI-2 with just 7M parameters.

“TRM reaches 6.3% on ARC-AGI-2 with just 7M parameters”

GPT-5.2Pro achieved 54.2% on ARC-AGI-2 at $15.72/task.

“By December 2025, GPT-5.2Pro achieved 54.2% on ARC-AGI-2 at $15.72/task [ARC Prize Foundation 2025a]”

• cites ARC Prize Foundation 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

When restricted to ≥100 tasks, only six systems achieve ≥75%.

“When restricted to ≥100 tasks, only six systems achieve ≥75%: Huang (75%/400), Pang (77.1%/100),Kolev (78.8%/100),Berman (79.6%/100)Bonnet (80%/100), and Google Gemini (87.5%/100).”

Under Kaggle resource constraints, the best systems achieve only 24% on ARC-AGI-2.

“Under Kaggle resource constraints, the best systems achieve only 24% on ARC-AGI-2 [ARC Prize Foundation 2025a,b].”

• cites ARC Prize Foundation 2025a,bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Examining how top-performing systems evolved reveals three paradigm-level trajectories.

“Examining how top-performing systems evolved reveals three paradigm-level trajectories”

Only 9 of 80 papers (11%) report both cost and performance.

“only 9 of 80 papers (11%) report both cost and performance”

ARC-AGI-2 performance shows 2.5-3× degradation compared to ARC-AGI-1, regardless of approach type or implementation quality.

“ARC-AGI-2 performance shows 2.5-3× degradation compared to ARC-AGI-1, regardless of approach type or implementation quality.”

Adherence to evaluation protocols varies dramatically.

“However, adherence varies dramatically.”

• AssumptionRests on an assumption: ARC-AGI standard evaluation protocols specify exact match scoring, maximum two attempts per task, held-out test sets, and separate public/private reporting.

MindsAI progressed from 5% zero-shot to 58% through test-time fine-tuning combined with AIRV, a 680% improvement.

“MindsAI progressed from 5% zero-shot to 58% through test-time fine-tuning combined with Augment Inference Reverse-Augmentation and Vote (AIRV), a 680% improvement”

Pang's library approach ($3.97, 77.1%) outperforms systems costing 10× more.

“Pang's library approach ($3.97, 77.1%) outperforms systems costing 10× more”

There is an 80% transparency gap in reporting public and private scores.

“a 80% transparency gap”

Papers apply different test-time adaptation practices without consistent reporting.

“apply different test-time adaptation practices without consistent reporting”

The LLM ARChitect system achieved 72.5% under strict Kaggle constraints (2×T4 GPUs, 12 hours) through systematic optimization.

“The LLM ARChitect system achieved 72.5% under strict Kaggle constraints (2×T4 GPUs, 12 hours) through systematic optimization”

Papers use varying evaluation sets (standard 400-task vs custom subsets).

“use varying evaluation sets (standard 400-task vs custom subsets)”

Many highly-cited >80% results derive from <10 task evaluations.

“many highly-cited >80% results derive from <10 task evaluations”

On ARC-AGI-1, the rigorous maximum rose from 39.0% (Icecuber, 2020, public) to 93.0% (Opus 4.6, 2026, semi-private).

“On ARC-AGI-1, the rigorous maximum rose from 39.0% (Icecuber, 2020, public) to 93.0% (Opus 4.6, 2026, semi-private).”

Only 15 of 80 papers report ARC-AGI-2 performance.

“only 15 of 80 papers report performance”

ARC-AGI-2's primary difference from ARC-AGI-1 is increased compositional complexity: average transformation depth increases from 1.3 to 2.7 steps.

“ARC-AGI-2's primary difference from ARC-AGI-1 lies in increased compositional complexity: average transformation depth increases from 1.3 to 2.7 steps”

The low-cost regime (<$1/task) achieves approximately 40% through efficient methods like small fine-tuned models or constraint-based synthesis.

“The low-cost regime (<$1/task) achieves approximately 40% through efficient methods like small fine-tuned models or constraint-based synthesis.”

The public-private gap shows 10-20% drops.

“The public-private gap (Figure 12) shows 10-20% drops”

Pure inductive approaches span from 2% to 79.3% on ARC-AGI-1.

“pure inductive approaches span from 2% to 79.3%”

Neural approaches during 2019-2023 consistently underperformed, rarely exceeding 5% accuracy.

“Neural approaches during this period consistently underperformed, rarely exceeding 5% accuracy”

On ARC-AGI-1, trillion-scale models vary widely in both score and cost.

“On ARC-AGI-1, trillion-scale models vary widely in both score and cost: Opus 4.6 reaches 93.0% at $1.88/task, GPT-5.2Pro scores 90.5% at $11.64/task, and Grok 4 scores 66.7% at $1.01/task.”

The cost-performance landscape exhibits three distinct regimes characterized by different scaling behaviors and economic viability.

“The cost-performance landscape, visualized in Figure 9, exhibits three distinct regimes characterized by different scaling behaviors and economic viability.”

The relative drops in ARC-AGI-2 performance across six systems range from 23% (Land) to 77% (MindsAI).

“The relative drops range from 23% (Land) to 77% (MindsAI)”

Systematic biases inflate reported performance.

“systematic biases that inflate reported performance”

Larger models do not proportionally outperform smaller ones on abstract reasoning tasks.

“larger models do not proportionally outperform smaller ones on abstract reasoning tasks”

The ARC Prize 2025 competition revealed a unifying theme: refinement loops-iterative cycles of generation, verification, and correction.

“The ARC Prize 2025 competition [ARC Prize Foundation 2025b] revealed a unifying theme: refinement loops-iterative cycles of generation, verification, and correction.”

• cites ARC Prize Foundation 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

OpenAI's o3 achieved 87.5% on ARC-AGI-1 through massive test-time search in December 2024.

“December 2024 marked another inflection point with OpenAI's announcement of o3, achieving 87.5% on ARC-AGI-1 through massive test-time search.”

ANPL drops from 75% on ARC-AGI-1 to near-zero on harder variants with no intermediate attempts or partial solutions.

“ANPL drops from 75% on ARC-AGI-1 to near-zero on harder variants with no intermediate attempts or partial solutions.”

Substantial gaps in generalization assessment obscure true capability levels.

“substantial gaps in generalization assessment that obscure true capability levels”

Neural approaches show the sharpest ARC-AGI-2 degradation (Wang: 40.3%→5%; ARChitect: 72.5%→2.5%).

“neural approaches show the sharpest ARC-AGI-2 degradation (Wang: 40.3%→5%;ARChitect: 72.5%→2.5%)”

There is a 390× efficiency gain from o3 ($4,500/task, 87.5%) to GPT-5.2 Pro ($11.64/task, 90.5%).

“The 390× efficiency gain from o3 ($4,500/task, 87.5%) to GPT-5.2 Pro ($11.64/task, 90.5%)”

Only 13 of 66 papers report both public and private scores.

“only 13 of 66 papers report both”

The competition's top performer, MindsAI, achieved 55.5% through test-time fine-tuning combined with inference-time augmentation.

“The competition's top performer, MindsAI, achieved 55.5% through test-time fine-tuning combined with inference-time augmentation.”

Only 3 systems report both public and private scores on ARC-AGI-1.

“only 3 systems report both”

Pure neural approaches declined after demonstrating consistent 20% ceilings.

“Pure neural approaches declined after demonstrating consistent 20% ceilings.”

Gains on ARC-AGI-1 do not robustly translate to deeper compositions.

“It revealed that gains on ARC-AGI-1 do not robustly translate to deeper compositions.”

ARC-AGI-3 best performance is 13% versus 100% human baseline.

“best performance of 13% versus 100% human baseline”

The human baseline occupies the high-efficiency region that no AI system yet approaches.

“The human baseline (star) occupies the high-efficiency region that no AI system yet approaches.”

The Pareto frontier shows steep diminishing returns above $2/task.

“The Pareto frontier (dashed) shows steep diminishing returns above $2/task.”

The 2024 phase transition shows performance improving more in six months than the previous five years.

“The 2024 phase transition shows performance improving more in six months than the previous five years.”

The performance cliff persists across all systems: even the best public entry drops 23% from ARC-AGI-1 to ARC-AGI-2.

“The performance cliff persists across all systems: even the best public entry drops 23% from ARC-AGI-1 to ARC-AGI-2”

Current improvements reflect computational investment rather than compositional generalization.

“suggesting that current improvements reflect computational investment rather than compositional generalization”

Test-time training on individual puzzles, rather than massive pretraining, enables efficient reasoning on novel tasks.

“Both approaches demonstrate that test-time training on individual puzzles, rather than massive pretraining, enables efficient reasoning on novel tasks.”

The 2.5-3× performance degradation across all AI paradigms indicates fundamental limitations in compositional generalization rather than paradigm-specific weaknesses.

“This 2.5-3× performance degradation across all AI paradigms indicates fundamental limitations in compositional generalization rather than paradigm-specific weaknesses (Section 4).”

ARC-AGI fundamentally differs from conventional AI benchmarks.

“The Abstraction and Reasoning Corpus fundamentally differs from conventional AI benchmarks.”

Breakthroughs on MMLU, HLE, and mathematical olympiads have been achieved through scaling rather than novel reasoning mechanisms.

“breakthroughs on MMLU, HLE, and mathematical olympiads have been achieved through scaling rather than novel reasoning mechanisms [Phan et al. 2025]”

• cites Phan et al. 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The transformation from near-zero to near-human performance on ARC-AGI-1 came from a paradigm shift away from massive pre-training and toward test-time compute.

“The transformation from near-zero to near-human performance on ARC-AGI-1 came from a paradigm shift away from massive pre-training and toward test-time compute.”

These findings motivated ARC-AGI-2's design.

“These findings motivated ARC-AGI-2's design [Chollet et al. 2025b].”

• cites Chollet et al. 2025b sourceNot checked — no full text of the source

The cross-paradigm consistency indicates a shared fundamental limitation in compositional reasoning capabilities rather than a weakness of any particular architectural choice.

“This cross-paradigm consistency indicates a shared fundamental limitation in compositional reasoning capabilities rather than a weakness of any particular architectural choice.”

Test-time training on individual puzzles, where all task-specific learning happens at inference time, can outperform pretrained models.

“Both demonstrate that test-time training on individual puzzles, where all task-specific learning happens at inference time, can outperform pretrained models.”

This 70% relative inflation indicates that many reported high scores come from cherry-picked subsets or insufficient statistical samples rather than robust generalization.

“This 70% relative inflation indicates that many reported high scores come from cherry-picked subsets or insufficient statistical samples rather than robust generalization.”

The cross-version performance degradation indicates fundamental limitations in compositional generalization.

“indicating fundamental limitations in compositional generalization”

This shift addresses a critical limitation of static benchmarks: they test whether systems can recognize patterns but not whether they can discover them through active learning.

“This shift addresses a critical limitation of static benchmarks: they test whether systems can recognize patterns but not whether they can discover them through active learning.”

Static evaluation is insufficient for measuring general intelligence.

“Principle 3. Static evaluation is insufficient for measuring general intelligence.”

ARC-AGI-3 challenges systems with interactive mini-games where rules and goals must be discovered through autonomous exploration.

“it challenges systems with interactive mini-games where rules and goals must be discovered through autonomous exploration.”

ARC-AGI-3 shifts to interactive environments requiring additional capabilities beyond the six static-reasoning categories.

“ARC-AGI-3 shifts to interactive environments requiring additional capabilities beyond these categories”

The ARC-AGI-3 preview represents a fundamental reconceptualization of intelligence evaluation.

“The ARC-AGI-3 preview (July 2025) represents a fundamental reconceptualization of intelligence evaluation [Kamradt 2025;Ying et al. 2025].”

• cites Kamradt 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Ying et al. 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The 390× cost reduction largely reflects reduced test-time parallelism rather than fundamentally more efficient reasoning.

“although this largely reflects reduced test-time parallelism”

• cites Chollet 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The 30-60 percentage point gap between unconstrained and constrained regimes suggests that current progress reflects computational investment as much as architectural insight.

“The 30-60 percentage point gap between unconstrained and constrained regimes suggests that current progress reflects computational investment as much as architectural insight.”

Current AI evaluations predominantly measure crystallized intelligence, the ability to apply memorized skills to familiar problems.

“Current AI evaluations predominantly measure crystallized intelligence, the ability to apply memorized skills to familiar problems.”

Algorithmic innovation, particularly refinement loops and test-time adaptation, provides far greater efficiency gains than scaling compute alone.

“revealing that algorithmic innovation, particularly refinement loops and test-time adaptation, provides far greater efficiency gains than scaling compute alone”

The variation in ARC-AGI-2 task solve rates reflects task difficulty variation rather than fundamental human limitations.

“reflecting task difficulty variation rather than fundamental human limitations”

Parameter-efficient approaches such as TRM (7M parameters) and CompressARC (76K parameters) demonstrate that competitive performance need not require massive scale.

“parameter-efficient approaches such as TRM (7M parameters) and CompressARC (76K parameters) demonstrate that competitive performance need not require massive scale [Jolicoeur-Martineau 2025;Liao and Gu 2025a].”

• cites Jolicoeur-Martineau 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Liao and Gu 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Reasoning remains knowledge-bound.

“confirming that reasoning remains knowledge-bound”

Addressing compositional generalization likely requires mechanisms for hierarchical decomposition rather than sequential chaining.

“Addressing compositional generalization likely requires mechanisms for hierarchical decomposition rather than sequential chaining.”

Test-time adaptation is essential rather than auxiliary for ARC-AGI performance.

“validating this technique as essential rather than auxiliary.”

Neither scaling nor year-over-year improvements resolve compositional generalization.

“neither scaling nor year-over-year improvements resolve compositional generalization”

Compositional generalization represents the binding constraint on current approaches.

“Compositional generalization, the ability to systematically recombine known primitives in novel ways, represents the binding constraint on current approaches.”

Implementation quality often matters more than architectural category for pure inductive approaches.

“indicating that implementation quality often matters more than architectural category.”

AI systems require 10×-100× human cognitive costs for comparable performance.

“so AI systems require 10×-100× human cognitive costs for comparable performance.”

Competition-verified results provide the most reliable estimates through independent evaluation, hidden test sets, and standardized budgets.

“Competition-verified results provide the most reliable estimates through independent evaluation, hidden test sets, and standardized budgets.”

Without mechanisms to prune search spaces through principled abstraction, the exponential growth of hypothesis spaces overwhelms computational budgets.

“Without mechanisms to prune search spaces through principled abstraction, the exponential growth of hypothesis spaces overwhelms computational budgets.”

No current system demonstrates robust symbol grounding at the flexibility required for human-level abstract reasoning.

“but no current system demonstrates robust symbol grounding at the flexibility required for human-level abstract reasoning.”

Brute-force coverage partially compensates for missing compositional mechanisms.

“suggesting that brute-force coverage partially compensates for missing compositional mechanisms.”

ARC-AGI-3's interactive paradigm raises the bar by demanding exploration and world model induction, capabilities that no current architecture demonstrates at human-level efficiency.

“ARC-AGI-3's interactive paradigm further raises the bar by demanding exploration and world model induction, capabilities that no current architecture demonstrates at human-level efficiency.”

The transparency limitation potentially biases the field toward expensive approaches.

“potentially biasing the field toward expensive approaches”

Increased compositional complexity in ARC-AGI-2 creates a performance ceiling that few current methods can overcome.

“indicating that increased compositional complexity creates a performance ceiling that few current methods can overcome.”

These results demonstrated that pre-trained models, despite never encountering ARC tasks during training, contained inductive biases useful for compositional reasoning.

“These results demonstrated that pre-trained models, despite never encountering ARC tasks during training, contained inductive biases useful for compositional reasoning, a finding that challenged prevailing assumptions about the necessity of task-specific architectures.”

The magnitude of degradation from ARC-AGI-1 to ARC-AGI-2 correlates with the compositional depth increase in ARC-AGI-2.

“The magnitude of degradation correlates with the compositional depth increase in ARC-AGI-2”

The fundamental scaling challenge persists: achieving the final percentage points toward human-level performance still requires disproportionate resources.

“the fundamental scaling challenge persists: achieving the final percentage points toward human-level performance still requires disproportionate resources.”

Diminishing returns are occurring as performance approaches current paradigm limits.

“suggesting diminishing returns as performance approaches current paradigm limits.”

The distribution shift from ARC-AGI-1 to ARC-AGI-2 is not merely quantitative but qualitative, requiring generalization along compositional dimensions absent from training data.

“The distribution shift from ARC-AGI-1 to ARC-AGI-2 is not merely quantitative but qualitative, requiring generalization along compositional dimensions absent from training data.”

Current approaches achieve performance through exhaustive search rather than discovering minimal, transferable abstractions.

“current approaches achieve performance through exhaustive search rather than discovering minimal, transferable abstractions”

• AssumptionRests on an assumption: Human per-task energy consumption is approximately 2,400J (20W for 1-2 minutes), and AI systems use megawatt-scale energy, 6-7 orders of magnitude more per task.

The controlled variation between ARC-AGI-1 and ARC-AGI-2 isolates compositional generalization as the limiting factor.

“This controlled variation isolates compositional generalization as the limiting factor.”

After applying these filters, 59 papers remain for quantitative performance comparisons.

“After applying these filters, 59 papers remain for quantitative performance comparisons”

This is not gradual degradation but catastrophic failure once compositional depth exceeds system capacity.

“This is not gradual degradation but catastrophic failure once compositional depth exceeds system capacity.”

ARC-AGI-3's shift to interactive environments exposes capability gaps beyond compositional reasoning.

“ARC-AGI-3's shift to interactive environments exposes capability gaps beyond compositional reasoning.”

This hierarchical approach scales sub-exponentially because it reduces effective search space at each level.

“This hierarchical approach scales sub-exponentially because it reduces effective search space at each level.”

These results indicate shared fundamental limitations.

“indicate shared fundamental limitations”

The persistent performance cliff from ARC-AGI-1 to ARC-AGI-2 indicates that current refinement-based mechanisms do not yet constitute robust compositional generalization.

“At the same time, the persistent performance cliff from ARC-AGI-1 to ARC-AGI-2 indicates that current refinement-based mechanisms do not yet constitute robust compositional generalization.”

The transparency gap likely underestimates the true generalization problem.

“that likely underestimates the true generalization problem”

Current AI achieves performance through scaling computational resources rather than discovering compressed representations.

“Current AI achieves performance through scaling computational resources rather than discovering compressed representations.”

The root cause of failure is that current systems treat composition as sequential concatenation, searching over all ordered sequences of operations.

“The root cause is that current systems treat composition as sequential concatenation, searching over all ordered sequences of operations.”

Scaling to human-level (100%) is economically prohibitive.

“making scaling to human-level (100%) economically prohibitive.”

This brittleness suggests fundamental differences in how humans and current AI represent compositional structure.

“This brittleness suggests fundamental differences in how humans and current AI represent compositional structure.”

Even commercial systems' higher scores on ARC-AGI-2 represent substantial degradation from ARC-AGI-1 performance levels.

“yet even these represent substantial degradation from ARC-AGI-1 performance levels.”

No system, regardless of scale, cost regime, or architectural paradigm, maintains its ARC-AGI-1 performance on ARC-AGI-2.

“yet the pattern is universal: no system, regardless of scale, cost regime, or architectural paradigm, maintains its ARC-AGI-1 performance on ARC-AGI-2.”

Current systems' compositional reasoning capabilities remain shallow despite sophisticated engineering.

“suggesting that current systems' compositional reasoning capabilities remain shallow despite sophisticated engineering.”

Genuine intelligence involves finding minimal-energy paths through problem spaces.

“genuine intelligence involves finding minimal-energy paths through problem spaces [Krakauer et al. 2025].”

• cites Krakauer et al. 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Current approaches that achieve the strongest reported ARC-AGI results approximate aspects of abstraction discovery without fully achieving it.

“Current approaches that achieve the strongest reported ARC-AGI results approximate aspects of abstraction discovery without fully achieving it.”

The 390× improvement reflects engineering optimization (fewer parallel runs at lower API costs) rather than algorithmic compression toward human-like efficiency.

“The 390× improvement thus reflects engineering optimization (fewer parallel runs at lower API costs) rather than algorithmic compression toward human-like efficiency.”

Neural networks possess latent reasoning capabilities unlocked by task-specific adaptation.

“validating that neural networks possess latent reasoning capabilities unlocked by task-specific adaptation”

Pattern matching cannot handle increased compositional depth.

“confirming that pattern matching cannot handle increased compositional depth”

Gemini 3 Flash Preview establishes a new cost-efficiency Pareto frontier that rivals competition winners at substantially lower cost.

“establishing a new costefficiency Pareto frontier that rivals competition winners at substantially lower cost.”

Capabilities developed for passive pattern recognition do not transfer to active learning contexts.

“This results revealed that capabilities developed for passive pattern recognition do not transfer to active learning contexts”

• AssumptionRests on an assumption: ARC-AGI-3 tasks remain within the scope of human core knowledge priors.

The efficiency gain reflects reduced parallelism rather than algorithmic breakthroughs.

“reflects reduced parallelism rather than algorithmic breakthroughs”

The only systematic difference between ARC-AGI-2 and ARC-AGI-1 is that solutions require composing more primitive operations.

“The only systematic difference is that solutions require composing more primitive operations.”

The 87% relative drop indicates that pattern matching approaches, regardless of architectural sophistication, cannot handle even modestly deeper compositions.

“The 87% relative drop indicates that pattern matching approaches, regardless of architectural sophistication, cannot handle even modestly deeper compositions, a finding consistent with the broader limitations of pure transductive methods.”

Current architectures miss essential aspects of intelligence related to reasoning and interaction.

“suggesting that current architectures miss essential aspects of intelligence related to reasoning and interaction.”

Current AI primitives remain tied to specific instantiations, limiting their compositional utility.

“Current AI primitives, by contrast, remain tied to specific instantiations, limiting their compositional utility.”

Current approaches achieve performance through parallelism and search rather than discovering compressed representations.

“This gap indicates current approaches achieve performance through parallelism and search rather than discovering compressed representations.”

Representation choice alone cannot overcome compositional reasoning limitations.

“representation choice alone cannot overcome compositional reasoning limitations”

TRM achieved 45% on ARC with 7M parameters.

“recursive latent refinement (TRM achieving 45% with 7M parameters)”

• cites Jolicoeur-Martineau 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Capabilities developed for passive pattern recognition do not transfer to active learning.

“exposes that capabilities developed for passive pattern recognition do not transfer to active learning”

High-compute test-time approaches demonstrate that sufficient computation can solve ARC-AGI-1 tasks.

“High-compute test-time approaches demonstrate that sufficient computation can solve ARC-AGI-1 tasks.”

Modern systems still struggle with the compositional abstraction and emergent compression that make human reasoning fluid, transferable, and efficient.

“yet they still struggle with the compositional abstraction and emergent compression that make human reasoning fluid, transferable, and efficient.”

The persistence of the compositional bottleneck across versions suggests this progress reflects increasingly sophisticated pattern matching rather than breakthroughs in compositional generalization.

“Yet the persistence of the compositional bottleneck across versions suggests this progress reflects increasingly sophisticated pattern matching rather than breakthroughs in compositional generalization.”

Exponential scaling requirements make approaching human performance economically prohibitive.

“exponential scaling requirements make approaching human performance economically prohibitive”

The 2025 innovations (including refinement loops, recursive latent reasoning, self-improving search, and compression-based inference) show that progress can come from methodological advances, not scale alone.

“The 2025 innovations (including refinement loops, recursive latent reasoning, self-improving search, and compression-based inference) show that progress can come from methodological advances, not scale alone.”

• AssumptionRests on an assumption: General intelligence requires mechanisms for emergent compression, spontaneous discovery of minimal principles with maximal explanatory power.

Failed solution attempts contain valuable learning signal.

“The key insight is that failed solution attempts contain valuable learning signal.”

ARC-AGI-3's interactive format tests agents' ability to infer environmental mechanics through exploration and discover goals from sparse feedback.

“ARC-AGI-3's [Ying et al. 2025] interactive format tests these capabilities: agents must infer environmental mechanics through exploration and discover goals from sparse feedback.”

• cites Ying et al. 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The failure of ARC-AGI-1-optimized systems to transfer to ARC-AGI-3 demonstrates that static reasoning misses essential aspects of intelligence requiring active model building.

“The failure of ARC-AGI-1-optimized systems to transfer to ARC-AGI-3 demonstrates that static reasoning misses essential aspects of intelligence requiring active model building.”

Achieving artificial general intelligence requires architectural innovations beyond scaling current paradigms.

“The empirical evidence and theoretical analyses converge on a clear conclusion: achieving artificial general intelligence requires architectural innovations beyond scaling current paradigms.”

• AssumptionRests on an assumption: Genuine intelligence requires building predictive models of environment dynamics rather than memorizing input-output mappings.
• AssumptionRests on an assumption: World models enable counterfactual reasoning, compositional understanding, and efficient planning.
• AssumptionRests on an assumption: General intelligence requires mechanisms for emergent compression, spontaneous discovery of minimal principles with maximal explanatory power.
• AssumptionRests on an assumption: Current learning paradigms optimize for prediction accuracy, incentivizing memorization.
• AssumptionRests on an assumption: Achieving human-like intelligence likely requires optimization objectives that explicitly reward compression.

Recursive depth, learning from failure, and compression objectives can substitute for massive scale.

“These approaches demonstrate that recursive depth, learning from failure, and compression objectives can substitute for massive scale.”

The ARC Prize 2025 competition revealed refinement loops as the central innovation across winning approaches.

“The ARC Prize 2025 competition revealed refinement loops, iterative cycles of generation, verification, and correction, as the central innovation across winning approaches [ARC Prize Foundation 2025b].”

• cites ARC Prize Foundation 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The key challenge remains bridging perceptual grounding with compositional structure.

“The key challenge remains bridging perceptual grounding with compositional structure: TRM achieves efficient recursion but lacks symbolic interpretability; SOAR learns search strategies but requires LLM foundations; CompressARC grounds through compression but within fixed architectural primitives.”

Rapid progress is possible when challenges are well-designed.

“demonstrates that rapid progress is possible when challenges are well-designed”

Learning how to search may matter more than searching with fixed capabilities.

“This suggests that learning how to search may matter more than searching with fixed capabilities.”

Modern systems can achieve impressive competence through refined pattern matching and increasingly powerful search.

“modern systems can achieve impressive competence through refined pattern matching and increasingly powerful search”

Efficient systems demonstrate that performance need not require massive computation when architectures discover appropriate abstractions.

“Efficient systems demonstrate that performance need not require massive computation when architectures discover appropriate abstractions.”

• AssumptionRests on an assumption: Genuine intelligence requires building predictive models of environment dynamics rather than memorizing input-output mappings.
• AssumptionRests on an assumption: World models enable counterfactual reasoning, compositional understanding, and efficient planning.
• AssumptionRests on an assumption: General intelligence requires mechanisms for emergent compression, spontaneous discovery of minimal principles with maximal explanatory power.

MDL-based inference can substitute for massive pretraining.

“demonstrating that MDL-based inference can substitute for massive pretraining.”

SOAR reached 52% by learning from search traces.

“self-improving program synthesis (SOAR reaching 52% by learning from search traces)”

• cites Liao and Gu 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The cross-paradigm performance cliff from ARC-AGI-1 to ARC-AGI-2 confirms that all current learning paradigms optimize for capability accumulation rather than intelligent compression.

“The cross-paradigm performance cliff from ARC-AGI-1 to ARC-AGI-2 confirms that all current learning paradigms, whether gradient descent, evolutionary search, or symbolic reasoning, optimize for capability accumulation rather than intelligent compression.”

ARC-AGI-3's interactive paradigm requires that such primitives also support world model induction through exploration.

“ARC-AGI-3's interactive paradigm compounds this challenge by requiring that such primitives also support world model induction through exploration [Ying et al. 2025].”

• cites Ying et al. 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

The efficiency gap suggests this path produces capability without understanding.

“the efficiency gap suggests this path produces capability without understanding”

CompressARC solved 20% with zero pretraining.

“compression-based inference (CompressARC solving 20% with zero pretraining)”

• cites Pourcel et al. 2025 sourceNot checked yet

  Not checked in the free run.

The gap from current best performance to human baseline indicates that substantial architectural innovation remains necessary.

“The gap from current best performance to human baseline indicates that substantial architectural innovation remains necessary.”

Cost barriers can fall rapidly.

“shows that cost barriers can fall rapidly”