SkillOpt: Executive Strategy for Self-Evolving Agent Skills

May combine two claims.

Removing both meta skill and slow update drops SpreadsheetBench from 77.5 to 55.0 (-22.5 points), the largest degradation in the ablation.

“removing both meta skill and slow update drops SpreadsheetBench from 77.5 to 55.0 (-22.5 points), the largest degradation in the ablation”

The quote only partly states this claim.

On GPT-5.5, SkillOpt lifts the average no-skill accuracy by +19.1 points inside Claude Code.

“and by +19.1 inside Claude Code”

• Also stated in: § 4.1 Main Results · plain

  “with average gain +19.1 over no skill”

May combine two claims.

Constant decay scores 87.3/80.7/62.1, cosine 87.1/77.5/61.3, and linear 87.2/72.9/62.9.

“constant decay scores 87.3/80.7/62.1,cosine 87.1/77.5/61.3, and linear 87.2/72.9/62.9”

May combine two claims.

Every remaining row in the transfer tables (a)-(c) is a positive transfer (no row falls below the target's no-skill baseline).

“Every remaining row in (a)-(c) is a positive transfer (no row falls below the target's no-skill baseline).”

May combine two claims.

The same optimizer works for direct QA, spreadsheet execution, document reasoning, multimodal QA, embodied environments, and Codex-style or Claude Code-style execution loops.

“The same optimizer therefore works for direct QA, spreadsheet execution, document reasoning, multimodal QA, embodied environments, and Codex-style or Claude Code-style execution loops.”

May combine two claims.

SkillOpt leads every baseline even for GPT-5.4-nano, and a target-matched optimizer recovers much of the gain.

“SkillOpt leads every baseline even for GPT-5.4-nano, and the optimizer-strength analysis in Table 5 shows that a target-matched optimizer recovers much of the gain.”

May combine two claims.

Human skills are 145-516 tokens long and often exceed the one-shot LLM skill, yet they are beaten in every direct-chat model row while the learned artifacts remain compact.

“human skills are already 145-516 tokens long and often exceed the one-shot LLM skill, yet they are beaten in every direct-chat model row while the learned artifacts remain compact (Table 6).”

May combine two claims.

Varying the reflection mini-batchsize from 1 to 32 keeps SearchQA inside 85.9-87.1 and SpreadsheetBench inside 75.4-77.9.

“varying the reflection mini-batchsize from 1 to 32 keeps SearchQA inside 85.9-87.1 and Spread-sheetBench inside 75.4-77.9”

May combine two claims. The quote only partly states this claim.

Optimized skill artifacts retain value when moved across model scales, between Codex and Claude Code execution environments, and to a nearby math benchmark without further optimization.

“Transfer experiments further show that optimized skill artifacts retain value when moved across model scales, between Codex and Claude Code execution”

May combine two claims.

EvoSkill improves the Codex SpreadsheetBench cell from 27.5 to 67.5, but SkillOpt adds another +17.5 points (67.5→85.0).

“EvoSkill already improves the Codex SpreadsheetBench cell from 27.5 to 67.5, but SkillOpt adds another +17.5 points (67.5→85.0).”

Probably not a substantial claim: may not pass S3 (load-bearing).

Slow-update sampling places the default at 20 examples per epoch (87.1, 77.5, and 61.3).

“Slow-update sampling (panel f) places the default at 20 examples per epoch (87.1, 77.5, and 61.3)”

May combine two claims.

SkillOpt is best on every benchmark for GPT-5.5, GPT-5.4, GPT-5.4-mini, GPT-5.4-nano, GPT-5.2, Qwen3.5-4B, and Qwen3.6-35B-A3B in direct chat, and for GPT-5.5 under both Codex and Claude Code harnesses.

“SkillOpt is best on every benchmark for GPT-5.5, GPT-5.4,GPT-5.4-mini,GPT-5.4-nano,GPT-5.2,Qwen3.5-4B, and Qwen3.6-35B-A3B in direct chat, and for GPT-5.5 under both Codex and Claude Code harnesses.”

May combine two claims.

The best per-cell baseline averages 76.9, leaving SkillOpt +5.4 points clear of an oracle baseline that picks the best of six competing methods per cell.

“while the best per-cell baseline averages only 76.9, leaving SkillOpt +5.4 points clear of an oracle baseline that picks the best of six competing methods per cell.”

May combine two claims.

Procedural benchmarks see the largest improvements: SpreadsheetBench 41.8→80.7, OfficeQA 33.1→72.1, and LiveMathematicianBench 37.6→66.9 on GPT-5.5; SpreadsheetBench 9.3→23.9 on Qwen3.5-4B; and ALFWorld 34.3→69.4 on GPT-5.4-nano.

“Procedural benchmarks see the largest improvements: SpreadsheetBench 41.8→80.7,OfficeQA 33.1→72.1, and LiveMathematicianBench 37.6→66.9 on GPT-5.5;SpreadsheetBench 9.3→23.9(×2.6) on Qwen3.5-4B; and ALFWorld 34.3→69.4(×2.0) on GPT-5.4-nano.”

May combine two claims.

Procedural benchmarks reward more training evidence: SpreadsheetBench climbs 47.5→78.0 and LiveMathematicianBench climbs 59.1→70.5 as the optimizer sees 1→100% of the training partition.

“SpreadsheetBench climbs 47.5→78.0 and LiveMathematicianBench climbs 59.1→70.5 as the optimizer sees 1→100% of the training partition”

May combine two claims.

Averaged over the six benchmarks, SkillOpt lifts GPT-5.4 by +12.7 points, GPT-5.4-mini by +15.4, GPT-5.4-nano by +26.7, GPT-5.2 by +16.6, Qwen3.5-4B by +19.2, and Qwen3.6-35B-A3B by +9.1, for an average improvement of approximately +17.6 points per model.

“Averaged over the six benchmarks, SkillOpt lifts GPT-5.4 by +12.7 points, GPT-5.4-mini by +15.4,GPT-5.4-nano by +26.7,GPT-5.2 by +16.6, Qwen3.5-4B by +19.2, and Qwen3.6-35B-A3B by +9.1, for an average improvement of approximately +17.6 points per model.”

May combine two claims.

SearchQA has limited headroom and is stable across many settings, with most cells fluctuating inside a ±1.5 point band.

“SearchQA has limited headroom and is therefore stable across many settings (most cells fluctuate inside a ±1.5 point band)”

May combine two claims.

The learned skills remain compact (300-2,000 tokens after only 1-4 accepted edits), inspectable, and procedural rather than instance-specific.

“the learned skills remain compact (300-2,000 tokens after only 1-4 accepted edits), inspectable, and procedural rather than instance-specific.”

May combine two claims.

On the OlympiadBench→Omni-MATH direction, the transferred skill is positive on all three model scales, with gains of +3.7 on GPT-5.4, +1.8 on GPT-5.4-mini, and +1.3 on GPT-5.4-nano.

“On the OlympiadBench→Omni-MATH direction reported in Table 4(c), the transferred skill is positive on all three model scales we evaluate, with gains of +3.7 on GPT-5.4,+1.8 on GPT-5.4-mini, and +1.3 on GPT-5.4-nano.”

May combine two claims.

The optimized SpreadsheetBench skill learns to inspect the actual workbook rather than rely on previews, locate headers and target ranges across multiple sheets, normalize keys and cell types before lookup or aggregation, and preserve formatting during structural edits.

“The optimized skill learns to inspect the actual workbook rather than rely on previews, locate headers and target ranges across multiple sheets, normalize keys and cell types before lookup or aggregation, and preserve formatting during structural edits.”

May combine two claims.

The learned rules consistently encode the discipline that frontier models lack zero-shot: answer-format constraints (OfficeQA, LiveMathematicianBench), evidence binding to a specific visual region (DocVQA), workbook-structure-first reasoning (SpreadsheetBench), search-frontier discipline (ALFWorld), and canonical-entity choice (SearchQA).

“Second, they consistently encode the discipline that frontier models lack zero-shot: answer-format constraints (OfficeQA, LiveMathematicianBench), evidence binding to a specific visual region (DocVQA), workbook-structure-first reasoning (Spread-sheetBench), search-frontier discipline (ALFWorld), and canonical-entity choice (SearchQA).”

May combine two claims.

SpreadsheetBench skills trained on GPT-5.4 transfer to GPT-5.4-mini (+9.4) and GPT-5.4-nano (+3.0).

“SpreadsheetBench skills trained on GPT-5.4 transfer to GPT-5.4-mini (+9.4) and GPT-5.4-nano(+3.0)”

May combine two claims.

The remaining cross-model rows still recover a useful fraction of the in-domain gain-e.g. SpreadsheetBench GPT-5.4-mini retains 82% of the in-domain gain (+9.4 of +11.4)-and no row falls below the target's no-skill baseline.

“The remaining cross-model rows still recover a useful fraction of the in-domain gain-e.g.SpreadsheetBench GPT-5.4-miniretains 82% of the in-domain gain (+9.4 of +11.4)-and no row falls below the target's no-skill baseline.”

May combine two claims.

SkillOpt lifts GPT-5.5 by +23.5 points on average over no skill in direct chat and by +24.8/+19.1 points under Codex and Claude Code harnesses.

“lifts GPT-5.5 by +23.5 points on average over no skill in direct chat and by +24.8/ + 19.1 points under Codex and Claude Code harnesses”

May combine two claims.

OfficeQA achieves +39.0 points at 1.1M tokens per point, total 20.8M tokens.

“e.g.+39.0 points on OfficeQA at 1.1M tokens / point, total 20.8M tokens”

Classified as probably not a substantial claim.

The optimized SpreadsheetBench skill adds a key rule for formula-style prompts: when the grader reads cell values, the agent should compute and write evaluated static values, even if the prompt mentions formulas such as INDEX/MATCH or XLOOKUP.

“It also adds a key rule for formula-style prompts: when the grader reads cell values, the agent should compute and write evaluated static values, even if the prompt mentions formulas such as INDEX/MATCH or XLOOKUP.”

May combine two claims.

In both ALFWorld and SpreadsheetBench cases, SkillOpt does not replace the initial skill with an unrelated prompt; accepted edits add compact procedural constraints around recurring failure modes observed in rollout trajectories.

“In both cases, SkillOpt does not replace the initial skill with an unrelated prompt.Instead, accepted edits add compact procedural constraints around recurring failure modes observed in rollout trajectories.”

Classified as probably not a substantial claim. May combine two claims.

The optimized ALFWorld skill adds destination memory, pick-two progress locks, and direct completion rules: once the agent can clean, heat, cool, place, or otherwise complete the next subgoal, it should take that admissible action instead of examining, closing, or verifying again.

“It also adds destination memory, pick-two progress locks, and direct completion rules: once the agent can clean, heat, cool, place, or otherwise complete the next subgoal, it should take that admissible action instead of examining, closing, or verifying again.”

May combine two claims.

Per-benchmark case studies show that these gains arise from compact (<2,000 token), interpretable skill artifacts assembled from only 1-4 accepted edits.

“Per-benchmark case studies show that these gains arise from compact (< 2,000 token), interpretable skill artifacts assembled from only 1-4 accepted edits”

• AssumptionThe authors state this as an assumption: The trainable object should remain a small, inspectable text document.

May combine two claims.

The stronger optimizer produces larger absolute gains on every (benchmark, target) cell tested: GPT-5.4-nano lifts by +19.0 vs. +11.9 on SpreadsheetBench and +19.0 vs. +14.1 on SearchQA, and GPT-5.4-mini follows the same ordering (+11.4 vs. +7.1 on SpreadsheetBench, +4.3 vs. +2.4 on SearchQA).

“the stronger optimizer produces larger absolute gains on every (benchmark, target) cell we test: GPT-5.4-nanolifts by +19.0 vs. +11.9 on SpreadsheetBench and +19.0 vs. +14.1 on SearchQA, and GPT-5.4-minifollows the same ordering (+11.4 vs. +7.1 on SpreadsheetBench, +4.3 vs. +2.4 on SearchQA).”

Classified as probably not a substantial claim. May combine two claims.

Later SpreadsheetBench edits require filling complete target ranges, including currently blank result cells, keeping helper computations in Python rather than adding workbook artifacts, and reopening the saved workbook to check boundary rows and remaining blanks.

“Later edits further require filling complete target ranges, including currently blank result cells, keeping helper computations in Python rather than adding workbook artifacts, and reopening the saved workbook to check boundary rows and remaining blanks.”

Classified as probably not a substantial claim. May combine two claims.

The validation gate is intentionally strict: a candidate skill is accepted only when its selection-split score is strictly greater than the current selection score, so ties are rejected and the deployed skill never silently drifts.

“The validation gate is intentionally strict: a candidate skill is accepted only when its selection-split score is strictly greater than the current selection score, so ties are rejected and the deployed skill never silently drifts.”

Classified as probably not a substantial claim.

The slow-update candidate is still passed through the validation gate.

“this candidate is still passed through the validation gate”

May combine two claims.

TextGrad and GEPA optimize prompts but not a persistent skill artifact.

“TextGrad and GEPA optimize prompts but not a persistent skill artifact”

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [13]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The gains are largest on procedural benchmarks, where reusable rules about tool use and output formatting matter most, but they also appear on factual and multimodal benchmarks.

“The gains are largest on procedural benchmarks, where reusable rules about tool use and output formatting matter most, but they also appear on factual and multimodal benchmarks.”

May combine two claims.

SkillOpt benefits from sufficient evidence, a bounded textual learning rate, rejected-edit feedback, and epoch-wise slow/meta update.

“The overall message is that SkillOpt benefits from sufficient evidence, a bounded textual learning rate, rejected-edit feedback, and epoch-wise slow/meta update.”

May combine two claims.

Taken together, the table supports a strong empirical claim: across direct chat and two tool-execution harnesses, across seven target models, and on procedural and factual benchmarks alike, optimizing a single compact skill artifact under bounded text-space training is the strongest no-weight-update adaptation strategy among the baselines we consider.

“optimizing a single compact skill artifact under bounded text-space training is the strongest no-weight-update adaptation strategy among the baselines we consider.”

Classified as probably not a substantial claim.

Every candidate skill is evaluated on D_sel with the same frozen target model and harness.

“Every candidate skill is evaluated on D sel with the same frozen target model and harness.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

GEPA demonstrates that trajectory feedback can guide reflective prompt evolution and outperform reinforcement learning on several language-agent tasks.

“GEPA demonstrates that trajectory feedback can guide reflective prompt evolution and outperform reinforcement learning on several languageagent tasks [13].”

• cites [13]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Validation checkpoints track held-out test performance across epochs, confirming that the gate tends to select skills that generalize rather than skills that only fit the selection split.

“validation checkpoints track held-out test performance across epochs, confirming that the gate tends to select skills that generalize rather than skills that only fit the selection split.”

May combine two claims.

The headline gains are not the product of a fragile prompt-search batch size, but a genuine effect of having enough scored evidence per update.

“Together this means the headline gains are not the product of a fragile prompt-search batch size, but a genuine effect of having enough scored evidence per update.”

May combine two claims.

All baselines use the same target model, the same held-out test split, and the same scorer for every benchmark, so the comparison isolates the choice of adaptation procedure rather than secondary factors such as prompt template or scoring pipeline.

“All baselines use the same target model, the same held-out test split, and the same scorer for every benchmark, so the comparison isolates the choice of adaptation procedure rather than secondary factors such as prompt template or scoring pipeline.”

Classified as probably not a substantial claim.

An edit is accepted only when it strictly improves a held-out validation score.

“an edit is accepted only when it strictly improves a held-out validation score”

• AssumptionRests on an assumption: Plausible textual diagnoses can still hurt the actual target model.

May combine two claims.

EvoSkill lacks both bounded textual learning rates and rejected-edit memory.

“EvoSkill, the strongest harness-side competitor, lacks both bounded textual learning rates and rejected-edit memory.”

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Dataset-backed runs use deterministic train/selection/test splits derived from the same dataset seed (split_seed = 42); the selection split is used only to accept or reject candidate skill edits, and all reported scores are computed on the disjoint held-out test split.

“Dataset-backed runs use deterministic train/selection/test splits derived from the same dataset seed (split_seed = 42); the selection split is used only to accept or reject candidate skill edits, and all reported scores are computed on the disjoint held-out test split.”

Probably not a substantial claim: may not pass S3 (load-bearing).

SkillsBench and the SoK on agentic skills frame skills as reusable procedural knowledge.

“SkillsBench and the SoK on agentic skills frame skills as reusable procedural knowledge”

• cites [7]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [8]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Each merged edit records a support count and a source type, allowing ranking to prefer edits that survive independent analyses and hierarchical merges.

“Each merged edit also records a support count and a source type, allowing ranking to prefer edits that survive independent analyses and hierarchical merges.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The 100% row uses the full training partition under the same split, so it is directly comparable to the smaller-subset rows.

“The 100% row uses the full training partition under the same split, so it is directly comparable to the smaller-subset rows.”

Classified as probably not a substantial claim. May combine two claims.

The student model, backend, harness, and benchmark evaluator remain fixed during optimization.

“The student model, backend, harness, and benchmark evaluator remain fixed during optimization.”

Classified as probably not a substantial claim. May combine two claims.

The optimizer-side meta skill lives only in the teacher's reflection context and is never shipped with the deployed artifact.

“the optimizer-side meta skill lives only in the teacher's reflection context and is never shipped with the deployed artifact.”

May combine two claims.

The epoch-wise slow/meta update writes into a markup-fenced protected region of the skill document that step-level edits cannot overwrite, separating the fast intra-epoch update from the slower cross-epoch consolidation.

“The epoch-wise slow/meta update writes into a markup-fenced protected region of the skill document that step-level edits cannot overwrite, separating the fast intra-epoch update from the slower cross-epoch consolidation”

May combine two claims.

The bounded-edit, validation-gated loop is what makes the stronger-optimizer advantage monotone: without the gate, a stronger optimizer could just as easily push larger but harmful rewrites.

“The bounded-edit, validation-gated loop is what makes this monotone: without the gate, a stronger optimizer could just as easily push larger but harmful rewrites.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The edit budget serves as a learning-rate analogue, allowing larger early changes and smaller late refinements.

“Fourth, the edit budget serves as a learning-rate analogue, allowing larger early changes and smaller late refinements.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The cost of training the skill is amortized when the same skill is reused, but may be less attractive for one-off tasks.

“this cost is amortized when the same skill is reused, but may be less attractive for one-off tasks.”

May combine two claims.

Because the optimizer runs only during the offline training loop and is never invoked at deployment, optimizer choice is a training-time lever: a stronger optimizer can improve the deployed skill without raising the inference cost of using that skill.

“Because the optimizer in SkillOpt runs only during the offline training loop and is never invoked at deployment, optimizer choice is a training-time lever: a stronger optimizer can improve the deployed skill without raising the inference cost of using that skill.”

Classified as probably not a substantial claim.

The optimization loop relies on scored trajectories and a held-out selection split, so it is most directly applicable when the target task has automatic verifiers, exact-match metrics, executable checks, or otherwise reliable feedback signals.

“First, the optimization loop relies on scored trajectories and a held-out selection split, so it is most directly applicable when the target task has automatic verifiers, exact-match metrics, executable checks, or otherwise reliable feedback signals.”

• AssumptionRests on an assumption: The benchmarks' native evaluators provide reliable feedback signals for skill optimization.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The deployed skill remains lightweight and inspectable, while the optimizer-side meta skill stays separate from the skill shown to the task-execution model.

“Fifth, the deployed skill remains lightweight and inspectable, while the optimizer-side meta skill stays separate from the skill shown to the task-execution model.”

May combine two claims.

Compactness (<2,000 tokens) and edit economy (1-4 accepted edits) mean the deployed artifact is interpretable.

“Compactness (< 2,000 tokens) and edit economy (1-4 accepted edits) mean the deployed artifact is interpretable.”

• AssumptionThe authors state this as an assumption: The trainable object should remain a small, inspectable text document.

May combine two claims.

The ablations show that the gains are relatively insensitive to the exact rollout batch, reflection minibatch, or learning-rate schedule, but much more sensitive to the presence of bounded text-space learning, validation gating, rejected-edit feedback, and epoch-wise slow/meta update.

“the ablations show that the gains are relatively insensitive to the exact rollout batch, reflection minibatch, or learning-rate schedule, but much more sensitive to the presence of bounded text-space learning, validation gating, rejected-edit feedback, and epoch-wise slow/meta update”

May combine two claims.

These implementation choices explain why removing both meta skill and slow update is especially damaging on SpreadsheetBench: it removes the long-horizon evidence stream and the protected-region contract that keeps local edits from overwriting durable procedural lessons.

“These implementation choices explain why removing both meta skill and slow update is especially damaging on SpreadsheetBench: it removes the long-horizon evidence stream and the protected-region contract that keeps local edits from overwriting durable procedural lessons.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The optimizer runs only during offline training, so the stronger-optimizer column adds zero cost at deployment.

“The optimizer runs only during offline training, so the stronger-optimizer column adds zero cost at deployment.”

Classified as probably not a substantial claim. May combine two claims.

Every candidate skill is evaluated on a selection split before acceptance, which prevents unvalidated reflection from accumulating.

“Second, every candidate skill is evaluated on a selection split before acceptance, which prevents unvalidated reflection from accumulating.”

• AssumptionRests on an assumption: The held-out selection split is representative enough that improvement on it predicts improvement on the test split.

Probably not a substantial claim: may not pass S3 (load-bearing).

A single skill may be insufficient for highly heterogeneous domains that require many disjoint procedures.

“This design improves deployment simplicity, but a single skill may be insufficient for highly heterogeneous domains that require many disjoint procedures.”

Classified as probably not a substantial claim. May combine two claims.

The deployed artifact is still a static best_skill.md that calls only the target model.

“The deployed artifact is still a static best_skill.md that calls only the target model.”

May combine two claims.

These results suggest that compact natural-language skills can serve as a practical domain-adaptation layer for frontier agents, enabling reusable improvement without modifying model weights.

“These results suggest that compact natural-language skills can serve as a practical domain-adaptation layer for frontier agents, enabling reusable improvement without modifying model weights.”

Probably not a substantial claim: may not pass S4 (based).

Minibatch analyses are merged hierarchically so that the final edits represent recurring evidence rather than single examples.

“Third, minibatch analyses are merged hierarchically so that the final edits represent recurring evidence rather than single examples.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The prompts require JSON outputs so that edits can be parsed, filtered, applied, and validated without manual intervention.

“The prompts require JSON outputs so that edits can be parsed, filtered, applied, and validated without manual intervention.”

Probably not a substantial claim: may not pass S4 (based).

Optimized skills can encode domain-specific heuristics from the training distribution.

“Finally, optimized skills can encode domain-specific heuristics from the training distribution, so careful held-out evaluation remains necessary before transferring them to substantially different models, harnesses, or task settings.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Rejected candidates are not discarded entirely: their failure patterns and rejected edits are stored in the step buffer so that later optimizer calls can avoid repeating harmful changes.

“Rejected candidates are not discarded entirely: their failure patterns and rejected edits are stored in the step buffer so that later optimizer calls can avoid repeating harmful changes.”

May combine two claims.

The training cost is paid once during skill training; after export, the optimized best_skill.md adds no optimizer calls, no weight updates, and only a compact text artifact to the target agent.

“this cost is paid once during skill training; after export, the optimized best_skill.mdadds no optimizer calls, no weight updates, and only a compact text artifact to the target agent.”

May combine two claims.

In SpreadsheetBench especially, the transferred skill appears to encode workbook-level procedures such as structure-first inspection, formula-aware verification, and static-value materialization, so the cost of optimizing a skill in one execution environment can be amortized across related deployment environments.

“In SpreadsheetBench especially, the transferred skill appears to encode workbook-level procedures such as structure-first inspection, formula-aware verification, and static-value materialization, so the cost of optimizing a skill in one execution environment can be amortized across related deployment environments.”

Probably not a substantial claim: may not pass S2 (checkable).

Careful held-out evaluation remains necessary before transferring optimized skills to substantially different models, harnesses, or task settings.

“Finally, optimized skills can encode domain-specific heuristics from the training distribution, so careful held-out evaluation remains necessary before transferring them to substantially different models, harnesses, or task settings.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The edit budget L t acts as a textual learning rate: it limits how many proposed edits can be applied at a step, preserving continuity between adjacent skills.

“The edit budget L t acts as a textual learning rate: it limits how many proposed edits can be applied at a step, preserving continuity between adjacent skills.”

Probably not a substantial claim: may not pass S3 (load-bearing).

One-factor ablations vary a single scalar or component while holding the remaining optimizer configuration fixed.

“One-factor ablations vary a single scalar or component while holding the remaining optimizer configuration fixed.”

May combine two claims.

SkillOpt is not a distillation pipeline from a stronger teacher into a weaker student: the optimization loop itself contributes substantial value on top of whatever the optimizer can already do.

“confirming that SkillOpt is not a distillation pipeline from a stronger teacher into a weaker student: the optimization loop itself contributes”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

For open-ended domains where success is subjective, multi-dimensional, or costly to judge, the validation gate may require stronger human or model-based evaluation.

“For open-ended domains where success is subjective, multi-dimensional, or costly to judge, the validation gate may require stronger human or model-based evaluation.”

May combine two claims.

Cost-per-point (0.6M-46.4M tokens/point) shows that the training cost is measurable and paid before deployment.

“Cost-per-point (0.6M-46.4M tokens / point) shows that the training cost is measurable and paid before deployment.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The protected slow-update section, delimited by SLOW_UPDATE_START and SLOW_UPDATE_END, is off limits to all step-level prompts.

“The protected slow-update section, delimited by SLOW_UPDATE_START and SLOW_UPDATE_END, is off limits to all step-level prompts.”

Classified as probably not a substantial claim.

This conservative criterion makes rejected edits informative negative feedback rather than hidden state.

“This conservative criterion makes rejected edits informative negative feedback rather than hidden state.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Every step records an edit_apply_report.json containing per-edit accept/skip status, so the source of every change to best_skill.md is recoverable after the fact.

“every step also records an edit_apply_report.jsoncontaining per-edit accept/skip status, so the source of every change to best_skill.md is recoverable after the fact.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The candidate is evaluated on the selection split and is accepted only if it improves the current selection score; the best accepted skill is exported as best_skill.md.

“The candidate is evaluated on the selection split and is accepted only if it improves the current selection score; the best accepted skill is exported as best_skill.md.”

• AssumptionRests on an assumption: The held-out selection split is representative enough that improvement on it predicts improvement on the test split.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Dataset-backed benchmarks use deterministic train/selection/test splits, with a default 2:1:7 split when no benchmark-specific split is stated.

“Dataset-backed benchmarks use deterministic train/selection/test splits, with a default 2:1:7 split when no benchmark-specific split is stated.”

May combine two claims.

The validation gate is doing real work: the optimizer model proposes many more edits per epoch, but only a handful pass the held-out check and survive into the deployed skill.

“This is direct evidence that the validation gate is doing real work: the optimizer model proposes many more edits per epoch, but only a handful pass the held-out check and survive into the deployed skill.”

May combine two claims.

Even the longest learned skill is well below a typical system-prompt budget for modern frontier models, and the shortest one fits inside a single screen.

“Even the longest learned skill is well below a typical system-prompt budget for modern frontier models, and the shortest one fits inside a single screen.”

• AssumptionThe authors state this as an assumption: The trainable object should remain a small, inspectable text document.

Classified as probably not a substantial claim. May combine two claims.

The selection split is used only for model selection over candidate skills; all headline scores are computed on held-out test data.

“The selection split is used only for model selection over candidate skills; all headline scores are computed on held-out test data.”

• AssumptionRests on an assumption: The held-out selection split is representative enough that improvement on it predicts improvement on the test split.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The task-execution model is fixed; only the text skill changes.

“First, the task-execution model is fixed; only the text skill changes.”

Classified as probably not a substantial claim. May combine two claims.

Only the epoch-boundary slow-update process may rewrite that section, and the rewritten skill still passes through the same held-out selection gate before it can become the current skill.

“Only the epoch-boundary slow-update process may rewrite that section, and the rewritten skill still passes through the same held-out selection gate before it can become the current skill.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The learned rules read like rules a thoughtful human practitioner would write after a day with the benchmark, except they are produced automatically by the optimizer and validated edit-by-edit on held-out data.

“Third, they read like rules a thoughtful human practitioner would write after a day with the benchmark-except they are produced automatically by the optimizer and validated edit-by-edit on held-out data.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Entries not measured under the final aligned protocol are marked as - rather than mixed with incompatible runs.

“Entries not measured under the final aligned protocol are marked as -rather than mixed with incompatible runs.”

Classified as probably not a substantial claim.

This design improves deployment simplicity.

“This design improves deployment simplicity, but a single skill may be insufficient for highly heterogeneous domains that require many disjoint procedures.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

TextGrad and GEPA are reflective prompt-optimization baselines for direct-chat settings.

“TextGrad and GEPA are reflective prompt-optimization baselines for direct-chat settings.”