MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement

May combine two claims.

SWE-bench Pro increases from 32.0 to 44.6, and AutomationBench from 5.0% to 30.3%.

“SWE-bench Pro (Deng et al., 2025) increases from 32.0 to 44.6, and AutomationBench from 5.0% to 30.3%.”

• cites Deng et al., 2025 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

MiMo-V2.6-Flash is a 310B-parameter Mixture-of-Experts model with 15B active parameters.

“MiMo-V2.6-Flash, a 310B-parameter Mixture-of-Experts model with 15B active parameters”

May combine two claims.

The average@3 score on DeepSWE rises steadily with cumulative cost for both models: MiMo-V2.6-Pro improves from 58.4 to 72.6 and MiMo-V2.6-Flash from 48.7 to 65.7.

“The average@3 score on the DeepSWE benchmark (Huang and Jiang, 2026) rises steadily with cumulative cost for both models: over the course of RL, MiMo-V2.6-Pro improves from 58 . 4 to 72 . 6 and MiMo-V2.6-Flash from 48 . 7 to 65 . 7.”

• cites Huang and Jiang, 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Experiments with MiMo-V2.6-Distill-Qwen-9B demonstrate consistent RL gains across diverse tasks and agent harnesses, validating the effectiveness and generality of the proposed suite.

“Experiments with MiMo-V2.6-Distill-Qwen-9B demonstrate consistent RL gains across diverse tasks and agent harnesses, validating the effectiveness and generality of the proposed suite.”

May combine two claims.

After pre-training on more than 4T image tokens, MiMo-ViT learns strong visual representations and serves as a robust foundation for MiMo-V2.6.

“After pre-training on more than 4T image tokens, MiMo-ViT learns strong visual representations and serves as a robust foundation for MiMo-V2.6.”

Probably not a substantial claim: may not pass S4 (based).

Varying both the harness and the task improves the model generalization.

“Varying both the harness and the task improves the model generalization.”

May combine two claims.

Both MiMo-V2.6-Pro and MiMo-V2.6-Flash steadily improve their performance across the reported benchmarks as training steps increase.

“both MiMo-V2.6-Pro and MiMo-V2.6-Flash steadily improve their performance across the reported benchmarks as training steps increase”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

MiMo-V2.6-Pro is a 1.02T-parameter Mixture-of-Experts model with 42B active parameters.

“MiMo-V2.6-Pro, a 1.02T-parameter Mixture-of-Experts model with 42B active parameters”

May combine two claims.

MiMo-ViT's design substantially reduces the computational cost of high-resolution visual processing while achieving performance comparable to GA ViTs.

“This design substantially reduces the computational cost of high-resolution visual processing while achieving performance comparable to GA ViTs.”

May combine two claims.

RL post-training for MiMo-V2.6-Pro cost $2.6M and for MiMo-V2.6-Flash cost $0.9M.

“spending $2.6M and $0.9M on RL post-training for MiMo-V2.6-Pro and MiMo-V2.6-Flash, respectively.”

May combine two claims.

Both Flash and Pro achieve overall improvements on DeepSWE v1.1, AutomationBench v1.0.6, and MiMo Visual Coding during RL training, despite fluctuations between checkpoints.

“As shown in Figure 9, both Flash and Pro achieve overall improvements on DeepSWE v1.1, AutomationBench v1.0.6, and MiMo Visual Coding during RL training, despite fluctuations between checkpoints.”

May combine two claims.

When the router is trainable, a severe load-collapse problem occurs: all three expert-load metrics rise monotonically over the first 20 steps, with CV increasing from 0.78 to 2.0, peak load from 6× to 16×, and the cold-expert fraction from 0.5% to 22%.

“We observe a severe load-collapse problem when the router is trainable: all three metrics rise monotonically over the first 20 steps, with CV increasing from 0 . 78 to 2 . 0, peak load from 6 × to 16 × , and the cold-expert fraction from 0 . 5% to 22%.”

May combine two claims.

Restoring the router parameters of the step-20 checkpoint to their initial pre-RL values while keeping all other parameters unchanged recovers load balance to near-initial levels while benchmark performance remains unchanged, indicating that the collapse is driven by router drift rather than by degradation of the expert weights.

“To diagnose the cause, we restore the router parameters of the step-20 checkpoint to their initial pre-RL values while keeping all other parameters unchanged: load balance recovers to near-initial levels while benchmark performance remains unchanged, indicating that the collapse is driven by router drift rather than by degradation of the expert weights.”

May combine two claims.

This process yields thousands of environments and diverse, verifiable tasks, which are combined with other tasks for RL training.

“This process yields thousands of environments and diverse, verifiable tasks, which we combine with other tasks for RL training.”

May combine two claims.

Policies trained with online grading tended to produce smaller, more precise patches that remained within the requested scope and were easier to maintain.

“In contrast, policies trained with online grading tended to produce smaller, more precise patches that remained within the requested scope and were easier to maintain.”

May combine two claims.

A dedicated hack agent uncovered many exploit paths that had not been observed during training and that existing cleanup procedures did not cover.

“It uncovered many exploit paths that we had not observed during training and that our existing cleanup procedures did not cover.”

May combine two claims.

These gains generally accompany increasing total token counts, showing that stronger task performance develops alongside greater token usage.

“These gains generally accompany increasing total token counts, showing that stronger task performance develops alongside greater token usage.”

May combine two claims.

With online grading, pass-rate gains are sustained through step 52, while turn counts remain roughly stable and token length grows gradually.

“With online grading, pass-rate gains are sustained through step 52, while turn counts remain roughly stable and token length grows gradually.”

May combine two claims.

A group-relative length penalty improves generalization and curbs rapid growth in generated tokens during RL training.

“We find that a group-relative length penalty improves generalization and curbs rapid growth in generated tokens during RL training.”

May combine two claims.

Without online grading, turns and total token length grow rapidly, causing more trajectories to hit the length limit, making it difficult to sustain improvements in pass rate.

“Without online grading, turns and total token length grow rapidly, causing more trajectories to hit the length limit, making it difficult to sustain improvements in pass rate.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Pro was restarted after the grader became unreachable over the network after step 14.

“Pro was restarted after the grader became unreachable over the network after step 14.”

May combine two claims.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 66.2 avg@3 on SWE-bench Verified, compared to 61.1 for SFT and 60.0 for Qwen3.5-9B.

“| SWE-bench Verified | avg@3 | 60.0 | 61.1 | 66.2 |”

Probably not a substantial claim: may not pass S3 (load-bearing).

Flash was restarted after a Kubernetes failure caused pods in the Cyber-task cluster to crash between steps 15 and 16.

“Flash was also restarted after a Kubernetes failure caused pods in the Cyber-task cluster to crash between steps 15 and 16.”

May combine two claims.

Deficit-corrected scheduling (α=0.5) improves occupancy stability over Deficit-based scheduling (α=0) and collection balance over Target-based scheduling (α=1) in this workload.

“Deficit-corrected scheduling ( 𝛼 = 0 . 5) improves occupancy stability over Deficit-based scheduling ( 𝛼 = 0) and collection balance over Target-based scheduling ( 𝛼 = 1) in this workload.”

May combine two claims.

In mixed-task RL evaluation, block-6 improves global average throughput by approximately 6% over block-8, with little change in average accepted length.

“in mixed-task RL evaluation, block-6 improves global average throughput by approximately 6% over block-8, with little change in average accepted length.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Driver failures occurred during packing late in Flash as longer sequences increased per-node data volume beyond host-memory capacity.

“Driver failures occurred during packing late in Flash as longer sequences increased per-node data volume beyond host-memory capacity.”

May combine two claims.

The MiMo-V2.6 series delivers substantial improvements over MiMo-V2.5, achieving performance comparable to that of frontier models across various domains.

“The MiMo-V2.6 series delivers substantial improvements over MiMo-V2.5, achieving performance comparable to that of frontier models across various domains.”

May combine two claims.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 59.9 avg@3 on MiMo Code Bench (mini), compared to 51.6 for SFT and 19.5 for Qwen3.5-9B.

“| MiMo Code Bench (mini) | avg@3 | 19.5 | 51.6 | 59.9 |”

May combine two claims.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 52.8 avg@1 on Terminal Bench 2.1, compared to 37.1 for SFT and 27.0 for Qwen3.5-9B.

“| Terminal Bench 2.1 | avg@1 | 27.0 | 37.1 | 52.8 |”

May combine two claims.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 47.0 avg@3 on MiMo Cyber Bench (mini), compared to 31.3 for SFT and 5.7 for Qwen3.5-9B.

“| MiMo Cyber Bench (mini) | avg@3 | 5.7 | 31.3 | 47.0 |”

Probably not a substantial claim: may not pass S3 (load-bearing).

At a typical topp of 0.97, a candidate set averages fewer than five tokens.

“at a typical topp of 0.97, a candidate set averages fewer than five tokens.”

May combine two claims. The quote only partly states this claim.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 38.0 avg@1 on Toolathlon-Verified, compared to 35.2 for SFT and 25.9 for Qwen3.5-9B.

“| Toolathlon-Verified | avg@1 | 25.9 | 35.2 | 38.0 |”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The four training sets contain approximately 7k tasks in total, with the general-domain set focusing on knowledge work.

“The four training sets contain approximately 7k tasks in total, with the general-domain set focusing on knowledge work.”

May combine two claims.

Freezing the router for RL training keeps all three expert-load statistics flat (CV ≈ 0.7, peak load ≈ 5.5×, cold fraction near 1%) with benchmark performance growing normally.

“We therefore freeze the router for RL training; the frozen-router run keeps all three statistics flat (CV ≈ 0 . 7, peak load ≈ 5 . 5 × , cold fraction near 1%) with benchmark performance growing normally.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The training resources additionally include approximately 1k music-generation tasks, which support the GRPO experiments reported below.

“The training resources additionally include approximately 1k music-generation tasks, which support the GRPO experiments reported below.”

May combine two claims.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 47.6 avg@3 on SWE-bench Pro, compared to 44.6 for SFT and 32.0 for Qwen3.5-9B.

“| SWE-bench Pro | avg@3 | 32.0 | 44.6 | 47.6 |”

May combine two claims.

Training failures were GPU out-of-memory (OOM) errors from MoE imbalance within a micro-batch: at one layer, an expert-parallel (EP) rank received over 30× the mean token load despite a relatively balanced full batch.

“Training failures were GPU out-of-memory (OOM) errors from MoE imbalance within a micro-batch: at one layer, an expert-parallel (EP) rank received over 30 × the mean token load despite a relatively balanced full batch.”

May combine two claims.

Across 25 profiled data sources, the mean generated tokens and the active rollout duration vary by 90× and 66×, respectively.

“Across 25 profiled data sources, the mean generated tokens and the active rollout duration vary by 90 × and 66 × , respectively (Figure 15), motivating scheduling that adapts to each source's workload.”

May combine two claims.

Although packing was distributed across nodes, local memory demand still caused CPU OOM and interrupted the run.

“Although packing was distributed across nodes (§6.2), local memory demand still caused CPU OOM and interrupted the run.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Infrastructure failures were primarily GPU-memory double-bit errors (DBEs).

“Infrastructure failures were primarily GPU-memory double-bit errors (DBEs).”

May combine two claims.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 33.1 avg@1 on AutomationBench v1.0.6, compared to 30.3 for SFT and 5.0 for Qwen3.5-9B.

“| AutomationBench v1.0.6 | avg@1 | 5.0 | 30.3 | 33.1 |”

May combine two claims.

Rollout failures arose in the partial-rollout setting: shorter rollouts completed first after startup, biasing length estimates in Predictive Rollout Dispatch and exhausting both the GPU and pinned host-memory KV pools.

“Rollout failures arose in the partial-rollout setting: shorter rollouts completed first after startup, biasing length estimates in Predictive Rollout Dispatch (§6.3) and exhausting both the GPU and pinned host-memory KV pools.”

May combine two claims.

Both R3 and topp candidate-set replay incur negligible overhead, as the payloads stay compact and move off the critical path.

“Both R3 and topp candidate-set replay incur negligible overhead, as the payloads stay compact and move off the critical path.”

May combine two claims.

MiMo-V2.6-Distill-Qwen-9B improves on Qwen3.5-9B in all 21 dataset-harness pairs, and multi-harness RL further improves every pair.

“MiMo-V2.6-Distill-Qwen-9B improves on Qwen3.5-9B in all 21 datasetharness pairs, and multi-harness RL further improves every pair.”

May combine two claims.

The mixture contains 77.4 billion total tokens, including 27.2 billion loss tokens that contribute to the SFT objective.

“The mixture contains 77.4 billion total tokens, including 27.2 billion loss tokens that contribute to the SFT objective.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

The HR management interface in (c) suffers from clear layout issues.

“Notably, the HR management interface in (c) suffers from clear layout issues.”

May combine two claims. The quote only partly states this claim.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 72.4 avg@1 on MiMo Visual Coding (mini), compared to 64.0 for SFT and 61.7 for Qwen3.5-9B.

“| MiMo Visual Coding (mini) | avg@1 | 61.7 | 64.0 | 72.4 |”

May combine two claims.

+ Multi-Harness RL achieves a mean of 59.0 on MiMo Code Bench (mini), compared to 53.1 for MiMo-V2.6-Distill-Qwen-9B and 15.3 for Qwen3.5-9B.

“| Qwen3.5-9B | 19.0 | 7.5 | 16.5 | 22.5 | 10.5 | 13.5 | 17.5 | 15.3 |”

• Also stated in: § 7.2 RL with Open Environments · p. 35 · plain

  “| MiMo-V2.6-Distill-Qwen-9B | 53.2 | 56.7 | 51.5 | 56.3 | 46.0 | 51.2 | 56.8 | 53.1 |”

• Also stated in: § 7.2 RL with Open Environments · p. 35 · plain

  “| + Multi-Harness RL | 62.5 | 64.5 | 57.0 | 63.3 | 50.7 | 53.0 | 62.0 | 59.0 |”

May combine two claims.

After distillation, MiMo-V2.6-Distill-Qwen-9B (SFT) generates websites with noticeably richer content, more harmonious color palettes, and more effective incorporation of image assets.

“After distillation, MiMo-V2.6-Distill-Qwen-9B (SFT) (middle column) generates websites with noticeably richer content, more harmonious color palettes, and more effective incorporation of image assets”

May combine two claims.

RL gains are consistent across domains and harnesses.

“Consistent RL gains across domains and harnesses highlight the value of these resources as a shared foundation for further experimentation.”

May combine two claims. The quote only partly states this claim.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 24.8 avg@1 on OfficeQA Pro, compared to 19.5 for SFT and 9.0 for Qwen3.5-9B.

“| OfficeQA Pro | avg@1 | 9.0 | 19.5 | 24.8 |”

May combine two claims.

+ Multi-Harness RL achieves a mean of 65.7 on SWE-bench Verified, compared to 62.3 for MiMo-V2.6-Distill-Qwen-9B and 53.1 for Qwen3.5-9B.

“| Qwen3.5-9B | 58.4 | 36.4 | 54.8 | 57.8 | 48.6 | 54.8 | 60.6 | 53.1 |”

• Also stated in: § 7.2 RL with Open Environments · p. 35 · plain

  “| MiMo-V2.6-Distill-Qwen-9B | 61.7 | 63.9 | 61.7 | 63.1 | 58.5 | 61.7 | 65.3 | 62.3 |”

• Also stated in: § 7.2 RL with Open Environments · p. 35 · plain

  “| + Multi-Harness RL | 67.9 | 65.1 | 66.6 | 67.2 | 61.1 | 65.3 | 66.7 | 65.7 |”

Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

Websites produced by Qwen3.5-9B appear relatively plain in visual design, with simplistic layouts and minimal use of imagery.

“As shown in the left column, websites produced by Qwen3.5-9B appear relatively plain in visual design, with simplistic layouts”

May combine two claims. The quote only partly states this claim.

+ Multi-Harness RL achieves a mean of 46.5 on SWE-bench Pro, compared to 44.4 for MiMo-V2.6-Distill-Qwen-9B and 27.5 for Qwen3.5-9B.

“| Qwen3.5-9B | 33.5 | 15.2 | 31.1 | 31.1 | 23.1 | 26.9 | 31.6 | 27.5 |”

• Also stated in: § 7.2 RL with Open Environments · p. 35 · plain

  “| MiMo-V2.6-Distill-Qwen-9B | 45.2 | 46.6 | 45.1 | 45.5 | 40.3 | 42.2 | 45.6 | 44.4 |”

• Also stated in: § 7.2 RL with Open Environments · p. 35 · plain

  “| + Multi-Harness RL | 48.5 | 46.9 | 47.6 | 48.0 | 42.6 | 43.1 | 48.4 | 46.5 |”

May combine two claims. The quote only partly states this claim.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 70.6 avg@1 on MiMo General Bench (mini), compared to 62.2 for SFT and 28.5 for Qwen3.5-9B.

“| MiMo General Bench (mini) | avg@1 | 28.5 | 62.2 | 70.6 |”

May combine two claims. The quote only partly states this claim.

MiMo-V2.6-Distill-Qwen-9B (RL) achieves 25.2 avg@1 on JobBench, compared to 18.3 for SFT and 2.6 for Qwen3.5-9B.

“| JobBench | avg@1 | 2.6 | 18.3 | 25.2 |”

Probably not a substantial claim: may not pass S3 (load-bearing).

Prior work reports that switching an Adam-pre-trained model to Muon training can cause optimizer mismatch and degraded performance.

“Prior work reports that switching an Adam-pre-trained model to Muon training can cause optimizer mismatch and degraded performance (Qu et al., 2026).”

• cites Qu et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Scaling RL compute substantially unlocks model potential on both verifiable tasks such as coding and less verifiable tasks such as web development.

“Scaling RL compute substantially unlocks model potential on both verifiable tasks such as coding and less verifiable tasks such as web development.”

May combine two claims.

MiMo-V2.6 is capable of stronger complex problem solving and more reliable performance in daily co-work scenarios, reflecting more general agentic intelligence.

“These gains indicate that MiMo-V2.6 is capable of stronger complex problem solving and more reliable performance in daily co-work scenarios, reflecting more general agentic intelligence.”

May combine two claims.

Muon's matrix-based update retains stronger data efficiency beyond the critical-batch-size regime, making Muon particularly attractive for large-batch training.

“This matrix-based update retains stronger data efficiency beyond the critical-batch-size regime, making Muon particularly attractive for large-batch training (Liu et al., 2025b; Shah et al., 2025).”

• cites Liu et al., 2025bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Shah et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

MXFP4 quantization-aware training during mid-training allows the model to adapt to low-precision computation while preserving model quality.

“We employ MXFP4 quantization-aware training (QAT) during mid-training, allowing the model to adapt to low-precision computation while preserving model quality.”

May combine two claims.

A large batch is good for scaling out GPUs: rollout parallelizes over sequences and training shards the batch across data-parallel ranks, so throughput grows with the GPU count.

“A large batch is good for scaling out GPUs: rollout parallelizes over sequences and training shards the batch across data-parallel ranks, so throughput grows with the GPU count.”

May combine two claims.

MiMo-ViT's sink-augmented SWA enables information exchange across window boundaries over successive layers and mitigates visual fragmentation.

“It replaces fixed, non-overlapping window attention in MiMo-VL-7B (Yue et al., 2025) with sink-augmented SWA, enabling information exchange across window boundaries over successive layers and mitigating visual fragmentation.”

• cites Yue et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Muown augments Muon with explicit row-norm control, mitigating spectral-norm drift and reducing sensitivity to weight decay at negligible overhead.

“Muown augments Muon with explicit row-norm control, mitigating spectral-norm drift and reducing sensitivity to weight decay at negligible overhead (Lion et al., 2026).”

• cites Lion et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Muon leverages the matrix structure of hidden weights by orthogonalizing their updates.

“Muon leverages the matrix structure of hidden weights by orthogonalizing their updates (Jordan et al., 2024).”

• cites Jordan et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Executable evaluation alone does not guarantee reliable supervision: tests may overlook required behavior, reject valid implementations, or yield inconsistent outcomes across executions.

“However, executable evaluation alone does not guarantee reliable supervision: tests may overlook required behavior, reject valid implementations, or yield inconsistent outcomes across executions.”

Classified as probably not a substantial claim.

Iterative hack-agent screening continued until the hack agent could no longer find a successful exploit in any of the environments.

“We continued this process until the hack agent could no longer find a successful exploit in any of the environments.”

May combine two claims.

The difficulty in vulnerability reproduction is not triggering a crash, since complex C/C++ projects expose dozens of reachable crash paths, but triggering the specific vulnerability described.

“The difficulty is not triggering a crash, since complex C/C++ projects expose dozens of reachable crash paths, but triggering the specific vulnerability described.”

• AssumptionRests on an assumption: Complex C/C++ projects expose dozens of reachable crash paths.

May combine two claims.

Production harness modules are tightly coupled rather than independently configurable, so one cannot vary a single interaction mechanism in isolation or assemble diversity by controlled recombination.

“Second, their modules are tightly coupled rather than independently configurable, so one cannot vary a single interaction mechanism in isolation or assemble diversity by controlled recombination.”

Classified as probably not a substantial claim. May combine two claims.

The diversity of valid creative solutions makes aesthetic quality difficult to capture through fixed rules alone; therefore the paper combines pointwise and groupwise grading to establish consistent quality standards while rewarding relative improvements in aesthetic quality.

“The diversity of valid creative solutions makes aesthetic quality difficult to capture through fixed rules alone. We therefore combine pointwise and groupwise grading to establish consistent quality standards while rewarding relative improvements in aesthetic quality.”

Probably not a substantial claim: may not pass S3 (load-bearing).

These safeguards are accompanied by explicit instructions against retrieving existing solutions or bypassing the required implementation.

“These safeguards are accompanied by explicit instructions against retrieving existing solutions or bypassing the required implementation.”

Classified as probably not a substantial claim. May combine two claims.

The group-relative length penalty encourages concise successful solutions using a reference adapted to each prompt, while the pass-rate gate preserves room for exploration on difficult prompts.

“This encourages concise successful solutions using a reference adapted to each prompt, while the pass-rate gate preserves room for exploration on difficult prompts.”

Classified as probably not a substantial claim.

Building a project with the reference patch applied during environment construction can leave behind artifacts that reveal the solution.

“Building a project with the reference patch applied during environment construction can leave behind artifacts that reveal the solution.”

May combine two claims.

Each sign's total advantage mass is conserved when neither scale is clipped, limiting excess negative pressure that can drive uncontrolled entropy growth.

“Each sign's total advantage mass is conserved when neither scale is clipped, limiting excess negative pressure that can drive uncontrolled entropy growth.”

Probably not a substantial claim: may not pass S4 (based). The quote only partly states this claim.

Aligning training and inference engines on MoE routing and topp sampling candidate sets supports stable RL training.

“We align the training and inference engines on MoE routing and topp sampling candidate sets, and optimize both engines for RL workloads.”

May combine two claims.

Removed positive advantage is redistributed to unflagged positive tokens, while added negative magnitude is offset by reducing penalties on unflagged negative tokens: behavior without detected errors receives more reinforcement or less punishment, depending on the trajectory's sign.

“Removed positive advantage is redistributed to unflagged positive tokens, while added negative magnitude is offset by reducing penalties on unflagged negative tokens: behavior without detected errors receives more reinforcement or less punishment, depending on the trajectory's sign.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

If a denominator is zero, its scale is set to one; conservation is not guaranteed in this case or when clipping occurs.

“If a denominator is zero, its scale is set to one; conservation is not guaranteed in this case or when clipping occurs.”

May combine two claims.

Disagreements between the auditor's assessment and observed reward identify tasks requiring further review and provide concrete evidence of possible mismatches between intended behavior and implemented verification.

“These disagreements identify tasks requiring further review and provide concrete evidence of possible mismatches between the intended behavior and the implemented verification.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

A sample mixing mechanism, working with dynamic sampling and partial rollout, stabilizes per-task sample composition in train batches.

“A sample mixing mechanism, working together with dynamic sampling and partial rollout, stabilizes per-task sample composition in train batches.”

May combine two claims.

Failed trajectories retain zero reward, while passing trajectories are further distinguished by implementation quality and problem-solving behavior.

“Failed trajectories retain zero reward, while passing trajectories are further distinguished by implementation quality and problem-solving behavior.”

Classified as probably not a substantial claim. May combine two claims.

The paper's general-agent environment design balances realism with large-scale RL requirements: files, software behavior, and underlying data reflect professional practice, while execution remains local and environments are easy to reset.

“Our design balances realism with the requirements of large-scale RL: files, software behavior, and underlying data should reflect professional practice, while execution must remain local and environments must be easy to reset.”

May combine two claims.

Fix-binary differential testing, as used in CyberGym (Wang et al., 2025), accepts a PoC that crashes the vulnerable binary but not the patched one; an incomplete patch rejects correct PoCs, and unrelated changes between the two commits flip verdicts for reasons unconnected to the bug.

“Fix-binary differential testing, as used in CyberGym (Wang et al., 2025), accepts a PoC that crashes the vulnerable binary but not the patched one; an incomplete patch rejects correct PoCs, and unrelated changes between the two commits flip verdicts for reasons unconnected to the bug.”

• cites Wang et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

These workarounds aim to increase the likelihood of passing test but can exceed the scope of the task instructions, expand APIs unnecessarily, obscure failures, and make the code harder to maintain.

“These workarounds aim to increase the likelihood of passing test but can exceed the scope of the task instructions, expand APIs unnecessarily, obscure failures, and make the code harder to maintain.”

Probably not a substantial claim: may not pass S4 (based).

Realizing recursive self-improvement requires agents that couple models with interactive environments and supply multi-step trajectories and feedback signals.

“Realizing this vision requires agents, which couple models with interactive environments and thereby supply the multi-step trajectories and feedback signals that self-improvement depends on.”

• AssumptionRests on an assumption: RL is the central training paradigm for advancing large foundation models towards self-improvement.

May combine two claims.

Agent harnesses differ in module design and are selected or built to meet different application needs; models must therefore adapt to diverse interaction mechanisms, including those of harnesses unseen during training, making cross-harness generalization an important capability.

“Agent harnesses differ in module design and are selected or built to meet different application needs. Models must therefore adapt to diverse interaction mechanisms, including those of harnesses unseen during training, making cross-harness generalization an important capability.”

May combine two claims.

The paper extracts two attributes from the ground-truth sanitizer report: the vulnerability type and the crash location (the topmost project-level stack frame). A PoC is accepted iff its crash matches both under rule-based string matching, which is deterministic, reproducible, and computationally trivial.

“We instead extract two attributes from the ground-truth sanitizer (ASan/MSan/UBSan) report: the vulnerability type (e.g., heap-buffer-overflow) and the crash location (the topmost project-level stack frame). A PoC is accepted iff its crash matches both under rule-based string matching, which is deterministic, reproducible, and computationally trivial.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The paper reuses the previous rollout pipeline to collect agent trajectories to investigate potential reward hacking, and the submitted patches and conversation logs provide evidence of how agents obtained their rewards, helping identify unintended shortcuts or exploitation.

“We also reuse the previous rollout pipeline to collect agent trajectories to investigate potential reward hacking. The submitted patches and conversation logs provide evidence of how agents obtained their rewards, helping identify unintended shortcuts or exploitation of the environment and evaluation process.”

Probably not a substantial claim: may not pass S4 (based).

Providing the compiled harness binary mirrors real vulnerability analysis, where a researcher runs the target under a debugger, inspects memory, and crafts mutations from runtime observations.

“providing it mirrors real vulnerability analysis, where a researcher runs the target under a debugger, inspects memory, and crafts mutations from runtime observations.”

Classified as probably not a substantial claim. May combine two claims.

Meeting the requirements for diverse RL environments jointly is challenging because realistic workflows involve heterogeneous tools and complex state, while automated graders may be incomplete, inconsistent, or vulnerable to exploitation.

“Meeting these requirements jointly is challenging: realistic workflows involve heterogeneous tools and complex state, while automated graders may be incomplete, inconsistent, or vulnerable to exploitation.”

May combine two claims.

Production harnesses wrap the agent loop with engineering safeguards and multi-step workflows, and steer the model with numerous constraint and instruction prompts; these extras fall outside the task-completion reward signal, making credit assignment unreliable and leaving reward-unmeasured requirements ignored.

“First, production harnesses wrap the agent loop with engineering safeguards and multi-step workflows, and steer the model with numerous constraint and instruction prompts. These extras fall outside the task-completion reward signal, making credit assignment unreliable and leaving reward-unmeasured requirements to simply be ignored.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In general-agent task synthesis, task completion is evaluated using atomic, binary rubric items: code-based checks verify deterministic properties, while LLM-based checks assess more open-ended content; for LLM-based items, agreement across repeated judgments by the same model and across different judge models helps identify ambiguity.

“Task completion is evaluated using atomic, binary rubric items: code-based checks verify deterministic properties, such as database values and deliverable formats, while LLM-based checks assess more open-ended content. For LLM-based items, agreement across repeated judgments by the same model and across different judge models helps identify ambiguity.”

May combine two claims.

Verification for vulnerability reproduction must separate the intended bug from unrelated crashes, and because it doubles as the RL reward, it must be accurate, deterministic, and cheap.

“Verification must therefore separate the intended bug from unrelated crashes, and because it doubles as the RL reward, it must be accurate, deterministic, and cheap.”

Classified as probably not a substantial claim. May combine two claims.

Mid-training bridges the general foundation and subsequent large-scale RL by further developing the model's agentic abilities, extending long-context support, and adapting the optimization setup for large-batch training.

“Mid-training bridges this general foundation and subsequent large-scale RL by further developing the model's agentic abilities, extending long-context support, and adapting the optimization setup for large-batch training.”

May combine two claims.

Training exclusively within a single harness may couple task-solving strategies to harness-specific implementations and limit transfer.

“Training exclusively within a single harness may couple task-solving strategies to harness-specific implementations and limiting transfer.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Freezing the MoE router and establishing a multi-layer defense against reward hacking keeps training stable at scale.

“To keep training stable at scale, we freeze the MoE router and establish a multi-layer defense against reward hacking.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

In coding tasks, agents may pass tests by recovering leaked solutions from the environment or retrieving existing solutions over the network.

“In coding tasks, agents may pass tests by recovering leaked solutions from the environment or retrieving existing solutions over the network.”

Classified as probably not a substantial claim.

Coding tasks are particularly well suited to RL, as candidate solutions can be executed and evaluated through automated tests, providing feedback at scale.

“Coding tasks are particularly well suited to RL, as candidate solutions can be executed and evaluated through automated tests, providing feedback at scale.”

Classified as probably not a substantial claim.

A choice made by one successful solution does not automatically become a requirement for all others.

“At the same time, a choice made by one successful solution does not automatically become a requirement for all others.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

A unified trajectory representation and a penalty mechanism together refine the learning signal.

“we design a unified trajectory representation and a penalty mechanism that together refine the learning signal.”

Classified as probably not a substantial claim. May combine two claims.

The paper removes build logs, verifier outputs, residual patches, and project-generated binaries or bytecode that could expose the solution; cleans caches that may contain solution information; retains Git history up to and including the base commit, removing later commits and their associated references; and enforces container-level network isolation to restrict access to upstream fixes and other

“We therefore remove build logs, verifier outputs, residual patches, and projectgenerated binaries or bytecode that could expose it. We also clean caches that may contain solution information, including those outside the repository, while preserving third-party dependencies needed for offline rebuilding. For every task, we retain Git history up to and including the base commit, removing later”

May combine two claims.

The task description is derived from the same sanitizer report, stating the exact type and function in which the crash must occur, so description and verification share a single source of truth; CyberGym's LLM-generated descriptions, by contrast, are often too broad or simply wrong.

“The task description is derived from the same report, stating the exact type and function in which the crash must occur, so description and verification share a single source of truth; CyberGym's LLM-generated descriptions, by contrast, are often too broad (e.g., 'buffer overflow in libxml2') or simply wrong.”

Classified as probably not a substantial claim. May combine two claims.

For tasks with a reference patch, the paper ensures fail-to-pass tests fail and pass-to-pass tests pass before applying the reference patch, and both pass after the patch; these outcomes must remain stable across eight reruns, screening for flaky tests and environment-induced reward fluctuations.

“For those tasks with reference patch, we ensure fail-to-pass (F2P) tests must fail and pass-to-pass (P2P) tests must pass before applying the reference patch; after the patch, both must pass. We require these outcomes to remain stable across eight reruns, screening for flaky tests and environment-induced reward fluctuations.”

Classified as probably not a substantial claim. May combine two claims.

The paper proposes multi-harness training with mini-harnesses that all start from the same minimal agent loop including system prompt, tools, and context management; these modules stay minimal and decoupled, so implementations can be freely recombined and harness expansion remains controllable, safe, and clean.

“we propose multi-harness training with carefully designed mini-harnesses. All miniharnesses start from the same minimal agent loop, which already includes the components needed for task completion-system prompt, tools, and context management. These modules stay minimal and decoupled, so implementations can be freely recombined and harness expansion remains controllable, safe, and clean.”

May combine two claims.

Consistency alone does not establish that rubrics capture task completion; therefore the paper collects rollouts from models with different capability levels and has a review agent examine trajectories, execution results, and rubric judgments, revising overly restrictive and overly permissive criteria.

“Consistency alone does not establish that rubrics capture task completion. We therefore collect rollouts from models with different capability levels and have a review agent examine their trajectories, execution results, and rubric judgments. The reviewer revises overly restrictive criteria that reject valid solutions and overly permissive criteria that accept incomplete ones.”

Classified as probably not a substantial claim. May combine two claims.

To test resistance to reward hacking, the paper includes negative checks for unintended changes to unrelated files or databases and constructs adversarial solutions that appear correct without actually solving the task.

“To test resistance to reward hacking, we include negative checks for unintended changes to unrelated files or databases and construct adversarial solutions that appear correct without actually solving the task.”

Probably not a substantial claim: may not pass S3 (load-bearing).

During RL, a self-hosted MiMo-V2.6-SFT model serves as the grader to support stable scoring.

“During RL, a self-hosted MiMo-V2.6-SFT model serves as the grader to support stable scoring.”

May combine two claims.

The segment-level behavioral penalties mask flagged tokens in positive trajectories and penalize them more strongly in negative trajectories.

“This masks flagged tokens in positive trajectories and penalizes them more strongly in negative trajectories.”

Probably not a substantial claim: may not pass S4 (based).

A Sample Mixer ensures efficient and stable training batch distribution given various rollout durations and pass rates of different tasks.

“In multi-task RL, we implement a Sample Mixer to ensure efficient and stable training batch distribution given various rollout durations and pass rates of different tasks.”

Classified as probably not a substantial claim. May combine two claims.

All state in general-agent environments is stored locally, and each rollout runs in an isolated sandbox that can be restored to a fixed initial state, avoiding network variability and service limits while supporting reproducible execution.

“All state is stored locally, and each rollout runs in an isolated sandbox that can be restored to a fixed initial state. This avoids network variability and service limits while supporting reproducible execution.”

May combine two claims.

Together, these procedures support the construction of a diverse coding-task corpus under a consistent standard of supervision quality; specification-test alignment targets fidelity of the reward signal, repeated execution checks its stability, and rollout-based auditing probes whether it agrees with an independent assessment of solution correctness.

“Together, these procedures support the construction of a diverse coding-task corpus under a consistent standard of supervision quality. Specification-test alignment targets the fidelity of the reward signal, repeated execution checks its stability, and rollout-based auditing probes whether it agrees with an independent assessment of solution correctness.”

Probably not a substantial claim: may not pass S4 (based).

An agent-centric mid-training phase expands the exploration space for agentic tasks, enabling the model to discover more effective task-solving trajectories during post-training.

“We further introduce an agent-centric mid-training phase that expands the exploration space for agentic tasks, enabling the model to discover more effective task-solving trajectories during post-training.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Scaling agentic RL requires diverse environments that reflect real-world tasks, support reproducible execution at training scale, and provide rewards aligned with task objectives.

“Scaling agentic RL requires diverse environments that reflect real-world tasks, support reproducible execution at training scale, and provide rewards aligned with task objectives.”

May combine two claims.

The uncapped update preserves the sum of advantages over passing trajectories and the quality-induced relative weights without altering failed trajectories.

“This uncapped update preserves 𝑖 ∈P 𝐴 ′ 𝑖 = 𝑖 ∈P 𝐴𝑖 and the quality-induced relative weights without altering failed trajectories.”

May combine two claims.

The central challenge is to scale task construction while ensuring that rewards faithfully reflect task correctness.

“The central challenge is therefore to scale task construction while ensuring that rewards faithfully reflect task correctness.”

May combine two claims.

Simply downweighting positive advantages leaves negative advantages unchanged; renormalization restores their balance as a safeguard against excessive entropy growth.

“Simply downweighting positive advantages leaves negative advantages unchanged; renormalization restores their balance as a safeguard against excessive entropy growth.”

Classified as probably not a substantial claim. May combine two claims.

Inspection alone may miss discrepancies between specifications and tests, so the paper assesses their alignment through rollout-based auditing.

“As inspection alone may miss discrepancies between specifications and tests, we further assess their alignment through rollout-based auditing.”

Probably not a substantial claim: may not pass S4 (based).

Scaling RL on complex agentic tasks opens a concrete path to recursive self-improvement.

“Towards this goal, scaling reinforcement learning (RL) on complex agentic tasks thus opens a concrete path.”

• AssumptionRests on an assumption: RL is the central training paradigm for advancing large foundation models towards self-improvement.

May combine two claims.

The gap between the mean performance on training and held-out harnesses narrows, providing evidence that the learned coding capabilities transfer across harness implementations.

“The gap between the mean performance on training and held-out harnesses also narrows, providing evidence that the learned coding capabilities transfer across harness implementations.”

May combine two claims.

The paper derives diverse, task-adapted mini-harness configurations for Code, General, Visual, and Cyber; the resulting training distribution is diverse yet controllable, supporting analysis of individual harness mechanisms and encouraging transferable task-solving strategies.

“We then derive diverse, task-adapted mini-harness configurations for Code, General, Visual, and Cyber. The resulting training distribution is diverse yet controllable, supporting analysis of individual harness mechanisms and encouraging transferable task-solving strategies.”

Probably not a substantial claim: may not pass S4 (based).

MOPD2 extends the capabilities of the RL-trained model to domains where reliable training-time verification is challenging, including those with complex environments or verifiers that are difficult to design, such as long-horizon game development, scientific research, and embodied intelligence.

“MOPD2further extends the capabilities of the RL-trained model to domains where reliable trainingtime verification is challenging, including those with complex environments or verifiers that are difficult to design, such as long-horizon game development, scientific research, and embodied intelligence.”

• AssumptionRests on an assumption: Reliable training-time verification is challenging for domains with complex environments or verifiers that are difficult to design.

May combine two claims.

The fixed shape of the topp bitmap avoids a GPU-CPU synchronization; the full width never truncates even a set that spans the whole vocabulary.

“The fixed shape avoids a GPU-CPU synchronization; the full width never truncates even a set that spans the whole vocabulary.”

May combine two claims.

Our experiments show substantial gains across multiple domains, demonstrating the value of these resources for RL training.

“Our experiments show substantial gains across multiple domains, demonstrating the value of these resources for RL training.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

HBM is thereby devoted to running requests as far as possible: the larger the decode batch, the higher the arithmetic intensity and compute utilization.

“HBM is thereby devoted to running requests as far as possible: the larger the decode batch, the higher the arithmetic intensity and compute utilization.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Freezing the router during RL training maintains stable expert loads.

“During RL training, we freeze the router to maintain stable expert loads.”

May combine two claims.

The quantization follows the numeric constraints of the MXFP4 Humming GEMM kernels used during rollout, so the two engines see identical expert weights.

“The quantization follows the numeric constraints of the MXFP4 Humming GEMM kernels (vLLM Project, 2026) used during rollout, so the two engines see identical expert weights.”

• cites vLLM Project, 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

This limits redundant payload movement while accommodating uneven multi-modal workloads.

“This limits redundant payload movement while accommodating uneven multi-modal workloads.”

Probably not a substantial claim: may not pass S4 (based).

Prompt-mean aggregation prevents response length from growing too quickly during RL.

“For loss aggregation we use prompt-mean aggregation, which averages the surrogate at the prompt level rather than over all response tokens; this prevents response length from growing too quickly during RL.”

Classified as probably not a substantial claim. May combine two claims.

This avoids full-batch aggregation on the driver and dense padded intermediates during packing.

“This avoids full-batch aggregation on the driver and dense padded intermediates during packing.”

May combine two claims.

These results highlight the value of high-quality training data and a strong SFT initialization for further improvement through RL.

“These results highlight the value of high-quality training data and a strong SFT initialization for further improvement through RL.”

Probably not a substantial claim: may not pass S4 (based).

Carrying over FP32 master weights and Muown's row state from the SFT checkpoint stabilizes MXFP4 training.

“To stabilize MXFP4 training, we initialize RL by carrying over the FP32 master weights and Muown's row state from the SFT checkpoint.”

Classified as probably not a substantial claim. May combine two claims.

Demonstrations supply the context, while the student generates its own continuation rather than imitating a fixed response.

“Demonstrations supply the context, while the student generates its own continuation rather than imitating a fixed response.”

May combine two claims.

Restricting replay to the first collection step reduces the wait for slow sources while preserving the specified training distribution.

“Restricting replay to the first collection step reduces the wait for slow sources while preserving the specified training distribution.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

We maintain alignment between the two engines in mixture-of-experts (MoE) routing and probability normalization.

“We maintain alignment between the two engines in mixture-of-experts (MoE) routing and probability normalization.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

These evaluation sets follow the same task distributions as their corresponding training sets.

“These evaluation sets follow the same task distributions as their corresponding training sets.”

May combine two claims.

This amortizes process and service overhead across concurrent rollouts, supporting larger concurrent batches without a proportional increase in actor count.

“This amortizes process and service overhead across concurrent rollouts, supporting larger concurrent batches without a proportional increase in actor count.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Tuning importance sampling bounds based on policy entropy pulls entropy back to the normal range.

“Positive and negative bounds are both initialized to [ 0 . 2 , 5 . 0 ] and tuned independently at runtime based on policy entropy: when entropy is too low, we widen the positive bounds and narrow the negative ones to pull entropy back to the normal range, and we do the opposite when entropy is too high.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

We bound this expectation by the max running requests used for CUDA graph capture, limiting queueing delays that prolong rollout lifetimes and increase staleness.

“We bound this expectation by the max running requests used for CUDA graph capture, limiting queueing delays that prolong rollout lifetimes and increase staleness.”

May combine two claims.

We record each token's candidate set during rollout and renormalize the training log-probabilities within it, matching the sampler's normalization.

“we record each token's candidate set during rollout (Liu et al., 2025a; The Microsoft AI Team, 2026) and renormalize the training log-probabilities within it, matching the sampler's normalization.”

• cites Liu et al., 2025aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites The Microsoft AI Team, 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Offloading and restoration run on side CUDA streams rather than the compute stream, never stalling generation.

“Offloading and restoration run on side CUDA streams rather than the compute stream, never stalling generation.”

Probably not a substantial claim: may not pass S2 (checkable).

The MiMo-V2.6 series demonstrates the potential of reinforcement learning to substantially advance agentic capabilities.

“The MiMo-V2.6 series demonstrates the potential of reinforcement learning to substantially advance agentic capabilities.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The fusion of all loss computation into one kernel saves memory and reduces step time.

“The fusion saves memory and reduces step time.”

May combine two claims.

The progressive qualitative improvements in generated websites align with the quantitative trajectory (61.7 → 64.0 → 72.4) observed in Table 6, jointly demonstrating the cumulative benefits of distillation from MiMo-V2.6 followed by RL in enhancing both the aesthetic quality and functional completeness of generated outputs.

“These progressive qualitative improvements align with the quantitative trajectory (61 . 7 → 64 . 0 → 72 . 4) observed in Table 6, jointly demonstrating the cumulative benefits of distillation from MiMo-V2.6 followed by RL in enhancing both the aesthetic quality and functional completeness of generated outputs.”

May combine two claims.

The advances described enable sustained optimization over long-horizon interactions while improving solution quality and token efficiency.

“Together, they enable sustained optimization over long-horizon interactions while improving solution quality and token efficiency.”