Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Model

May combine two claims.

When deployed within a general agent framework such as OpenClaw, Nanbeige4.2-3B performs well on daily assistance, office workflows, and deep research, supporting its use as a compact local assistant.

“When deployed within a general agent framework such as OpenClaw [23], it performs well on daily assistance, office workflows, and deep research, further supporting its use as a compact local assistant.”

• cites [23]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Nanbeige4.2-3B delivers strong performance across code-agent, office-agent, and complex tool-use tasks while maintaining highly competitive reasoning capabilities in mathematics, coding, and science.

“It delivers strong performance across code-agent, officeagent, and complex tool-use tasks while maintaining highly competitive reasoning capabilities in mathematics, coding, and science.”

May combine two claims.

Nanbeige4.2-3B is a compact general agentic model with 3B nonembedding parameters.

“We present Nanbeige4.2-3B,a compact general agentic model with 3B nonembedding parameters.”

May combine two claims.

Nanbeige4.2-3B achieves strong performance on complex tool-use, office-agent, and code-agent benchmarks, outperforming substantially larger Qwen3.5-9B and Gemma4-12B across diverse evaluations.

“Nanbeige4.2-3Bachieves strong performance on complex tool-use, office-agent, and code-agent benchmarks, outperforming substantially larger Qwen3.5-9B[20] and Gemma4-12B [25] across diverse evaluations.”

• cites [20]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [25]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Nanbeige4.2-3B is pretrained from scratch on 28T tokens with a Looped Transformer that reuses the layer stack to increase capacity without adding parameters.

“Nanbeige4.2-3B is pretrained from scratch on 28T tokens with a Looped Transformer that reuses the layer stack to increase capacity without adding parameters.”

May combine two claims.

Extensive evaluations show that Nanbeige4.2-3B outperforms larger models, including Qwen3.5-9B and Gemma4-12B, across diverse agentic benchmarks while remaining competitive on reasoning and alignment tasks.

“Extensive evaluations show that Nanbeige4.2-3Boutperforms larger models, including Qwen3.5-9B and Gemma4-12B, across diverse agentic benchmarks while remaining competitive on reasoning and alignment tasks.”

May combine two claims.

Nanbeige4.2-3B remains competitive in mathematical, coding, and scientific reasoning, as well as alignment.

“It also remains competitive in mathematical, coding, and scientific reasoning, as well as alignment.”

May combine two claims.

The repository-level data synthesis pipeline transforms historical GitHub development activities into executable tasks backed by automated environments, while leveraging model failure feedback to co-evolve task distribution alongside agent capabilities.

“This system transforms historical GitHub development activities into executable tasks backed by automated environments, while leveraging model failure feedback to co-evolve task distribution alongside agent capabilities.”

May combine two claims.

A two-pass configuration provides the most favorable trade-off in our experiments: relative to a standard Transformer, it retains approximately 75% of the token efficiency and provides a significant capacity gain.

“A two-pass configuration provides the most favorable trade-off in our experiments: relative to a standard Transformer, it retains approximately 75% of the token efficiency and provides a significant capacity gain.”

May combine two claims.

Across six benchmarks covering mathematical and code reasoning, alignment, software engineering, and agentic task execution, the post-RL checkpoint achieves higher accuracy while using fewer output tokens than the pre-RL checkpoint.

“As illustrated in Figure 7, among these benchmarks, the post-RL checkpoint achieves higher accuracy while using fewer output tokens.”

Borderline on S4 (based): unclear from the text.

The behavioral regularization learned from general-purpose RLHF exhibits strong generalization along two distinct dimensions.

“A central finding is that the behavioral regularization learned from general-purpose RLHF exhibits strong generalization along two distinct dimensions:”

May combine two claims.

In the 128K stage, the mixture shifts to 47.8% reasoning-oriented STEM data, 22.7% general instruction data, and 29.5% agentic data, providing a transition toward longer-context instruction following, tool use, and multi-turn environment interaction.

“In the 128K stage, the mixture shifts to 47.8% reasoning-oriented STEM data, 22.7% general instruction data, and 29.5% agentic data, providing a transition toward longer-context instruction following, tool use, and multi-turn environment interaction.”

May combine two claims.

The two-stage RLHF procedure improves task performance while producing shorter and more stable generation trajectories, as shown by three benchmarks (AA-LCR, LiveCodeBench-V6, PinchBench-V2).

“These three benchmarks consistently show that the two-stage RLHF procedure improves task performance while producing shorter and more stable generation trajectories.”

• cites [12]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

After mixed-domain SFT, the compact model still exhibits unstable generation behaviors, including repetitive reasoning, cyclic reflection, delayed termination, duplicated answers, malformed formats, and abnormal continuations.

“After mixed-domain SFT, the compact model still exhibits unstable generation behaviors, including repetitive reasoning, cyclic reflection, delayed termination, duplicated answers, malformed formats, and abnormal continuations.”

May combine two claims.

Nanbeige4.2-3B achieves the best result on five of the six reasoning benchmarks while remaining competitive on alignment tasks.

“Nanbeige4.2-3B also achieves the best result on five of the six reasoning benchmarks while remaining competitive on alignment tasks.”

May combine two claims.

With only 3B non-embedding parameters, Nanbeige4.2-3B achieves the best results on all reported general-agent and code-agent benchmarks, outperforming the larger Qwen3.5-9B and Gemma4-12B models.

“With only 3B non-embedding parameters, Nanbeige4.2-3Bachieves the best results on all reported general-agent and code-agent benchmarks, outperforming the larger Qwen3.5-9B and Gemma4-12B models.”

May combine two claims.

During agentic RL training, the normalized action error rate decreases by approximately 20%, while the overall score improves from 66.0 to a peak of 71.0.

“Meanwhile, the normalized action error rate decreases by approximately 20%, while the overall score improves from 66.0 to a peak of 71.0 during training.”

May combine two claims.

Nanbeige4.2-3B-Base consistently improves upon Nanbeige4-3B-Base and performs significantly better than other base models of similar parameter scale (Qwen3.5-4B-Base and Gemma4-E4B-Base).

“Nanbeige4.2-3B-Baseconsistently improves upon Nanbeige4-3B-Base and performs significantly better than the other base models.”

May combine two claims.

Increasing the number of passes beyond two provides only marginal additional improvement, but substantially slows training and makes optimization less stable.

“Increasing the number of passes provides only marginal additional improvement, but substantially slows training and makes optimization less stable.”

May combine two claims.

Gemma4-12B performs better on IF-Bench and Recruit-Bench, but Nanbeige4.2-3B provides a stronger overall balance across agentic, reasoning, and alignment evaluations under a substantially smaller parameter budget.

“Gemma4-12B performs better on IF-Bench and Recruit-Bench, but Nanbeige4.2-3Bprovides a stronger overall balance across agentic, reasoning, and alignment evaluations under a substantially smaller parameter budget.”

May combine two claims.

In the 256K stage, 68.9% of supervised target tokens are allocated to agentic data, while retaining 22.4% reasoning-oriented STEM data and 8.7% general instruction data.

“We allocate 68.9% of the supervised target tokens to agentic data, while retaining 22.4% reasoning-oriented STEM data and 8.7% general instruction data.”

May combine two claims.

General-purpose RLHF improves not only instruction following but also mathematical reasoning, coding, and agentic performance.

“General-purpose RLHF improves not only instruction following but also mathematical reasoning, coding, and agentic performance.”

May combine two claims.

Sharing the KV cache across loop passes reduces the KV-cache by half but its performance gains are consistently lower than those of the full, non-sharing loop configuration.

“Although the sharing configuration reduces the KV-cache by half, its performance gains are consistently lower than those of the full, non-sharing loop configuration.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The pre-training corpus comprises 28T tokens, exceeding that of Nanbeige 4.1 in both scale and data quality.

“Our pre-training corpus comprises 28T tokens, exceeding that of Nanbeige 4.1 in both scale and data quality.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Compact models that combine reasoning and tool use for specific agentic settings, such as deep search, have been investigated.

“Other studies investigate compact models that combine reasoning and tool use for specific agentic settings, such as deep search [31].”

• cites [31]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The Looped Transformer increases effective computational depth and model capacity without introducing another set of parameters.

“It increases the effective computational depth and model capacity without introducing another set of parameters.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

This provides a solid foundation for subsequent post-training stages.

“This provides a solid foundation for subsequent post-training stages.”

Classified as probably not a substantial claim.

Small language models can achieve strong performance on mathematical reasoning, competitive programming, and other verifiable tasks.

“Recent work shows that small language models can achieve strong performance on mathematical reasoning, competitive programming, and other verifiable tasks [28,30].”

• cites [28]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [30]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

The problem-dependent length-control objective for Think-mode RL encourages concise reasoning on reliably solved problems while preserving exploration on difficult ones.

“The objective combines a fixed length budget with a continuous, difficulty-aware penalty, encouraging concise reasoning on reliably solved problems while preserving exploration on difficult ones.”

May combine two claims.

The gains are consistent across all three task categories and are especially clear on office workflows, indicating that the model's general agentic capabilities transfer well to a unified local-assistant setting.

“The gains are consistent across all three task categories and are especially clear on office workflows, indicating that the model's general agentic capabilities transfer well to a unified local-assistant setting.”

May combine two claims.

The 256K stage strengthens long-horizon planning, tool invocation, execution feedback utilization, and recovery from intermediate failures.

“This strengthens long-horizon planning, tool invocation, execution feedback utilization, and recovery from intermediate failures.”

Classified as probably not a substantial claim.

An independent judge agent evaluates the fidelity of each deliverable to the task specification, the consistency of the associated rubric, and the overall quality of the execution trace, retaining only high-quality samples for subsequent synthesis rounds.

“An independent judge agent then evaluates the fidelity of each deliverable to the task specification, the consistency of the associated rubric, and the overall quality of the execution trace, retaining only high-quality samples for subsequent synthesis rounds.”

Classified as probably not a substantial claim.

The compact held-out task suite enables fast and reproducible assessment of whether successive data-synthesis and reinforcement-learning iterations improve tool-use performance before full-scale evaluation.

“It enables fast and reproducible assessment of whether successive data-synthesis and reinforcement-learning iterations improve tool-use performance before full-scale evaluation.”

May combine two claims.

Because the penalty is subtracted rather than gating the task reward, it preserves correctness differences and remains continuous at the budget boundary; for binary rewards, α < 1 guarantees that a correct response is always preferred to an incorrect one regardless of length.

“Because the penalty is subtracted rather than gating the task reward, it preserves correctness differences and remains continuous at the budget boundary; for binary rewards, α < 1 further guarantees that a correct response is always preferred to an incorrect one regardless of length.”

May combine two claims.

Nanbeige4.2-3B is a compact model that combines broad agentic capabilities with strong reasoning under a 3B non-embedding parameter budget.

“We present Nanbeige4.2-3B,a compact model that combines broad agentic capabilities with strong reasoning under a 3B non-embedding parameter budget.”

May combine two claims.

Aggregating complementary trajectories from multiple scaffolds yields a training corpus that emphasizes scaffold-invariant reasoning and repair strategies, thereby improving generalization to unseen agent interfaces and tool schemas.

“Aggregating these complementary trajectories yields a training corpus that emphasizes scaffold-invariant reasoning and repair strategies, rather than scaffold-specific interaction patterns, thereby improving generalization to unseen agent interfaces and tool schemas.”

May combine two claims.

The length penalty is difficulty-aware: responses within budget are never penalized, while the penalty for over-budget responses grows with both the normalized excess length and the problem's current pass rate, so concise reasoning is encouraged on reliably solved problems but not on still-difficult ones.

“The penalty is thus difficulty-aware: responses within budget are never penalized, while the penalty for over-budget responses grows with both the normalized excess length and the problem's current pass rate, so concise reasoning is encouraged on reliably solved problems but not on still-difficult ones.”

May combine two claims.

With its small parameter scale, Nanbeige4.2-3B is compact enough for efficient local deployment while retaining strong reasoning and tool-use capabilities.

“With the small parameter scale, Nanbeige4.2-3B is compact enough for efficient local deployment while retaining strong reasoning and tool-use capabilities.”

May combine two claims.

Combining outcome and action-centric process rewards suppresses recurrent action errors and improves end-task performance.

“These results show that combining outcome and action-centric process rewards suppresses recurrent action errors and improves end-task performance.”

Probably not a substantial claim: may not pass S4 (based).

The closed-loop artifact recycling process progressively expands the task distribution, enabling the generation of increasingly diverse and complex office workflows.

“This closed-loop process progressively expands the task distribution, enabling the generation of increasingly diverse and complex office workflows.”

• AssumptionRests on an assumption: Agents must handle specialized office workflows involving reports, slide decks, spreadsheets, and other artifacts—capabilities central to knowledge-worker productivity.

Classified as probably not a substantial claim. May combine two claims.

This design supports both customized tool-use scenarios with complex data dependencies and general-purpose tool use requiring real network interaction, balancing environmental diversity with ecological realism.

“This design supports both customized tool-use scenarios with complex data dependencies and general-purpose tool use requiring real network interaction, balancing environmental diversity with ecological realism.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The process of capability-guided code repository collection preserves diversity across repositories and problem settings while improving coverage of capability areas in which the model exhibits systematic weaknesses.

“This process preserves diversity across repositories and problem settings while improving coverage of capability areas in which the model exhibits systematic weaknesses.”