Qwen3 Technical Report

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Qwen3 models utilize Qwen's tokenizer, which implements byte-level byte-pair encoding (BBPE) with a vocabulary size of 151,669.

“Qwen3 models utilize Qwen's tokenizer (Bai et al., 2023), which implements byte-level byte-pair encoding (BBPE, Brown et al., 2020;Wang et al., 2020;Sennrich et al., 2016) with a vocabulary size of 151,669.”

• cites Bai et al., 2023 sourceSupported
• cites Brown et al., 2020 sourceSupported
• cites Wang et al., 2020 sourceSupported

May combine two claims.

They employ Qwen2.5-VL to perform text recognition on a large volume of PDF-like documents, and the recognized text is refined using Qwen2.5.

“To further expand the pre-training data corpus, we first employ the Qwen2.5-VLmodel (Bai et al., 2025) to perform text recognition on a large volume of PDF-like documents.The recognized text is then refined using the Qwen2.5 model (Yang et al., 2024b), which helps improve its quality.”

• cites Bai et al., 2025 sourceSupported
• cites Yang et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• AssumptionRests on an assumption: The synthetic data generated by Qwen2.5-Math and Qwen2.5-Coder is of high quality and beneficial for pre-training.

May combine two claims.

They employ Qwen2.5, Qwen2.5-Math, and Qwen2.5-Coder models to synthesize trillions of text tokens in different formats, covering dozens of domains.

“Besides, we employ Qwen2.5 (Yang et al., 2024b), Qwen2.5-Math(Yang et al., 2024c), and Qwen2.5-Coder(Hui et al., 2024) models to synthesize trillions of text tokens in different formats, including textbooks, question-answering, instructions, and code snippets, covering dozens of domains.”

• cites Yang et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Yang et al., 2024cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Hui et al., 2024 sourceSupported

• AssumptionRests on an assumption: The synthetic data generated by Qwen2.5-Math and Qwen2.5-Coder is of high quality and beneficial for pre-training.

May combine two claims.

The architecture of the Qwen3 dense models is similar to Qwen2.5, including using Grouped Query Attention (GQA), SwiGLU, Rotary Positional Embeddings (RoPE), and RMSNorm with pre-normalization.

“The architecture of the Qwen3 dense models is similar to Qwen2.5 (Yang et al., 2024b), including using Grouped Query Attention (GQA, Ainslie et al., 2023), SwiGLU (Dauphin et al., 2017), Rotary Positional Embeddings (RoPE, Su et al., 2024), and RMSNorm (Jiang et al., 2023) with pre-normalization.”

• cites Yang et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Ainslie et al., 2023 sourceSupported
• cites Dauphin et al., 2017Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Well-designed rule-based rewards can assess the correctness of model outputs with high precision, preventing issues like reward hacking.

“Well-designed rule-based rewards can assess the correctness of model outputs with high precision, preventing issues like reward hacking.”

• cites Lambert et al., 2024 sourcePartly supported

  Section 6, “Reinforcement Learning with Verifiable Rewards” (page not provided), describes deterministic answer matching or constraint verification that rewards outputs judged correct on verifiable tasks. It does not establish that these checks have high precision or prevent reward hacking; searches for reward hacking and verification precision found no such finding. (LLM, conf=0.85)

  Experimental — accuracy not yet measured

May combine two claims.

The Qwen3 MoE models have 128 total experts with 8 activated experts per token.

“The Qwen3 MoE models have 128 total experts with 8 activated experts per token.”

May combine two claims.

Due to improvements of the Qwen3 MoE architecture, scale-up of training tokens, and more advanced training strategies, the Qwen3 MoE base models can outperform the Qwen2.5 MoE base models with less than 1/2 activated parameters and fewer total parameters.

“Due to the improvements of the Qwen3 MoE architecture, the scale-up of the training tokens, and more advanced training strategies, the Qwen3 MoE base models can outperform the Qwen2.5 MoE base models with less than 1/2 activated parameters and fewer total parameters.”

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

May combine two claims.

Compared with Qwen2.5, they have significantly expanded the scale and diversity of training data: collected twice as many pre-training tokens, covering three times more languages.

“Compared with Qwen2.5 (Yang et al., 2024b), we have significantly expanded the scale and diversity of our training data.Specifically, we collected twice as many pre-training tokens-covering three times more languages.”

• cites Yang et al., 2024bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

All Qwen3 models are trained on a large and diverse dataset consisting of 119 languages and dialects, with a total of 36 trillion tokens.

“All Qwen3 models are trained on a large and diverse dataset consisting of 119 languages and dialects, with a total of 36 trillion tokens.”

Probably not a substantial claim: may not pass S4 (based).

All Qwen3 models are publicly accessible under Apache 2.0.

“all Qwen3 models are publicly accessible under Apache 2.0.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Qwen3 has been pre-trained on 36 trillion tokens covering up to 119 languages and dialects.

“Furthermore, Qwen3 has been pre-trained on 36 trillion tokens covering up to 119 languages and dialects”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Qwen3 is a collection of open-weight large language models that achieve state-of-the-art performance across a wide variety of tasks and domains.

“Qwen3 is a collection of open-weight large language models (LLMs) that achieve state-of-the-art performance across a wide variety of tasks and domains.”

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

May combine two claims.

Empirical evaluations demonstrate that Qwen3 achieves state-of-the-art results across diverse benchmarks, including code generation, mathematical reasoning, and agent tasks, competitive against larger MoE models and proprietary models.

“Empirical evaluations demonstrate that Qwen3 achieves state-of-the-art results across diverse benchmarks, including tasks in code generation, mathematical reasoning, agent tasks, etc., competitive against larger MoE models and proprietary models.”

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The flagship model, Qwen3-235B-A22B, is an MoE model with a total of 235 billion parameters and 22 billion activated ones per token.

“Notably, the flagship model, Qwen3-235B-A22B, is an MoE model with a total of 235 billion parameters and 22 billion activated ones per token.”

May combine two claims.

Qwen3-235B-A22B-Base outperforms previously open-source SOTA dense and MoE base models in most tasks with significantly fewer total parameters or activated parameters.

“Compared with the previously open-source SOTA dense and MoE base models (such as DeepSeek-V3 Base, Llama-4-Maverick Base, and Qwen2.5-72B-Base),Qwen3-235B-A22B-Base outperforms these models in most tasks with significantly fewer total parameters or activated parameters.”

• cites DeepSeek-V3 BaseNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Llama-4-Maverick BaseNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Qwen2.5-72B-BaseNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

Probably not a substantial claim: may not pass S4 (based).

Compared to its predecessor Qwen2.5, Qwen3 expands multilingual support from 29 to 119 languages and dialects.

“Compared to its predecessor Qwen2.5, Qwen3 expands multilingual support from 29 to 119 languages and dialects”

May combine two claims.

The long context corpus includes 75% of text between 16,384 to 32,768 tokens in length, and 25% of text between 4,096 to 16,384 in length.

“The long context corpus includes 75% of text between 16,384 to 32,768 tokens in length, and 25% of text between 4,096 to 16,384 in length.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The Qwen3 series includes 6 dense models and 2 MoE models.

“The Qwen3 series includes 6 dense models, namely Qwen3-0.6B,Qwen3-1.7B,Qwen3-4B, Qwen3-8B, Qwen3-14B, and Qwen3-32B, and 2 MoE models, Qwen3-30B-A3B and Qwen3-235B-A22B.”

Probably not a substantial claim: may not pass S4 (based).

These architectural and training innovations have yielded substantial improvements in model performance across downstream tasks.

“These architectural and training innovations have yielded substantial improvements in model performance across downstream tasks.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Distillation from advanced teacher models significantly outperforms reinforcement learning in performance and training efficiency.

“Distillation from advanced teacher models significantly outperforms reinforcement learning in performance and training efficiency.”

May combine two claims.

By leveraging knowledge from flagship models, the computational resources required to build smaller-scale models are significantly reduced while ensuring highly competitive performance.

“Moreover, by leveraging the knowledge from the flagship models, we significantly reduce the computational resources required to build smaller-scale models, while ensuring their highly competitive performance.”

Classified as probably not a substantial claim.

The dataset includes high-quality content in various domains such as coding, STEM, reasoning tasks, books, multilingual texts, and synthetic data.

“This dataset includes high-quality content in various domains such as coding, STEM (Science, Technology, Engineering, and Mathematics), reasoning tasks, books, multilingual texts, and synthetic data.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The Qwen3 series includes models of both dense and Mixture-of-Expert (MoE) architectures, with parameter scales ranging from 0.6 to 235 billion.

“The Qwen3 series includes models of both dense and Mixture-of-Expert (MoE) architectures, with parameter scales ranging from 0.6 to 235 billion.”

May combine two claims.

Qwen3-235B-A22B (Thinking) is highly competitive to the closed-source OpenAI-o1, Grok-3-Beta (Think), and Gemini2.5-Pro, substantially narrowing the gap in the reasoning capabilities between open-source and close-source models.

“Moreover, Qwen3-235B-A22B (Thinking) is also highly competitive to the closed-source OpenAI-o1, Grok-3-Beta (Think), and Gemini2.5-Pro,substantially narrowing the gap in the reasoning capabilities between open-source and close-source models.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

We achieve consistent improvements in both training reward and validation performance over the course of a single RL run, without any manual intervention on hyperparameters.

“As a result, we achieve consistent improvements in both training reward and validation performance over the course of a single RL run, without any manual intervention on hyperparameters.”

• AssumptionRests on an assumption: The training methods and hyperparameters used in the RL stages generalize to other settings and do not overfit to the specific benchmarks.

May combine two claims.

Qwen3-32B outperforms QwQ-32B in most of the benchmarks, and performs comparably to the closed-source OpenAI-o3mini.

“(2) Our flagship dense model, Qwen3-32B, outperforms our previous strongest reasoning model, QwQ-32B, in most of the benchmarks, and performs comparably to the closed-source OpenAI-o3mini, indicating its compelling reasoning capabilities.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

Probably not a substantial claim: may not pass S4 (based).

Models capable of handling both modes proficiently perform consistently well under different thinking budgets.

“Moreover, we find that models capable of handling both modes proficiently perform consistently well under different thinking budgets.”

May combine two claims.

Qwen3-30B-A3B and Qwen3-14B exceed Qwen2.5-32B-Instruct with significantly fewer activated and total parameters, allowing for more efficient and cost-effective performance.

“They exceed our previous Qwen2.5-32B-Instructmodel with significantly fewer activated and total parameters, allowing for more efficient and costeffective performance.”

Probably not a substantial claim: may not pass S4 (based).

Once the model learns to respond in both non-thinking and thinking modes, it naturally develops the ability to handle intermediate cases-generating responses based on incomplete thinking.

“An additional advantage of Thinking Mode Fusion is that, once the model learns to respond in both non-thinking and thinking modes, it naturally develops the ability to handle intermediate cases-generating responses based on incomplete thinking.”

May combine two claims.

Stage 4 further strengthens the model's general, instruction-following, and agent capabilities in both thinking and non-thinking modes.

“(2) Stage 4 further strengthens the model's general, instruction-following, and agent capabilities in both thinking and non-thinking modes.”

The quote only partly states this claim.

In thinking mode, the model's performance slightly degrades on long-context processing tasks.

“2. In thinking mode, the model's performance slightly degrades.”

May combine two claims.

On-policy distillation achieves significantly better performance than reinforcement learning while requiring approximately only 1/10 of the GPU hours.

“The results, summarized in Table 21, show that distillation achieves significantly better performance than reinforcement learning while requiring approximately only 1/10 of the GPU hours.”

May combine two claims.

Qwen3-30B-A3B and Qwen3-14B (Thinking) are both highly competitive to QwQ-32B, especially on the reasoning-related benchmarks.

“(1) From Table 15, Qwen3-30B-A3B and Qwen3-14B (Thinking) are both highly competitive to QwQ-32B, especially on the reasoning-related benchmarks.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

Compared with Qwen2.5-72B-Base, Qwen3-235B-A22B-Base surpasses the latter in all benchmarks and uses fewer than 1/3 of the activated parameters.

“Compared with our previous flagship open-source dense model Qwen2.5-72B-Base,Qwen3-235B-A22B-Base surpasses the latter in all benchmarks and uses fewer than 1/3 of the activated parameters.”

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

May combine two claims.

Compared to Llama-4-Scout-Base, Qwen3-32B-Base significantly outperforms it on all 15 benchmarks, with only one-third of the number of parameters of Llama-4-Scout-Base, but twice the number of activated parameters.

“Compared to Llama-4-Scout-Base, Qwen3-32B-Base significantly outperforms it on all 15 benchmarks, with only one-third of the number of parameters of Llama-4-Scout-Base, but twice the number of activated parameters.”

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

May combine two claims.

Stage 3 enhances the model's general and instruction-following capabilities in thinking mode, with CounterFactQA improving by 10.9 points and LengthCtrl by 8.0 points.

“Stage 3 also enhances the model's general and instruction-following capabilities in thinking mode, with CounterFactQA improving by 10.9 points and LengthCtrl by 8.0 points.”

May combine two claims.

Qwen3-30B-A3B, Qwen3-14B, and other smaller dense models possess consistently superior performance to the open-source models with a close or larger amount of parameters, proving the success of Strong-to-Weak Distillation.

“(3) Our lightweight models, including Qwen3-30B-A3B, Qwen3-14B, and other smaller dense ones, possess consistently superior performance to the open-source models with a close or larger amount of parameters, proving the success of our Strong-to-Weak Distillation approach.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

With only 1/5 activated non-embedding parameters, Qwen3-30B-A3B significantly outperforms Qwen2.5-14B-Base on all tasks, and achieves comparable performance to Qwen3-14B-Base and Qwen2.5-32B-Base.

“With only 1/5 activated non-embedding parameters, Qwen3-30B-A3B significantly outperforms Qwen2.5-14B-Base on all tasks, and achieves comparable performance to Qwen3-14B-Base and Qwen2.5-32B-Base,which brings us significant advantages in inference and training costs.”

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

May combine two claims.

Although Qwen3-32B-Base has less than half the number of parameters of Qwen2.5-72B-Base, it outperforms Qwen2.5-72B-Base in 10 of the 15 evaluation benchmarks.

“Although Qwen3-32B-Base has less than half the number of parameters of Qwen2.5-72B-Base, it outperforms Qwen2.5-72B-Base in 10 of the 15 evaluation benchmarks.”

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

May combine two claims.

Qwen3-235B-A22B-Base outperforms DeepSeek-V3-Base on 14 out of 15 evaluation benchmarks with only about 1/3 the total number of parameters and 2/3 activated parameters.

“(2) Compared with the previously state-of-the-art open-source model DeepSeek-V3-Base, Qwen3-235B-A22B-Base outperforms DeepSeek-V3-Base on 14 out of 15 evaluation benchmarks with only about 1/3 the total number of parameters and 2/3 activated parameters, demonstrating the powerful and cost-effectiveness of our models.”

May combine two claims.

Qwen3-235B-A22B (Non-thinking) exceeds the other leading open-source models, including DeepSeek-V3, LLaMA-4-Maverick, and Qwen2.5-72B-Instruct, and also surpasses the closed-source GPT-4o-2024-11-20 in 18/23 the benchmarks.

“(2) From Table 12, Qwen3-235B-A22B (Non-thinking) exceeds the other leading open-source models, including DeepSeek-V3, LLaMA-4-Maverick, and our previous flagship model Qwen2.5-72B-Instruct, and also surpasses the closed-source GPT-4o-2024-11-20 in 18/23 the benchmarks, indicating its inherent strong capabilities even when not enhanced with the deliberate thinking process.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

Qwen3 edge-side models outperform baselines with more parameters, including previous Qwen2.5 models, in both thinking and non-thinking modes.

“Overall, these edge-side models exhibit impressive performance and outperform baselines even with more parameters, including our previous Qwen2.5 models, in either the thinking or the non-thinking mode.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Using a large batch size and a high number of rollouts per query, along with off-policy training to improve sample efficiency, is beneficial to the training process.

“We observe that using a large batch size and a high number of rollouts per query, along with off-policy training to improve sample efficiency, is beneficial to the training process.”

• AssumptionRests on an assumption: The training methods and hyperparameters used in the RL stages generalize to other settings and do not overfit to the specific benchmarks.

May combine two claims.

Qwen3 can understand and generate text in 119 languages and dialects.

“The model was pre-trained on an extensive dataset containing 36 trillion tokens, enabling it to understand and generate text in 119 languages and dialects.”

May combine two claims.

The inference costs and training costs on each trillion tokens of Qwen3-235B-A22B-Base are much cheaper than those of Qwen2.5-72B-Base.

“Meanwhile, due to the advantage of the model architecture, the inference costs and training costs on each trillion tokens of Qwen3-235B-A22B-Base are much cheaper than those of Qwen2.5-72B-Base.”

May combine two claims.

Qwen3-30B-A3B achieves comparable performance to QwQ-32B with a smaller model size and less than

“It is noteworthy that Qwen3-30B-A3B achieves comparable performance to QwQ-32B with a smaller model size and less than”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

Qwen3-32B (Non-thinking) performs on par with Qwen2.5-72B-Instruct on the general tasks with significant advantages on the alignment, multilingual, and reasoning-related tasks.

“Particularly, Qwen3-32B (Non-thinking) performs on par with Qwen2.5-72B-Instruct on the general tasks with significant advantages on the alignment, multilingual, and reasoning-related tasks, again proving the fundamental improvements of Qwen3 over our previous Qwen2.5 series models.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

Qwen3-32B (Thinking) competes with the closed-source OpenAI-o3-mini (medium) with better alignment and multilingual performance.

“Moreover, Qwen3-32B (Thinking) also competes with the closed-source OpenAI-o3-mini (medium) with better alignment and multilingual performance.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

Qwen3-32B is remarkably performant in the non-thinking mode and surpasses Qwen2.5-72B-Instruct.

“Qwen3-32B is also remarkably performant in the non-thinking mode and surpasses our previous flagship non-reasoning dense model, Qwen2.5-72B-Instruct.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

Stage 3 integrates the non-thinking mode into the model, which already possesses thinking capabilities after the first two stages of training.

“(1) Stage 3 integrates the non-thinking mode into the model, which already possesses thinking capabilities after the first two stages of training.”

May combine two claims.

With only 60% activated and 35% total parameters, Qwen3-235B-A22B (Thinking) outperforms DeepSeek-R1 on 17/23 the benchmarks, particularly on the reasoning-demanded tasks (e.g., mathematics, agent, and coding).

“(1) From Table 11, with only 60% activated and 35% total parameters, Qwen3-235B-A22B (Thinking) outperforms DeepSeek-R1 on 17/23 the benchmarks, particularly on the reasoning-demanded tasks (e.g., mathematics, agent, and coding), demonstrating the state-of-the-art reasoning capabilities of Qwen3-235B-A22B among open-source models.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

Qwen3-32B-Base achieves 65.54 on MMLU-Pro and 39.78 on SuperGPQA, significantly outperforming its predecessor Qwen2.5-32B-Base.

“Notably, Qwen3-32B-Base achieves 65.54 on MMLU-Pro and 39.78 on SuperGPQA, significantly outperforming its predecessor Qwen2.5-32B-Base.”

• AssumptionRests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
• AssumptionRests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Qwen3 features both thinking mode and non-thinking mode, allowing users to dynamically manage the number of tokens used for complex thinking tasks.

“Qwen3 features both thinking mode and non-thinking mode, allowing users to dynamically manage the number of tokens used for complex thinking tasks.”

May combine two claims.

Qwen3-32B (Thinking) outperforms QwQ-32B on 17/23 the benchmarks, making it the new state-of-the-art reasoning model at the sweet size of 32B.

“(1) From Table 13, Qwen3-32B (Thinking) outperforms QwQ-32B on 17/23 the benchmarks, making it the new state-of-the-art reasoning model at the sweet size of 32B.”

• AssumptionRests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
• AssumptionRests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.

May combine two claims.

It leads to better immediate performance, as indicated by higher Pass@1 scores, and also improves the model's ability of exploration, as reflected in improved Pass@64 results.

“It leads to better immediate performance, as indicated by higher Pass@1 scores, and also improves the model's ability of exploration, as reflected in improved Pass@64 results.”

Probably not a substantial claim: may not pass S4 (based).

The ability to handle intermediate cases is not explicitly trained but emerges naturally as a result of applying Thinking Mode Fusion.

“It is worth noting that this ability is not explicitly trained but emerges naturally as a result of applying Thinking Mode Fusion.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Qwen3 was pre-trained on an extensive dataset containing 36 trillion tokens.

“The model was pre-trained on an extensive dataset containing 36 trillion tokens, enabling it to understand and generate text in 119 languages and dialects.”

May combine two claims.

Removing QKV-bias and introducing QK-Norm to the attention mechanism ensures stable training for Qwen3.

“Besides, we remove QKV-bias used in Qwen2 (Yang et al., 2024a) and introduce QK-Norm (Dehghani et al., 2023) to the attention mechanism to ensure stable training for Qwen3.”

• cites Yang et al., 2024aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Dehghani et al., 2023 sourceNot checked — no full text of the source

May combine two claims.

The integration of thinking and non-thinking modes eliminates the need to switch between different models and enables dynamic mode switching based on user queries or chat templates.

“This eliminates the need to switch between different models--such as chat-optimized models (e.g., GPT-4o) and dedicated reasoning models (e.g., QwQ-32B)--and enables dynamic mode switching based on user queries or chat templates.”

Probably not a substantial claim: may not pass S4 (based).

All models are evaluated using the same evaluation pipeline and the widely-used evaluation settings to ensure fair comparison.

“All models are evaluated using the same evaluation pipeline and the widely-used evaluation settings to ensure fair comparison.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The design of Qwen3-235B-A22B ensures both high performance and efficient inference.

“This design ensures both high performance and efficient inference.”

May combine two claims.

Thinking Mode Fusion allows developers to manage and control reasoning behaviors, while also reducing the cost and complexity of deploying separate models for thinking and non-thinking tasks.

“This approach allows developers to manage and control reasoning behaviors, while also reducing the cost and complexity of deploying separate models for thinking and non-thinking tasks.”

Probably not a substantial claim: may not pass S4 (based).

Allowing the model to perform complete multi-turn interaction cycles with real environment execution feedback during RL rollout improves its performance and stability in long-horizon decision-making tasks.

“During the RL rollout, the model is allowed to perform complete multi-turn interaction cycles with real environment execution feedback, thereby improving its performance and stability in long-horizon decision-making tasks.”

Classified as probably not a substantial claim. May combine two claims.

The chat template design ensures internal format consistency within the model and allows developers to prevent the model from engaging in thinking behavior by concatenating an empty think block in the chat template.

“This design ensures internal format consistency within the model and allows developers to prevent the model from engaging in thinking behavior by concatenating an empty think block in the chat template.”

May combine two claims.

The Qwen3 series models achieve competitive performance across all evaluated benchmarks, showcasing their strong multilingual capabilities.

“The results of these tables demonstrate that the Qwen3 series models achieve competitive performance across all evaluated benchmarks, showcasing their strong multilingual capabilities.”

Classified as probably not a substantial claim. May combine two claims.

Using Qwen2.5-72B-Instruct to identify and remove queries that are not easily verifiable helps prevent the model from relying on superficial guessing and ensures that only complex problems requiring deeper reasoning are included.

“This helps prevent the model from relying on superficial guessing and ensures that only complex problems requiring deeper reasoning are included.”

• AssumptionRests on an assumption: The filtering criteria and human annotation in dataset construction correctly identify and remove low-quality or non-verifiable queries/responses without removing valuable ones.
• AssumptionRests on an assumption: The Qwen2.5-72B-Instruct model can accurately identify non-verifiable queries and assess response accuracy.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Model-based Reward without Reference Answer can handle a broader range of queries while effectively enhancing the model's engagement and helpfulness.

“This approach, which does not depend on a reference answer, can handle a broader range of queries while effectively enhancing the model's engagement and helpfulness.”

May combine two claims.

The ThinkFollow score improves to 98.9, ensuring accurate mode switching.

“Notably, the ThinkFollow score improves to 98.9, ensuring accurate mode switching.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

This approach ensures that the model's potential is not limited, allowing for greater flexibility and improvement during the subsequent reinforcement learning (RL) phase.

“This approach ensures that the model's potential is not limited, allowing for greater flexibility and improvement during the subsequent reinforcement learning (RL) phase.”

• AssumptionRests on an assumption: The filtering criteria and human annotation in dataset construction correctly identify and remove low-quality or non-verifiable queries/responses without removing valuable ones.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Off-policy Distillation helps lightweight student models develop basic reasoning skills and the ability to switch between different modes of thinking, laying a solid foundation for the next on-policy training phase.

“This helps lightweight student models develop basic reasoning skills and the ability to switch between different modes of thinking, laying a solid foundation for the next on-policy training phase.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Model-based Reward with Reference Answer allows for more flexible handling of diverse tasks without requiring strict formatting, avoiding false negatives that can occur with purely rule-based rewards.

“This method allows for more flexible handling of diverse tasks without requiring strict formatting, avoiding false negatives that can occur with purely rule-based rewards.”

May combine two claims.

The Strong-to-Weak Distillation approach is efficacious and enables building lightweight Qwen3 models with remarkably reduced costs and efforts.

“These results, once again, demonstrate the efficacy of our Strong-to-Weak Distillation approach, making it possible for us to build the lightweight Qwen3 models with remarkably reduced costs and efforts.”

May combine two claims.

Distillation from teacher logits enables the student model to expand its exploration space and enhance its reasoning potential, as evidenced by improved pass@64 scores on AIME'24 and AIME'25 after distillation compared to the initial checkpoint.

“Furthermore, distillation from teacher logits enables the student model to expand its exploration space and enhance its reasoning potential, as evidenced by the improved pass@64 scores on the AIME'24 and AIME'25 benchmarks after distillation, compared to the initial checkpoint.”

May combine two claims.

The ThinkFollow benchmark score of 88.7 indicates that the model has developed an initial ability to switch between modes, though it still occasionally makes errors.

“The ThinkFollow benchmark score of 88.7 indicates that the model has developed an initial ability to switch between modes, though it still occasionally makes errors.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The Strong-to-Weak Distillation approach enhances model performance while effectively imparting robust mode-switching capabilities.

“This approach enhances model performance while effectively imparting robust mode-switching capabilities.”