The DOI matches its DataCite record; 60 of the 60 references it cites were found in a registry or an index; 11 of the 27 sources its claims cite were checked for support.
Qwen3 Technical Report
Open accessAbstract
In this work, we present Qwen3, the latest version of the Qwen model family. Qwen3 comprises a series of large language models (LLMs) designed to advance performance, efficiency, and multilingual capabilities. The Qwen3 series includes models of both dense and Mixture-of-Expert (MoE) architectures, with parameter scales ranging from 0.6 to 235 billion. A key innovation in Qwen3 is the integration of thinking mode (for complex, multi-step reasoning) and non-thinking mode (for rapid, context-driven responses) into a unified framework. This eliminates the need to switch between different models--such as chat-optimized models (e.g., GPT-4o) and dedicated reasoning models (e.g., QwQ-32B)--and enables dynamic mode switching based on user queries or chat templates. Meanwhile, Qwen3 introduces a thinking budget mechanism, allowing users to allocate computational resources adaptively during inference, thereby balancing latency and performance based on task complexity. Moreover, by leveraging the knowledge from the flagship models, we significantly reduce the computational resources required to build smaller-scale models, while ensuring their highly competitive performance. Empirical evaluations demonstrate that Qwen3 achieves state-of-the-art results across diverse benchmarks, including tasks in code generation, mathematical reasoning, agent tasks, etc., competitive against larger MoE models and proprietary models. Compared to its predecessor Qwen2.5, Qwen3 expands multilingual support from 29 to 119 languages and dialects, enhancing global accessibility through improved cross-lingual understanding and generation capabilities. To facilitate reproducibility and community-driven research and development, all Qwen3 models are publicly accessible under Apache 2.0.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
47 No basis given · 46 Own result · 22 Own interpretation · 7 Partly supported · 3 Sources not found · 2 Supported · 1 Not checked yet · 1 Own method · accuracy not yet measured
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Meanwhile, we introduce YARN (Peng et al., 2023) and Dual Chunk Attention (DCA, An et al., 2024) to achieve a four-fold increase in sequence length capacity during inference.”
What the sources say
- Supportedcites Peng et al., 2023 source
The Abstract identifies this paper as presenting YaRN, so it supports the citation identifying that method. The sentence attributes DCA to a different citation and describes the four-fold increase as the citing authors’ objective, not as a result reported by Peng et al. (LLM, conf=0.93)
- Not matchedcites An et al., 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Unlike previous studies (Xie et al., 2023;Fan et al., 2023;Liu et al., 2024b) that optimize the data mixture at the data source or domain level, our method optimizes the data mixture at the instance-level through extensive ablation experiments on small proxy models with the fine-grained data labels.”
What the sources say
- Not matchedcites Xie et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Fan et al., 2023 source
The citation to Fan et al. supports the contrast in the citing sentence: DoGE optimizes sampling weights for data domains, not individual instances. Its Abstract describes learning domain weights with a proxy model, and the related-work passage explicitly distinguishes domain reweighting from instance-wise strategies. The sentence’s instance-level method and fine-grained labels describe the citing authors’ own work, not DoGE. (LLM, conf=0.94)
- Not matchedcites Liu et al., 2024b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“Furthermore, we adopt the global-batch load balancing loss (Qiu et al., 2025) to encourage expert specialization.”
What the sources say
- Supportedcites Qiu et al., 2025 source
The Introduction says the paper proposes global-batch load balancing loss and reports that domain specialization clearly emerges when models are trained with it. The Method section describes how to implement the loss. This supports the citation as identifying a method used to encourage expert specialization. (LLM, conf=0.93)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Following Qwen2.5 (Yang et al., 2024b), we increase the base frequency of RoPE from 10,000 to 1,000,000 using the ABF technique (Xiong et al., 2023).”
What the sources say
- Not matchedcites Yang et al., 2024b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Xiong et al., 2023 source
Section 4.1 identifies RoPE with adjusted base frequency (RoPE ABF) as a method the source paper proposes and evaluates. The citation supports use of the ABF technique; the change to 1,000,000 is described as the citing authors’ own choice, not as a value used by Xiong et al. (LLM, conf=0.91)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“Similar to Qwen2.5 (Yang et al., 2024b), we develop scaling laws for optimal hyper-parameters (e.g., learning rate scheduler, and batch size) predictions based on three pre-training stages mentioned above.”
What the sources say
- Not matchedcites Yang et al., 2024b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Compared to the pre-training data used in Qwen2.5, the number of supported languages has been significantly increased from 29 to 119, enhancing the model's linguistic coverage and cross-lingual capabilities.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Through this two-step process, we are able to obtain an additional set of high-quality text tokens, amounting to trillions in total.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The synthetic data generated by Qwen2.5-Math and Qwen2.5-Coder is of high quality and beneficial for pre-training.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The post-trained models, whether in thinking or nonthinking mode, perform competitively against leading proprietary models and large mixture-of-experts (MoE) models such as o1, o3-mini, and DeepSeek-V3.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Experimental results show that our base pre-trained models achieve state-of-the-art performance.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Qwen3 models are pre-trained through a three-stage process:”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 28
- It may state two separate claims as one. 62
- The quote only partly states this claim. 1
Every source the paper cites for this claim was checked and supports it.
In the paper
“Qwen3 models utilize Qwen's tokenizer (Bai et al., 2023), which implements byte-level byte-pair encoding (BBPE, Brown et al., 2020;Wang et al., 2020;Sennrich et al., 2016) with a vocabulary size of 151,669.”
What the sources say
- Supportedcites Bai et al., 2023 source
The Bai et al. citation identifies Qwen’s tokenizer. Section 2.2 (Tokenization) describes the QWEN tokenizer and its BPE method, supporting that identification; the BBPE method has separate citations in the citing sentence. (LLM, conf=0.90)
- Supportedcites Brown et al., 2020 source
The Brown et al. citation is attached to the BBPE method, not to the Qwen3 tokenizer or its vocabulary size. Section 3.3 (p. 14) explicitly describes the tokenizer reused by GPT-3 as a byte-level BPE tokenizer, supporting that method citation. (LLM, conf=0.91)
- Supportedcites Wang et al., 2020 source
The Wang et al. citation is attached to byte-level byte-pair encoding (BBPE), not specifically to Qwen3 or its vocabulary size. The Introduction (p. 1) says the paper focuses on byte-level BPE, and the Conclusion (p. 5) says it proposes BBPE. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“To further expand the pre-training data corpus, we first employ the Qwen2.5-VLmodel (Bai et al., 2025) to perform text recognition on a large volume of PDF-like documents.The recognized text is then refined using the Qwen2.5 model (Yang et al., 2024b), which helps improve its quality.”
What the sources say
- Supportedcites Bai et al., 2025 source
The Bai et al. citation identifies the Qwen2.5-VL model used for text recognition, not the citing authors’ PDF-processing workflow. Section 3.3.2 (p. 12) reports Qwen2.5-VL’s OCR and document-parsing capabilities. The separate claim about refining the text with Qwen2.5 is attached to a different citation. (LLM, conf=0.93)
- Not matchedcites Yang et al., 2024b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The synthetic data generated by Qwen2.5-Math and Qwen2.5-Coder is of high quality and beneficial for pre-training.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Besides, we employ Qwen2.5 (Yang et al., 2024b), Qwen2.5-Math(Yang et al., 2024c), and Qwen2.5-Coder(Hui et al., 2024) models to synthesize trillions of text tokens in different formats, including textbooks, question-answering, instructions, and code snippets, covering dozens of domains.”
What the sources say
- Not matchedcites Yang et al., 2024b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Yang et al., 2024c
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Hui et al., 2024 source
The citation to Hui et al. is attached specifically to “Qwen2.5-Coder,” identifying the model the citing authors say they employ. The source introduces the Qwen2.5-Coder series in its Abstract; the citing authors’ statement about their own synthesis of text tokens is not attributed specifically to this source. (LLM, conf=0.93)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The synthetic data generated by Qwen2.5-Math and Qwen2.5-Coder is of high quality and beneficial for pre-training.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The architecture of the Qwen3 dense models is similar to Qwen2.5 (Yang et al., 2024b), including using Grouped Query Attention (GQA, Ainslie et al., 2023), SwiGLU (Dauphin et al., 2017), Rotary Positional Embeddings (RoPE, Su et al., 2024), and RMSNorm (Jiang et al., 2023) with pre-normalization.”
What the sources say
- Not matchedcites Yang et al., 2024b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Ainslie et al., 2023 source
The citation is attached to Grouped Query Attention (GQA), not to the full list of Qwen3 architecture features. The Introduction says the paper proposes GQA, and §2.2 defines how it groups query heads. Our copy does not give page numbers for these passages. (LLM, conf=0.94)
- Not matchedcites Dauphin et al., 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Well-designed rule-based rewards can assess the correctness of model outputs with high precision, preventing issues like reward hacking.”
What the sources say
- Partly supportedcites Lambert et al., 2024 sourceExperimental — accuracy not yet measured
Section 6, “Reinforcement Learning with Verifiable Rewards” (page not provided), describes deterministic answer matching or constraint verification that rewards outputs judged correct on verifiable tasks. It does not establish that these checks have high precision or prevent reward hacking; searches for reward hacking and verification precision found no such finding. (LLM, conf=0.85)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Partly supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The Qwen3 MoE models have 128 total experts with 8 activated experts per token.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Due to the improvements of the Qwen3 MoE architecture, the scale-up of the training tokens, and more advanced training strategies, the Qwen3 MoE base models can outperform the Qwen2.5 MoE base models with less than 1/2 activated parameters and fewer total parameters.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
In the paper
“Compared with Qwen2.5 (Yang et al., 2024b), we have significantly expanded the scale and diversity of our training data.Specifically, we collected twice as many pre-training tokens-covering three times more languages.”
What the sources say
- Not matchedcites Yang et al., 2024b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“All Qwen3 models are trained on a large and diverse dataset consisting of 119 languages and dialects, with a total of 36 trillion tokens.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“all Qwen3 models are publicly accessible under Apache 2.0.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Furthermore, Qwen3 has been pre-trained on 36 trillion tokens covering up to 119 languages and dialects”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Qwen3 is a collection of open-weight large language models (LLMs) that achieve state-of-the-art performance across a wide variety of tasks and domains.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Empirical evaluations demonstrate that Qwen3 achieves state-of-the-art results across diverse benchmarks, including tasks in code generation, mathematical reasoning, agent tasks, etc., competitive against larger MoE models and proprietary models.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Notably, the flagship model, Qwen3-235B-A22B, is an MoE model with a total of 235 billion parameters and 22 billion activated ones per token.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Compared with the previously open-source SOTA dense and MoE base models (such as DeepSeek-V3 Base, Llama-4-Maverick Base, and Qwen2.5-72B-Base),Qwen3-235B-A22B-Base outperforms these models in most tasks with significantly fewer total parameters or activated parameters.”
What the sources say
- Not matchedcites DeepSeek-V3 Base
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Llama-4-Maverick Base
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Qwen2.5-72B-Base
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Compared to its predecessor Qwen2.5, Qwen3 expands multilingual support from 29 to 119 languages and dialects”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The long context corpus includes 75% of text between 16,384 to 32,768 tokens in length, and 25% of text between 4,096 to 16,384 in length.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Qwen3 series includes 6 dense models, namely Qwen3-0.6B,Qwen3-1.7B,Qwen3-4B, Qwen3-8B, Qwen3-14B, and Qwen3-32B, and 2 MoE models, Qwen3-30B-A3B and Qwen3-235B-A22B.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These architectural and training innovations have yielded substantial improvements in model performance across downstream tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Distillation from advanced teacher models significantly outperforms reinforcement learning in performance and training efficiency.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Moreover, by leveraging the knowledge from the flagship models, we significantly reduce the computational resources required to build smaller-scale models, while ensuring their highly competitive performance.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This dataset includes high-quality content in various domains such as coding, STEM (Science, Technology, Engineering, and Mathematics), reasoning tasks, books, multilingual texts, and synthetic data.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The Qwen3 series includes models of both dense and Mixture-of-Expert (MoE) architectures, with parameter scales ranging from 0.6 to 235 billion.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, Qwen3-235B-A22B (Thinking) is also highly competitive to the closed-source OpenAI-o1, Grok-3-Beta (Think), and Gemini2.5-Pro,substantially narrowing the gap in the reasoning capabilities between open-source and close-source models.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“As a result, we achieve consistent improvements in both training reward and validation performance over the course of a single RL run, without any manual intervention on hyperparameters.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The training methods and hyperparameters used in the RL stages generalize to other settings and do not overfit to the specific benchmarks.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(2) Our flagship dense model, Qwen3-32B, outperforms our previous strongest reasoning model, QwQ-32B, in most of the benchmarks, and performs comparably to the closed-source OpenAI-o3mini, indicating its compelling reasoning capabilities.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Moreover, we find that models capable of handling both modes proficiently perform consistently well under different thinking budgets.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“They exceed our previous Qwen2.5-32B-Instructmodel with significantly fewer activated and total parameters, allowing for more efficient and costeffective performance.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“An additional advantage of Thinking Mode Fusion is that, once the model learns to respond in both non-thinking and thinking modes, it naturally develops the ability to handle intermediate cases-generating responses based on incomplete thinking.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“(2) Stage 4 further strengthens the model's general, instruction-following, and agent capabilities in both thinking and non-thinking modes.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“2. In thinking mode, the model's performance slightly degrades.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results, summarized in Table 21, show that distillation achieves significantly better performance than reinforcement learning while requiring approximately only 1/10 of the GPU hours.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(1) From Table 15, Qwen3-30B-A3B and Qwen3-14B (Thinking) are both highly competitive to QwQ-32B, especially on the reasoning-related benchmarks.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Compared with our previous flagship open-source dense model Qwen2.5-72B-Base,Qwen3-235B-A22B-Base surpasses the latter in all benchmarks and uses fewer than 1/3 of the activated parameters.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Compared to Llama-4-Scout-Base, Qwen3-32B-Base significantly outperforms it on all 15 benchmarks, with only one-third of the number of parameters of Llama-4-Scout-Base, but twice the number of activated parameters.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Stage 3 also enhances the model's general and instruction-following capabilities in thinking mode, with CounterFactQA improving by 10.9 points and LengthCtrl by 8.0 points.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(3) Our lightweight models, including Qwen3-30B-A3B, Qwen3-14B, and other smaller dense ones, possess consistently superior performance to the open-source models with a close or larger amount of parameters, proving the success of our Strong-to-Weak Distillation approach.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With only 1/5 activated non-embedding parameters, Qwen3-30B-A3B significantly outperforms Qwen2.5-14B-Base on all tasks, and achieves comparable performance to Qwen3-14B-Base and Qwen2.5-32B-Base,which brings us significant advantages in inference and training costs.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although Qwen3-32B-Base has less than half the number of parameters of Qwen2.5-72B-Base, it outperforms Qwen2.5-72B-Base in 10 of the 15 evaluation benchmarks.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“(2) Compared with the previously state-of-the-art open-source model DeepSeek-V3-Base, Qwen3-235B-A22B-Base outperforms DeepSeek-V3-Base on 14 out of 15 evaluation benchmarks with only about 1/3 the total number of parameters and 2/3 activated parameters, demonstrating the powerful and cost-effectiveness of our models.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(2) From Table 12, Qwen3-235B-A22B (Non-thinking) exceeds the other leading open-source models, including DeepSeek-V3, LLaMA-4-Maverick, and our previous flagship model Qwen2.5-72B-Instruct, and also surpasses the closed-source GPT-4o-2024-11-20 in 18/23 the benchmarks, indicating its inherent strong capabilities even when not enhanced with the deliberate thinking process.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, these edge-side models exhibit impressive performance and outperform baselines even with more parameters, including our previous Qwen2.5 models, in either the thinking or the non-thinking mode.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We observe that using a large batch size and a high number of rollouts per query, along with off-policy training to improve sample efficiency, is beneficial to the training process.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
- Rests on an assumption: The training methods and hyperparameters used in the RL stages generalize to other settings and do not overfit to the specific benchmarks.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The model was pre-trained on an extensive dataset containing 36 trillion tokens, enabling it to understand and generate text in 119 languages and dialects.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Meanwhile, due to the advantage of the model architecture, the inference costs and training costs on each trillion tokens of Qwen3-235B-A22B-Base are much cheaper than those of Qwen2.5-72B-Base.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is noteworthy that Qwen3-30B-A3B achieves comparable performance to QwQ-32B with a smaller model size and less than”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Particularly, Qwen3-32B (Non-thinking) performs on par with Qwen2.5-72B-Instruct on the general tasks with significant advantages on the alignment, multilingual, and reasoning-related tasks, again proving the fundamental improvements of Qwen3 over our previous Qwen2.5 series models.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Moreover, Qwen3-32B (Thinking) also competes with the closed-source OpenAI-o3-mini (medium) with better alignment and multilingual performance.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Qwen3-32B is also remarkably performant in the non-thinking mode and surpasses our previous flagship non-reasoning dense model, Qwen2.5-72B-Instruct.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(1) Stage 3 integrates the non-thinking mode into the model, which already possesses thinking capabilities after the first two stages of training.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(1) From Table 11, with only 60% activated and 35% total parameters, Qwen3-235B-A22B (Thinking) outperforms DeepSeek-R1 on 17/23 the benchmarks, particularly on the reasoning-demanded tasks (e.g., mathematics, agent, and coding), demonstrating the state-of-the-art reasoning capabilities of Qwen3-235B-A22B among open-source models.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Notably, Qwen3-32B-Base achieves 65.54 on MMLU-Pro and 39.78 on SuperGPQA, significantly outperforming its predecessor Qwen2.5-32B-Base.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks used are not contaminated by the pre-training data.
- Rests on an assumption: The benchmarks used are valid and sufficient measures of the models' general capabilities.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Qwen3 features both thinking mode and non-thinking mode, allowing users to dynamically manage the number of tokens used for complex thinking tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(1) From Table 13, Qwen3-32B (Thinking) outperforms QwQ-32B on 17/23 the benchmarks, making it the new state-of-the-art reasoning model at the sweet size of 32B.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
- Rests on an assumption: The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It leads to better immediate performance, as indicated by higher Pass@1 scores, and also improves the model's ability of exploration, as reflected in improved Pass@64 results.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“It is worth noting that this ability is not explicitly trained but emerges naturally as a result of applying Thinking Mode Fusion.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The model was pre-trained on an extensive dataset containing 36 trillion tokens, enabling it to understand and generate text in 119 languages and dialects.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Besides, we remove QKV-bias used in Qwen2 (Yang et al., 2024a) and introduce QK-Norm (Dehghani et al., 2023) to the attention mechanism to ensure stable training for Qwen3.”
What the sources say
- Not matchedcites Yang et al., 2024a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Dehghani et al., 2023 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This eliminates the need to switch between different models--such as chat-optimized models (e.g., GPT-4o) and dedicated reasoning models (e.g., QwQ-32B)--and enables dynamic mode switching based on user queries or chat templates.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All models are evaluated using the same evaluation pipeline and the widely-used evaluation settings to ensure fair comparison.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This design ensures both high performance and efficient inference.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This approach allows developers to manage and control reasoning behaviors, while also reducing the cost and complexity of deploying separate models for thinking and non-thinking tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“During the RL rollout, the model is allowed to perform complete multi-turn interaction cycles with real environment execution feedback, thereby improving its performance and stability in long-horizon decision-making tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This design ensures internal format consistency within the model and allows developers to prevent the model from engaging in thinking behavior by concatenating an empty think block in the chat template.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results of these tables demonstrate that the Qwen3 series models achieve competitive performance across all evaluated benchmarks, showcasing their strong multilingual capabilities.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This helps prevent the model from relying on superficial guessing and ensures that only complex problems requiring deeper reasoning are included.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
- Rests on an assumption: The filtering criteria and human annotation in dataset construction correctly identify and remove low-quality or non-verifiable queries/responses without removing valuable ones.
- Rests on an assumption: The Qwen2.5-72B-Instruct model can accurately identify non-verifiable queries and assess response accuracy.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This approach, which does not depend on a reference answer, can handle a broader range of queries while effectively enhancing the model's engagement and helpfulness.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Notably, the ThinkFollow score improves to 98.9, ensuring accurate mode switching.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This approach ensures that the model's potential is not limited, allowing for greater flexibility and improvement during the subsequent reinforcement learning (RL) phase.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
- Rests on an assumption: The filtering criteria and human annotation in dataset construction correctly identify and remove low-quality or non-verifiable queries/responses without removing valuable ones.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This helps lightweight student models develop basic reasoning skills and the ability to switch between different modes of thinking, laying a solid foundation for the next on-policy training phase.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This method allows for more flexible handling of diverse tasks without requiring strict formatting, avoiding false negatives that can occur with purely rule-based rewards.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These results, once again, demonstrate the efficacy of our Strong-to-Weak Distillation approach, making it possible for us to build the lightweight Qwen3 models with remarkably reduced costs and efforts.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, distillation from teacher logits enables the student model to expand its exploration space and enhance its reasoning potential, as evidenced by the improved pass@64 scores on the AIME'24 and AIME'25 benchmarks after distillation, compared to the initial checkpoint.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The ThinkFollow benchmark score of 88.7 indicates that the model has developed an initial ability to switch between modes, though it still occasionally makes errors.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This approach enhances model performance while effectively imparting robust mode-switching capabilities.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper relies on this without support.
The evaluation benchmarks used are not contaminated by the pre-training data.
“Empirical evaluations demonstrate that Qwen3 achieves state-of-the-art results across diverse benchmarks, including tasks in code generation, mathematical reasoning, agent tasks, etc., competitive against larger MoE models and proprietary models.”
The paper relies on this without support.
The benchmarks used are valid and sufficient measures of the models' general capabilities.
“Empirical evaluations demonstrate that Qwen3 achieves state-of-the-art results across diverse benchmarks, including tasks in code generation, mathematical reasoning, agent tasks, etc., competitive against larger MoE models and proprietary models.”
The paper relies on this without support.
The synthetic data generated by Qwen2.5-Math and Qwen2.5-Coder is of high quality and beneficial for pre-training.
“Besides, we employ Qwen2.5 (Yang et al., 2024b), Qwen2.5-Math(Yang et al., 2024c), and Qwen2.5-Coder(Hui et al., 2024) models to synthesize trillions of text tokens in different formats, including textbooks, question-answering, instructions, and code snippets, covering dozens of domains.”
The paper relies on this without support.
The evaluation benchmarks accurately measure the capabilities they are intended to measure (e.g., reasoning, alignment, multilingual ability).
“To comprehensively evaluate the quality of instruction-tuned models, we adopted automatic benchmarks to assess model performance under both thinking and non-thinking modes.”
The paper relies on this without support.
The baseline scores obtained from different sources (leaderboards, papers) are comparable to the scores produced by the paper's evaluation setup.
“Some baselines are derived from the BFCL leaderboard, taking the higher scores between FC and Prompt formats.”
The paper relies on this without support.
The filtering criteria and human annotation in dataset construction correctly identify and remove low-quality or non-verifiable queries/responses without removing valuable ones.
“When QwQ-32B consistently fails to generate correct solutions, human annotators manually assess the accuracy of the responses.”
The paper relies on this without support.
The Qwen2.5-72B-Instruct model can accurately identify non-verifiable queries and assess response accuracy.
“In the query filtering phase, we use Qwen2.5-72B-Instruct to identify and remove queries that are not easily verifiable.”
The paper relies on this without support.
The training methods and hyperparameters used in the RL stages generalize to other settings and do not overfit to the specific benchmarks.
“As a result, we achieve consistent improvements in both training reward and validation performance over the course of a single RL run, without any manual intervention on hyperparameters.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The current effort to independently focus on improving models' longcontext retrieval and short-context capacities at training (Meta, 2024; Chen Wu and Yin Song and Eden Duthie, 2024; Yang et al., 2025; AI et al., 2024) may not fully translate to an overall improvement in long-context ability: failure is possible despite the model excelling in both.”
From Context Length Alone Hurts LLM Performance Despite Perfect Retrieval (2025) · cites this paper as Yang et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, the rapid release of new and more capable LLMs (Grattafiori et al., 2024; Yang et al., 2025) necessitates a continuous and costly re-training cycle, as the entire fine-tuning process must be repeated on D train to leverage the increased knowledge and reasoning abilities of each new base model on the downstream task.”
From TT-SI: Self-Improving LLM Agents with Test-Time Training (2026) · cites this paper as Yang et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Qwen3-14B was selected because it reliably performs paraphrasing, document-grounded QA generation, and translation.”
From Scaling Data-Constrained Language Models with Synthetic Data (2026) · cites this paper as Yang et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The results show that thinking models make fewer arithmetic errors than instruct models, consistent with their stronger reasoning ability (Yu et al., 2025; Guo et al., 2025a; Yang et al., 2025).”
From StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets? (2025) · cites this paper as Yang et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One of the most widely adopted designs is the 'global-batch' LBL introduced by Shazeer et al. (2017), which underpins several state-of-the-art open models such as Qwen 3 (Yang et al., 2025).”
From ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution (2025) · cites this paper as Yang et al. (2025)
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“it has been shown that it is also possible to perform RLVR training on a base model, leading to good math and reasoning performance [21, 29, 31].”
From Generalizing Verifiable Instruction Following (2025) · cites this paper as [31]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“More recently RL has been extensively used for improving code and math performance in verifiable domains [34,64,89,134,204]”
From RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs (2026) · cites this paper as [204]
The cited source says what the claim attributes to it.
In the citing paper
“Different model sizes, such as 7B and 72B, different downstream tasks, and different architectures within the same model family, such as dense Qwen3 [21] and Qwen3 MoE, require task-specific boundaries.”
From SparseX: Efficient Segment-Level KV Cache Sharing for Interleaved LLM Serving (2026) · cites this paper as [21]
The cited source says what the claim attributes to it.
In the citing paper
“Our synthetic corpora were generated exclusively with Qwen3-14B (Yang et al., 2025).”
From Scaling Data-Constrained Language Models with Synthetic Data (2026) · cites this paper as Yang et al., 2025
The cited source says what the claim attributes to it.
In the citing paper
“Although reasoning-tuned models such as Qwen3235B-Think and Qwen3-30B-Think exhibit strong performance in tasks requiring complex reasoning, including math and coding (Yang et al., 2025), they do not consistently outperform instructiontuned counterparts in this trading task.”
From StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets? (2025) · cites this paper as Yang et al., 2025
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Techniques such as grouped-query attention (GQA), multihead latent attention (MLA), and hybrid attention change the KV cache memory footprint but not the underlying management problem [21], [22].”
From Unified AI Gateway: A Framework for Joint Model Routing and KV Cache Management (2026) · cites this paper as [21]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“With the Qwen3-Coder 480B [27, 8] model, Observation Masking achieved a solve rate of 54.8%, a slight improvement over the LLM-Summary's 53.8%.”
From The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Management (2025) · cites this paper as [27]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Qwen3-235B-A22B-Base
“(3) Compared to Llama-4-Scout-Base, Qwen3-32B-Base significantly outperforms it on all 15 benchmarks, with only one-third of the number of parameters of Llama-4-Scout-Base, but twice the number of activated parameters.”
§ Qwen3-235B-A22B-Base
“INCLUDE 64.35 69.05 68.94 68.09 67.87”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 2
- [15]15. Yann N. Dauphin, Angela Fan, Michael Auli, and David Grangier. Language modeling with gated convolutional networks. In ICML, volume 70 of Proceedings of Machine Learning Research, pp. 933-941.
- [16]16. PMLR, 2017.
Cited by
Sorted by citations
Graph Retrieval-Augmented Generation: A Survey
Peng, B., Zhu, Y., Liu, Y., Bo, X., Shi, H., Hong, C., Zhang, Y., & Tang, S. (2026) · ACM Transactions on Information Systems · doi:10.1145/3777378 · Cited by 206
Self-citationRLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs
Chaudhari, S., Aggarwal, P., Murahari, V., Rajpurohit, T., Kalyan, A., Narasimhan, K., Deshpande, A., & Castro da Silva, B. (2026) · ACM Computing Surveys · doi:10.1145/3743127 · Cited by 92
Agentic Large Language Models, a Survey
Plaat, A., Van Duijn, M., Van Stein, N., Preuss, M., Van der Putten, P., & Batenburg, K. J. (2025) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.18675 · Cited by 75
Jailbreak and Guard Aligned Language Models With Only Few In-Context Demonstrations
Wei, Z., Wang, Y., Li, A., Mo, Y., & Wang, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3660147 · Cited by 51
Self-citationBenchmarking DNA foundation models for genomic and genetic tasks
Feng, H., Wu, L., Zhao, B., Huff, C. D., Zhang, J. J., Wu, J., Lin, L., Wei, P., & Wu, C. (2025) · Nature Communications · doi:10.1038/s41467-025-65823-8 · Cited by 83
Self-citationLarge language models forecast patient health trajectories enabling digital twins
Makarov, N., Bordukova, M., Quengdaeng, P., Garger, D., Rodriguez‐Esteban, R., Schmich, F., & Menden, M. P. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02004-3 · Cited by 74
Context Length Alone Hurts LLM Performance Despite Perfect Retrieval
Du, Y., Tian, M., Ronanki, S., Rongali, S., Bodapati, S. B., Galstyan, A., Wells, A., Schwartz, R., Huerta, E. A., & Peng, H. (2025) · Findings of the Association for Computational Linguistics: EMNLP 2025 · doi:10.18653/v1/2025.findings-emnlp.1264 · Cited by 39
Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs
Hua, A., Tang, K., Gu, C., Gu, J., Wong, E., & Qin, Y. (2025) · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2025.emnlp-main.1006 · Cited by 28
Brittlebench: Quantifying LLM robustness via prompt sensitivity
Romanou, A., Ibrahim, M., Ross, C., Oktar, K., Shaib, C., Bell, S. J., Ovalle, A., Bosselut, A., Dodge, J., Sinha, K., et al. (2026) · arXiv · doi:10.48550/arxiv.2603.13285 · Cited by 24
Automating expert-level medical reasoning evaluation of large language models
Zhou, S., Xie, W., Li, J., Zhan, Z., Song, M., Yang, H., Espinoza, C., Welton, L., Mai, X., Jin, Y., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02208-7 · Cited by 30
Multi-step retrieval and reasoning improves radiology question answering with large language models
Wind, S., Sopa, J., Truhn, D., Lotfinia, M., Nguyen, T.-T., Bressem, K. K., Adams, L. C., Rusu, M., Koestler, H., Wellein, G., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02250-5 · Cited by 29
Implementation of large language models in electronic health records
Griot, M., Vanderdonckt, J., & Yuksel, D. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0001141 · Cited by 23
Genos: a human-centric genomic foundation model
Lin, A., Xie, B., Cheng, Y., Wang, C., Chen, D., Wang, E., Lü, F., Xue, G.-R., Zhang, H., Zhan, J., et al. (2025) · GigaScience · doi:10.1093/gigascience/giaf132 · Cited by 15
Self-citationWang, S., Yu, L., Gao, C., Zheng, C., Liu, S., Lu, R., Dang, K., Chen, X., Yang, J., Zhang, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.01939 · Cited by 14
“…reason why supervised fine-tuning (SFT) memorizes but RL generalizes, (ii) how prior knowledge and readability requirements shape the different entropy patterns seen in LLM CoTs compared to traditional RL trajectories, and (iii) the advantage of clip-higher over entropy bonus for RLVR. (§6)”
InfluentialSelf-citationQiu, Z., Huang, Z., Zheng, B., Wen, K., Wang, Z., Men, R., Titov, I., Liu, D., Zhou, J., & Lin, J. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.249 · Cited by 10
Self-citationRemember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
Cao, Z., Deng, J., Yu, L., Zhou, W., Liu, Z., Ding, B., & Zhao, H. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.829 · Cited by 2
Self-citationGEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
Agrawal, L. A., Tan, S., Soylu, D., Ziems, N., Khare, R., Opsahl-Ong, K., Singhvi, A., Shandilya, H., Ryan, M. J., Jiang, M., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.19457 · Cited by 7
VASPilot: MCP-facilitated multi-agent intelligence for autonomous VASP simulations
Liu 刘, J. 家., Zhu 朱, T. 天., Ye 叶, C. 财., Fang 方, Z. 忠., Weng 翁, H. 红., & Wu 吴, Q. 泉. (2025) · Chinese Physics B · doi:10.1088/1674-1056/ae0681 · Cited by 7
AI-agent communication network for 6G: vision, architecture, and key technologies
Duan, X., Huang, Z., Liang, S., Zheng, S., Lu, L., & Sun, T. (2025) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2500582 · Cited by 8
Fang, J., Peng, Y., Zhang, X., Wang, Y., Yi, X., Zhang, G., Xu, Y., Wu, B., Liu, S., Li, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2508.07407 · Cited by 6
Self-citationThe DNA dialect: a comprehensive guide to pretrained genomic language models
Veiner, M., & Supek, F. (2026) · Molecular Systems Biology · doi:10.1038/s44320-025-00184-4 · Cited by 10
When AI Co-Scientists Fail: SPOT-a Benchmark for Automated Verification of Scientific Research
Son, G., Hong, J., Fan, H., Nam, H., Ko, H., Lim, S., Song, J., Choi, J., Paulo, G., Yu, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.11855 · Cited by 5
Zhang, Y., Qiu, Q., Liu, X., Yu, X., Fu, D., Liu, X., wang, Z., Lin, H., Chen, Y., Yi, L., et al. (2026) · Journal of Optical Communications and Networking · doi:10.1364/jocn.576017 · Cited by 10
Self-citationLarge language models for peer review in biotechnology
Li, W., Zhao, R., Sun, P.-T., Lee, J., Lu, O., Yuan, S., Sureshkumar, P., Chen, Y., Xiao, Z., & Tang, Y. J. (2026) · New Biotechnology · doi:10.1016/j.nbt.2026.03.007 · Cited by 4
Generalizing Verifiable Instruction Following
Pyatkin, V., Malik, S., Graf, V., Ivison, H., Huang, S., Dasigi, P., Lambert, N., & Hajishirzi, H. (2025) · arXiv · doi:10.48550/arxiv.2507.02833 · Cited by 4
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
DeepSeek-AI, Xu, A., Lin, B., Xue, B., Wang, B., Xu, B., Wu, B., Zhang, B., Lin, C., Dong, C., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.19348 · Cited by 4
Self-citationDoes Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?
Yue, Y., Chen, Z., Lu, R., Zhao, A., Wang, Z., Yue, Y., Song, S., & Huang, G. (2025) · arXiv · doi:10.48550/arxiv.2504.13837 · Cited by 804
“Discussion 1: Key Differences Between Traditional RL and RLVR for LLMs are Vast Action Space and Pretrained Priors.”
Self-citationWang, X., Chen, Z., Guo, P., Gao, Z.-F., Mu, C., & Lu, Z.-Y. (2026) · Communications Materials · doi:10.1038/s43246-026-01099-9 · Cited by 10
Self-citationAI-generated data contamination erodes pathological variability and diagnostic reliabilityPreprint
He, H., Xiang, S., Zhang, Y., Zhu, Y., Zhang, J., Lu, Y., Deng, H., Alsentzer, E., Liu, Y., Chen, Q., et al. (2026) · medRxiv · doi:10.64898/2026.01.19.26344383 · Cited by 6
Self-citationBrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
Chen, Z., Ma, X., Zhuang, S., Nie, P., Zou, K., Liu, A., Green, J., Patel, K., Meng, R., Su, M., et al. (2025) · arXiv · doi:10.48550/arxiv.2508.06600 · Cited by 3
Self-citationFrom Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
Luo, J., Tian, Y., Cao, C., Luo, Z., Lin, H., Li, K., Kong, C., Yang, R., & Ma, J. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.2069 · Cited by 3
Self-citationGarg, K., Tang, X., Heo, J., Morgan, D. R., Gergle, D., Sudderth, E. B., & Piper, A. M. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791309 · Cited by 3
Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory
Long, L., He, Y., Ye, W., Pan, Y., Lin, Y., Li, H., Zhao, J., & Li, W. (2025) · arXiv · doi:10.48550/arxiv.2508.09736 · Cited by 102
Foo, C. Z., Duggan, A., Bartom, E. T., Tao, L., & Garcı́a-Añoveros, J. (2025) · Journal of the Association for Research in Otolaryngology · doi:10.1007/s10162-025-01005-z · Cited by 2
Liu, C., Wang, W. Y. C., & Khan, G. F. (2025) · Industrial Management & Data Systems · doi:10.1108/imds-05-2025-0609 · Cited by 2
Koh, E. C. Y. (2026) · Research in Engineering Design · doi:10.1007/s00163-026-00476-2 · Cited by 2
Performance of latest AI models, RAG, and MCP on lung cancer-related questions
Zhao, X., Yang, M., Tian, K., Jiang, H., Guo, D., Wang, Y., & Du, J. (2026) · Digital Health · doi:10.1177/20552076261427503 · Cited by 3
Boosting LLMs for Mutation Generation
Wang, B., Deng, M., Chen, M., Yang, C., Lin, Y., Harman, M., Papadakis, M., & Zhang, J. M. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808156 · Cited by 3
Self-citationAuditing medical multi-agent AI reveals risks of false consensus
Zhu, Y., Gu, L., Wang, Z., Sang, H., Sui, D., Tang, W., Mi, L., Wang, Y., Gao, J., Yao, L., et al. (2025) · arXiv · doi:10.48550/arxiv.2510.10185 · Cited by 17
Self-citationBrowseComp-Plus: A Fair and Disentangled Evaluation Benchmark for Deep Search Agents
Chen, Z., Ma, X., Zhuang, S., Nie, P., Zou, K., Sharifymoghaddam, S., Liu, A., Green, J., Patel, K., Meng, R., et al. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.1023 · Cited by 2
Self-citationWang, X., Zeng, Q., Xu, D.-H., Zhang, L., Jiang, G., & Yang, M. (2026) · Journal of Materials Informatics · doi:10.20517/jmi.2025.69 · Cited by 2
Self-citationWilliamson, A., Tavabi, N., Kalepalli, N., Lavoie-Gagne, O. Z., Weiss, A., Bijwadia, S. R., Sibley, A., Owens, B., Andujar, R. A. G., Singh, H., et al. (2026) · Scientific Reports · doi:10.1038/s41598-026-52928-3 · Cited by 1
Zhu, S., Gong, J., Sui, S., Jiang, K., Wang, N., & Zheng, S. (2025) · Journal of Materials Science · doi:10.1007/s10853-025-11692-x · Cited by 3
Wang, R., Wang, J., Wang, Y., Zheng, C., Huang, S., Liu, X., Tan, G., Zhao, W., Wang, Z., Peng, S., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02285-8 · Cited by 1
Self-citationSmall, W. R., Crowley, R. J., Pariente, C. S., Zhang, J., Eaton, K. P., Jiang, L. Y., Oermann, E. K., & Aphinyanaphongs, Y. (2026) · npj Health Systems · doi:10.1038/s44401-025-00059-8 · Cited by 2
Self-citationImproving biomedical entity linking with generative relevance feedback
Shlyk, D., & Hunter, L. (2026) · Bioinformatics · doi:10.1093/bioinformatics/btag011 · Cited by 2
Synergizing Chemical and AI Communities for Advancing Laboratories of the Future
Oh, S., Fang, X., Lin, I.-H., Dee, P., Dunham, C. S., Copp, S. M., Doyle, A. G., de Alaniz, J. R., & Gu, M. (2026) · ACS Central Science · doi:10.1021/acscentsci.5c01994 · Cited by 5
Matsumura, M., Nishida, K., Toyoda, K., Kadoyama, K., Yano, R., Kanazawa, T., Nakamura, T., & Morishima, Y. (2026) · Scientific Reports · doi:10.1038/s41598-026-39676-0 · Cited by 1
RunBugRun: An executable dataset for automated program repair
Prenner, J. A., & Robbes, R. (2026) · Empirical Software Engineering · doi:10.1007/s10664-025-10790-3 · Cited by 33
Fang, W., Li, L., Shi, K., Yang, Y., & Zhang, J. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792976 · Cited by 1
Self-citationSmall but Dangerous: Evaluating and Mitigating Jailbreak Vulnerabilities in Small Language Models
Piano, L., Battistin, C., den Abeele, J. V., & Pompianu, L. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-19099-4_35 · Cited by 1
CLSM: A Collaborative LLM-SM Framework for Road Network Congestion Prediction
Liu, J., Li, L., Chen, B., & Li, Y. (2026) · International Conference on Autonomous Driving and Intelligent Sensing Technology (ADIST) · doi:10.1145/3807211.3807233 · Cited by 1
Wekemo Bioincloud 2026: An AI‐enabled platform for standardized multi‐omics data analyses
Gao, Y.-Y., Zhang, G., Wang, C.-R., et al. (2026) · iMeta · doi:10.1002/imt2.70149 · Cited by 1
Self-citationAgentic systems in computational pathology: architectures, evidence, and translational challenges
Lu, X., Li, Q., Gao, Y., Wei, D., Lyu, M., Ma, S., Li, J., Wu, Y., Cai, L., Zhang, T., et al. (2026) · Journal of Translational Medicine · doi:10.1186/s12967-026-08829-0 · Cited by 2
Implicit-bias-like patterns in reasoning models
Lee, M. H. J., & Lai, C. K. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01300-1 · Cited by 4
Mali, Y., Zeng, Z., Heo, K., Zhang, G., Kashyap, A., Chen, J., Keramatian, K., Saraf, G., Solmi, M., Tam, E. M., et al. (2025) · medRxiv · doi:10.64898/2025.11.30.25341311 · Cited by 1
Nguyen, D.-N., Shakil, S., Tong, R. K.-Y., & Dinh, N. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.14.705953 · Cited by 1
Bridging the Gap in Chinese Legal Conflict Review: A Dataset, Benchmark Tasks, and Framework
Zhao, S., Xu, Y., Chen, Z., Qiao, F., Chen, H., Li, X., Lin, S., Ji, Z., Li, Y., & Wang, W. (2026) · Scientific Data · doi:10.1038/s41597-026-07195-2 · Cited by 2
Sun, X., Hong, Q., Zhang, M., Li, Y., Chen, T., Huang, Z., Liang, G., Tang, W., Xu, S., Ni, X., et al. (2026) · Cell Reports Medicine · doi:10.1016/j.xcrm.2025.102547 · Cited by 3
Oh, G., Kim, S., Park, S., & Kim, B.-H. (2026) · Journal of Medical Internet Research · doi:10.2196/90693 · Cited by 7
“In addition, we evaluate the Qwen3-Instruct models (Qwen3-8B, 30B-IT), which represent the updated nonthinking mode of the Qwen3 model [48].”
StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?
Chen, Y., Yao, Z., Liu, Y., Xin, A., Ye, J., Yu, J., Hou, L., & Li, J. (2025) · arXiv · Cited by 62
Self-citationAgentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
Lin, J., Liu, S., Pan, C., Lin, L., Dou, S., Xi, Z., Huang, X., Yan, H., Han, Z., Gui, T., et al. (2026) · arXiv · doi:10.48550/arxiv.2604.25850 · Cited by 1
“Existing approaches mostly optimize individual harness components, typically the prompt [30, 44, 18] or an in-context playbook [43], with few jointly evolving the full set of editable components [15].”
InfluentialSelf-citationOn Randomness in Agentic Evals
Bjarnason, B. H., Silva, A., & Monperrus, M. (2026) · arXiv · doi:10.48550/arxiv.2602.07150 · Cited by 1
MDTeamGPT: Mitigating Context Collapse and Enabling Self-Evolution in Medical Multi-Agent Reasoning
Chen, K., Li, X., Yang, T., Wang, H., Yang, G., Huo, J., & Gao, Y. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.1427 · Cited by 2
TT-SI: Self-Improving LLM Agents with Test-Time Training
Acikgoz, E. C., Qian, C., Ji, H., Hakkani-Tür, D., & Tur, G. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.462 · Cited by 1
SWE-Pruner: Self-Adaptive Context Pruning for Coding Agents
Wang, Y., Shi, Y., Yang, M., Zhang, R., He, S., Lian, H., Chen, Y., Ye, S., Cai, K., & Gu, X. (2026) · arXiv · doi:10.48550/arxiv.2601.16746 · Cited by 2
HingeMem: Boundary Guided Long-Term Memory with Query Adaptive Retrieval for Scalable Dialogues
Zhong, Y., Gao, Y., & Wang, H. (2026) · Proceedings of the ACM Web Conference 2026 · doi:10.1145/3774904.3792089 · Cited by 1
Context as a Tool: Context Management for Long-Horizon SWE-Agents
Liu, S., Yang, J., Jiang, B., Li, Y., Guo, J., Liu, X., & Dai, B. (2025) · arXiv · doi:10.48550/arxiv.2512.22087 · Cited by 35
Self-citationReasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination
Wu, M., Zhang, Z., Dong, Q., Xi, Z., Zhao, J., Jin, S., Fan, X., Zhou, Y., Lv, H., Zhang, M., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.10532 · Cited by 75
Self-citationDeepResearchGym: A Free, Transparent, and Reproducible Evaluation Sandbox for Deep Research
Coelho, J., Ning, J., He, J., Mao, K., Paladugu, A., Setlur, P., Jin, J., Callan, J., Magalhães, J., Martins, B., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.19253 · Cited by 1
“Link1, Link2, Link3, Link4, Link5, Link6, Link7, Link8, Link9, Link10 Why gas prices are so high Link1, Link2, Link3, Link4, Link5, Link6, Link7, Link8, Link9, Link10 Does religion cause war Link1, Link2, Link3, Link4, Link5, Link6, Link7, Link8, Link9, Link10”
Mamba-3: Improved Sequence Modeling using State Space Principles
Lahoti, A., Li, K. Y., Chen, B., Wang, C., Bick, A., Kolter, J. Z., Dao, T., & Gu, A. (2026) · arXiv · doi:10.48550/arxiv.2603.15569 · Cited by 1
“…modeling accuracy by +2.2 over Transformers, +1.9 points over Mamba-2, and +1.8 over GDN, while Mamba-3 (SISO) improves over the next best model, GDN, by +0.6 points. the perplexity of Mamba-2 with state size 128, effectively achieving the same language modeling performance with half the latency .”
InfluentialLiao, Y., Franco, Z., Lizarraga Mazaba, J. E., & Chen, K. (2026) · Proceedings of the 17th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics · doi:10.1145/3807503.3819453 · Cited by 1
SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios
Le, T., Thai, M. V. T., Manh, D. N., Nhat, H. P., & Bui, N. D. Q. (2025) · arXiv · doi:10.48550/arxiv.2512.18470 · Cited by 79
CAPTURE: Disentangling Preference Drift from Memory Poisoning in Personalized LLM Agents
Hossain, S. M. A., Shayoni, R. K., & Morol, M. K. (2026) · arXiv · doi:10.48550/arxiv.2609.02265 · Cited by 3
“1-8B-Instruct (Yang et al., 2025; Grattafiori et al., 2024), with the extractor and gate built on Qwen2.”
Automated ICD-O-3 Coding of Real-World Pathology Reports Using Self-Hosted Large Language ModelsPreprint
Arzideh, K., Hosch, R., Turki, A. T., Erilymaz, B., Bahn, M., Schäfer, H., Idrissi-Yaghir, A., Khattab, S., Dada, A., Baba, H. A., et al. (2025) · medRxiv · doi:10.1101/2025.07.23.25332040
Borgersen, K. A. K., Goodwin, M., & Nossum, A. S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-11442-6_25
Where Did the Research Data Originate? Acquiring Provenance of Research Data from Scholarly Papers
Motegi, K., Ito, K., & Matsubara, S. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4861-3_29
Dataset Similarity Estimation Using LLM-Based Metadata Embeddings
Ito, K., & Matsubara, S. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4861-3_11
Du, R., Mancheong, F. U. N. G., Yuanjia, H. U., & Dongyang, L. I. U. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.12.699148
Self-citationA multimodal dataset of causal mechanisms in materials science literature
Liu, Y., Wang, C., Liu, J., Shi, X. D., Huang, Y., Cheng, Q., & Lu, W. (2026) · Scientific Data · doi:10.1038/s41597-026-06598-5
Self-citationGu, R., Liu, Y., Zhu, B., Liang, L., Liu, H., Zhang, Y., & Chen, Y. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c02499 · Cited by 1
Self-citationNoRMA: A Multi-agent Communication-Centric Dataset for Enhanced Customs Nomenclature Classification
Bouchtib, H., Karboub, K., Tabaa, M., & Hamlich, M. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-15632-7_18
SIPA: a self-iterative preference alignment method for generative language models
Du, Y., Wang, B., Hou, Y., & Han, H. (2026) · Applied Intelligence · doi:10.1007/s10489-025-07079-9
Lai, Z., Li, J., & Zhu, X. (2026) · Nanoscale · doi:10.1039/d5nr05302a
Prompt Engineering for Large Models
Yu, J. S., & Yao, Y. (2026) · Springer eBooks · doi:10.1007/978-981-95-4632-9_3
Medical concept understanding in large language models is fragmentedPreprint
Deng, L., Chen, L., & Liu, M. (2026) · medRxiv · doi:10.64898/2026.03.03.26347552
Self-citationCareEval: Evaluating Large Language Models for Decision-Making in Physical Robot Caregiving
Liu, Z., Dimitropoulou, K. A., Cheung, C., & Bhattacharjee, T. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3776734.3794354
Arzideh, K., Schäfer, H., Idrissi-Yaghir, A., Eryılmaz, B., Warmer, S., Hartmann, E. M., Borys, K., Schmidt, C. S., Haubold, J., Umutlu, L., et al. (2026) · European Radiology · doi:10.1007/s00330-026-12445-3 · Cited by 1
OPENXRD: a comprehensive benchmark framework for LLM/MLLM XRD question answering
Vosoughi, A., Shahnazari, A., Xi, Y., Zhang, Z., Hess, G., Xu, C., & Abdolrahim, N. (2026) · Digital Discovery · doi:10.1039/d5dd00519a · Cited by 4
Self-citationVidor, P. R., Casiraghi, Y., de Souza, A. M., & Schmidt, M. I. (2026) · Scientific Reports · doi:10.1038/s41598-026-44303-z · Cited by 1
Iterative Reranking as a Compute-Scaling Method for LLM-Based Rankers
Czinczoll, T., Liu, D., & Betello, F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21321-1_16
Self-citationWebsite Segmentation Beyond Structure: A Benchmark on Functional and Digital Maturity Classes
Saxer, J., Gerber, J., Weiler, A., & Grossniklaus, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21300-6_14
ji, C., Li, H., & Huang, X. (2026) · Research Square · doi:10.21203/rs.3.rs-8183155/v1
Liu, Y., Liu, X., Huang, H., Yu, F., Xiong, T., Xia, X., You, B., & Wu, J. (2026) · Artificial Intelligence and Law · doi:10.1007/s10506-026-09510-z
Self-citationComputational identification of salient cancer care topics and themes in oncology social work notes
Benson, R., Rajkumar, S., Kenny, C., Zhao, M., Chang, J.-H., Scheel, T., Boreta, L. C., & Hong, J. C. (2026) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkag033
Poimanov, D. R., & Shutov, M. S. (2025) · Automatic Documentation and Mathematical Linguistics · doi:10.3103/s0005105525701389
Dey, S. K., Qureshi, A. I., & Shyu, C. (2026) · medRxiv · doi:10.64898/2026.04.09.26350523
Ngo, T. T., Nguyen, A.-M., Van, D. N., & Nguyen-Quoc, A. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798320 · Cited by 1
Manikpuri, R., Madhariya, R., Raj, R., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9336263/v1
Metadata
- Authors
- Yang, A., Li, A., Yang, B., Zhang, B., Hui, B., Zheng, B., Yu, B., Gao, C., Huang, C., Lv, C., Zheng, C., Liu, D., Zhou, F., Huang, F., Hu, F., Ge, H., Wei, H., Lin, H., Tang, J., Yang, J., Tu, J., Zhang, J., Yang, J., Yang, J., Zhou, J., Zhou, J., Lin, J., Dang, K., Bao, K., Yang, K., Yu, L., Deng, L., Li, M., Xue, M., Li, M., Zhang, P., Wang, P., Zhu, Q., Men, R., Gao, R., Liu, S., Luo, S., Li, T., Tang, T., Yin, W., Ren, X., Wang, X., Zhang, X., Ren, X., Fan, Y., Su, Y., Zhang, Y., Zhang, Y., Wan, Y., Liu, Y., Wang, Z., Cui, Z., Zhang, Z., Zhou, Z., & Qiu, Z.
- ORCID
- Li, Anfeng
- Yang, Baosong
- Zhang, Beichen
- Hui, Binyuan
- Yu, Bowen
- Gao, Chang
- Zheng, Chujie
- Liu, Dayiheng
- Huang, Fei
- Wei, Haoran
- Yang, Jian
- Tu, Jianhong
- Zhang, Jianwei
- Yang, Jiaxi
- Zhou, Jing
- Zhou, Jingren
- Lin, Junyang
- Bao, Keqin
- Yang, Kexin
- Yu, Le
- Li, Mei
- Li, Mingze
- Zhang, Pei
- Wang, Peng
- Men, Rui
- Liu, Shixuan
- Luo, Shuang
- Li, Tianhao
- Wang, Xinyu
- Ren, Xuancheng
- Zhang, Yichang
- Zhang, Yinger
- Wang, Zekun
- Zhou, Zhipeng
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2505.09388
- OpenAlex
- W4414939355
- Cited by
- 17,283
- References
- 0
- Citations by year
- 2026: 14351 · 2025: 2907
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- Qwen3, large language models, mixture of experts, thinking mode, dynamic mode switching, multilingual support, code generation, mathematical reasoning, inference efficiency, knowledge distillation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
