The DOI matches its DataCite record; 1 of the 13 references it cites were found in a registry or an index, and 12 are not checked yet.
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Open accessAbstract
Mathematical reasoning poses a significant challenge for language models due to its complex and structured nature. In this paper, we introduce DeepSeekMath 7B, which continues pre-training DeepSeek-Coder-Base-v1.5 7B with 120B math-related tokens sourced from Common Crawl, together with natural language and code data. DeepSeekMath 7B has achieved an impressive score of 51.7% on the competition-level MATH benchmark without relying on external toolkits and voting techniques, approaching the performance level of Gemini-Ultra and GPT-4. Self-consistency over 64 samples from DeepSeekMath 7B achieves 60.9% on MATH. The mathematical reasoning capability of DeepSeekMath is attributed to two key factors: First, we harness the significant potential of publicly available web data through a meticulously engineered data selection pipeline. Second, we introduce Group Relative Policy Optimization (GRPO), a variant of Proximal Policy Optimization (PPO), that enhances mathematical reasoning abilities while concurrently optimizing the memory usage of PPO.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Recent studies primarily rely on rule-based verification (Shao et al., 2024; Mroueh, 2025), where agent trajectories are evaluated against predefined rules (Wei et al., 2025).”
From AJ-Bench: Benchmarking Agent-as-a-Judge for Environment-Aware Evaluation (2026) · cites this paper as Shao et al., 2024
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Among recent advances, GRPO (Shao et al., 2024) enhances stability by optimizing policies based on the relative quality of sampled trajectories, removing the need for an explicit value function.”
From Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents (2026) · cites this paper as Shao et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Early methods for mid-training data curation prioritized high-value sources by up-sampling domain-specific corpora and curated reasoning data, particularly those with CoT trajectories, to strengthen relevant analytical and reasoning capabilities in specific domains [30,176].”
From A Survey of Large Language Models (2026) · cites this paper as [30]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“State-of-the-art approaches [98, 2] typically employ reinforcement learning frameworks [116], where a multi-objective reward function is designed to optimize correctness and length compliance jointly.”
From Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodality (2025) · cites this paper as [116]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Outcome-based RL like GRPO (Shao et al., 2024) addresses this by encouraging diverse reasoning paths, including error and self-correction, while given ground-truth feedback”
From Self-Correction Bench: Uncovering and Addressing the Self-Correction Blind Spot in Large Language Models (2025) · cites this paper as Shao et al., 2024
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Reinforcement learning (RL) algorithms like PPO (Schulman et al., 2017) and GRPO (Shao et al., 2024) have effectively aligned LLM agents for complex tasks.”
From Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updates (2026) · cites this paper as Shao et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The run halts itself at step 175 on ten consecutive zero-advantage batches: once almost every sampled rollout in a group answers correctly, GRPO's group-relative advantage (and hence the gradient) goes to zero.”
From Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents (2026) · cites this paper as Shao et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our results indicate that RLVR with Group Region Policy Optimization (GRPO) [21] and data augmentation leads to significant performance increases on old IF benchmarks and IFBENCH.”
From Generalizing Verifiable Instruction Following (2025) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“it has been shown that it is also possible to perform RLVR training on a base model, leading to good math and reasoning performance [21, 29, 31].”
From Generalizing Verifiable Instruction Following (2025) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Reinforcement learning with verifiable rewards has been shown to be an effective approach for improving mathematical reasoning and coding abilities in language models [15, 21, 8, 33, 10, 13]”
From Generalizing Verifiable Instruction Following (2025) · cites this paper as [21]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“One notable example is GRPO [167], which eliminates the need for a separate value model, which group multiple rollouts for a single input prompt and uses the mean of rewards as a baseline.”
From RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs (2026) · cites this paper as [167]
The cited source says what the claim attributes to it.
In the citing paper
“Technically, capability internalization is achieved by learning from reasoning traces, through supervised fine-tuning (Wei et al., 2022; Zelikman et al., 2022; Schick et al., 2023; Mukherjee et al., 2023) or preference-guided optimization methods such as DPO (Rafailov et al., 2023; Tunstall et al., 2023; Yuan et al., 2024c; Grattafiori et al., 2024) and GRPO (Shao et al., 2024; DeepSeek-AI et al.,”
From Memory in the Age of AI Agents (2025) · cites this paper as Shao et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“This formulation avoids an explicit value function while maintaining PPO-style stability.”
From Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning (2025) · cites this paper as Shao et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“GRPO enables a streamlined approach to policy optimization, wherein the advantage function is derived by normalizing rewards within a cohort of responses generated for each prompt.”
From Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning (2025) · cites this paper as Shao et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“We experimented with various on-policy methods such as Group Relative Policy Optimization (GRPO) [66] and Proximal Policy Optimization (PPO) [67], but found the training to be unstable.”
From Self-Adapting Language Models (2025) · cites this paper as [66]
The cited source says what the claim attributes to it.
In the citing paper
“This can be viewed as an interpolation between per-question baselines, as in GRPO (Shao et al., 2024), and a global baseline, allowing for more structured variance reduction tailored to each task setup.”
From Absolute Zero: Reinforced Self-play Reasoning with Zero Data (2025) · cites this paper as Shao et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Notably, DeepSeek-R1 (Guo et al., 2025) further demonstrates the feasibility of pure RL with Group Relative Policy Optimisation (Shao et al., 2024) when ground-truth verification is possible.”
From A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems (2025) · cites this paper as Shao et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“achieving performance competitive with GRPO (Shao et al., 2024), which relies on reinforcement learning.”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Shao et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“In the normal mode and the more challenging cross mode , iCLP consistently outperforms all baselines and closely matches the performance of the GRPO algorithm (Shao et al., 2024).”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Shao et al., 2024
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“non-thinking mode still exhibits the blind spot.”
From Self-Correction Bench: Uncovering and Addressing the Self-Correction Blind Spot in Large Language Models (2025) · cites this paper as Shao et al., 2024
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“held-out oracle accuracy rises from 9.0% to 16.7% (13/78 vs. 7/78 correct), a + 7.7-point ( + 86% relative) gain that nearly doubles the untrained baseline”
From Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents (2026) · cites this paper as Shao et al., 2024
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“On the procedural training distribution, GRPO reward climbs from 0.66 to 0.97 (Figure 4a).”
From Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents (2026) · cites this paper as Shao et al., 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 41
- J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le, et al. Program synthesis with large language models. arXiv preprint arXiv:2108.07732, 2021. · arXiv
- Z. Azerbayev, H. Schoelkopf, K. Paster, M. D. Santos, S. McAleer, A. Q. Jiang, J. Deng, S. Bider- man, and S. Welleck. Llemma: An open language model for mathematics. arXiv preprint arXiv:2310.10631, 2023. · arXiv
- J. Bai, S. Bai, Y. Chu, Z. Cui, K. Dang, X. Deng, Y. Fan, W. Ge, Y. Han, F. Huang, et al. Qwen technical report. arXiv preprint arXiv:2309.16609, 2023. · arXiv
- C. Burns, P. Izmailov, J. H. Kirchner, B. Baker, L. Gao, L. Aschenbrenner, Y. Chen, A. Ecoffet, M. Joglekar, J. Leike, et al. Weak-to-strong generalization: Eliciting strong capabilities with weak supervision. arXiv preprint arXiv:2312.09390, 2023. · arXiv
- M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. de Oliveira Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such, D. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W. H. Guss, A. Nichol, A. Paino, N. Tezak, J. Tang, I. Babuschkin, S. Balaji, S. Jain, W. Saunders, C. Hesse, A. N. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, and W. Zaremba. Evaluating large language models trained on code. CoRR, abs/2107.03374, 2021. URL https://arxiv.org/abs/2107.03374. · arXiv
- K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano, et al. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168, 2021. · arXiv
- Z. Du, Y. Qian, X. Liu, M. Ding, J. Qiu, Z. Yang, and J. Tang. Glm: General language model pretraining with autoregressive blank infilling. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 320-335, 2022.
- L. Gao, A. Madaan, S. Zhou, U. Alon, P. Liu, Y. Yang, J. Callan, and G. Neubig. PAL: program- aided language models. In A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, and J. Scarlett, editors, International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA, volume 202 of Proceedings of Machine Learning Research, pages 10764-10799. PMLR, 2023. URL https://proceedings.mlr.press/v202/gao23f. html.
- D. Guo, Q. Zhu, D. Yang, Z. Xie, K. Dong, W. Zhang, G. Chen, X. Bi, Y. Wu, Y. K. Li, F. Luo, Y. Xiong, and W. Liang. Deepseek-coder: When the large language model meets programming -the rise of code intelligence, 2024. · DOI · Paper page
- D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, and J. Steinhardt. Measuring massive multitask language understanding. arXiv preprint arXiv:2009.03300, 2020. · arXiv
- D. Hendrycks, C. Burns, S. Kadavath, A. Arora, S. Basart, E. Tang, D. Song, and J. Steinhardt. Mea- suring mathematical problem solving with the math dataset. arXiv preprint arXiv:2103.03874, 2021. · arXiv
- A. Q. Jiang, S. Welleck, J. P. Zhou, W. Li, J. Liu, M. Jamnik, T. Lacroix, Y. Wu, and G. Lample. Draft, sketch, and prove: Guiding formal theorem provers with informal proofs. arXiv preprint arXiv:2210.12283, 2022. · arXiv
- A. Joulin, E. Grave, P. Bojanowski, M. Douze, H. Jégou, and T. Mikolov. Fasttext. zip: Compress- ing text classification models. arXiv preprint arXiv:1612.03651, 2016. · arXiv
- W. Kwon, Z. Li, S. Zhuang, Y. Sheng, L. Zheng, C. H. Yu, J. E. Gonzalez, H. Zhang, and I. Stoica. Efficient memory management for large language model serving with pagedattention. In Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles, 2023.
- Y. Leviathan, M. Kalman, and Y. Matias. Fast inference from transformers via speculative decoding. In International Conference on Machine Learning, pages 19274-19286.
- PMLR, 2023.
- A. Lewkowycz, A. Andreassen, D. Dohan, E. Dyer, H. Michalewski, V. Ramasesh, A. Slone, C. Anil, I. Schlag, T. Gutman-Solo, et al. Solving quantitative reasoning problems with language models. Advances in Neural Information Processing Systems, 35:3843-3857, 2022a.
- A. Lewkowycz, A. Andreassen, D. Dohan, E. Dyer, H. Michalewski, V. V. Ramasesh, A. Slone, C. Anil, I. Schlag, T. Gutman-Solo, Y. Wu, B. Neyshabur, G. Gur-Ari, and V. Misra. Solving quantitative reasoning problems with language models. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 -December 9, 2022, 2022b. URL http://papers.nips. cc/paper_files/paper/2022/hash/18abbeef8cfe9203fdf9053c9c4fe191-Abstr act-Conference.html.
- H. Lightman, V. Kosaraju, Y. Burda, H. Edwards, B. Baker, T. Lee, J. Leike, J. Schulman, I. Sutskever, and K. Cobbe. Let's verify step by step. arXiv preprint arXiv:2305.20050, 2023. · arXiv
- I. Loshchilov and F. Hutter. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017. · arXiv
- H. Luo, Q. Sun, C. Xu, P. Zhao, J. Lou, C. Tao, X. Geng, Q. Lin, S. Chen, and D. Zhang. Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol-instruct. arXiv preprint arXiv:2308.09583, 2023. · arXiv
- X. Nguyen, W. Zhang, X. Li, M. M. Aljunied, Q. Tan, L. Cheng, G. Chen, Y. Deng, S. Yang, C. Liu, H. Zhang, and L. Bing. Seallms -large language models for southeast asia. CoRR, abs/2312.00738, 2023. doi: 10.48550/ARXIV.2312.00738. URL https://doi.org/10.485 50/arXiv.2312.00738. · DOI
- OpenAI. GPT4 technical report. arXiv preprint arXiv:2303.08774, 2023. · arXiv
- L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray, et al. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730-27744, 2022.
- L. C. Paulson. Three years of experience with sledgehammer, a practical link between auto- matic and interactive theorem provers. In R. A. Schmidt, S. Schulz, and B. Konev, editors, Proceedings of the 2nd Workshop on Practical Aspects of Automated Reasoning, PAAR-2010, Edinburgh, Scotland, UK, July 14, 2010, volume 9 of EPiC Series in Computing, pages 1-10. EasyChair, 2010. doi: 10.29007/TNFD. URL https://doi.org/10.29007/tnfd. · DOI
- S. Polu and I. Sutskever. Generative language modeling for automated theorem proving. CoRR, abs/2009.03393, 2020. URL https://arxiv.org/abs/2009.03393. · arXiv
- J. Schulman, P. Moritz, S. Levine, M. Jordan, and P. Abbeel. High-dimensional continuous control using generalized advantage estimation. arXiv preprint arXiv:1506.02438, 2015. · arXiv
- J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017. · arXiv
- F. Shi, M. Suzgun, M. Freitag, X. Wang, S. Srivats, S. Vosoughi, H. W. Chung, Y. Tay, S. Ruder, D. Zhou, D. Das, and J. Wei. Language models are multilingual chain-of-thought reasoners. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023. URL https://openreview.net/pdf?id= fR3wGCk-IXp.
- F. Song, B. Yu, M. Li, H. Yu, F. Huang, Y. Li, and H. Wang. Preference ranking optimization for human alignment. arXiv preprint arXiv:2306.17492, 2023. · arXiv
- M. Suzgun, N. Scales, N. Schärli, S. Gehrmann, Y. Tay, H. W. Chung, A. Chowdhery, Q. V. Le, E. H. Chi, D. Zhou, et al. Challenging big-bench tasks and whether chain-of-thought can solve them. arXiv preprint arXiv:2210.09261, 2022. · arXiv
- T. H. Trinh, Y. Wu, Q. V. Le, H. He, and T. Luong. Solving olympiad geometry without human demonstrations. Nature, 625(7995):476-482, 2024.
- P. Wang, L. Li, L. Chen, F. Song, B. Lin, Y. Cao, T. Liu, and Z. Sui. Making large language models better reasoners with alignment. arXiv preprint arXiv:2309.02144, 2023a. · arXiv
- P. Wang, L. Li, Z. Shao, R. Xu, D. Dai, Y. Li, D. Chen, Y. Wu, and Z. Sui. Math-shepherd: Verify and reinforce llms step-by-step without human annotations. CoRR, abs/2312.08935, 2023b. · arXiv
- J. Wei, X. Wang, D. Schuurmans, M. Bosma, B. Ichter, F. Xia, E. H. Chi, Q. V. Le, and D. Zhou. Chain-of-thought prompting elicits reasoning in large language models. In NeurIPS, 2022. URL http://papers.nips.cc/paper_files/paper/2022/hash/9d5609613524ecf 4f15af0f7b31abca4-Abstract-Conference.html.
- H. Xia, T. Ge, P. Wang, S.-Q. Chen, F. Wei, and Z. Sui. Speculative decoding: Exploiting speculative execution for accelerating seq2seq generation. In H. Bouamor, J. Pino, and K. Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, pages 3909- 3925, Singapore, Dec. 2023. Association for Computational Linguistics. doi: 10.18653/v1/20 · DOI
- H. Xia, Z. Yang, Q. Dong, P. Wang, Y. Li, T. Ge, T. Liu, W. Li, and Z. Sui. Unlocking efficiency in large language model inference: A comprehensive survey of speculative decoding. arXiv preprint arXiv:2401.07851, 2024. · arXiv
- S. Yao, D. Yu, J. Zhao, I. Shafran, T. L. Griffiths, Y. Cao, and K. Narasimhan. Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint arXiv:2305.10601, 2023. · arXiv
- Z. Yuan, H. Yuan, C. Li, G. Dong, C. Tan, and C. Zhou. Scaling relationship on learning mathematical reasoning with large language models. arXiv preprint arXiv:2308.01825, 2023a. · arXiv
- Z. Yuan, H. Yuan, C. Tan, W. Wang, S. Huang, and F. Huang. Rrhf: Rank responses to align language models with human feedback without tears. arXiv preprint arXiv:2304.05302, 2023b. · arXiv
- K. Zheng, J. M. Han, and S. Polu. Minif2f: a cross-system benchmark for formal olympiad-level mathematics. arXiv preprint arXiv:2109.00110, 2021. · arXiv
Cited by
Sorted by citations
Items 101–178 of 178
SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training
Song, H., Huang, L., Sun, S., Jiang, J., Le, R., Cheng, D., Chen, G., Hu, Y., Chen, Z., Jia, Y., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.03411
“We adopt Reinforcement Learning with Verifiable Reward (RLVR) as our foundational paradigm, employing the Group Relative Policy Optimization (GRPO) algorithm [32] to optimize SWE-Master-SFT directly.”
ACTIVE-o3: Empowering MLLMs with Active Perception via Pure Reinforcement Learning
Zhu, M., Zhong, H., Zhao, C., Du, Z., Liu, M., Huang, Z., Li, A., Chen, H., Zou, C., Chen, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.21457
DeepResearchGym: A Free, Transparent, and Reproducible Sandbox for Deep Research
Coelho, J., Ning, J., He, J., Mao, K., Paladugu, A. S., Setlur, P., Jin, J., Callan, J., Magalhães, J., Martins, B., et al. (2026) · Proceedings of the 2026 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR) · doi:10.1145/3805713.3820409
OS-Themis: A Scalable Critic Framework for Generalist GUI Rewards
Li, Z., Wu, Z., Zhao, Y., Yang, B., Xie, J., Liu, Z., Liu, Z., Jin, K., Liang, J., Li, Z., et al. (2026) · arXiv · doi:10.48550/arxiv.2603.19191
Beyond the Capability Boundary: Zeroth-Order Optimization for Self-Evolving LLM Agents
Liu, B., Fan, X., Wu, Y., Gao, Z., Gao, M., Li, C., & Jia, Y. (2026) · arXiv
Self-citationCoCoReviewBench: A Completeness- and Correctness-Oriented Benchmark for AI Reviewers
Deng, H., Ke, X., Li, Y., Hu, R., Huang, D., Wong, D. F., Wang, Y., Liu, X., & Zhang, M. (2026) · arXiv · doi:10.48550/arxiv.2605.07905
Self-citationVisual-ERM: Reward Modeling for Visual Equivalence
Liu, Z., Ding, S., Fang, X., Dai, X., Yang, P., Liang, J., Wang, J., Chen, K., Lin, D., & Zang, Y. (2026) · arXiv · doi:10.48550/arxiv.2603.13224
Yu, Y., Yao, L., Xie, Y., Tan, Q., Feng, J., Li, Y., & Wu, L. (2026) · arXiv · doi:10.48550/arxiv.2601.01885
Self-citationAJ-Bench: Benchmarking Agent-as-a-Judge for Environment-Aware Evaluation
Shi, W., Wang, Y., Zhao, Y., Chen, Y., Feng, F., Hao, X., Su, X., Gu, Q., Su, H., Cai, X., et al. (2026) · arXiv · doi:10.48550/arxiv.2604.18240
Mendel Gödel Machine: Recursive Self-Improving Coding Agents via Comparative Evolution
Liu, C., Liu, Y., Yan, S., Tresp, V., & Ma, Y. (2026) · arXiv · doi:10.48550/arxiv.2608.07645
Tsui, K. (2025) · arXiv · doi:10.48550/arxiv.2507.02778 · Cited by 29
Judging the Judges: Confidence and Disagreement in Rubrics as Rewards
Liu, M. T.-Y., Harrington, A., Darrell, T., & Bai, Y. (2026) · arXiv · doi:10.48550/arxiv.2610.21179
Mitigating Context Interference for Reliable and Efficient Search Agents
Xue, B., Wu, B., Qiao, S., Wang, S., Wang, R., Du, Y., Wang, H., Pan, J. Z., Yilmaz, E., Wong, K.-F., et al. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.160
“A variety of RL algorithms have been introduced, like PPO (Schulman et al., 2017) and GRPO (Shao et al., 2024).”
InfluentialSkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning
Xia, P., Chen, J., Wang, H., Liu, J., Zeng, K., Wang, Y., Han, S., Zhou, Y., Zhao, X., Chen, H., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.08234
OmniGen2: Towards Instruction-Aligned Multimodal Generation
Wu, C., Zheng, P., Yan, R., Xiao, S., Luo, X., Wang, Y., Li, W., Jiang, X., Liu, Y., Zhou, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.18871
Enhancing Biosecurity with Language Models: Defining Research DirectionsPreprint
Chen, M., Holub, M., & Tice, C. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4772574
Bansal, N., C, S. D. R., Pathak, A., & Narayanan, M. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.09.17.613424
StreamAdapter: Efficient Test Time Adaptation from Contextual StreamsPreprint
Muhtar, D., Shen, Y., Yang, Y., Liu, X., Lu, Y., Liu, J., Zhan, Y., Sun, H., Deng, W., Sun, F., et al. (2024) · Qeios · doi:10.32388/g5h95j · Cited by 10
Tabib, H. M. S., & Deedar, J. A. (2024) · International Journal on Natural Language Computing · doi:10.5121/ijnlc.2024.13604 · Cited by 1
Enhancing Code LLMs with Reinforcement Learning in Code Generation: A SurveyPreprint
He, Y., Shi, T., Li, Y., & Chen, Q. (2025) · Qeios · doi:10.32388/8g8tb2
Self-citationAlonso, M. N. I. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5080865
A Survey of LLM-Based Methods for Synthetic Data Generation and the Rise of Agentic Workflows
Alismail, A., & Lanquillon, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93418-6_9 · Cited by 3
Benchmarking Large Language Models on Network Optimization
Cui, E. (2025) · Operations Research and Applications An International Journal · doi:10.5121/oraj.2025.12201
TestFlow: Advancing Mobile UI Testing through Multi-Step Reinforcement Learning
Tang, X., Chen, X., Chen, D., Zhou, S., Jiang, W., & Li, Y. (2025) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3713081.3732930
Self-citationChallenging Deepseek-R1 with Serbian High School Math Competition Problems
Vučićević, N., Svicevic, M. R., & Milenković, A. (2025) · International Scientific Conference Sinteza · doi:10.15308/sinteza-2025-274-280
Enhancing Clinical Reasoning in Medical Vision-Language Model through Structured PromptsPreprint
Prakash, K. D., Kim, K., & Han, Y. (2025) · medRxiv · doi:10.1101/2025.07.31.25331901
Unmasking Model Behavior: How LLMs Reason on Vulnerability Detection
Fontana, A., & Simoni, M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-00639-4_18
Large language models – the future of fundamental physics?
Heneka, C. S., Nieser, F., Ore, A., Plehn, T., & Schiller, D. (2026) · SciPost Physics · doi:10.21468/scipostphys.20.3.070 · Cited by 13
Our EEG group discussion on 'useful' AI tools
Madhavapeddy, A. (2025) · doi:10.59350/zgqbx-b5333
Our EEG group discussion on 'useful' AI tools
Madhavapeddy, A. (2025) · doi:10.59350/qxz6t-xre87
Autonomous Reasoning-Retrieval for Large Language Model Based Recommendation
Zheng, B., Wang, X., Liu, E., Wang, X., Lu, H., Chen, Y., Zhao, W. X., & Wen, J.-R. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761384
Li, X., Sun, F., Yu, J., & Zhang, Y. (2025) · doi:10.1145/3746276.3760467
SIPA: a self-iterative preference alignment method for generative language models
Du, Y., Wang, B., Hou, Y., & Han, H. (2026) · Applied Intelligence · doi:10.1007/s10489-025-07079-9
Zeng, S., Zhang, W., Li, C., Jiang, Y., Wang, D., Shao, Q., & Xu, D. (2026) · Biophysical Journal · doi:10.1016/j.bpj.2026.02.001
KnowFC: Navigating Knowledge Conflicts in Large Language Model-based Fact-Checking
Zhang, Y., Zhou, S., Li, X., Tian, Z., Gao, Y., Zhang, S., Hou, W., Liu, Y., & Zhou, B. (2026) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3773966.3777935 · Cited by 2
Haddad, M.-S., & Seibel, A. (2026) · Journal of Engineering Design · doi:10.1080/09544828.2026.2639928
Toward Generalized Web Agent Training: A Deep Dive into Entropy-Balanced Reinforcement Learning
Dong, G., Bao, L., Wang, Z., Zhao, K., Li, X., Jin, J., Yang, J., Mao, H., Zhang, F., Gai, K., et al. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792301 · Cited by 3
Text Classification Using LLM and Group Relative Policy Optimization (GRPO)
Vaghasiya, V., Shimpi, D., Shah, P., & Bhatt, J. S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-18477-1_65
Maintaining Control States for Initialization-Aware GRPO in Industrial LLM Workflows
Liu, C., Yuan, Z., 范奉媛, Che, L., Qian, Q., Liang, Q., Sun, Z., & Zhang, L. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834459
Wu, S., Zhong, X., Zhang, D., Duan, S., & Wang, L. (2026) · International Conference on Big Data and Informatization Education (ICBDIE) · doi:10.1145/3806980.3807011
Grow3D: Hierarchical Next-Scale Octree Prediction for Fast and High-Fidelity 3D Shape Generation
Feng, Q.-Y., Zou, Z., Chen, H.-X., Guo, Y.-C., Cao, Y., Mu, T., & Hu, S. (2026) · ACM Transactions on Graphics · doi:10.1145/3820379
Singh, N. P., Wang, X., Garikipati, A., Ciobanu, M., Mao, Q., & Das, R. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1851993
LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression
Yuan, B., Wang, Z., Luo, Y., Wang, S., & Huang, Z. H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37211-6_20
Wang, C., Beppu, S., Soma, D., Sumita, S., Wakayama, Y., Yoshikane, N., & Tsuritani, T. (2026) · Journal of Optical Communications and Networking · doi:10.1364/jocn.600499
Exp$$^{2}$$RL: Enhancing LLM Agent Training with Expert Experiences
Li, Y., Chen, Q., Zhang, Z., Deng, Y., Gong, Y., & ZHANG, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2856-0_45
Self-citationGenFacet: End-to-End Generative Faceted Search via Multi-Task Preference Alignment in E-Commerce
Zhai, Z., Yang, M., & Li, J. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808451 · Cited by 1
AdversarialCoT: Single-Document Retrieval Poisoning for LLM Reasoning
Song, H., Liu, Y.-A., Zhang, R., Guo, J., de Rijke, M., Fan, Y., & Cheng, X. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809838 · Cited by 2
Tool-Star: Empowering Multi-Tool Collaborative Web Agent via Reinforcement Learning
Dong, G., Chen, Y., Li, X., Jin, J., Qian, H., Zhu, Y., Mao, H., Zhou, G., Dou, Z., & Wen, J.-R. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809712 · Cited by 2
SARE: Soft Alignment Reward for Reinforcement Learning in Generative Recommendation
Yang, Y., Wang, Z., Li, L., & Zeng, D. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3391-5_45
Ma, M., Wu, Y., Chen, X., Jiang, F., Lin, P., Ye, D., Sun, Y., Zhang, Y., Shi, T., Zhao, Y., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.28.741284 · Cited by 1
Self-citationGUIDER: Generative User Interest Discovery via Explicit Reasoning with Large Language Models
Wu, J., Wu, Y., Liu, S., Bai, Y., Zhu, Q., Xiao, H., & Yang, F. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818428
Self-citationLuo, Q.-W., Ren, S., Chen, X., Liu, R., Fang, J., Tan, N., & Huang, S.-J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817726 · Cited by 3
Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis
Qiu, Z., Qiao, S., Xu, K., Zhu, Y., Du, L., Zhang, N., & Chen, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3819049 · Cited by 3
Multimodale Deepfake-Erkennung in der Praxis: Framework und Prototyp für die digitale Forensik
Jarvers, L., Bezzaoui, I., & Fegert, J. (2026) · HMD Praxis der Wirtschaftsinformatik · doi:10.1365/s40702-026-01314-8
Hierarchical Residual Policy Optimization for Generative Recommendations
Guo, K., Yang, Y., Gao, J., Zeng, G., Yang, F., Liang, Y., Jiang, P., Cai, Q., & Zhao, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818206 · Cited by 1
Towards general auditory intelligence for machine listening and speaking
Wang, S., Jin, Z., Tang, C., Li, Q., Li, B., Chen, C., Hu, Y., Yu, W., Li, Y., Zhuang, J., et al. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01281-1 · Cited by 6
Self-citationLarge Language Models as Distributional Baselines for Language Tasks
Trott, S., Michaelov, J. A., Jones, C., Chang, T. A., & Bergen, B. K. (2026) · Open Mind · doi:10.1162/opmi.a.373
Ji, J., Sun, Z., Ying, X., Hao, J., Fu, Z., Shi, D., Kong, X., Xu, Y., Zhang, X., Du, X., et al. (2026) · medRxiv · doi:10.64898/2026.08.28.26361585
Reconstructing wireless signals for low altitude networks using small language models
Li, X., Liu, R., & Yuen, C. (2026) · npj Wireless Technology · doi:10.1038/s44459-026-00084-5
Qiu, J., Qin, Z., Ma, K., Hu, P., Zhang, Y., Xie, X., Zhao, W., & Wei, X. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.4079
DFRL-Mol: a dual-stage framework of reinforcement learning for multi-scenario molecule optimization
Wu, Z., Zhao, P., Li, J., Wang, Q., Zhang, Q., Yu, H., Yu, Z., & Shi, J. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag493
Mao, Z., Gao, Y., Pu, Q., Wang, M., & Shen, H. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07449-x
Credit Assignment in Reinforcement Learning with Group Relative Policy Optimization
Leal, A. A. F., & Ramos, G. D. O. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39882-6_15
From Greedy Steps to Global Optimization: Learning Sequential Test Suite Generation
Wang, G., Yang, C., Zhou, X., Sun, Z., Wang, B., Lo, D., & Hao, D. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832162 · Cited by 4
Liu, Y., 侯熙智, Yang, L., Liu, H., Zhu, C., Zhang, F., & Zuo, C. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832096
SWE-PDB: Teaching LLMs to Leverage Debugging Tools via Agentic Training
Liu, J., Hu, X., & Xia, X. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832117
Multi-Level Knowledge Graph for Formal Mathematics
Ataeva, O. M., Khalov, A. P., & Tuchkova, N. P. (2026) · Lobachevskii Journal of Mathematics · doi:10.1134/s1995080226618990
Training datasets tailored for domain-specific large language models: challenges, methods and trends
Qiu, X., Ren, K., Cui, X., Liu, W., Gao, Z., Hu, J., & Liang, Q. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01150-2
ActionNex: A Production-Grade System for Next-Best-Action Recommendation in Cloud Outage Management
Lin, Z., Hu, H., Hao, M., Zhang, X., 何宇迪, Kulygin, O., Tuna, H., Bansal, C., Li, Z., Chintalapati, M., et al. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834472
Chen, X., Zhang, H., Feng, Z., Xiao, G., Yang, Z., & Biancardo, S. A. (2026) · Maritime Policy & Management · doi:10.1080/03088839.2026.2745847
Self-citationBeyond LLMs: Small Multimodal Models for Semantic Accessibility Validation of Alternative Texts
Leonardi, N., Manca, M., & Paternò, F. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3829029
References for Learning CLI Agents with Structured Action Credit under Selective Observation
Su, H., & Wen, Y. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.22641288
Guo, M., Likun, L., Hu, Z., Ge, M., Zhang, Y., Guo, Y., Wang, H., & Yu, X. (2026) · Cybersecurity · doi:10.1186/s42400-026-00685-1
MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents
Zhou, Z., Qu, A., Wu, Z., Kim, S., Prakash, A., Rus, D., Zhao, J., Low, B. K. H., & Liang, P. P. (2025) · arXiv · doi:10.48550/arxiv.2506.15841 · Cited by 218
TTRL: Test-Time Reinforcement Learning
Zuo, Y., Zhang, K., Sheng, L., Qu, S., Cui, G., Zhu, X., Li, H., Zhang, Y., Long, X., Hua, E., et al. (2025) · arXiv · Cited by 7
“2-3B-Oat-Zero [26]; • Mistral Family: Mistral-Nemo-Instruct-2407 [29], Ministral-8B-Instruct-2410 [28]; • DeepSeek Family: DeepSeek-Math-7B-Instruct [38], DeepSeek-R1-LLaMA-8B [11]; • Others: Skywork-OR1-Math-7B [13]; Benchmarks We evaluate TTRL on GPQA-Diamond [35], a challenging and high-quality…”
InfluentialA Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Self-citationReason-KE++: Aligning the Process, Not Just the Outcome, for Faithful LLM Knowledge Editing
Wu, Y., Ding, L., Shen, L., & Tao, D. (2025) · arXiv · doi:10.48550/arxiv.2511.12661
Self-citationGrattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.21783 · Cited by 505
Self-citation
Metadata
- Authors
- Shao, Z., Wang, P., Zhu, Q., Xu, R., Song, J., Bi, X., Zhang, H., Zhang, M., Li, Y. K., Wu, Y., & Guo, D.
- Affiliations
- DeepSeek (China) (CN)
- Peking University (CN)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2402.03300
- OpenAlex
- W4391631327
- Cited by
- 101
- References
- 0
- Citations by year
- 2026: 49 · 2025: 47 · 2024: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- synthetic environments, playworlds, preference optimization, entropy collapse, out-of-distribution evaluation, few-shot prompting, LLM agents
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
