The DOI matches its DataCite record.
Qwen2.5 Technical Report
Open accessAbstract
In this report, we introduce Qwen2.5, a comprehensive series of large language models (LLMs) designed to meet diverse needs. Compared to previous iterations, Qwen 2.5 has been significantly improved during both the pre-training and post-training stages. In terms of pre-training, we have scaled the high-quality pre-training datasets from the previous 7 trillion tokens to 18 trillion tokens. This provides a strong foundation for common sense, expert knowledge, and reasoning capabilities. In terms of post-training, we implement intricate supervised finetuning with over 1 million samples, as well as multistage reinforcement learning. Post-training techniques enhance human preference, and notably improve long text generation, structural data analysis, and instruction following. To handle diverse and varied use cases effectively, we present Qwen2.5 LLM series in rich sizes. Open-weight offerings include base and instruction-tuned models, with quantized versions available. In addition, for hosted solutions, the proprietary models currently include two mixture-of-experts (MoE) variants: Qwen2.5-Turbo and Qwen2.5-Plus, both available from Alibaba Cloud Model Studio. Qwen2.5 has demonstrated top-tier performance on a wide range of benchmarks evaluating language understanding, reasoning, mathematics, coding, human preference alignment, etc. Specifically, the open-weight flagship Qwen2.5-72B-Instruct outperforms a number of open and proprietary models and demonstrates competitive performance to the state-of-the-art open-weight model, Llama-3-405B-Instruct, which is around 5 times larger. Qwen2.5-Turbo and Qwen2.5-Plus offer superior cost-effectiveness while performing competitively against GPT-4o-mini and GPT-4o respectively. Additionally, as the foundation, Qwen2.5 models have been instrumental in training specialized models such as Qwen2.5-Math, Qwen2.5-Coder, QwQ, and multimodal models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In practice, expanding dataset size has often proven highly effective-even relatively small models show substantial improvements when trained on large, high-quality corpora [26].”
From A Survey of Large Language Models (2026) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The combination of pre-training (optionally enhanced by mid-training) and post-training has established the prevailing methodology for developing capable and aligned LLMs [26,27].”
From A Survey of Large Language Models (2026) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, Qwen2.5-1M [26] follows a four-stage schedule (i.e., 32K → 65K → 131K → 262K) while maintaining a mix of 40 % fulllength and 60 % short sequences in each batch to prevent catastrophic forgetting.”
From A Survey of Large Language Models (2026) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To develop capable instruction-tuned models, five key instruction data types are typically covered: (1) mathematical reasoning (20 % -30 % ), (2) coding (20 % -30 % ), (3) agentic tasks (10 % -20 % ), (4) general tasks like chitchat, QA, and instruction following (20 % -40 % ), and (5) AI identity and safety (a minor proportion).”
From A Survey of Large Language Models (2026) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similarly DeepSeek [35] and Qwen [146] series of LLMs have shown remarkable performance improvements using RLHF for a variety of capabilities, including long-text generation, structured data analysis.”
From RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs (2026) · cites this paper as [146]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Many models even have designated sections in their technical reports on how they improve IF performance - the most common approach is targeted synthetic data generation [32, 15, 1, 7].”
From Generalizing Verifiable Instruction Following (2025) · cites this paper as [32]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Specialized text data enhances LLM capabilities by incorporating domain-specific or task-related sources, particularly those involving scientific reasoning and code [26,29].”
From A Survey of Large Language Models (2026) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Recent trends show an increasing incorporation of reasoning-focused data in pre-training [26,39,40] (e.g., LLaMA-3.1).”
From A Survey of Large Language Models (2026) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“which on math tasks generally matches or outperforms the larger Qwen2.572B-Instruct (Qwen et al., 2024) or other open models (Dubey et al., 2024; Groeneveld et al., 2024; Muennighoff et al., 2024).”
From s1: Simple test-time scaling (2025) · cites this paper as Qwen et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“We adopt the default maximum context length for all LLMs (128K for GPT-4o-mini [52] and Qwen models [56]; 32K for DS-Coder [17]), which is sufficient to accommodate all the prompts synthesized in our study since the maximum token number is approximately 11K for LeetCode and 27K for DevEval under 𝑘 = 5 configuration.”
From What Makes In-Context Examples Effective for Code Generation? (2026) · cites this paper as [56]
The cited source says what the claim attributes to it.
In the citing paper
“We also show that our recipe can be successfully applied to 3 different model families: OLMo [18], Qwen 2.5 [26], and Llama 3.1 [27].”
From Generalizing Verifiable Instruction Following (2025) · cites this paper as [26]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Storing these parameters requires substantial memory, leading to increased deployment costs, particularly in production environments [26,40].”
From A Survey of Large Language Models (2026) · cites this paper as [26]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 85
- Xingzhang Ren, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yu Wan, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, Zihan Qiu References Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat S. Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Amit Garg, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Eric Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olatunji Ruwase, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Masahiro Tanaka, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yue Zhang, Yunan Zhang, and Xiren Zhou. Phi-3 technical report: A highly capable language model locally on your phone. CoRR, abs/2404.14219, 2024. · arXiv
- Bo Adler, Niket Agarwal, Ashwath Aithal, Dong H. Anh, Pallab Bhattacharya, Annika Brundyn, Jared Casper, Bryan Catanzaro, Sharon Clay, Jonathan Cohen, Sirshak Das, Ayush Dattagupta, Olivier Delalleau, Leon Derczynski, Yi Dong, Daniel Egert, Ellie Evans, Aleksander Ficek, Denys Fridman, Shaona Ghosh, Boris Ginsburg, Igor Gitman, Tomasz Grzegorzek, Robert Hero, Jining Huang, Vibhu Jawa, Joseph Jennings, Aastha Jhunjhunwala, John Kamalu, Sadaf Khan, Oleksii Kuchaiev, Patrick LeGresley, Hui Li, Jiwei Liu, Zihan Liu, Eileen Peters Long, Ameya Mahabaleshwarkar, Somshubra Majumdar, James Maki, Miguel Martinez, Maer Rodrigues de Melo, Ivan Moshkov, Deepak Narayanan, Sean Narenthiran, Jesus Navarro, Phong Nguyen, Osvald Nitski, Vahid Noroozi, Guruprasad Nutheti, Christopher Parisien, Jupinder Parmar, Mostofa Patwary, Krzysztof Pawelec, Wei Ping, Shrimai Prabhumoye, Rajarshi Roy, Trisha Saar, Vasanth Rao Naik Sabavat, Sanjeev Satheesh, Jane Polak Scowcroft, Jason D. Sewall, Pavel Shamis, Gerald Shen, Mohammad Shoeybi, Dave Sizer, Misha Smelyanskiy, Felipe Soares, Makesh Narsimhan Sreedhar, Dan Su, Sandeep Subramanian, Shengyang Sun, Shubham Toshniwal, Hao Wang, Zhilin Wang, Jiaxuan You, Jiaqi Zeng, Jimmy Zhang, Jing Zhang, Vivienne Zhang, Yian Zhang, and Chen Zhu. Nemotron-4 340B technical report. CoRR, abs/2406.11704, 2024. · arXiv
- Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebr ón, and Sumit Sanghai. GQA: Training generalized multi-query Transformer models from multi-head checkpoints. In EMNLP, pp. 4895-4901. Association for Computational Linguistics, 2023.
- Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Mérouane Debbah, Étienne Goffinet, Daniel Hesslow, Julien Launay, Quentin Malartic, Daniele Maz- zotta, Badreddine Noune, Baptiste Pannier, and Guilherme Penedo. The Falcon series of open language models. CoRR, abs/2311.16867, 2023. · arXiv
- Chenxin An, Fei Huang, Jun Zhang, Shansan Gong, Xipeng Qiu, Chang Zhou, and Lingpeng Kong. Training-free long-context scaling of large language models. CoRR, abs/2402.17463, 2024. · arXiv
- Jacob Austin, Augustus Odena, Maxwell I. Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie J. Cai, Michael Terry, Quoc V. Le, and Charles Sutton. Program synthesis with large language models. CoRR, abs/2108.07732, 2021. · arXiv
- Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xuancheng Ren, Chuanqi Tan, Sinan Tan, Jianhong Tu, Peng Wang, Shijie Wang, Wei Wang, Shengguang Wu, Benfeng Xu, Jin Xu, An Yang, Hao Yang, Jian Yang, Shusheng Yang, Yang Yao, Bowen Yu, Hongyi Yuan, Zheng Yuan, Jianwei Zhang, Xingxuan Zhang, Yichang Zhang, Zhenru Zhang, Chang Zhou, Jingren Zhou, Xiaohuan Zhou, and Tianhang Zhu. Qwen technical report. CoRR, abs/2309.16609, 2023. · arXiv
- Yushi Bai, Xin Lv, Jiajie Zhang, Yuze He, Ji Qi, Lei Hou, Jie Tang, Yuxiao Dong, and Juanzi Li. LongAlign: A recipe for long context alignment of large language models. In EMNLP (Findings), pp. 1376-1395. Association for Computational Linguistics, 2024.
- Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Donald Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, and Madian Khabsa. The Belebele benchmark: A parallel reading comprehension dataset in 122 language variants. CoRR, abs/2308.16884, 2023. · arXiv
- Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. Language models are few-shot learners. In NeurIPS, 2020.
- Boxi Cao, Keming Lu, Xinyu Lu, Jiawei Chen, Mengjie Ren, Hao Xiang, Peilin Liu, Yaojie Lu, Ben He, Xianpei Han, Le Sun, Hongyu Lin, and Bowen Yu. Towards scalable automated alignment of LLMs: A survey. CoRR, abs/2406.01252, 2024. · arXiv
- Federico Cassano, John Gouwar, Daniel Nguyen, Sydney Nguyen, Luna Phipps-Costin, Donald Pinckney, Ming-Ho Yee, Yangtian Zi, Carolyn Jane Anderson, Molly Q. Feldman, Arjun Guha, Michael Greenberg, and Abhinav Jangda. MultiPL-E: A scalable and polyglot approach to benchmarking neural code generation. IEEE Trans. Software Eng., 49(7):3675-3691, 2023.
- Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Pondé de Oliveira Pinto, Jared Kaplan, Harrison Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Joshua Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba. Evaluating large language models trained on code. CoRR, abs/2107.03374, 2021. · arXiv
- Wenhu Chen, Ming Yin, Max Ku, Pan Lu, Yixin Wan, Xueguang Ma, Jianyu Xu, Xinyi Wang, and Tony Xia. TheoremQA: A theorem-driven question answering dataset. In EMNLP, pp. 7889-7901. Association for Computational Linguistics, 2023a.
- Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. Think you have solved question answering? Try ARC, the AI2 reasoning challenge. CoRR, abs/1803.05457, 2018. · arXiv
- Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. Training verifiers to solve math word problems. CoRR, abs/2110.14168, 2021. · arXiv
- Damai Dai, Chengqi Deng, Chenggang Zhao, R. X. Xu, Huazuo Gao, Deli Chen, Jiashi Li, Wangding Zeng, Xingkai Yu, Y. Wu, Zhenda Xie, Y. K. Li, Panpan Huang, Fuli Luo, Chong Ruan, Zhifang Sui, and Wenfeng Liang. DeepSeekMoE: Towards ultimate expert specialization in mixture-of-experts language models. CoRR, abs/2401.06066, 2024. · arXiv
- Yann N. Dauphin, Angela Fan, Michael Auli, and David Grangier. Language modeling with gated convolutional networks. In ICML, volume 70 of Proceedings of Machine Learning Research, pp. 933-941.
- PMLR, 2017.
- Guanting Dong, Keming Lu, Chengpeng Li, Tingyu Xia, Bowen Yu, Chang Zhou, and Jingren Zhou. Self-play with execution feedback: Improving instruction-following capabilities of large language models. CoRR, abs/2406.13542, 2024. · arXiv
- Shihan Dou, Jiazheng Zhang, Jianxiang Zang, Yunbo Tao, Haoxiang Jia, Shichun Liu, Yuming Yang, Shenxi Wu, Shaoqing Zhang, Muling Wu, et al. Multi-programming language sandbox for llms. CoRR, abs/2410.23074, 2024. · arXiv
- Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Zhang, Aurélien Rodriguez, Austen Gregerson, Ava Spataru, Baptiste Rozière, Bethany Biron, Binh Tang, Bobbie Chern, Charlotte Caucheteux, Chaya Nayak, Chloe Bi, Chris Marra, Chris McConnell, Christian Keller, Christophe Touret, Chunyang Wu, Corinne Wong, Cristian Canton Ferrer, Cyrus Nikolaidis, Damien Allonsius, Daniel Song, Danielle Pintz, Danny Livshits, David Esiobu, Dhruv Choudhary, Dhruv Mahajan, Diego Garcia-Olano, Diego Perino, Dieuwke Hupkes, Egor Lakomkin, Ehab AlBadawy, Elina Lobanova, Emily Dinan, Eric Michael Smith, Filip Radenovic, Frank Zhang, Gabriel Synnaeve, Gabrielle Lee, Georgia Lewis Anderson, Graeme Nail, Grégoire Mialon, Guan Pang, Guillem Cucurell, Hailey Nguyen, Hannah Korevaar, Hu Xu, Hugo Touvron, Iliyan Zarov, Imanol Arrieta Ibarra, Isabel M. Kloumann, Ishan Misra, Ivan Evtimov, Jade Copet, Jaewon Lee, Jan Geffert, Jana Vranes, Jason Park, Jay Mahadeokar, Jeet Shah, Jelmer van der Linde, Jennifer Billock, Jenny Hong, Jenya Lee, Jeremy Fu, Jianfeng Chi, Jianyu Huang, Jiawen Liu, Jie Wang, Jiecao Yu, Joanna Bitton, Joe Spisak, Jongsoo Park, Joseph Rocca, Joshua Johnstun, Joshua Saxe, Junteng Jia, Kalyan Vasuden Alwala, Kartikeya Upasani, Kate Plawiak, Ke Li, Kenneth Heafield, Kevin Stone, and et al. The Llama 3 herd of models. CoRR, abs/2407.21783, 2024. · arXiv
- Alena Fenogenova, Artem Chervyakov, Nikita Martynov, Anastasia Kozlova, Maria Tikhonova, Albina Akhmetgareeva, Anton A. Emelyanov, Denis Shevelev, Pavel Lebedev, Leonid Sinev, Ulyana Isaeva, Ka- terina Kolomeytseva, Daniil Moskovskiy, Elizaveta Goncharova, Nikita Savushkin, Polina Mikhailova, Denis Dimitrov, Alexander Panchenko, and Sergey Markov. MERA: A comprehensive LLM evaluation in russian. CoRR, abs/2401.04531, 2024. · arXiv
- Evan Frick, Tianle Li, Connor Chen, Wei-Lin Chiang, Anastasios Nikolas Angelopoulos, Jiantao Jiao, Banghua Zhu, Joseph E. Gonzalez, and Ion Stoica. How to evaluate reward models for RLHF. CoRR, abs/2410.14872, 2024b. · arXiv
- Aryo Pradipta Gema, Joshua Ong Jun Leang, Giwon Hong, Alessio Devoto, Alberto Carlo Maria Mancino, Rohit Saxena, Xuanli He, Yu Zhao, Xiaotang Du, Mohammad Reza Ghasemi Madani, et al. Are we done with mmlu? CoRR, abs/2406.04127, 2024. · arXiv
- Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, et al. Gemma 2: Improving open language models at a practical size. CoRR, abs/2408.00118, 2024. · arXiv
- Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Krishnan, Marc'Aurelio Ranzato, Francisco Guzmán, and Angela Fan. The Flores-101 evaluation benchmark for low-resource and multilingual machine translation. Trans. Assoc. Comput. Linguistics, 10: 522-538, 2022.
- Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. Measuring massive multitask language understanding. In ICLR. OpenReview.net, 2021a.
- Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. Measuring mathematical problem solving with the MATH dataset. In NeurIPS Datasets and Benchmarks, 2021b.
- Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, et al. Training compute- optimal large language models. CoRR, abs/2203.15556, 2022. · arXiv
- Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, Shantanu Acharya, Dima Rekesh, Fei Jia, Yang Zhang, and Boris Ginsburg. RULER: What's the real context size of your long-context language models? CoRR, abs/2404.06654, 2024. · arXiv
- Shengding Hu, Yuge Tu, Xu Han, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, Xinrong Zhang, Zhen Leng Thai, Kai Zhang, Chongyi Wang, Yuan Yao, Chenyang Zhao, Jie Zhou, Jie Cai, Zhongwu Zhai, Ning Ding, Chao Jia, Guoyang Zeng, Dahai Li, Zhiyuan Liu, and Maosong Sun. MiniCPM: Unveiling the potential of small language models with scalable training strategies. CoRR, abs/2404.06395, 2024. · arXiv
- Binyuan Hui, Jian Yang, Zeyu Cui, Jiaxi Yang, Dayiheng Liu, Lei Zhang, Tianyu Liu, Jiajun Zhang, Bowen Yu, Keming Lu, et al. Qwen2.5-Coder technical report. CoRR, abs/2409.12186, 2024. · arXiv
- Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar- Lezama, Koushik Sen, and Ion Stoica. LiveCodeBench: Holistic and contamination free evaluation of large language models for code. CoRR, abs/2403.07974, 2024. · arXiv
- Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de Las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, and William El Sayed. Mistral 7B. CoRR, abs/2310.06825, 2023a. · arXiv
- Albert Q. Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de Las Casas, Emma Bou Hanna, Florian Bressand, Gianna Lengyel, Guillaume Bour, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Sandeep Subramanian, Sophia Yang, Szymon Antoniak, Teven Le Scao, Théophile Gervet, Thibaut Lavril, Thomas Wang, Timothée Lacroix, and William El Sayed. Mixtral of experts. CoRR, abs/2401.04088, 2024a. · arXiv
- Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, and Lili Qiu. Minference 1.0: Accelerating pre-filling for long-context llms via dynamic sparse attention. arXiv preprint arXiv:2407.02490, 2024b. · arXiv
- Zixuan Jiang, Jiaqi Gu, Hanqing Zhu, and David Z. Pan. Pre-RMSNorm and Pre-CRMSNorm Transform- ers: Equivalent and efficient pre-LN Transformers. CoRR, abs/2305.14858, 2023b. · arXiv
- Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. Scaling laws for neural language models. CoRR, abs/2001.08361, 2020. · arXiv
- Fajri Koto, Nurul Aisyah, Haonan Li, and Timothy Baldwin. Large language models only pass primary school exams in Indonesia: A comprehensive test on IndoMMLU. In EMNLP, pp. 12359-12374. Association for Computational Linguistics, 2023.
- Nathan Lambert, Valentina Pyatkin, Jacob Daniel Morrison, Lester James Validad Miranda, Bill Yuchen Lin, Khyathi Raghavi Chandu, Nouha Dziri, Sachin Kumar, Tom Zick, Yejin Choi, Noah A. Smith, and Hanna Hajishirzi. RewardBench: Evaluating reward models for language modeling. CoRR, abs/2403.13787, 2024. · arXiv
- Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen. GShard: Scaling giant models with conditional computation and automatic sharding. CoRR, abs/2006.16668, 2020. · arXiv
- Tianle Li, Wei-Lin Chiang, Evan Frick, Lisa Dunlap, Tianhao Wu, Banghua Zhu, Joseph E. Gonzalez, and Ion Stoica. From crowdsourced data to high-quality benchmarks: Arena-Hard and BenchBuilder pipeline. CoRR, abs/2406.11939, 2024. · arXiv
- Stephanie Lin, Jacob Hilton, and Owain Evans. TruthfulQA: Measuring how models mimic human falsehoods. In ACL (1), pp. 3214-3252. Association for Computational Linguistics, 2022a.
- Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, and Xian Li. Few-shot learning with multilingual generative language models. In EMNLP, pp. 9019-9052. Association for Computational Linguistics, 2022b.
- Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, and Lingming Zhang. Is your code generated by ChatGPT really correct? Rigorous evaluation of large language models for code generation. In NeurIPS, 2023.
- Keming Lu, Bowen Yu, Fei Huang, Yang Fan, Runji Lin, and Chang Zhou. Online merging optimizers for boosting rewards and mitigating tax in alignment. CoRR, abs/2405.17931, 2024a. · arXiv
- Keming Lu, Bowen Yu, Chang Zhou, and Jingren Zhou. Large language models are superpositions of all characters: Attaining arbitrary role-play via self-alignment. CoRR, abs/2401.12474, 2024b. · arXiv
- Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M. Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, and Colin Raffel. Crosslingual generalization through multitask finetuning. In ACL (1), pp. 15991-16111. Association for Computational Linguistics, 2023.
- Junho Myung, Nayeon Lee, Yi Zhou, Jiho Jin, Rifki Afina Putri, Dimosthenis Antypas, Hsuvas Borkakoty, Eunsu Kim, Carla Pérez-Almendros, Abinew Ali Ayele, Víctor Gutiérrez-Basulto, Yazmín Ibá ñez- García, Hwaran Lee, Shamsuddeen Hassan Muhammad, Ki-Woong Park, Anar Sabuhi Rzayev, Nina White, Seid Muhie Yimam, Mohammad Taher Pilehvar, Nedjma Ousidhoum, José Camacho-Collados, and Alice Oh. Blend: A benchmark for llms on everyday knowledge in diverse cultures and languages. CoRR, abs/2406.09948, 2024. · arXiv
- OpenAI. GPT4 technical report. CoRR, abs/2303.08774, 2023. · arXiv
- Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F. Christiano, Jan Leike, and Ryan Lowe. Training language models to follow instructions with human feedback. In NeurIPS, 2022.
- Bowen Peng, Jeffrey Quesnelle, Honglu Fan, and Enrico Shippole. YaRN: Efficient context window extension of large language models. CoRR, abs/2309.00071, 2023. · arXiv
- Edoardo Maria Ponti, Goran Glavas, Olga Majewska, Qianchu Liu, Ivan Vulic, and Anna Korhonen. XCOPA: A multilingual dataset for causal commonsense reasoning. In EMNLP (1), pp. 2362-2376. Association for Computational Linguistics, 2020.
- Shanghaoran Quan, Tianyi Tang, Bowen Yu, An Yang, Dayiheng Liu, Bofei Gao, Jianhong Tu, Yichang Zhang, Jingren Zhou, and Junyang Lin. Language models can self-lengthen to generate long texts. CoRR, abs/2410.23933, 2024. · arXiv
- Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn. Direct preference optimization: Your language model is secretly a reward model. In NeurIPS, 2023.
- Samyam Rajbhandari, Conglong Li, Zhewei Yao, Minjia Zhang, Reza Yazdani Aminabadi, Ammar Ahmad Awan, Jeff Rasley, and Yuxiong He. DeepSpeed-MoE: Advancing mixture-of-experts inference and training to power next-generation AI scale. In ICML, volume 162 of Proceedings of Machine Learning Research, pp. 18332-18346. PMLR, 2022.
- David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman. GPQA: A graduate-level Google-proof Q&A benchmark. CoRR, abs/2311.12022, 2023. · arXiv
- Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. WinoGrande: An adversarial winograd schema challenge at scale. Commun. ACM, 64(9):99-106, 2021.
- Rico Sennrich, Barry Haddow, and Alexandra Birch. Neural machine translation of rare words with subword units. In ACL (1). The Association for Computer Linguistics, 2016.
- Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Mingchuan Zhang, Y. K. Li, Y. Wu, and Daya Guo. Deepseekmath: Pushing the limits of mathematical reasoning in open language models. CoRR, abs/2402.03300, 2024. · arXiv
- Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny Zhou, and Jason Wei. Challenging BIG-Bench tasks and whether chain-of-thought can solve them. In ACL (Findings), pp. 13003-13051. Association for Computational Linguistics, 2023.
- Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurélien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. LLaMA: Open and efficient foundation language models. CoRR, abs/2302.13971, 2023a. · arXiv
- Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton- Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurélien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. Llama 2: Open foundation and fine-tuned chat models. CoRR, abs/2307.09288, 2023b. · arXiv
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. In NIPS, pp. 5998-6008, 2017.
- Binghai Wang, Rui Zheng, Lu Chen, Yan Liu, Shihan Dou, Caishuang Huang, Wei Shen, Senjie Jin, Enyu Zhou, Chenyu Shi, et al. Secrets of RLHF in large language models part II: Reward modeling. CoRR, abs/2401.06080, 2024a. · arXiv
- Changhan Wang, Kyunghyun Cho, and Jiatao Gu. Neural machine translation with byte-level subwords. In AAAI, pp. 9154-9160. AAAI Press, 2020.
- Yubo Wang, Xueguang Ma, Ge Zhang, Yuansheng Ni, Abhranil Chandra, Shiguang Guo, Weiming Ren, Aaran Arulraj, Xuan He, Ziyan Jiang, Tianle Li, Max Ku, Kai Wang, Alex Zhuang, Rongqi Fan, Xiang Yue, and Wenhu Chen. MMLU-Pro: A more robust and challenging multi-task language understanding benchmark. CoRR, abs/2406.01574, 2024b. · arXiv
- Zhilin Wang, Alexander Bukharin, Olivier Delalleau, Daniel Egert, Gerald Shen, Jiaqi Zeng, Oleksii Kuchaiev, and Yi Dong. HelpSteer2-Preference: Complementing ratings with preferences. CoRR, abs/2410.01257, 2024c. · arXiv
- Colin White, Samuel Dooley, Manley Roberts, Arka Pal, Benjamin Feuer, Siddhartha Jain, Ravid Shwartz- Ziv, Neel Jain, Khalid Saifullah, Siddartha Naidu, Chinmay Hegde, Yann LeCun, Tom Goldstein, Willie Neiswanger, and Micah Goldblum. LiveBench: A challenging, contamination-free LLM benchmark. CoRR, abs/2406.19314, 2024. · arXiv
- Hao Xiang, Bowen Yu, Hongyu Lin, Keming Lu, Yaojie Lu, Xianpei Han, Le Sun, Jingren Zhou, and Junyang Lin. Aligning large language models via self-steering optimization. CoRR, abs/2410.17131, 2024. · arXiv
- Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, and Hao Ma. Effective long-context scaling of foundation models. CoRR, abs/2309.16039, 2023. · arXiv
- An Yang, Baosong Yang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Zhou, Chengpeng Li, Chengyuan Li, Dayiheng Liu, Fei Huang, Guanting Dong, Haoran Wei, Huan Lin, Jialong Tang, Jialin Wang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Ma, Jianxin Yang, Jin Xu, Jingren Zhou, Jinze Bai, Jinzheng He, Junyang Lin, Kai Dang, Keming Lu, Keqin Chen, Kexin Yang, Mei Li, Mingfeng Xue, Na Ni, Pei Zhang, Peng Wang, Ru Peng, Rui Men, Ruize Gao, Runji Lin, Shijie Wang, Shuai Bai, Sinan Tan, Tianhang Zhu, Tianhao Li, Tianyu Liu, Wenbin Ge, Xiaodong Deng, Xiaohuan Zhou, Xingzhang Ren, Xinyu Zhang, Xipin Wei, Xuancheng Ren, Xuejing Liu, Yang Fan, Yang Yao, Yichang Zhang, Yu Wan, Yunfei Chu, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, Zhifang Guo, and Zhihao Fan. Qwen2 technical report. CoRR, abs/2407.10671, 2024a. · arXiv
- An Yang, Beichen Zhang, Binyuan Hui, Bofei Gao, Bowen Yu, Chengpeng Li, Dayiheng Liu, Jianhong Tu, Jingren Zhou, Junyang Lin, et al. Qwen2.5-Math technical report: Toward mathematical expert model via self-improvement. CoRR, abs/2409.12122, 2024b. · arXiv
- Jian Yang, Jiaxi Yang, Ke Jin, Yibo Miao, Lei Zhang, Liqun Yang, Zeyu Cui, Yichang Zhang, Binyuan Hui, and Junyang Lin. Evaluating and aligning codellms on human preference. CoRR, abs/2412.05210, 2024c. · arXiv
- Yinfei Yang, Yuan Zhang, Chris Tar, and Jason Baldridge. PAWS-X: A cross-lingual adversarial dataset for paraphrase identification. In EMNLP/IJCNLP (1), pp. 3685-3690. Association for Computational Linguistics, 2019.
- Alex Young, Bei Chen, Chao Li, Chengen Huang, Ge Zhang, Guanwei Zhang, Heng Li, Jiangcheng Zhu, Jianqun Chen, Jing Chang, Kaidong Yu, Peng Liu, Qiang Liu, Shawn Yue, Senbin Yang, Shiming Yang, Tao Yu, Wen Xie, Wenhao Huang, Xiaohui Hu, Xiaoyi Ren, Xinyao Niu, Pengcheng Nie, Yuchi Xu, Yudong Liu, Yue Wang, Yuxuan Cai, Zhenyu Gu, Zhiyuan Liu, and Zonghong Dai. Yi: Open foundation models by 01.AI. CoRR, abs/2403.04652, 2024. · arXiv
- Tao Yuan, Xuefei Ning, Dong Zhou, Zhijie Yang, Shiyao Li, Minghui Zhuang, Zheyue Tan, Zhuyu Yao, Dahua Lin, Boxun Li, Guohao Dai, Shengen Yan, and Yu Wang. LV-Eval: A balanced long-context benchmark with 5 length levels up to 256K. CoRR, abs/2402.05136, 2024. · arXiv
- Zheng Yuan, Hongyi Yuan, Chengpeng Li, Guanting Dong, Chuanqi Tan, and Chang Zhou. Scaling relationship on learning mathematical reasoning with large language models. CoRR, abs/2308.01825, 2023. · arXiv
- Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. HellaSwag: Can a machine really finish your sentence? In ACL (1), pp. 4791-4800. Association for Computational Linguistics, 2019.
- Yidan Zhang, Boyi Deng, Yu Wan, Baosong Yang, Haoran Wei, Fei Huang, Bowen Yu, Junyang Lin, and Jingren Zhou. P-MMEval: A parallel multilingual multitask benchmark for consistent evaluation of LLMs. CoRR, abs/2411.09116, 2024. · arXiv
- Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. Judging LLM-as-a-judge with MT-Bench and Chatbot Arena. In NeurIPS, 2023.
- Enyu Zhou, Guodong Zheng, Bing Wang, Zhiheng Xi, Shihan Dou, Rong Bao, Wei Shen, Limao Xiong, Jessica Fan, Yurong Mou, Rui Zheng, Tao Gui, Qi Zhang, and Xuanjing Huang. RMB: Comprehensively benchmarking reward models in LLM alignment. CoRR, abs/2410.09893, 2024. · arXiv
- Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou. Instruction-following evaluation for large language models. CoRR, abs/2311.07911, 2023. · arXiv
- Barret Zoph, Irwan Bello, Sameer Kumar, Nan Du, Yanping Huang, Jeff Dean, Noam Shazeer, and William Fedus. ST-MoE: Designing stable and transferable sparse expert models. CoRR, abs/2202.08906, 2022. · arXiv
Cited by
Sorted by citations
Items 101–200 of 220
Re2: A Consistency-ensured Dataset for Full-stage Peer Review and Multi-turn Rebuttal Discussions
Zhang, D., Bao, Z., Du, S., Zhao, Z., Zhang, K., Bao, D., & Yang, Y. (2025) · arXiv · doi:10.48550/arxiv.2505.07920 · Cited by 26
“5-7B-Instruct [Yang et al., 2024].”
Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models
Liu, R., Sun, Y., Zhang, M., Bai, H., Yu, X., Yu, T., Yuan, C., & Hou, L. (2025) · arXiv · doi:10.48550/arxiv.2504.04823
Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents
Patel, V. (2026) · arXiv
Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation
Caruzzo, C., Yoo, D., & Kim, T. S. (2026) · arXiv · doi:10.48550/arxiv.2607.09349
MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents
Zhou, Z., Qu, A., Wu, Z., Kim, S., Prakash, A., Rus, D., Zhao, J., Low, B. K. H., & Liang, P. P. (2025) · arXiv · doi:10.48550/arxiv.2506.15841 · Cited by 218
“5-14B-Instruct [58].”
Designing reproducible large-language-model-assisted scientific analyses
Dunn, C. W., Schultz, D. T., & Musser, J. M. (2026) · Patterns · doi:10.1016/j.patter.2026.101644
The Limits of Query Monitoring against Distributed Model Extraction
Khilar, S. C. (2026) · arXiv
What Makes In-Context Examples Effective for Code Generation?
Li, D., Chen, S., Cao, J., & Cheung, S.-C. (2026) · Proceedings of the ACM on Software Engineering · doi:10.1145/3832275
BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinese
Zhou, P., Leon, B., Ying, X., Zhang, C., Shao, Y., Ye, Q., Chong, D., Jin, Z., Xie, C., Cao, M., et al. (2025) · arXiv · doi:10.48550/arxiv.2504.19314
Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations
Jiang, D., Li, Y., Wei, S., Yang, J., Kishore, A., Zhao, A., Kang, D., Hu, X., Chen, F., Li, Q., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.19320
Self-citationOmniRouter: Budget and Performance Controllable Multi-LLM Routing
Mei, K., Xu, W., Guo, M., Lin, S., & Zhang, Y. (2025) · arXiv · doi:10.48550/arxiv.2502.20576 · Cited by 2
Self-citationUltraEdit: Training-, Subject-, and Memory-Free Lifelong Editing in Language Models
Gu, X., Huang, Z., Gu, J.-C., & Zhang, K. (2025) · arXiv · doi:10.48550/arxiv.2505.14679 · Cited by 10
On the Difficulty of Selecting Few-Shot Examples for Effective LLM-based Vulnerability Detection
Hannan, M. A., Ni, R., Zhang, C., Jia, L., Mangal, R., & Pasareanu, C. S. (2026) · Proceedings 2026 Workshop on LLM Assisted Security and Trust Exploration · doi:10.14722/last-x.2026.23025
An, J., Yang, L., Wang, M., Lu, L., An, W., & Yang, E. (2026) · arXiv · doi:10.48550/arxiv.2603.26323
At Equal Inference Cost, Multi-Agent Structure Does Not Beat a Single Frozen Agent
Dylan, D., Brennan, A., Murphy, C., O'Sullivan, N., Kelly, C., & Walsh, S. (2026) · arXiv · doi:10.48550/arxiv.2609.04217 · Cited by 3
“5-7B model [92] serves every role of every arm, at greedy decoding (temperature 0 ) for deterministic, reproducible trajectories.”
Detecting Data Contamination from Reinforcement Learning Post-training for Large Language Models
Tao, Y., Wang, T., Dong, Y., Liu, H., Zhang, K., Hu, X., & Li, G. (2025) · arXiv · doi:10.48550/arxiv.2510.09259 · Cited by 1
MRMMIA: Membership Inference Attacks on Memory in Chat Agents
Chen, K., Pang, Y., & Wang, T. (2026) · arXiv · Cited by 4
LatentEvolve: Self-Evolving Test-Time Scaling in Latent Space
Zhang, G., Meng, F., Wan, G., Li, Z., Wang, K., Yin, Z., Bai, L., & Yan, S. (2025) · arXiv · doi:10.48550/arxiv.2509.24771
Post-Incorporating Code Structural Knowledge Into Pretrained Models via ICL for Code Translation
Du, Y., Sun, H., & Li, M. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3605768
Self-citationTsui, K. (2025) · arXiv · doi:10.48550/arxiv.2507.02778 · Cited by 29
CoCoReviewBench: A Completeness- and Correctness-Oriented Benchmark for AI Reviewers
Deng, H., Ke, X., Li, Y., Hu, R., Huang, D., Wong, D. F., Wang, Y., Liu, X., & Zhang, M. (2026) · arXiv · doi:10.48550/arxiv.2605.07905
Zhang, C., Wan, Z., Yu, X., Wu, J., Zhou, Y., Tsang, I., & An, B. (2026) · arXiv
HeLa-Mem: Hebbian Learning and Associative Memory for LLM Agents
Zhu, J., Li, J., Zhang, C., Liu, J., & Yang, M. (2026) · arXiv · doi:10.48550/arxiv.2604.16839
DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesis
Patel, L., Arabzadeh, N., Gupta, H., Sundar, A., Stoica, I., Zaharia, M., & Guestrin, C. (2025) · arXiv · doi:10.48550/arxiv.2508.20033
Sun, X., Wang, Q., Li, H., & Chen, L. (2026) · arXiv · doi:10.48550/arxiv.2608.03137
Multi-agent Architecture Search via Agentic Supernet
Zhang, G., Niu, L., Fang, J., Wang, K., Bai, L., & Wang, X. (2025) · arXiv · doi:10.48550/arxiv.2502.04180
“0.01 0.19 0.06 0.06 0.45 0.13 0.00 0.06 0.12 0.31 0.05 0.05 0.36 0.01 0.06 0.13 0.17 0.02 0.05 0.23 0.34”
InfluentialAutomated Discovery Has No Universally Superior Harness
Gupta, A., Lei, J., Lu, A., Anumanchipalli, G., & Choshen, L. (2026) · arXiv · doi:10.48550/arxiv.2607.18235
FlowReasoner: Reinforcing Query-Level Meta-Agents
Gao, H., Liu, Y., He, Y., Dou, L., Du, C., Deng, Z., Hooi, B., Lin, M., & Pang, T. (2025) · arXiv · doi:10.48550/arxiv.2504.15257
Self-citationScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization
Wang, Y., Yang, L., Li, G., Wang, M., & Aragam, B. (2025) · arXiv · doi:10.48550/arxiv.2502.04306
MAPLE: Multi-Aspect Panels of LLM Evaluators for Open-Ended Questions
Jinji, M., Atarashi, K., Takeuchi, K., & Kashima, H. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.1351
“5-7B-instruct (Yang et al., 2024), Llama-3.”
DIAGPaper: Diagnosing Valid and Specific Weaknesses in Scientific Papers via Multi-Agent Reasoning
Zou, Z., Ansari, A., Zhang, D. C., Lee, D., & Yin, W. (2026) · arXiv · doi:10.48550/arxiv.2601.07611
JudgeMoE: Distributional Aggregation for LLM-as-a-Judge
Liu, Y., James, J., Wang, Y., Zhao, K., Xiao, C., & Lin, C. (2026) · arXiv · doi:10.48550/arxiv.2610.07109
Self-citationMitigating Context Interference for Reliable and Efficient Search Agents
Xue, B., Wu, B., Qiao, S., Wang, S., Wang, R., Du, Y., Wang, H., Pan, J. Z., Yilmaz, E., Wong, K.-F., et al. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.160
SERA: Soft-Verified Efficient Repository Agents
Shen, E., Tormoen, D., Shah, S., Farhadi, A., & Dettmers, T. (2026) · arXiv · doi:10.48550/arxiv.2601.20789
“Tool Format Compatibility: SERA is trained on SWE-agent tool formats and performs best with exact format matching at inference time.”
InfluentialTabib, H. M. S., & Deedar, J. A. (2024) · International Journal on Natural Language Computing · doi:10.5121/ijnlc.2024.13604 · Cited by 1
Wang, S., Duan, X., & Cai, Z. G. (2025) · Workshop on Cognitive Modeling and Computational Linguistics (CMCL) · doi:10.18653/v1/2025.cmcl-1.28
أداء النماذج اللغوية الضخمة في الحوارات الفكرية: دراسة تطبيقية
البصري, ع. (2025) · مجلة العلوم الهندسية و تكنولوجيا المعلومات · doi:10.26389/ajsrp.n050525
AI-Driven Knowledge Transfer in Architectural Education
Hirsekorn, Y., Ansre, N., & Grunwald, G. (2025) · Smart Design Policies · doi:10.38027/smart.v2n1-8 · Cited by 1
Composable Effect Handling for Programming LLM-Integrated Scripts
Wang, D. (2025) · ACM SIGPLAN International Workshop on Language Models and Programming Languages (LMPL) · doi:10.1145/3759425.3763396
Large language models – the future of fundamental physics?
Heneka, C. S., Nieser, F., Ore, A., Plehn, T., & Schiller, D. (2026) · SciPost Physics · doi:10.21468/scipostphys.20.3.070 · Cited by 13
ReFactX: Scalable Reasoning with Reliable Facts via Constrained Generation
Pozzi, R., Palmonari, M., Coletta, A., Bellomarini, L., Lehmann, J., & Vahdati, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09527-5_16 · Cited by 1
Autonomous Reasoning-Retrieval for Large Language Model Based Recommendation
Zheng, B., Wang, X., Liu, E., Wang, X., Lu, H., Chen, Y., Zhao, W. X., & Wen, J.-R. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761384
Self-citationLi, Y., Peng, J., Yang, L., Li, Y., Shi, F., Xue, P., & Xu, C. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4088-4_7
A Unifying Scheme for Extractive Content Selection Tasks
Amar, S., Shapira, O., Slobodkin, A., & Dagan, I. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.53 · Cited by 1
Li, J., Tang, J., Zhao, P., Huang, F., Lyu, W., Wang, J., Li, D., Richards, D. R., Lu, Q., Zhang, J., et al. (2025) · Earth s Future · doi:10.1029/2025ef006592
Self-citationCosynllm: predicting drug combination synergy with LLM-generated descriptions
Mao, S., Tang, W. W., Li, L., Jing, M., Liu, Y., & Wang, J. (2026) · Journal of Cheminformatics · doi:10.1186/s13321-026-01158-w · Cited by 2
Self-citationTeng, D., Lu, C.-L., Qin, L., & Che, W. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02823-6
REPA: Re configurable P IM for the Joint A cceleration of KV Cache Offloading and Processing
Hong, Y., Yang, J., Peng, B., & Yao, J. (2026) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3779212.3790212
Self-citationOPENXRD: a comprehensive benchmark framework for LLM/MLLM XRD question answering
Vosoughi, A., Shahnazari, A., Xi, Y., Zhang, Z., Hess, G., Xu, C., & Abdolrahim, N. (2026) · Digital Discovery · doi:10.1039/d5dd00519a · Cited by 4
Self-citationInterpretable learning for detection of cognitive distortions from natural language texts
Kolonin, A., & Arinicheva, A. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3699
LAGA: A graph adapter for long-tail text classification via semantic space refinement
Wang, S., Zhou, G., Lan, M., Lu, J., Li, Z., & Xia, Y. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00656-z · Cited by 1
Describe-Then-Act: Proactive Agent Steering via Distilled Language-Action World Models
Pappa, M., Romani, L., Sacco, V., Palma, A., Lathuilière, S., Galasso, F., Alameda-Pineda, X., & Spinelli, I. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37350-2_26
AEG-Edit: Bridging API Evolution and Code Semantics for Accurate API Usage in Code Generation
Lin, Y., Tian, H., Zhao, D., Ni, C., Yang, X., & Ren, X. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834415
Self-citationNguyen, H.-K., Nguyen, C. H., Nguyen, V.-V., Luong, T. M.-H., Nguyen, K.-S., Do, D.-C., & Nguyen, T.-V. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-18159-6_36
LLM-Based Multimodal Planning for TAVR: Independent Validation, Calibration, and Efficiency Gains
Wang, X., Li, Y., Jin, M., Hu, H., Ye, Y., Yin, Y., & Dong, P. (2026) · Cardiovascular Innovations and Applications · doi:10.15212/cvia.2026.0006
Zhang, C., Shen, L., & Li, Y. (2026) · Complex & Intelligent Systems · doi:10.1007/s40747-026-02290-8
The Creation of Reasonable Robot Control Behavior in the Form of Executable Code
Скороходов, М. С., Latalin, V. E., Борисович, Р. Р., & Sboev, A. G. (2025) · Moscow University Physics Bulletin · doi:10.3103/s002713492570314x
A geographic entity recognition method utilizing temporal active learning and large language models
Tang, H., Rui, X., Lü, Y., Xie, Y., & Ouyang, N. (2026) · Geo-spatial Information Science · doi:10.1080/10095020.2026.2657656
Parameter-Efficient LLMs for Flow-Based Intrusion Detection
Muhammad, M., Wunsch, A., & Sardy, L. A. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-27993-4_4
Benchmarking Memory Architectures for Mobile Agents in Short-Term and Long-Term Applications
Zhang, L., Yang, H., & Ouyang, X. (2026) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3812836.3814752
Cho, J., Jang, C., Lee, C., & Kim, K. (2026) · The Journal of Korea Robotics Society · doi:10.7746/jkros.2026.21.2.182
Kim, S., & Yang, J. (2026) · International Conference on Advances in Information Technology · doi:10.1145/3816713.3819786
Self-citationMultimodal graph neural network with large language models for node and link prediction
Peng, B., Xu, H. G., & Che, X. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1758852
Xia, Y., Lv, J., He, Y., & Li, F. (2026) · Frontiers in Plant Science · doi:10.3389/fpls.2026.1811772
Measuring Creativity at Scale via Multimodal Large Language Models
Lewis, A., & Ochôa, X. (2026) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3774398.3811607
Zheng, Y., Chen, D., & Li, Y. (2026) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2026.2687097
Influence-Aware Bayesian-Inspired Token Reweighting for Improved Code Generation
Zhu, Y., Li, G., Mei, H., Jin, Z. G., Li, J., Zheng, Q., & Zhang, J. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808200
Self-citationLi, Z., 刘晓霞, Chen, T., Yang, Y., Liu, X., Lv, Y., Zhao, Z., Li, X., Yin, X., Feng, Z., et al. (2026) · Journal of Medical Systems · doi:10.1007/s10916-026-02433-x
How Robustly Do LLMs Understand Execution Semantics?
Spieß, C. K., Dévanbu, P., & Barr, E. T. (2026) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1145/3805760.3814919 · Cited by 1
Multilingual Game Dialogue Translation using Large Language Models: A Performance Survey
Nguyen, Q., Politowski, C., Rahman, L., & Lee, E.-S. A. (2026) · IEEE/ACM International Workshop on Games and Software Engineering (GAS) · doi:10.1145/3786171.3788386
Exp$$^{2}$$RL: Enhancing LLM Agent Training with Expert Experiences
Li, Y., Chen, Q., Zhang, Z., Deng, Y., Gong, Y., & ZHANG, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2856-0_45
Self-citationTimelineReasoner: Advancing Timeline Summarization with Large Reasoning Models
Zhang, L., Li, X., & Dou, Z. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809710
WebFAQ 2.0: A Multilingual QA Dataset with Mined Hard Negatives for Dense Retrieval
Dinzinger, M., Caspari, L., Salman, A., Topi, I., Mitrović, J., & Granitzer, M. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808621 · Cited by 1
CREK: Contextualized Reasoning-Graph and Epistemic Knowledge-Guided Medical Hallucination Detection
Ji, S., Pan, Y., He, L., & Fan, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3417-2_2
Self-citationA Language‐Guided Multimodal Foundation Model for Zero‐Shot and Multi‐Task Brain Signal Analysis
Chen, M., Gui, Y., Luo, G., & Yang, Y. (2026) · Advanced Intelligent Systems · doi:10.1002/aisy.70486
“The instruction is processed by the same model pipeline: it is first tokenized with the Qwen 2.5 [59] tokenizer into discrete indices and then passed through the model’s internal embedding layer to form instruction to-kens.”
InfluentialZhang, Y., Zhang, F., & Zhang, Z. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1875025
“Plus (Qwen et al., 2024) (Alibaba, China).”
Self-citationFrom Generation to Reasoning: Chain-of-Thought Guided Merge Conflict Resolution
Peng, C., Zhang, Z., Tyszberowicz, S. S., Liu, Z., & Liu, B. (2026) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3794763.3794821
“5 7B model [33].”
Self-citationD’Cruz, C., Precioso, F., Béréder, J.-M., & Riveill, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31673-8_7
Dynamic Personality Adaptation in Large Language Models via State Machines
Pielage, L., Hätscher, O., Back, M. D., Marschall, B., & Risse, B. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31673-8_34 · Cited by 3
PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects
Yang, S., Ruan, S., Wu, S., Liu, Y., Fan, L., Li, Z., & He, Y. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817561
Self-citationDuCCAE: A Hybrid Engine for Immersive Conversation via Collaboration, Augmentation, and Evolution
Shen, X., Jiang, Z., Yang, J., Liu, H., Wan, Y., Zhang, J., Dai, T., Xu, L., Wu, S., Qi, G., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818383
Self-citationImage-grounded text canonicalization for robust Chinese harmful meme detection
Wang, Y., Zhang, X., ismail, G. M., & Li, B. (2026) · Signal Image and Video Processing · doi:10.1007/s11760-026-05635-5
Mocanu, B., & Țapu, R. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21853-y
Eğin, F., Durak, A., & Onan, A. (2026) · Quality & Quantity · doi:10.1007/s11135-026-03053-w
Knowledge-enhanced large language model construction for garlic cultivation using GraphRAG
Zhou, K., Dong, M., Meng, X., Lv, J., Long, X., Hou, R., Li, Y., & Hou, J. (2026) · Frontiers in Plant Science · doi:10.3389/fpls.2026.1912355
Huang, K. A., Prakash, S. V., Samvelian, D. A., & Prakash, N. S. (2026) · Cureus · doi:10.7759/cureus.114918
VLM-guided retrieval augmented generation (RAG) for robot action prediction
Kuster, B., Marić, N., Aziz, F., Koloski, B., Gams, A., & Ude, A. (2026) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2026.1894674
Ji, J., Sun, Z., Ying, X., Hao, J., Fu, Z., Shi, D., Kong, X., Xu, Y., Zhang, X., Du, X., et al. (2026) · medRxiv · doi:10.64898/2026.08.28.26361585
Self-citationTowards Automatic ACT-Based Analysis of Chats
Bieberstein, A., Gampe, S., Schnitzer, B. L., & Korn, O. (2026) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3806774.3827978
Li, C., Shu, Z., Zhang, P., Ding, P., & Zhang, J. (2026) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-026-02966-5
Self-citationEfficiency Evaluation Framework for LLM-Generated Code
Avagian, D. A., & Ball, A. L. J. (2026) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661826700306
“As a proof of concept for our efficiency evaluation benchmark, we generated solutions using six language models: Phi-1 [11], Phi-2 [17], Code Llama [31], QwQ-32B [30, 36], Qwen3 [29], and DeepSeek-V3 [7].”
Qiu, J., Qin, Z., Ma, K., Hu, P., Zhang, Y., Xie, X., Zhao, W., & Wei, X. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.4079
Self-citationXSemanticFlow: Cross Object Semantic Alignment for Zero-Shot Manipulation
Nan, J., Okorn, B., Kitani, K., & Eshed, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37464-6_10
OmniExtract: an automatic data extraction tool based on large language model and prompt engineering
Wang, Y., Tang, B., Wu, S., Bei, S., Gao, X., Wu, Y., Liu, S., Hu, H., Meng, Y., Kong, D., et al. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag502
A Unified Framework for Function-Level Vulnerability Detection and Explanation in Smart Contracts
Nguyen, N. M., & Nguyen, L.-M. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3840386
Diabetes question answering method based on knowledge graph and large language model
Zhang, Y., Li, S., Lyu, T., Yu, X., Jiang, T., Li, X., He, G., & Zhou, W. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02078-2
“5 is an open-source series of large language models [28]; Qwen2.”
Self-citationDementia Language Models: a generalizable and controllable representation of cognitive impairmentPreprint
Peled-Cohen, L., Shmidov, A., Rein, N., Shapira, E., Calderon, N., Tikochinski, R., Zeltzer, E., Nathan, T., Uliel, B., Mueller, K. D., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.16.752129
“5-1.5B-Instruct 18 on 217 Cookie Theft picture descriptions produced by dementia patients from the Pitt DementiaBank corpus 15 .”
Liu, J., Nhu, D., Zhao, X., Jiang, Y., Yan, S., Xue, X., Shen, Y., de Oliveira, G. C., Fong, S., Xu, Q., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38260-3_50
Lenz, E., Seuffert, S., Wiegert, J., Mülfarth, R. R., Mrozek, A., Kircher, T., Schwarz, E., & Stein, F. (2026) · Research Square · doi:10.21203/rs.3.rs-10942665/v1
Ping, L. E. I., Xu, Y., Zhang, Y., & Ray, N. (2026) · medRxiv · doi:10.64898/2026.10.08.26365059
Self-citation
Metadata
- Authors
- Qwen, :, Yang, A., Yang, B., Zhang, B., Hui, B., Zheng, B., Yu, B., Li, C., Liu, D., Huang, F., Wei, H., Lin, H., Yang, J., Tu, J., Zhang, J., Yang, J., Yang, J., Zhou, J., Lin, J., Dang, K., Lu, K., Bao, K., Yang, K., Yu, L., Li, M., Xue, M., Zhang, P., Zhu, Q., Men, R., Lin, R., Li, T., Tang, T., Xia, T., Ren, X., Ren, X., Fan, Y., Su, Y., Zhang, Y., Wan, Y., Liu, Y., Cui, Z., Zhang, Z., & Qiu, Z.
- Affiliations
- additional authors not shown
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2412.15115
- OpenAlex
- W4405655184
- Cited by
- 128
- References
- 0
- Citations by year
- 2026: 84 · 2025: 43 · 2024: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- Qwen2.5, large language models, supervised fine-tuning, mixture of experts, instruction tuning, long-form text generation, instruction following, human preference alignment, Qwen2.5-Coder, multimodal models, open-weight models, quantized models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
