The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.
DeepSeek-Coder: When the Large Language Model Meets Programming - The Rise of Code Intelligence
Open accessAbstract
The rapid development of large language models has revolutionized code intelligence in software development. However, the predominance of closed-source models has restricted extensive research and development. To address this, we introduce the DeepSeek-Coder series, a range of open-source code models with sizes from 1.3B to 33B, trained from scratch on 2 trillion tokens. These models are pre-trained on a high-quality project-level code corpus and employ a fill-in-the-blank task with a 16K window to enhance code generation and infilling. Our extensive evaluations demonstrate that DeepSeek-Coder not only achieves state-of-the-art performance among open-source code models across multiple benchmarks but also surpasses existing closed-source models like Codex and GPT-3.5. Furthermore, DeepSeek-Coder models are under a permissive license that allows for both research and unrestricted commercial use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Specifically, state-of-the-art models (Guo et al., 2024;Huang et al., 2023) show minimal performance differences between different algorithms.”
From Does Few-Shot Learning Help LLM Performance in Code Synthesis? (2024) · cites this paper as Guo et al., 2024
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The development of evaluations in tandem with language models (LMs) has substantially contributed to the rapid advancement of these models [29, 11, 7, 25, 81, 27, 72].”
From SciCode: A Research Coding Benchmark Curated by Scientists (2024) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Models released at different times, from DeepSeek-Coder in 2023 [10] to Qwen2.5Coder in 2024 [11] and Seed-Coder in 2025 [12], achieve similarly strong performance with only minor differences in average ES scores.”
From LongCodeZip: Compress Long Context for Code Language Models (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To exclude potential effects of data leakage, we used DeepSeek-Coder-6.7B [10], which was trained only on data available before March 2023, while all the benchmarks we evaluated were released after that date [1], [21], [13].”
From LongCodeZip: Compress Long Context for Code Language Models (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“At the same time, different LLMs possess unique strengths and specialize in various tasks aspects.”
From Mixture-of-Agents Enhances Large Language Model Capabilities (2024) · cites this paper as Guo et al., 2024
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“LoRA is proposed to update partial parameters of LLMs by optimizing the low-rank decomposition of the attention module's matrices.”
From Exploring the Capabilities of LLMs for Code-Change-Related Tasks (2025) · cites this paper as [24]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 34
- L. B. Allal, R. Li, D. Kocetkov, C. Mou, C. Akiki, C. M. Ferrandis, N. Muennighoff, M. Mishra, A. Gu, M. Dey, et al. Santacoder: don't reach for the stars! arXiv preprint arXiv:2301.03988, 2023. · arXiv
- M. Bavarian, H. Jun, N. Tezak, J. Schulman, C. McLeavey, J. Tworek, and M. Chen. Efficient training of language models to fill in the middle. arXiv preprint arXiv:2207.14255, 2022. · arXiv
- F. Cassano, J. Gouwar, D. Nguyen, S. Nguyen, L. Phipps-Costin, D. Pinckney, M.-H. Yee, Y. Zi, C. J. Anderson, M. Q. Feldman, et al. Multipl-e: a scalable and polyglot approach to benchmarking neural code generation. IEEE Transactions on Software Engineering, 2023.
- M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. d. O. Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, et al. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374, 2021. · arXiv
- S. Chen, S. Wong, L. Chen, and Y. Tian. Extending context window of large language models via positional interpolation. arXiv preprint arXiv:2306.15595, 2023. · arXiv
- P. Clark, I. Cowhey, O. Etzioni, T. Khot, A. Sabharwal, C. Schoenick, and O. Tafjord. Think you have solved question answering? try arc, the ai2 reasoning challenge. arXiv preprint arXiv:1803.05457, 2018. · arXiv
- K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano, et al. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168, 2021. · arXiv
- DeepSeek-AI. Deepseek llm: Scaling open-source language models with longtermism. arXiv preprint arXiv:2401.02954, 2024. · arXiv
- Y. Ding, Z. Wang, W. U. Ahmad, H. Ding, M. Tan, N. Jain, M. K. Ramanathan, R. Nallapati, P. Bhatia, D. Roth, et al. Crosscodeeval: A diverse and multilingual benchmark for cross-file code completion. In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2023.
- Z. Du, Y. Qian, X. Liu, M. Ding, J. Qiu, Z. Yang, and J. Tang. Glm: General language model pretraining with autoregressive blank infilling. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 320-335, 2022.
- D. Fried, A. Aghajanyan, J. Lin, S. Wang, E. Wallace, F. Shi, R. Zhong, W.-t. Yih, L. Zettlemoyer, and M. Lewis. Incoder: A generative model for code infilling and synthesis. arXiv preprint arXiv:2204.05999, 2022. · arXiv
- L. Gao, A. Madaan, S. Zhou, U. Alon, P. Liu, Y. Yang, J. Callan, and G. Neubig. Pal: Program- aided language models. In International Conference on Machine Learning, pages 10764- 10799.
- PMLR, 2023.
- Z. Gou, Z. Shao, Y. Gong, Y. Yang, M. Huang, N. Duan, W. Chen, et al. Tora: A tool-integrated reasoning agent for mathematical problem solving. arXiv preprint arXiv:2309.17452, 2023. · arXiv
- D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, and J. Steinhardt. Measur- ing massive multitask language understanding. In International Conference on Learning Representations, 2020.
- D. Hendrycks, C. Burns, S. Kadavath, A. Arora, S. Basart, E. Tang, D. Song, and J. Steinhardt. Mea- suring mathematical problem solving with the math dataset. arXiv preprint arXiv:2103.03874, 2021. · arXiv
- D. Kocetkov, R. Li, L. Jia, C. Mou, Y. Jernite, M. Mitchell, C. M. Ferrandis, S. Hughes, T. Wolf, D. Bahdanau, et al. The stack: 3 tb of permissively licensed source code. Transactions on Machine Learning Research, 2022.
- V. A. Korthikanti, J. Casper, S. Lym, L. McAfee, M. Andersch, M. Shoeybi, and B. Catanzaro. Reducing activation recomputation in large transformer models. Proceedings of Machine Learning and Systems, 5, 2023.
- Y. Lai, C. Li, Y. Wang, T. Zhang, R. Zhong, L. Zettlemoyer, W.-t. Yih, D. Fried, S. Wang, and T. Yu. Ds-1000: A natural and reliable benchmark for data science code generation. In International Conference on Machine Learning, pages 18319-18345. PMLR, 2023.
- K. Lee, D. Ippolito, A. Nystrom, C. Zhang, D. Eck, C. Callison-Burch, and N. Carlini. Deduplicat- ing training data makes language models better. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8424-8445, 2022.
- R. Li, L. B. Allal, Y. Zi, N. Muennighoff, D. Kocetkov, C. Mou, M. Marone, C. Akiki, J. Li, J. Chim, et al. Starcoder: may the source be with you! arXiv preprint arXiv:2305.06161, 2023. · arXiv
- P. Lu, L. Qiu, K.-W. Chang, Y. N. Wu, S.-C. Zhu, T. Rajpurohit, P. Clark, and A. Kalyan. Dynamic prompt learning via policy gradient for semi-structured mathematical reasoning. In The Eleventh International Conference on Learning Representations, 2022.
- S.-Y. Miao, C.-C. Liang, and K.-Y. Su. A diverse corpus for evaluating and developing english math word problem solvers. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 975-984, 2020.
- D. Narayanan, A. Harlap, A. Phanishayee, V. Seshadri, N. R. Devanur, G. R. Ganger, P. B. Gibbons, and M. Zaharia. Pipedream: Generalized pipeline parallelism for dnn training. In Proceedings of the 27th ACM Symposium on Operating Systems Principles, pages 1-15, 2019.
- E. Nijkamp, B. Pang, H. Hayashi, L. Tu, H. Wang, Y. Zhou, S. Savarese, and C. Xiong. Codegen: An open large language model for code with multi-turn program synthesis. arXiv preprint arXiv:2203.13474, 2022. · arXiv
- A. Patel, S. Bhattamishra, and N. Goyal. Are nlp models really able to solve simple math word problems? In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2080- 2094, 2021.
- S. Rajbhandari, J. Rasley, O. Ruwase, and Y. He. Zero: Memory optimizations toward training tril- lion parameter models. In SC20: International Conference for High Performance Computing, Networking, Storage and Analysis, pages 1-16. IEEE, 2020.
- B. Roziere, J. Gehring, F. Gloeckle, S. Sootla, I. Gat, X. E. Tan, Y. Adi, J. Liu, T. Remez, J. Rapin, et al. Code llama: Open foundation models for code. arXiv preprint arXiv:2308.12950, 2023. · arXiv
- K. Sakaguchi, R. L. Bras, C. Bhagavatula, and Y. Choi. Winogrande: An adversarial winograd schema challenge at scale. Communications of the ACM, 64(9):99-106, 2021.
- M. Suzgun, N. Scales, N. Schärli, S. Gehrmann, Y. Tay, H. W. Chung, A. Chowdhery, Q. V. Le, E. H. Chi, D. Zhou, , and J. Wei. Challenging big-bench tasks and whether chain-of-thought can solve them. arXiv preprint arXiv:2210.09261, 2022. · arXiv
- H. Touvron, L. Martin, K. Stone, P. Albert, A. Almahairi, Y. Babaei, N. Bashlykov, S. Batra, P. Bhargava, S. Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023. · arXiv
- Y. Wang, W. Wang, S. Joty, and S. C. Hoi. Codet5: Identifier-aware unified pre-trained encoder- decoder models for code understanding and generation. arXiv preprint arXiv:2109.00859, 2021. · arXiv
- R. Zellers, A. Holtzman, Y. Bisk, A. Farhadi, and Y. Choi. Hellaswag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4791-4800, 2019.
- Q. Zheng, X. Xia, X. Zou, Y. Dong, S. Wang, Y. Xue, L. Shen, Z. Wang, A. Wang, Y. Li, et al. Codegeex: A pre-trained model for code generation with multilingual benchmarking on humaneval-x. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 5673-5684, 2023.
Cited by
Sorted by citations
Items 101–200 of 216
SwiftEval: Developing a Language-Specific Benchmark for LLM-generated Code Evaluation
Petrukha, I., Kurliak, Y., & Stulova, N. (2025) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1109/forge66646.2025.00015 · Cited by 3
E-code: Mastering efficient code generation through pretrained models and expert encoder group
Pan, Y., Lyu, C., Yang, Z., Li, L., Liu, Q., & Shao, X. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107602 · Cited by 4
Translating dialects between ChatGPT and DeepSeek: Yemeni Sana’ani Arabic terms as a case-in-point
Shormani, M. Q., & Al-Samki, A. A. (2025) · F1000Research · doi:10.12688/f1000research.165879.1 · Cited by 3
Seed-Coder: Let the Code Model Curate Data for Itself
Seed, B., Zhang, Y., Su, J., Sun, Y., Xi, C., Xiao, X., Zheng, S., Zhang, A., Liu, K., Zan, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.03524 · Cited by 3
“Specifically, we employed the widely adopted 10-gram filtering method [Guo et al., 2024, Hui et al., 2024], which removed all data that had any 10-gram word overlap with key benchmark datasets, including HumanEval, MBPP, MHPP, BigCodeBench, LiveCodeBench, Aider, FullStack Bench, etc.”
InfluentialSelf-citationAppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
Trivedi, H., Khot, T., Hartmann, M., Manku, R., Dong, V., Li, E., Gupta, S., Sabharwal, A., & Balasubramanian, N. (2024) · arXiv · doi:10.48550/arxiv.2407.18901 · Cited by 2
FullStack Bench: Evaluating LLMs as Full Stack Coders
Bytedance-Seed-Foundation-Code-Team, :, Cheng, Y., Chen, J., Chen, J., Chen, L., Chen, L., Chen, W., Chen, Z., Geng, S., et al. (2024) · arXiv · doi:10.48550/arxiv.2412.00535 · Cited by 2
Observational Scaling Laws and the Predictability of Language Model Performance
Ruan, Y., Maddison, C. J., & Hashimoto, T. (2024) · arXiv · doi:10.48550/arxiv.2405.10938 · Cited by 3
A Study on C Code Defect Detection with Fine-Tuned Large Language Models
Wang, Y., Wang, X., Yu, H., Gao, F., Liu, X., & Wang, X. (2024) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec65559.2024.00055 · Cited by 2
Iterative Generation of Adversarial Example for Deep Code Models
Huang, L. H., Sun, W., & Yan, M. L. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00086 · Cited by 2
Large Language Model for Verilog Code Generation: Literature Review and the Road Ahead
Yang, G., Zheng, W., Liang, D., Hu, P., Yang, Y., Peng, S., Li, Z., Feng, J., Wei, X., Sun, K., et al. (2026) · ACM Computing Surveys · doi:10.1145/3841636 · Cited by 20
Clean Code, Better Models: Enhancing LLM Performance with Smell-Cleaned Dataset
Xue, Z., Zhang, X., Gao, Z., Hu, X., Gao, S., Xia, X., & Li, S. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3793252 · Cited by 3
Li, J., Deng, H., Zhang, Y., Zhang, K., Shao, T., Zhao, T., Wang, W., Jin, Z. G., Li, G., Liu, Y., et al. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3797106 · Cited by 5
Retrofitting language models to operate over bytes
Minixhofer, B., Murray, T., Limisiewicz, T., Korhonen, A., Zettlemoyer, L., Smith, N. A., Ponti, E. D., Soldaini, L., & Hofmann, V. (2026) · Nature · doi:10.1038/s41586-026-11111-4 · Cited by 19
An Exploration of Open Source Small Language Models for Automated Assessment
Sterbini, A., & Temperini, M. (2024) · International Conference on Information Visualisation (IV) · doi:10.1109/iv64223.2024.00064 · Cited by 2
LLM-based Interactive Code Generation: Empirical Evaluation
Shaikhelislamov, D., Drobyshevskiy, M., & Belevantsev, A. A. (2024) · Ivannikov ISPRAS Open Conference (ISPRAS) · doi:10.1109/ispras64596.2024.10899123 · Cited by 2
Bootstrapping LLM-based Fact-checking via Iterative Rationalization Finetuning
Lyu, X., Cao, C., Sun, M., Liang, B., Yao, L., & Xu, R. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887888 · Cited by 3
Enhancing Accuracy and Explainability in Anomaly Classification with Large Language Models
Santana, R. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-89103-8_7 · Cited by 2
YABLoCo: Yet Another Benchmark for Long Context Code Generation
Valeev, A., Garaev, R., Lomshakov, V., Piontkovskaya, I., Ivanov, V. V., & Adewuyi, I. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00016 · Cited by 2
Ai-Based Automated Grading of Source Code of Introductory Programming Assignments
Havare, J., Apte, V., Maharajan, K., Samudrala, N. C. G., Ramakrishnan, G., Tamilselvam, S., & Vavilapalli, S. (2025) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc66645.2025.00025 · Cited by 2
UnCert-CoT: Uncertainty-Aware Chain-of-Thought for Code Generation with Large Language Model
Zhu, Y., Li, G., Jiang, X., Li, J., Mei, H., Jin, Z. G., Dong, Y., & Zheng, Q. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0014-7_36 · Cited by 2
Improving OpenDevin: Boosting code generation LLM through advanced memory management
He, R., Ying, A., & Hu, X. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/68/20241506 · Cited by 1
Rethinking Verification for LLM Code Generation: From Generation to Testing
Ma, Z., Zhang, T., Cao, M., Liu, J., Zhang, W., Luo, M., Zhang, S., & Chen, K. (2025) · arXiv · doi:10.48550/arxiv.2507.06920 · Cited by 2
Self-citationUnlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset
Laurençon, H., Tronchon, L., & Sanh, V. (2024) · arXiv · doi:10.48550/arxiv.2403.09029 · Cited by 2
Does Few-Shot Learning Help LLM Performance in Code Synthesis?
Xu, D., Xie, T., Xia, B., Li, H., Bai, Y., Sun, Y., & Wang, W. (2024) · arXiv · doi:10.48550/arxiv.2412.02906 · Cited by 3
“Current LLMs exhibit code generation capabilities through improved model design (Guo et al., 2024), training (Roziere et al., 2023), and chain-of-thought (Li et al., 2023).”
InfluentialMcEval: Massively Multilingual Code Evaluation
Chai, L., Liu, S., Yang, J., Yin, Y., Jin, K., Liu, J., Sun, T., Zhang, G., Ren, C., Guo, H., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.07436 · Cited by 73
“…et al., 2020; Chen et al., 2021; Scao et al., 2022; Li et al., 2022; Allal et al., 2023; Fried et al., 2022; Wang et al., 2021; Zheng et al., 2024; Guo et al., 2024) pre-trained on billions of code snippets, such as StarCoder (Li et al., 2023; Lozhkov et al., 2024), CodeLlama (Rozière et al.,…”
MethodInfluentialLongCodeZip: Compress Long Context for Code Language Models
Shi, Y., Qian, Y., Zhang, H., Shen, B., & Gu, X. (2025) · arXiv · Cited by 7
“Models like DeepSeek-Coder [10], Qwen2.”
InfluentialFeedbackEval: A Benchmark for Evaluating Large Language Models in Feedback-Driven Code Repair Tasks
Dai, D., Liu, M., Li, A., Cao, J., Wang, Y., Wang, C., Peng, X., & Zheng, Z. (2025) · arXiv · doi:10.48550/arxiv.2504.06939 · Cited by 1
“On Hu-manEval, composed of relatively simple, function-level tasks, all LLMs achieve high performance: Deepseek-R1 leads with 86.2%, followed by Claude-3.”
InfluentialAI-Assisted Peer Review at Scale: The AAAI-26 AI Review Pilot
Biswas, J., Schoepp, S., Vasan, G., Opipari, A., Zhang, A., Hu, Z., Joseph, S., Lease, M., Li, J. J., Stone, P., et al. (2026) · arXiv · doi:10.48550/arxiv.2604.13940 · Cited by 1
Improving Source Code Pre-Training via Type-Specific Masking
Zou, W., Li, Q., Li, C., Ge, J., Chen, X., Huang, L., & Luo, B. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3699599 · Cited by 2
Advanced code time complexity prediction approach using contrastive learning
Park, S., Hahn, J., Orwig, E., Ko, S., & Han, Y.-S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110631 · Cited by 1
Sun, C. (2025) · Ceramics - Silikaty · doi:10.13168/cs.2025.0023 · Cited by 1
Enhancing Code Generation Through Retrieval of Cross-Lingual Semantic Graphs
Jiang, Z., Shi, Z., Gao, X., & Xiong, Y. (2024) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec65559.2024.00026 · Cited by 1
Self-citationExploring continual learning in code intelligence with domain-wise distilled prompts
Liu, S., Keung, J., Yang, Z., Liu, F., Zhang, F., & Sun, Y. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107775 · Cited by 1
The Shortcomings of Code LLMs in Modeling Code Properties
Pyda, S., Nichols, D., & Bhatele, A. S. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00029 · Cited by 1
Mix-of-Language-Experts Architecture for Multilingual Programming
Zong, Y., Deng, Y., & Nie, P. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00030 · Cited by 1
HWFixBench: Benchmarking Tools for Hardware Understanding and Fault Repair
Fu, W., Li, S., Jin, Y., & Guo, X. (2025) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3716368.3735171 · Cited by 1
Chen, L., Ahmed, N. K., Capotă, M., Willke, T., Hasabnis, N., & Jannesari, A. (2025) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps64566.2025.00055 · Cited by 2
Sundaram, G., Venktesh, B., V, & Sundharakumar, K. B. (2025) · International Conference on Emerging Technologies in Computing and Communication (ETCC) · doi:10.1109/etcc65847.2025.11108633 · Cited by 1
LLaVA-GM: lightweight LLaVA multimodal architecture
Han, Z., Liu, X., & Hao, J. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1626346 · Cited by 2
Evaluation and Improvement of Test Selection for Large Language Models
Quan, L., Jin, W., Hu, Q., Cordy, M., Huang, Y., Ma, L., & Li, X. (2025) · Journal of Software Evolution and Process · doi:10.1002/smr.70057 · Cited by 4
Reasoned or Rapid code? Unveiling the strengths and limits of DeepSeek for Solidity development
Baralla, G., Ibba, G., & Tonelli, R. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107917 · Cited by 1
Mao, K., Hu, B., Lin, R., Li, Z., Lu, G., & Zhang, Z. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1660912 · Cited by 4
From Legal Text to Tech Specs: Generative AI’s Interpretation of Consent in Privacy Law
Kesari, A., Breaux, T. D., Santos, S., Norton, T. B., & Singhal, A. (2025) · International Conference on Artificial Intelligence and Law · doi:10.1145/3769126.3769241 · Cited by 1
On the Evaluation of Large Language Models in Unit Test Evolution (Experience Paper)
None, Zhang, J., Niu, Y., & Zhou, B. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832282 · Cited by 1
AI for battery-accelerated discovery of high-voltage electrolytes for advanced lithium batteries
Zhan, Y. Z., Chen, N., Li, L., Wu, F., & Chen, R. (2026) · Chemical Society Reviews · doi:10.1039/d4cs01250j · Cited by 1
Security Analysis of Large Language Models on API Misuse Programming Repair
Zhang, R., Qiao, Z., & Yu, Y. (2024) · International Journal of Intelligent Systems · doi:10.1155/2024/7135765 · Cited by 1
Sterbini, A., & Temperini, M. (2024) · International Conference on Information Technology Based Higher Education and Training (ITHET) · doi:10.1109/ithet61869.2024.10837616 · Cited by 1
Towards Trustworthy LLMs for Code: A Data-Centric Synergistic Auditing Framework
Wang, C., Chen, Z., Li, T., Zhang, Y., & Liu, Y. (2025) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1109/icse-nier66352.2025.00017 · Cited by 8
Stacking Llm Models' Predictions for Feature Selection in Anomaly Classification
Santana, R. (2024) · International Conference on Sustainable Technology and Engineering (i-COSTE) · doi:10.1109/i-coste63786.2024.11024839 · Cited by 1
CODEMORPH: Mitigating Data Leakage in Large Language Model Assessment
Rao, H., Zhao, Y., Zhu, W., Xiao, L., Wang, M., & Wang, H. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion66252.2025.00081 · Cited by 1
Xue, Y., Liu, M., Wang, K., Yang, Y., Cheng, Y., Ma, X., & Qiao, Y. (2025) · CHAIN · doi:10.23919/chain.2025.000010 · Cited by 1
Xingxing, 郭. G., Zhiwei, 戴. D., Shuiying, 项. X., Hanxu, 周. Z., Yahui, 张. Z., Yanan, 韩. H., Changjian, 解. X., Wang, T., & Yue, 郝. H. (2025) · Acta Optica Sinica · doi:10.3788/aos250938 · Cited by 1
Predicting typeScript type annotations and definitions with machine learning
Yee, M. (2024) · doi:10.17760/d20653005 · Cited by 1
Cao, J., & Lu, Y. (2025) · Qeios · doi:10.32388/mlaotg · Cited by 1
Wang, W., Yu, W., Yang, Q., Zheng, R., & Li, M. (2026) · Tsinghua Science & Technology · doi:10.1101/2025.05.18.654422 · Cited by 1
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning
Han, X., Jian, Y., Hu, X., Liu, H., Wang, Y., Fan, Q., Ai, Y., Huang, H., He, R., Yang, Z., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.12568 · Cited by 1
RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents
Dai, Z., Deng, S., Guan, S., Tian, Y., Yao, X., Yan, X., & Cheng, J. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.1619
“Large Language Models (LLMs) have demonstrated strong capabilities across a wide range of tasks (Guo et al., 2024; Shao et al., 2024).”
Zhou, C., Zhang, X., Song, D., Chen, X., Gu, W., Ma, H., Tian, Y., Zhang, M., & Hu, L. (2025) · arXiv · doi:10.48550/arxiv.2502.09183 · Cited by 18
“Numerous studies focus on developing code-specific pre-trained models, such as CodeLlama (Roziere et al., 2023), DeepSeek-Coder (Guo et al., 2024), and Qwen-Coder (Hui et al., 2024).”
InfluentialSWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training
Song, H., Huang, L., Sun, S., Jiang, J., Le, R., Cheng, D., Chen, G., Hu, Y., Chen, Z., Jia, Y., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.03411
“Unlike traditional code generation models that focus on short snippets or isolated functions [4, 5], modern SWE agents are expected to understand natural language requirements, navigate large codebases, modify multiple files, execute tests, and iteratively refine solutions until a task is…”
Self-citationTwinMem-Agent: Episodic and Semantic Memory for Repository-Level Program Repair
Wu, B., Luo, Z., Mu, F., & Xiang, L. (2026) · Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering · doi:10.1145/3803437.3807664
Post-Incorporating Code Structural Knowledge Into Pretrained Models via ICL for Code Translation
Du, Y., Sun, H., & Li, M. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3605768
Jiang, J., Shen, J., Kim, S., Yoo, K. M., Kim, J., & Kim, S. (2026) · arXiv · doi:10.48550/arxiv.2603.05863 · Cited by 8
AlphaResearch: Accelerating New Algorithm Discovery with Language Models
Yu, Z., Feng, K., Zhao, Y., He, S., Zhang, X.-P., & Cohan, A. (2025) · arXiv · doi:10.48550/arxiv.2511.08522
Liu, X., Yin, D., Zhang, C., Zhao, D., & Feng, Y. (2025) · Computational Linguistics · doi:10.1162/coli_a_00548 · Cited by 4
Automatic Algorithm Design Assisted by LLMs for Solving Vehicle Routing Problems
Ma, L., Hao, X., Yang, R., & Hai, Z. (2024) · International Conference on Signal Processing · doi:10.1109/icsp62129.2024.10846261
Comparative Analysis of Large Language Models for Web Page Design
Lee, T., Park, J.-S., Han, K., & Jung, H.-K. (2025) · Journal of Digital Contents Society · doi:10.9728/dcs.2025.26.3.591
Shi, Z., Li, L., Zhou, H., Peng, S., Liu, R., Wan, F., Zhang, R., & Xie, H. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5232174
LLMs for Virtualized Networking Infrastructures: An Industrial Report
Pannocchi, L., Lahiri, S., Fichera, S., Artale, A., & Cucinotta, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-90200-0_13
Evaluating Language Models for Computer Graphics Code Completion
Kels, J., Dahou, A. H., & Mathiak, B. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00017
CoUpJava: A Dataset of Code Upgrade Histories in Open-Source Java Repositories
Jiang, K., Jin, B., & Nie, P. (2025) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr66628.2025.00075
Effective Code Generation Using Program Synthesis And CodeLLM
Sadasivam, G. S., & Dharun Kanna, N. (2025) · International Conference on Computational Innovations and Engineering Sustainability (ICCIES) · doi:10.1109/iccies63851.2025.11032972
Coft: Making Large Language Models Better Zero-Shot Learners for Code Generation
Li, W., Qian, Y., Gao, K., Chen, H., Wang, X., Tong, Y., Li, L., Wu, Y., & Zhao, C. (2025) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc66645.2025.00059 · Cited by 1
Self-citationAdvancing Large Language Models in Code Generation: Usaco Benchmark and Bug Mitigation Insights
Trentini, J., Liu, V., Peng, Y., & Zong, Z. (2025) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc66645.2025.00057 · Cited by 1
HyRACC: A Hybrid Retrieval-Augmented Framework for More Efficient Code Completion
Li, C., Shang, J., Feng, Y., & Luo, B. (2025) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1109/forge66646.2025.00013
Guo, H., Lv, X., Li, S., Ma, D.-C., Li, Y.-Z., & Li, M. (2025) · Journal of Pharmaceutical Analysis · doi:10.1016/j.jpha.2025.101386
Self-citationSu, F.-Y., Ngo, G.-H., Phan, B., & Chiang, J.-H. (2025) · Database · doi:10.1093/database/baaf025 · Cited by 1
Melo, B. G. D. S. O., de Araujo, V. M. U., de Araújo, I. C., de Santos, A. S., & Pinto, P. H. R. (2025) · Anais do Workshop sobre as Implicações da Computação na Sociedade (WICS) · doi:10.5753/wics.2025.8556
Spec2Doc2RTL: RTL Generation from Specification with Natural Language Representation
Chen, Z., Lin, Z., Chen, X., Liu, Z., Liu, C., Qiao, Y., Feng, Y., Zuo, J., Song, Y., & Yang, F. (2025) · International Symposium of Electronics Design Automation (ISEDA) · doi:10.1109/iseda65950.2025.11101140
Wang, C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5385351
Zhan, S., Wang, X., Wei, D., Cao, X., & Chen, B. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112590
EFIM: Efficient Serving of LLMs for Infilling Tasks with Improved KV Cache Reuse
Guo, T., Dong, H., Leng, Y., Liu, F., Lin, C., Xiao, N., & Zhang, X. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-99857-7_24
Software Trustworthiness Assessment via Large Language Models (LLMs)
Jananloo, S. J. (2025) · European Dependable Computing Conference · doi:10.1109/edcc-c66476.2025.00034
TALE: Token-Adaptive Low-Rank KVCache Approximation with Reconstruction Elimination
Lee, J., Hwang, S.-W., Qiao, A., Campos, D., Yao, Z., & He, Y. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.39
API-Repo: API-centric Repository-level Code Completion
Li, Z., Li, C., Niu, C., Yan, Y., Ge, J., & Luo, B. (2025) · Asia-Pacific Symposium on Internetware · doi:10.1145/3755881.3755913
Repository-level code completion with adaptive segmentation and fused retrieval
Shen, Y., Qin, P., Zhao, K., Zhang, F., Zhang, F., & Li, G. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10762-7
CodeRankEval: Benchmarking and Analyzing LLM Performance for Code Ranking
Chen, L.-G., Xiao, Z., Xu, Y.-J., An, R.-C., Wang, X., Li, Y.-N., Li, Y.-H., Wang, Y.-D., Zeng, Z.-R., Gao, Q., et al. (2025) · Journal of Computer Science and Technology · doi:10.1007/s11390-025-5514-9
Self-citationAtomizer: An LLM-based Collaborative Multi-Agent Framework for Intent-Driven Commit Untangling
Zhu, K., Tian, Z., Wang, S., Leng, M., & Mao, X. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3787773 · Cited by 4
TheBotCompany: Self-Organizing Multi-agent Systems for Continuous Software Development
Lyu, W., Xiao, Y., Zhang, Y., & Sun, Y. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834358 · Cited by 3
Struggling at the Start: Structural Causes of Decoding Difficulty in Code Generation
Zhu, Y., Li, J., Jiang, H., Li, S., Zhang, J., & Li, A. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3795840
Kátai, Z., & Iclănzan, D. (2026) · Acta Universitatis Sapientiae Informatica · doi:10.1007/s44427-026-00033-8
PlayCoder: Making LLM-Generated GUI Code Playable
Peng, Z., Tao, W., Yin, X., Ying, C., Luo, Y., & Guo, Y. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808097 · Cited by 10
Influence-Aware Bayesian-Inspired Token Reweighting for Improved Code Generation
Zhu, Y., Li, G., Mei, H., Jin, Z. G., Li, J., Zheng, Q., & Zhang, J. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808200
Sivapiran, S., & Uddin, G. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808123 · Cited by 1
DuCodeMark: Dual-Purpose Code Dataset Watermarking via Style-Aware Watermark-Poison Design
Chen, Y., Xiao, Y., Fang, C., Chen, Z., & Xu, B. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3797076
In Line with Context: Repository-Level Code Generation via Context Inlining
Hu, C., Zeng, W., Shi, Y., Shen, B., & Gu, X. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3797094 · Cited by 2
CertiCoder: Towards MISRA-Compliant C Code Generation with LLMs
Gou, M., Yao, Z., Ma, H., Zhang, E.-D., Zhou, J., & He, F. (2026) · Proc. ACM Softw. Eng. · doi:10.1145/3797120
Zhang, L., Chen, C., Yan, D., Xu, H., Cao, M., Song, J., Cai, Z., & Guo, Y. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3797073
ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation
Chen, Y., Xie, C., Shi, Y., Zeng, W., Wang, Y., Zhang, H., & Gu, X. (2026) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1145/3805760.3814925 · Cited by 3
BiVCoder: A Multi-Agent Framework for Code Generation via Bidirectional Code-Test Diagnosis
Li, X., Dong, J., Shi, W., Lü, W., & Du, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818107
STALL + : Boosting LLM-based Repository-level Code Completion with Static Analysis
Jun-wei, L., Chen, Y., Liu, M., Peng, X., & Lou, Y. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3846180 · Cited by 12
Metadata
- Authors
- Guo, D., Zhu, Q., Yang, D., Xie, Z., Dong, K., Zhang, W., Chen, G., Bi, X., Wu, Y., Li, Y. K., Luo, F., Xiong, Y., & Liang, W.
- Affiliations
- Peking University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2401.14196
- OpenAlex
- W4391272793
- Cited by
- 180
- References
- 0
- Citations by year
- 2026: 39 · 2025: 109 · 2024: 32
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- DeepSeek-Coder, code generation, code intelligence, permissive licenses
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
