The DOI matches its DataCite record; 76 of the 92 references it cites were found in a registry or an index, and 1 are not checked yet.
Code Llama: Open Foundation Models for Code
Open accessAbstract
We release Code Llama, a family of large language models for code based on Llama 2 providing state-of-the-art performance among open models, infilling capabilities, support for large input contexts, and zero-shot instruction following ability for programming tasks. We provide multiple flavors to cover a wide range of applications: foundation models (Code Llama), Python specializations (Code Llama - Python), and instruction-following models (Code Llama - Instruct) with 7B, 13B, 34B and 70B parameters each. All models are trained on sequences of 16k tokens and show improvements on inputs with up to 100k tokens. 7B, 13B and 70B Code Llama and Code Llama - Instruct variants support infilling based on surrounding content. Code Llama reaches state-of-the-art performance among open models on several code benchmarks, with scores of up to 67% and 65% on HumanEval and MBPP, respectively. Notably, Code Llama - Python 7B outperforms Llama 2 70B on HumanEval and MBPP, and all our models outperform every other publicly available model on MultiPL-E. We release Code Llama under a permissive license that allows for both research and commercial use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Given a new task, current LLMs consume and learn from the task data 'as-is' via finetuning or in-context learning [9, 10, 11, 12].”
From Self-Adapting Language Models (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Code-based LLMs (e.g., CodeLlama(Roziere etal. 2023) and StarCoder(Li etal. 2023d; Lozhkov et al. 2024)) are particularly well suited to address this demand.”
From When LLMs meet cybersecurity: a systematic literature review (2025) · cites this paper as Roziere et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“At the time of writing, only the CodeLlama models (Rozi` ere et al., 2023) are able to handle the very long contexts necessary.”
From SWE-bench: Can Language Models Resolve Real-World GitHub Issues? (2023) · cites this paper as Rozière et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Code Llama family are based upon Llama 2. It is pre-trained on a 500B token corpus with both code and natural language texts using the infilling objective.”
From Exploring the Capabilities of LLMs for Code-Change-Related Tasks (2025) · cites this paper as [67]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“which is a 7B decoder-only model trained on code synthesis.”
From Does Few-Shot Learning Help LLM Performance in Code Synthesis? (2024) · cites this paper as Roziere et al., 2023
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLMs have achieved remarkable proficiency at generating code in mainstream programming languages such as Python and JavaScript, yet this proficiency does not transfer to logic programming.”
From From Reasoning to Code: GRPO Optimization for Underrepresented Languages (2026) · cites this paper as Rozière et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“CodeLLaMA-34B [42] is an aligned version of LLaMA-234B, which is fine-tuned with 500B tokens of code data.”
From Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation (2024) · cites this paper as [42]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“At the same time, different LLMs possess unique strengths and specialize in various tasks aspects.”
From Mixture-of-Agents Enhances Large Language Model Capabilities (2024) · cites this paper as Roziere et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“There have been many previous works that have confirmed that LLMs do have good code comprehension capabilities (He et al. 2024; Luo et al. 2024; Roziere et al. 2023; Li et al. 2023d).”
From When LLMs meet cybersecurity: a systematic literature review (2025) · cites this paper as Roziere et al. 2023
The cited source says what the claim attributes to it.
In the citing paper
“Moreover, while numerous LMs have been implemented with a primary focus on code generation, most tend to underperform the best generalist LMs (Li et al., 2022; Le et al., 2022; Roziere et al., 2023; Austin et al., 2021; Xu et al., 2022).”
From Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation (2023) · cites this paper as Roziere et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Utilizing SWE-bench-train, we release two fine-tuned models, SWE-Llama 7 b and 13 b, based on the CodeLlama (Rozi` ere et al., 2023) model.”
From SWE-bench: Can Language Models Resolve Real-World GitHub Issues? (2023) · cites this paper as Rozière et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Prior studies showed that within the same LLM family, larger models are associated with better performance [59, 67, 73].”
From Exploring the Capabilities of LLMs for Code-Change-Related Tasks (2025) · cites this paper as [67]
The cited source says what the claim attributes to it.
In the citing paper
“The main experiments are performed on CODELLAMA (Roziere et al., 2023).”
From Does Few-Shot Learning Help LLM Performance in Code Synthesis? (2024) · cites this paper as Roziere et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Furthermore CODELLAMA is more specialized in coding tasks thus yielding slightly lower PERPLEX-ITY (TARGET) score compared to MISTRAL despite their comparable sizes.”
From Does Few-Shot Learning Help LLM Performance in Code Synthesis? (2024) · cites this paper as Roziere et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Among the LLMs tested, CODELLAMA (Roziere et al., 2023) benefits the most from good test case selection, hence we focus this work around CODELLAMA.”
From Does Few-Shot Learning Help LLM Performance in Code Synthesis? (2024) · cites this paper as Roziere et al., 2023
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Moreover, both of these tools aim to maximise the acceptance rate of the shown completions”
From A Transformer-Based Approach for Smart Invocation of Automatic Code Completion (2024) · cites this paper as [32]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Specifically, optimising only acceptance rate results in worse completions [32, 49].”
From A Transformer-Based Approach for Smart Invocation of Automatic Code Completion (2024) · cites this paper as [32]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Consistent with earlier research [32, 49], we acknowledge that these proxy metrics might not fully capture the usability of the interaction without potentially compromising it in some other way.”
From A Transformer-Based Approach for Smart Invocation of Automatic Code Completion (2024) · cites this paper as [32]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“and contains most of the significant features found in previous work [32].”
From A Transformer-Based Approach for Smart Invocation of Automatic Code Completion (2024) · cites this paper as [32]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“Effective handling of long sequences is a major topic of research in transformer-based language modeling (Vaswani et al., 2017).”
BackgroundBLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · cited 3×
“( b) Difference in BLEU scores for single line code completion of long context models compared to their respective base models before fine-tuning.”
MethodInfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 1×
“To measure the toxicity of the generated outputs from each of the LLMs, we employ the default ToxiGen classifier, tuned on RoBERTa (Liu et al., 2019).”
MethodExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 1×
“…2023; Nguyen et al., 2023), many tasks related to code understanding or synthesis have been addressed since the early 2020s with NLP models adapted for code (Raffel et al., 2020; Feng et al., 2020; Guo et al., 2021; Wang et al., 2021; Ahmad et al., 2021), also see the survey by Xu & Zhu (2022).”
VADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087 · cited 2×
“The VADER produces sentiment scores between -1 and 1, where a positive (negative) score indicates a positive (negative) sentiment towards the population mentioned in the prompt.”
MethodLLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602 · cited 11×
“ChatGPT and GPT-4 (OpenAI, 2023), PaLM (Chowdhery et al., 2022) and Chinchilla (Hoffmann et al., 2022) are closed source, while BLOOM (Scao et al., 2022), OPT (Zhang et al., 2022b), and the seminal work of Llama are public (Touvron et al., 2023a).”
BackgroundMethodInfluentialSelf-citationKudo, T., & Richardson, J. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-2012 · Cited by 4,454 · cited 1×
“� 500B 20B 20B”
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169 · cited 1×
“Long sequences in LLMs. Scaling Transformers and LLMs to long input sequences has attracted much recent interest (Dai et al., 2019; Beltagy et al., 2020; Yu et al., 2023; Ding et al., 2023).”
BackgroundTraining Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117 · cited 3×
“Collecting supervised data from human annotators or training from human feedback (Ouyang et al., 2022) is expensive for coding tasks as it requires input from professional developers.”
BackgroundMethodModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Research works printed but not linked: 6
- Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernandez Abrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vlad Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, Guy Gur-Ari, Steven Hand, Hadi Hashemi, Le Hou, Joshua Howland, Andrea Hu, Jeffrey Hui, Jeremy Hurwitz, Michael Isard, Abe Ittycheriah, Matthew Jagielski, Wenhao Jia, Kathleen Kenealy, Maxim Krikun, Sneha Kudugunta, Chang Lan, Katherine Lee, Benjamin Lee, Eric Li, Music Li, Wei Li, YaGuang Li, Jian Li, Hyeontaek Lim, Hanzhao Lin, Zhongtao Liu, Frederick Liu, Marcello Maggioni, Aroma Mahendru, Joshua Maynez, Vedant Misra, Maysam Moussalem, Zachary Nado, John Nham, Eric Ni, Andrew Nystrom, Alicia Parrish, Marie Pellat, Martin Polacek, Alex Polozov, Reiner Pope, Siyuan Qiao, Emily Reif, Bryan Richter, Parker Riley, Alex Castro Ros, Aurko Roy, Brennan Saeta, Rajkumar Samuel, Renee Shelby, Ambrose Slone, Daniel Smilkov, David R. So, Daniel Sohn, Simon Tokumine, Dasha Valter, Vijay Vasudevan, Kiran Vodrahalli, Xuezhi Wang, Pidong Wang, Zirui Wang, Tao Wang, John Wieting, Yuhuai Wu, Kelvin Xu, Yunhan Xu, Linting Xue, Pengcheng Yin, Jiahui Yu, Qiao Zhang, Steven Zheng, Ce Zheng, Weikang Zhou, Denny Zhou, Slav Petrov, and Yonghui Wu. PaLM 2 Technical Report. arXiv:abs/2305.10403, 2023.
- Jaehun Jung, Peter West, Liwei Jiang, Faeze Brahman, Ximing Lu, Jillian Fisher, Taylor Sorensen, and Yejin Choi. Impossible distillation: From low-quality model to high-quality dataset & model for summarization and paraphrasing. arXiv:abs/2305.16635, 2023.
- Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. In ICLR, 2019.
- Han Peng, Ge Li, Wenhan Wang, Yunfei Zhao, and Zhi Jin. Integrating tree path in transformer for code representation. In NeurIPS, pp. 9343-9354, 2021.
- Vighnesh Leonardo Shiv and Chris Quirk. Novel positional encodings to enable tree-based transformers. In NeurIPS, pp. 12058-12068, 2019.
- Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, and Neel Sundaresan. Unit test case generation with transformers. arXiv:abs/2009.05617, 2020.
Cited by
Sorted by citations
Items 301–400 of 609
aiXcoder-7B: A Lightweight and Effective Large Language Model for Code CompletionPreprint
Jiang, S., Li, J., Zong, H., Liu, H., Zhu, H., Hu, S., Li, E. M., Ding, J., Han, Y., Ning, W., et al. (2024) · Qeios · doi:10.32388/atahd0 · Cited by 6
Counterexample Guided Program Repair Using Zero-Shot Learning and MaxSAT-based Fault Localization
Orvalho, P., Janota, M., & Manquinho, V. (2025) · arXiv · doi:10.48550/arxiv.2502.07786 · Cited by 4
“Counterexamples help in the repair process of certain LLM S , such as C ODE G EMMA and L LAMA 3, across all prompt configurations.”
InfluentialAggarwal, P., Parno, B., & Welleck, S. (2024) · arXiv · doi:10.48550/arxiv.2412.06176 · Cited by 4
LongCodeZip: Compress Long Context for Code Language Models
Shi, Y., Qian, Y., Zhang, H., Shen, B., & Gu, X. (2025) · 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00020 · Cited by 7
“This need has motivated efforts to extend LLM context windows [14], [11], [15].”
DroidCoder: Enhanced Android Code Completion with Context-Enriched Retrieval-Augmented Generation
Yu, X., Li, C., Pan, M., & Li, X. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695063 · Cited by 5
DocSpider: a dataset of cross-domain natural language querying for MongoDB
Özer, A. G., Çekinel, R. F., Toroslu, İ. H., & Karagöz, P. (2025) · Natural language processing. · doi:10.1017/nlp.2024.63 · Cited by 6
Amiri, S. M. H., & Islam, M. (2025) · Software Engineering · doi:10.11648/j.se.20251101.11 · Cited by 4
Enhancing LLM Performance on Hardware Design Generation Task via Reinforcement Learning
Zhao, Y., Fu, W., Li, S., Hu, Y., Guo, X., & Jin, Y. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11043832 · Cited by 4
Towards LLM-Assisted HDL Generation and Verification
Amin, R. A., Lincoln, M. G. R., & Obermaisser, R. (2025) · Mediterranean Conference on Embedded Computing (MECO) · doi:10.1109/meco66322.2025.11049176 · Cited by 4
“Among the available models, CodeLlama Instruct stands out for its strong instruction-following capabilities, making it more suitable for HDL design automation [18].”
Zhao, Y. D., Gong, L., Yu, Y., Huang, Z., & Wei, M. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126762 · Cited by 4
WeightedKV: Attention Scores Weighted Key-Value Cache Merging for Large Language Models
Yuan, J., He, Z., Bai, H., Leng, J., & Jiang, B. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889583 · Cited by 4
“Recently, the decoder-only transformer has emerged as the leading architecture for large language models (LLMs) [1]– [3], showcasing exceptional effectiveness across various application areas [4]–[6].”
RefleXGen:The unexamined code is not worth using
Wang, B., Li, H., Liu, A., Yang, B., Yang, A., Zhong, Y., Huang, W., Huang, R., Zeng, W., & Zhang, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890824 · Cited by 4
“Models like StarCoder [5] and CodeLlama [17] have implemented specific security-enhancing measures during training.”
Zhao, J., Song, Y., & Cohen, E. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112493 · Cited by 4
Program Skeletons for Automated Program Translation
Wang, B., Li, T., Li, R., Mathur, U., & Saxena, P. (2025) · Proceedings of the ACM on Programming Languages · doi:10.1145/3729287 · Cited by 4
Du, X., Wen, M., Wang, H., Wei, Z., & Jin, H. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3729403 · Cited by 4
“Recently, approaches based on LLMs, particularly CodeLLMs [34], have been proposed.”
Fu, Y., Li, B., Li, L., Zhang, W., & Xie, T. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728947 · Cited by 7
Enhancing Automated Unit Test Generation with Large Language Models: A Systematic Literature Review
Zhang, J., Hu, X., Gao, C., Xia, X., & Li, S. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3802827 · Cited by 6
Generative Threat Variants for Detection Tools Assessment
Shieh, S. W., Lee, S., Tsai, M., Chen, P.-C., & Lin, Y.-T. (2024) · IEEE reliability magazine · doi:10.1109/mrl.2024.3408710 · Cited by 4
“CodeLlama is one of the most popular GAI models fine-tuned for code generation [9].”
BackgroundExploring the Effectiveness of Abstract Syntax Tree Patterns for Algorithm Recognition
Neumüller, D., Sihler, F., Straub, R., & Tichy, M. (2024) · International Conference on Code Quality (ICCQ) · doi:10.1109/iccq60895.2024.10576984 · Cited by 4
“During our evaluation of Codellama 213 of the Java methods in BigCloneEval exceeded our chosen model context window of 4096 tokens and could therefore not be processed by the LLM.”
BackgroundResultInfluentialAre Large Language Models Good Neural Architecture Generators for Edge?
Benmeziane, H., & Maghraoui, K. E. (2024) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge62653.2024.00029 · Cited by 3
“5 [2], CodeLlama [3], and CodeGen2.”
LLM-SAP: Large Language Models Situational Awareness-Based Planning
Wang, L., & Zhong, H. (2024) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew63481.2024.10645429 · Cited by 7
“5 [34], Claude-2 [42], alongside open-source alternatives such as LLama-2 [43], LLava [44], Vicuna [45], MiniGPT-4 [46], and CodeLLama [47], on their ability to perform hazard planning using scene-informed one-shot prompts.”
BackgroundPerko, A., & Wotawa, F. (2024) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs62785.2024.00032 · Cited by 4
“Potential future work also includes the evaluation of other LLMs, like Gemini 1.5 [22], Llama 2 [24], Code Llama [25], StarCoder [26], or Mistral 7B [27].”
BackgroundInfluentialEmpirical Evaluation of Large Language Models for Novice Program Fault Localization
Liu, Y., Liu, H., Yang, Z., Li, Z., & Liu, Y. (2024) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs62785.2024.00027 · Cited by 9
“Code Llama: Code Llama [14], an adaptation of Llama2 tailored for coding tasks, offers improved coding functionalities like code generation, description, completion, and debugging through training on code-centric [55] datasets.”
BackgroundThe Future of Game Development in the Era of Gen AI
Pilaniwala, P., Chhabra, G., & Kaur, P. (2024) · Artificial Intelligence for Business (AIxB) · doi:10.1109/aixb62249.2024.00013 · Cited by 5
Fault Localization via Fine-Tuning Large Language Models with Mutation Generated Stack Traces
Jambigi, N., Bogacz, B., Mueller, M., Bach, T., & Felderer, M. (2025) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst62969.2025.10988982 · Cited by 6
“2) Fine-tuned LLMs: We conduct experiments with three open source LLMs: Mistral-7B [47], Santacoder-1B [48], and CodeLlama-7B [49].”
Memory Efficient with Parameter Efficient Fine-Tuning for Code Generation Using Quantization
Purnawansyah, P., Ali, Z., Darwis, H., Ilmawan, L. B., Jabir, S. R., & Manga, A. R. (2024) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1109/imcom60618.2024.10418267 · Cited by 6
How should the advent of large language models affect the practice of science?Preprint
Binz, M., Alaniz, S., Roskies, A. L., Aczél, B., Bergstrom, C. T., Allen, C., Schad, D. J., Wulff, D. U., West, J. D., Zhang, Q., et al. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/yr9xb · Cited by 16
Benchmarking Large Language Models for Bio-Image Analysis Code GenerationPreprint
Haase, R., Tischer, C., Hèriché, J.-K., & Scherf, N. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.04.19.590278 · Cited by 8
Dong, Z., Tang, T., Li, J., Zhao, W. X., & Wen, J.-R. (2023) · arXiv · doi:10.48550/arxiv.2309.13345 · Cited by 7
“S4 (Gu et al., 2022), DSS (Gupta et al., 2022), and GSS (Mehta et al., 2023) employed State Space Models, while RetNet (Sun et al., 2023) utilized retention mechanism, achieving parallel training and recurrent inference for long sequences.”
MethodZhou, X., Weyssow, M., Widyasari, R., Zhang, T., He, J., Lyu, Y., Chang, J., Zhang, B., Huang, D., & Lo, D. (2025) · arXiv · doi:10.48550/arxiv.2502.06215 · Cited by 3
On the Impacts of Contexts on Repository-Level Code Generation
Hai, N. L., Nguyen, D. M., & Bui, N. D. Q. (2024) · arXiv · doi:10.48550/arxiv.2406.11927 · Cited by 3
“…for assisting with coding tasks (Wang et al., 2021, 2023; Feng et al., 2020; Allal et al., 2023; Li et al., 2023; Lozhkov et al., 2024; Guo et al., 2024; Pinnaparaju et al., 2024; Zheng et al., 2024; Roziere et al., 2023; Nijkamp et al., 2022; Luo et al., 2023; Xu et al., 2022; Bui et al., 2023).”
Zweiger, A., Pari, J., Guo, H., Akyürek, E., Kim, Y., & Agrawal, P. (2025) · arXiv · Cited by 3
Enhancing Code Transformation in Large Language Models Through Retrieval-Augmented Fine-Tuning
Guo, J.-M., Liu, P. L., Zeng, Y., & Chen, T.-J. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3565294 · Cited by 3
“The proposed method utilizes Code Llama [7] as the base model of LLMs for training the standard causal language modeling (CLM) objective.”
Towards More Trustworthy Deep Code Models by Enabling Out-of-Distribution Detection
Yan, Y., Duong, V., Shao, H., & Poshyvanyk, D. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00177 · Cited by 3
“Scaling up transformer-based code models and training them on vast amounts of code data allows LLMs [104] to perform a wide range of code-related tasks, making coding less labor-intensive and more accessible to end-users.”
Cannikin: No Lagger of SLO in Concurrent Multiple LoRA LLM Serving
Zhu, R., Jiang, Z., Zhang, Z., Liu, X., Liu, X., & Jin, X. (2025) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2025.3590014 · Cited by 7
Cyber Defense Through Strategic Dynamic Deception
Russo, S., Zanasi, C., & Colajanni, M. (2025) · International Conference on Cyber Conflict · doi:10.23919/cycon65856.2025.11103713 · Cited by 4
ChatHPC: Building the Foundations for a Productive and Trustworthy AI-Assisted HPC Ecosystem
Valero‐Lara, P., Young, A. R., Vetter, J. S., Jin, Z., Pophale, S., Monil, M. A. H., Teranishi, K., & Godoy, W. F. (2025) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3712285.3759787 · Cited by 3
The Art of Repair: Optimizing Iterative Program Repair with Instruction-Tuned Models
Ruiz, F. V., Hort, M., & Moonen, L. (2025) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3756681.3756966 · Cited by 13
“Models such as CodeLlama [35] or DeepSeek-Coder [9] have shown high competency in code generation, translation, and completion.”
InfluentialLarge language models in model-driven engineering: a systematic mapping study
Zhang, W., Jiang, B., Yuhong, F., Cheng, H., Hummel, M., Scotti, V., Hagel, N., Li, J., Großmann, G., Stumptner, M., et al. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10921-4 · Cited by 4
“Besides assistant-style fine-tuning, other variants target specialized domains such as code generation or logical reasoning [45, 49, 88].”
Mathematical Problem Solving in Arabic: Assessing Large Language Models
Mahgoub, A., Khoriba, G. A., & ElSabry, E. A. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.10.181 · Cited by 4
Improving Long-Tail Vulnerability Detection Through Data Augmentation Based on Large Language Models
Deng, X., Duan, F., Xie, R., Ye, W., & Zhang, S. (2024) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58944.2024.00033 · Cited by 5
Fine-Tuning LLMs for Code Mutation: A New Era of Cyber Threats
Setak, M., & Madani, P. (2024) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa62245.2024.00043 · Cited by 5
“Code Llama [22] is a family of large language models tailored for coding tasks, leveraging the Llama 2 architecture.”
MethodAutomated Insights Into GitHub Collaboration Dynamics
Bian, J., Arefyev, N. V., Mühlhäuser, M., & Welzl, M. (2025) · IEEE Access · doi:10.1109/access.2025.3566309 · Cited by 3
“Mistral-7b outperforms Llama2-13b [25], is on par with Llama1-34b [26], and approaches CodeLlama-7b [27] in code performance while excelling in English tasks.”
Li, X., Li, Y., Wu, H., Zhang, Y., Xu, K., Cheng, X., Zhong, S., & Xu, F. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00125 · Cited by 5
SwiftEval: Developing a Language-Specific Benchmark for LLM-generated Code Evaluation
Petrukha, I., Kurliak, Y., & Stulova, N. (2025) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1109/forge66646.2025.00015 · Cited by 3
“Over the past few years, Large Language Models for Code (Code LLMs) [1]–[5] have significantly impacted the programming and software engineering fields, excelling in tasks such as code completion [6], translation [7], summarization [8], and more.”
Enhancing Medical Information Retrieval with a Language Model
Natarajan, Y., Preethaa, K. R. S., Pandian, S., Geetha, S., & Senthilkumar, S. (2024) · International Conference on Cognitive Robotics and Intelligent Systems (ICC-ROBINS) · doi:10.1109/icc-robins60238.2024.10533903 · Cited by 3
“This approach ensures that the chatbot remains at the forefront of current medical developments, offering unparalleled adaptability and precision in addressing intricate healthcare queries [3].”
BackgroundAutomated description generation for software patches
Vu, T. T., Bui, T.-D., Do, T.-D., Nguyen, T.-T., Vo, H. D., & Nguyen, S. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107543 · Cited by 3
Code Generation Using Self-Interactive Assistant
Zhao, Z., Sun, J., Cai, C., & Wei, Z. (2024) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac61105.2024.00377 · Cited by 3
“Recent large language models (LLMs) [12], [13] have significantly improved accuracy and efficiency using larger datasets and parameters.”
BackgroundPyramid Coder: Hierarchical Code Generator for Compositional Visual Question Answering
Shen, R., Inoue, N., & Shinoda, K. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10648180 · Cited by 7
Do LLMs Provide Links to Code Similar to What They Generate? A Study with Gemini and Bing CoPilot
Bifolco, D., Cassieri, P., Scanniello, G., Penta, M. D., & Zampetti, F. (2025) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr66628.2025.00042 · Cited by 3
“Our analysis highlighted how “open” models, such as Llama-3 [39] or its code-specific counterpart, i.e., Code Llama [52], do not provide additional information as links.”
Stalnaker, T., Wintersgill, N., Chaparro, O., Heymann, L. A., Tufo, M., Germán, D. M., & Poshyvanyk, D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5353252 · Cited by 3
Assessing Small Language Models for Code Generation: An Empirical Study with BenchmarksPreprint
Hasan, M. M., Waseem, M., Kemell, K., Rasku, J., Ala-Rantala, J., & Abrahamsson, P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5472927 · Cited by 3
PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
Cai, Z., Zhang, Y., Gao, B., Liu, Y., Li, Y., Liu, T., Lu, K., Xiong, W., Dong, Y., Hu, J., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.02069 · Cited by 2
“Large language models (LLMs) [1, 27, 28, 18] are integral to various natural language processing applications, including dialogue systems [5], document summarization [9], and code completion [25].”
BackgroundSelf-citationFull Line Code Completion: Bringing AI to Desktop
Semenkin, A., Bibaev, V., Sokolov, Y., Krylov, K., Kalina, A., Khannanova, A., Savenkov, D., Rovdo, D., Davidenko, I., Karnaukhov, K., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.08704 · Cited by 8
“A notable development to address these issues is the introduction of The Stack dataset [9], [37], [38] by BigCode [39], a collaboration of over 350 researchers backed by HuggingFace and ServiceNow.”
Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
Zelikman, E., Lorch, E., Mackey, L., & Kalai, A. T. (2023) · arXiv · doi:10.48550/arxiv.2310.02304 · Cited by 4
FullStack Bench: Evaluating LLMs as Full Stack Coders
Bytedance-Seed-Foundation-Code-Team, :, Cheng, Y., Chen, J., Chen, J., Chen, L., Chen, L., Chen, W., Chen, Z., Geng, S., et al. (2024) · arXiv · doi:10.48550/arxiv.2412.00535 · Cited by 2
Self-citationObservational Scaling Laws and the Predictability of Language Model Performance
Ruan, Y., Maddison, C. J., & Hashimoto, T. (2024) · arXiv · doi:10.48550/arxiv.2405.10938 · Cited by 3
Fard, F. H. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3639478.3643060 · Cited by 2
Chain-of-Program Prompting with Open-Source Large Language Models for Text-to-SQL
Xu, B., Li, S., Wu, Y., Wei, S., Du, M., Wang, H., & Song, H. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650552 · Cited by 3
“Therefore, a more cost-effective strategy is to fine-tune open-source LLMs with smaller parameters (such as Llama [11] and Code Llama [12]) for SQL generation.”
BackgroundMethodExploring AI for Vulnerability Detection and Repair
Ezenwoye, O., Pinconschi, E., & Roberts, E. (2024) · Cyber Awareness and Research Symposium (CARS) · doi:10.1109/cars61786.2024.10778769 · Cited by 2
Xu, J., Wen, Y., Liu, Z., Xu, R., Ruan, T., Bi, J., Zhang, R., Huang, D. S., Song, X., Hao, Y., et al. (2025) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3676641.3716262 · Cited by 2
Vilar, G. P. I., Rashid, P., & Tonekaboni, N. H. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016497 · Cited by 3
OpenAssert: Towards Secure Assertion Generation using Large Language Models
Menon, A., Miftah, S. S., Srivastava, A., Kundu, S., Kundu, S., Raha, A., Banerjee, S., Mathaikutty, D. A., & Basu, K. (2025) · IEEE VLSI Test Symposium (VTS) · doi:10.1109/vts65138.2025.11022798 · Cited by 2
“These models are widely embraced across various frameworks and remain the best-performing open-source models in code generation [5].”
LLM2FedLLM - A Tool for Simulating Federated LLMs for Software Engineering Tasks
Kumar, J., Gandu, S., & Chimalakonda, S. (2025) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc66645.2025.00052 · Cited by 2
“Additionally, we experiment with recent version and code-specific model from the LLaMA family [9] using the same FL framework design.”
Neurosymbolic Modular Refinement Type Inference
Sakkas, G., Sahu, P., Ong, K., & Jhala, R. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00090 · Cited by 2
“Therefore, we use the following LLMs; S TAR C ODER -3B [18], C ODE L LAMA -7B [25] and S TAR C ODER 2-15B [19] with 3, 7 and 15 billion trainable parameters respectively.”
Iterative Generation of Adversarial Example for Deep Code Models
Huang, L. H., Sun, W., & Yan, M. L. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00086 · Cited by 2
“Second, we will investigate more scalable optimization frameworks to handle larger and more complex code models, such as DeepSeek-Coder [51] and CodeLlama [52], to further improve the efficiency of ITGen.”
Towards Better Answers: Automated Stack Overflow Post Updating
Mai, Y., Gao, Z., Wang, H., Bi, T., Hu, X., Xia, X., & Sun, J. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00024 · Cited by 7
“Considering the computation resource limitation, we chose the CodeLlama instruct model with 13B parameters [37] in this study and fine-tuned it using the low-rank adaptation (LoRA) method [38].”
HMF: Enhancing reentrancy vulnerability detection and repair with a hybrid model framework
Li, M., Shen, Q., Ren, X., Fu, H., Li, Z., & Sun, J. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00546-0 · Cited by 2
“● CodeLlama (Rozière, et al. 2023) is an LLM-based model developed by Meta, designed to achieve state-of-the-art results in a wide array of natural language processing tasks.”
Wei, G., Zhang, Z., & Urban, C. (2025) · ACM SIGPLAN International Workshop on Language Models and Programming Languages (LMPL) · doi:10.1145/3759425.3763378 · Cited by 2
“Witnessing the recent success (e.g., [1, 25]) of large language models (LLMs) in various code generation and comprehension tasks, it is promising to use LLMs to perform static analysis of programs, i.e., to predict the dynamic behavior of programs without executing them.”
Understanding Formal Reasoning Failures in LLMs as Abstract Interpreters
Mitchell, J., Kim, B. H., Zhou, C., & Wang, C. (2025) · ACM SIGPLAN International Workshop on Language Models and Programming Languages (LMPL) · doi:10.1145/3759425.3763389 · Cited by 4
“2 Background and Related Work”
Large Language Model for Verilog Code Generation: Literature Review and the Road Ahead
Yang, G., Zheng, W., Liang, D., Hu, P., Yang, Y., Peng, S., Li, Z., Feng, J., Wei, X., Sun, K., et al. (2026) · ACM Computing Surveys · doi:10.1145/3841636 · Cited by 20
“The snowballing process was implemented as follows: First, we systematically reviewed the reference lists of our 85 primary studies to identify potentially relevant publications that may have been missed in our initial search.”
ChatMPI: LLM-Driven MPI Code Generation for HPC Workloads
Valero‐Lara, P., Young, A., Naughton, T. J., Engelmann, C., Geist, A., Vetter, J. S., Teranishi, K., & Godoy, W. F. (2026) · International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia) · doi:10.1145/3773656.3773659 · Cited by 2
Boosting LLMs for Mutation Generation
Wang, B., Deng, M., Chen, M., Yang, C., Lin, Y., Harman, M., Papadakis, M., & Zhang, J. M. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808156 · Cited by 3
Advancing Edge Artificial Intelligence
Vermesan, O., & Marples, D. (2024) · River Publishers eBooks · doi:10.1201/9781003478713 · Cited by 2
Spatial Data Discovery Using Small Language Model
Thakur, S. K., & Tyagi, N. (2024) · IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT) · doi:10.1109/ic2pct60090.2024.10486799 · Cited by 3
Faster Feedback with AI? A Test Prioritization Study
Mattis, T., Böhme, L., Krebs, E., Rinard, M., & Hirschfeld, R. (2024) · International Conference on Art, Science, and Engineering of Programming (<Programming>) · doi:10.1145/3660829.3660837 · Cited by 2
MoonBit: Explore the Design of an AI-Friendly Programming Language
Fei, H., Zhang, Y., Zhang, H., Wang, Y., & Liu, Q. (2024) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1145/3643795.3648376 · Cited by 2
Insights into the Development Trends of Industrial Large Language Models
Lai, Y., Bai, J., You, Y., & Dejun, N. (2024) · Trends in Computer Science and Information Technology · doi:10.17352/tcsit.000084 · Cited by 2
An Exploration of Open Source Small Language Models for Automated Assessment
Sterbini, A., & Temperini, M. (2024) · International Conference on Information Visualisation (IV) · doi:10.1109/iv64223.2024.00064 · Cited by 2
HLAT: High-quality Large Language Model Pre-trained on AWS Trainium
Fan, H., Zhou, H., Huang, G., Raman, P., Fu, X., Gupta, G., Ram, D., Wang, Y., & Huan, J. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825098 · Cited by 9
Entailment-Driven Privacy Policy Classification with LLMs
Silva, B., Denipitiyage, D., Seneviratne, S., Mahanti, A., & Seneviratne, A. P. (2024) · Conference on Building a Secure & Empowered Cyberspace (BuildSEC) · doi:10.1109/buildsec64048.2024.00010 · Cited by 3
“The performance of LLMs could be further enhanced through domain adaptation, as demonstrated by initiatives like BloombergGPT [12] for the financial sector and Code LLaMA [32] for software development.”
MethodScaling Laws for Discriminative Classification in Large Language Models
Wyatte, D., Tahmasbi, F., Li, M., & Markovich, T. (2025) · Applied AI Letters · doi:10.1002/ail2.109 · Cited by 7
LLM-based Interactive Code Generation: Empirical Evaluation
Shaikhelislamov, D., Drobyshevskiy, M., & Belevantsev, A. A. (2024) · Ivannikov ISPRAS Open Conference (ISPRAS) · doi:10.1109/ispras64596.2024.10899123 · Cited by 2
“Large Language Models (Code LLMs; [1]–[3]) quickly turned into powerful assistants when writing and editing code.”
Ray, L. S. S., Zhou, B., Suh, S., & Lukowicz, P. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890689 · Cited by 2
“…language processing, providing invaluable insights into different domains like computer vision, robotics, and software development with tasks including image understanding [3], robot control [4], [5], code generation [6], [7], sensor data generation [8] and multi-modal comprehension [9], [10].”
Leveraging Search-Based and Pre-Trained Code Language Models for Automated Program Repair
Lijzenga, O., Moghadam, I. H., & Zaytsev, V. (2025) · ACM Symposium on Applied Computing · doi:10.1145/3672608.3707774 · Cited by 2
“To capitalize on the strengths of both search-based techniques and pre-trained Code Language Models (CLMs) while addressing their respective limitations in automated program repair, this study proposes ARJACLM.”
InfluentialCOSMosFL: Ensemble of Small Language Models for Fault Localisation
Cho, H., Kang, S., An, G., & Yoo, S. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00007 · Cited by 2
“We focus on 4-bit quan-tised models for the sake of memory usage, and choose the following open-source SLMs: CodeLlama 7B [24], Gemma2 9B [12], grantie3 8B [25], Llama3 8B [11], Llama3.”
From Zero to Sixty at the Speed of RAG: Improving YAML Recipe Generation via Retrieval
Farmahinifarahani, F., Babkin, P., Alamir, S., & Liu, X. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00011 · Cited by 2
“Several works have been done in context of general-purpose programming languages code generation with various CodeLLMs developed; some notable examples are Codex [1], Code LLaMA [9] and CodeGen [10].”
Deriving Coding-Specific Sub-Models from LLMs using Resource-Efficient Pruning
Puccioni, L., Farshin, A., Scazzariello, M., Wang, C., Chiesa, M., & Kostić, D. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00028 · Cited by 2
“Unlike CodeLlama, which is primarily fine-tuned on coding data [65], Gemma has been exposed to a diverse range of sources, including web documents, code, and math [41].”
YABLoCo: Yet Another Benchmark for Long Context Code Generation
Valeev, A., Garaev, R., Lomshakov, V., Piontkovskaya, I., Ivanov, V. V., & Adewuyi, I. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00016 · Cited by 2
Too Noisy To Learn: Enhancing Data Quality for Code Review Comment Generation
Liu, C., Lin, H. Y., & Thongtanunam, P. (2025) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr66628.2025.00043 · Cited by 3
“5) and two open-source models (CodeLlama [38] and Llama 3 [39]).”
Codebreaker: Dynamic Extraction Attacks on Code Language Models
Han, C., Deng, Z., Ma, W., Zhu, X., Xue, M., Zhu, T., Wen, S., & Xiang, Y. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00124 · Cited by 2
“The use of code assistants has grown significantly in recent years [1], [2], [3].”
Ai-Based Automated Grading of Source Code of Introductory Programming Assignments
Havare, J., Apte, V., Maharajan, K., Samudrala, N. C. G., Ramakrishnan, G., Tamilselvam, S., & Vavilapalli, S. (2025) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc66645.2025.00025 · Cited by 2
“• Codellama-7B-Instruct [23] (CL): It is pre-trained from scratch to support a myriad of code-related tasks.”
Guarding Your Conversations: Privacy Gatekeepers for Secure Interactions with Cloud- Based AI Models
Uzor, G., Al-Qudah, H. S. S., Ineza, Y., & Serwadda, A. (2025) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc64641.2025.00040 · Cited by 2
The Sustainability Face of Automated Program Repair Tools
Martínez, M., Martínez‐Fernández, S., & Franch, X. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3744900 · Cited by 2
“…[28]), 10 fine-tuned LLMs (including InCoder [29] and CodeGen [30]) used by Jiang et al. [31], and RepairLlama [32], a repair approach based on CodeLlama [33], which introduces LoRA [34], a state-of-the-art fine-tuning technique named parameter-efficient fine-tuning (PEFT) , for program repair.”
UnCert-CoT: Uncertainty-Aware Chain-of-Thought for Code Generation with Large Language Model
Zhu, Y., Li, G., Jiang, X., Li, J., Mei, H., Jin, Z. G., Dong, Y., & Zheng, Q. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0014-7_36 · Cited by 2
Peer-aided repairer: empowering large language models to repair advanced student assignments
Zhao, Q., Zhang, L., Liu, F., Liu, Y., Yan, Z., Chen, Z., Zhou, Y., Jiang, J., Li, G., Sun, Z., et al. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10716-z · Cited by 8
“Notable contributions include GPT-NeoX [3], GPT-J [45], InCoder [11], CodeGen [33], LLaMA [41], StarCoder [26], Code Llama [39], etc .”
Advancing Edge Artificial Intelligence
Vermesan, O., & Marples, D. (2023) · doi:10.13052/rp-9788770041010 · Cited by 2
Improving Human Resources’ Efficiency with a Generative AI-Based Resume Analysis Solution
Tran, T. T., Nguyen, T. G., Dang, T. H., & Yoshinaga, Y. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-8296-7_25 · Cited by 2
Metadata
- Authors
- Rozière, B., Gehring, J., Gloeckle, F., Sootla, S., Gat, I., Tan, X. E., Adi, Y., Liu, J., Sauvestre, R., Remez, T., Rapin, J., Kozhevnikov, A., Evtimov, I., Bitton, J., Bhatt, M., Ferrer, C. C., Grattafiori, A., Xiong, W., Défossez, A., Copet, J., Azhar, F., Touvron, H., Martin, L., Usunier, N., Scialom, T., & Synnaeve, G.
- Affiliations
- École nationale des ponts et chaussées (FR)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2308.12950
- OpenAlex
- W4386185625
- Cited by
- 531
- References
- 92
- Citations by year
- 2026: 65 · 2025: 232 · 2024: 216 · 2023: 18
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- CodeLlama, code large language models, Llama 2, HumanEval, MBPP, code generation benchmarks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
