The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
UniXcoder: Unified Cross-Modal Pre-training for Code Representation
Open accessAbstract
Pre-trained models for programming languages have recently demonstrated great success on code intelligence.To support both code-related understanding and generation tasks, recent works attempt to pre-train unified encoder-decoder models.However, such encoder-decoder framework is sub-optimal for auto-regressive tasks, especially code completion that requires a decoder-only manner for efficient inference.In this paper, we present UniXcoder, a unified cross-modal pre-trained model for programming language.The model utilizes mask attention matrices with prefix adapters to control the behavior of the model and leverages cross-modal contents like AST and code comment to enhance code representation.To encode AST that is represented as a tree in parallel, we propose a one-to-one mapping method to transform AST in a sequence structure that retains all structural information from the tree.Furthermore, we propose to utilize multi-modal contents to learn representation of code fragment with contrastive learning, and then align representations among programming languages using a cross-modal generation task.We evaluate UniXcoder on five code-related tasks over nine datasets.To further evaluate the performance of code fragment representation, we also construct a dataset for a new task, called zero-shot code-to-code search.Results show that our model achieves state-of-the-art performance on most tasks and analysis reveals that comment and AST can both enhance UniXcoder.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
SimCSE: Simple Contrastive Learning of Sentence Embeddings
Gao, T., Yao, X., & Chen, D. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.552 · Cited by 2,851
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feng, Z., Guo, D., Tang, D., Duan, N., Feng, X., Gong, M., Shou, L., Qin, B., Liu, T., Jiang, D., et al. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.139 · Cited by 2,824
Self-citationWang, Y., Wang, W., Joty, S., & Hoi, S. C. H. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.685 · Cited by 1,495
Self-citation
Research works printed but not linked: 2
- Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, LIU Shujie, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, et al. 2020. Graphcode- bert: Pre-training code representations with data flow. In International Conference on Learning Rep- resentations.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Lan- guage models are unsupervised multitask learners. OpenAI blog, 1(8):9.
Cited by
Sorted by citations
Items 101–200 of 674
Deep learning for code generation: a survey
Zhang, H., Zhang, K., Li, Z., Li, J., Li, J., Li, Y., Zhao, Y., Zhu, Y. S., Liu, F., Li, G., et al. (2024) · Science China Information Sciences · doi:10.1007/s11432-023-3956-3 · Cited by 20
RAPID: Zero-Shot Domain Adaptation for Code Search with Pre-Trained Models
Fan, G., Chen, S., Gao, C., Xiao, J., Zhang, T., & Feng, Z. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3641542 · Cited by 22
Multilingual code refactoring detection based on deep learning
Li, T., & Zhang, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125164 · Cited by 16
Detecting Android malware: A multimodal fusion method with fine-grained feature
Li, X., Liu, L., Liu, Y., & Liu, H. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102662 · Cited by 18
LTM: Scalable and Black-Box Similarity-Based Test Suite Minimization Based on Language Models
Pan, R., Ghaleb, T. A., & Briand, L. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3469582 · Cited by 19
When Deep Learning Meets Information Retrieval-based Bug Localization: A Survey
Niu, F., Li, C., Liu, K., Xia, X., & Lo, D. (2025) · ACM Computing Surveys · doi:10.1145/3734217 · Cited by 21
Learning-based models for vulnerability detection: an extensive study
Ni, C., Yin, X., Shen, L., & Wang, S.-H. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10734-x · Cited by 34
Enriching Source Code with Contextual Data for Code Completion Models: An Empirical Study
van Dam, T., Izadi, M., & Arie Van Deursen, A. (2023) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr59073.2023.00035 · Cited by 21
DIP: Dead code Insertion based Black-box Attack for Programming Language Model
Na, C., Choi, Y., & Lee, J.-H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.430 · Cited by 16
Delving into Commit-Issue Correlation to Enhance Commit Message Generation Models
Wang, L., Tang, X., He, Y., Ren, C., Shi, S., Yan, C., & Li, Z. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00050 · Cited by 19
Multimodal Fusion for Android Malware Detection Based on Large Pre-Trained Models
Li, X., Liu, L., Liu, Y., Zhao, Y., Zhang, P., & Liu, H. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3557577 · Cited by 18
GrammarT5: Grammar-Integrated Pretrained Encoder-Decoder Neural Model for Code
Zhu, Q., Liang, Q., Sun, Z., Xiong, Y., Zhang, L., & Cheng, S. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639125 · Cited by 21
SparseCoder: Identifier-Aware Sparse Transformer for File- Level Code Summarization
Wang, Y., Huang, Y., Guo, D., Zhang, H., & Zheng, Z. (2024) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner60148.2024.00068 · Cited by 17
Self-citationZhang, R., Liu, F., Lin, X., Wang, Z., Lu, Z., & Zhang, Q. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70068-2_12 · Cited by 21
He, Y., Huang, J., Rong, Y., Guo, Y., Wang, E., & Chen, H. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3680342 · Cited by 14
On Inter-Dataset Code Duplication and Data Leakage in Large Language Models
López, J. A. H., Chen, B., Saad, M., Sharma, T., & Varró, D. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3504286 · Cited by 18
Syntax-aware on-the-fly code completion
Takerngsaksiri, W., Tantithamthavorn, C. K., & Li, Y.-F. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107336 · Cited by 14
Multimodal Deep Learning for Android Malware Classification
Arrowsmith, J., Sušnjak, T., & Jang‐Jaccard, J. (2025) · Machine Learning and Knowledge Extraction · doi:10.3390/make7010023 · Cited by 17
An Unbiased Transformer Source Code Learning with Semantic Vulnerability Graph
Islam, N. T., Parra, G. D. L. T., Manuel, D., Bou‐Harb, E., & Najafirad, P. (2023) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp57164.2023.00018 · Cited by 16
Demystifying and Extracting Fault-indicating Information from Logs for Failure Diagnosis
Huang, J., Jiang, Z., Liu, J., Huo, Y., Gu, J., Chen, Z., Feng, C., Dong, H., Yang, Z., & Lyu, M. R.-T. (2024) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre62328.2024.00055 · Cited by 13
What You See is What You Get: Attention-Based Self-Guided Automatic Unit Test Generation
Yin, X., Ni, C., Xu, X., & Yang, X. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00105 · Cited by 21
RepoTransBench: A Real-World Multilingual Benchmark for Repository-Level Code Translation
Wang, Y., Wang, Y., Wang, S., Guo, D., Chen, J., Grundy, J., Liu, X., Ma, Y., Mao, M., Zhang, H., et al. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3645056 · Cited by 12
Self-citationEnhancing vulnerability detection by fusing code semantic features with LLM-generated explanations
Tian, Z., Li, M., Sun, J., Chen, Y., & Chen, L. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103450 · Cited by 15
Who Judges the Judge: An Empirical Study on Online Judge Tests
Liu, K., Han, Y., Zhang, J. M., Chen, Z., Sarro, F., Harman, M., Huang, G., & Ma, Y. (2023) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3597926.3598060 · Cited by 15
Automating modern code review processes with code similarity measurement
Kartal, Y., Akdeniz, E. K., & Özkan, K. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107490 · Cited by 12
Towards cost-efficient vulnerability detection with cross-modal adversarial reprogramming
Tian, Z.-Z., Qiu, R., Teng, Y., Sun, J.-Z., Chen, Y., & Chen, L. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112365 · Cited by 12
Assessing and improving syntactic adversarial robustness of pre-trained models for code translation
Yang, G., Zhou, Y., Zhang, X., Chen, X., Han, T., & Chen, T. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107699 · Cited by 12
LLMs Meet Library Evolution: Evaluating Deprecated API Usage in LLM-Based Code Completion
Wang, C., Huang, K., Zhang, J., Feng, Y., Zhang, L., Liu, Y., & Peng, X. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00245 · Cited by 17
Learning Program Representations with a Tree-Structured Transformer
Wang, W., Zhang, K., Li, G., Liu, S., Li, A., Jin, Z. G., & Liu, Y. (2023) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner56733.2023.00032 · Cited by 12
Ren, K., Qiang, W., Wu, Y., Zhou, Y., Zou, D., & Jin, H. (2023) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3597926.3598146 · Cited by 12
Diverse title generation for Stack Overflow posts with multiple-sampling-enhanced transformer
Zhang, F., Liu, J., Wan, Y., Yu, X., Liu, X., & Keung, J. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111672 · Cited by 12
CONCORD: Clone-Aware Contrastive Learning for Source Code
Ding, Y., Chakraborty, S., Buratti, L., Pujar, S., Morari, A., Kaiser, G. E., & Ray, B. (2023) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3597926.3598035 · Cited by 13
Improving Code Search with Multi-Modal Momentum Contrastive Learning
Shi, Z., Xiong, Y., Zhang, Y., Jiang, Z., Zhao, J., Wang, L., & Li, S. (2023) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc58990.2023.00043 · Cited by 11
ZC3: Zero-Shot Cross-Language Code Clone Detection
Li, J., Tao, C., Jin, Z. G., Liu, F., Li, J., & Li, G. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00210 · Cited by 20
RRGcode: Deep hierarchical search-based code generation
Gou, Q., Dong, Y., Yujiao, W., & Ke, Q. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.111982 · Cited by 14
Machine Learning Approaches to Code Similarity Measurement: A Systematic Review
Zhang, Z., & Saber, T. (2025) · IEEE Access · doi:10.1109/access.2025.3553392 · Cited by 17
CrossCodeBench: Benchmarking Cross-Task Generalization of Source Code Models
Niu, C., Li, C., Ng, V., & Luo, B. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00055 · Cited by 11
A syntax-guided multi-task learning approach for Turducken-style code generation
Yang, G., Zhou, Y., Chen, X., Zhang, X., Xu, Y., Han, T., & Chen, T. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10372-1 · Cited by 11
A Preference-Driven Methodology for Efficient Code Generation
Li, Y., Zhou, Z., Peng, Z., Dong, J., You, H., Yan, R., Wen, S., Tian, Y., & Huang, T. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3639527 · Cited by 11
HexT5: Unified Pre-Training for Stripped Binary Code Information Inference
Xiong, J., Chen, G., Chen, K., Gao, H., Cheng, S., & Zhang, W. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00099 · Cited by 13
Katzy, J., Popescu, R. M., Arie Van Deursen, A., & Izadi, M. (2024) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1145/3650105.3652298 · Cited by 12
Large language models based vulnerability detection: How does it enhance performance?
Xuan, C. D., Quang, D. B., & Quang, V. D. (2025) · International Journal of Information Security · doi:10.1007/s10207-025-00983-8 · Cited by 13
Context-aware prompting for LLM-based program repair
Li, Y., Cai, M., Chen, J., Xu, Y., Huang, L., & Li, J. K. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00512-w · Cited by 14
LLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generation
Ma, Z., Gong, Y., Guo, H., Chen, J., Ma, Y., Cao, Z., & Zhang, J. (2026) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2026.3656374 · Cited by 59
Better Context Makes Better Code Language Models: A Case Study on Function Call Argument Completion
Pei, H., Zhao, J., Lausen, L., Zha, S., & Karypis, G. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25653 · Cited by 17
Syntax-Aware Retrieval Augmented Code Generation
Zhang, X., Zhou, Y., Yang, G., & Chen, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.90 · Cited by 10
Turn tree into graph: Automatic code review via simplified AST driven graph convolutional network
Wu, B., Liang, B., & Zhang, X. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109450 · Cited by 10
You Augment Me: Exploring ChatGPT-based Data Augmentation for Semantic Code Search
Wang, Y., Guo, L., Shi, E., Chen, W., Chen, J., Zhong, W., Wang, M., Li, H., Zhang, H., Lyu, Z., et al. (2023) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58846.2023.00014 · Cited by 9
Self-citationMapping APIs in Dynamic-typed Programs by Leveraging Transfer Learning
Huang, Z., Chen, J., Jiang, J., Liang, Y., You, H., & Li, F. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3641848 · Cited by 9
Comprehensive Semantic Repair of Obsolete GUI Test Scripts for Mobile Applications
Cao, S., Pan, M., Pei, Y., Yang, W., Zhang, T., Wang, L., & Li, X. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639108 · Cited by 10
A Comparison of Pretrained Models for Classifying Issue Reports
Heo, J., Kwon, G., Kwak, C., & Lee, S. (2024) · IEEE Access · doi:10.1109/access.2024.3408688 · Cited by 10
Automated Commit Intelligence by Pre-training
Liu, S., Li, Y., Xie, X., Ma, W., Meng, G., & Liu, Y. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3674731 · Cited by 9
A search-and-fill strategy to code generation for complex software requirements
Dong, Y., Kong, L., Zhang, L., Wang, S., Liu, X., Liu, S., & Chen, M.-C. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107584 · Cited by 10
Rozi, M. F., Ban, T., Ozawa, S., Yamada, A., Takahashi, T., & Inoue, D. (2024) · IEEE Access · doi:10.1109/access.2024.3467180 · Cited by 11
An Empirical Study on Automatically Detecting AI-Generated Source Code: How Far are We?
Suh, H., Tafreshipour, M., Li, J., Bhattiprolu, A., & Ahmed, I. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00064 · Cited by 17
RepoHyper: Search-Expand-Refine on Semantic Graphs for Repository-Level Code Completion
Phan, H. N., Phan, H. N., Nguyen, T. N., & Bui, N. D. Q. (2025) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1109/forge66646.2025.00009 · Cited by 23
Lin, D., Zheng, Z., Wu, J., Yang, J., Lin, K., Xiao, H., Song, B., & Zheng, Z. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3618729 · Cited by 9
Cross-Modal Contrastive Learning for Code Search
Shi, Z., Xiong, Y., Zhang, X., Zhang, Y., Li, S., & Zhu, Y. (2022) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme55016.2022.00017 · Cited by 11
Enhancing code summarization with action word prediction
Li, M., Yu, H., Fan, G., Zhou, Z., & Huang, Z. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126777 · Cited by 9
TCCCD: Triplet-Based Cross-Language Code Clone Detection
Fang, Y., Zhou, F., Xu, Y., & Liu, Z. (2023) · Applied Sciences · doi:10.3390/app132112084 · Cited by 9
Hierarchical features extraction and data reorganization for code search
Zhang, F., Peng, M., Shen, Y., & Wu, Q. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111896 · Cited by 10
INSPECT: Intrinsic and Systematic Probing Evaluation for Code Transformers
Karmakar, A., & Robbes, R. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3341624 · Cited by 9
Mapping Source Code to Software Architecture by Leveraging Large Language Models
Johansson, N., Caporuscio, M., & Olsson, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71246-3_13 · Cited by 8
Promises and perils of using Transformer-based models for SE research
Xiao, Y., Zuo, X., Lu, X., Dong, J. S., Cao, X., & Beschastnikh, I. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.107067 · Cited by 27
Evaluating the Effectiveness and Efficiency of Demonstration Retrievers in RAG for Coding Tasks
He, P., Wang, S., Chowdhury, S., & Chen, T. H. (2025) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner64311.2025.00053 · Cited by 16
Enhancing Vulnerability Detection via Inter-procedural Semantic Completion
Wu, B., Liu, C., Li, Z., Cao, Y., Sun, J., & Lin, S. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728912 · Cited by 12
Code Comment Inconsistency Detection and Rectification Using a Large Language Model
Rong, G., Yu, Y., Liu, S., Tan, X., Zhang, T., Shen, H., & Hu, J. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00035 · Cited by 19
Securebert 2.0: Advanced Language Model for Cybersecurity Intelligence
Aghaei, E., Jain, S., Arun, P., & Sambamoorthy, A. (2025) · Annual Computer Security Applications Conference Workshops (ACSAC Workshops) · doi:10.1109/acsacw69556.2025.00071 · Cited by 13
A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Models
Kaniewski, S., Schmidt, F., Enzweiler, M., Menth, M., & Heer, T. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3815425 · Cited by 27
A Static Evaluation of Code Completion by Large Language Models
Ding, H., Kumar, V., Tian, Y., Wang, Z., Kwiatkowski, R., Li, X., Ramanathan, M. K., Ray, B., Bhatia, P., & Sengupta, S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-industry.34 · Cited by 14
Generating Variable Explanations via Zero-shot Prompt Learning
Wang, C., Lou, Y., Liu, J., & Peng, X. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00130 · Cited by 10
Towards automating self-admitted technical debt repayment
Alhefdhi, A., Dam, H. K., & Ghose, A. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107376 · Cited by 8
On the Impact of Language Selection for Training and Evaluating Programming Language Models
Katzy, J., Izadi, M., & Arie Van Deursen, A. (2023) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam59687.2023.00038 · Cited by 8
Bash comment generation via data augmentation and semantic-aware CodeBERT
Shen, Y., Ju, X., Chen, X., & Yang, G. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00431-2 · Cited by 10
Software Defect Prediction via Generative Adversarial Networks and Pre-Trained Model
Song, W., Gan, L., & Bao, T. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.01503119 · Cited by 8
van Dam, T., van der Heijden, F., de Bekker, P., Nieuwschepen, B., Otten, M., & Izadi, M. (2024) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1145/3650105.3652289 · Cited by 15
SimAC: simulating agile collaboration to generate acceptance criteria in user story elaboration
Li, Y., Keung, J., Yang, Z., Ma, X., Zhang, J., & Liu, S. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00448-7 · Cited by 14
Li, L., Liang, B., Chen, L., & Zhang, X. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107527 · Cited by 7
Soft-Labeled Contrastive Pre-Training for Function-Level Code Representation
Li, X., Guo, D., Gong, Y., Lin, Y., Shen, Y., Qiu, X., Jiang, D., Chen, W., & Duan, N. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.9 · Cited by 18
Self-citationContext-Encoded Code Change Representation for Automated Commit Message Generation
Vu, T. T., Do, T.-D., & Vo, H. D. (2023) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194023500493 · Cited by 8
Park, S., Kim, Y., & Han, Y.-S. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.262 · Cited by 8
Program Translation via Code Distillation
Huang, Y., Qi, M., Yao, Y., Wang, M., Gu, B., Clement, C. B., & Sundaresan, N. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.672 · Cited by 22
LogUpdater : Automated Detection and Repair of Specific Defects in Logging Statements
Zhong, R., Li, Y., Kuang, J., Gu, W., Huo, Y., & Lyu, M. R. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3731754 · Cited by 7
A Transformer-Based Approach for Smart Invocation of Automatic Code Completion
de Moor, A., van Deursen, A., & Izadi, M. (2024) · Proceedings of the 1st ACM International Conference on AI-Powered Software · doi:10.1145/3664646.3664760 · Cited by 7
The Struggles of LLMs in Cross-Lingual Code Clone Detection
Moumoula, M. B., Kaboré, A. K., Klein, J., & Bissyandé, T. F. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715764 · Cited by 23
An enhanced transformer-based framework for interpretable code clone detection
Nashaat, M., Amin, R., Eid, A. H., & Abdel-Kader, R. F. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112347 · Cited by 9
Tian, Z., Teng, Y., Ke, X., Chen, Y., & Chen, L. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107766 · Cited by 8
Enhancing Fine-Grained Vulnerability Detection With Reinforcement Learning
Jiang, Y., Qu, Z., Treude, C., Su, X., & Wang, T. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3603400 · Cited by 8
Zhao, A., Gui, Z., Liang, J., Liu, Y., Peng, D., Wei, W., Hou, S., & Wu, H. (2025) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2025.2577252 · Cited by 7
VulTrLM: LLM-assisted vulnerability detection via AST decomposition and comment enhancement
Zhang, S., Wang, Q., Liu, Q., Luo, E., & Peng, T. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10738-7 · Cited by 11
Detection of Software Security Weaknesses Using Cross-Language Source Code Representation (CLaSCoRe)
Zaharia, S., Rebedea, T. E., & Trăușan-Matu, Ș. (2023) · Applied Sciences · doi:10.3390/app13137871 · Cited by 7
Ni, C., Shen, L., Wang, W., Chen, X., Yin, X., & Zhang, L. (2023) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc58990.2023.00048 · Cited by 8
I2R: Intra and inter-modal representation learning for code search
Zhang, X., Xiang, Y., Liu, Z., Hu, X., & Zhou, D. (2023) · Intelligent Data Analysis · doi:10.3233/ida-230082 · Cited by 7
CP-BCS: Binary Code Summarization Guided by Control Flow Graph and Pseudo Code
Ye, T., Wu, L., Ma, T., Zhang, X., Du, Y., Liu, P., Ji, S., & Wang, W. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.911 · Cited by 9
Rethinking Negative Pairs in Code Search
Li, H., Zhou, X. L., Luu, A. N., & Miao, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.786 · Cited by 21
FAIR: Flow Type-Aware Pre-Training of Compiler Intermediate Representations
Niu, C., Li, C., Ng, V., Lo, D., & Luo, B. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3608136 · Cited by 8
Software Defect Prediction via Code Language Models
Song, W., Gan, L., & Bao, T. (2023) · International Conference on Communication Technology and Information Technology (ICCTIT) · doi:10.1109/icctit60726.2023.10435711 · Cited by 7
An Empirical Study on Noisy Label Learning for Program Understanding
Wang, W., Li, Y., Li, A., Zhang, J., Ma, W., & Liu, Y. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639217 · Cited by 7
Large Language Models for Software Engineering: A Systematic Mapping Study
Görmez, M. K., Yılmaz, M., & Clarke, P. M. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-71139-8_5 · Cited by 10
TIGER: A Generating-Then-Ranking Framework for Practical Python Type Inference
Wang, C., Zhang, J., Lou, Y., Liu, M., Sun, W., Liu, Y., & Peng, X. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00019 · Cited by 11
Metadata
- Authors
- Guo, D., Lu, S., Duan, N., Wang, Y., Zhou, M., & Yin, J.
- Affiliations
- Sun Yat-sen University (CN)
- Microsoft Research Asia (China) (CN)
- Venue
- Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2022
- Pages
- 7212-7225
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W4221166942
- Cited by
- 673
- References
- 28
- Citations by year
- 2026: 153 · 2025: 239 · 2024: 148 · 2023: 122 · 2022: 11
- FWCI
- 116.24
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (U1811262, U1811261, U2001211, U1811264, U1911203)
- Basic and Applied Basic Research Foundation of Guangdong Province (2019B15 15130001)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- UniXcoder, code representation, programming language models, code comments, contrastive learning, cross-modal generation, code completion, code intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
