The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
UniXcoder: Unified Cross-Modal Pre-training for Code Representation
Open accessAbstract
Pre-trained models for programming languages have recently demonstrated great success on code intelligence.To support both code-related understanding and generation tasks, recent works attempt to pre-train unified encoder-decoder models.However, such encoder-decoder framework is sub-optimal for auto-regressive tasks, especially code completion that requires a decoder-only manner for efficient inference.In this paper, we present UniXcoder, a unified cross-modal pre-trained model for programming language.The model utilizes mask attention matrices with prefix adapters to control the behavior of the model and leverages cross-modal contents like AST and code comment to enhance code representation.To encode AST that is represented as a tree in parallel, we propose a one-to-one mapping method to transform AST in a sequence structure that retains all structural information from the tree.Furthermore, we propose to utilize multi-modal contents to learn representation of code fragment with contrastive learning, and then align representations among programming languages using a cross-modal generation task.We evaluate UniXcoder on five code-related tasks over nine datasets.To further evaluate the performance of code fragment representation, we also construct a dataset for a new task, called zero-shot code-to-code search.Results show that our model achieves state-of-the-art performance on most tasks and analysis reveals that comment and AST can both enhance UniXcoder.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
SimCSE: Simple Contrastive Learning of Sentence Embeddings
Gao, T., Yao, X., & Chen, D. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.552 · Cited by 2,851
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feng, Z., Guo, D., Tang, D., Duan, N., Feng, X., Gong, M., Shou, L., Qin, B., Liu, T., Jiang, D., et al. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.139 · Cited by 2,824
Self-citationWang, Y., Wang, W., Joty, S., & Hoi, S. C. H. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.685 · Cited by 1,495
Self-citation
Research works printed but not linked: 2
- Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, LIU Shujie, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, et al. 2020. Graphcode- bert: Pre-training code representations with data flow. In International Conference on Learning Rep- resentations.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Lan- guage models are unsupervised multitask learners. OpenAI blog, 1(8):9.
Cited by
Sorted by citations
Items 201–300 of 674
Better Language Models of Code through Self-Improvement
To, H. Q., Bui, N., Guo, J., & Nguyen, T. N. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.823 · Cited by 18
ShellGPT: Generative Pre-trained Transformer Model for Shell Language Understanding
Shi, J., Jiang, S., Xu, B., Liang, J., Xiao, Y., & Wang, W. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00082 · Cited by 10
Multi-grained contextual code representation learning for commit message generation
Wang, C., Zhang, L., & Zhang, X. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107393 · Cited by 6
The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation
Nguyen, D., Nam, L., Dau, A. T. V., Nguyen, A., Nghiem, K., Guo, J., & Bui, N. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.316 · Cited by 18
End-to-end log statement generation at block-level
Fu, Y., Yan, M. L., He, P., Liu, C., Zhang, X., & Yang, D. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112146 · Cited by 6
Yao, K., Wang, H., Qin, C., Zhu, H., Wu, Y., & Zhang, L. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3688839 · Cited by 7
Enhanced Prompting Framework for Code Summarization with Large Language Models
Fang, M., Yuan, X., Li, Y., Li, H., Fang, C., & Du, J. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728949 · Cited by 6
Enhancing Project-Specific Code Completion by Inferring Internal API Information
Deng, L., Ren, X., Ni, C., Liang, M., Lo, D., & Liu, Z.-X. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3592823 · Cited by 13
ContraCLM: Contrastive Learning For Causal Language Model
Jain, N., Zhang, D., Ahmad, W. U., Wang, Z., Nan, F., Li, X., Tan, M., Nallapati, R. M., Ray, B., Bhatia, P., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.355 · Cited by 13
Cell2Doc: ML Pipeline for Generating Documentation in Computational Notebooks
Mondal, T., Barnett, S., Lal, A., & Vedurada, J. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00200 · Cited by 6
Tang, G., Yang, L., Zhang, L., Kuang, H., & Wang, H. (2024) · Computers & Security · doi:10.1016/j.cose.2024.103816 · Cited by 7
Bridge and Hint: Extending Pre-trained Language Models for Long-Range Code
Chen, Y., Gao, C., Yang, Z., Zhang, H., & Liao, Q. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652127 · Cited by 6
Approaching code search for python as a translation retrieval problem with dual encoders
Khan, M. M., & Yu, Z. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10580-3 · Cited by 6
VEGA: Automatically Generating Compiler Backends using a Pre-trained Transformer Model
Zhong, M., Lv, F., Wang, L., Qiu, L., Wang, Y., Liu, Y., Cui, H., Feng, X., & Xue, J. (2025) · Proceedings of the CGO/Proceedings of the ... CGO · doi:10.1145/3696443.3708931 · Cited by 6
Self-citationImpact of Large Language Models of Code on Fault Localization
Ji, S., Lee, S.-H., Lee, C.-S., Han, Y.-S., & Im, H. (2025) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst62969.2025.10989036 · Cited by 12
Cao, Y., Ju, X., Chen, X., & Gong, L. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00543-3 · Cited by 9
The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation
Manh, D. N., Hai, N. L., Dau, A. T. V., Nguyen, A. M., Nghiem, K., Guo, J., & Bui, N. D. Q. (2023) · Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/2023.nlposs-1.25 · Cited by 6
Context-aware code generation with synchronous bidirectional decoder
Zhang, X., Zhou, Y., Yang, G., Han, T., & Chen, T. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112066 · Cited by 6
SECON: Maintaining Semantic Consistency in Data Augmentation for Code Search
Zhang, X., Lin, Z., Hu, X., Wang, J., Lü, W., & Zhou, D. (2024) · ACM Transactions on Information Systems · doi:10.1145/3686151 · Cited by 7
Assessing and Improving Syntactic Adversarial Robustness of Pre-Trained Models for Code TranslationPreprint
Yang, G., Zhou, Y., Zhang, X., Chen, X., Han, T., & Chen, T. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4623115 · Cited by 8
R+R: Security Vulnerability Dataset Quality Is Critical
Yadav, A. S., & Wilson, J. N. (2024) · Annual Computer Security Applications Conference · doi:10.1109/acsac63791.2024.00086 · Cited by 5
Retrieval-Augmented Fine-Tuning for Improving Retrieve-and-Edit Based Assertion Generation
Li, H., Sun, W., Yan, M. L., Xu, L., Li, Q., Zhang, X., & Zhang, H. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3558403 · Cited by 7
Source code vulnerability detection based on deep learning: a review
Su, H., Xu, Z., Zhang, Y., & Tan, Q. (2026) · Cybersecurity · doi:10.1186/s42400-025-00518-7 · Cited by 7
Exploring Data Augmentation for Code Generation Tasks
Chen, P., & Λάμπουρας, Γ. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.114 · Cited by 6
Effective Hard Negative Mining for Contrastive Learning-Based Code Search
Ye, F., Li, C., Ge, J., Huang, L., & Luo, B. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3695994 · Cited by 5
Contextualized Data-Wrangling Code Generation in Computational Notebooks
Huang, J., Guo, D., Wang, C., Gu, J., Lu, S., Inala, J. P., Yan, C., Gao, J., Duan, N., & Lyu, M. R.-T. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695503 · Cited by 12
Self-citationLOFTune: A Low-Overhead and Flexible Approach for Spark SQL Configuration Tuning
Li, J., Ye, J., Mao, Y., Gao, Y., & Chen, L. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3549232 · Cited by 5
SCodeSearcher: soft contrastive learning for code search
Li, J., Zheng, F., Xianjie, S., Jin, Z. G., Liu, F., Li, J., Zhao, Y., & Li, G. (2025) · Empirical Software Engineering · doi:10.1007/s10664-024-10603-z · Cited by 4
BePilot: An AI Programming Assistant for Compiler Backend Development
Zhong, M., Sun, X., Lv, F., Wang, L., Geng, H., Qiu, L., Cui, H., & Feng, X. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3764585 · Cited by 5
Towards Deep Learning Models for Automatic Computer Program Grading
Nagy, P. D., & Davoudi, H. (2023) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa60987.2023.10302571 · Cited by 5
Laminar: A New Serverless Stream-based Framework with Semantic Code Search and Code Completion
Zahra, Z., Li, Z., & Filgueira, R. (2023) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3624062.3624280 · Cited by 5
On Calibration of Pre-trained Code Models
Zhou, Z., Sha, C., & Peng, X. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639126 · Cited by 5
Raisin: Identifying Rare Sensitive Functions for Bug Detection
Huang, J., Nie, J., Gong, Y., You, W., Liang, B., & Bian, P. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639165 · Cited by 5
On Representation Learning-based Methods for Effective, Efficient, and Scalable Code Retrieval
França, C., Lima, R. C., de Andrade, C. M. V., da Cunha, W. L. M., de Melo, P. O. S. V., Ribeiro-Neto, B. A., da Rocha, L. C. D., Santos, R. L. T., Pagano, A. S., & Gonçalves, M. A. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128172 · Cited by 5
Guiding ChatGPT for Better Code Generation: An Empirical Study
Liu, C., Bao, X., Zhang, H., Zhang, N., Hu, H., Zhang, X., & Yan, M. L. (2024) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner60148.2024.00018 · Cited by 10
Boosting Large Language Models for System Software Retargeting: A Preliminary Study
Zhong, M., Lv, F., Wang, L., Qiu, L., Geng, H., Cui, H., & Feng, X. (2025) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner64311.2025.00037 · Cited by 5
Chen, N., Sun, Q., Zhu, R., Li, X., Lu, X., & Gao, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.295 · Cited by 6
LongCodeZip: Compress Long Context for Code Language Models
Shi, Y., Qian, Y., Zhang, H., Shen, B., & Gu, X. (2025) · 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00020 · Cited by 7
CodeBERT-Based Embeddings for Detecting Vulnerable Smart Contracts
Perera, A., Pillai, B., Tharani, J. S., Rao, A. S., & Muthukkumarasamy, V. (2025) · Conference on Local Computer Networks · doi:10.1109/lcn65610.2025.11146388 · Cited by 4
VulTriNet: A software vulnerability detection method based on tri-channel network
Yang, Y., Yao, Y., Lv, X., & Chen, W. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107893 · Cited by 4
LLM-Powered Intent-Driven Configuration Generation for Multi-Vendor Networks
Wang, J., He, B., Zhao, J., Xuan, Y., Sun, H., Qi, Q., Liang, J., Zhuang, Z., & Liao, J. (2026) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2026.3675409 · Cited by 4
Enhancing Automated Unit Test Generation with Large Language Models: A Systematic Literature Review
Zhang, J., Hu, X., Gao, C., Xia, X., & Li, S. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3802827 · Cited by 6
CodeArt: Better Code Models by Attention Regularization When Symbols Are Lacking
Su, Z., Xu, X., Huang, Z., Zhang, Z., Ye, Y., Huang, J., & Zhang, X. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3643752 · Cited by 11
Snopy: Bridging Sample Denoising with Causal Graph Learning for Effective Vulnerability Detection
Cao, S., Sun, X., Wu, X., Lo, D., Bo, L., Li, B., Liu, X., Lin, X., & Liu, W. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695057 · Cited by 8
Vulnerability detection with feature fusion and learnable edge-type embedding graph neural network
Cheng, G., Luo, Q., & Zhang, Y. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107686 · Cited by 5
Bash command comment generation via multi-scale heterogeneous feature fusion
Zhang, J., Zhu, Y., Lu, A., Yan, Y., & Wan, Y. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00494-9 · Cited by 5
Ju, X., Cao, Y., Chen, X., Gong, L., Chakma, V., & Zhou, X. Y. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107706 · Cited by 6
OCEAN: Open-World Contrastive Authorship Identification
Mächtle, F., Serr, J.-N., Loose, N., Sander, J., & Eisenbarth, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-95764-2_18 · Cited by 4
Oskooei, A. R., Yukcu, S. S., Bozoglan, M. C., & Aktaş, M. S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-97576-9_6 · Cited by 4
MDVul: A semantic-based complex dependency code vulnerability detection using fusion path
Zhequ, S., Wang, S., Lu, N., Shi, W., & Liu, Z. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103475 · Cited by 4
A zero-shot framework for cross-project vulnerability detection in source code
Haque, R., Ali, A., McClean, S. I., & Khan, N. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10749-4 · Cited by 6
Enhanced Vulnerability Localization: Harmonizing Task-Specific Tuning and General LLM Prompting
Tian, W., Lin, Y., Gao, X., & Sun, H. (2025) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme64153.2025.00020 · Cited by 5
Multi-view adaptive contrastive learning for information retrieval based fault localization
Zhou, C., Xie, X., Gong, C., He, P. J., & Li, B. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00573-x · Cited by 4
BERTVRepair: On the Adoption of CodeBERT for Automated Vulnerability Code Repair
Dang, N. N. H., Quan, T., & Nguyen‐Duc, A. (2024) · Springer eBooks · doi:10.1007/978-3-031-55642-5_8 · Cited by 4
bjEnet: a fast and accurate software bug localization method in natural language semantic space
Han, J., Huang, C., & Liu, J. (2024) · Software Quality Journal · doi:10.1007/s11219-024-09693-1 · Cited by 5
Reinforest: Reinforcing Semantic Code Similarity for Cross-Lingual Code Search Models
Saieva, A., Chakraborty, S., & Kaiser, G. E. (2024) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam63643.2024.00026 · Cited by 10
Deep Code Search with Naming-Agnostic Contrastive Multi-View Learning
Feng, J., Li, W., Wu, S., Wei, Z., Xu, Y., Wang, J., & Li, H. (2025) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3737878 · Cited by 4
Optimizing Deep Learning Models to Address Class Imbalance in Code Comment Classification
Mock, M., Borsani, T., Fatta, G. D., & Russo, B. (2025) · IEEE/ACM International Workshop on Natural Language-Based Software Engineering (NLBSE) · doi:10.1109/nlbse66842.2025.00016 · Cited by 4
Zero-Shot Cross-Domain Code Search without Fine-Tuning
Liang, K., Liu, Z., Liu, C. C., Wan, Z., Lo, D., & Yang, X. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3729357 · Cited by 7
Liu, J., Sha, C., & Peng, X. (2023) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner56733.2023.00039 · Cited by 5
Wang, J., Huang, Z., Xiao, H., & Xiao, Y. (2023) · High-Confidence Computing · doi:10.1016/j.hcc.2023.100148 · Cited by 4
Exploring and Improving Code Completion for Test Code
Zhu, T., Liu, Z., Xu, T., Tang, Z. J., Zhang, T., Pan, M., & Xia, X. (2024) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3643916.3644421 · Cited by 4
Enabling Generalized Zero-Shot Vulnerability Classification
Hu, J., Guo, J., Luo, C., Hu, Y., Lanzinger, M., & Li, Z. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3532487 · Cited by 4
Learning to represent code semantics
Liu, F., Li, G., Zhao, Q., & Zhang, L. (2025) · Science China Information Sciences · doi:10.1007/s11432-023-3898-5 · Cited by 3
Towards More Trustworthy Deep Code Models by Enabling Out-of-Distribution Detection
Yan, Y., Duong, V., Shao, H., & Poshyvanyk, D. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00177 · Cited by 3
Large Language Models for Vulnerability Detection in Static Code Analysis: A Survey
Jin, S. (2025) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd64986.2025.11082007 · Cited by 3
Fine-Tune LLMs for PLC Code Security: An Information-Theoretic Analysis
Chen, P., Liu, X., & Wang, Y. (2025) · Mathematics · doi:10.3390/math13193211 · Cited by 3
Self-citationBinary Code Similarity Detection: Retrospective Review and Future Directions
Chang, S., Cui, B., & Feng, S. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.070195 · Cited by 3
A Deep Dive into Retrieval-Augmented Generation for Code Completion: Experience on WeChat
Yang, Z.-Z., Peng, T., Gao, C.-Y., Wang, C.-Z., Huang, H.-L., & Deng, Y. (2025) · IEEE International Conference on Software Maintenance and Evolution · doi:10.1109/icsme64153.2025.00062 · Cited by 7
Boosting Redundancy-Based Automated Program Repair by Fine-Grained Pattern Mining
Jiang, J., Li, F., Zhao, Z., Ye, Z., Liu, M., Wang, B., Zhang, H., & Chen, J. (2025) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme64153.2025.00018 · Cited by 3
Steer Your Model: Secure Code Generation With Contrastive Decoding
Huang, L., Yan, M. L., Yin, T., Sun, W., Liu, Z., Zhang, H., & Lo, D. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3650127 · Cited by 4
When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?
Chen, J., Chen, S., Cao, J., Shen, J., & Cheung, S.-C. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3821424 · Cited by 3
Input Transformation for Pre-Trained-Model-Based Cross-Language Code Search
Geng, M., Dong, D., & Lu, P. (2023) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c60940.2023.00021 · Cited by 3
Chen, G., Liu, W., & Xie, X. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00487-8 · Cited by 5
PATEN: Identifying Unpatched Third-Party APIs via Fine-Grained Patch-Enhanced AST-Level Signature
Lin, L., Ye, J., Wang, C., & Wu, R. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3537102 · Cited by 3
Qi, W., Cao, J., Poddar, D., Li, S., & Wang, X. (2025) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-94458-1_9 · Cited by 4
Wang, Z., Li, G., Li, J., Li, J., Yan, M. L., Xiong, Y., & Jin, Z. G. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3771923 · Cited by 8
Wu, Y., & Xiao, L. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3456-2_24 · Cited by 3
Line-level Semantic Structure Learning for Code Vulnerability Detection
Wang, Z., Li, G., Li, J., Dong, Y., Xiong, Y., & Jin, Z. G. (2025) · Asia-Pacific Symposium on Internetware · doi:10.1145/3755881.3755894 · Cited by 3
Leveraging Artificial Intelligence on Binary Code Comprehension
Zhang, Y. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3559564 · Cited by 3
Chen, N., Sun, Q., Wang, J., Gao, M. Y., Li, X., & Li, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.991 · Cited by 3
Ko, J., Park, S., Kim, Y., Ahn, S., Chang, D.-S., Ahn, E., & Yun, S.-Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.404 · Cited by 10
Towards Low-Resource Automatic Program Repair with Meta-Learning and Pretrained Language Models
Wang, W., Wang, Y., Hoi, S. C. H., & Joty, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.430 · Cited by 3
Self-citationDu, Y., Ma, T., Wu, L., Zhang, X., & Ji, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29749 · Cited by 5
An Empirical Study on Automatically Detecting AI-Generated Source Code: How Far Are We?Preprint
Suh, H., Tafreshipour, M., Li, J., Bhattiprolu, A., & Ahmed, I. (2025) · Qeios · doi:10.32388/sbl97o · Cited by 3
Multi-step Automated Generation of Parameter Docstrings in Python: An Exploratory Study
Venkatkrishna, V., Nagabushanam, D. S., Simon, E. I.-O., & Vidoni, M. C. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3639478.3643110 · Cited by 2
OppropBERL: A GNN and BERT-Style Reinforcement Learning-Based Type Inference
Jha, P., & Dietl, W. (2024) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner60148.2024.00021 · Cited by 2
Multi-Level AI-Driven Analysis of Software Repository Similarities
Zhang, H., Zhang, L., Fang, L., & Filgueira, R. (2024) · IEEE International Conference on eScience · doi:10.1109/e-science62913.2024.10678701 · Cited by 2
Mutual Learning-Based Framework for Enhancing Robustness of Code Models via Adversarial Training
Wang, Y. Y., Chen, Y., Zhao, Y., Gong, Z., Chen, J., & Hao, D. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695519 · Cited by 3
Self-citationWRDScore: New Metric for Evaluation of Natural Language Generation Models
Mussabayev, R. (2024) · International Asian School-Seminar Optimization Problems of Complex Systems (OPCS) · doi:10.1109/opcs63516.2024.10720439 · Cited by 2
Hort, M., Vidziunas, L., & Moonen, L. (2025) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw64639.2025.10962512 · Cited by 2
Element-Based Automated DNN Repair with Fine-Tuned Masked Language Model
Wang, X., Zhang, M., Meng, X., Zhang, J., Liu, Y., & Hu, C. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715716 · Cited by 2
Planning a Large Language Model for Static Detection of Runtime Errors in Code Snippets
Patel, S., Yadavally, A., Dhulipala, H., & Nguyen, T. N. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00102 · Cited by 2
Iterative Generation of Adversarial Example for Deep Code Models
Huang, L. H., Sun, W., & Yan, M. L. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00086 · Cited by 2
A systematic literature review on cross-language source code clone detection
Alshabeeb, E. S., Mahmood, S., & Alshayeb, M. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100786 · Cited by 2
Liu, Y., Chen, Z., Chen, L., Li, Y., Li, X., & Song, W. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3583027 · Cited by 2
AutoReview: An LLM-based Multi-Agent System for Security Issue-Oriented Code Review
Chen, Y. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3728618 · Cited by 2
Nguyen, V., Nepal, ., Yuan, X., Wu, T., & Rudolph, C. (2025) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3708821.3736208 · Cited by 3
Automated Code Summarization by Training Large Language Models with Crowdsourced Knowledge
Xia, M., Maharjan, S., & Song, M. (2025) · IEEE/ACIS International Conference on Software Engineering Research, Management and Applications (SERA) · doi:10.1109/sera65747.2025.11154515 · Cited by 4
Metadata
- Authors
- Guo, D., Lu, S., Duan, N., Wang, Y., Zhou, M., & Yin, J.
- Affiliations
- Sun Yat-sen University (CN)
- Microsoft Research Asia (China) (CN)
- Venue
- Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2022
- Pages
- 7212-7225
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W4221166942
- Cited by
- 673
- References
- 28
- Citations by year
- 2026: 153 · 2025: 239 · 2024: 148 · 2023: 122 · 2022: 11
- FWCI
- 116.24
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (U1811262, U1811261, U2001211, U1811264, U1911203)
- Basic and Applied Basic Research Foundation of Guangdong Province (2019B15 15130001)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- UniXcoder, code representation, programming language models, code comments, contrastive learning, cross-modal generation, code completion, code intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review