On the naturalness of software
The DOI matches its Crossref record; 55 of the 56 references it cites were found in a registry or an index.
Abstract
Natural languages like English are rich, complex, and powerful. The highly creative and graceful use of languages like English and Tamil, by masters like Shakespeare and Avvaiyar, can certainly delight and inspire. But in practice, given cognitive constraints and the exigencies of daily life, most human utterances are far simpler and much more repetitive and predictable. In fact, these utterances can be very usefully modeled using modern statistical methods. This fact has led to the phenomenal success of statistical approaches to speech recognition, natural language translation, question-answering, and text mining and comprehension. We begin with the conjecture that most software is also natural , in the sense that it is created by humans at work, with all the attendant constraints and limitations---and thus, like natural language, it is also likely to be repetitive and predictable. We then proceed to ask whether (a) code can be usefully modeled by statistical language models and (b) such models can be leveraged to support software engineers. Using the widely adopted n -gram model, we provide empirical evidence supportive of a positive answer to both these questions. We show that code is also very regular, and, in fact, even more so than natural languages. As an example use of the model, we have developed a simple code completion engine for Java that, despite its simplicity, already improves Eclipse's completion capability. We conclude the paper by laying out a vision for future research in this area.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
On The Language Instinct: (412952005-009)
Pinker, S., & American Psychological Association (1994) · PsycEXTRA Dataset · doi:10.1037/e412952005-009 · Cited by 5,646
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
Knuth, D. E. (1984) · The Computer Journal · doi:10.1093/comjnl/27.2.97 · Cited by 1,467
Statistical machine translation
(2010) · Choice Reviews Online · doi:10.5860/choice.47-6293 · Cited by 1,309
Recovering traceability links between code and documentation
Antoniol, G., Canfora, G., Casazza, G., De Lucia, A., & Merlo, E. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1041053 · Cited by 967
Towards automatically generating summary comments for Java methods
Sridhara, G., Hill, E., Muppaneni, D., Pollock, L., & Vijay-Shanker, K. (2010) · Proceedings of the IEEE/ACM international conference on Automated software engineering · doi:10.1145/1858996.1859006 · Cited by 514 · cited 1×
“Summarization and Concern Location A line of work on code summarization 9, 47, 48 uses semantic properties inferred by static analysis, rather than the “natural” regularities of software corpora capturable in statistical models; it is complementary to ours: properties derived by static analysis (as…”
MethodMining Version Histories to Guide Software Changes
Zimmermann, T., Member, S., Weißgerber, P., Diehl, S., Zeller, A., & Ieee Computer Society (2004) · Cited by 494
Building a Large Annotated Corpus of English: The
MarcusMitchell, P., Ann, M., & SantoriniBeatrice (1993) · Computational Linguistics · doi:10.5555/972470.972475 · Cited by 489
Jungloid mining: helping to navigate the API jungle
Mandelin, D., Xu, L., Bodík, R., & Kimelman, D. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065018 · Cited by 388
Research works printed but not linked: 6
- 10.5555/2819009.2819143 · doi:10.5555/2819009.2819143
- 10.5555/1734086 · doi:10.5555/1734086
- 10.1145/1062455.1062526 · doi:10.1145/1062455.1062526 · Paper page
- 10.5555/311445 · doi:10.5555/311445
- 10.5555/2820518.2820559 · doi:10.5555/2820518.2820559
- 10.5555/998675.999460 · doi:10.5555/998675.999460
Cited by
Items 201–300 of 330
Liu, X., Yin, D., Zhang, C., Zhao, D., & Feng, Y. (2025) · Computational Linguistics · doi:10.1162/coli_a_00548 · Cited by 10
Detecting and Untangling Composite Commits via Attributed Graph Modeling
Xu, S., Chen, S., Yao, Y., & Feng, X. (2025) · Journal of Computer Science and Technology · doi:10.1007/s11390-024-2943-9 · Cited by 4
ObscuraCoder: Powering Efficient Code LM Pre-Training Via Obfuscation Grounding
Paul, I., Yang, H., Glavaš, G., Kersting, K., & Gurevych, I. (2025) · TUbilio (Technical University of Darmstadt) · doi:10.48550/arxiv.2504.00019 · Cited by 13
On the Flakiness of LLM-Generated Tests for Industrial and Open-Source Database Management Systems
Berndt, A., Bach, T., Gemulla, R., Kessel, M., & Baltes, S. (2026) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3786583.3786919 · Cited by 4
Deep learning based identification of inconsistent method names: How far are we?
Wang, T., Zhang, Y., Jiang, L. C., Tang, Y., Li, G., & Liu, H. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10592-z · Cited by 4
Information-theoretic detection of unusual source code changes
Torres, A., Baltes, S., Treude, C., & Wagner, M. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10644-y · Cited by 4
Semantic Mastery: Enhancing LLMs with Advanced Natural Language Understanding
Hariharan, M. (2026) · IEEE International Conference on AI in Cybersecurity (ICAIC) · doi:10.1109/icaic67076.2026.11395740 · Cited by 4
Automatic Acquisition of Annotated Training Corpora for Test-Code Generation
Kacmajor, M., & Kelleher, J. D. (2019) · Information · doi:10.3390/info10020066 · Cited by 4
Editable AI: Mixed Human-AI Authoring of Code Patterns
chugh, K., Solis, A. Y., & LaToza, T. D. (2019) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2019.8818871 · Cited by 4
DDPT: Diffusion-Driven Prompt Tuning for Large Language Model Code Generation
Li, J., Hyun, S., & Babar, M. A. (2025) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain66642.2025.00030 · Cited by 5
Khan, H. A., Jiang, Y., Umer, Q., Zhang, Y., Akram, W., & Liu, H. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715765 · Cited by 4
Empirical Study of Code Large Language Models for Binary Security Patch Detection
Li, Q., Li, B., Gao, C., Gao, S., Li, Z., Xiao, Y., Li, C., & Luo, B. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3822506 · Cited by 5
Althar, R. R., Alahmadi, A. M., Samanta, D., Khan, M. Z., & Alahmadi, A. H. (2022) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2022170 · Cited by 4
Joint Embedding of Semantic and Statistical Features for Effective Code Search
Kong, X., Kong, S., Yu, M., & Du, C. (2022) · Applied Sciences · doi:10.3390/app121910002 · Cited by 4
QTC4SO: Automatic Question Title Completion for Stack Overflow
Zhou, Y., Yang, S., Chen, X., Zhang, Z., & Pei, J. (2023) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc58990.2023.00011 · Cited by 5
Embedding Code Contexts for Cryptographic API Suggestion:New Methodologies and ComparisonsPreprint
Xiao, Y., Ahmed, S., Song, W., Ge, X., Viswanath, B., & Yao, D. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08747 · Cited by 6
Giabbanelli, P. J., Beverley, J., Dávid, I., & Tolk, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5365069 · Cited by 4
AlignCoder: Aligning Retrieval with Target Intent for Repository-Level Code Completion
Jiang, T., Wang, Y., Wang, Y., Guo, D., Shi, E., Ma, Y., Chen, T., & Zheng, Z. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00085 · Cited by 10
ProxyWar: Dynamic Assessment of LLM Code Generation in Game Arenas
Peng, W., Wang, X., & Wu, Q. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773220 · Cited by 8
Boosting LLMs for Mutation Generation
Wang, B., Deng, M., Chen, M., Yang, C., Lin, Y., Harman, M., Papadakis, M., & Zhang, J. M. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808156 · Cited by 4
Geometric Analysis and Metric Learning of Instruction Embeddings
Biswas, S., Barao, T., Lazzari, J., McCoy, J., Liu, X., & Kostandarithes, A. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892426 · Cited by 3
JUST-IN-TIME VULNERABILITY DETECTION AND LOCALIZATION
Vo, H. D. (2024) · Journal of Computer Science and Cybernetics · doi:10.15625/1813-9663/19102 · Cited by 3
Automatic title completion for Stack Overflow posts and GitHub issues
Chen, X., Pei, W., Yang, S., Zhou, Y., Zhang, Z., & Pei, J. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10513-0 · Cited by 3
Chen, Z., Li, A., Zhang, N., Chen, J., Huang, Y., & Zheng, Z. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129972 · Cited by 4
Fairer Software Made Easier (using “Keys”)
Menzies, T., Peng, K., & Lustosa, A. (2021) · IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW) · doi:10.1109/asew52652.2021.00031 · Cited by 3
Deng, Y., & Murari, S. (2021) · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion) · doi:10.1145/3461615.3485403 · Cited by 3
Nacef, A., Bahroun, S., Khalfallah, A., & Ahmed, S. B. (2023) · International Conference on Evaluation of Novel Approaches to Software Engineering · doi:10.5220/0011992100003464 · Cited by 3
A Multiple-Path Learning Neural Network Model for Code Completion
Liu, Y., Liu, J., Zhang, X., & Hu, H. (2023) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws60048.2023.00042 · Cited by 5
Hubungan antara Kemampuan Matematika dengan Keterampilan Pemrograman
Zulkipli, Z. (2023) · Jurnal Bangkit Indonesia · doi:10.52771/bangkitindonesia.v12i2.251 · Cited by 3
Software Bug Count Prediction Model Based on Software Source Code
Kumar, R., & Chaturvedi, A. (2023) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt56998.2023.10307457 · Cited by 3
Automated description generation for software patches
Vu, T. T., Bui, T.-D., Do, T.-D., Nguyen, T.-T., Vo, H. D., & Nguyen, S. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107543 · Cited by 4
An Empirical Study on the Relationship between Defects and Source Code’s Unnaturalness
Jiang, Y., Liu, H., Liu, J., Zhang, Y., Ji, W., Zhong, H., & Zhang, L. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3718083 · Cited by 3
Systematic Mapping Study on AI Integration in CI/CD Pipelines
Berrouyne, O., Bajta, M. E., & Benelallam, I. (2025) · International Conference on Optimization and Applications (ICOA) · doi:10.1109/icoa66896.2025.11236947 · Cited by 2
JIT-MTL: Just-in-Time Defect Localization and Prediction with Multi-Task Learning
Shen, Z., Zou, W., Chen, X., Ge, J., Li, C., Cao, S., Zhang, X., Huang, L., & Luo, B. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3797269 · Cited by 2
REBench: A Procedural, Fair-by-Construction Benchmark for LLMs on Stripped-Binary Types and Names
Won, J. Y., Jin, X., Ma, S., & Lin, Z. (2026) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1145/3805760.3814935 · Cited by 3
On the Naturalness of Bytecode Instructions
Choi, Y.-H., & Nam, J. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3559559 · Cited by 2
FlexType: A Plug-and-Play Framework for Type Inference Models
Voruganti, S., Jesse, K., & Dévanbu, P. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3559527 · Cited by 2
VarGAN: Adversarial Learning of Variable Semantic Representations
Lin, Y., Wan, C., Bai, S., & Gu, X. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3391730 · Cited by 2
A Combinatorial Strategy for API Completion: Deep Learning and Heuristics
Liu, Y., Yin, Y., Deng, J., Li, W., & Peng, Z. (2024) · Electronics · doi:10.3390/electronics13183669 · Cited by 2
Yang, L., Zhao, J., Xie, R., Ren, Y., Guan, J., Li, B., Ma, J., & Tan, Y. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.107743 · Cited by 2
Giabbanelli, P. J., Beverley, J. R., Dávid, I., & Tolk, A. (2025) · Winter Simulation Conference · doi:10.1109/wsc68292.2025.11338852 · Cited by 2
NameChecker: Detecting Inconsistency between Method Names and Method Bodies
Li, K., Wang, T., & Liu, H. (2021) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec53868.2021.00010 · Cited by 2
On the naturalness of fuzzer-generated code
Kambhamettu, R. H., Billos, J., Oluwaseun-Apo, T., Gafford, B., Padhye, R., & Hellendoorn, V. J. (2022) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3524842.3527972 · Cited by 3
Improving Code Completion by Sequence Features and Structural Features
Liu, Y., Huang, Z., Yu, Y., Hussain, Y., & Lin, L. (2022) · World Symposium on Software Engineering (WSSE) · doi:10.1145/3568364.3568373 · Cited by 2
Mapping Modern JVM Language Code to Analysis-Friendly Graphs: A Study with Kotlin
Li, L., & Liu, Y. (2022) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194022500735 · Cited by 2
Enhancing Code Completion with Implicit Feedback
Jin, H., Zhou, Y., & Hussain, Y. (2023) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs60937.2023.00030 · Cited by 2
Obstacles in Fully Automatic Program Repair: A surveyPreprint
Mousavi, S. A., Babani, D. A., & Flammini, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02714 · Cited by 2
Checking Patch Behaviour against Test SpecificationPreprint
Tian, H., Li, Y., Pian, W., Kaboré, A. K., Liu, K., Klein, J., & Bissyandé, T. F. (2021) · arXiv (Cornell University) · Cited by 2
Generalização Cartográfica: Desafios e Perspectivas
Freiman, F. P., & dos Santos, D. R. (2022) · Revista Brasileira de Cartografia · doi:10.14393/rbcv74n3-65431 · Cited by 1
PATVD:Vulnerability Detection Based on Pre-training Techniques and Adversarial Training
Yu, W., Kou, G., Liu, Q., Zhang, H., & Wang, Q. (2022) · IEEE Smart World Congress (SWC) · doi:10.1109/smartworld-uic-atc-scalcom-digitaltwin-pricomp-metaverse56740.2022.00253 · Cited by 1
Ojha, P. R. (2024) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit241051031 · Cited by 1
PRECOS: Project-specific Retrieval for Better Code Summarization
Zhu, T., Li, Z., Zhang, T., Pan, M.-X., & Li, X.-D. (2024) · IEEE International Conference on Software Maintenance and Evolution · doi:10.1109/icsme58944.2024.00051
On the Generalizability of Transformer Models to Code Completions of Different Lengths
Cooper, N., Tufano, R., Bavota, G., & Poshyvanyk, D. (2024) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58944.2024.00042 · Cited by 1
Dramko, L., Bölöni-Turgut, D., Goues, C. L., & Schwartz, E. J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-97620-9_14 · Cited by 1
CodeMark : Contextual and Natural Watermarking for Tracing Code Snippet Provenance
Li, W., Yang, B., Sun, Y., Chen, S., Chen, Y., & Xiang, L. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3594599 · Cited by 3
Binary2vec:Cross-architecture binary embeddings with global attention-enhanced graph neural networks
Gao, Z., Xiao, L., Weng, W. H., Xu, Q., Zhou, B., & Luo, L. (2025) · Array · doi:10.1016/j.array.2025.100491 · Cited by 2
Synthetic Malware at Scale: Malicious Code Generation With Code Transplanting
Wang, G., Chen, D., Gu, X., Chen, Y., & Shen, B. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3633280 · Cited by 1
Enhancing Semantic Clone Detection with Siamese Bi-LSTM for Multi-Level Source Code Representations
Quradaa, F. H., Shahzad, S., Almoqbily, R. S., & Al-Hakimi, M. H. (2025) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-025-10675-z · Cited by 1
Literate Programming With LLMs? — A Study on Rosetta Code and CodeNet
Sun, S., & Staron, M. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3629828 · Cited by 2
DockerFill: Automatically Completing Dockerfile Code With Syntax-Aware Multi-Task Learning
Wu, Y., Zhang, Y., Wang, T., Ding, B., & Wang, H. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3632074 · Cited by 1
Semantic code clone detection using hybrid intermediate representations and BiLSTM networks
Ismail, M. S., Shahzad, S., & Quradaa, F. H. (2026) · PLoS ONE · doi:10.1371/journal.pone.0340971 · Cited by 1
How Does ChatGPT Make Assumptions When Creating Erroneous Programs?
Jahan, S., & Xiaoyin, W. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00321 · Cited by 1
SLMFL: Structural and semantic fusion for fault localization based on Small Language Models
Fan, X., Hu, J., Zheng, W., Liu, Y., & Gao, S. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108143 · Cited by 1
Automatic Validation of LLM-Generated Code with Prompt Paraphrasing
Wang, X., & Zhu, D. K. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3786582.3786809 · Cited by 1
Behavioral Analysis of AI Code Generation Agents: Edit, Rewrite, and Repetition
Abazar, M., Farahmand, R., Ginde, G., Tan, B., & Carli, L. D. (2026) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3793302.3793605 · Cited by 2
BinRAG: An RAG-Based Decompilation Framework Fusing Name Prediction and Calling Context
Wong, W. K., Wu, D., Liu, Z., Wang, H., Li, Z., & Wang, S. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832245 · Cited by 2
Cross-Architecture Lifter Synthesis
van Tonder, R., & Goues, C. L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-92970-5_10 · Cited by 1
Multi-location cryptographic code repair with neural-network-based methodologies
Xiao, Y. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3473102 · Cited by 2
Code Representation Based on Hybrid Graph Modelling
Wu, Q., Jiang, X., Zheng, Z., Gao, X., Lyu, C., & Lyu, L. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-92307-5_35 · Cited by 1
Hardware descriptions code completion based on a pre-training model
Liang, X. (2021) · IEEE Conference on Telecommunications, Optics and Computer Science (TOCS) · doi:10.1109/tocs53301.2021.9688846 · Cited by 1
Accurate module name prediction using similarity based and sequence generation models
Rai, S., Belwal, R. C., & Gupta, A. K. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-022-03722-2 · Cited by 1
EPR: a Neural Network for Automatic Feature Learning from Code for Defect Prediction
Fang, D., Liu, S., & Ai, L. (2021) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs54544.2021.00059 · Cited by 1
Schnappinger, M., Zachau, S., Fietzke, A., & Pretschner, A. (2022) · Lecture notes in business information processing · doi:10.1007/978-3-031-04115-0_4 · Cited by 3
Fine-Grained Analysis of Similar Code Snippets
Carbonnel, J., Famelis, M., & Sahraoui, H. A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-08129-3_1 · Cited by 4
NNSMT: Deep Neural Networks for SMT Solvers Fuzzing
Yan, Z., Wang, Y., & Xu, H. (2022) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1145/3532213.3532221 · Cited by 1
Cross-Project Transfer Learning on Lightweight Code Semantic Graphs for Defect Prediction
Fang, D., Liu, S., & Li, Y. (2023) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194023500262 · Cited by 1
A Semantic and Structural Transformer for Code Summarization Generation
Ji, R., Tong, Z., Luo, T., Liu, J., & Zhang, L. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191735 · Cited by 1
Automation of Software Code Analysis Using Machine Learning Methods
Moshkin, V., Dyrnochkin, A., & Yarushkina, N. G. (2023) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661823030318 · Cited by 1
Intelligent Program Correction and Evaluation System
Ganguli, I., Bhowmick, R. S., Biswas, S., & Sil, J. (2023) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213023500719 · Cited by 2
Comparing Programming Language Models for Design Pattern Recognition
Pandey, S. K., Staron, M., Horkoff, J., Ochodek, M., & Durisic, D. (2024) · IEEE International Conference on Software Architecture Companion (ICSA-C) · doi:10.1109/icsa-c63560.2024.00041 · Cited by 1
Research on Compressed Input Sequences Based on Compiler Tokenization
Li, Z., & Lu, X. (2025) · Information · doi:10.3390/info16020073 · Cited by 1
A code completion approach combining pointer network and Transformer-XL network
Zhang, X., Liu, J., Long, T., & Hu, H. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06315-6 · Cited by 2
Advancing code completion through rotary position embedding
Yin, Y., Liu, J., Liu, Y., & Deng, J. (2025) · Cluster Computing · doi:10.1007/s10586-024-05015-z · Cited by 1
EmbeddedKittens: An Evaluation of Code Embeddings for ScratchPreprint
Fein, B., & Fraser, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.19291 · Cited by 1
SRTEF: Automatic Test Function Recommendation with Scenarios for Implementing Stepwise Test Case
Liu, K., Wu, J. T., Yang, H., Sun, Q., & Wan, R. (2021) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs54544.2021.00115
Represent Code as Action Sequence for Predicting Next Method Call
Jiang, Y., Wang, L., Hu, H., & Tao, X. (2022) · Asia-Pacific Symposium on Internetware · doi:10.1145/3545258.3545263
A Pragmatic Approach to Syntax Repair
Considine, B. (2023) · ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity (SPLASH) · doi:10.1145/3618305.3623591
A Code Completion Approach Combining Pointer Network and Transformer-XL Network
Zhang, X., Liu, J., Long, T., & Hu, H. (2024) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-54521-4_17
Re2GCC: Retrieve-Rerank-Generate Framework for Code Completion
Du, S., Wang, Q., & Jia, D. (2023) · International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR) · doi:10.1109/aihcir61661.2023.00020
Krasniqi, R. (2024) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc2332577
Wen, D., Liu, D., Zheng, Y., Jiang, H., & Lin, H. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5672-8_20
Nagender, Y., Ravichand, M., Kocherlakota, N., Mary, S. S. C., Bharathi, S. K., & Kalaivaani, P. C. D. (2024) · Smart innovation, systems and technologies · doi:10.1007/978-981-97-2716-2_23
A Combined Approach of Program Analysis and Deep Learning for Code Completion
Liu, Y. (2024) · Scientific Journal of Technology · doi:10.54691/hkyc3a89
Rethinking the Role of Structural Information: How It Enhances Code Representation Learning?
Sun, Q., Chen, N., Wang, J., & Li, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651132 · Cited by 2
The role of surprisal in issue trackers
Caddy, J., Treude, C., Wagner, M., & Barr, E. T. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10587-w
Self-citationCode Search Oriented Node-Enhanced Control Flow Graph Embedding
Xu, Y., & Peng, W. (2024) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam63643.2024.00016
Revitalizing Language Processing with Intelligent Syntax Repair and Boolean Tensor Completion
Joshi, A. N. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825203
UNA: Improving Automated PL-NL System by A Unified Neural Architecture
Yuan, D., Zhang, T., & Jiang, H. (2025) · IEEE Transactions on Reliability · doi:10.1109/tr.2025.3541087
White-box structure analysis of pre-trained language models of code for effective attacking
Liu, C., Ren, X., & Xue, Y. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107730
Metadata
- Authors
- Hindle, A., Barr, E. T., Gabel, M., Su, Z., & Devanbu, P.
- Affiliations
- University of Alberta (CA)
- University College London (GB)
- University of California, Davis (US)
- UC Davis, CA
- Venue
- Communications of the ACM
- Published
- 2016-04-26
- Volume
- 59
- Issue
- 5
- Pages
- 122-131
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2344444819
- Cited by
- 307
- References
- 56
- Citations by year
- 2026: 34 · 2025: 58 · 2024: 48 · 2023: 45 · 2022: 66 · 2021: 26 · 2020: 16 · 2019: 5 · 2018: 6 · 2017: 2 · 2016: 1
- FWCI
- 10.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communications of the ACM (publishedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/J017515/1)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- statistical language models, n-gram language models, code completion, Java, eclipses, software engineering support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.