On the naturalness of software
The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Abstract
Natural languages like English are rich, complex, and powerful. The highly creative and graceful use of languages like English and Tamil, by masters like Shakespeare and Avvaiyar, can certainly delight and inspire. But in practice, given cognitive constraints and the exigencies of daily life, most human utterances are far simpler and much more repetitive and predictable. In fact, these utterances can be very usefully modeled using modern statistical methods. This fact has led to the phenomenal success of statistical approaches to speech recognition, natural language translation, question-answering, and text mining and comprehension. We begin with the conjecture that most software is also natural, in the sense that it is created by humans at work, with all the attendant constraints and limitations - and thus, like natural language, it is also likely to be repetitive and predictable. We then proceed to ask whether a) code can be usefully modeled by statistical language models and b) such models can be leveraged to support software engineers. Using the widely adopted n-gram model, we provide empirical evidence supportive of a positive answer to both these questions. We show that code is also very repetitive, and in fact even more so than natural languages. As an example use of the model, we have developed a simple code completion engine for Java that, despite its simplicity, already improves Eclipse's built-in completion capability. We conclude the paper by laying out a vision for future research in this area.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The IntelliCode Compose system uses the term click through rate (CTR) for this and reports a value of 10% in online trials.20”
From Measuring GitHub Copilot's Impact on Productivity (2024) · cites this paper as [20]
In the citing paper
“It's been well-known right from the outset that language modeling for code has to deal with project-specific phenomena [10,11,22].”
From Few-shot training LLMs for project-specific code-summarization (2022) · cites this paper as [11]
Citations
Cites
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
Recovering traceability links between code and documentation
Antoniol, G., Canfora, G., Casazza, G., De Lucia, A., & Merlo, E. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1041053 · Cited by 967
Statistical Machine Translation
Koehn, P. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815829 · Cited by 871
Towards automatically generating summary comments for Java methods
Sridhara, G., Hill, E., Muppaneni, D., Pollock, L., & Vijay-Shanker, K. (2010) · Proceedings of the IEEE/ACM international conference on Automated software engineering · doi:10.1145/1858996.1859006 · Cited by 514
Jungloid mining: helping to navigate the API jungle
Mandelin, D., Xu, L., Bodík, R., & Kimelman, D. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065018 · Cited by 388
Learning from examples to improve code completion systems
Bruch, M., Monperrus, M., & Mezini, M. (2009) · Proceedings of the 7th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering · doi:10.1145/1595696.1595728 · Cited by 378
Mining version histories to guide software changes
Zimmermann, T., Weibgerber, P., Diehl, S., & Zeller, A. (2004) · Proceedings. 26th International Conference on Software Engineering · doi:10.1109/icse.2004.1317478 · Cited by 322
Statistical language model adaptation: review and perspectives
Bellegarda, J. R. (2004) · Speech Communication · doi:10.1016/j.specom.2003.08.002 · Cited by 297
Cited by
Items 501–600 of 834
Representing Programs with Dependency and Function Call Graphs for Learning Hierarchical Embeddings
Romanov, V., Ivanov, V. V., & Succi, G. (2020) · International Conference on Enterprise Information Systems · doi:10.5220/0009511803600366 · Cited by 6
RAPID: a knowledge-based assistant for designing web APIs
Sadi, M. H., & Yu, E. S. K. (2021) · Requirements Engineering · doi:10.1007/s00766-020-00342-0 · Cited by 6
Revisiting ssFix for Better Program RepairPreprint
Qi, X., & Reiss, S. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.04583 · Cited by 6
Embedding Code Contexts for Cryptographic API Suggestion:New Methodologies and ComparisonsPreprint
Xiao, Y., Ahmed, S., Song, W., Ge, X., Viswanath, B., & Yao, D. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08747 · Cited by 6
Code Reasoning for Software Engineering Tasks: A Survey and A Call to Action
Pujar, S., Ceka, I., Manotas, I., Kaiser, G. E., Ray, B., & Ramji, S. (2025) · Transactions on machine learning research · doi:10.48550/arxiv.2506.13932 · Cited by 6
Security Evaluations of GitHub's Copilot
Asare, O. (2023) · UWSpace (University of Waterloo) · Cited by 6
Retrospective: Data Mining Static Code Attributes to Learn Defect Predictors
Menzies, T. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3537406 · Cited by 5
Boosting Redundancy-Based Automated Program Repair by Fine-Grained Pattern Mining
Jiang, J., Li, F., Zhao, Z., Ye, Z., Liu, M., Wang, B., Zhang, H., & Chen, J. (2025) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme64153.2025.00018 · Cited by 5
Configuring and Assembling Information Retrieval Based Solutions for Software Engineering Tasks
Dit, B. (2016) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2016.85 · Cited by 5
Semantic Understanding of Source and Binary Code based on Natural Language Processing
Zhang, Z., Liu, S., Yang, Q., & Guo, S. (2021) · IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC) · doi:10.1109/imcec51613.2021.9482032 · Cited by 5
Helion: Enabling Natural Testing of Smart Homes
Mandal, P., Manandhar, S., Kafle, K., Moran, K., Poshyvanyk, D., & Nadkarni, A. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3613095 · Cited by 5
Do developer perceptions have borders? Comparing C code responses across continents
Zhuang, Y., Yu, Y., DeLong, L. A., & Yeh, M. K. ‐. (2023) · Software Quality Journal · doi:10.1007/s11219-023-09654-0 · Cited by 5
How Well Can Masked Language Models Spot Identifiers That Violate Naming Guidelines?
Villmow, J., Campos, V., Petry, J., Andaloussi, A. A., Ulges, A., & Weber, B. (2023) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam59687.2023.00023 · Cited by 5
MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain
Pašek, J., Sido, J., Konopík, M., & Pražák, O. (2023) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-092-2_089 · Cited by 5
RWKV-based Encoder-Decoder Model for Code Completion
Zhou, L., Xiao, Z., & Ning, Z. (2023) · International Conference on Electronic Information Engineering and Computer Technology (EIECT) · doi:10.1109/eiect60552.2023.10442108 · Cited by 5
An empirical study of end-user programmers in the computer music community
Burlet, G., & Hindle, A. (2015) · Mining Software Repositories · doi:10.5555/2820518.2820554 · Cited by 5
Self-citationNext Syntactic-Unit Code Completion and Applications
Nguyen, A. T., Yadavally, A., & Nguyen, T. N. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3559544 · Cited by 5
Pointing to Subwords for Generating Function Names in Source Code
Fujita, S., Kamigaito, H., Takamura, H., & Okumura, M. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.28 · Cited by 5
A replication of ‘DeepBugs: a learning approach to name-based bug detection’
Winkler, J., Agarwal, A., Tung, C., Ugalde, D. R., Jung, Y., & Davis, J. C. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3477221 · Cited by 5
Code Naturalness to Assist Search Space Exploration in Search-Based Program Repair Methods
Dantas, A., de Souza, E. F., Souza, J., & Camilo-Junior, C. G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27455-9_12 · Cited by 5
Using Sequence-to-Sequence Learning for Repairing C VulnerabilitiesPreprint
Chen, Z., Kommrusch, S., & Monperrus, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.02015 · Cited by 5
Learning to Extend Program Graphs to Work-in-Progress CodePreprint
Li, X., Maddison, C. J., & Tarlow, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.14038 · Cited by 5
Borrowing from Similar Code: A Deep Learning NLP-Based Approach for Log Statement AutomationPreprint
Gholamian, S., & Ward, P. A. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.01259 · Cited by 5
Detection of security smells in IaC scripts through semantics-aware code and language processingPreprint
War, A., Rawass, A. A., Kaboré, A. K., Samhi, J., Klein, J., & Bissyandé, T. F. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.18790 · Cited by 5
Taba, S. E. S. (2014) · QSpace (Queen's University Library) · Cited by 5
Echoes of AI: Investigating the downstream effects of AI assistants on software maintainability
Borg, M., Hewett, D., Hagatulah, N., Couderc, N., Söderberg, E., Graham, D., Kini, U., & Farley, D. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10889-1 · Cited by 4
Valdivia, J., Mauricio, D., & Jiménez, R. M. G. (2026) · IEEE Access · doi:10.1109/access.2026.3659713 · Cited by 4
Is Hyper-Parameter Optimization Different for Software Analytics?
Yedida, R., & Menzies, T. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3550103 · Cited by 4
Rethinking the Capability of Fine-Tuned Language Models for Automated Vulnerability Repair
Han, W., Kwak, Y., Yu, M., Kim, K., Lee, Y., Moon, H., & Paek, Y. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773167 · Cited by 4
Complexity: Let's Not Make This Complicated
Hindle, A. (2019) · IEEE Software · doi:10.1109/ms.2018.2883875 · Cited by 4
Self-citationSoftware Defect Prediction via Multi-Channel Convolutional Neural Network
Chen, L., Li, J., & Kobayashi, T. (2021) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs54544.2021.00065 · Cited by 4
Bug localization based on syntactical and semantic information of source code
Yan, X., Cheng, S., & Guo, L. (2023) · Journal of Systems Engineering and Electronics · doi:10.23919/jsee.2023.000010 · Cited by 4
Liu, Y., & Wang, Y. (2022) · International Symposium on Big Data and Artificial Intelligence (ISBDAI) · doi:10.1145/3598438.3598452 · Cited by 4
Software Defect Prediction using Multi-scale Structural Information
Tang, F., & He, P. (2023) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1145/3594315.3594371 · Cited by 4
Improving Fitness Function for Language Fuzzing with PCFG Model
Sun, X., Fu, Y. V., Dong, Y., Liu, Z., & Zhang, Y. (2018) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2018.00098 · Cited by 4
Defining and Extracting Singleton Design Pattern Information from Object-Oriented Software Program
Nacef, A., Khalfallah, A., Bahroun, S., & Ahmed, S. B. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-16210-7_58 · Cited by 4
GLAD: Neural Predicate Synthesis to Repair Omission Faults
Kang, S., & Yoo, S. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion58688.2023.00087 · Cited by 4
Field experience with obfuscating million‐user iOS apps in large enterprise mobile development
Wang, P., Wu, D., Chen, Z., & Wei, T. (2018) · Software Practice and Experience · doi:10.1002/spe.2648 · Cited by 4
A Neural Language Model with a Modified Attention Mechanism for Software Code
Zhang, X., & Ben, K. (2018) · IEEE International Conference on Software Engineering and Service Science (ICSESS) · doi:10.1109/icsess.2018.8663962 · Cited by 4
Natural Language Processing Techniques for Code Generation
Sellik, H. (2019) · Research Repository (Delft University of Technology) · Cited by 4
D-REX: Static Detection of Relevant Runtime Exceptions with Location Aware Transformer
Farmahinifarahani, F., Lu, Y., Saini, V., Baldi, P., & Lopes, C. V. (2021) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam52516.2021.00032 · Cited by 4
Combining CNN with DS3 for Detecting Bug-prone Modules in Cross-version Projects
Fiore, A., Russo, A., Gravino, C., & Risi, M. (2021) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa53835.2021.00021 · Cited by 4
Tree-based Mining of Fine-grained Code Changes to Detect Unknown Change Patterns
Higo, Y., Matsumoto, J., & Kusumoto, S. (2021) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec53868.2021.00014 · Cited by 4
AdaComplete: improve DL-based code completion method’s domain adaptability
Wang, Z., Liu, F., Hao, Y., & Jin, Z. G. (2023) · Automated Software Engineering · doi:10.1007/s10515-023-00376-y · Cited by 4
Predicting Next Changes at the Fine-Grained Level
Murakami, H., Hotta, K., Higo, Y., & Kusumoto, S. (2014) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2014.27 · Cited by 4
Summary - TerpreT: A Probabilistic Programming Language for Program InductionPreprint
Gaunt, A. L., Brockschmidt, M., Singh, R., Kushman, N., Kohli, P., Taylor, J., & Tarlow, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00817 · Cited by 4
Data-Driven Techniques for Type Error Diagnosis
Seidel, E. L. (2017) · eScholarship (California Digital Library) · Cited by 4
On the Lexical Distinguishability of Source CodePreprint
Velez, M., Qiu, D., Zhou, Y., Barr, E. T., & Su, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.01410 · Cited by 4
Self-citationAre My Invariants Valid? A Learning ApproachPreprint
Hellendoorn, V. J., Dévanbu, P., Polozov, O., & Marron, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.06089 · Cited by 4
On the "Naturalness" of Buggy CodePreprint
Ray, B., Hellendoorn, V. J., Godhane, S., Tu, Z., Bacchelli, A., & Dévanbu, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.01159 · Cited by 4
Profiling Software Developers with Process Mining and N-Gram Language ModelsPreprint
Caldeira, J., Abreu, F. B. E., Cardoso, J., Ribeiro, R., & Werner, C. M. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06733 · Cited by 4
AugmentedCode: Examining the Effects of Natural Language Resources in Code Retrieval ModelsPreprint
Bahrami, M., Shrikanth, N. C., Mizobuchi, Y., Liu, L., Fukuyori, M., Chen, W., & Munakata, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08512 · Cited by 4
LLMs are Bug Replicators: An Empirical Study on LLMs' Capability in Completing Bug-prone CodePreprint
Guo, L., Ye, S., Sun, Z., Chen, X., Zhang, Y., Wang, B., Zhang, J. M., Li, Z., & Liu, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.11082 · Cited by 4
Zhou, Y., Tang, H., Zhu, L., Ding, H., & Qian, J. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3707456 · Cited by 3
Why Personalizing Deep Learning-Based Code Completion Tools Matters
Giagnorio, A., Martin-Lopez, A., & Bavota, G. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3725732 · Cited by 3
Li, Y., Zhong, W., Shen, Z., Li, C., Chen, X., Ge, J., & Luo, B. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00502-y · Cited by 3
The fools are certain; the wise are doubtful: Exploring LLM confidence in code completion
Kotti, Z., Dritsa, K., Spinellis, D. D., & Λουρίδας, Π. (2026) · Automated Software Engineering · doi:10.21203/rs.3.rs-7302683/v1 · Cited by 3
Package-Aware Approach for Repository-Level Code Completion in Pharo
AbedelKader, O., Ducasse, S., Zaitsev, O., Robbes, R., & Polito, G. (2026) · Agritrop (Cirad) · doi:10.48550/arxiv.2601.05617 · Cited by 3
Mundhra, Y., Valk, M., & Izadi, M. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00287 · Cited by 3
Challenges of deploying code embeddings: an industrial case study on method name generation
Fein, B., Jungwirth, M., Fraser, G., & Kandlinger, F. (2026) · Automated Software Engineering · doi:10.1007/s10515-026-00592-2 · Cited by 3
Lexical content as a cooperation aide: A study based on Java software
Capiluppi, A., & Ajienka, N. (2020) · Journal of Systems and Software · doi:10.1016/j.jss.2020.110543 · Cited by 3
Automation of Program Code Analysis Using Machine Learning Methods
Moshkin, V., Kalachev, V., & Александрович, З. А. (2022) · International Russian Automation Conference (RusAutoCon) · doi:10.1109/rusautocon54946.2022.9896360 · Cited by 3
Code Vulnerability Detection via Signal-Aware Learning
Suneja, S., Zhuang, Y., Zheng, Y., Laredo, J., Morari, A., & Khurana, U. (2023) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp57164.2023.00037 · Cited by 3
Yu, Y., Huang, Z., Shen, G., Li, W., & Shao, Y. (2023) · Science China Information Sciences · doi:10.1007/s11432-021-3665-1 · Cited by 3
A Comparative Study of Commit Representations for JIT Vulnerability Prediction
Aladics, T., Hegedűs, P., & Ferenć, R. (2024) · Computers · doi:10.3390/computers13010022 · Cited by 3
Deep Learning-Based Code Completion: On the Impact on Performance of Contextual Information
Ciniselli, M., Pascarella, L., & Bavota, G. (2024) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58944.2024.00029 · Cited by 3
Contextual Augmented Multi-Model Programming (CAMP): A Local-Cloud Copilot Solution
Wang, Y., Guo, S., & Tan, C. W. (2025) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai64502.2025.00122 · Cited by 3
Exploring the Impact of Vocabulary Techniques on Code Completion: A Comparative Approach
Hussain, Y., Huang, Z., Zhou, Y., & Khan, I. A. (2023) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194023500687 · Cited by 3
Learning AI Coding Style for Software Plagiarism Detection
Ambati, S. H., Stakhanova, N., & Branca, E. (2024) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-64954-7_24 · Cited by 3
Towards Framework-Independent, Non-Intrusive Performance Characterization for Dataflow Computation
Tian, H., Weng, Q., & Wang, W. (2019) · ACM SIGOPS Asia-Pacific Workshop on Systems (APSys) · doi:10.1145/3343737.3343743 · Cited by 3
Barr, E. T., & Dévanbu, P. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-804206-9.00010-6 · Cited by 3
Self-citationCode Component Retrieval Using Code2Vec
Ramyasree, B., Ramakrishna, B., Harshitha, M., Kavya, A., Reshvanth, P., & Rao, N. V. K. (2021) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac52330.2021.9640648 · Cited by 3
Seq2Seq or Seq2Tree: Generating Code Using Both Paradigms via Mutual Learning
Zhao, Y., Dong, Y., & Li, G. (2023) · Asia-Pacific Symposium on Internetware · doi:10.1145/3609437.3609465 · Cited by 3
Generación automática de códigofuente a través de Modelos Preentrenados de Lenguaje
Bender, A., Nicolet, S., Folino, P., Lopez, J. J., & Hansen, G. (2023) · SADIO Electronic Journal of Informatics and Operations Research · doi:10.24215/15146774e002 · Cited by 3
Searching for missing library function calls using machine learning
Yakimov, I. A., & Кузнецов, А. С. (2017) · Proceedings of the Institute for System Programming of RAS · doi:10.15514/ispras-2017-29(6)-6 · Cited by 3
Dynamic and Interactive Synthesis of Code Snippets
Galenson, J. (2014) · UC Berkeley · Cited by 3
Recognizing Handwritten Source CodePreprint
Zhi, Q., & Metoyer, R. (2017) · arXiv (Cornell University) · doi:10.20380/gi2017.21 · Cited by 3
Location of Features as Model Fragments and their Co-Evolution
Burdeus, J. F. (2017) · NORA - Norwegian Open Research Archives · Cited by 3
Yang, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08080 · Cited by 3
On-the-Fly Adaptation of Source Code Models using Meta-LearningPreprint
Shrivastava, D., Larochelle, H., & Tarlow, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11768 · Cited by 3
Automatically assessing and improving code readability and understandability
Scalabrino, S. (2019) · Archivio Istituzionale della Ricerca - Università degli Studi del Molise · Cited by 3
An Empirical Study on Bash Language Usage in Github
Li, Z. (2021) · UWSpace (University of Waterloo) · Cited by 3
Sahar, H., Liu, Y., Hindle, A., & Barbosa, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10789 · Cited by 3
Self-citationDeepMutants: Training neural bug detectors with contextual mutationsPreprint
Richter, C., & Wehrheim, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06657 · Cited by 3
Salmon, A., Hammer, K., Santos, E. A., & Becker, B. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.05706 · Cited by 3
Modeling Source Code For Developers
Jesse, K. (2023) · eScholarship (California Digital Library) · Cited by 3
Proksch, S. (2017) · Technischen Universität Darmstadt · doi:10.26083/tuprints-00006971 · Cited by 3
Extraction and analysis of knowledge for automatic software repair
Martínez, M. (2014) · theses.fr (ABES) · doi:10.70675/8804cf18zf1d9z4ab7z889fzf941251065f7 · Cited by 3
A Statistical Method for API Usage Learning and API Misuse Violation Finding
Panda, D., Basia, P., Nallavolu, K., Zhong, X. R., Siy, H. P., & Song, M. (2023) · IEEE/ACIS International Conference on Software Engineering Research, Management and Applications (SERA) · doi:10.1109/sera57763.2023.10197708 · Cited by 2
Artificial Intelligence (AI) – based strategies for point cloud data and digital twins
Aftab, I., Dowajy, M., Kapitány, K., & Lovas, T. (2023) · Nova Geodesia · doi:10.55779/ng33138 · Cited by 2
A Naive Approach for Automatic Line-level Code Completion
Naznin, S., & Mondal, M. (2023) · IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE) · doi:10.1109/wiecon-ece60392.2023.10456476 · Cited by 2
The Evolution of Automated Software Repair
Goues, C. L., Nguyen, T. H., Forrest, S., & Weimer, W. R. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3533309 · Cited by 2
Teaching LLMs a Low-Resource Language: Enhancing Code Completion in Pharo
Kier, K., Giagnorio, A., AbedelKader, O., Zaitsev, O., Peharz, R., Robbes, R., Bavota, G., & Ducasse, S. (2026) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme67971.2026.00035 · Cited by 2
Do Language Models Prefer Vulnerable Code? A Probabilistic Study of Insecure Code Preference
Melo, R., Reis, S., Catarino, A., & Abreu, R. (2026) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst69053.2026.00075 · Cited by 2
Building Statistical Language Models of code
Schulam, P., Rosenfeld, R., & Dévanbu, P. (2013) · doi:10.1109/dapse.2013.6603797 · Cited by 2
Towards a Universal Python: Translating the Natural Modality of Python into Other Human Languages
Otten, J., Anastasopoulos, A., & Moran, K. (2023) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58846.2023.00044 · Cited by 2
Data-Driven Decisions and Actions in Today’s Software Development
Gall, H. C., Alexandru, C. V., Ciurumelea, A., Grano, G., Laaber, C., Panichella, S., Proksch, S., Schermann, G., Vassallo, C., & Zhao, J. (2018) · Springer eBooks · doi:10.1007/978-3-319-73897-0_9 · Cited by 2
Linguistic Change in Open Source Software
Tushev, M., Khatiwada, S., & Mahmoud, A. (2019) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2019.00045 · Cited by 2
Using API-Embedding for API-Misuse Repair
Nielebock, S., Heumüller, R., Krüger, J., & Ortmeier, F. (2020) · doi:10.1145/3387940.3392171 · Cited by 2
Metadata
- Authors
- Hindle, A., Barr, E. T., Su, Z., Gabel, M., & Devanbu, P.
- Affiliations
- University of California, Davis (US)
- The University of Texas at Dallas (US)
- Venue
- 2012 34th International Conference on Software Engineering (ICSE)
- Publisher
- IEEE
- Published
- 2012-06
- Pages
- 837-847
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W3146720657
- Cited by
- 425
- References
- 39
- Citations by year
- 2026: 19 · 2025: 24 · 2024: 36 · 2023: 44 · 2022: 49 · 2021: 50 · 2020: 48 · 2019: 46 · 2018: 22 · 2017: 35 · 2016: 13 · 2015: 23 · 2014: 2 · 2013: 14
- FWCI
- 9.81
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- statistical language models, n-gram language models, code completion, Java, eclipses, software engineering support, natural language modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.