On the naturalness of software
The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Abstract
Natural languages like English are rich, complex, and powerful. The highly creative and graceful use of languages like English and Tamil, by masters like Shakespeare and Avvaiyar, can certainly delight and inspire. But in practice, given cognitive constraints and the exigencies of daily life, most human utterances are far simpler and much more repetitive and predictable. In fact, these utterances can be very usefully modeled using modern statistical methods. This fact has led to the phenomenal success of statistical approaches to speech recognition, natural language translation, question-answering, and text mining and comprehension. We begin with the conjecture that most software is also natural, in the sense that it is created by humans at work, with all the attendant constraints and limitations - and thus, like natural language, it is also likely to be repetitive and predictable. We then proceed to ask whether a) code can be usefully modeled by statistical language models and b) such models can be leveraged to support software engineers. Using the widely adopted n-gram model, we provide empirical evidence supportive of a positive answer to both these questions. We show that code is also very repetitive, and in fact even more so than natural languages. As an example use of the model, we have developed a simple code completion engine for Java that, despite its simplicity, already improves Eclipse's built-in completion capability. We conclude the paper by laying out a vision for future research in this area.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The IntelliCode Compose system uses the term click through rate (CTR) for this and reports a value of 10% in online trials.20”
From Measuring GitHub Copilot's Impact on Productivity (2024) · cites this paper as [20]
In the citing paper
“It's been well-known right from the outset that language modeling for code has to deal with project-specific phenomena [10,11,22].”
From Few-shot training LLMs for project-specific code-summarization (2022) · cites this paper as [11]
Citations
Cites
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
Recovering traceability links between code and documentation
Antoniol, G., Canfora, G., Casazza, G., De Lucia, A., & Merlo, E. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1041053 · Cited by 967
Statistical Machine Translation
Koehn, P. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815829 · Cited by 871
Towards automatically generating summary comments for Java methods
Sridhara, G., Hill, E., Muppaneni, D., Pollock, L., & Vijay-Shanker, K. (2010) · Proceedings of the IEEE/ACM international conference on Automated software engineering · doi:10.1145/1858996.1859006 · Cited by 514
Jungloid mining: helping to navigate the API jungle
Mandelin, D., Xu, L., Bodík, R., & Kimelman, D. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065018 · Cited by 388
Learning from examples to improve code completion systems
Bruch, M., Monperrus, M., & Mezini, M. (2009) · Proceedings of the 7th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering · doi:10.1145/1595696.1595728 · Cited by 378
Mining version histories to guide software changes
Zimmermann, T., Weibgerber, P., Diehl, S., & Zeller, A. (2004) · Proceedings. 26th International Conference on Software Engineering · doi:10.1109/icse.2004.1317478 · Cited by 322
Statistical language model adaptation: review and perspectives
Bellegarda, J. R. (2004) · Speech Communication · doi:10.1016/j.specom.2003.08.002 · Cited by 297
Cited by
Items 401–500 of 834
DLTPy: Deep Learning Type Inference of Python Function Signatures using Natural Language ContextPreprint
Boone, C., de Bruin, N., Langerak, A., & Stelmach, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00680 · Cited by 13
Exploring Research Interest in Stack Overflow -- A Systematic Mapping Study and Quality EvaluationPreprint
Meldrum, S., Licorish, S. A., & Savarimuthu, B. T. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12282 · Cited by 13
Beep: Fine-grained Fix Localization by Learning to Predict Buggy Code ElementsPreprint
Wang, S., Liu, K., Lin, B., Mao, X., Bissyandé, T. F., Li, L., & Klein, J. (2021) · arXiv (Cornell University) · doi:10.13140/rg.2.2.25272.26884 · Cited by 13
On the Uniqueness of Code Redundancies
Lin, B., Ponzanelli, L., Mocci, A., Bavota, G., & Lanza, M. (2017) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2017.36 · Cited by 12
Fostering the diversity of exploratory testing in web applications
Leveau, J., Blanc, X., Réveillère, L., Falleri, J., & Rouvoy, R. (2022) · Software Testing Verification and Reliability · doi:10.1002/stvr.1827 · Cited by 12
Analyzing source code vulnerabilities in the D2A dataset with ML ensembles and C-BERT
Pujar, S., Zheng, Y., Buratti, L., Lewis, B. L., Chen, Y. Q., Laredo, J., Morari, A., Epstein, E., Lin, T.-N., Yang, B. S., et al. (2024) · Empirical Software Engineering · doi:10.1007/s10664-023-10405-9 · Cited by 12
Self-citationFrom API to NLI: A new interface for library reuse
Shen, Q., Wu, S., Zou, Y., Zhu, Z., & Xie, B. (2020) · Journal of Systems and Software · doi:10.1016/j.jss.2020.110728 · Cited by 12
Code Authors Hidden in File Revision Histories: An Empirical Study
Gong, S., & Zhong, H. (2021) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc52881.2021.00016 · Cited by 12
Implant Global and Local Hierarchy Information to Sequence based Code Representation Models
Zhang, K., Li, Z., Jin, Z. G., & Li, G. (2023) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc58990.2023.00030 · Cited by 12
Chen, Z., Kwon, Y., & Song, M. (2018) · Journal of Software Evolution and Process · doi:10.1002/smr.1951 · Cited by 12
The Metric for Automatic Code Generation
Li, Z., Jiang, Y., Zhang, X. J., & Xu, H. Y. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.02.099 · Cited by 12
What Distributed Systems Say: A Study of Seven Spark Application Logs
Gholamian, S., & Ward, P. A. S. (2021) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds53918.2021.00030 · Cited by 12
Toward Semantic Foundations for Program Editors
Omar, C., Voysey, I., Hilton, M., Sunshine, J. S., Goues, C. L., Aldrich, J., & Hammer, M. A. (2017) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.snapl.2017.11 · Cited by 12
Estimating defectiveness of source code: A predictive model using GitHub contentPreprint
Kapur, R., & Sodhi, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.07764 · Cited by 12
Tkachenko, A., Suskevic, D., & Adolphi, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.19887 · Cited by 12
When Names Disappear: Revealing What LLMs Actually Understand About CodePreprint
Le, C. C., Pham, M. V. T., Van, C. D., Phan, H. N., Phan, H. N., & Nguyen, T. N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.03178 · Cited by 12
Meta-RAG on Large Codebases Using Code SummarizationPreprint
Tawosi, V., Alamir, S., Liu, X., & Veloso, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.02611 · Cited by 12
On LLMs’ Internal Representation of Code Correctness
Ribeiro, F., Spiess, C., Devanbu, P., & Nadi, S. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3787846 · Cited by 11
Self-citationLiu, J., Zhu, X., Liu, C., Cui, X., & Liu, Q. (2022) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom56396.2022.00046 · Cited by 11
Pre-implementation Method Name Prediction for Object-oriented Programming
Wang, S., Wen, M., Lin, B., Liu, Y., Bissyandé, T. F., & Mao, X. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3597203 · Cited by 11
Which Syntactic Capabilities Are Statistically Learned by Masked Language Models for Code?
Velasco, A., Palacio, D. N., Rodríguez-Cárdenas, D., & Poshyvanyk, D. (2024) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1145/3639476.3639768 · Cited by 11
Dependency-Aware Code Naturalness
Yang, C., Chen, J., Jiang, J., & Huang, Y. (2024) · Proceedings of the ACM on Programming Languages · doi:10.1145/3689794 · Cited by 11
Neural language models for code quality identification
Sengamedu, S. H., & Zhao, H. (2022) · doi:10.1145/3549034.3561175 · Cited by 11
Fitting missing API puzzles with machine translation techniques
Nguyen, P. T., Sipio, C. D., Rocco, J. D., Ruscio, D. D., & Penta, M. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119477 · Cited by 12
A language-agnostic model for semantic source code labeling
Gelman, B., Hoyle, B., Moore, J., Saxe, J., & Slater, D. (2018) · doi:10.1145/3243127.3243132 · Cited by 11
Fostering the Diversity of Exploratory Testing in Web Applications
Leveau, J., Blanc, X., Réveillère, L., Falleri, J., & Rouvoy, R. (2020) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst46399.2020.00026 · Cited by 11
Heuristic and Neural Network Based Prediction of Project-Specific API Member Access
Jiang, L. C., Liu, H., Jiang, H., Zhang, L., & Hong, M. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3017794 · Cited by 11
Learning Off-By-One Mistakes: An Empirical Study
Sellik, H., van Paridon, O., Gousios, G., & Aniche, M. F. (2021) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr52588.2021.00019 · Cited by 11
Conclusion stability for natural language based mining of design discussions
Mahadi, A., Ernst, N., & Tongay, K. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-10009-1 · Cited by 11
JSEA: A Program Comprehension Tool Adopting LDA-based Topic Modeling
Wang, T., & Liu, Y. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.080359 · Cited by 11
Dai, P., Zhu, H., Wu, J., & He, H. (2025) · Scientific Reports · doi:10.1038/s41598-025-31209-5 · Cited by 10
Which Exception Shall We Throw?
Zhong, H. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3556895 · Cited by 10
IRJIT: A simple, online, information retrieval approach for just-in-time software defect prediction
Sahar, H., Bangash, A. A., Hindle, A., & Barbosa, D. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10514-z · Cited by 10
Self-citationDeep Generation of Coq Lemma Names Using Elaborated Terms
Nie, P., Palmskog, K., Li, J. J., & Gligoric, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-51054-1_6 · Cited by 10
Hussain, Y., Huang, Z., & Zhou, Y. (2021) · IET Software · doi:10.1049/sfw2.12017 · Cited by 10
Fine-Grained Obfuscation Scheme Recognition on Binary Code
Tian, Z., Mao, H., Huang, Y., Tian, J., & Li, J. (2022) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-06365-7_13 · Cited by 10
Boosting source code suggestion with self-supervised Transformer Gated Highway
Hussain, Y., Huang, Z., Zhou, Y., & Wang, S. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111553 · Cited by 10
Yang, Y., & Chen, X. (2019) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2019-056 · Cited by 10
Exploring Type Inference Techniques of Dynamically Typed Languages
Saifullah, C. M. K., Asaduzzaman, M., & Roy, C. K. (2020) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner48275.2020.9054814 · Cited by 10
Deep-AutoCoder: Learning to Complete Code Precisely with Induced Code Tokens
Hu, X., Men, R., Li, G., & Jin, Z. G. (2019) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2019.00030 · Cited by 10
Exploiting Abstract Syntax Trees to Locate Software Defects
Shippey, T. (2015) · University of Hertfordshire Research Archive (University of Hertfordshire) · doi:10.18745/th.16365 · Cited by 10
Adaptive Intellect Unleashed: The Feasibility of Knowledge Transfer in Large Language ModelsPreprint
Huang, Q. Y., Wu, Y., Xing, Z., Jiang, H., Cheng, Y., & Jin, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.04788 · Cited by 10
New Initiative: The Naturalness of Software
Devanbu, P. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.190 · Cited by 9
ReACC: A Retrieval-Augmented Code Completion Framework
Lu, S., Duan, N., Han, H., Guo, D., Hwang, S.-W., & Svyatkovskiy, A. (2022) · arXiv · doi:10.48550/arxiv.2203.07722 · Cited by 96
“With the growth of software engineering field, large-scale source code corpus gives a chance to train language models in code domain (Hindle et al., 2016; Tu et al., 2014).”
MethodGenetic Improvement of Software (Dagstuhl Seminar 18052)
Petke, J., Goues, C. L., Forrest, S., & Langdon, W. B. (2018) · Dagstuhl reports · doi:10.4230/dagrep.8.1.158 · Cited by 9
DeMinify: Neural Variable Name Recovery and Type Inference
Li, Y., Yadavally, A., Zhang, J., Wang, S., & Nguyen, T. N. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616368 · Cited by 9
Enhancing Source Code Representations for Deep Learning with Static Analysis
Guan, X., & Treude, C. (2024) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3643916.3644396 · Cited by 9
On the Generalizability of Deep Learning-based Code Completion Across Programming Language Versions
Ciniselli, M., Martin-Lopez, A., & Bavota, G. (2024) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3643916.3644411 · Cited by 9
Towards Attention Based Vulnerability Discovery Using Source Code Representation
Kim, J., Hubczenko, D., & Montague, P. S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30490-4_58 · Cited by 9
Improving Patch Quality by Enhancing Key Components of Automatic Program Repair
Soto, M. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00147 · Cited by 9
On the naturalness of hardware descriptions
Lee, J., Nie, P., Li, J. J., & Gligoric, M. (2020) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3368089.3409692 · Cited by 9
Sequential coding patterns: How to use them effectively in code recommendation
da Silva, L. L. N., Kohwalter, T. C., Plastino, A., & Murta, L. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106690 · Cited by 9
New Initiative: The Naturalness of Software
Dévanbu, P. (2015) · Cited by 9
Program Synthesis using Natural LanguagePreprint
Desai, A., Gulwani, S., Hingorani, V., Jain, N., Karkare, A., Marron, M., Sailesh, R., & Roy, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.00413 · Cited by 9
Language Modelling for Source Code with Transformer-XLPreprint
Dowdell, T., & Zhang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15813 · Cited by 9
tl;dr: Chill, y’all: AI Will Not Devour SE
Kang, E., & Shaw, M. (2024) · Proceedings of the 2024 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software · doi:10.1145/3689492.3689816 · Cited by 8
Shockingly Simple:"KEYS" for Better AI for SE
Menzies, T. (2021) · IEEE Software · doi:10.1109/ms.2020.3043014 · Cited by 8
SQL-DP:A Novel Difficulty Prediction Framework for SQL Programming Problems
Xu, J., Wei, T., & Lv, P. (2022) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.6852985 · Cited by 8
Mu, W., Xu, L., Pei, S., Mi, L., & Zhou, H. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-9994-0_31 · Cited by 8
Deep learning based searching approach for RDF graphs
Soliman, H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0230500 · Cited by 8
Open-vocabulary models for source code
Karampatsis, R.-M., Babii, H., Robbes, R., Sutton, C. A., & Janes, A. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377812.3390806 · Cited by 8
Promoting social diversity for the automated learning of complex MDE artifacts
Batot, E., & Sahraoui, H. A. (2022) · Software & Systems Modeling · doi:10.1007/s10270-021-00969-9 · Cited by 8
Deep Representations for Software Engineering
White, M. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.248 · Cited by 8
Yang, Y., & Chen, X. (2019) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2019-057 · Cited by 8
Towards the optical character recognition of DSLs
Perianez-Pascual, J., Rodríguez-Echeverría, R., Burgueño, L., & Cabot, J. (2020) · ACM SIGPLAN International Conference on Software Language Engineering (SLE) · doi:10.1145/3426425.3426937 · Cited by 8
DIRE: A Neural Approach to Decompiled Identifier NamingPreprint
Lacomis, J., Yin, P., Schwartz, E. J., Allamanis, M., Goues, C. L., Neubig, G., & Vasilescu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09029 · Cited by 8
Optimizing Large Language Models to Expedite the Development of Smart ContractsPreprint
Dade, N. O. O., Lartey-Quaye, M., Odonkor, E. T.-K., & Ammah, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.05178 · Cited by 8
Entropy Guided Spectrum Based Bug Localization Using Statistical Language Model
Chakraborty, S., Li, Y., Irvine, M., Saha, R., & Ray, B. (2018) · arXiv · doi:10.48550/arxiv.1802.06947 · Cited by 7
Do names echo semantics? A large-scale study of identifiers used in C++’s named casts
Petrescu, C. C., Smith, S., Giavrimis, R., & Dash, S. K. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111693 · Cited by 7
DeepFPD: Browser Fingerprinting Detection via Deep Learning With Multimodal Learning and Attention
Qiang, W., Ren, K., Wu, Y., Zou, D., & Jin, H. (2024) · IEEE Transactions on Reliability · doi:10.1109/tr.2024.3355233 · Cited by 7
Abdelsalam, Y., Peitek, N., Maurer, A.-M., Toneva, M., & Apel, S. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773219 · Cited by 7
Designing of a Voice-Based Programming IDE for Source Code Generation: A Machine Learning Approach
Nizzad, A. R. M., & Thelijjagoda, S. (2022) · International Research Conference on Smart Computing and Systems Engineering (SCSE) · doi:10.1109/scse56529.2022.9905095 · Cited by 7
Naturalness of Attention: Revisiting Attention in Code Language Models
Saad, M., & Sharma, T. (2024) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1145/3639476.3639774 · Cited by 7
Enhancing Code Readability through Automated Consistent Formatting
Kanoutas, T., Karanikiotis, T., & Symeonidis, A. L. (2024) · Electronics · doi:10.3390/electronics13112073 · Cited by 7
Cleaning StackOverflow for Machine Translation
Rahman, M., Rigby, P. C., Palani, D., & Nguyen, T. N. (2019) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2019.00021 · Cited by 7
Suggesting Descriptive Method Names: An Exploratory Study of Two Machine Learning Approaches
Zaitsev, O., Ducasse, S., Bergel, A., & Eveillard, M. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-58793-2_8 · Cited by 7
Measuring design compliance using neural language models: an automotive case study
Parthasarathy, D., Ekelin, C., Karri, A. P., Sun, J., & Moraitis, P. (2022) · doi:10.1145/3558489.3559067 · Cited by 7
An empirical study on API usages from code search engine and local library
Zhong, H., & Wang, X. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10304-z · Cited by 7
How are Deep Learning Models Similar? An Empirical Study on Clone Analysis of Deep Learning Software
Wu, X., Qin, L., Yu, B., Xie, X., Ma, L., Xue, Y., Liu, Y., & Zhao, J. (2020) · International Conference on Program Comprehension · doi:10.1145/3387904.3389254 · Cited by 7
Evaluating lexical approximation of program dependence
Lee, S., Binkley, D., Gold, N., Islam, S., Krinke, J., & Yoo, S. (2019) · Journal of Systems and Software · doi:10.1016/j.jss.2019.110459 · Cited by 7
Zhang, J., Liu, S., Luo, J., Liang, J., & Huang, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3013694 · Cited by 7
Recommendation of Exception Handling Code in Mobile App DevelopmentPreprint
Nguyen, T. T., Vu, P. M., & Nguyen, T. T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.06567 · Cited by 7
Combining Code Embedding with Static Analysis for Function-Call CompletionPreprint
Weyssow, M., Sahraoui, H. A., Frénay, B., & Vanderose, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.03731 · Cited by 7
Xavier: Toward Better Coding Assistance in Authoring Tabular Data Wrangling Scripts
Zhou, Y., Cai, X., Shi, Q., Huang, Y., Li, H., Qu, H., Weng, D., & Wu, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714239 · Cited by 6
PERSONA: A personalized model for code recommendation
Nguyen, T. T., & Nguyen, T. T. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259834 · Cited by 6
Bug-Transformer: Automated Program Repair Using Attention-Based Deep Neural Network
Yao, J., Rao, B., Xing, W., & Wang, L. (2022) · Journal of Circuits Systems and Computers · doi:10.1142/s0218126622502103 · Cited by 6
ShaderTransformer: Predicting Shader Quality via One-shot Embedding for Fast Simplification
Huo, Y., Li, S., Yuan, Y., Xu, C., Wang, R., Zheng, W., Lin, H., & Bao, H. (2022) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3528233.3530722 · Cited by 6
Parvathy, R., & Thushara, M. G. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10725521 · Cited by 6
TUNA: TUning Naturalness-Based Analysis
Jimenez, M., Cordy, M., Traon, Y. L., & Papadakis, M. (2018) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2018.00087 · Cited by 6
Comprehension Driven Document Planning in Natural Language Generation Systems
Thomson, C., Reiter, E., & Sripada, S. G. (2018) · International Conference on Natural Language Generation · doi:10.18653/v1/w18-6544 · Cited by 6
Deep Learning Based Code Completion Models for Programming Codes
Wang, S., Liu, J., Qiu, Y., Ma, Z., Liu, J., & Wu, Z. (2019) · International Symposium on Computer Science and Intelligent Control (ISCSIC) · doi:10.1145/3386164.3389083 · Cited by 6
Deep Learning In Software Engineering
Watson, C. (2020) · W&M Publish (College of William & Mary) · doi:10.21220/s2-3bn1-fv48 · Cited by 6
SourcererCC: Scalable and Accurate Clone Detection
Sajnani, H., Saini, V., Roy, C. K., & Lopes, C. V. (2021) · Springer eBooks · doi:10.1007/978-981-16-1927-4_4 · Cited by 6
Specializing Neural Networks for Cryptographic Code Completion Applications
Xiao, Y., Song, W., Qi, J., Viswanath, B., McDaniel, P. D., & Yao, D. D. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3265362 · Cited by 6
Learning Graph Representations for Defect Prediction
Loyola, P., & Matsuo, Y. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-c.2017.68 · Cited by 6
JavaScript Code Suggestion Based on Deep Learning
Zhong, C., Yang, M. Y., & Sun, J. (2019) · International Conference on Innovation in Artificial Intelligence (ICIAI) · doi:10.1145/3319921.3319922 · Cited by 6
Modeling hierarchical usage context for software exceptions based on interaction data
Chen, H., Damevski, K., Shepherd, D. C., & Kraft, N. A. (2019) · Automated Software Engineering · doi:10.1007/s10515-019-00265-3 · Cited by 6
DeepVS: an efficient and generic approach for source code modelling usage
Hussain, Y., Huang, Z., Zhou, Y., & Wang, S. (2020) · Electronics Letters · doi:10.1049/el.2020.0500 · Cited by 6
Yang, Y., Chen, X., & Sun, J. (2019) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194019400229 · Cited by 6
Metadata
- Authors
- Hindle, A., Barr, E. T., Su, Z., Gabel, M., & Devanbu, P.
- Affiliations
- University of California, Davis (US)
- The University of Texas at Dallas (US)
- Venue
- 2012 34th International Conference on Software Engineering (ICSE)
- Publisher
- IEEE
- Published
- 2012-06
- Pages
- 837-847
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W3146720657
- Cited by
- 425
- References
- 39
- Citations by year
- 2026: 19 · 2025: 24 · 2024: 36 · 2023: 44 · 2022: 49 · 2021: 50 · 2020: 48 · 2019: 46 · 2018: 22 · 2017: 35 · 2016: 13 · 2015: 23 · 2014: 2 · 2013: 14
- FWCI
- 9.81
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- statistical language models, n-gram language models, code completion, Java, eclipses, software engineering support, natural language modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.