A Survey on Deep Learning for Software Engineering
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
In 2006, Geoffrey Hinton proposed the concept of training “Deep Neural Networks (DNNs)” and an improved model training method to break the bottleneck of neural network development. More recently, the introduction of AlphaGo in 2016 demonstrated the powerful learning ability of deep learning and its enormous potential. Deep learning has been increasingly used to develop state-of-the-art software engineering (SE) research tools due to its ability to boost performance for various SE tasks. There are many factors, e.g., deep learning model selection, internal structure differences, and model optimization techniques, that may have an impact on the performance of DNNs applied in SE. Few works to date focus on summarizing, classifying, and analyzing the application of deep learning techniques in SE. To fill this gap, we performed a survey to analyze the relevant studies published since 2006. We first provide an example to illustrate how deep learning techniques are used in SE. We then conduct a background analysis (BA) of primary studies and present four research questions to describe the trend of DNNs used in SE (BA), summarize and classify different deep learning techniques (RQ1), and analyze the data processing including data collection, data classification, data pre-processing, and data representation (RQ2). In RQ3, we depicted a range of key research topics using DNNs and investigated the relationships between DL-based model adoption and multiple factors (i.e., DL architectures, task types, problem types, and data types). We also summarized commonly used datasets for different SE tasks. In RQ4, we summarized the widely used optimization algorithms and provided important evaluation metrics for different problem types, including regression, classification, recommendation, and generation. Based on our findings, we present a set of current challenges remaining to be investigated and outline a proposed research road map highlighting key opportunities for future work.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning models accelerate and enhance the accuracy of complex coding tasks [122, 214, 234].”
From A 2030 Roadmap for Software Engineering (2025) · cites this paper as [234]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · cited 1×
“[40] proposed the concept of “Deep Learning (DL)”.”
BackgroundGuidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522 · cited 1×
“We describe 9 general ways to combat overfitting [38, 107] by considering 3 aspects: data processing, model construction as well as model training, and then analyzed the usage distribution of these methods in relevant studies.”
MethodDECKARD: Scalable and Accurate Tree-Based Detection of Code Clones
Jiang, L., Misherghi, G., Su, Z., & Glondu, S. (2007) · 29th International Conference on Software Engineering (ICSE'07) · doi:10.1109/icse.2007.30 · Cited by 1,039
A tutorial survey of architectures, algorithms, and applications for deep learning
Deng, L. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2013.9 · Cited by 725 · cited 1×
“We classified the architecture of various DNNs into 3 categories: the layered architecture, AutoEncoder (AE), and Encoder-Decoder [20, 91].”
MethodSourcererCC: scaling code clone detection to big-code
Sajnani, H., Saini, V., Svajlenko, J., Roy, C. K., & Lopes, C. V. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884877 · Cited by 447
A Systematic Literature Review and Meta-Analysis on Cross Project Defect Prediction
Hosseini, S., Turhan, B., & Gunarathna, D. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2770124 · Cited by 317 · cited 1×
“Following previous studies [43, 47, 67], we selected 22 widely read SE journals (10) and conferences (12) listed in Table 1 to conduct a comprehensive literature review.”
MethodLearning to rank relevant files for bug reports using domain knowledge
Ye, X., Bunescu, R., & Liu, C. (2014) · Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering · doi:10.1145/2635868.2635874 · Cited by 290 · cited 1×
“Bug localization code-based data Defects4J benchmark [IEEE40] text-based data [13] bug report benchmark [IEEE40] code- and text-based data AspectJ in Bugzilla, SWT, JDT, Tomcat [IEEE135]”
Research works printed but not linked: 3
- Staffs Keele et al. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report. Technical report, Ver. 2.3 EBSE Technical Report. EBSE.
- Abdel-rahman Mohamed, George Dahl, and Geoffrey Hinton. 2009. Deep belief networks for phone recognition. In NIPS Workshop on Deep Learning for Speech Recognition and Related Applications, Vol. 1. 39.
- Chao Liu Cuiyun Gao Xin Xia David Lo John Grundy and Xiaohu Yang. 2020. On the Replicability and Reproducibility of Deep Learning in Software Engineering. arXiv preprint arXiv:2006.14244. · arXiv
Cited by
Large Language Models for Software Engineering: A Systematic Literature Review
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3695988 · Cited by 1,029
“[309] 2022 DL General SE scope ✓ 2015-2020 250”
BackgroundSelf-citationSoftware Testing With Large Language Models: Survey, Landscape, and Vision
Wang, J., Huang, Y., Chen, C., Liu, Z., Wang, S., & Wang, Q. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3368208 · Cited by 573
“Yang et al. and Watson et al. respectively carried out surveys about the use of deep learning in software engineering domain [161], [162].”
On the use of deep learning in software defect prediction
Giray, G., Bennin, K. E., Köksal, Ö., Babur, Ö., & Tekinerdogan, B. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111537 · Cited by 209
Friha, O., Amine Ferrag, M., Kantarci, B., Cakmak, B., Ozgun, A., & Ghoualmi-Zine, N. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3456549 · Cited by 189
A Survey of Learning-based Automated Program Repair
Zhang, Q., Fang, C., Ma, Y., Sun, W., & Chen, Z. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3631974 · Cited by 132
Retrieval-Based Prompt Selection for Code-Related Few-Shot Learning
Nashid, N., Sintaha, M., & Mesbah, A. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00205 · Cited by 178
A survey on machine learning techniques applied to source code
Sharma, T., Kechagia, M., Georgiou, S., Tiwari, R., Vats, I., Moazen, H., & Sarro, F. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111934 · Cited by 173
A Survey on LLM-Based Code Generation for Low-Resource and Domain-Specific Programming Languages
Joel, S., Wu, J. J., & Fard, F. H. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3770084 · Cited by 205
A Systematic Literature Review on Large Language Models for Automated Program Repair
Zhang, Q., Fang, C., Xie, Y., Ma, Y., Sun, W., Yang, Y. J., & Chen, Z. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3799693 · Cited by 188
“Following prior surveys [149, 172, 182], we divide the search items used for searching papers automatically into two groups: (1) an APR-related group containing some commonly-used keywords related to program repair; and (2) an LLM-related group containing some popular keywords related to large…”
Self-citationDeep learning-based software engineering: progress, challenges, and opportunities
Chen, X., Hu, X., Huang, Y., Jiang, H., Ji, W., Jiang, Y., Jiang, Y., Liu, B., Liu, H., Li, X., et al. (2024) · Science China Information Sciences · doi:10.1007/s11432-023-4127-5 · Cited by 152
Self-citationKeeping Deep Learning Models in Check: A History-Based Approach to Mitigate Overfitting
Li, H., Rajbahadur, G. K., Lin, D., Bezemer, C., & Jiang, Z. M. (2024) · IEEE Access · doi:10.1109/access.2024.3402543 · Cited by 129
“Among the overfitting prevention methods, dropout is the most commonly adopted approach [79, 85].”
BackgroundMethodHITS: High-coverage LLM-based Unit Test Generation via Method Slicing
Wang, Z., Liu, K., Li, G., & Jin, Z. G. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695501 · Cited by 198
A Survey on Software Defect Prediction Using Deep Learning
Akimova, E. N., Bersenev, A. Y., Deikov, A. A., Kobylkin, K. S., Konygin, A. V., Mezentsev, I. P., & Misilov, V. E. (2021) · Mathematics · doi:10.3390/math9111180 · Cited by 150
A survey on large language models for software engineering
Zhang, Q., Fang, C., Xie, Y., Zhang, Y., Yu, S., Sun, W., Yang, Y., & Chen, Z. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4670-0 · Cited by 124
Self-citationReal-world robot applications of foundation models: a review
Kawaharazuka, K., Matsushima, T., Gambardella, A., Guo, J., Paxton, C., & Zeng, A. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2408593 · Cited by 164
Using LLMs in Software Requirements Specifications: An Empirical Evaluation
Krishna, M., Gaur, B., Verma, A., & Jalote, P. (2024) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re59067.2024.00056 · Cited by 157
“With the explosion in the adoption of Artificial Intelligence (AI), it is now possible to leverage AI agents in key requirement engineering (RE) tasks like extraction, classification, prioritization, and validation of requirements [5], [6].”
BackgroundKausik, A. K., Rashid, A. B., Baki, R. F., & Maktum, M. M. J. (2025) · Array · doi:10.1016/j.array.2025.100393 · Cited by 131
Large Language Models for Software Engineering: A Systematic Literature Review
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2308.10620 · Cited by 114
“[309] 2022 DL General SE scope ✓ 2015-2020 250”
BackgroundSelf-citationFinding A Needle in a Haystack: Automated Mining of Silent Vulnerability Fixes
Zhou, J., Pacheco, M., Wan, Z., Xia, X., Lo, D., Wang, Y., & Hassan, A. E. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678720 · Cited by 152
“• LSTM: Long short-term memory (LSTM) network [29] is a widely applied RNN-based model throughout software engineering studies [30].”
BackgroundSelf-citationWhen Software Security Meets Large Language Models: A Survey
Zhu, X., Zhou, W., Han, Q., Ma, W., Wen, S., & Xiang, Y. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2024.124971 · Cited by 127
Free lunch for testing: fuzzing deep-learning libraries from open source
Wei, A., Deng, Y., Yang, C., & Zhang, L. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510041 · Cited by 106
“application domains, including image classification [37, 58], natural language processing [31, 33], game playing [57], and software engineering [22, 42, 70].”
BackgroundStealthy Backdoor Attack for Code Models
Yang, Z., Xu, B., Zhang, J. M., Kang, H. J., Shi, J., He, J., & Lo, D. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3361661 · Cited by 75
“DNN-based models to critical software engineering tasks [1], including function name prediction [2], code search [3], clone detection [4], API classification [5], StackOverflow post tagging [6], etc.”
MethodSelf-citationCodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Tasks
Puri, R., Kung, D. S., Janssen, G., Zhang, W., Domeniconi, G., Zolotov, V., Dolby, J., Chen, J., Choudhury, M., Decker, L., et al. (2021) · arXiv · doi:10.48550/arxiv.2105.12655 · Cited by 92
Actionable and interpretable fault localization for recurring failures in online service systems
Li, Z., Zhao, N., Li, M., Lu, X., Wang, L., Chang, D., Nie, X., Cao, L., Zhang, W., Sui, K., et al. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549092 · Cited by 70
Diffusion models in protein structure and docking
Yim, J., Stärk, H., Corso, G., Jing, B., Barzilay, R., & Jaakkola, T. (2024) · Wiley Interdisciplinary Reviews Computational Molecular Science · doi:10.1002/wcms.1711 · Cited by 107
Fuzzing deep-learning libraries via automated relational API inference
Deng, Y., Yang, C., Wei, A., & Zhang, L. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549085 · Cited by 86
“Recent years have witnessed the surge of deep learning (DL) in a variety of applications, including computer vision [32, 60], natural language processing [24, 28], robotics [23, 35], bioinformatics [46, 57], and software engineering [25, 29, 36, 37, 45, 68, 78, 79, 81, 82].”
BackgroundUsing Transfer Learning for Code-Related Tasks
Mastropaolo, A., Cooper, N., Palacio, D. N., Scalabrino, S., Poshyvanyk, D., Oliveto, R., & Bavota, G. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3183297 · Cited by 72
“available approaches support a plethora of concrete SE tasks [81], [86], in this section we focus on the ones we target in our study: automated bug-fixing, injection of code mutants, generation of assert statements in test methods,”
BackgroundGamma: Revisiting Template-Based Automated Program Repair Via Mask Prediction
Zhang, Q., Fang, C., Zhang, T., Yu, B., Sun, W., & Chen, Z. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00063 · Cited by 126
“As a promising technique to shift the heavy manual de-bugging to efficient automated patch generation, APR has developed rapidly and received much attention from a broad of research communities, such as software engineering, software security, and artificial intelligence [6], [30].”
MethodChain-of-Thought in Neural Code Generation: From and for Lightweight Language Models
Yang, G., Zhou, Y., Chen, X., Zhang, X., Zhuo, T. Y., & Chen, T. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3440503 · Cited by 112
“CodeLlama tokenizes the given functional description X into sub token sequences { w i } =1 using byte-pair encoding (BPE) and the SentencePiece algorithm [29].”
MethodCoProtector: Protect Open-Source Code against Unauthorized Training Usage with Data Poisoning
Sun, Z., Du, X., Song, F., Ni, M., & Li, L. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3512225 · Cited by 63
“Deep learning (DL) has demonstrated great advantages in automated program understanding and generation [45].”
BackgroundTrustworthy and Synergistic Artificial Intelligence for Software Engineering: Vision and Roadmaps
Lo, D. (2023) · 2023 IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1109/icse-fose59343.2023.00010 · Cited by 40
Self-citationA systematic review of machine learning methods in software testing
Ajorloo, S., Jamarani, A., Kashfi, M., Kashani, M. H., & Najafizadeh, A. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111805 · Cited by 76
Software defect prediction: future directions and challenges
Li, Z., Niu, J., & Jing, X. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00424-1 · Cited by 79
“In recent years, deep learn‑ ing techniques have garnered extensive application across various software engi‑ neering tasks (Yang et al. 2022; Samoaa et al. 2022), consistently outperforming other state‑of‑the‑art methods.”
Towards AI-Native Software Engineering (SE 3.0): A Vision and a Challenge Roadmap
Hassan, A. E., Oliva, G. A., Lin, D., Chen, B., & Ming, Z. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3807901 · Cited by 81
Mitigating False Positive Static Analysis Warnings: Progress, Challenges, and Opportunities
Guo, Z., Tan, T., Liu, S., Liu, X., Lai, W., Yang, Y., Li, Y., Chen, L., Dong, W., & Zhou, Y. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3329667 · Cited by 65
“Additionally, with the rapid development of DL techniques, many novel DL models have been leveraged for SE tasks [138], [151], but these models have not been applied to the FPM task.”
BackgroundMethodInfluentialSelf-citationDurrani, U. K., Akpınar, M., Adak, M. F., Kabakuş, A. T., Öztürk, M. M., & Saleh, M. (2024) · IEEE Access · doi:10.1109/access.2024.3488904 · Cited by 77
“The incorporation of Artificial Intelligence (AI) into SE has brought about a significant period of change, transforming the software development cycle with remarkable progress and effectiveness in recent years [2], [3], [4].”
Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities
Ma, W., Liu, S., Zhao, M., Xie, X., Wang, W., Hu, Q., Zhang, J., & Liu, Y. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3664606 · Cited by 74
“Before the emergence of Language Model Learners (LLMs), these deep learning models were used in two ways in software engineering [35, 73]: 1) Adding a task model on top of these code models and fine-tuning the weights of the entire model.”
MethodMachine Learning for Software Engineering: A Tertiary Study
Kotti, Z., Galanopoulou, R., & Spinellis, D. (2022) · ACM Computing Surveys · doi:10.1145/3572905 · Cited by 45
Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit
Wan, Y., Bi, Z., He, Y., Zhang, J., Zhang, H., Sui, Y., Xu, G., Jin, H., & Yu, P. S. (2024) · ACM Computing Surveys · doi:10.1145/3664597 · Cited by 76
“Deep learning for code intelligence has been studied in many related research communities.”
Challenges and Opportunities for the Web 3.0 Metaverse Turn in Education
Fan, S., Yecies, B., Zhou, Z. I., & Shen, J. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3385505 · Cited by 45
“DL models have shown impressive results in tasks such as image recognition, speech recognition, and natural language processing in the development of deep learning models [29].”
BackgroundArtificial Intelligence for Software Engineering: The Journey So Far and the Road Ahead
Ahmed, I., Aleti, A., Cai, H., Chatzigeorgiou, A., He, P., Hu, X., Pezzè, M., Poshyvanyk, D., & Xia, X. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3719006 · Cited by 51
Self-citationSynthetic ethnography: Field devices for the qualitative study of generative models
de Seta, G., Pohjonen, M., & Knuutila, A. (2024) · Big Data & Society · doi:10.1177/20539517241303126 · Cited by 49
“Unlike GANs, diffusion models work by adding noise to training data and then reverse-engineering the process by learning to remove this noise (Yang et al., 2022).”
Towards AI-Assisted Synthesis of Verified Dafny Methods
Misu, M. R. H., Lopes, C. V., Ma, I., & Noble, J. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3643763 · Cited by 38
“Dafny-Synthesis : https://github.com/Mondego/dafny-synthesis”
GNet4FL: effective fault localization via graph convolutional neural network
Qian, J., Ju, X., & Chen, X. (2023) · Automated Software Engineering · doi:10.1007/s10515-023-00383-z · Cited by 41
“Deep learning techniques have made significant achievements in current software engineering studies, such as AI for software engineering and software engineering for AI (Yang et al. 2021; Zhang et al. 2020).”
Method(2021) · arXiv (Cornell University) · Cited by 37
An Extensive Comparison of Static Application Security Testing Tools
Esposito, M., Falaschi, V., & Falessi, D. (2024) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3661167.3661199 · Cited by 46
Large Language Models for Unit Testing: A Systematic Literature Review
Zhang, Q., Fang, C., Gu, S., Shang, Y., Chen, Z., & Liang, X. Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.15227 · Cited by 47
“[115] 2022 DL Software Engineering Y 2015-2020 142 Wang et al. [104] 2023 LLMs Software Testing Y 2019-2023 102 Fan et al. [22] 2023 LLMs Software Engineering ✗ - - Zheng et al. [136] 2023 LLMs Software Engineering Y 2022-2024 123 Hou et al. [40] 2023 LLMs Software Engineering Y 2017-2023 395 Zhang…”
CBCT‐based synthetic CT image generation using a diffusion model for CBCT‐guided lung radiotherapy
Chen, X., Qiu, R. L. J., Peng, J., Shelton, J. W., Chang, C., Yang, X., & Kesarwala, A. H. (2024) · Medical Physics · doi:10.1002/mp.17328 · Cited by 35
From Simulators to Digital Twins for Enabling Emerging Cellular Networks: A Tutorial and Survey
Manalastas, M., Farooq, M. U. B., Zaidi, S. M. A., Qureshi, H. N., Sambo, Y. A., & Imran, A. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3490178 · Cited by 41
“Additionally, AI techniques are increasingly utilized for code generation and bug detection [265], [266], [267].”
CoLeFunDa: Explainable Silent Vulnerability Fix Identification
Zhou, J., Pacheco, M., Chen, J., Hu, X., Xia, X., Lo, D., & Hassan, A. E. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00214 · Cited by 52
“BiLSTM is applied throughout various software engineering studies [45].”
MethodSelf-citationPitfalls in Language Models for Code Intelligence: A Taxonomy and Survey
She, X., Liu, Y., Zhao, Y., He, Y., Li, L., Tantithamthavorn, C. K., Qin, Z., & Wang, H. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3748647 · Cited by 40
Deep Configuration Performance Learning: A Systematic Survey and Taxonomy
Gong, J., & Chen, T. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3702986 · Cited by 39
Anatomizing Deep Learning Inference in Web Browsers
Wang, Q., Jiang, S., Chen, Z., Cao, X., Li, Y., Li, A., Ma, Y., Cao, T., & Liu, X. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3688843 · Cited by 34
Federated transfer learning for attack detection for Internet of Medical Things
Alharbi, A. (2024) · International Journal of Information Security · doi:10.1007/s10207-023-00805-9 · Cited by 31
LibEER: A Comprehensive Benchmark and Algorithm Library for EEG-Based Emotion Recognition
Liu, H., Yang, S., Zhang, Y., Wang, M., Gong, F., Xie, C., Liu, G., Liu, Z., Liu, Y., Lu, B., et al. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3605833 · Cited by 38
“(cid:2) These 20 methods, following the common practice in previous studies of categorizing deep learning models by their main architecture [41], [42], are divided into five categories: CNN, RNN, GNN, DNN, and Transformer.”
Automatically Recommend Code Updates: Are We There Yet?
Liu, Y., Tantithamthavorn, C. K., Liu, Y., Thongtanunam, P., & Li, L. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3678167 · Cited by 32
“DL has also been extensively applied to natural language processing and source code analysis in software engineering [94].”
MethodData preparation for Deep Learning based Code Smell Detection: A systematic literature review
Zhang, F., Zhang, Z., Keung, J., Tang, X., Yang, Z., Yu, X., & Hu, W. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112131 · Cited by 29
“According to Yang et al. [96], a classification of the dataset based on data types—such as code data and metric data—is essential for maintaining relevance and accuracy in data analysis.”
MethodSystematic Literature Review of Commercial Participation in Open Source Software
Li, X., Zhang, Y., Osborne, C., Zhou, M., Jin, Z. G., & Liu, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3690632 · Cited by 41
PSIMiner: A Tool for Mining Rich Abstract Syntax Trees from Code
Spirin, E., Bogomolov, E., Kovalenko, V., & Bryksin, T. (2021) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr52588.2021.00014 · Cited by 24
Quradaa, F. H., Shahzad, S., & Almoqbily, R. S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0296858 · Cited by 27
He, G., Demartini, G., & Gadiraju, U. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713218 · Cited by 23
“In recent decades, deep learning-based AI systems have shown promising performance across various domains [23, 110] and applications [15, 81].”
Using textual bug reports to predict the fault category of software bugs
Hirsch, T., & Hofer, B. (2022) · Array · doi:10.1016/j.array.2022.100189 · Cited by 23
Maximizing Test Coverage for Security Threats Using Optimal Test Data Generation
Hussain, T., Faiz, R. B., Aljaidi, M., Khattak, A., Samara, G., Alsarhan, A., & Alazaidah, R. (2023) · Applied Sciences · doi:10.3390/app13148252 · Cited by 22
A Roadmap for Software Testing in Open-Collaborative and AI-Powered Era
Wang, Q., Wang, J., Li, M., Wang, Y., & Liu, Z. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3709355 · Cited by 26
Denoising Diffusion Straightforward Models for Energy Conversion Monitoring Data Imputation
Xu, H., Liu, Z., Wang, H., Li, C., Niu, Y., Wang, W., & Liu, X. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3413349 · Cited by 22
The Lost World: Characterizing and Detecting Undiscovered Test Smells
Yang, Y., Hu, X., Xia, X., & Yang, X. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3631973 · Cited by 20
“Besides, we adopt the snowballing strategy [98, 108, 109] to ind out relevant posts but not found by the search string, i.e., similar post links provided by answers in collected posts.”
MethodSelf-citationCodeS: Towards Code Model Generalization Under Distribution Shift
Hu, Q., Guo, Y., Xie, X., Cordy, M., Papadakis, M., Ma, L., & Traon, Y. L. (2023) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1109/icse-nier58687.2023.00007 · Cited by 30
“In particular, to enable the large volume of source code analysis, there comes a new trend in both software engineering and machine learning communities – machine learning for source code [2], [3] in the last decade where deep neural”
BackgroundJin, X., & Lin, Z. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3660769 · Cited by 28
“While the public datasets are centered on Java methods, we expand the scope to build our own evaluation dataset to include code in Python, JavaScript, Ruby, Go, and PHP ( i.e. , the five most popular programming languages [Roziere et al. 2023; Yang et al. 2022]).”
Zhang, Y., Lu, Q., Liu, K., Dou, W., Zhu, J., Li, Q., Zhang, C., Lin, Z., & Wei, J. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3763791 · Cited by 29
Fairness Concerns in App Reviews: A Study on AI-Based Mobile Apps
Nasab, A. R., Dashti, M., Shahin, M., Zahedi, M., Khalajzadeh, H., Arora, C., & Liang, P. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3690633 · Cited by 29
“Here, we describe six of them that performed better than the other four, due to space constraints.”
Backgroundda Roza, E. A., Lima, J. P., Silva, R. C., & Vergílio, S. R. (2022) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner53432.2022.00034 · Cited by 23
Siva, R., Kaliraj, S., Hariharan, B., & Premkumar, N. (2023) · Wireless Personal Communications · doi:10.1007/s11277-023-10694-9 · Cited by 17
“1 3 The use of deep learning techniques in software development studies, such as the forecasting of defects and vulnerabilities and the localization of faults, is well-explained in a recent survey [40].”
Interpretable software estimation with graph neural networks and orthogonal array tunning method
Ranković, N., Ranković, D., Ivanović, M. D., & Kaljević, J. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103778 · Cited by 17
A Study of Gender Discussions in Mobile Apps
Shahin, M., Zahedi, M., Khalajzadeh, H., & Nasab, A. R. (2023) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr59073.2023.00086 · Cited by 23
“4) Performance Measures: We used five well-known and widely used metrics including precision, recall, F1-score, accuracy, and AUC to assess the performance of the ML and DL models [55], [70], [71].”
MethodYang, M., Yang, S., & Wong, W. E. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3421591 · Cited by 17
“Deep Belief Networks (DBNs), Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Transformers, and their variants are the most common deep learning techniques in SDP studies [9].”
BackgroundMethodImproving Deep Assertion Generation via Fine-Tuning Retrieval-Augmented Pre-Trained Language Models
Zhang, Q., Fang, C., Zheng, Y., Zhang, Y., Zhao, Y. F., Huang, R., Zhou, J., Yang, Y. J., Zheng, T., & Chen, Z. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3721128 · Cited by 20
Self-citationPrediction of Vulnerability Characteristics Based on Vulnerability Description and Prompt Learning
Li, X., Ren, X., Xue, Y., Xing, Z., & Sun, J. (2023) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner56733.2023.00062 · Cited by 20
“Deep learning models have recently been adopted in vulnerability detection and analysis, due to their ability to solve complex problems even if the source code and software text are very diverse and massive [5], [42].”
BackgroundImproving Retrieval-Augmented Deep Assertion Generation via Joint Training
Zhang, Q., Fang, C., Zheng, Y., Qian, R., Yu, S., Zhao, Y., Zhou, J., Yang, Y., Zheng, T., & Chen, Z. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3545970 · Cited by 17
“With the success of DL, researchers have increasingly been utilizing advanced DL techniques to automate a variety of software engineering tasks [24], [25], such as program repair [26], [27], [28] and vulnerability detection [29], [30], [31], [32].”
Self-citationMethods and Techniques of Agentic Software Engineering: A Systematic Literature Review
Otoum, N. A., & El-Khalili, N. H. (2026) · IEEE Access · doi:10.1109/access.2026.3652325 · Cited by 23
“Additionally, the principles and methodologies existing in software engineering should be periodically updated and extended to control the conduct of agents and to guarantee quality in the AI-influenced development processes [3], [54], [55].”
A 2030 Roadmap for Software Engineering
Pezzè, M., Abrahão, S., Penzenstadler, B., Poshyvanyk, D., Roychoudhury, A., & Yue, T. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3731559 · Cited by 13
VALIDATE: A deep dive into vulnerability prediction datasets
Esposito, M., & Falessi, D. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107448 · Cited by 23
Zhao, C., Mu, Y., Chen, X., Zhao, J., Ju, X., & Wang, G. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.106982 · Cited by 13
Requirement Dependency Extraction Based on Improved Stacking Ensemble Machine Learning
Guan, H., Xu, H., & Cai, L. (2024) · Mathematics · doi:10.3390/math12091272 · Cited by 12
“Machine learning can also perform data analysis tasks in software engineering, such as small dataset engineering problems [12], software requirements and code review problems [13–15].”
MethodCFG2AT: Control Flow Graph and Graph Attention Network-Based Software Defect Prediction
Liu, H., Li, Z., Zhang, H., Jing, X., & Liu, J. (2024) · IEEE Transactions on Reliability · doi:10.1109/tr.2024.3503688 · Cited by 14
“Inthefieldsofsoftwareengineering,GNNshavebeenincreas-ingly gaining popularity with various applications [23], [24], [45], such as runtime performance prediction, code generation, and log anomaly detection.”
Alshammari, F. H. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/1960684 · Cited by 12
“In other words, “software applications that deliver information items deemed to be relevant for software engineering tasks” are “recommenders” for the discipline [6].”
BackgroundDynamically Relative Position Encoding-Based Transformer for Automatic Code Edit
Qi, S., Li, Y., Gao, C., Su, X., Gao, S., Zheng, Z., & Liu, C. (2022) · IEEE Transactions on Reliability · doi:10.1109/tr.2022.3194370 · Cited by 12
“D EEP learning (DL) techniques have been adapted to solve many traditional software engineering problems and tasks recently [1], [2], e.”
Source-Code Generation Using Deep Learning: A Survey
Ahmed, A., Azab, S. S., & Abdelhamid, Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-49011-8_37 · Cited by 17
Hu, X., Zheng, M., Zhu, R., Zhang, X., & Jin, Z. G. (2025) · IEEE Transactions on Reliability · doi:10.1109/tr.2024.3524064 · Cited by 11
“Thiswillleadtoinsufficientpredictionperformanceof themodelandlimititspracticalapplicationeffect[10],[11].”
Human-Machine Teaming and Team Effectiveness in AI Tools for Software Engineering
Rauf, I., Sharp, H., López, T., & Wermelinger, M. (2025) · International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) · doi:10.1109/chase66643.2025.00017 · Cited by 18
“For instance, Watson et al [14] and Yang et al [15] explore the application of deep learning in SE research, while Mohammadkhani et al [16] investigate explainable AI4SE and Hou et al [17] focus on large language models.”
Cao, Y., Ju, X., Chen, X., & Gong, L. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00543-3 · Cited by 12
“Vulnerability detection in software systems is critical to ensure the security, integrity, and reliability of applications (Neuhaus et al. 2007; Chakraborty et al. 2021; Yang et al. 2022).”
A review of deep learning approaches for drug synergy prediction in cancer
Li, L., Zhang, H., Zheng, C., & Su, Y. (2025) · npj Drug Discovery. · doi:10.1038/s44386-025-00034-1 · Cited by 14
Lei, T., Xue, J., Man, D., Wang, Y., Li, M., & Kong, Z. (2024) · Electronics · doi:10.3390/electronics13132439 · Cited by 11
HTTD: A Hierarchical Transformer for Accurate Table Detection in Document Images
Kasem, M. S., Mahmoud, M., Yagoub, B., Senussi, M. F., Abdalla, M. I., & Kang, H. (2025) · Mathematics · doi:10.3390/math13020266 · Cited by 11
Enhancing Software Engineering With AI: Innovations, Challenges, and Future Directions
Abbas, T., Rathore, S. A., Turki, A., Khan, S., Alghushairy, O., & Daud, A. Y. (2025) · IET Software · doi:10.1049/sfw2/5691460 · Cited by 21
“Generally, these models can leverage code metrics, historical defect data, development processes, and other project variables to identify areas of software that are more likely to fail, aiding development efforts accordingly [35].”
Towards an Understanding of Context Utilization in Code Intelligence
Wang, Y., Duan, K., Zheng, D., Shi, E., Zhang, F., Wang, Y., Chen, J., Liu, X., Ma, Y., Zhang, H., et al. (2026) · ACM Computing Surveys · doi:10.1145/3797261 · Cited by 12
“Yang et al.[179] review integrating deep learning techniques with software engineering, examining model selection, data processing methods, and relevant datasets.”
Using Deep Learning to Automatically Improve Code Readability
Vitale, A., Piantadosi, V., Scalabrino, S., & Oliveto, R. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00112 · Cited by 18
“A broader overview is available in the surveys by Allamanis et al. [2], Watson et al. [54], and Yang et al. [56].”
BackgroundTowards Reliable AI for Source Code Understanding
Suneja, S., Zheng, Y., Zhuang, Y., Laredo, J., & Morari, A. (2021) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3472883.3486995 · Cited by 13
“In the software engineering domain, AI-for-code has been employed in source code understanding tasks such as defect detection [17, 26, 39, 48], code summarization [5, 24, 28, 33, 43], code completion [15, 25, 54], function and variable naming [3, 4, 7, 41], amongst others [23, 37, 58, 60].”
MethodVulnerability Detection in Popular Programming Languages with Language ModelsPreprint
Atiiq, S. A., Gehrmann, C., & Dahlén, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.15905 · Cited by 12
Berardinelli, L., Muttillo, V., Eramo, R., Brunelière, H., Rahimi, A., Cicchetti, A., Giner-Miguelez, J., Gómez, A., Potena, P., & Saadatmand, M. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3759454 · Cited by 17
Large Language Models for Early-Stage Software Project Estimation: A Systematic Mapping Study
Radliński, Ł., & Swacha, J. (2025) · Applied Sciences · doi:10.3390/app152413099 · Cited by 11
Metadata
- Authors
- Yang, Y., Xia, X., Lo, D., & Grundy, J.
- Affiliations
- Zhejiang University (CN)
- Huawei Technologies (China) (CN)
- Singapore Management University (SG)
- Monash University (AU)
- Venue
- ACM Computing Surveys
- Published
- 2022-01-31
- Volume
- 54
- Issue
- 10s
- Pages
- 1-73
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4206238894
- Cited by
- 223
- References
- 13
- Citations by year
- 2026: 41 · 2025: 63 · 2024: 66 · 2023: 36 · 2022: 12
- FWCI
- 26.90
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- ARC Laureate Fellowship (FL190100035)
- National Research Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- deep learning, software engineering, deep neural network, software engineering tools, research trends, data preprocessing, data representation, datasets, optimization algorithms, evaluation metrics, research roadmap
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.