Cited by 208Software Testing and Debugging TechniquesSoftware Engineering ResearchSoftware Engineering Techniques and Practices

The DOI matches its Crossref record; 89 of the 93 references it cites were found in a registry or an index.

Machine Learning Applied to Software Testing: A Systematic Mapping Study

Durelli, Vinicius H. S., Durelli, Rafael S., Borges, Simone S., Endo, Andre T., Eler, Marcelo M., Dias, Diego R. C., Guimaraes, Marcelo P.·2019·IEEE Transactions on Reliability

DOI 10.1109/tr.2019.2892517

Open this paper in CoChat — free account

Abstract

Software testing involves probing into the behavior of software systems to uncover faults. Most testing activities are complex and costly, so a practical strategy that has been adopted to circumvent these issues is to automate software testing. There has been a growing interest in applying machine learning (ML) to automate various software engineering activities, including testing-related ones. In this paper, we set out to review the state-of-the art of how ML has been explored to automate and streamline software testing and provide an overview of the research at the intersection of these two fields by conducting a systematic mapping study. We selected 48 primary studies. These selected studies were then categorized according to study type, testing activity, and ML algorithm employed to automate the testing activity. The results highlight the most widely used ML algorithms and identify several avenues for future research. We found that ML algorithms have been used mainly for test-case generation, refinement, and evaluation. Also, ML has been used to evaluate test oracle construction and to predict the cost of testing-related activities. The results of this paper outline the ML algorithms that are most commonly used to automate software-testing activities, helping researchers to understand the current state of research concerning ML applied to software testing. We also found that there is a need for better empirical studies examining how ML algorithms have been used to automate software-testing activities.

Integrity signals

Registry

Crossref · 10.1109/tr.2019.2892517

Cites

89 of 89 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Untitled work
(1963) · Medical Entomology and Zoology · Cited by 15,085
An Introduction to Statistical Learning
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013) · Springer Texts in Statistics · doi:10.1007/978-1-4614-7138-7 · Cited by 12,106
Experimentation in Software Engineering
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., & Wesslén, A. (2012) · doi:10.1007/978-3-642-29044-2 · Cited by 4,460
Guidelines for snowballing in systematic literature studies and a replication in software engineering
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · cited 2×
“Throughout the backward snowballing process, we followed the guidelines provided by Wohlin [35].”
BackgroundMethod
Understanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
Untitled work
(2015) · Cited by 2,857
Guidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669
An Analysis and Survey of the Development of Mutation Testing
Jia, Y., & Harman, M. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.62 · Cited by 1,752
The Goal Question Metric Approach
Basili, V. R., Caldiera, G., & Rombach, H. D. (1994) · Cited by 1,651
Prioritizing test cases for regression testing
Rothermel, G., Untch, R. H., Chu, C., & Harrold, M. J. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.962562 · Cited by 1,361

Show all 93 references

Research works printed but not linked: 11

choi, 0, Guided GUI testing of android apps with minimal restart and approximate learning, Proc ACM SIGPLAN Int Conf Object Oriented Program Syst Lang Appl, 623
noorian, 0, Machine learning-based software testing: Towards a classification framework, Proc Int Conf on Software Eng Knowledge Eng, 225
10.1109/TEST.1995.529902 · DOI
10.1109/QSIC.2008.29 · DOI
10.1109/ICFEM.1997.630406 · DOI
stone, 2012, Bayes’ Rule A Tutorial Introduction to Bayesian Analysis
lantz, 2015, Machine Learning with R
10.1145/1007512.1007539 · DOI
myers, 2011, The Art of Software Testing
10.1145/2896921.2896923 · DOI
stringer, 2013, Action Research

Sorted by citations

Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions
Lwakatare, L. E., Raj, A., Crnkovic, I., Bosch, J., & Olsson, H. H. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106368 · Cited by 241
A software engineering perspective on engineering machine learning systems: State of the art and challenges
Giray, G. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111031 · Cited by 187
Test case selection and prioritization using machine learning: a systematic literature review
Pan, R., Bagherzadeh, M., Ghaleb, T. A., & Briand, L. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-10066-6 · Cited by 220
Reinforcement Learning for Test Case Prioritization
Bagherzadeh, M., Kahani, N., & Briand, L. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3070549 · Cited by 157
AI-driven innovations in software engineering: a review of current practices and future directions
Alenezi, M., & Akour, M. (2025) · Applied Sciences · doi:10.3390/app15031344 · Cited by 121
Engineering AI Systems: A Research Agenda
Bosch, J., Olsson, H. H., & Crnkovic, I. (2021) · Advances in Systems Analysis, Software Engineering, and High Performance Computing · doi:10.4018/978-1-7998-5101-1.ch001 · Cited by 108
Deep learning-based software engineering: progress, challenges, and opportunities
Chen, X., Hu, X., Huang, Y., Jiang, H., Ji, W., Jiang, Y., Jiang, Y., Liu, B., Liu, H., Li, X., et al. (2024) · Science China Information Sciences · doi:10.1007/s11432-023-4127-5 · Cited by 133
When Software Security Meets Large Language Models: A Survey
Zhu, X., Zhou, W., Han, Q., Ma, W., Wen, S., & Xiang, Y. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2024.124971 · Cited by 110
Software fault prediction using data mining, machine learning and deep learning techniques: A systematic literature review
Batool, I., & Khan, T. A. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.107886 · Cited by 96
Learning-to-rank vs ranking-to-learn
Bertolino, A., Guerriero, A., Miranda, B., Pietrantuono, R., & Russo, S. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377811.3380369 · Cited by 86
FlakeFlagger: Predicting Flakiness Without Rerunning Tests
Alshammari, A., Morris, C., Hilton, M. L., & Bell, J. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00140 · Cited by 75
A Literature Review of Using Machine Learning in Software Development Life Cycle Stages
Shafiq, S., Mashkoor, A., Mayr‐Dorn, C., & Egyed, A. F. (2021) · IEEE Access · doi:10.1109/access.2021.3119746 · Cited by 79
An Overview of Adaptive-Surrogate-Model-Assisted Methods for Reliability-Based Design Optimization
Ling, C., Kuo, W., & Xie, M. (2022) · IEEE Transactions on Reliability · doi:10.1109/tr.2022.3200137 · Cited by 68
A Survey on Machine Learning Techniques for Source Code AnalysisPreprint
Sharma, T., Kechagia, M., Georgiou, S., Tiwari, R. K., Vats, I., Moazen, H., & Sarro, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09610 · Cited by 56
Systematic Mapping: Artificial Intelligence Techniques in Software Engineering
Sofian, H., Yunus, N. A. M., & Ahmad, R. B. (2022) · IEEE Access · doi:10.1109/access.2022.3174115 · Cited by 54
A systematic review of machine learning methods in software testing
Ajorloo, S., Jamarani, A., Kashfi, M., Kashani, M. H., & Najafizadeh, A. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111805 · Cited by 72
Artificial Intelligence Applied to Software Testing: A Tertiary Study
Amalfitano, D., Faralli, S., Hauck, J. C. R., Matalonga, S., & Distante, D. (2023) · ACM Computing Surveys · doi:10.1145/3616372 · Cited by 64
Artificial Intelligence in Software Testing: A Systematic Review
Islam, M., Khan, F., Alam, S., & Hasan, M. (2023) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon58879.2023.10322349 · Cited by 64
A survey on machine learning techniques applied to source code
Sharma, T., Kechagia, M., Georgiou, S., Tiwari, R., Vats, I., Moazen, H., & Sarro, F. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111934 · Cited by 159
Machine learning in software defect prediction: A business-driven systematic mapping study
Stradowski, S., & Madeyski, L. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.107128 · Cited by 51
Machine Learning for Software Engineering: A Tertiary Study
Kotti, Z., Galanopoulou, R., & Spinellis, D. D. (2022) · ACM Computing Surveys · doi:10.1145/3572905 · Cited by 54
Industrial applications of software defect prediction using machine learning: A business-driven systematic literature review
Stradowski, S., & Madeyski, L. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107192 · Cited by 34
Towards automated video game testing
Politowski, C., Guéhéneuc, Y., & Petrillo, F. D. S. (2022) · doi:10.1145/3524494.3527627 · Cited by 52
Test Suite Optimization Using Machine Learning Techniques: A Comprehensive Study
Mehmood, A., Ilyas, Q. M., Ahmad, M., & Shi, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3490453 · Cited by 28
Machine Learning in Requirements Engineering: A Mapping Study
Zamani, K., Zowghi, D., & Arora, C. (2021) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew53955.2021.00023 · Cited by 28
Root causing, detecting, and fixing flaky tests: State of the art and future roadmap
Zolfaghari, B., Parizi, R. M., Srivastava, G., & Hailemariam, Y. (2020) · Software Practice and Experience · doi:10.1002/spe.2929 · Cited by 27
Assessing test artifact quality—A tertiary study
Tran, H. K. V., Unterkalmsteiner, M., Börstler, J., & bin Ali, N. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106620 · Cited by 26
A Survey of Source Code Representations for Machine Learning-Based Cybersecurity Tasks
Casey, B., Santos, J. C. S., & Perry, G. (2025) · ACM Computing Surveys · doi:10.1145/3721977 · Cited by 28
An Improved Crow Search Algorithm for Test Data Generation Using Search-Based Mutation Testing
Jatana, N., & Suri, B. (2020) · Neural Processing Letters · doi:10.1007/s11063-020-10288-7 · Cited by 25
Using Machine Learning to Build Test Oracles: an Industrial Case Study on Elevators Dispatching Algorithms
Arrieta, A., Ayerdi, J., Illarramendi, M., Agirre, A., Sagardui, G., & Arratibel, M. (2021) · doi:10.1109/ast52587.2021.00012 · Cited by 25
The integration of machine learning into automated test generation: A systematic mapping study
Fontes, A., & Gay, G. (2023) · Software Testing Verification and Reliability · doi:10.1002/stvr.1845 · Cited by 24
Trend Application of Machine Learning in Test Case Prioritization: A Review on Techniques
Khatibsyarbini, M., Isa, M. A., Jawawi, D. N. A., Mohd-Shafie, M. L., Kadir, W. M. N. W., Hamed, H. N. A., & Suffian, M. D. M. (2021) · IEEE Access · doi:10.1109/access.2021.3135508 · Cited by 22
A Review of AI-augmented End-to-End Test Automation Tools
Pham, P., Nguyen, V., & Nguyen, T. N. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3563240 · Cited by 21
Chapter 1 Climbing the Stairway to Heaven
Olsson, H. H., Alahyari, H., & Bosch, J. (2012) · Springer eBooks · doi:10.1007/978-3-031-10873-0_2 · Cited by 22
Systematic Literature Review on Test Case Selection and Prioritization: A Tertiary Study
Singhal, S., Jatana, N., Suri, B., Misra, S., & Sanz, L. F. (2021) · Applied Sciences · doi:10.3390/app112412121 · Cited by 20
A Preliminary Investigation into Using Machine Learning Algorithms to Identify Minimal and Equivalent Mutants
Brito, C., Durelli, V. H. S., Durelli, R. S., Souza, S. R. S., Vincenzi, A. M. R., & Delamaro, M. E. (2020) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw50294.2020.00056 · Cited by 19
Self-citation
Predicting test failures induced by software defects: A lightweight alternative to software defect prediction and its industrial application
Madeyski, L., & Stradowski, S. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112360 · Cited by 23
Modeling the Development of Energy Network Software, Taking into Account the Detection and Elimination of Vulnerabilities
Kotenko, I. V., Евгеньевич, И. К., Buinevich, M., Saenko, I. B., & Shorey, R. (2023) · Energies · doi:10.3390/en16135111 · Cited by 15
Systematic Literature Review on Application of Learning-Based Approaches in Continuous Integration
Arani, A. K., Le, T. H. M., Zahedi, M., & Babar, M. A. (2024) · IEEE Access · doi:10.1109/access.2024.3424276 · Cited by 15
A multi-year grey literature review on AI-assisted test automation
Ricca, F., Marchetto, A., & Stocco, A. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107799 · Cited by 15
Machine learning‐based test oracles for performance testing of cyber‐physical systems: An industrial case study on elevators dispatching algorithms
Gartziandia, A., Arrieta, A., Ayerdi, J., Illarramendi, M., Agirre, A., Sagardui, G., & Arratibel, M. (2022) · Journal of Software Evolution and Process · doi:10.1002/smr.2465 · Cited by 14
Using deep learning for selenium web UI functional tests: A case-study with e-commerce applications
Khaliq, Z., Khan, D. A., & Farooq, S. U. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105446 · Cited by 14
A Taxonomy of Information Attributes for Test Case Prioritisation: Applicability, Machine Learning
Ramírez, A., FELDT, R. H., & Romero, J. R. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3511805 · Cited by 15
Pitfalls in Language Models for Code Intelligence: A Taxonomy and Survey
She, X., Liu, Y., Zhao, Y., He, Y., Li, L., Tantithamthavorn, C. K., Qin, Z., & Wang, H. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3748647 · Cited by 31
An Automated Path-Focused Test Case Generation with Dynamic Parameterization Using Adaptive Genetic Algorithm (AGA) for Structural Program Testing
Rajagopal, M., Ramkumar, S., Loganathan, K., & Sarris, I. E. (2023) · Information · doi:10.3390/info14030166 · Cited by 13
Using machine learning to generate test oracles: a systematic literature review
Fontes, A., & Gay, G. (2021) · doi:10.1145/3472675.3473974 · Cited by 13
Automating Fault Prediction in Software Testing Using Machine Learning Techniques: A Real-World Applications
Panda, P., Sahoo, D., & Sahoo, D. (2024) · International Conference on Sustainable Computing and Smart Systems (ICSCSS) · doi:10.1109/icscss60660.2024.10625524 · Cited by 11
AutoTestGPT: A System for the Automated Generation of Software Test Cases based on ChatGPT
Liu, H., Liu, L., Yue, C., Wang, Y., & Deng, B. (2024) · Journal of Software · doi:10.17706/jsw.19.4.108-120 · Cited by 12
A comprehensive review for test case prioritization in Software Engineering
Ashima, A., Shaheamlung, G., & Rote, K. (2020) · International Conference on Intelligent Engineering and Management (ICIEM) · doi:10.1109/iciem48762.2020.9160217 · Cited by 11
VALIDATE: A deep dive into vulnerability prediction datasets
Esposito, M., & Falessi, D. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107448 · Cited by 13
Potential Bottleneck and Measuring Performance of Serverless Computing: A Literature Study
Khatri, D., Khatri, S. K., & Mishra, D. (2020) · International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) · doi:10.1109/icrito48877.2020.9197837 · Cited by 10
Test Automation Framework using Soft Computing Techniques
Swathi, B., & Tiwari, H. (2021) · International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT) · doi:10.1109/icaect49130.2021.9392602 · Cited by 10
On Using Decision Tree Coverage Criteria forTesting Machine Learning Models
Santos, S. H. N., Silveira, B., Durelli, V. H. S., Durelli, R. S., Souza, S. R. S., & Delamaro, M. E. (2021) · Brazilian Symposium on Systematic and Automated Software Testing (SAST) · doi:10.1145/3482909.3482911 · Cited by 9
Self-citation
A survey on software test automation return on investment, in organizations predominantly from Bengaluru, India
Reanzi, S. R. D., & Thangaiah, P. R. J. (2021) · International Journal of Engineering Business Management · doi:10.1177/18479790211062044 · Cited by 9
Machine Learning for Software Engineering: A Systematic MappingPreprint
Shafiq, S., Mashkoor, A., Mayr‐Dorn, C., & Egyed, A. F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.13299 · Cited by 11
SimADFuzz: Simulation-Feedback Fuzz Testing for Autonomous Driving Systems
Yang, H., Zhou, Y., & Chen, T. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3744242 · Cited by 8
TestLab: An Intelligent Automated Software Testing Framework
Dias, T., Batista, A., Maia, E., & Praça, I. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-38318-2_35 · Cited by 8
Predicting Test Case Verdicts Using Textual Analysis of Committed Code Churns.
Al-Sabbagh, K. W., Staron, M., Hebig, R., & Meding, W. (2019) · Cited by 8
Neural Network Embeddings for Test Case PrioritizationPreprint
Lousada, J., & Ribeiro, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10154 · Cited by 8
Sustainability Integration of Artificial Intelligence into the Software Development Life Cycle
Trinh, E., Funke, M., Lago, P., & Bogner, J. (2024) · IEEE International Conference on Software Architecture Companion (ICSA-C) · doi:10.1109/icsa-c63560.2024.00044 · Cited by 9
Reinforcement learning for test case prioritization based on LLEed K-means clustering and dynamic priority factor
Qian, Z., Yu, Q., Hui, Z., Liu, J., & Fu, T. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107654 · Cited by 7
A systematic mapping study of crowd knowledge enhanced software engineering research using Stack Overflow
Tanzil, M. H., Chowdhury, S., Modaberi, S., Uddin, G., & Hemmati, H. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112405 · Cited by 7
Artificial Intelligence For Software Testing-Perspectives And Practices
Jha, N., & Popli, R. (2021) · International Conference on Computational Intelligence and Communication Technologies (CCICT) · doi:10.1109/ccict53244.2021.00075 · Cited by 10
Exploring potential implications of intelligent tools for human aspects of software engineering
Melegati, J., Nascimento, N., Chanin, R. M., Sales, A., & Wiese, I. (2024) · International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) · doi:10.1145/3641822.3641877 · Cited by 7
Understanding the factors that influence software testing through moments of translation
Sekgweleo, T., & Iyamu, T. (2022) · Journal of Systems and Information Technology · doi:10.1108/jsit-07-2021-0125 · Cited by 7
Using Machine Learning on Testing IoT Applications: a systematic mapping
Freitas, L. M., & Lelli, V. (2022) · Brazilian Symposium on Multimedia and the Web · doi:10.1145/3539637.3558049 · Cited by 7
Chapter 13 Engineering AI Systems
Bosch, J., Olsson, H. H., & Crnković, I. (2021) · Springer eBooks · doi:10.1007/978-3-031-10873-0_18 · Cited by 8
Reasoning-Based Software Testing
Giamattei, L., Pietrantuono, R., & Russo, S. (2023) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1109/icse-nier58687.2023.00018 · Cited by 6
ML-Based Software Defect Prediction in Embedded Software for Telecommunication Systems (Focusing on the Case of SAMSUNG ELECTRONICS)
Kang, H., & Do, S. (2024) · Electronics · doi:10.3390/electronics13091690 · Cited by 6
Agent-based Testing of Extended Reality Systems
Prada, R., Prasetya, I. S. W. B., Kifetew, F. M., Dignum, F. P. M., Vos, T. E. J., Lander, J., Donnart, J.-Y., Kazmierowski, A., Davidson, J., & Fernandes, P. M. (2020) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst46399.2020.00051 · Cited by 6
High-throughput design and performance validation of superior latent heat eutectic salt materials
Yang, F., Xuan, Y., & Liu, X. (2025) · Journal of Energy Storage · doi:10.1016/j.est.2025.115864 · Cited by 5
AutoQALLMs: Automating Web Application Testing Using Large Language Models (LLMs) and Selenium
Mallipeddi, S., Yaqoob, M., Khan, J. A., Mehmood, T., Mylonas, A., & Pitropakis, N. (2025) · Computers · doi:10.3390/computers14110501 · Cited by 5
A Novel Vision-Based Approach to Test Sequence Generation for Mobile GUI Testing
Cui, C., Huang, Y., Huang, R., Zhou, L., Wang, R., & Li, T. (2026) · IEEE Transactions on Reliability · doi:10.1109/tr.2025.3648728 · Cited by 6
A Novel approach of GUI Mapping with image based widget detection and classification
Jaganeshwari, K., & Djodilatchoumy, S. (2021) · International Conference on Intelligent Engineering and Management (ICIEM) · doi:10.1109/iciem51511.2021.9445281 · Cited by 5
Automatically Tagging the “AAA” Pattern in Unit Test Cases Using Machine Learning Models
Wei, C., Xiao, L., Yu, T., Chen, X., Wang, X., Wong, S., & Clune, A. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3252442 · Cited by 5
Bridging the Gap Between Academia and Industry in Machine Learning Software Defect Prediction: Thirteen Considerations
Stradowski, S., & Madeyski, L. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00026 · Cited by 7
A Multimodal conceptual framework to achieve automated software evolution for context-rich intelligent applications
Yue, S. (2024) · Innovations in Systems and Software Engineering · doi:10.1007/s11334-024-00591-0 · Cited by 9
A novel test case prioritization method based on problems of numerical software code statement defect prediction
Shao, Y., Liu, B., Wang, S., & Xiao, P. (2020) · Eksploatacja i Niezawodnosc - Maintenance and Reliability · doi:10.17531/ein.2020.3.4 · Cited by 5
Robotic Automation of Software Testing From a Machine Learning Viewpoint
Yadav, V., Botchway, R. K., Šenkeřík, R., & Oplatková, Z. K. (2021) · MENDEL · doi:10.13164/mendel.2021.2.068 · Cited by 5
Test Data Selection Based on Applying Mutation Testing to Decision Tree Models
Silveira, B., Durelli, V. H. S., Santos, S. H. N., Durelli, R. S., Delamaro, M. E., & Souza, S. R. S. (2023) · Brazilian Symposium on Systematic and Automated Software Testing (SAST) · doi:10.1145/3624032.3624038 · Cited by 5
Self-citation
A Two-Stage Framework for Ambiguous Classification in Software Engineering
Li, J., Lei, Y., Li, S., Zhou, H., Yu, Y., Jia, Z., Ma, Y., & Wang, T. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00070 · Cited by 6
The qualitative factor in software testing: A systematic mapping study of qualitative methods
Ardic, B., Brandt, C., Khatami, A., Swillus, M., & Zaidman, A. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112447 · Cited by 10
Revolutionizing Software Development: The Transformative Influence of Machine Learning Integrated SDLC Model
Mohapatra, H., Pramanik, S., & Mishra, S. R. (2025) · Artificial intelligence-enhanced software and systems engineering · doi:10.1007/978-3-031-88188-6_3 · Cited by 4
Refining software defect prediction through attentive neural models for code understanding
Nashaat, M., & Miller, J. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112266 · Cited by 5
Transforming QA Efficiency: Leveraging Predictive Analytics to Minimize Costs in Business-Critical Software Testing for the US Market
Joy, M. S., Alam, G. T., & Bakhsh, M. M. (2024) · Journal of Artificial Intelligence General science (JAIGS) · doi:10.60087/jaigs.v7i01.297 · Cited by 4
Regression Testing in Agile—A Systematic Mapping Study
Das, S., & Gary, K. A. (2025) · Software · doi:10.3390/software4020009 · Cited by 4
Application of Machine Learning on Software Quality Assurance and Testing: A Chronological Survey
Chen, H., & Hossain, M. A. (2022) · EPiC series in computing · doi:10.29007/5p9l · Cited by 5
Metamorphic relation automation: Rationale, challenges, and solution directions
Altamimi, E., Elkawakjy, A., & Catal, C. (2022) · Journal of Software Evolution and Process · doi:10.1002/smr.2509 · Cited by 4
Rational Jacobi Kernel Functions: A novel massively parallelizable orthogonal kernel for support vector machines
Moghaddam, M. M., Aghaei, A. A., & Parand, K. (2024) · International Conference on Distributed Computing and High Performance Computing (DCHPC) · doi:10.1109/dchpc60845.2024.10454075 · Cited by 4
Proceedings of the 2024 IEEE/ACM 17th International Conference on Cooperative and Human Aspects of Software Engineering
(2024) · doi:10.1145/3641822 · Cited by 4
Reimagining Unit Test Generation With AI: A Journey From Evolutionary Models to Transformers
Esubalew, S. Z., & Assefa, B. G. (2025) · IEEE Access · doi:10.1109/access.2025.3597049 · Cited by 3
Sustainable Reconstruction Planning from Natural Disasters (Earthquakes): A Systematic Mapping Study of Machine Learning and Technological Approaches
Mudassir, G., & Marco, A. D. (2025) · Sustainability · doi:10.3390/su172210035 · Cited by 3
Chapter 8 Recognizing Lines of Code Violating Company-Specific Coding Guidelines Using Machine Learning
Ochodek, M., Hebig, R., Meding, W., Frost, G., & Staron, M. (2019) · Springer eBooks · doi:10.1007/978-3-031-10873-0_11 · Cited by 3
When debugging encounters artificial intelligence: state of the art and open challenges
Song, Y., Xie, X., & Xu, B. (2024) · Science China Information Sciences · doi:10.1007/s11432-022-3803-9 · Cited by 4
Software Quality Assessment Model: A New Approach for Software Testing Tools
Zulkifli, Z., Mardiana, M., & Despa, D. (2024) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194024500517 · Cited by 3
Can explainable artificial intelligence support software modelers in model comprehension?
Alcaide, F. J., Romero, J. R., & Ramírez, A. (2025) · Software & Systems Modeling · doi:10.1007/s10270-024-01251-4 · Cited by 3
Software Test Automation Using Selenium and Machine Learning
Jha, N., Popli, R., Chakraborty, S., & Kumar, P. R. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-16-6246-1_35 · Cited by 4
Enhancing Software Testing with Machine Learning Techniques
Akila, V., Vasuki, A., Christaline, J. A., Sathiya, R., Rishi, P., & Edward, A. S. (2023) · International Conference on Sustainable Computing and Data Communication Systems (ICSCDS) · doi:10.1109/icscds56580.2023.10105028 · Cited by 3
Review of Software Model-Checking Techniques for Dealing with Error Detection in Program Codes
Aliyu, E. O. (2023) · Journal of Software Engineering and Applications · doi:10.4236/jsea.2023.166010 · Cited by 3
Towards the definition of a research agenda on mobile application testing based on a tertiary study
Kuroishi, P. H., Maldonado, J. C., & Vincenzi, A. M. R. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107363 · Cited by 3

Authors: Durelli, V. H. S., Durelli, R. S., Borges, S. S., Endo, A. T., Eler, M. M., Dias, D. R. C., & Guimaraes, M. P.
Affiliations: Universidade Federal de Lavras (BR)
Universidade Tecnológica Federal do Paraná (BR)
Universidade de São Paulo (BR)
Federal University of São João del-Rei (BR)
ORCID: Durelli, Vinicius H. S.
Durelli, Rafael S.
Borges, Simone S.
Endo, Andre T.
Eler, Marcelo M.
Dias, Diego R. C.
Guimaraes, Marcelo P.
Venue: IEEE Transactions on Reliability
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Published: 2019-09
Volume: 68
Issue: 3
Pages: 1189-1212
ISSN: 0018-9529 (ISSN-L)
1558-1721
DOI: 10.1109/tr.2019.2892517
OpenAlex: W2912899164
Cited by: 207
References: 93
Citations by year: 2026: 13 · 2025: 42 · 2024: 33 · 2023: 28 · 2022: 36 · 2021: 23 · 2020: 21 · 2019: 5
FWCI: 51.06
Type: journal article
Language: en
Open access: closed
Licence: ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Transactions on Reliability (publishedVersion)
Funders: CNPq/Brazil (420363/2018-1)
Topics: Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
Physical Sciences › Computer Science › Information Systems › Software Engineering Research
Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
Keywords: machine learning, software testing, test automation, test case generation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Machine Learning Applied to Software Testing: A Systematic Mapping Study

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks