A Survey on Software Fault Localization
The DOI matches its Crossref record; 436 of the 451 references it cites were found in a registry or an index.
Abstract
Software fault localization, the act of identifying the locations of faults in a program, is widely recognized to be one of the most tedious, time consuming, and expensive - yet equally critical - activities in program debugging. Due to the increasing scale and complexity of software today, manually locating faults when failures occur is rapidly becoming infeasible, and consequently, there is a strong demand for techniques that can guide software developers to the locations of faults in a program with minimal human intervention. This demand in turn has fueled the proposal and development of a broad spectrum of fault localization techniques, each of which aims to streamline the fault localization process and make it more effective by attacking the problem in a unique way. In this article, we catalog and provide a comprehensive overview of such techniques and discuss key issues and concerns that are pertinent to software fault localization as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, Steinder et al. [21], Wong et al. [24], and Solé et al. [25] described the process of root-cause identification but did not focus on the microservices architecture.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [24]
Citations
Cites
Cousot, P., & Cousot, R. (1977) · Proceedings of the 4th ACM SIGACT-SIGPLAN symposium on Principles of programming languages - POPL '77 · doi:10.1145/512950.512973 · Cited by 6,279 · cited 1×
“lem, Mayer and Stumptner [246] propose an abstractionbased model in which abstract interpretation [55], [78] is applied to handle loops, recursive procedures, and heap data structures.”
BackgroundBasic concepts and taxonomy of dependable and secure computing
Avizienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,223 · cited 1×
“The following terms appear repeatedly throughout this article, and thus for convenience, we provide definitions for them here per the taxonomy provided in [37]: A failure is when a service deviates from its correct behavior.”
BackgroundCAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Weiser, M. (1984) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1984.5010248 · Cited by 3,204
A theory of diagnosis from first principles
Reiter, R. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90062-2 · Cited by 3,031 · cited 1×
“While using model-based diagnosis [301], it is assumed that a correct model of each program being diagnosed is available.”
MethodFundamentals of neural networks: architectures, algorithms, and applications
Fausett, L. V. (1994) · CERN Document Server (European Organization for Nuclear Research) · Cited by 3,025
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
Theory of the backpropagation neural network
Hecht-Nielsen (1989) · International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1989.118638 · Cited by 2,222
de Kleer, J., & Williams, B. C. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90063-4 · Cited by 2,039
Lewis, D. (1973) · The Journal of Philosophy · doi:10.2307/2025310 · Cited by 1,914
Research works printed but not linked: 17
- jannach, 0, Toward model-based debugging of spreadsheet programs, Proc Knowledge-Based Software Eng Conf, 252
- panko, 2006, Facing the problem of spreadsheet errors, Decision Line, 37, 8
- he, 0, Automated debugging using path-based weakest preconditions, Proc 8th Int Conf Fundam Approaches Softw Eng, 267
- lewis, 1973, Counterfactuals
- lucia lo, 0, Fusing fault localizers, IEEE Int Conf on Auto Soft Eng, 127
- lyle, 0, Automatic program bug location by program slicing, Proc Int Conf Comput Appl, 877
- grottke, 0, A classification of software faults, Proc 16th IEEE Int Symp Softw Rel Eng, 419
- mayer, 0, Prioritizing model-based debugging diagnostic reports, Proc Int Workshop Principles Diagnosis, 127
- mayer, 2004, Approximate modeling for debugging of program loops, Proc Int Workshop Principles Diagnosis, 87
- moon, 2014, Effective software fault localization using dynamic program behaviors, Master thesis
- gong, 0, Diversity maximization speedup for fault, Proc Int Conf Autom Softw Eng, 30
- torlak, 0, MemSAT: Checking axiomatic specifications of memory models, Proc ACM SIGPLAN Conf Programming Language Design and Implementation, 341
- vayani, 2007, Improving automatic software fault localization, Master thesis
- wu, 0, A statistical model to locate faults at input levels, Proc Int Conf Autom Softw Eng, 274
- collofello, 0, Towards automatic software fault localization through decision-to-decision path analysis, Proc Nat Comput Conf, 539
- stumptner, 0, Debugging functional program, Proc Int Joint Conf Artif Intell, 440
- xie, 0, Provably optimal and human-competitive results in SBSE for spectrum based fault localization, Proc 2nd Int Symp Search Based Software Eng, 224
Cited by
Items 401–500 of 1,006
Effective Isolation of Fault-Correlated Variables via Statistical and Mutation Analysis
Wen, M., Xie, Z., Luo, K., Chen, X., Yang, Y., & Jin, H. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3209590 · Cited by 13
“Program state-based techniques have also attracted considerable research attention over the years [24], which locate bugs via inspecting the variables and their values at a particular point during program execution.”
BackgroundMethodInfluentialImproving Fault Localization Using Model-domain Synthesized Failing Test Generation
Zhang, Z., Lei, Y., Mao, X., Yan, M. L., & Xia, X. (2022) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme55016.2022.00026 · Cited by 12
“Benchmarks The experiments choose the subject programs fro the three reasons: (1) they are the widely used large-sized programs ( e.g., [1], [10]–[13], [16]) in fault localization; (2) they are large-sized programs at least more than 5 KLOC; (3) they are easy to be acquired for enabling comparable…”
BackgroundMethodMetaFL: Metamorphic fault localisation using weakly supervised deep learning
Fu, L., Lei, Y., Yan, M. L., Xu, L., Zhou, X., & Zhang, X. (2023) · IET Software · doi:10.1049/sfw2.12102 · Cited by 12
ElGhondakly, R., Moussa, S. M., & Badr, N. L. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110430 · Cited by 11
A systematic mapping study of bug reproduction and localization
Wang, D., Galster, M., & Morales-Trujillo, M. E. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107338 · Cited by 13
Can we spot energy regressions using developers tests?
Danglot, B., Falleri, J., & Rouvoy, R. (2024) · Empirical Software Engineering · doi:10.1007/s10664-023-10429-1 · Cited by 11
Neural-MBFL: Improving Mutation-Based Fault Localization by Neural Mutation
Du, B., Han, B., Liu, H., Chang, Z., Liu, Y., & Chen, X. (2024) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac61105.2024.00168 · Cited by 14
“In software debugging, a critical step is fault localization, which aims at accurately localizing the specific locations of code that cause the test fail [1].”
BackgroundLightweight fault localization combined with fault context to improve fault absolute rank
Wang, Y., Huang, Z., Li, Y., & Fang, B. (2017) · Science China Information Sciences · doi:10.1007/s11432-017-9112-2 · Cited by 11
Self-citationAn Empirical Study on the Effect of Dynamic Slicing on Automated Program Repair Efficiency
Guo, A., Mao, X., Yang, D., & Wang, S. (2018) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2018.00066 · Cited by 11
“To study the effect of dynamic slicing on program repair under different SFL techniques, we implement two formulas, including Tarantula and Jaccard [13], in Nopol.”
MethodSearch-based fault localisation: A systematic mapping study
Leitao-Junior, P. S., de Freitas, D. M., Vergílio, S. R., Camilo-Junior, C. G., & Harrison, R. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106295 · Cited by 11
“In this context there has been renewed interest in proposals for fault localisation methods, and as a result literature-reviewing papers of such research area have been published [4, 18] and the number of papers has increased since 2001 [4].”
BackgroundMethodA Model with Iterative Trials for Correcting Logic Errors in Source Code
Matsumoto, T., Watanobe, Y., & Nakamura, K. (2021) · Applied Sciences · doi:10.3390/app11114755 · Cited by 14
Variability fault localization
Ngo, K.-T., Nguyen, T.-T., Nguyen, S., & Vo, H. D. (2021) · International Software Product Line Conference (SPLC) · doi:10.1145/3461001.3473058 · Cited by 11
“In this challenge, we apply the standard metrics which are widely used in evaluating FL techniques [4, 13, 14, 21, 23, 24].”
MethodInfluentialA Variability Fault Localization Approach for Software Product Lines
Nguyen, T.-T., Ngo, K.-T., Nguyen, S., & Vo, H. D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3113859 · Cited by 11
“identify the locations of faults in programs [9], [53], [54], [55].”
BackgroundMethodInfluentialIsolating Compiler Optimization Faults via Differentiating Finer-grained Options
Yang, J., Yang, Y., Sun, M., Wen, M., Zhou, Y., & Jin, H. (2022) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner53432.2022.00065 · Cited by 11
Bug localization in game software engineering
Casamayor, R., Arcega, L., Pérez, F., & Cetina, C. (2022) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1145/3550355.3552440 · Cited by 11
“principle as other approaches in the literature [34].”
BackgroundInfluentialFlaky Test Sanitisation via On-the-Fly Assumption Inference for Tests with Network Dependencies
Dietrich, J. B., Rasheed, S., & Tahir, A. (2022) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam55253.2022.00037 · Cited by 15
“The results are analysed using a spectrum-based localisation technique [34] that assigns a suspiciousness value and ranking to each configuration to determine the most likely factors that caused the flakiness.”
MethodDupHunter: Detecting Duplicate Pull Requests in Fork-Based Development
Jiang, H., Li, Y., Guo, S., Li, X., Zhang, T., Li, H., & Chen, R. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3235942 · Cited by 13
“We assume that developers check PR pairs in the list from top to bottom [39].”
BackgroundSelf-citationApproaches to Fault Localization in Combinatorial Testing: A Survey
Jayaram, R., & Krishnan, R. (2017) · Smart innovation, systems and technologies · doi:10.1007/978-981-10-5547-8_55 · Cited by 11
Fault localization using itemset mining under constraints
Maamar, M., Lazaar, N., Loudni, S., & Lebbah, Y. (2016) · Automated Software Engineering · doi:10.1007/s10515-015-0189-z · Cited by 11
“We used a common metric in fault localization, the exam score (Wong and Debroy, 2009) that measures the effectiveness of a given fault localization technique.”
MethodDu, B., Cai, Y., Wang, H., Liu, Y., & Chen, X. (2022) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre55969.2022.00038 · Cited by 10
“Previous studies [2]–[4] have shown that SBFL is simple, lightweight, and efficient.”
BackgroundMethodLarge Language Models for Automated Program Repair
Ribeiro, F. (2023) · ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity (SPLASH) · doi:10.1145/3618305.3623587 · Cited by 18
Dynamic Data Fault Localization for Deep Neural Networks
Yin, Y., Feng, Y., Weng, S., Liu, Z., Yao, Y., Zhang, Y., Zhao, Z., & Chen, Z. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616345 · Cited by 15
“Essentially, just as the code faults explicitly influence the program behavior through test case execution [62, 83], defects hidden in the dataset impact the model’s internal parameters during training, which in turn leads to potential vulnerabilities in the model [53, 71]. to manually label the…”
BackgroundInstruction Sequence Faults with Formal Change Justification
Bergstra, J. A. (2020) · Scientific Annals of Computer Science · doi:10.7561/sacs.2020.2.105 · Cited by 10
“For the extensive survey of fault localization techniques in [52] it suffices to know that a fault is the underlying cause of an error, which itself is a precondition for a fault, without further explanation of causation in this context.”
BackgroundTowards boosting patch execution on-the-fly
Benton, S., Xie, Y., Lu, L., Zhang, M., Li, X., & Zhang, L. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510117 · Cited by 10
“localization [19] techniques (such as Ochiai [20] and Tarantula [21]) to identify potential buggy locations.”
BackgroundA comprehensive empirical investigation on failure clustering in parallel debugging
Song, Y., Xie, X., Liu, Q., Zhang, X., & Wu, X. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111452 · Cited by 10
Spectrum-based feature localization for families of systems
Michelon, G. K., Martinez, J., Sotto-Mayor, B., Arrieta, A., Assunção, W. K. G., Abreu, R., & Egyed, A. F. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111532 · Cited by 10
Self-citationBL-GAN: Semi-Supervised Bug Localization via Generative Adversarial Network
Zhu, Z., Tong, H., Wang, Y., & Li, Y. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3225329 · Cited by 15
“Various surveys on hundreds of software development projects undeniably reveal that bugs often appear in software development [1], [2], [3].”
BackgroundSelf-citationCode-aware fault localization with pre-training and interpretable machine learning
Zhang, Z., Li, Y., Yang, S., Zhang, Z., & Lei, Y. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121689 · Cited by 11
Self-citationTrace matrix optimization for fault localization
Hu, J. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111900 · Cited by 11
Delta4Ms: Improving mutation‐based fault localization by eliminating mutant bias
Liu, H., Li, Z., Han, B., Liu, Y., Chen, X., & Liu, Y. (2024) · Software Testing Verification and Reliability · doi:10.1002/stvr.1872 · Cited by 10
Evaluating the Effectiveness of BEN in Localizing Different Types of Software Fault
Chandrasekaran, J., Ghandehari, L. S., Lei, Y., Kacker, R. N., & Kuhn, D. R. (2016) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw.2016.44 · Cited by 10
MD-ART: a test case generation method without test oracle problem
Hui, Z., & Huang, S. (2016) · doi:10.1145/2975954.2975959 · Cited by 10
Parameter Optimization in Control Software Using Statistical Fault Localization Techniques
Deshmukh, J. V., Jin, X., Majumdar, R., & Prabhu, V. S. (2018) · ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1109/iccps.2018.00029 · Cited by 10
Optimising Spectrum Based Fault Localisation for Single Fault Programs Using Specifications
Landsberg, D., Sun, Y., & Kroening, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-89363-1_14 · Cited by 11
“of the most prominent areas of software fault localisation research, estimated to make up 35% of published work in the field to date [3], and has been demonstrated to be efficient and effective at finding faults [4–12].”
BackgroundHellhake, D., Schmid, T., & Wagner, S. (2019) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2019.00051 · Cited by 10
“This is usually done when reproducing the failure occurrence during fault localization based on traces contained in the failure reports [19].”
BackgroundEffective Fault Localization using an Ensemble Classifier
Dutta, A., Pant, N., Mitra, P., & Mall, R. (2019) · International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering · doi:10.1109/qr2mse46217.2019.9021187 · Cited by 10
“In order to relieve the programmer from the tedious job of bug localization, a large number of automated fault localization (FL) techniques have been proposed [7, 8, 16, 21].”
BackgroundMethodUsing Fine-Grained Test Cases for Improving Novice Program Fault Localization
Li, Z., Yu, D., Wu, Y., & Liu, Y. (2020) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac48688.2020.00032 · Cited by 10
“Nowadays dozens of fault localization techniques have been proposed, and experimental studies proved that fault localization techniques are quite effective on artificial faults [5].”
BackgroundMethodInfluentialFactorials Experiments, Covering Arrays, and Combinatorial Testing
Kacker, R. N., Kuhn, D. R., Lei, Y., & Simos, D. E. (2021) · Mathematics in Computer Science · doi:10.1007/s11786-021-00502-7 · Cited by 11
Ahead of Time Mutation Based Fault Localisation using Statistical Inference
Kim, J.-H., An, G., FELDT, R. H., & Yoo, S. (2021) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre52982.2021.00036 · Cited by 11
Identifying Coincidental Correct Test Cases with Multiple Features Extraction for Fault Localization
Wu, Y., Tian, S., Yang, Z., Li, Z., Liu, Y., & Chen, X. (2023) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac57700.2023.00109 · Cited by 10
“To address this, we employ the average rank strategy, a widely used strategy in previous works [29].”
BackgroundMethodFast Model-Based Fault Localisation with Test Suites
Birch, G., Fischer, B., & Poppleton, M. R. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-21215-9_3 · Cited by 10
Slicing ATL model transformations for scalable deductive verification and fault localization
Cheng, Z., & Tisi, M. (2018) · International Journal on Software Tools for Technology Transfer · doi:10.1007/s10009-018-0491-8 · Cited by 10
“Ideally, one of the most user-friendly solutions would be the introduction of fault localization techniques [37,44], in order to directly point to the part of MT code that is responsible for the fault.”
BackgroundOn the use of sequence mining within spectrum based fault localisation
Laghari, G., & Demeyer, S. (2018) · ACM Symposium on Applied Computing · doi:10.1145/3167132.3167337 · Cited by 10
“Fault localisation is widely acknowledged to be one of the more difficult and time consuming steps while fixing defects and it is, therefore, a heavily investigated research topic [33].”
BackgroundEvaluating the Strategies of Statement Selection in Automated Program Repair
Yang, D., Qi, Y., & Mao, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-04272-1_3 · Cited by 13
Why train-and-select when you can use them all? ensemble model for fault localisation
Sohn, J., & Yoo, S. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321873 · Cited by 11
“, program spectrum as well as code and change metrics), other techniques such as Information Retrieval (IR) [22, 37, 40], mutation analysis [16, 26], invariant mining [1], and program slicing [35] have been applied to fault localisation.”
Compiler Bug Isolation via Enhanced Test Program Mutation
Liu, Y., Zhu, M., Dong, J., Yu, J., & Hao, D. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695074 · Cited by 9
“Elements frequently covered by failing tests and less by passing ones are considered more likely to be buggy [28, 36].”
Wang, B., Deng, M., Chen, M., Lin, Y., Zhou, J., & Zhang, J. M. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00549-x · Cited by 13
“In this section, we introduce the related work of this study, including LLM for code-related tasks, FL, and APR appraoches.”
Adaptive Immunity for Software: Towards Autonomous Self-healing Systems
Naqvi, M. A., Astekin, M., Malik, S., & Moonen, L. (2021) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner50967.2021.00058 · Cited by 10
“Starting points include diagnosis techniques such as spectrumbased fault localization (SFL) [44, 45], and more recent approaches based on convolutional neural networks [46].”
BackgroundPredicting Crash Fault Residence via Simplified Deep Forest Based on A Reduced Feature Set
Zhao, K., Liu, J., Zhou, X., Li, L., Yan, M. L., Yu, J., & Zhou, Y. (2021) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc52881.2021.00031 · Cited by 9
BatFix: Repairing language model-based transpilation
Ramos, D., Lynce, I., Manquinho, V. M., Martins, R., & Goues, C. L. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3658668 · Cited by 16
“The task of identifying bugs in code is known as fault localization [55, 73].”
Fault localization by abstract interpretation and its applications
Dimovski, A. S. (2024) · Journal of Computer Languages · doi:10.1016/j.cola.2024.101288 · Cited by 10
Benzene: A Practical Root Cause Analysis System with an Under-Constrained State Mutation
Park, Y., Lee, H., Jung, J., Koo, H., & Kim, H. K. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00074 · Cited by 18
“A crucial phase of software debugging is the RCA (also referred to as fault localization [118] in the literature) for deducing a site(s) that triggers a bug, which helps a developer to find the fault location(s).”
BackgroundAn Exploratory Analysis on Software Developers' Bug-Introducing Tendency over Time
Li, Y., Li, D., Huang, F., Lee, S.-Y., & Ai, J. (2016) · International Conference on Software Analysis, Testing and Evolution (SATE) · doi:10.1109/sate.2016.9 · Cited by 9
“Keywords—Bug-introducing commit; human errors; software developers; metrics; bug-introducing tendency”
Self-citationRobustness of spectrum-based fault localisation in environments with labelling perturbations
Xu, Y., Yin, B., Zheng, Z., Zhang, X., Li, C., & Yang, S. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.09.091 · Cited by 9
The use of decision table for reducing complex rules in software testing
Joosten, J., Permanasari, A. E., & Adji, T. B. (2020) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/732/1/012086 · Cited by 9
“More than half the cost of fixing bugs given to software users is given to developers and vendors [6].”
BackgroundAlhumam, A. (2021) · Sensors · doi:10.3390/s21217401 · Cited by 9
“Traditionally, fault localization, which focuses on locating defects in software manually, has been a difficult, time-consuming, and costly job because of the complexity of large-scale software systems [1].”
BackgroundMethod Calls Frequency-Based Tie-Breaking Strategy For Software Fault Localization
Sarhan, Q. I., Vancsics, B., & Beszédes, Á. (2021) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam52516.2021.00021 · Cited by 9
Majd, A., Vahidi-Asl, M., Khalilian, A., & Bagheri, B. (2022) · Applied Intelligence · doi:10.1007/s10489-021-02954-7 · Cited by 9
“The Jaccard formula is defined as ( N CF ) / ( N CF + N UF + N CS ).”
BackgroundMethodInfluentialIdentifying Incorrect Patches in Program Repair Based on Meaning of Source Code
Phung, Q.-N., Kim, M., & Lee, E. (2022) · IEEE Access · doi:10.1109/access.2022.3145983 · Cited by 15
Learning Fault Localisation for both Humans and Machines Using Multi-objective GP
Choi, K., Sohn, J., & Yoo, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99241-9_20 · Cited by 9
“Genetic Programming has been successfully applied to fault localisation [9], initially to learn individual Spectrum-Based Fault Localisation (SBFL) risk evaluation formulæ [11] and subsequently to learn more complicated ranking models that take multiple SBFL formulæ as well as code and change metrics as input and prod…”
BackgroundIdentifying Crashing Fault Residence Based on Cross Project Model
Zhou, X., Zhang, T., Zhang, Y., Tang, Y., Liu, J., Luo, X., Keung, J., & Cui, X. (2019) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2019.00027 · Cited by 9
“This process is called crash localization (or fault localization) [1].”
BackgroundInvestigating the Configurations of an Industrial Path Planner in Terms of Collision Avoidance
Zhang, X., Arcaini, P., Ishikawa, F., & Liu, K. (2020) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre5003.2020.00036 · Cited by 10
“III-B and III-C are adapted from Spectra-Based Fault Localization (SBFL) [41], [42], [24].”
MethodFTFL: A Fisher’s test-based approach for fault localization
Dutta, A., Kunal, K., Srivastava, S. S., Shankar, S., & Mall, R. (2021) · Innovations in Systems and Software Engineering · doi:10.1007/s11334-021-00403-9 · Cited by 9
Model Based Diagnosis of Multiple Observations with Implicit Hitting SetsPreprint
Ignatiev, A., Morgado, A., & Marques-Silva, J. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01972 · Cited by 9
TransMap: Pinpointing Mistakes in Neural Code Translation
Wang, B., Li, R., Li, M., & Saxena, P. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616322 · Cited by 16
“This setup is unlike that in fault localization [5, 26, 28, 41, 44, 59] or repair [17, 18, 21, 34, 57] which works with the same program.”
BackgroundJavaScript Language Design and Implementation in Tandem
Ryu, S., & Park, J. (2024) · Communications of the ACM · doi:10.1145/3624723 · Cited by 9
Integrating neural mutation into mutation-based fault localization: A hybrid approach
Liu, H., Li, Z., Han, B., Chen, X., Paul, D., & Liu, Y. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112281 · Cited by 9
Effectiveness of Weighted Neural Network on Accuracy of Software Fault Localization
Heris, S. R., & Keyvanpour, M. R. (2019) · International Conference on Web Research (ICWR) · doi:10.1109/icwr.2019.8765262 · Cited by 8
“It is a costly and grueling process [4].”
BackgroundSpectrum-based feature localization
Michelon, G. K., Sotto-Mayor, B., Martinez, J., Arrieta, A., Abreu, R., & Assunção, W. K. G. (2021) · International Software Product Line Conference (SPLC) · doi:10.1145/3461001.3473065 · Cited by 8
“Using a spectrum, numerous ranking metrics [24] have been proposed to create a ranking of suspiciousness, i.e., trying to point developers to the lines that are potentially creating the issue or at least narrowing the part of the source code that is worthy to examine or debug.”
BackgroundMethodInfluentialSelf-citationGraph Neural Network based Two-Phase Fault Localization Approach
Li, Z., Tang, E., Chen, X., Wang, L., & Li, X. (2022) · Asia-Pacific Symposium on Internetware · doi:10.1145/3545258.3545266 · Cited by 8
“[29] point out that simple SBFL is easy to find the basic block which contains the faulty element, but not the specific location in the block.”
BackgroundT-Evos: A Large-Scale Longitudinal Study on CI Test Execution and Failure
Chen, A. R., Chen, T.-H. P., & Wang, S. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3218264 · Cited by 12
“For example, researchers have proposed using code coverage information in failed test cases for tasks such as bug localization [1], [2], [3], [4], [5] and automated program repair [6], [7], [8].”
BackgroundGlock, J., Pichler, J., & Pinzger, M. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112037 · Cited by 8
“Similarly, spectrum-based fault localization formulas (Wong et al., 2016) could be adapted to use di ff erent weighting factors that consider the information provided by best e ff ort classifications with a lower weight than the information provided by non-/ equivalence proofs.”
MethodDeepCNN: A Dual Approach to Fault Localization and Repair in Convolutional Neural Networks
Wardat, M., & Al-Alaj, A. (2024) · IEEE Access · doi:10.1109/access.2024.3384981 · Cited by 10
“These methods fall into eight main categories [18]: spectrum-based [19], [20], slice-based [21], [22], statistics-based [23], [24], program state-based [25], machine learning-based [26], [27], model-based [28], data mining-based [29], and miscellaneous techniques [30].”
A New Interactive Fault Localization Method with Context Aware User Feedback
Horváth, F., Lacerda, V. S., Beszédes, Á., Vidács, L., & Gyimóthy, T. (2019) · IEEE International Workshop on Intelligent Bug Fixing (IBF) · doi:10.1109/ibf.2019.8665415 · Cited by 8
Do Bug-Fix Types Affect Spectrum-Based Fault Localization Algorithms' Efficiency?
Szatmári, A., Vancsics, B., & Beszédes, Á. (2020) · doi:10.1109/vst50071.2020.9051638 · Cited by 8
“For example, the type IF-ABR is rather put in the (3,5] interval and MC-DAP is a bit more likely to be put in the [1] interval than other types.”
BackgroundMethodInfluentialImproving the Accuracy of Spectrum-based Fault Localization for Automated Program Repair
Kuma, T., Higo, Y., Matsumoto, S., & Kusumoto, S. (2020) · International Conference on Program Comprehension · doi:10.1145/3387904.3389290 · Cited by 8
“Spectrum-Based Fault Localization (in short, SBFL ), which is a kind of FL based on execution paths of test cases, is one of the most actively studied methods in recent years [14].”
MethodPrecfix: large-scale patch recommendation by mining defect-patch pairs
Zhang, X., Zhu, C., Li, Y., Guo, J., Liu, L., & Gu, H. (2020) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3377813.3381356 · Cited by 13
Self-citationExploring the Triggering Modes of Spectrum-Based Fault Localization: An Industrial Case
Dao, T. M., Wang, M., & Meng, N. (2021) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst49551.2021.00052 · Cited by 8
“Researchers empirically studied fault localization techniques in various ways [31], [32], [7], [33], [34].”
BackgroundAssisting Bug Report Assignment Using Automated Fault Localisation: An Industrial Case Study
Sohn, J., An, G., Hong, J., Hwang, D., & Yoo, S. (2021) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst49551.2021.00041 · Cited by 8
“We have applied Spectrum-based Fault Localisation (SBFL) [29], an automated localisation technique that uses test results as well as test coverage information, to these known test executions and evaluated how precisely SBFL techniques can identify the components responsible for the failure in each…”
BackgroundMethodInfluentialQayum, A., Khan, S. U. R., Rehman, I. U., & Akhunzada, A. (2022) · IEEE Access · doi:10.1109/access.2022.3151395 · Cited by 8
“However, it becomes a worst, hectic and much time-consuming task when the software system is large, that is, many thousands to a millions line of codes [5].”
BackgroundDigBug—Pre/post-processing operator selection for accurate bug localization
Kim, K., Ghatpande, S., Liu, K., Koyuncu, A., Kim, D., Bissyandé, T. F., Klein, J., & Traon, Y. L. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111300 · Cited by 10
“Based on the information, SBFL techniques provide a ranked list of suspicious locations (generally, specific lines or blocks in a program).”
InfluentialFDG: a precise measurement of fault diagnosability gain of test cases
An, G., & Yoo, S. (2022) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3533767.3534370 · Cited by 11
CRMF: A fault localization approach based on class reduction and method call frequency
Liu, H., Li, Z., Wang, H., Liu, Y., & Chen, X. (2022) · Software Practice and Experience · doi:10.1002/spe.3178 · Cited by 9
“From the called times by failed test cases, M3 is called most (17), followed by M6 (9) and M5 (6), while the two faulty methods M1 and M4 are called least (2).”
BackgroundMethodSearch-based Testing for Accurate Fault Localization in CPS
Bartocci, E., Mariani, L., Ničković, D., & Yadav, D. (2022) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre55969.2022.00024 · Cited by 8
“From the perspective of software engineering, fault localization has remained to offer continually increasing challenges [39], [40].”
BackgroundEvent-aware precise dynamic slicing for automatic debugging of Android applications
Win, H. M., Tan, S. H., & Sui, Y. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111606 · Cited by 8
A fault localization approach based on fault propagation context
Yan, Y. P., Jiang, S., Zhang, Y., Zhang, S., & Zhang, C. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107245 · Cited by 8
The MAP Metric in Information Retrieval Fault Localization
Hirsch, T., & Hofer, B. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00041 · Cited by 8
“To support developers in their work, researchers have proposed various approaches to automate this task [3].”
MethodA study of common bug fix patterns in Rust
Shirzad, M. R., & Lam, P. (2024) · Empirical Software Engineering · doi:10.1007/s10664-023-10437-1 · Cited by 8
“If a fault localization tool knows about the common bug patterns that can appear in the underlying programming language, it can prioritize candidates based on their bug-producing potential.”
The Failure Behaviors of Multi-Faults Programs: An Empirical Study
Xiaobo, Y., Liu, B., & Li, J. (2017) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c.2017.11 · Cited by 8
“Most fault localization methods assume that each program has a single bug [5].”
BackgroundToward Understanding Information Models of Fault Localization: Elaborate is Not Always Better
Lei, Y., Mao, X., Zhang, M., Ren, J., & Jiang, Y. (2017) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2017.246 · Cited by 8
“More other work on fault localization can refer to a recent survey [25] by”
BackgroundTrEKer: Tracing error propagation in operating system kernels
Coppik, N., Schwahn, O., Winter, S., & Suri, N. (2017) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115650 · Cited by 8
“give an extensive overview [38].”
Poster: Aiding Java Developers with Interactive Fault Localization in Eclipse IDE
Balogh, G., Horváth, F., & Beszédes, Á. (2019) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2019.00045 · Cited by 8
“In particular, we present a technique to aid SpectrumBased Fault Localization (SBFL), a class of FL methods popular among researchers [1].”
MethodModel-Based Test Suite Generation Using Mutation Analysis for Fault Localization
Choi, Y.-M., & Lim, D.-J. (2019) · Applied Sciences · doi:10.3390/app9173492 · Cited by 8
“To overcome this problem, slice-based, spectrum-based (coverage-based), statistics-based, and program state-based methods were studied as advanced fault-localization techniques, of which the spectrum-based technique was the most frequently studied [16].”
BackgroundMethodInfluentialHOTFUZ: Cost‐effective higher‐order mutation‐based fault localization
Jang, J., Ryu, D., & Baik, J. (2021) · Software Testing Verification and Reliability · doi:10.1002/stvr.1802 · Cited by 8
“Spectrum-based fault localization (SBFL) techniques are the most widely studied and used fault localization techniques [1].”
BackgroundAn Empirical Study on Higher-Order Mutation-Based Fault Localization
Wang, H., Li, Z., Liu, Y., & Chen, X. (2022) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194022500012 · Cited by 8
Symptomatic Bug Localization for Functional Debug of Hardware Designs
Pal, D., & Vasudevan, S. (2016) · International Conference on VLSI Design · doi:10.1109/vlsid.2016.14 · Cited by 8
“Debugging and bug localization have had a long history in software programs [16].”
BackgroundHow Developers Debug Software — The DBGBENCH Dataset
Böhme, M., Soremekun, E., Chattopadhyay, S., Ugherughe, E., & Zeller, A. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-c.2017.94 · Cited by 9
“Automated Fault Localization (AFL), the identification of a ranked list of most suspicious statements, is a major topic in automated debugging research; a recent literature survey on AFL cites more than 400 papers [1].”
BackgroundInfluentialTest case selection using multi-criteria optimization for effective fault localization
Wang, K., Wang, T., & Su, X. (2018) · Computing · doi:10.1007/s00607-018-0610-0 · Cited by 8
DRAST -- A Deep Learning and AST Based Approach for Bug LocalizationPreprint
Sangle, S., Muvva, S., Chimalakonda, S., Ponnalagu, K., & Venkoparao, V. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03449 · Cited by 10
Differential Performance Debugging With Discriminant Regression Trees
Tizpaz-Niari, S., Černý, P., Chang, B.-Y. E., & Trivedi, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11875 · Cited by 7
Metadata
- Authors
- Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F.
- Affiliations
- The University of Texas at Dallas (US)
- Palo Alto Research Center (US)
- Graz University of Technology (AT)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2016-08-01
- Volume
- 42
- Issue
- 8
- Pages
- 707-740
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- OpenAlex
- W2343875716
- Cited by
- 1,110
- References
- 451
- Citations by year
- 2026: 91 · 2025: 96 · 2024: 127 · 2023: 113 · 2022: 132 · 2021: 118 · 2020: 117 · 2019: 117 · 2018: 88 · 2017: 54 · 2016: 26
- FWCI
- 324.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- software fault localization, debugging, automated fault diagnosis, software defects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.