A Survey on Software Fault Localization
The DOI matches its Crossref record; 436 of the 451 references it cites were found in a registry or an index.
Abstract
Software fault localization, the act of identifying the locations of faults in a program, is widely recognized to be one of the most tedious, time consuming, and expensive - yet equally critical - activities in program debugging. Due to the increasing scale and complexity of software today, manually locating faults when failures occur is rapidly becoming infeasible, and consequently, there is a strong demand for techniques that can guide software developers to the locations of faults in a program with minimal human intervention. This demand in turn has fueled the proposal and development of a broad spectrum of fault localization techniques, each of which aims to streamline the fault localization process and make it more effective by attacking the problem in a unique way. In this article, we catalog and provide a comprehensive overview of such techniques and discuss key issues and concerns that are pertinent to software fault localization as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, Steinder et al. [21], Wong et al. [24], and Solé et al. [25] described the process of root-cause identification but did not focus on the microservices architecture.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [24]
Citations
Cites
Cousot, P., & Cousot, R. (1977) · Proceedings of the 4th ACM SIGACT-SIGPLAN symposium on Principles of programming languages - POPL '77 · doi:10.1145/512950.512973 · Cited by 6,279 · cited 1×
“lem, Mayer and Stumptner [246] propose an abstractionbased model in which abstract interpretation [55], [78] is applied to handle loops, recursive procedures, and heap data structures.”
BackgroundBasic concepts and taxonomy of dependable and secure computing
Avizienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,223 · cited 1×
“The following terms appear repeatedly throughout this article, and thus for convenience, we provide definitions for them here per the taxonomy provided in [37]: A failure is when a service deviates from its correct behavior.”
BackgroundCAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Weiser, M. (1984) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1984.5010248 · Cited by 3,204
A theory of diagnosis from first principles
Reiter, R. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90062-2 · Cited by 3,031 · cited 1×
“While using model-based diagnosis [301], it is assumed that a correct model of each program being diagnosed is available.”
MethodFundamentals of neural networks: architectures, algorithms, and applications
Fausett, L. V. (1994) · CERN Document Server (European Organization for Nuclear Research) · Cited by 3,025
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
Theory of the backpropagation neural network
Hecht-Nielsen (1989) · International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1989.118638 · Cited by 2,222
de Kleer, J., & Williams, B. C. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90063-4 · Cited by 2,039
Lewis, D. (1973) · The Journal of Philosophy · doi:10.2307/2025310 · Cited by 1,914
Research works printed but not linked: 17
- jannach, 0, Toward model-based debugging of spreadsheet programs, Proc Knowledge-Based Software Eng Conf, 252
- panko, 2006, Facing the problem of spreadsheet errors, Decision Line, 37, 8
- he, 0, Automated debugging using path-based weakest preconditions, Proc 8th Int Conf Fundam Approaches Softw Eng, 267
- lewis, 1973, Counterfactuals
- lucia lo, 0, Fusing fault localizers, IEEE Int Conf on Auto Soft Eng, 127
- lyle, 0, Automatic program bug location by program slicing, Proc Int Conf Comput Appl, 877
- grottke, 0, A classification of software faults, Proc 16th IEEE Int Symp Softw Rel Eng, 419
- mayer, 0, Prioritizing model-based debugging diagnostic reports, Proc Int Workshop Principles Diagnosis, 127
- mayer, 2004, Approximate modeling for debugging of program loops, Proc Int Workshop Principles Diagnosis, 87
- moon, 2014, Effective software fault localization using dynamic program behaviors, Master thesis
- gong, 0, Diversity maximization speedup for fault, Proc Int Conf Autom Softw Eng, 30
- torlak, 0, MemSAT: Checking axiomatic specifications of memory models, Proc ACM SIGPLAN Conf Programming Language Design and Implementation, 341
- vayani, 2007, Improving automatic software fault localization, Master thesis
- wu, 0, A statistical model to locate faults at input levels, Proc Int Conf Autom Softw Eng, 274
- collofello, 0, Towards automatic software fault localization through decision-to-decision path analysis, Proc Nat Comput Conf, 539
- stumptner, 0, Debugging functional program, Proc Int Joint Conf Artif Intell, 440
- xie, 0, Provably optimal and human-competitive results in SBSE for spectrum based fault localization, Proc 2nd Int Symp Search Based Software Eng, 224
Cited by
Items 101–200 of 1,006
An optimal mutation execution strategy for cost reduction of mutation-based fault localization
Liu, Y., Li, Z., Zhao, R., & Gong, P. (2017) · Information Sciences · doi:10.1016/j.ins.2017.09.006 · Cited by 49
Large Language Model-Based Agents for Software Engineering: A Survey
Liu, J., Wang, K., Chen, Y., Peng, X., Chen, Z., Zhang, L., & Lou, Y. (2024) · arXiv · doi:10.48550/arxiv.2409.02977 · Cited by 49
“Some agents integrate the traditional fault localization approaches, especially spectrum-based fault localization techniques [157], which calculate the suspiciousness score of code elements based on their coverage of failed tests and passing tests.”
Bifröst: Visualizing and Checking Behavior of Embedded Systems across Hardware and Software
McGrath, W., Drew, D., Warner, J., Kazemitabaar, M., Karchemsky, M., Mellis, D. A., & Hartmann, B. (2017) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3126594.3126658 · Cited by 56
“Survey papers of prior work cover techniques for monitoring program execution [24], intelligent or automated debugging techniques [9, 27], and fault localization [33].”
MethodSpectrum-based fault localization in software product lines
Arrieta, A., Segura, S., Markiegi, U., Sagardui, G., & Etxeberria, L. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.03.008 · Cited by 48
“having faults, so-called suspiciousness [13, 14, 15, 16].”
BackgroundMethodInfluentialLocalizing Faults in Simulink/Stateflow Models with STL
Bartocci, E., Ferrère, T., Manjunath, N., & Ničković, D. (2018) · International Conference on Hybrid Systems: computation and control · doi:10.1145/3178126.3178131 · Cited by 48
“Since the late 1970s, in the software engineering community there has been a great effort to provide (semi-)automatic techniques assisting the developer to localize and to explain program bugs (we refer the reader to the very comprehensive survey of [26]).”
BackgroundEnhanced compiler bug isolation via memoized search
Chen, J., Ma, H., & Zhang, L. (2020) · Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3324884.3416570 · Cited by 37
“Based on the set of generated passing test programs and the given failing test program, RecBi leverages the idea of SBFL to identify the buggy compiler files via comparing the coverage of failing and passing tests [16].”
BackgroundInfluentialIdentifying linked incidents in large-scale online service systems
Chen, Y., Yang, X., Dong, H., He, X., Zhang, H., Lin, Q., Chen, J., Zhao, P., Kang, Y., Gao, F., et al. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3409768 · Cited by 47
“It is the key procedure of troubleshooting in large systems [2], and is widely applied in a number of different areas, such as computer networks [12, 22], software [1, 35], industrial systems [5, 13] and so on.”
BackgroundAligning the Objective of LLM-Based Program Repair
Xu, J., Fu, Y., Tan, S. H., & He, P. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00169 · Cited by 69
“…still adhere to the workflow of first using statement-level fault localization (statement-level FL) tools [29] to obtain a ranked list of potential buggy hunks ( i.e. , contiguous statements to be modified in patches [30]), and then using APR methods to generate patches by modifying the buggy…”
VFix: Value-Flow-Guided Precise Program Repair for Null Pointer Dereferences
Xu, X., Sui, Y., Yan, H., & Xue, J. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00063 · Cited by 62
De-Flake Your Tests : Automatically Locating Root Causes of Flaky Tests in Code At Google
Ziftci, C., & Cavalcanti, D. (2020) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme46990.2020.00083 · Cited by 68
Localizing multiple software faults based on evolution algorithm
Zheng, Y., Wang, Z., Fan, X., Chen, X., & Yang, Z. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.02.001 · Cited by 45
Extracting Concise Bug-Fixing Patches from Human-Written Patches in Version Control Systems
Jiang, Y., Liu, H., Niu, N., Zhang, L., & Hu, Y. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) · doi:10.1109/icse43902.2021.00069 · Cited by 41
APPT: Boosting Automated Patch Correctness Prediction via Fine-Tuning Pre-Trained Models
Zhang, Q., Fang, C., Sun, W., Liu, Y., He, T., Hao, X., & Chen, Z. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3354969 · Cited by 57
“…the localization phase utilizes off-the-shelf fault localization techniques to recognize the suspicious code elements (e.g., statements or methods) [23], [24]; (2) the repair phase then modifies these elements based on a set of transformation rules to generate various new program variants, also…”
MethodNetwork-Clustered Multi-Modal Bug Localization
Hoang, T., Oentaryo, R. J., Le, T.-D. B., & Lo, D. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2810892 · Cited by 46
“[72] provided a comprehensive literature review of a large number of spectrum-fault localization tech-”
BackgroundProgram vulnerability repair via inductive inference
Zhang, Y., Gao, X., Duck, G. J., & Roychoudhury, A. (2022) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3533767.3534387 · Cited by 44
“In practice, the patch location can decided using fix localization [29] or provided manually.”
MethodFlexFL: Flexible and Effective Fault Localization With Open-Source Large Language Models
Xu, C.-Y., Liu, Z.-X., Ren, X.-X., Zhang, G., Liang, M., & Lo, D. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3553363 · Cited by 35
“F AULT localization (FL) is tasked with precisely identifying the locations of bugs within a software system [1].”
HMER: A Hybrid Mutation Execution Reduction approach for Mutation-based Fault Localization
Li, Z., Wang, H., & Liu, Y. (2020) · Journal of Systems and Software · doi:10.1016/j.jss.2020.110661 · Cited by 44
Prevalence of Single-Fault Fixes and Its Impact on Fault Localization
Perez, A., Abreu, R., & d’Amorim, M. (2017) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2017.9 · Cited by 41
“Spectrum-based fault localization is a popular approach to efficiently and effectively debug software applications [1].”
BackgroundMethodInfluentialSelf-citationMajd, A., Vahidi-Asl, M., Khalilian, A., Baraani-Dastjerdi, A., & Zamani, B. (2019) · Journal of Computer Languages · doi:10.1016/j.cola.2019.03.006 · Cited by 49
Bhutamapuram, U. S., & Sadam, R. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111522 · Cited by 42
“Due to the enormous increase in building large-scale complex software systems, with the limited available resources such as manpower and cost, achieving the project goals within the deadlines is a challenging task [2, 3].”
BackgroundAre Large Language Models Memorizing Bug Benchmarks?
Ramos, D., Mamede, C., Jain, K., Canelas, P., Gamboa, C., & Goues, C. L. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00005 · Cited by 52
“Two significant such tasks are bug finding, through automated fault localization (FL) [2]; and bug fixing, through automated program repair [3] (APR).”
Jaguar: A Spectrum-Based Fault Localization Tool for Real-World Software
Ribeiro, H. L., de Araujo, R. P. A., Chaim, M. L., de Souza, H. A., & Kon, F. (2018) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2018.00048 · Cited by 40
“Few tools provide information to support fault localization, as shown in [13].”
BackgroundLarge-Scale Empirical Studies on Effort-Aware Security Vulnerability Prediction Methods
Chen, X., Zhao, Y., Cui, Z., Meng, G., Liu, Y., & Wang, Z. (2019) · IEEE Transactions on Reliability · doi:10.1109/tr.2019.2924932 · Cited by 44
“research on automatic software fault localization [65].”
PraPR: Practical Program Repair via Bytecode Mutation
Ghanbari, A., & Zhang, L. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00116 · Cited by 43
“So far, a large body of research has been dedicated to automatically localize [2] or fix software bugs [3].”
BackgroundExplaining Image Classifiers Using Statistical Fault Localization
Sun, Y., Chockler, H., Huang, X., & Kroening, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58604-1_24 · Cited by 49
“p as ep +as np (2c) Wong-II [26]: as ef a s ep (2d) The tool then presents to the user the list of program elements in the order of descending suspiciousness score. As reported in surveys [14], [15], [22], there is no single best measure for fault localization. Different measures perform better on different types of a…”
BackgroundMethodAccuracy Graphs of Spectrum-Based Fault Localization Formulas
Tang, C. M., Chan, W. K., Yu, Y. T., & Zhang, Z. (2017) · IEEE Transactions on Reliability · doi:10.1109/tr.2017.2688487 · Cited by 39
Improving deep‐learning‐based fault localization with resampling
Zhang, Z., Lei, Y., Mao, X., Yan, M. L., Xu, L., & Wen, J. (2020) · Journal of Software Evolution and Process · doi:10.1002/smr.2312 · Cited by 46
“Specifically, CNN-FL10 uses Convolutional Neural Networks (CNN), MLP-FL12 utilizes Multi-Layer Perceptron (MLP), BPNN-FL uses a Back-Propagation Neural Network 2,24 (BPNN), and BiLSTM-FL 10,25 utilizes a recurrent neural network named Bi-directional Long Short-Term Memory (BiLSTM).”
MethodScaffle: bug localization on millions of files
Pradel, M., Murali, V., Qian, R., Machalica, M., Meijer, E., & Chandra, S. (2020) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3395363.3397356 · Cited by 46
“Overall, Scaffle provides a practical technique for pinpointing the files to consider in a large-scale code base, which helps assigning crashes to the appropriate team or developer, and may serve as a starting point for automated program repair.”
MethodRevisiting heterogeneous defect prediction methods: How far are we?
Chen, X., Mu, Y., Liu, K., Cui, Z., & Ni, C. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106441 · Cited by 39
“IFA returns the number of initial false alarms encountered before we find the first defective module, which is inspired by research on automatic software fault localization [82].”
BackgroundGhanbari, A., & Marcus, A. (2022) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3533767.3534368 · Cited by 55
“First, a fault localization algorithm [87] is applied to the buggy program to find suspicious program elements.”
BackgroundMethodInfluentialContext-Aware Neural Fault Localization
Zhang, Z., Lei, Y., Mao, X., Yan, M. L., Xia, X., & Lo, D. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3279125 · Cited by 38
“F OR reducing the debugging cost, researchers have proposed automated assistance in finding faults that cause failures (e.g., [1], [2], [3], [4], [5], [6], [7], [8], [9]).”
BackgroundMethodMUSEUM: Debugging real-world multilingual programs using mutation analysis
Hong, S., Kwak, T., Lee, B., Jeon, Y., Ko, B., Kim, Y., & Kim, M. (2016) · Information and Software Technology · doi:10.1016/j.infsof.2016.10.002 · Cited by 37
Exploring True Test Overfitting in Dynamic Automated Program Repair using Formal Methods
Nilizadeh, A., Leavens, G. T., Le, X.-B. D., Păsăreanu, C. S., & Cok, D. R. (2021) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst49551.2021.00033 · Cited by 54
“The first step is to detect bugs and find their likely cause, which is known as bug localization [3].”
BackgroundGNet4FL: effective fault localization via graph convolutional neural network
Qian, J., Ju, X., & Chen, X. (2023) · Automated Software Engineering · doi:10.1007/s10515-023-00383-z · Cited by 41
“The worst case is when the faulty statement is last checked (Wong et al. 2016).”
BackgroundMethodKumar, S. (2023) · Journal of Computers Mechanical and Management · doi:10.57159/gadl.jcmm.2.1.23041 · Cited by 36
Test flakiness’ causes, detection, impact and responses: A multivocal review
Tahir, A., Rasheed, S., Dietrich, J. B., Hashemi, N., & Zhang, L. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111837 · Cited by 44
Demystifying Faulty Code: Step-by-Step Reasoning for Explainable Fault Localization
Widyasari, R., Ang, J. W., Nguyen, T. G., Sharma, N., & Lo, D. (2024) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner60148.2024.00064 · Cited by 52
“If the scores are shared among several lines, the final position would be averaged, following the common practice from previous studies [1], [22].”
BackgroundResultInfluentialLLM-based Agents for Automated Bug Fixing: How Far Are We?
Meng, X., Ma, Z., Gao, P., & Peng, C. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773269 · Cited by 40
“Fail-to-Pass Tests: SWE-bench uses Fail-to-Pass (F2P) tests to verify the correctness of generated patches.”
Improving Software Fault Localization by Combining Spectrum and Mutation
Cui, Z., Jia, M., Chen, X., Zheng, L., & Liu, X. (2020) · IEEE Access · doi:10.1109/access.2020.3025460 · Cited by 36
“The value of EXAM is the percentage of elements that must be inspected until a real faulty element is found [2], [10], [23], [26].”
BackgroundMethodOn the effectiveness of unified debugging: an extensive study on 16 program repair systems
Benton, S., Li, X., Lou, Y., & Zhang, L. (2020) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3324884.3416566 · Cited by 37
JEST: N+1-Version Differential Testing of Both JavaScript Engines and Specification
Park, J., An, S., Youn, D., Kim, G., & Ryu, S. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00015 · Cited by 59
ORBS and the limits of static slicing
Binkley, D., Gold, N., Harman, M., Islam, S., Krinke, J., & Yoo, S. (2015) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam.2015.7335396 · Cited by 35
“RQ2 uses the small programs shown in Table I and known as the Siemens Suite which have been widely-studied in previous work on analysis and manipulation [25].”
MethodWang, S., Wen, M., Chen, L., Yi, X., & Mao, X. (2019) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2019.8870172 · Cited by 43
“Over the years, many studies have been conducted with the aim to better identify the fault location [10-19], advance the patch generation process [2-9, 20-29], and enhance the assessment of patch correctness [30-34].”
BackgroundWang, H., Du, B., He, J., Liu, Y., & Chen, X. (2020) · IEEE Access · doi:10.1109/access.2020.3004145 · Cited by 35
“Among the automated fault localization techniques, spectrum-based fault localization (SBFL) [4]–[7] is the most The associate editor coordinating the review of this manuscript and approving it for publication was Porfirio Tramontana . studied and evaluated technique.”
MethodSoremekun, E., Pavese, E., Havrikov, N., Grunske, L., & Zeller, A. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3013716 · Cited by 35
“Statistical fault localization techniques [67], for instance, could then identify input elements most likely associated with a failure.”
BackgroundDreamLoc: A Deep Relevance Matching-Based Framework for bug Localization
Qi, B., Sun, H., Yuan, W., Zhang, H., & Meng, X. (2021) · IEEE Transactions on Reliability · doi:10.1109/tr.2021.3104728 · Cited by 47
ABFL: An autoencoder based practical approach for software fault localization
Peng, Z., Xiao, X., Hu, G., Sangaiah, A. K., Atiquzzaman, M., & Xia, S. (2019) · Information Sciences · doi:10.1016/j.ins.2019.08.077 · Cited by 34
Where2Change: Change Request Localization for App Reviews
Zhang, T., Chen, J., Zhan, X., Luo, X., Lo, D., & Jiang, H. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2956941 · Cited by 38
“Wong et al. [37] provide a systematic survey of such fault localization techniques and discuss some key issues and future directions.”
BackgroundA Machine Learning Approach to Classify Security Patches into Vulnerability Types
Wang, X., Wang, S., Sun, K., Batcheller, A. L., & Jajodia, S. (2020) · IEEE Conference on Communications and Network Security · doi:10.1109/cns48642.2020.9162237 · Cited by 34
“Some fault detecting approaches make the assumption that each buggy file contains exactly one line of faulty code [14].”
BackgroundAnalysing the Impact of Workloads on Modeling the Performance of Configurable Software Systems
Mühlbauer, S., Sattler, F., Kaltenecker, C., Dorn, J., Apel, S., & Siegmund, N. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00176 · Cited by 38
“Applications of such an approach have been studied not only for feature location [63]–[66], but root in work on program comprehension [67]–[71] and fault localization [72], [73].”
BackgroundLearning to blame: localizing novice type errors with data-driven diagnosis
Seidel, E. L., Sibghat, H., Chaudhuri, K., Weimer, W. R., & Jhala, R. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3138818 · Cited by 41
“Other similar approaches, including those of Chen et al. [2002] and Abreu et al. [2006, 2007] consider alternate features of information or refined formulae and generally obtain more precise results; see Wong and Debroy [2009] for a survey.”
PyTy: Repairing Static Type Errors in Python
Chow, Y. W., Di Grazia, L., & Pradel, M. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3639184 · Cited by 23
“Delta debugging [54] finds failure-inducing code hunks in a commit, and is widely used, e.g., for fault localization [47].”
BackgroundApplying Combinatorial Testing to the Siemens Suite
Ghandehari, L. S., Bourazjany, M. N., Lei, Y., Kacker, R. N., & Kuhn, D. R. (2013) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw.2013.47 · Cited by 33
An Interleaving Approach to Combinatorial Testing and Failure-Inducing Interaction Identification
Niu, X., Nie, C., LEUNG, H. K. N., Lei, Y., Wang, X., Xu, J., & Wang, Y. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2865772 · Cited by 33
“In our experiments, we simply took the one-bug-at-a-time strategy [40].”
BackgroundMethodA program slicing-based method for effective detection of coincidentally correct test cases
Feyzi, F., & Parsa, S. A. (2018) · Computing · doi:10.1007/s00607-018-0591-z · Cited by 34
“That is, when multiple statements have the same suspiciousness score, then all of them are treated as being the nth element in the output, where n is their average rank [35,36].”
BackgroundFaster mutation-based fault localization with a novel mutation execution strategy
Gong, P., Zhao, R., & Li, Z. (2015) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw.2015.7107448 · Cited by 32
“It has been shown that detecting and finding bugs of software require huge efforts [1] and many researchers paid attentions to fault localization techniques in the past decades.”
BackgroundConsidering dependencies between bug reports to improve bugs triage
Almhana, R., & Kessentini, M. (2021) · Automated Software Engineering · doi:10.1007/s10515-020-00279-2 · Cited by 32
Fast and Precise On-the-Fly Patch Validation for All
Chen, L., Ouyang, Y., & Zhang, L. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00104 · Cited by 32
Call Frequency-Based Fault Localization
Vancsics, B., Horváth, F., Szatmári, A., & Beszédes, Á. (2021) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner50967.2021.00041 · Cited by 40
“Spectrum refers to the statistical information about how the executed test cases relate to program elements and what are their outcomes (hence, also Statistical Fault Localization is a commonly used term for these methods) [3]–[7].”
BackgroundLocalizing Vulnerabilities Statistically From One Exploit
Shen, S., Kolluri, A., Dong, Z., Saxena, P., & Roychoudhury, A. (2021) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3433210.3437528 · Cited by 43
“The framework presented thus far is similar to the underpinning of a long line of works on statistical fault isolation [19, 38].”
BackgroundMethodiBiR : Bug-report-driven Fault Injection
Khanfir, A., Koyuncu, A., Papadakis, M., Cordy, M., Bissyandé, T. F., Klein, J., & Traon, Y. L. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3542946 · Cited by 32
“Several automated fault localization techniques have been proposed [80], such as slice based [79], spectrum based [2], statistics based [37], mutation based [61], and so forth.”
BackgroundAutomatic Failure Explanation in CPS Models
Bartocci, E., Manjunath, N., Mariani, L., Mateis, C., & Ničković, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30446-1_4 · Cited by 31
CPSDebug: Automatic failure explanation in CPS models
Bartocci, E., Manjunath, N., Mariani, L., Mateis, C., & Ničković, D. (2021) · International Journal on Software Tools for Technology Transfer · doi:10.1007/s10009-020-00599-4 · Cited by 31
Andror2: A Dataset of Manually-Reproduced Bug Reports for Android apps
Wendland, T., Sun, J., Mahmud, J., Mansur, S. M. H., Huang, S., Moran, K., Rubin, J., & Fazzini, M. (2021) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr52588.2021.00082 · Cited by 31
“3) Similarly, fault localization techniques [29], especially for Android applications [30], could benefit from our collection of apps with “verified” faulty behaviors.”
Enhancing Mobile App Bug Reporting via Real-Time Understanding of Reproduction Steps
Fazzini, M., Moran, K., Bernal-Cárdenas, C., Wendland, T., Orso, A., & Poshyvanyk, D. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3174028 · Cited by 31
“area of research but refer the reader to surveys on this line of research for a more thorough discussion [18], [53], [54].”
BackgroundNeural Program Repair : Systems, Challenges and Solutions
Zhong, W., Li, C., Ge, J., & Luo, B. (2022) · Asia-Pacific Symposium on Internetware · doi:10.1145/3545258.3545268 · Cited by 35
“First, the fault statement of the buggy program will be located by fault localization techniques [52].”
MethodEnhancing Software Fault Prediction with Machine Learning: A Comparative Study on the PC1 Dataset
Gunda, S. K. (2024) · Global Conference on Communications and Information Technologies (GCCIT) · doi:10.1109/gccit63234.2024.10862351 · Cited by 30
“Root cause analysis of software defects helps in identifying the root causes for these errors, which will assists literature screening to be more precise [13].”
Using Tri-Relation Networks for Effective Software Fault-Proneness Prediction
Li, Y., Wong, W. E., Lee, S.-Y., & Wotawa, F. (2019) · IEEE Access · doi:10.1109/access.2019.2916615 · Cited by 30
“niques [74]–[77], [80] are becoming more comprehensive, it is still expensive to precisely locate, let alone fix, bugs1 in a program.”
BackgroundSelf-citationCan Higher-Order Mutants Improve the Performance of Mutation-Based Fault Localization?
Wang, H., Li, Z., Liu, Y., Chen, X., Doyle, P., Cai, Y., & Fan, L. (2022) · IEEE Transactions on Reliability · doi:10.1109/tr.2022.3162039 · Cited by 30
Contextualizing spectrum-based fault localization
de Souza, H. A., Mutti, D., Chaim, M. L., & Kon, F. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2017.10.014 · Cited by 30
“Several techniques to automate fault localization have been proposed [2], aiming at reducing the effort and time spent for improving the debugging process.”
MethodLiu, Y., Li, M., Wu, Y., & Li, Z. (2019) · Journal of Systems and Software · doi:10.1016/j.jss.2019.01.056 · Cited by 30
A System Identification Based Oracle for Control-CPS Software Fault Localization
He, Z., Chen, Y., Huang, E., Wang, Q., Pei, Y., & Yuan, H. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00029 · Cited by 37
“According to a recent survey [13], there are over 331 papers on SFL.”
BackgroundMethodInfluentialWhen does my program do this? learning circumstances of software behavior
Kampmann, A., Havrikov, N., Soremekun, E., & Zeller, A. (2020) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3368089.3409687 · Cited by 29
Predictive Mutation Analysis via the Natural Language Channel in Source Code
Kim, J.-H., Jeon, J., Hong, S., & Yoo, S. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3510417 · Cited by 31
“A downstream task that can directly beneit from PMA in particular is Mutation Based Fault Localisation (MBFL) [49].”
BackgroundAquila: a practically usable verification system for production-scale programmable data planes
Tian, B., Gao, J., Liu, M., Zhai, E., Chen, Y., Zhou, Y., Dai, L., Feng, Y., Ma, M., Tang, M., et al. (2021) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/3452296.3472937 · Cited by 46
“Bug localization requires Aquila to point out the potential locations that could potentially fix the violation [44, 53], such as replacing table entries and changing a statement in the action granularity.”
BackgroundMutation-based Fault Localization of Deep Neural Networks
Ghanbari, A., Thomas, D.-G., Arshad, M., & Rajan, H. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00171 · Cited by 29
de Oliveira, V. Z. B., de Souza, E. F., Goues, C. L., & Camilo-Junior, C. G. (2018) · Empirical Software Engineering · doi:10.1007/s10664-017-9562-9 · Cited by 29
“…ways: (1) it uses the input tests to localize the bug to a smaller, weighted program slice (e.g., Jones et al. (2002), Saha et al. (2011), and Wong et al. (2016)), (2) it uses coarse-grained edit operators at the C statement level (insert, replace, and delete; swap has also been explored),…”
MethodJust, R., Parnin, C., Drosos, I., & Ernst, M. D. (2018) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3213846.3213870 · Cited by 29
“, [25, 36]) using datasets constructed from version control history implicitly assumed that developerprovided triggering tests are characteristic of user-provided triggering tests from bug reports, which are available before the defect is localized and fixed.”
BackgroundSoftware fault localization using BP neural network based on function and branch coverage
Maru, A., Dutta, A., Kumar, K. V., & Mohapatra, D. P. (2019) · Evolutionary Intelligence · doi:10.1007/s12065-019-00318-2 · Cited by 29
“Initially, programmers used to localize the faults using ad-hoc approaches, such as inserting print statements, assertions, breakpoints, watchpoints, and profiling [2].”
BackgroundMethodFault localization based on failure-inducing combinations
Ghandehari, L. S., Lei, Y., Kung, D. C., Kacker, R. N., & Kuhn, R. (2013) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2013.6698916 · Cited by 28
Empirical Evaluation of Fault Localisation Using Code and Change Metrics
Sohn, J., & Yoo, S. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2930977 · Cited by 33
“Spectrum Based Fault Localisation has been accepted as the one of the most widely studied technique [7].”
BackgroundFeature-FL: Feature-Based Fault Localization
Lei, Y., Xie, H., Zhang, T., Yan, M. L., Xu, Z., & Sun, C. P. (2022) · IEEE Transactions on Reliability · doi:10.1109/tr.2022.3140453 · Cited by 28
“amount of time and resource in pinpointing the location of a bug and understanding its cause of a failure [1], [2].”
BackgroundIsolating Compiler Bugs by Generating Effective Witness Programs With Large Language Models
Tu, H., Zhou, Z., Jiang, H., Yusuf, I. N. B., Li, Y., & Jiang, L. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3397822 · Cited by 35
“To eventually isolate the buggy files, following the well-established principles of Spectrum-Based Fault Localization (SBFL) [15], [16], they compare the execution traces (or spectra) between failing test programs and passing test programs using a formula such as Ochiai [15].”
MethodSelf-citationStatement-Oriented Mutant Reduction Strategy for Mutation Based Fault Localization
Liu, Y., Li, Z., Wang, L., Zhi, H., & Zhao, R. (2017) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2017.23 · Cited by 28
“In recent decades, more and more researchers begin to devote themselves to the area of automatic software fault localization, and this trend supports the claim that software fault localization is not just an important but also a popular research topic [2].”
BackgroundHierarchically Localizing Software Faults Using DNN
Dutta, A., Manral, R., Mitra, P., & Mall, R. (2019) · IEEE Transactions on Reliability · doi:10.1109/tr.2019.2956120 · Cited by 28
“[44], [46].”
BackgroundMethodInfluentialBUGSJS: a benchmark and taxonomy of JavaScript bugs
Gyimesi, P., Vancsics, B., Stocco, A., Mazinanian, D., Beszédes, Á., Ferenć, R., & Mesbah, A. (2020) · Software Testing Verification and Reliability · doi:10.1002/stvr.1751 · Cited by 36
“, the spectrum-based techniques [60, 61, 62, 63] because all the necessary data—test case outcomes, code coverage and bug information—are readily available.”
BackgroundSolver-Aided Constant-Time Hardware Verification
Gleissenthall, K. V., Kıcı, R. G., Stefan, D., & Jhala, R. (2021) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3460120.3484810 · Cited by 28
Unified Software Engineering Agent as AI Software Engineer
Applis, L., Zhang, Y., Liang, S., Jiang, N., Tan, L., & Roychoudhury, A. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773202 · Cited by 33
“We introduce a structured task state that represents the consensus memory, which can be read and modified by different actions.”
How test suites impact fault localisation starting from the size
Lei, Y., Sun, C. P., Mao, X., & Su, Z. (2018) · IET Software · doi:10.1049/iet-sen.2017.0026 · Cited by 26
Detecting and understanding real-world differential performance bugs in machine learning libraries
Tizpaz-Niari, S., Černý, P., & Trivedi, A. (2020) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3395363.3404540 · Cited by 26
“y shapes, while the performance model in DPFuzz often follows simpler shapes such as polynomials. Debugging Performances. Machine learning and statistical models have been used for fault localization [42] and debugging of performance issues [36, 38, 39]. These works generally assume that the interesting inputs are giv…”
MethodTesting Configuration Changes in Context to Prevent Production Failures.
Sun, X., Cheng, R., Chen, J., Ang, E., Legunsen, O., & Xu, T. (2020) · Operating Systems Design and Implementation · Cited by 81
BugBuilder: An Automated Approach to Building Bug Repository
Jiang, Y., Liu, H., Luo, X., Zhu, Z., Chi, X., Niu, N., Zhang, Y., Hu, Y., Bian, P., & Zhang, L. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3177713 · Cited by 31
“…their concise patches are indispensable for rigorous evaluation of numerous automatic or semi-automatic approaches to localizing faulty statements [1], [2], [3], [4], [5], to predicting the number of bugs in software applications [6], [7], [8], [9], and to repairing faulty applications [10],…”
BackgroundWidyasari, R., Prana, G. A. A., Haryono, S. A., Wang, S., & Lo, D. (2022) · Empirical Software Engineering · doi:10.1007/s10664-022-10189-4 · Cited by 26
“Spectrum-Based Fault Localization techniques have been gaining research attention in the past decade (Wong et al. 2016), and a number of studies have also evaluated the effectiveness of various techniques in this category (Lo et al. 2010; Renieres and Reiss 2003; Xie et al. 2013; Le et al.2013).”
BackgroundMethodResultInfluentialFinding Unstable Code via Compiler-Driven Differential Testing
Li, S., & Su, Z. (2023) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3582016.3582053 · Cited by 26
“Fault localization techniques, in general, although extensively studied [49], are not yet practical [5, 36].”
BackgroundNuzzleBug: Debugging Block-Based Programs in Scratch
Deiner, A., & Fraser, G. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623331 · Cited by 32
Software fault localisation: a systematic mapping study
Zakari, A., Lee, S. P., Alam, K. A., & Ahmad, R. B. (2018) · IET Software · doi:10.1049/iet-sen.2018.5137 · Cited by 26
“Software has become part of our daily lives, integrated into practically everything we do and devices we are dependent on [1].”
BackgroundMethodInfluentialVFL: Variable-based fault localization
Kim, J., Kim, J., & Lee, E. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.11.009 · Cited by 26
“The Siemens suite is a popular set of faults that has been used for most fault localization studies [ 8 , 27 , 29 , 39 , 40 ].”
MethodResultCordeiro, L. C., Filho, E. B. L., & de Bessa, I. V. (2019) · IET Cyber-Physical Systems Theory & Applications · doi:10.1049/iet-cps.2018.5006 · Cited by 33
FlakyLoc: Flakiness Localization for Reliable Test Suites in Web Applications
Morán, J., Augusto, C., Bertolino, A., de la Riva, C., & Tuya, J. (2020) · Journal of Web Engineering · doi:10.13052/jwe1540-9589.1927 · Cited by 26
“These executions are analysed with a spectrum-based localization technique [4] considering that the factors that usually trigger the flakiness are more prone to be the root cause of flakiness.”
BackgroundImproving bug management using correlations in crash reports
Wang, S., Khomh, F., & Zou, Y. (2014) · Empirical Software Engineering · doi:10.1007/s10664-014-9333-9 · Cited by 26
Metadata
- Authors
- Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F.
- Affiliations
- The University of Texas at Dallas (US)
- Palo Alto Research Center (US)
- Graz University of Technology (AT)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2016-08-01
- Volume
- 42
- Issue
- 8
- Pages
- 707-740
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- OpenAlex
- W2343875716
- Cited by
- 1,110
- References
- 451
- Citations by year
- 2026: 91 · 2025: 96 · 2024: 127 · 2023: 113 · 2022: 132 · 2021: 118 · 2020: 117 · 2019: 117 · 2018: 88 · 2017: 54 · 2016: 26
- FWCI
- 324.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- software fault localization, debugging, automated fault diagnosis, software defects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.