A Survey on Software Fault Localization
The DOI matches its Crossref record; 436 of the 451 references it cites were found in a registry or an index.
Abstract
Software fault localization, the act of identifying the locations of faults in a program, is widely recognized to be one of the most tedious, time consuming, and expensive - yet equally critical - activities in program debugging. Due to the increasing scale and complexity of software today, manually locating faults when failures occur is rapidly becoming infeasible, and consequently, there is a strong demand for techniques that can guide software developers to the locations of faults in a program with minimal human intervention. This demand in turn has fueled the proposal and development of a broad spectrum of fault localization techniques, each of which aims to streamline the fault localization process and make it more effective by attacking the problem in a unique way. In this article, we catalog and provide a comprehensive overview of such techniques and discuss key issues and concerns that are pertinent to software fault localization as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, Steinder et al. [21], Wong et al. [24], and Solé et al. [25] described the process of root-cause identification but did not focus on the microservices architecture.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [24]
Citations
Cites
Cousot, P., & Cousot, R. (1977) · Proceedings of the 4th ACM SIGACT-SIGPLAN symposium on Principles of programming languages - POPL '77 · doi:10.1145/512950.512973 · Cited by 6,279 · cited 1×
“lem, Mayer and Stumptner [246] propose an abstractionbased model in which abstract interpretation [55], [78] is applied to handle loops, recursive procedures, and heap data structures.”
BackgroundBasic concepts and taxonomy of dependable and secure computing
Avizienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,223 · cited 1×
“The following terms appear repeatedly throughout this article, and thus for convenience, we provide definitions for them here per the taxonomy provided in [37]: A failure is when a service deviates from its correct behavior.”
BackgroundCAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Weiser, M. (1984) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1984.5010248 · Cited by 3,204
A theory of diagnosis from first principles
Reiter, R. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90062-2 · Cited by 3,031 · cited 1×
“While using model-based diagnosis [301], it is assumed that a correct model of each program being diagnosed is available.”
MethodFundamentals of neural networks: architectures, algorithms, and applications
Fausett, L. V. (1994) · CERN Document Server (European Organization for Nuclear Research) · Cited by 3,025
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
Theory of the backpropagation neural network
Hecht-Nielsen (1989) · International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1989.118638 · Cited by 2,222
de Kleer, J., & Williams, B. C. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90063-4 · Cited by 2,039
Lewis, D. (1973) · The Journal of Philosophy · doi:10.2307/2025310 · Cited by 1,914
Research works printed but not linked: 17
- jannach, 0, Toward model-based debugging of spreadsheet programs, Proc Knowledge-Based Software Eng Conf, 252
- panko, 2006, Facing the problem of spreadsheet errors, Decision Line, 37, 8
- he, 0, Automated debugging using path-based weakest preconditions, Proc 8th Int Conf Fundam Approaches Softw Eng, 267
- lewis, 1973, Counterfactuals
- lucia lo, 0, Fusing fault localizers, IEEE Int Conf on Auto Soft Eng, 127
- lyle, 0, Automatic program bug location by program slicing, Proc Int Conf Comput Appl, 877
- grottke, 0, A classification of software faults, Proc 16th IEEE Int Symp Softw Rel Eng, 419
- mayer, 0, Prioritizing model-based debugging diagnostic reports, Proc Int Workshop Principles Diagnosis, 127
- mayer, 2004, Approximate modeling for debugging of program loops, Proc Int Workshop Principles Diagnosis, 87
- moon, 2014, Effective software fault localization using dynamic program behaviors, Master thesis
- gong, 0, Diversity maximization speedup for fault, Proc Int Conf Autom Softw Eng, 30
- torlak, 0, MemSAT: Checking axiomatic specifications of memory models, Proc ACM SIGPLAN Conf Programming Language Design and Implementation, 341
- vayani, 2007, Improving automatic software fault localization, Master thesis
- wu, 0, A statistical model to locate faults at input levels, Proc Int Conf Autom Softw Eng, 274
- collofello, 0, Towards automatic software fault localization through decision-to-decision path analysis, Proc Nat Comput Conf, 539
- stumptner, 0, Debugging functional program, Proc Int Joint Conf Artif Intell, 440
- xie, 0, Provably optimal and human-competitive results in SBSE for spectrum based fault localization, Proc 2nd Int Symp Search Based Software Eng, 224
Cited by
Items 301–400 of 1,006
What Made This Test Flake? Pinpointing Classes Responsible for Test Flakiness
Habchi, S., Haben, G., Sohn, J., Franci, A., Papadakis, M., Cordy, M., & Traon, Y. L. (2022) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme55016.2022.00039 · Cited by 16
“c) Fault localisation: Fault localisation was introduced to ease the developers’ burden of debugging by automatically identifying the root cause of a program failure [68], [57].”
BackgroundContext-based cluster fault localization
Yu, J., Lei, Y., Xie, H., Fu, L., & Liu, C. (2022) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3524610.3527891 · Cited by 16
“Software debugging is a time-consuming but important task in the process of software development and maintenance [41].”
A Deductive Approach for Fault Localization in ATL Model Transformations
Cheng, Z., & Tisi, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-662-54494-5_17 · Cited by 16
“in the performance of satisfiability modulo theory - SMT - solvers), many researchers are interested in developing techniques that can partially or fully automate the localization of faults in software (we refer the reader to [24,31] for an overview).”
BackgroundThe Right Prompts for the Job: Repair Code-Review Defects with Large Language ModelPreprint
Zhao, Z., Xu, Z., Zhu, J., Di, P., Yao, Y., & Ma, X. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.17485 · Cited by 23
“Existing APR tools typically involve three main steps: bug localization [35], patch generation, and patch validation.”
MethodAre Large Language Models Memorizing Bug Benchmarks?
Ramos, D., Mamede, C., Jain, K., Canelas, P., Gamboa, C., & Goues, C. L. (2024) · arXiv · doi:10.48550/arxiv.2411.13323 · Cited by 16
“Two significant such tasks are bug finding, through automated fault localization (FL) [2]; and bug fixing, through automated program repair [3] (APR).”
Fault Localization for Hardware Design Code with Time-Aware Program Spectrum
Wu, J., Zhang, Z., Yang, D., Meng, X., He, J., Mao, X., & Lei, Y. (2022) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd56317.2022.00085 · Cited by 15
“It can be used to track program behavior [15], [32].”
BackgroundHypothesizer: A Hypothesis-Based Debugger to Find and Test Debugging Hypotheses
Alaboudi, A., & LaToza, T. D. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606781 · Cited by 20
“Automated analysis tools may detect code syntax or style errors but may be unable to identify defects caused by the absence of certain code patterns [41].”
BackgroundGao, R., & Wong, W. E. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3180155.3182552 · Cited by 15
“Fault localization techniques using this approach have been well reported in the literature [1], [2], [4], [5], [17], [22], [23], [33], [40], [59], [61], [62], [63], [64].”
InfluentialSelf-citationDebugging of Behavioural Models using Counterexample Analysis
Barbon, G., Leroy, V., & Salaün, G. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2915303 · Cited by 15
“Several options have been investigated such as static analysis, slice-based method, statistical methods, or machine learning approaches, see [29] for a survey.”
Vancsics, B., Szatmári, A., & Beszédes, Á. (2020) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner48275.2020.9054803 · Cited by 15
“Overall, ≈ 30% of bugs belong to the best [ 1 ] category, but the most elements are found in interval ( 1 , 3 ] (nearly 33%).”
BackgroundMethodResultInfluentialKhalilian, A., Baraani-Dastjerdi, A., & Zamani, B. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114503 · Cited by 17
An Experience Report on Producing Verifiable Builds for Large-Scale Commercial Systems
Shi, Y., Wen, M., Cogo, F. R., Chen, B., & Jiang, Z. M. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3092692 · Cited by 21
“Prior studies in fault localization [53] focus on reproducing the”
BackgroundCharmFL: A Fault Localization Tool for Python
Sarhan, Q. I., Szatmári, A., Toth, R., & Beszédes, Á. (2021) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam52516.2021.00022 · Cited by 15
LocSeq: Automated Localization for Compiler Optimization Sequence Bugs of LLVM
Zhou, Z., Jiang, H., Ren, Z., Chen, Y., & Qiao, L. (2022) · IEEE Transactions on Reliability · doi:10.1109/tr.2022.3165378 · Cited by 15
PAFL: Probabilistic Automaton-based Fault Localization for Recurrent Neural Networks
Ishimoto, Y., Kondo, M., Ubayashi, N., & Kamei, Y. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.107117 · Cited by 15
GMBFL: Optimizing Mutation-Based Fault Localization via Graph Representation
Wu, S., Li, Z., Liu, Y., Chen, X., & Li, M. (2023) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58846.2023.00033 · Cited by 21
“As software systems grow in size and complexity, automated Fault Localization (FL) techniques have garnered significant attention [1]–[4].”
BackgroundCan explainability and deep-learning be used for localizing vulnerabilities in source code?
Marchetto, A. (2024) · doi:10.1145/3644032.3644448 · Cited by 15
“Software fault detection and localization is a relevant topic for the community, several works have been proposed and surveys exist that document and analyze them (e.g., [24, 26]).”
BackgroundMasri, W. (2015) · Advances in computers · doi:10.1016/bs.adcom.2015.05.001 · Cited by 15
Discovering common bug‐fix patterns: A large‐scale observational study
Campos, E. C., & Maia, M. D. A. (2019) · Journal of Software Evolution and Process · doi:10.1002/smr.2173 · Cited by 19
Effective Software Fault Localization Using a Back Propagation Neural Network
Maru, A., Dutta, A., Kumar, K. V., & Mohapatra, D. P. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-8676-3_44 · Cited by 15
Xiaobo, Y., Liu, B., & Wang, S. (2020) · Journal of Systems and Software · doi:10.1016/j.jss.2020.110861 · Cited by 15
Evaluation of fault localization techniques
Pearson, S. (2016) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2950290.2983967 · Cited by 15
Sohn, J., & Papadakis, M. (2022) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre55969.2022.00023 · Cited by 14
“In addition, we further investigated the usefulness of the resulting couplings in software maintenance activities, specifically fault localization, one of the most actively studied areas in software maintenance [2].”
BackgroundInfluentialMetamorphic Testing with Causal Graphs
Clark, A. G., Foster, M. S., Walkinshaw, N., & Hierons, R. M. (2023) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst57152.2023.00023 · Cited by 19
“Software bugs are commonly characterised in terms of “cause and e ff ect” [17].”
BackgroundAn effective fault localization approach based on PageRank and mutation analysis
Yan, Y. P., Jiang, S., Zhang, Y., & Zhang, C. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111799 · Cited by 14
An empirical study of fault localization in Python programs
Rezaalipour, M., & Furia, C. A. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10475-3 · Cited by 14
“This section summarizes a selection of studies that are directly relevant for the paper; Wong’s recent survey [71] provides a broader summary for interested readers.”
BackgroundInfluentialYang, M., Yang, S., & Wong, W. E. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3421591 · Cited by 17
“With the help of the above techniques, numerous SDP meth-ods are proposed to solve two important tasks: defect proneness prediction [1] and defect location prediction [11].”
MethodSelf-citationROCAS: Root Cause Analysis of Autonomous Driving Accidents via Cyber-Physical Co-mutation
Feng, S., Ye, Y., Shi, Q., Cheng, Z., Xu, X., Cheng, S., Choi, H., & Zhang, X. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695530 · Cited by 24
“Fixing configuration issues is complimentary to Rocas and still an open challenging problems in SE community [27, 35, 38, 39, 41, 59, 78, 79].”
ChatDL: An LLM-Based Defect Localization Approach for Software in IIoT Flexible Manufacturing
Yang, H., Zhou, Y. L., Liang, T., & Kuang, L. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3531512 · Cited by 16
“Since the defect localization task was proposed, researchers have designed various algorithms to improve the accuracy [9].”
OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolution
Guo, L., Tao, W., Jiang, R., Wang, Y., Chen, J., Liu, X., Ma, Y., Mao, M., Zhang, H., & Zheng, Z. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728871 · Cited by 40
“Additionally, benchmarks like SWE-bench [27] collect data from limited domains, such as scientific computing, machine learning, and visualization.”
Cost-effective testing based fault localization with distance based test-suite reduction
Wang, X., Jiang, S., Gao, P., Ju, X., Wang, R., & Zhang, Y. (2017) · Science China Information Sciences · doi:10.1007/s11432-016-9057-8 · Cited by 14
Evaluating the usage of fault localization in automated program repair: an empirical study
Yang, D., Qi, Y., Mao, X., & Lei, Y. (2020) · Frontiers of Computer Science · doi:10.1007/s11704-020-9263-1 · Cited by 18
“These SFL techniques are widely studied in recent researches [1, 2, 11, 34].”
BackgroundMethodInfluentialPractical Program Repair via Preference-based Ensemble Strategy
Zhong, W., Li, C., Liu, K., Xu, T., Ge, J., Bissyandé, T. F., Luo, B., & Ng, V. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623310 · Cited by 20
“The input of P-EPR is the buggy class file along with its suspicious faulty lines located by fault localization techniques [44].”
MethodUnderstanding Solidity Event Logging Practices in the Wild
Li, L., Liang, Y., Liu, Z., & Yu, Z. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616342 · Cited by 19
“Given much progress has been made in recent years towards automatically detecting [11, 36, 39, 40, 42] and fixing [20, 28, 35, 43, 44] relatively simple bugs, this prospect is huge.”
BackgroundFault localisation for WS-BPEL programs based on predicate switching and program slicing
Sun, C., Ran, Y., Zheng, C., Liu, H., Towey, D., & Zhang, X. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2017.10.030 · Cited by 14
Mining repair model for exception-related bug
Zhong, H., & Mei, H. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.03.046 · Cited by 14
Comparing line and AST granularity level for program repair using P y GGI
An, G., Kim, J.-H., & Yoo, S. (2018) · doi:10.1145/3194810.3194814 · Cited by 15
“We use Ochiai [16, 22] to provide the suspiciousness scores.”
MethodExplaining Violations of Properties in Control-Flow Temporal Logic
Dawes, J. H., & Reger, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32079-9_12 · Cited by 21
Simulating the Effect of Test Flakiness on Fault Localization Effectiveness
Vancsics, B., Gergely, T., & Beszédes, Á. (2020) · doi:10.1109/vst50071.2020.9051636 · Cited by 14
“There are a lot of FL approaches that help to automatically detect the location of bugs, and one of the largest families is Spectrum-Based Fault Localization (SBFL) [3], [4], [5], [6], our focus in this article.”
BackgroundZhou, X., Zhang, T., Keung, J., Yan, M. L., Luo, X., Zhang, X., Xu, L., & Tang, Y. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106452 · Cited by 14
“This process is called crash localization (or fault localization) [3].”
BackgroundA Framework for Improving Fault Localization Effectiveness Based on Fuzzy Expert System
Lin, C.-T., Chen, W., & Intasara, J. (2021) · IEEE Access · doi:10.1109/access.2021.3086878 · Cited by 14
“Thus, so far no single SBFL technique claims that it can outperform all of the others under every scenario [6].”
BackgroundInfluentialD2ABS: A Framework for Dynamic Dependence Analysis of Distributed Programs
Cai, H., & Fu, X. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3124795 · Cited by 14
“In particular, a large body and variety of dependence-based approaches have been proposed over the past few decades to support development and maintenance in general [3], [68], [69], [70], [71], [72], and fault diagnosis [73], [74], [75] and security defense in particular [76], [77], [78].”
BackgroundWhat to Blame? On the Granularity of Fault Localization for Deep Neural Networks
Duran, M., Zhang, X., Arcaini, P., & Ishikawa, F. (2021) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre52982.2021.00037 · Cited by 18
Generating Concise Patches for Newly Released Programming Assignments
Li, L., Liu, H., Li, K., Jiang, Y., & Sun, R. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3153522 · Cited by 17
“Clone Detection and Automated Program Repair Our approach is also related to automated fault localization (AFL) [11] and generic automated program repair (APR) techniques [12], which provide candidate buggy points and candidate patches to software developers in practice.”
MethodAn Analysis on the Negative Effect of Multiple-Faults for Spectrum-Based Fault Localization
Xiaobo, Y., Liu, B., & Wang, S. (2018) · IEEE Access · doi:10.1109/access.2018.2886413 · Cited by 14
“A systemic review of fault localization techniques can be found in [13].”
BackgroundMethodInfluentialA Theoretical and Empirical Analysis of Program Spectra Diagnosability
Perez, A., Abreu, R., & Arie Van Deursen, A. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2895640 · Cited by 14
“, hAijjj 2 1::Ni) and the observed transaction outcomes encoded in error vector e [6], [7], [11], [13], [14].”
BackgroundMethodSelf-citationParallel debugging: An investigative study
Zakari, A., & Lee, S. P. (2019) · Journal of Software Evolution and Process · doi:10.1002/smr.2178 · Cited by 14
“) to identify suspicious program statements.(3) However, advanced fault localization techniques have been proposed in the last decades to facilitate and improve the localization process.”
BackgroundAn Empirical Study of Bug Isolation on the Effectiveness of Multiple Fault Localization
Li, Z., Wu, Y., & Liu, Y. (2019) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2019.00016 · Cited by 14
Singh, M., & Chhabra, J. K. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.112082 · Cited by 19
Fault Localization from the Semantic Code Search Perspective
Qin, Y., Wang, S., Lei, Y., Zhang, Z., Lin, B., Peng, X., Ma, J., Chen, L., & Mao, X. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3757915 · Cited by 15
Pérez, F., Lapeña, R., Font, J., & Cetina, C. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.06.017 · Cited by 14
Measures to report the Location Problem of Model Fragment Location
Ballarín, M., Marcén, A. C., Pelechano, V., & Cetina, C. (2018) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1145/3239372.3239397 · Cited by 13
“For instance, [22] present a systematic literature survey of bug location in source code.”
BackgroundAn Approach to Generate Effective Fault Localization Methods for Programs
Bagheri, B., Rezaalipour, M., & Vahidi-Asl, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-31517-7_17 · Cited by 13
Fu, X., Cai, H., Li, W., & Li, L. (2020) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3379345 · Cited by 13
“Historically, dynamic dependence modeling and analysis [40, 61] served as the underpinning of a variety of code-based quality-assurance tool support, ranging from fault diagnosis [83] to security defense [7, 47].”
Experiments with Interactive Fault Localization Using Simulated and Real Users
Horváth, F., Beszédes, Á., Vancsics, B., Balogh, G., Vidács, L., & Gyimóthy, T. (2020) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme46990.2020.00036 · Cited by 13
“There is a class of approaches to aid fault localization which are popular among researchers, but have not yet been widely adopted by the industry: Spectrum-Based Fault Localization (SBFL) [2]–[4].”
BackgroundMethodInfluentialLeveraging Fault Localisation to Enhance Defect Prediction
Sohn, J., Kamei, Y., McIntosh, S., & Yoo, S. (2021) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner50967.2021.00034 · Cited by 13
“To support SQA repair activities, fault localisation [4] has been proposed to prioritise areas within the codebase that are likely to require modification to address a defect.”
BackgroundMethodSpreadsheet debugging: The perils of tool over-reliance
Mukhtar, A., Hofer, B., Jannach, D., & Wotawa, F. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111119 · Cited by 15
Self-citationAGFL: A Graph Convolutional Neural Network-Based Method for Fault Localization
Qian, J., Ju, X., Chen, X., Shen, H., & Shen, Y. (2021) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs54544.2021.00077 · Cited by 18
Framing program repair as code completion
Ribeiro, F., Abreu, R., & Saraiva, J. (2022) · IEEE/ACM International Workshop on Automated Program Repair (APR) · doi:10.1145/3524459.3527347 · Cited by 17
“We assume faulty line numbers are identified beforehand by well-established and accurate fault localization techniques [4, 14, 22, 23, 29].”
MethodSelf-citationTimed pattern-based analysis of collaboration failures in system-of-systems
Hyun, S., Song, J., Jee, E., & Bae, D. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111613 · Cited by 13
Yan, L., Wen, T., Xie, H., Fu, L., Liu, C., Xu, L., & Sun, H. (2023) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc58990.2023.00045 · Cited by 15
“As shown in TABLE III, CGAN4FL outperforms resampling and undersampling in all cases of SFL and most cases of DLFL. Taking Ochiai as an example, the number of faults CGAN4FL can locate is 50, 123, and 177 for Top-1, Top-5, and Top-10 metrics, respectively.”
BackgroundMethodInfluentialEvaluating the Impact of Experimental Assumptions in Automated Fault Localization
Soremekun, E., Kirschner, L., Böhme, M., & Papadakis, M. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00025 · Cited by 18
“The third assumption is that the root causes of bugs resides in a single contiguous fault location, even though in practice bugs may span multiple contiguous locations [1, 10, 9].”
BackgroundMethodInfluentialVsusFL: Variable-suspiciousness-based Fault Localization for novice programs
Li, Z., Wu, S., Liu, Y., Shen, J., Wu, Y., Zhang, Z., & Chen, X. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111822 · Cited by 14
Fully Automated Compiler Testing of a Reasoning Engine via Mutated Grammar Fuzzing
Köroglu, Y., & Wotawa, F. (2019) · doi:10.1109/ast.2019.00010 · Cited by 13
“<start> ::= <rule> <rule_end> <start> ::= <first_rule> <start> <first_rule> ::= <rule> <rule_end> <rule> ::= <atom> <entailments> <rule> ::= <implications> <atom> <rule> ::= <implies> <atom> <rule> ::= 'x[1|2|3]' <rule> ::= 'Assumption[1|2|3]' <rule> ::= 'false' <entailments> ::= <entails> <atom_list> <implications> :…”
BackgroundMethodSelf-citationZhang, L., Li, Z., Feng, Y., Zhang, Z., Chan, W. K., Zhang, J., & Zhou, Y. (2020) · IEEE Transactions on Reliability · doi:10.1109/tr.2020.2982975 · Cited by 13
“We note that the widely-used fractional ranking scheme (aka, the “Avg” scheme [101]) is used throughout the experiment to assign the faulty statement with a rank when reporting the analysis results.”
MethodMSFL: A Model for Fault Localization Using Mutation-Spectra Technique
Dutta, A., & Godboley, S. (2021) · Lecture notes in business information processing · doi:10.1007/978-3-030-67084-9_10 · Cited by 14
Assi, R. A., Masri, W., & Trad, C. (2021) · Software Testing Verification and Reliability · doi:10.1002/stvr.1762 · Cited by 13
“, SBFL metric), we measure its impact on the suspiciousness score of the faulty location, the EXAM score [25, 42] and the Top-N score [35, 43].”
BackgroundMethodInfluentialLegion: Massively Composing Rankers for Improved Bug Localization at Adobe
Jarman, D., Berry, J., Smith, R., Thung, F., & Lo, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3075215 · Cited by 15
Bug Localization in Model-Based Systems in the Wild
Arcega, L., Font, J., Haugen, Ø., & Cetina, C. (2021) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3472616 · Cited by 14
Using contextual knowledge in interactive fault localization
Horváth, F., Beszédes, Á., Vancsics, B., Balogh, G., Vidács, L., & Gyimóthy, T. (2022) · Empirical Software Engineering · doi:10.1007/s10664-022-10190-x · Cited by 12
“There is a class of approaches to aid fault localization which are popular among researchers, but have not yet been widely adopted by the industry: Spectrum-Based Fault Localization (SBFL) (Wong et al. 2016; Parmar and Patel 2016; Pearson et al. 2017).”
BackgroundInfluentialBUGSC++: A Highly Usable Real World Defect Benchmark for C/C++
An, G., Kwon, M., Choi, K., Yi, J., & Yoo, S. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00208 · Cited by 17
“As the size and complexity of a program inevitably increase the cost of its maintenance, debugging techniques such as Fault Localization (FL) [2] or Automated Program Repair (APR) [3] have been actively researched to increase developer productivity and reduce the debugging cost.”
BackgroundImpact of Large Language Models of Code on Fault Localization
Ji, S., Lee, S.-H., Lee, C.-S., Han, Y.-S., & Im, H. (2025) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst62969.2025.10989036 · Cited by 20
“Traditional fault localization (FL) techniques often construct a coverage matrix by executing the program with its input/output test data [67].”
Efilter: An effective fault localization based on information entropy with unlabelled test cases
Xiaobo, Y., Liu, B., Wang, S., Dong, A., Feng, Z., & Yelin, Y. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106543 · Cited by 15
Combinatorial methods for testing Internet of Things smart home systems
Garn, B., Schreiber, D., Simos, D. E., Kuhn, R., Voas, J., & Kacker, R. N. (2021) · Software Testing Verification and Reliability · doi:10.1002/stvr.1805 · Cited by 12
“Therefore, a complete combinatorial fault analysis [64,65] is out of scope of this paper and is part of future work.”
BackgroundIs refactoring always a good egg? exploring the interconnection between bugs and refactorings
Bagheri, A., & Hegedűs, P. (2022) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3524842.3528034 · Cited by 12
“On the one hand, real bugs/patches are required for a thorough examination of a variety of automatic or semi-automatic methods for detecting problematic software programs, to finding incorrect statements [7], [8] and fixing incorrect applications [9], [10].”
MethodHenderson, T. A. D., Dorward, B., Nickell, E., Johnston, C., & Kondareddy, A. (2023) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst57152.2023.00041 · Cited by 14
“Despite its industrial importance, culprit finding has been relatively less studied in the literature in comparison to topics such as Fault Localization [32], [33] (coverage based [34], [35], [36], [28], [29], [37], information retrieval based [38], [39], [40], or slicing based [41], [12], [42]), Bug Prediction [43],…”
BackgroundDistributed Repair of Deep Neural Networks
Calsi, D. L., Duran, M., Zhang, X., Arcaini, P., & Ishikawa, F. (2023) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst57152.2023.00017 · Cited by 21
“For classical programs, fault localisation (FL) [40] is a typical debugging approach that, given the results of testing, tries to identify the faulty components of the program.”
BackgroundMethodA Systematic Mapping Study of the Metrics, Uses and Subjects of Diversity‐Based Testing Techniques
Elgendy, I. T., Hierons, R. M., & McMinn, P. (2025) · Software Testing Verification and Reliability · doi:10.1002/stvr.1914 · Cited by 12
“FL is the process of identifying the locations of faults in a programme [220].”
Jonsson, L., Broman, D., Magnusson, M., Sandahl, K., Villani, M., & Eldh, S. (2016) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2016.54 · Cited by 13
“This is evident from a large survey [9] of more than 300 papers on fault localization, where only three papers study programs with more than one million lines of code.”
BackgroundDetecting Bugs of Concurrent Programs With Program Invariants
Wang, R., Ding, Z., Gui, N., & Liu, Y. (2017) · IEEE Transactions on Reliability · doi:10.1109/tr.2017.2681107 · Cited by 12
“Then they employ SFL to correlate detected errors with the concurrently executing code blocks.”
BackgroundInfluentialIdentifying typical approaches and errors in Prolog programming with argument-based machine learning
Možina, M., Lazar, T., & Bratko, I. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.06.029 · Cited by 12
Ammonia: an approach for deriving project-specific bug patterns
Higo, Y., Hayashi, S., Hata, H., & Nagappan, M. (2020) · Empirical Software Engineering · doi:10.1007/s10664-020-09807-w · Cited by 12
“Corrective techniques and analyses include log file analysis (Shang et al. 2015), crash report analysis (Kim et al. 2011), and bug localization (Wong et al. 2016), among others, which are applied once the software is deployed to the end user.”
BackgroundMethodLi, W., Li, Q., Ming, Y., Dai, W., Shi, Y., & Yuan, M. (2022) · Empirical Software Engineering · doi:10.1007/s10664-021-10082-6 · Cited by 15
“In order to reduce the manual effort and promote the efficiency in debugging, various bug localization techniques have been proposed to automate the process of finding buggy files for given bug reports (Wong et al. 2016; Lee et al. 2018).”
MethodWu, Y., Liu, Y., Wang, W., Li, Z., Chen, X., & Doyle, P. (2022) · IEEE Transactions on Reliability · doi:10.1109/tr.2022.3165126 · Cited by 12
Liu, Y., Nie, P., Legunsen, O., & Gligoric, M. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3556952 · Cited by 12
“Fault localization [1, 2, 56, 72, 98, 99] helps finds faulty statements that cause a test failure.”
BackgroundEvolutionary Algorithm for Bug Localization in the Reconfigurations of Models at Runtime
Arcega, L., Font, J., & Cetina, C. (2018) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1145/3239372.3239392 · Cited by 12
“A recent Search-Based Software Engineering survey [40] reveals that none of the Bug Location approaches take in account the bugs caused by the reconfigurations of a models at runtime system.”
MethodResearch on Software Multiple Fault Localization Method Based on Machine Learning
Gao, M., Li, P., Chen, C., & Jiang, Y. (2018) · MATEC Web of Conferences · doi:10.1051/matecconf/201823201060 · Cited by 16
Debugging Flaky Tests on Web Applications
Morán, J., Augusto, C., Bertolino, A., de la Riva, C., & Tuya, J. (2019) · International Conference on Web Information Systems and Technologies · doi:10.5220/0008559000002366 · Cited by 12
Human-level Ordinal Maintainability Prediction Based on Static Code Metrics
Schnappinger, M., Fietzke, A., & Pretschner, A. (2021) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3463274.3463315 · Cited by 13
“Using software metrics as input, considerable advances have been made in areas such as code smell detection [39, 45] or fault localization [65].”
MethodCordy, M., Rwemalika, R., Papadakis, M., & Harman, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.03197 · Cited by 12
“PRAPR applies Fault Localization (FL) [24] to associate an estimated degree of suspiciousness to the statements covered by the failing tests.”
BackgroundBeep: Fine-grained Fix Localization by Learning to Predict Buggy Code ElementsPreprint
Wang, S., Liu, K., Lin, B., Mao, X., Bissyandé, T. F., Li, L., & Klein, J. (2021) · arXiv (Cornell University) · doi:10.13140/rg.2.2.25272.26884 · Cited by 13
HetFL: Heterogeneous Graph-Based Software Fault Localization
Chen, X., Sun, T., Zhuang, D., Yu, D., Jiang, H., Zhou, Z., & Li, S. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3454605 · Cited by 13
A Systematic Exploration of Mutation‐Based Fault Localization Formulae
Wang, B., Wei, J., Chen, M., Chen, C., Lin, Y., & Zhang, J. M. (2024) · Software Testing Verification and Reliability · doi:10.1002/stvr.1905 · Cited by 11
“Existing approaches mostly use the code element granularity of method level or statement level [4].”
Vulnerability Repair via Concolic Execution and Code Mutations
Shariffdeen, R., Timperley, C. S., Noller, Y., Goues, C. L., & Roychoudhury, A. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3707454 · Cited by 11
“The three stages of handling security vulnerabilities, i.e., detection [31, 47], fix localization [21, 40, 49], and repair generation [16, 20], have been mostly handled separately in the past.”
SmartFL: Semantics Based Probabilistic Fault Localization
Wu, Y., Liu, Y., Yin, Y., Zeng, M., Ye, Z., Zhang, X., Xiong, Y., & Zhang, L. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3574487 · Cited by 11
“Here we leave a full summary of fault localization to respective surveys [29], [30], [31] and empirical studies [1], and discuss only the most related work.”
A Systematic Review of Search Strategies in Dynamic Symbolic Execution
Sabbaghi, A., & Keyvanpour, M. R. (2020) · Computer Standards & Interfaces · doi:10.1016/j.csi.2020.103444 · Cited by 13
Specification-Guided Automated Debugging of CPS Models
Singh, N. K., & Saha, I. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2020.3012862 · Cited by 11
“Bug localization [40], [41] has always been one of the significant challenges faced by the software engineering community.”
BackgroundANCHOR: locating android framework-specific crashing faults
Kong, P., Li, L., Gao, J., Riom, T., Zhao, Y., Bissyandé, T. F., & Klein, J. (2021) · Automated Software Engineering · doi:10.1007/s10515-021-00290-1 · Cited by 11
“A recent survey by Wong et al. (2016) marks the activity of identifying the locations of faults in a program to be most tedious, time-consuming, and expensive, yet equally critical.”
BackgroundReduction-assisted Fault Localization: Don’t Throw Away the By-products!
Vince, D., Hodován, R., & Kiss, Á. (2021) · International Conference on Software Technologies (ICSOFT) · doi:10.5220/0010560500002992 · Cited by 11
VSBFL: Variable Value Sequence Based Fault Localization for Novice Programs
Li, Z., Shen, J., Wu, Y., Liu, Y., & Sun, Z. (2021) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c55045.2021.00078 · Cited by 15
Metadata
- Authors
- Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F.
- Affiliations
- The University of Texas at Dallas (US)
- Palo Alto Research Center (US)
- Graz University of Technology (AT)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2016-08-01
- Volume
- 42
- Issue
- 8
- Pages
- 707-740
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- OpenAlex
- W2343875716
- Cited by
- 1,110
- References
- 451
- Citations by year
- 2026: 91 · 2025: 96 · 2024: 127 · 2023: 113 · 2022: 132 · 2021: 118 · 2020: 117 · 2019: 117 · 2018: 88 · 2017: 54 · 2016: 26
- FWCI
- 324.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- software fault localization, debugging, automated fault diagnosis, software defects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.