A Survey on Software Fault Localization
The DOI matches its Crossref record; 436 of the 451 references it cites were found in a registry or an index.
Abstract
Software fault localization, the act of identifying the locations of faults in a program, is widely recognized to be one of the most tedious, time consuming, and expensive - yet equally critical - activities in program debugging. Due to the increasing scale and complexity of software today, manually locating faults when failures occur is rapidly becoming infeasible, and consequently, there is a strong demand for techniques that can guide software developers to the locations of faults in a program with minimal human intervention. This demand in turn has fueled the proposal and development of a broad spectrum of fault localization techniques, each of which aims to streamline the fault localization process and make it more effective by attacking the problem in a unique way. In this article, we catalog and provide a comprehensive overview of such techniques and discuss key issues and concerns that are pertinent to software fault localization as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, Steinder et al. [21], Wong et al. [24], and Solé et al. [25] described the process of root-cause identification but did not focus on the microservices architecture.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [24]
Citations
Cites
Cousot, P., & Cousot, R. (1977) · Proceedings of the 4th ACM SIGACT-SIGPLAN symposium on Principles of programming languages - POPL '77 · doi:10.1145/512950.512973 · Cited by 6,279 · cited 1×
“lem, Mayer and Stumptner [246] propose an abstractionbased model in which abstract interpretation [55], [78] is applied to handle loops, recursive procedures, and heap data structures.”
BackgroundBasic concepts and taxonomy of dependable and secure computing
Avizienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,223 · cited 1×
“The following terms appear repeatedly throughout this article, and thus for convenience, we provide definitions for them here per the taxonomy provided in [37]: A failure is when a service deviates from its correct behavior.”
BackgroundCAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Weiser, M. (1984) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1984.5010248 · Cited by 3,204
A theory of diagnosis from first principles
Reiter, R. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90062-2 · Cited by 3,031 · cited 1×
“While using model-based diagnosis [301], it is assumed that a correct model of each program being diagnosed is available.”
MethodFundamentals of neural networks: architectures, algorithms, and applications
Fausett, L. V. (1994) · CERN Document Server (European Organization for Nuclear Research) · Cited by 3,025
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
Theory of the backpropagation neural network
Hecht-Nielsen (1989) · International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1989.118638 · Cited by 2,222
de Kleer, J., & Williams, B. C. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90063-4 · Cited by 2,039
Lewis, D. (1973) · The Journal of Philosophy · doi:10.2307/2025310 · Cited by 1,914
Research works printed but not linked: 17
- jannach, 0, Toward model-based debugging of spreadsheet programs, Proc Knowledge-Based Software Eng Conf, 252
- panko, 2006, Facing the problem of spreadsheet errors, Decision Line, 37, 8
- he, 0, Automated debugging using path-based weakest preconditions, Proc 8th Int Conf Fundam Approaches Softw Eng, 267
- lewis, 1973, Counterfactuals
- lucia lo, 0, Fusing fault localizers, IEEE Int Conf on Auto Soft Eng, 127
- lyle, 0, Automatic program bug location by program slicing, Proc Int Conf Comput Appl, 877
- grottke, 0, A classification of software faults, Proc 16th IEEE Int Symp Softw Rel Eng, 419
- mayer, 0, Prioritizing model-based debugging diagnostic reports, Proc Int Workshop Principles Diagnosis, 127
- mayer, 2004, Approximate modeling for debugging of program loops, Proc Int Workshop Principles Diagnosis, 87
- moon, 2014, Effective software fault localization using dynamic program behaviors, Master thesis
- gong, 0, Diversity maximization speedup for fault, Proc Int Conf Autom Softw Eng, 30
- torlak, 0, MemSAT: Checking axiomatic specifications of memory models, Proc ACM SIGPLAN Conf Programming Language Design and Implementation, 341
- vayani, 2007, Improving automatic software fault localization, Master thesis
- wu, 0, A statistical model to locate faults at input levels, Proc Int Conf Autom Softw Eng, 274
- collofello, 0, Towards automatic software fault localization through decision-to-decision path analysis, Proc Nat Comput Conf, 539
- stumptner, 0, Debugging functional program, Proc Int Joint Conf Artif Intell, 440
- xie, 0, Provably optimal and human-competitive results in SBSE for spectrum based fault localization, Proc 2nd Int Symp Search Based Software Eng, 224
Cited by
Demystifying LLM-Based Software Engineering Agents
Xia, C. S., Deng, Y., Dunn, S., & Zhang, L. (2025) · Proceedings of the ACM on Software Engineering · doi:10.1145/3715754 · Cited by 849
“Fault localization (FL) [Wong et al. 2016] techniques aim to identify the suspicious locations (e.g., statements or methods) in source code related to bugs.”
The DStar Method for Effective Software Fault Localization
Wong, W. E., Debroy, V., Gao, R., & Li, Y. (2014) · IEEE Transactions on Reliability · doi:10.1109/tr.2013.2285319 · Cited by 479
Self-citationEvaluating and Improving Fault Localization
Pearson, S., Campos, J., Just, R., Fraser, G., Abreu, R., Ernst, M. D., Pang, D., & Keller, B. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.62 · Cited by 426
Self-citationAutomated Program Repair via Conversation: Fixing 162 out of 337 Bugs for $0.42 Each using ChatGPT
Xia, C. S., & Zhang, L. (2024) · Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3650212.3680323 · Cited by 203
Automatic Software Repair: A Bibliography
Monperrus, M. (2019) · ACM Computing Surveys · doi:10.1145/3105906 · Cited by 321
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2887384 · Cited by 410
“In addition, existing fault localization techniques [36] are ineffective for microservices.”
Practitioners' expectations on automated fault localization
Kochhar, P. S., Xia, X., Lo, D., & Li, S. (2016) · Proceedings of the 25th International Symposium on Software Testing and Analysis · doi:10.1145/2931037.2931051 · Cited by 346
“, the proportion of time the success criterion is met) since they were measured in various ways to evaluate past fault localization techniques [14,28,49,51].”
BackgroundTBar: revisiting template-based automated program repair
Liu, K., Koyuncu, A., Kim, D., & Bissyandé, T. F. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330577 · Cited by 321
“s localized, ARP tools can mutate the buggy code entity to generate patches, which might fix a given bug. To identify defect locations in a program, several automated FL techniques have been proposed [67]: slice-based [41, 65], spectrum-based [3, 52], statisticsbased [28, 29], etc. Spectrum-based FL (SBFL) techniques…”
MethodContext-aware patch generation for better automated program repair
Wen, M., Chen, J., Wu, R., Hao, D., & Cheung, S.-C. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180233 · Cited by 328
DeepFL: integrating multiple fault diagnosis dimensions for deep fault localization
Li, X., Li, W., Zhang, Y., & Zhang, L. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330574 · Cited by 336
Ask the Mutants: Mutating Faulty Programs for Fault Localization
Moon, S., Kim, Y., Kim, M., & Yoo, S. (2014) · 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation · doi:10.1109/icst.2014.28 · Cited by 291
“A developer, then, is to inspect PUT following the order of statements in the given ranking, in the hope that the faulty statement will be encountered near the top of the ranking [26].”
BackgroundLarge Language Model-Based Agents for Software Engineering: A Survey
Jun-wei, L., Wang, K., Chen, Y., Peng, X., Chen, Z., Zhang, L., & Lou, Y. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3796507 · Cited by 325
An Empirical Study of Fault Localization Families and Their Combinations
Zou, D., Liang, J., Xiong, Y., Ernst, M. D., & Zhang, L. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2892102 · Cited by 270
“report, rather than a set of test cases, and generate as output a list of relevant source code files [45].”
BackgroundZhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Liu, D., Xiang, Q., & He, C. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338961 · Cited by 277
“Traditional fault localization approaches include slice-based fault localization (e.g., [3, 4, 6, 7, 55]), spectrum-based fault localization (e.g., [2, 18, 21, 23, 29, 38, 45], fault localization based on analyzing program states (e.g., [58–60]), fault localization based on data mining (e.g., [15,…”
BackgroundSoldani, J., & Brogi, A. (2023) · ACM Computing Surveys · doi:10.1145/3501297 · Cited by 256
“Wong et al. [89] instead provide an overview of the techniques allowing to identify the root causes of failures in the source code of a single software program.”
BackgroundFLUCCS: using code and change metrics to improve fault localization
Sohn, J., & Yoo, S. (2017) · Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3092703.3092717 · Cited by 242
“Fault localization is a problem that, given results of testing, asks to identify the location of the fault in the SUT [36].”
BackgroundMethodChen, J., Patra, J., Pradel, M., Xiong, Y., Zhang, H., Hao, D., & Zhang, L. (2021) · ACM Computing Surveys · doi:10.1145/3363562 · Cited by 215
“Christi et al. [33] investigate the impact of delta debugging for test input reduction (including test program reduction) on spectrum-based bug localization that localizes bugs based on statistics of coverage status of each program element during failing and passing executions [1, 121].”
BackgroundLess training, more repairing please: revisiting automated program repair via zero-shot learning
Xia, C. S., & Zhang, L. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549101 · Cited by 231
AutoCodeRover: Autonomous Program Improvement
Zhang, Y., Ruan, H., Fan, Z., & Roychoudhury, A. (2024) · Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3650212.3680384 · Cited by 202
“We note that the workflow of AutoCodeRover discussed so far only requires the problem statement 𝑃 and codebase 𝐶 as input, and do not require any program specifications such as testcases.”
AutoCodeRover: Autonomous Program Improvement
Zhang, Y., Ruan, H., Fan, Z., & Roychoudhury, A. (2024) · arXiv · doi:10.48550/arxiv.2404.05427 · Cited by 202
“We note that the workflow of AutoCodeRover discussed so far only requires the problem statement 𝑃 and codebase 𝐶 as input, and do not require any program specifications such as testcases.”
A Survey of Learning-based Automated Program Repair
Zhang, Q., Fang, C., Ma, Y., Sun, W., & Chen, Z. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3631974 · Cited by 132
Effective Software Fault Localization Using an RBF Neural Network
Wong, W. E., Debroy, V., Golden, R., Xu, X., & Thuraisingham, B. (2012) · IEEE Transactions on Reliability · doi:10.1109/tr.2011.2172031 · Cited by 189
Self-citationParry, O., Kapfhammer, G. M., Hilton, M. L., & McMinn, P. (2021) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3476105 · Cited by 238
Fault Localization with Code Coverage Representation Learning
Li, Y., Wang, S., & Nguyen, T. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) · doi:10.1109/icse43902.2021.00067 · Cited by 142
“In the FL problem, given the execution of test cases, an FL tool identifies the set of suspicious lines of code with their associated suspiciousness scores [49].”
BackgroundMethodSelf-citationPractical program repair via bytecode mutation
Ghanbari, A., Benton, S., & Zhang, L. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330559 · Cited by 162
“information obtained from both failing and passing test cases to compute degrees of suspiciousness for each element of the program. For example, so-called spectrum-based fault localization techniques [69], that identify the program elements covered by more failed tests and less passed tests as more suspicious, have be…”
BackgroundMethodDeep learning library testing via effective model generation
Wang, Z., Yan, M., Chen, J., Liu, S., & Zhang, D. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3409761 · Cited by 167
Liu, K., Koyuncu, A., Bissyandé, T. F., Kim, D., Klein, J., & Traon, Y. L. (2019) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2019.00020 · Cited by 194
Boosting coverage-based fault localization via graph-based representation learning
Lou, Y., Zhu, Q., Dong, J., Li, X., Sun, Z., Hao, D., Zhang, L., & Zhang, L. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3468580 · Cited by 163
“Fault localization (FL) [19, 34, 39, 54, 63, 70, 74, 78] aims to diagnose buggy program entities (i.”
BackgroundAn Empirical Study on Real Bug Fixes
Zhong, H., & Su, Z. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.101 · Cited by 130
“Wong and Debroy [34] claim that most fault localization approaches assume that each buggy .le has exactly a faulty line.”
BackgroundInfluentialA Roadmap Toward the Resilient Internet of Things for Cyber-Physical Systems
Ratasich, D., Khalid, F., Geißler, F., Grosu, R., Shafique, M., & Bartocci, E. (2019) · IEEE Access · doi:10.1109/access.2019.2891969 · Cited by 176
“This is often performed by root cause analysis [134] or fault-localization [135]–[141].”
BackgroundA Survey of Machine Learning for Big Code and Naturalness
Allamanis, M., Barr, E. T., Devanbu, P., & Sutton, C. (2019) · ACM Computing Surveys · doi:10.1145/3212695 · Cited by 150
“systematically applied andyet suffer fromuncertainty problemsthat machinelearningis particularlywell suited to address, promising new advances. Debugging. Debugging isa commontask forsoftware engineers[191]. Debuggingislike trying tofindaneedleinthehaystack;adeveloperhastorecognizerelevantinformationfromthedeluge of ava…”
BackgroundBoosting spectrum-based fault localization using PageRank
Zhang, M., Li, X., Zhang, L., & Khurshid, S. (2017) · Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3092703.3092731 · Cited by 137
“Recent survey by Wong et al. [58] shows more details about various fault localization approaches.”
BackgroundA survey of AIOps methods for failure management
Notaro, P., Cardoso, J., & Gerndt, M. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3483424 · Cited by 142
Dissection of a bug dataset: Anatomy of 395 patches from Defects4J
Sobreira, V., Durieux, T., Madeiral, F., Monperrus, M., & Maia, M. D. A. (2018) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330203 · Cited by 140
“In the last decades, research aiming to automate tasks such as fault localization [2], [3], [4] and program repair [5], [6], [7], [8], [9], [10], [11] emerged to support developers at fixing bugs.”
BackgroundA Systematic Literature Review on Large Language Models for Automated Program Repair
Zhang, Q., Fang, C., Xie, Y., Ma, Y., Sun, W., Yang, Y. J., & Chen, Z. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3799693 · Cited by 190
“…bug, (1) the fault localization phase identifies suspicious code elements that need to be fixed based on off-the-shelf localization techniques [158]; (2) the patch generation phase generates program variants (i.e., candidate patches) via transformation rules [182]; (3) the patch validation…”
CNN-FL: An Effective Approach for Localizing Faults using Convolutional Neural Networks
Zhang, Z., Lei, Y., Mao, X., & Li, P. (2019) · 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8668002 · Cited by 126
“More work on fault localization can refer to a recent survey [4] by Wong et al.”
Data cleaning and machine learning: a systematic literature review
Côté, P.-O., Nikanjam, A., Ahmed, N., Humeniuk, D. V., & Khomh, F. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00453-w · Cited by 163
Where is the bug and how is it fixed? an experiment with practitioners
Böhme, M., Soremekun, E. O., Chattopadhyay, S., Ugherughe, E., & Zeller, A. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106255 · Cited by 122
“In order to evaluate the e � ectiveness of a fault localization (FL) technique, researchers � rst need to identify the statements which are actually faulty and determine the rank of the highest ranked faulty statement (a.k.a. wasted e � ort [49]).”
MethodPapadakis, M., Shin, D., Yoo, S., & Bae, D. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3180155.3180183 · Cited by 162
“To do so, we use a typical similarity coefficient, named Ochiai3, which we borrow from fault localisation studies [42]).”
MethodA Quantitative and Qualitative Evaluation of LLM-Based Explainable Fault Localization
Kang, S., An, G., & Yoo, S. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3660771 · Cited by 128
“Commonly used FL technique families include Spectrum-based FL (SBFL), Information Retrieval-based FL (IRFL), and Mutation-based FL (MBFL) [45].”
Deep learning-based software engineering: progress, challenges, and opportunities
Chen, X., Hu, X., Huang, Y., Jiang, H., Ji, W., Jiang, Y., Jiang, Y., Liu, B., Liu, H., Li, X., et al. (2024) · Science China Information Sciences · doi:10.1007/s11432-023-4127-5 · Cited by 153
Spectrum-based Software Fault Localization: A Survey of Techniques, Advances, and ChallengesPreprint
de Souza, H. A., Chaim, M. L., & Kon, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.04347 · Cited by 126
“presented a fault localization survey addressing techniques from 1977 to November 2014 [146].”
MethodGraph-based root cause analysis for service-oriented and microservice architectures
Brandón, Á., Solé, M., Huélamo, A., Solans, D., Pérez, M. S., & Muntés-Mulero, V. (2020) · Journal of Systems and Software · doi:10.1016/j.jss.2019.110432 · Cited by 121
“There is a large body of work related to Root Cause Analysis (RCA) (see [7, 8] for extensive surveys).”
BackgroundStudying the advancement in debugging practice of professional software developers
Perscheid, M., Siegmund, B., Taeumel, M., & Hirschfeld, R. (2016) · Software Quality Journal · doi:10.1007/s11219-015-9294-2 · Cited by 144
“For example, there have been multiple approaches to automate parts of the fault localization process [23]–[40], a categorization and overview can be found in [10].”
MethodArachne: Search-Based Repair of Deep Neural Networks
Sohn, J., Kang, S., & Yoo, S. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3563210 · Cited by 135
“Regarding fault localisation, DeepFault [46] adopts the Spectrum Based Fault Localisation (SBFL) framework that has been successfully applied to coverage and test result information from traditional programs [31].”
MethodImproved bug localization based on code change histories and bug reports
Youm, K. C., Ahn, J., & Lee, E. (2016) · Information and Software Technology · doi:10.1016/j.infsof.2016.11.002 · Cited by 117
Fault Management in Software-Defined Networking: A Survey
Yu, Y., Li, X., Leng, X., Song, L., Bu, K., Chen, Y., Yang, J., Zhang, L., Cheng, K., & Xiao, X. W. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2868922 · Cited by 126
“In software engineering, various profiling techniques [96], [157], [158] have been developed for monitoring software behaviors, e.”
BackgroundMethodWong, W. E., Li, X., & Laplante, P. A. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2017.06.069 · Cited by 125
“The more complex the software, the more likely it is that it will contain faults ( Wong et al., 2016 ).”
Self-citationWhen Software Security Meets Large Language Models: A Survey
Zhu, X., Zhou, W., Han, Q., Ma, W., Wen, S., & Xiang, Y. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2024.124971 · Cited by 128
Can automated program repair refine fault localization? a unified debugging approach
Lou, Y., Ghanbari, A., Li, X., Zhang, L., Zhang, H., Hao, D., & Zhang, L. (2020) · Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3395363.3397351 · Cited by 99
“Please refer to the recent surveys on automated software debugging for more details [50, 76].”
MethodHistorical Spectrum Based Fault Localization
Wen, M., Chen, J., Tian, Y., Wu, R., Hao, D., Han, S., & Cheung, S.-C. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2948158 · Cited by 94
“Specifically, we use Ochiai [30] by default to compute the suspicious score for each statement s 2 S C in HSFL since it has been reported to be the optimum formula for SBFL [2].”
InfluentialAn empirical study on real bug fixes
Zhong, H., & Su, Z. (2015) · doi:10.5555/2818754.2818864 · Cited by 103
iFixR: bug report driven program repair
Koyuncu, A., Liu, K., Bissyandé, T. F., Kim, D., Monperrus, M., Klein, J., & Le Traon, Y. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338935 · Cited by 87
“ailing test case exists (i.e., only future test cases trigger the bug) 365 In the APR literature, fault localization is generally performed using the GZoltar [11] testing framework and a SBFL formula [88] (e.g., Ochiai [2]). To support our discussions, we attempt to perform fault localization without the future test c…”
BackgroundMethodBugsJS: a Benchmark of JavaScript Bugs
Gyimesi, P., Vancsics, B., Stocco, A., Mazinanian, D., Beszedes, A., Ferenc, R., & Mesbah, A. (2019) · 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST) · doi:10.1109/icst.2019.00019 · Cited by 89
“Similarly, B UGS JS will be of great benefit for other popular bug localization approaches, e.g. , the spectrum-based techniques [51, 52, 53, 54].”
BackgroundFault Localization Analysis Based on Deep Neural Network
Zheng, W., Hu, D., & Wang, J. (2016) · Mathematical Problems in Engineering · doi:10.1155/2016/1820454 · Cited by 93
“In this way, it will facilitate the software development process and reduce maintenance cost [2].”
DeepFault: Fault Localization for Deep Neural Networks
Enişer, H. F., Gerasimou, S., & Şen, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-16722-6_10 · Cited by 120
Multiple fault localization of software programs: A systematic literature review
Zakari, A., Lee, S. P., Abreu, R., Ahmed, B. H., & Rasheed, R. A. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106312 · Cited by 88
“At the time of this report, there was no systematic literature study that provided a rigorous review and analysis of existing research on MFL [10-16] .”
BackgroundResultInfluentialSelf-citationNasrabadi, M. Z., Parsa, S. A., Ramezani, M., Roy, C. K., & Ekhtiarzadeh, M. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111796 · Cited by 129
An Empirical Study of Boosting Spectrum-Based Fault Localization via PageRank
Zhang, M., Li, Y., Li, X., Chen, L., Zhang, Y., Zhang, L., & Khurshid, S. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2911283 · Cited by 84
“For example, it has been reported that debugging can take up to 80 percent of the total software cost [1], [2].”
BackgroundSelf-citationKeller, F., Grunske, L., Heiden, S., Filieri, A., van Hoorn, A., & Lo, D. (2017) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2017.22 · Cited by 83
“Debugging large scale programs might be dramatically time consuming [5].”
BackgroundMethodInfluentialBench4BL: reproducibility study on the performance of IR-based bug localization
Lee, J., Kim, D., Bissyandé, T. F., Jung, W.-S., & Traon, Y. L. (2018) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3213846.3213856 · Cited by 112
“There are two leading research directions on bug (fault) localization, namely spectrum-based fault localization [1, 2, 10, 47] and IR-based bug localization [37, 44–46, 52, 53].”
BackgroundA Survey of Challenges in Spectrum-Based Software Fault Localization
Sarhan, Q. I., & Beszédes, Á. (2022) · IEEE Access · doi:10.1109/access.2022.3144079 · Cited by 95
“In [29], In [12], the authors conducted a survey on the state-of-the-art of SBFL research including the proposed techniques, the type and number of faults they address, the types of spectra they use, the programs they utilize in their validation, and their use in industrial settings.”
BackgroundMethodMutation-Based Fault Localization for Real-World Multilingual Programs (T)
Hong, S., Lee, B., Kwak, T., Jeon, Y., Ko, B., Kim, Y., & Kim, M. (2015) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.14 · Cited by 77
“Fault localization techniques [31], [46] aim to locate the root cause of an error in the target program (i.e., the second step of debugging) by observing test runs.”
BackgroundA Grouping-Based Strategy to Improve the Effectiveness of Fault Localization Techniques
Debroy, V., Wong, W. E., Xu, X., & Choi, B. (2010) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2010.80 · Cited by 75
Self-citationMSeer—An Advanced Technique for Locating Multiple Bugs in Parallel
Gao, R., & Wong, W. E. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2776912 · Cited by 75
Self-citationSurvey on Models and Techniques for Root-Cause Analysis
Solé, M., Muntés-Mulero, V., Rana, A. I., & Estrada, G. (2017) · arXiv · doi:10.48550/arxiv.1701.08546 · Cited by 74
“on specific areas, the reader may refer to [3], [4] for computer networks, [5], [6] for software, [7], [8] for industrial systems, [9] for smart buildings, [10] for buildings, [11] for machinery, [12] for swarm systems, [13], [14] for automatic control systems, [15], [16] for automotive systems and [17] for aerospace…”
BackgroundGamma: Revisiting Template-Based Automated Program Repair Via Mask Prediction
Zhang, Q., Fang, C., Zhang, T., Yu, B., Sun, W., & Chen, Z. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00063 · Cited by 126
“In the future, we attempt to report the repair performance of G AMMA and baselines with both the automated fault localization (e.g., Ochiai [31]) and perfect fault localization.”
MethodInfluentialA Test-Suite Diagnosability Metric for Spectrum-Based Fault Localization Approaches
Perez, A., Abreu, R., & Arie Van Deursen, A. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2017.66 · Cited by 87
Self-citationA Survey of Software Quality for Machine Learning Applications
Masuda, S., Ono, K., Yasue, T., & Hosokawa, N. (2018) · 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw.2018.00061 · Cited by 68
“surveyed software fault localization [44].”
Huang, S., Lin, C., Xu, W., Gao, Y., Feng, Z., & Zhu, F. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3016125 · Cited by 74
“Moreover, software-defined radio platforms, such as USRP enable the cheap and easy design of illegitimate attack devices and this lowers the threshold for attacks and exacerbates the number of attackers [5].”
BackgroundA universal data augmentation approach for fault localization
Xie, H., Lei, Y., Yan, M. L., Yu, Y., Xia, X., & Mao, X. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510136 · Cited by 78
“Many formulas of SFL originate in the statistics, coefficient, or probability related to the raw data [56].”
BackgroundMethodInfluentialThe Plastic Surgery Hypothesis in the Era of Large Language Models
Xia, C. S., Ding, Y., & Zhang, L. (2023) · 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00047 · Cited by 67
“…as Generate-and-Validate (G&V) [8], [9], [6], [10], [4], [11], [12], [13], [14], [15], [16], which is typically based on the following pipeline: First, fault localization techniques [17], [18], [19], [20] are applied to determine the suspicious locations in programs where bugs are likely to exist.”
Exploring and exploiting the correlations between bug-inducing and bug-fixing commits
Wen, M., Wu, R., Liu, Y., Tian, Y., Xie, X., Cheung, S.-C., & Su, Z. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338962 · Cited by 64
“To investigate whether such information can boost the performance of SBFL, we devise the following approach inspired by Finding #2.”
BackgroundInfluentialCombining Spectrum-Based Fault Localization and Statistical Debugging: An Empirical Study
Jiang, J., Wang, R., Xiong, Y., Chen, X., & Zhang, L. (2019) · 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00054 · Cited by 55
“Moreover, we take the mean rank of a program element to break the tie when multiple elements have the same suspicious scores like exiting approaches [16], [38]–[40].”
BackgroundAn exploratory study of autopilot software bugs in unmanned aerial vehicles
Wang, D., Li, S., Xiao, G., Liu, Y., & Sui, Y. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3468559 · Cited by 79
“With the analysis, we identified two challenges in fixing bugs in UAV systems.”
MethodFault density, fault types, and spectra-based fault localization
DiGiuseppe, N., & Jones, J. A. (2014) · Empirical Software Engineering · doi:10.1007/s10664-014-9304-1 · Cited by 65
“…a fault-localization literature survey by Wong and Debroy discusses 19 separate articles that explicitly address specialized CFL techniques (Wong and Debroy 2009), and many of the earlier CFL techniques are cited several hundreds of times by other scholarly work that extends the techniques…”
BackgroundFailure Diagnosis for Distributed Systems using Targeted Fault Injection
Pham, C., Wang, L., Tak, B., Baset, S., Tang, C., Kalbarczyk, Z., & Iyer, R. (2016) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2016.2575829 · Cited by 65
A study of effectiveness of deep learning in locating real faults
Zhang, Z., Lei, Y., Mao, X., Yan, M. L., Xu, L., & Zhang, X. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106486 · Cited by 68
“More work on fault localization can refer to a survey [38] by Wong et al. Coverage-based fault localization techniques convert program spectrum data from test executions to suspiciousness score of program entities and rank them in descending order [1].”
BackgroundCompiler bug isolation via effective witness test program generation
Chen, J., Han, J., Sun, P., Zhang, L., Hao, D., & Zhang, L. (2019) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3338906.3338957 · Cited by 63
Improving Fault Localization by Integrating Value and Predicate Based Causal Inference Techniques
Kucuk, Y., Henderson, T. A. D., & Podgurski, A. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00066 · Cited by 76
A Public Unified Bug Dataset for Java
Ferenć, R., Tóth, Z., Ladányi, G., Siket, I., & Gyimóthy, T. (2018) · doi:10.1145/3273934.3273936 · Cited by 61
“Bug localization is a crucial and very expensive part of software engineering, therefore many researches have examined this topic and several different approaches were proposed which tried to reduce costs and to create more powerful methods [38].”
BackgroundTesting Web Enabled Simulation at Scale Using Metamorphic Testing
Ahlgren, J., Berezin, M. E., Bojarczuk, K., Dulskyte, E., Dvortsova, I., George, J., Gucevska, N., Harman, M., Lomelí, M., Meijer, E., et al. (2021) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip52600.2021.00023 · Cited by 75
“Techniques such as automated debugging [54] and spectrum based fault localisation [55], [56] could prove useful here, but may need adaption to handle metamorphic testing scenarios.”
BackgroundLocating faults with program slicing: an empirical analysis
Soremekun, E., Kirschner, L., Böhme, M., & Zeller, A. (2021) · Empirical Software Engineering · doi:10.1007/s10664-020-09931-7 · Cited by 60
“This implies that the error type can 22 The SIR benchmark is the most used subject for the evaluation of AFL techniques, especially statistical fault localization (Wong et al., 2016). influence the performance of an AFL technique.”
BackgroundMethodResultInfluentialFailure Diagnosis in Microservice Systems: A Comprehensive Survey and Analysis
Zhang, S., Xia, S., Fan, W., Shi, B., Xiong, X., Zhong, Z., Ma, M., Sun, Y., & Pei, D. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3715005 · Cited by 57
Learning Program Semantics with Code Representations: An Empirical Study
Siow, J. K., Liu, S., Xie, X., Meng, G., & Liu, Y. (2022) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner53432.2022.00073 · Cited by 75
Ziftci, C., & Reardon, J. (2017) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2017.13 · Cited by 57
“Fault localization aids developers to find the root cause of a failing test in source/test code [14].”
BackgroundChen, A. R., Chen, T.-H., & Wang, S. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3071473 · Cited by 47
Improving bug localization using correlations in crash reports
Wang, S., Khomh, F., & Zou, Y. (2013) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6624036 · Cited by 55
Precise Learn-to-Rank Fault Localization Using Dynamic and Static Features of Target Programs
Kim, Y., Mun, S., Yoo, S., & Kim, M. (2019) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3345628 · Cited by 64
“Spectrum-based fault localization is widely studied [74].”
BackgroundDeep Learning-Based Fault Localization with Contextual Information
Zhang, Z., Lei, Y., Tan, Q., Mao, X., Ping, Z. E. N. G., & CHANG, X. (2017) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2017edl8143 · Cited by 53
“Thus, many efforts have been made to provide assistance in guiding programmers to the locations of faults that cause incorrect outputs [1].”
BackgroundCoverage Prediction for Accelerating Compiler Testing
Chen, J., Wang, G., Hao, D., Xiong, Y., Zhang, H., Zhang, L., & Xie, B. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2889771 · Cited by 52
“Also, it has been widely adopted by researchers and practitioners to improve software testing process [9], [10], [11], [12].”
BackgroundAutomatically Generating Precise Oracles from Structured Natural Language Specifications
Motwani, M., & Brun, Y. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00035 · Cited by 44
“Requirements tracing maps specifications, bug reports, and other artifacts to code elements [15], [26], [77], which is related to Swami’s Section Identification using the Okapi model [57], [64].”
MethodTufano, M., Deng, S. K., Sundaresan, N., & Svyatkovskiy, A. (2022) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3524842.3528009 · Cited by 51
“Examples of these tasks include automating developers’ activities, such as: bug-fixing [5, 27], fault localization [28], writing comments [13] and documentation [6], code reviews [25], and merge conflict resolution [24].”
BackgroundA Combinatorial Testing-Based Approach to Fault Localization
Ghandehari, L. S., Lei, Y., Kacker, R. N., Kuhn, R., Xie, T., & Kung, D. C. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2865935 · Cited by 56
“generated randomly and/or using other techniques [24], [40], [50].”
BackgroundMethodInfluentialSpectrum-Based Fault Localization in Model Transformations
Troya, J., Segura, S., Parejo, J. A., & Ruiz–Cortés, A. (2018) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3241744 · Cited by 54
“Spectrum-Based Fault Localization (SBFL) is a popular technique used in software debugging for the localization of bugs [3, 115].”
BackgroundMethodInfluentialAn evaluation of pure spectrum‐based fault localization techniques for large‐scale software systems
Heiden, S., Grunske, L., Kehrer, T., Keller, F., van Hoorn, A., Filieri, A., & Lo, D. (2019) · Software Practice and Experience · doi:10.1002/spe.2703 · Cited by 51
“7 Among them, spectrum-based fault localization (SBFL) 4 techniques exploit the evidence provided by failing and successful test cases to analyze and rank the elements of a code base according to a degree of suspiciousness of their involvement with an incorrect behavior.”
BackgroundFault localization via efficient probabilistic modeling of program semantics
Zeng, M., Wu, Y., Ye, Z., Xiong, Y., Zhang, X., & Zhang, L. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510073 · Cited by 50
“spectively surveys [4, 28, 34] and empirical studies [38], and discuss only the most related work.”
BackgroundWhat constitutes debugging? An exploratory study of debugging episodes
Alaboudi, A., & LaToza, T. D. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10352-5 · Cited by 58
An Artificial Intelligence paradigm for troubleshooting software bugs
Elmishali, A., Stern, R., & Kalech, M. (2018) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.12.011 · Cited by 51
Spectrum-based multi-fault localization using Chaotic Genetic Algorithm
Ghosh, D., & Singh, J. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106512 · Cited by 50
Metadata
- Authors
- Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F.
- Affiliations
- The University of Texas at Dallas (US)
- Palo Alto Research Center (US)
- Graz University of Technology (AT)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2016-08-01
- Volume
- 42
- Issue
- 8
- Pages
- 707-740
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- OpenAlex
- W2343875716
- Cited by
- 1,110
- References
- 451
- Citations by year
- 2026: 91 · 2025: 96 · 2024: 127 · 2023: 113 · 2022: 132 · 2021: 118 · 2020: 117 · 2019: 117 · 2018: 88 · 2017: 54 · 2016: 26
- FWCI
- 324.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- software fault localization, debugging, automated fault diagnosis, software defects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.