A Survey on Software Fault Localization
The DOI matches its Crossref record; 436 of the 451 references it cites were found in a registry or an index.
Abstract
Software fault localization, the act of identifying the locations of faults in a program, is widely recognized to be one of the most tedious, time consuming, and expensive - yet equally critical - activities in program debugging. Due to the increasing scale and complexity of software today, manually locating faults when failures occur is rapidly becoming infeasible, and consequently, there is a strong demand for techniques that can guide software developers to the locations of faults in a program with minimal human intervention. This demand in turn has fueled the proposal and development of a broad spectrum of fault localization techniques, each of which aims to streamline the fault localization process and make it more effective by attacking the problem in a unique way. In this article, we catalog and provide a comprehensive overview of such techniques and discuss key issues and concerns that are pertinent to software fault localization as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, Steinder et al. [21], Wong et al. [24], and Solé et al. [25] described the process of root-cause identification but did not focus on the microservices architecture.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [24]
Citations
Cites
Items 201–400 of 436
Theory and Practice, Do They Match? A Case with Spectrum-Based Fault Localization
Le, T.-D. B., Thung, F., & Lo, D. (2013) · 2013 IEEE International Conference on Software Maintenance · doi:10.1109/icsm.2013.52 · Cited by 70 · cited 2×
“Comparisons among different spectrum-based fault localization techniques are frequently discussed in recent studies [12], [210], [267], [371].”
BackgroundAutomatically Inferring ClassSheet Models from Spreadsheets
Cunha, J., Erwig, M., & Saraiva, J. (2010) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2010.22 · Cited by 70 · cited 1×
“Other techniques aimed at reducing the occurrence of errors in spreadsheets include code inspection [279], refactoring [42], and adoption of better spreadsheet design practices [82], [83].”
MethodHow Well Do Test Case Prioritization Techniques Support Statistical Fault Localization
Jiang, B., Zhang, Z., Tse, T. H., & Chen, T. Y. (2009) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2009.23 · Cited by 70 · cited 4×
“Gcov Profiling tool to collect program spectra open source [13], [53], [102], [213]”
BackgroundMethodInfluentialModel-Based Debugging – State of the Art And Future Challenges
Mayer, W., & Stumptner, M. (2007) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2006.12.030 · Cited by 68 · cited 1×
“Differences between the behaviors of a model and the actual observed behaviors of the program are used to help find bugs in the program [249], [250].”
MethodExploiting purity for atomicity
Cormac Flanagan, A., Freund, S. N., & Qadeer, S. (2004) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/1007512.1007543 · Cited by 67 · cited 2×
“Concurrent programs suffer most from three kinds of access anomalies: data race [32], [321], atomicity violation [110], [113], [115], and atomic-set serializability violations [24], [44].”
BackgroundFarzan, A., & Madhusudan, P. (2006) · Lecture notes in computer science · doi:10.1007/11817963_30 · Cited by 67 · cited 1×
“Concurrent programs suffer most from three kinds of access anomalies: data race [32], [321], atomicity violation [110], [113], [115], and atomic-set serializability violations [24], [44].”
BackgroundHeap profiling of lazy functional programs
Runciman, C., & Wakeling, D. (1993) · Journal of Functional Programming · doi:10.1017/s0956796800000708 · Cited by 66 · cited 1×
“, [313]).”
Efficient forward computation of dynamic slices using reduced ordered binary decision diagrams
Zhang, X., Gupta, R., & Zhang, Y. (2004) · doi:10.5555/998675.999454 · Cited by 66
Reducing qualitative human oracle costs associated with automatically generated test data
McMinn, P., Stevenson, M., & Harman, M. (2010) · doi:10.1145/1868048.1868049 · Cited by 64 · cited 1×
“In response to this challenge, researchers have presented various solutions [16], [147], [148].”
BackgroundAutomated path generation for software fault localization
Wang, T., & Roychoudhury, A. (2005) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/1101908.1101966 · Cited by 64 · cited 1×
“Predicate switching [405] [352] present a similar technique that analyzes the execution path of a failed test and alters the outcome of branches in that path to produce a successful execution.”
BackgroundData clone detection and visualization in spreadsheets
Hermans, F., Sedee, B. M. W., Pinzger, M., & van Deursen, A. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606575 · Cited by 64 · cited 2×
“In response to this, many studies regarding spread-sheet fault localization have been reported [1], [3], [23], [56], [157], [158], [162], [164], [169], [311], [314].”
BackgroundMethodStumptner, M., & Wotawa, F. (1999) · International Joint Conference on Artificial Intelligence · Cited by 63
Self-citationOn the Empirical Evaluation of Fault Localization Techniques for Spreadsheets
Hofer, B., Riboira, A., Wotawa, F., Abreu, R., & Getzner, E. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37057-1_6 · Cited by 63 · cited 3×
“In response to this, many studies regarding spread-sheet fault localization have been reported [1], [3], [23], [56], [157], [158], [162], [164], [169], [311], [314].”
BackgroundMethodSelf-citationEnd-user software visualizations for fault localization
Ruthruff, J. R., Creswick, E. R., Burnett, M., Cook, C., Prabhakararao, S., Fisher, M., & Main, M. (2003) · ACM Symposium on Software Visualization (SoftVis) · doi:10.1145/774833.774851 · Cited by 63 · cited 1×
“In response to this, many studies regarding spread-sheet fault localization have been reported [1], [3], [23], [56], [157], [158], [162], [164], [169], [311], [314].”
BackgroundAutomated source-level error localization in hardware designs
Peischl, B., & Wotawa, F. (2006) · IEEE Design & Test of Computers · doi:10.1109/mdt.2006.5 · Cited by 63 · cited 1×
“They can be applied to functional programs [336], hardware description languages like VHDL [290], [376], and spreadsheets [163], [169].”
MethodSelf-citationPrioritizing tests for fault localization through ambiguity group reduction
González-Sánchez, A., Abreu, R., Groß, H.-G., & van Gemund, A. J. C. (2011) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2011.6100153 · Cited by 62 · cited 1×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundSelf-citationEvaluating the Accuracy of Fault Localization Techniques
Ali, S., Andrews, J. H., Dhandapani, T., & Wang, W. (2009) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2009.89 · Cited by 62 · cited 1×
“Many studies that evaluate the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393],…”
Towards automatic debugging of computer programs
Agrawal, H. (1992) · Cited by 61
Fault-localization using dynamic slicing and change impact analysis
Alves, E., Gligoric, M., Jagannath, V., & d'Amorim, M. (2011) · 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011) · doi:10.1109/ase.2011.6100114 · Cited by 61 · cited 4×
“Combinations between techniques from these two categories have been reported [28], [165], [214], [363].”
BackgroundMethodInfluentialThe Minimal Failure-Causing Schema of Combinatorial Testing
Nie, C., & LEUNG, H. K. N. (2011) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2000799.2000801 · Cited by 59 · cited 1×
“Similar studies [273], [274] based on combinatorial testing are reported, which separate input parameters into faulty-possible and healthy-possible and identify minimal failure-inducing combinations of parameters.”
BackgroundHow well does test case prioritization integrate with statistical fault localization?
Jiang, B., Zhang, Z., Chan, W. K., Tse, T. H., & Chen, T. Y. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.01.006 · Cited by 59 · cited 1×
“…the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393], [420], [406], [410], [424].”
Lucia, Lo, D., & Xia, X. (2014) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2642937.2642983 · Cited by 58 · cited 1×
“Based on a similar idea, Lucia and Xia [232] use two normalization methods to combine results”
MethodRefactoring meets spreadsheet formulas
Badame, S., & Dig, D. (2012) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405299 · Cited by 57 · cited 1×
“Other techniques aimed at reducing the occurrence of errors in spreadsheets include code inspection [279], refactoring [42], and adoption of better spreadsheet design practices [82], [83].”
MethodMinimizing reproduction of software failures
Burger, M., & Zeller, A. (2011) · International Symposium on Software Testing and Analysis · doi:10.1145/2001420.2001447 · Cited by 57 · cited 1×
“In [61], Burger and Zeller propose a technique, JINSI, which combines delta debugging and dynamic slicing for effective fault localization.”
MethodCombining mutation and fault localization for automated program debugging
Debroy, V., & Wong, W. E. (2013) · Journal of Systems and Software · doi:10.1016/j.jss.2013.10.042 · Cited by 57 · cited 3×
“Authors of [95] propose a strategy for automatically fixing bugs in both Java and C programs by combining mutation testing and software fault localization.”
BackgroundMethodResultSelf-citationExplaining abstract counterexamples
Chaki, S., Groce, A., & Strichman, O. (2004) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/1029894.1029908 · Cited by 57 · cited 4×
“Chaki et al. further extend the technique of Groce et al. by combining it with predicate abstraction [67].”
BackgroundMethodInfluentialThe use of program profiling for software maintenance with applications to the year 2000 problem
Reps, T., Ball, T., Das, M., & Larus, J. R. (1997) · Lecture notes in computer science · doi:10.1007/3-540-63531-9_29 · Cited by 57
Spectrum-Based Fault Localization: Testing Oracles are No Longer Mandatory
Xie, X., Wong, W. E., Chen, T. Y., & Xu, B. (2011) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2011.20 · Cited by 54 · cited 1×
“Other techniques such as confidence-based strategy and data dependency-based strategy are also used to break ties [369], [366], [386], [393].”
MethodSelf-citationYılmaz, C., Paradkar, A. M., & Williams, C. E. (2008) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1368088.1368100 · Cited by 53
Search-based fault localization
Wang, S., Lo, D., Jiang, L., Lucia, & Lau, H. C. (2011) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2011.6100124 · Cited by 53 · cited 1×
“In [350], Wang et al. use two different search algorithms, simulated annealing and genetic algorithm, to find approximate optimal compositions from 22 existing spectrum-based fault localization techniques.”
MethodAccurately Choosing Execution Runs for Software Fault Localization
Guo, L., Roychoudhury, A., & Wang, T. (2006) · Lecture notes in computer science · doi:10.1007/11688839_7 · Cited by 52 · cited 2×
“Some fault localization techniques (e.g., [21], [77], [133], [134], [140], [303], [400]) focus on locating program bugs using either a single failed test case or a single failed test case with a few successful test cases.”
BackgroundDiagnosing multiple persistent and intermittent faults
de Kleer, J. (2009) · Cited by 52
Automated Debugging Using Path-Based Weakest Preconditions
He, H., & Gupta, N. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24721-0_20 · Cited by 51 · cited 1×
“Haifeng He [153] Automated Debugging using Path-based Weakest Preconditions Master University of Arizona 2004”
MethodDOC: a practical approach to source-level debugging of globally optimized code
Coutant, D. S., Meloy, S., & Ruscetta, M. (1988) · ACM SIGPLAN Notices · doi:10.1145/960116.54003 · Cited by 51
Modeling Java Programs for Diagnosis
Mateis, C., Stumptner, M., & Wotawa, F. (2000) · Cited by 50
Self-citationSoftware Fault Localization Using N-gram Analysis
Nessa, S., Abedin, M., Wong, W. E., Khan, L. R., & Qi, Y. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88582-5_51 · Cited by 50
Self-citationAutomatic software fault localization using generic program invariants
Abreu, R., González-Sánchez, A., Zoeteweij, P., & van Gemund, A. J. C. (2008) · ACM Symposium on Applied Computing · doi:10.1145/1363686.1363855 · Cited by 50 · cited 1×
“Many studies that evaluate the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393],…”
Self-citationMDSheet: a framework for model-driven spreadsheet engineering
Cunha, J., Fernandes, J. P., Mendes, J., et al. (2012) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.5555/2337223.2337427 · Cited by 49
Analyzing concurrency bugs using dual slicing
Weeratunge, D., Zhang, X., Sumner, W. N., & Jagannathan, S. (2010) · International Symposium on Software Testing and Analysis · doi:10.1145/1831708.1831740 · Cited by 49 · cited 1×
“A similar idea has been used by Weeratunge et al. [358] to identify root causes of omission errors in concurrent programs, in which dual slicing , a combination of dynamic slicing and trace differencing, is used.”
MethodA survey on algorithmic debugging strategies
Silva, J. (2011) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2011.05.024 · Cited by 49 · cited 1×
“Algorithmic debugging (also called declarative debugging), first discussed in Shapiro’s dissertation [325] with more details in [328], [402], decomposes a complex computation into a series of sub-computations to help locate program bugs.”
MethodHeuristics for Automatic Localization of Software Faults
Pan, H., & Spafford, E. H. (1992) · Cited by 48
Avoiding coincidental correctness in boundary value analysis
Hierons, R. M. (2006) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/1151695.1151696 · Cited by 48 · cited 1×
“Studies discussing coincidental correctness have been reported in recent years [44], [46], [159], [218], [239], [254], [355], [419].”
BackgroundA Systematic Study of Failure Proximity
Liu, C., Zhang, X., & Han, J. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.66 · Cited by 48 · cited 1×
“To overcome this problem, Liu and Han [173], [226] further investigate the due-to relationship between failed tests and underlying bugs.”
BackgroundExploiting purity for atomicity
Cormac Flanagan, A., Freund, S. N., & Qadeer, S. (2005) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2005.47 · Cited by 48
Meta-analysis for Atomicity Violations under Nested Locking
Farzan, A., Madhusudan, P., & Sorrentino, F. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02658-4_21 · Cited by 47 · cited 1×
“significant attention [111], [113], [115], [116], [322], [349].”
Prioritizing Tests for Software Fault Localization
González-Sánchez, A., Piel, É., Groß, H.-G., & van Gemund, A. J. C. (2010) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2010.28 · Cited by 47 · cited 1×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundInteractive fault localization leveraging simple user feedback
Gong, L., Lo, D., Jiang, L., & Zhang, H. (2012) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405255 · Cited by 47 · cited 1×
“Gong et al. [123] propose an interactive fault localization technique, TALK, which incorporates programmers’ feed-back into spectrum-based fault localization techniques.”
MethodRefining spectrum-based fault localization rankings
Abreu, R., Mayer, W., Stumptner, M., & van Gemund, A. J. C. (2009) · ACM Symposium on Applied Computing · doi:10.1145/1529282.1529374 · Cited by 47 · cited 2×
“In [9], Abreu et al.”
MethodSelf-citationErmis, E., Schäf, M., & Wies, T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-32759-9_17 · Cited by 47 · cited 4×
“Formula-based fault localization techniques [76], [109], [180], [181] rely on an encoding of failed execution traces into error trace formulae .”
BackgroundInfluentialSteimann, F., & Frenkel, M. (2012) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2012.28 · Cited by 46 · cited 2×
“Steimann and Frenkel [332] use the Weil-Kettler algorithm , a technique widely used in integer linear programming, to cluster failed test cases.”
MethodExploring machine learning techniques for fault localization
Ascari, L. C., Araki, L. Y., Pozo, A., & Vergílio, S. R. (2009) · IEEE Latin American Test Symposium (LATS) · doi:10.1109/latw.2009.4813783 · Cited by 46 · cited 2×
“Many studies that evaluate the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393],…”
Automated debugging based on a constraint model of the program and a test case
Wotawa, F., Nica, M., & Moraru, I. (2012) · The Journal of Logic and Algebraic Programming · doi:10.1016/j.jlap.2012.03.002 · Cited by 45 · cited 1×
“Studies such as [272], [377] make use of constraint solving, in which programs are automatically compiled into a set of constraints.”
MethodSelf-citationJanssen, T., Abreu, R., & van Gemund, A. J. C. (2009) · doi:10.1145/1596495.1596502 · Cited by 45 · cited 1×
“Tools like Zoltar [170] and DEPUTO [9] are available to compute the suspiciousness with respect to selected techniques.”
MethodSelf-citationWhoseFault: Automatic developer-to-fault assignment through fault localization
Servant, F., & Jones, J. A. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227208 · Cited by 45 · cited 1×
“WhoseFault Debugging assignment tool via author [323]”
Software fault localization based on program slicing spectrum
Wen, W. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227049 · Cited by 45 · cited 1×
“Combinations between techniques from these two categories have been reported [28], [165], [214], [363].”
BackgroundEffects of Class Imbalance in Test Suites: An Empirical Study of Spectrum-Based Fault Localization
Gong, C., Zheng, Z., Li, W., & Peng, H. (2012) · IEEE Annual Computer Software and Applications Conference Workshops (COMPSACW) · doi:10.1109/compsacw.2012.89 · Cited by 44 · cited 2×
“A similar idea is subsequently used by Gong et al. to define the N-score [124]: When compared to T-score, EXAM is easier to understand, as it is directly proportional to the amount of code to be examined rather than to an indirect measurement in terms of the amount of code that does not need to be…”
MethodData clone detection and visualization in spreadsheets
Hermans, F., Sedee, B. M. W., Pinzger, M., et al. (2013) · doi:10.5555/2486788.2486827 · Cited by 44
Effective Statistical Fault Localization Using Program Slices
Lei, Y., Mao, X., Dai, Z., & Wang, C. (2012) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2012.9 · Cited by 44 · cited 1×
“Combinations between techniques from these two categories have been reported [28], [165], [214], [363].”
BackgroundAn Efficient Relevant Slicing Method for Debugging
Gyimóthy, T., Beszédes, Á., & Forgács, I. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48166-4_19 · Cited by 43
What you see is what you test: a methodology for testing form-based visual programs
Rothermel, G., Li, L., DuPuis, C., & Burnett, M. (2002) · Proceedings of the 20th International Conference on Software Engineering · doi:10.1109/icse.1998.671118 · Cited by 43 · cited 1×
“In response to this, many studies regarding spread-sheet fault localization have been reported [1], [3], [23], [56], [157], [158], [162], [164], [169], [311], [314].”
BackgroundOracles for Distributed Testing
Hierons, R. M. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.45 · Cited by 42 · cited 1×
“Studies such as [160], [161] have reported that for many systems and for much of testing as currently practiced in industry, testers do not have formal specifications, assertions, or automated oracles.”
BackgroundFault localization through evaluation sequences
Zhang, Z., Jiang, B., Chan, W. K., Tse, T. H., & Wang, X. (2009) · Journal of Systems and Software · doi:10.1016/j.jss.2009.09.041 · Cited by 42 · cited 1×
“Zhang et al. [414], [415] identify the short-circuit evaluations of an individual predicate and produce one set of evaluation sequences for each predicate.”
BackgroundIsolating Suspiciousness from Spectrum-Based Fault Localization Techniques
Xie, X., Chen, T. Y., & Xu, B. (2010) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2010.45 · Cited by 41 · cited 1×
“In [385], all statements are divided into suspicious and unsus-picious groups.”
BackgroundData mining and cross-checking of execution traces
Denmat, T., Ducassé, M., & Ridoux, O. (2005) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/1101908.1101979 · Cited by 41
Formal Concept Analysis Enhances Fault Localization in Software
Cellier, P., Ducassé, M., Ferré, S., & Ridoux, O. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-78137-0_20 · Cited by 41 · cited 1×
“Cellier et al. [65], [66] discuss a combination of association rules and Formal Concept Analysis to assist in fault localization.”
BackgroundSTAD-a system for testing and debugging: user perspective
Korel, B., & Laski, J. W. (2003) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1109/wst.1988.5350 · Cited by 41 · cited 1×
“Early studies [19], [201], [203], [341] only use failed test cases for spectrum-based fault localization, though this approach has subsequently been deemed ineffective [21], [185], [366].”
BackgroundFault Localization Based on Dynamic Slicing and Hitting-Set Computation
Wotawa, F. (2010) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2010.51 · Cited by 40 · cited 3×
“, the HS-Slice algorithm [379]) sometimes produce an undesirable ranking with statements (such as constructors), which are executed by many test cases, at the top.”
BackgroundSelf-citationDOC: a practical approach to source-level debugging of globally optimized code
Coutant, D. S., Meloy, S., & Ruscetta, M. (1988) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/53990.54003 · Cited by 40 · cited 1×
“Early studies (e.g., [80], [155]) use this approach to help developers locate bugs while a program is executed under the control of a symbolic debugger.”
BackgroundCan AI help to improve debugging substantially? debugging experiences with value-based models
Mayer, W., Stumptner, M., Wieland, D., & Wotawa, F. (2002) · Cited by 39
Self-citationSpectrum Enhanced Dynamic Slicing for better Fault Localization
Hofer, B., & Wotawa, F. (2012) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-61499-098-7-420 · Cited by 39 · cited 3×
“HoferandWotawa [165] emphasize that spectrum-based fault localization techniques (e.g., Ochiai [12]) operated at a basic block level do not provide fine-grained results, whereas techniques based on slicing-hitting-set-computa-tion (e.g., the HS-Slice algorithm [379]) sometimes produce an undesirable…”
BackgroundMethodSelf-citationLow-overhead memory leak detection using adaptive statistical profiling
Hauswirth, M., & Chilimbi, T. M. (2004) · ACM SIGPLAN Notices · doi:10.1145/1037187.1024412 · Cited by 39 · cited 1×
“…it can also be leveraged for debugging activities, such as the following: Detecting unexpected execution frequencies of different functions (e.g., [43]); Identifying memory leaks or code that performs unexpectedly poorly (e.g., [150]); Examining the side effects of lazy evaluation (e.g., [313]).”
Memory indexing: canonicalizing addresses across executions
Sumner, W. N., & Zhang, X. (2010) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/1882291.1882324 · Cited by 38 · cited 1×
“Sumner et al. further improve the robustness, precision, and efficiency of delta debugging by combining it with more precise execution alignment techniques [338], [339], [389].”
MethodDrDebug: Deterministic Replay based Cyclic Debugging with Dynamic Slicing
Wang, Y., Patil, H., Pereira, C. L., Lueck, G., Gupta, R., & Neamtiu, I. (2014) · Proceedings of the CGO/Proceedings of the ... CGO · doi:10.1145/2544137.2544152 · Cited by 38 · cited 1×
“Studies such as [18], [24], [28], [96], [104], [188], [192], [201], [219], [227], [237], [257], [277], [297], [334], [356], [378], [379], [406], [407], [410], which use the dynamic slicing concept in program debugging, have been reported.”
VIDA: Visual interactive debugging
Hao, D., Zhang, L., Zhang, L., Sun, J., & Mei, H. (2009) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2009.5070561 · Cited by 38 · cited 1×
“VIDA Visual interactive debugging tool via author [145]”
MethodSarbanes-Oxley: What About all the Spreadsheets?Preprint
Panko, R. R., & Ordway, N. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0804.0797 · Cited by 38
Spectrum-based Fault Localization in Embedded Software
Abreu, R. (2009) · Research Repository (Delft University of Technology) · Cited by 37
Self-citationFlow-Sensitive Fault Localization
Christ, J., Ermis, E., Schäf, M., & Wies, T. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-35873-9_13 · Cited by 37 · cited 2×
“Formula-based fault localization techniques [76], [109], [180], [181] rely on an encoding of failed execution traces into error trace formulae .”
BackgroundFailure and fault analysis for software debugging
DeMillo, R. A., Pan, H., & Spafford, E. H. (2002) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/cmpsac.1997.625061 · Cited by 37 · cited 2×
“In [97], DeMillo et al. propose a model for analyzing software failures and faults for debugging purposes.”
BackgroundNon-parametric statistical fault localization
Zhang, Z., Chan, W. K., Tse, T. H., Yu, Y. T., & Hu, P. (2011) · Journal of Systems and Software · doi:10.1016/j.jss.2010.12.048 · Cited by 37 · cited 1×
“This new enhancement has been empirically evaluated to be effective [416], [420].”
BackgroundSlicing, Chopping, and Path Conditions with Barriers
Krinke, J. (2004) · Software Quality Journal · doi:10.1023/b:sqjo.0000039792.93414.a5 · Cited by 36 · cited 1×
“In [205], the notion of using barriers is proposed to provide a filtering approach for smaller program slices and better comprehensibility.”
BackgroundStudy of the relationship of bug consistency with respect to performance of spectra metrics
Lee, H. J., Naish, L., & Ramamohanarao, K. (2009) · IEEE International Conference on Computer Science and Information Technology · doi:10.1109/iccsit.2009.5234512 · Cited by 36 · cited 1×
“Lee et al. [182], [212] prove that Tarantula always produces a ranking identical to that of a technique where the suspiciousness function is formulated as N CF N CF þ N CS .”
BackgroundFault Localization Based Only on Failed Runs
Zhang, Z., Chan, W. K., & Tse, T. H. (2012) · Computer · doi:10.1109/mc.2012.185 · Cited by 36 · cited 2×
“Zhang et al. [419] present FOnly, a technique that relies only on failed test cases to locate bugs statistically, even though fault localization commonly relies on both successful and failed tests.”
BackgroundYoo, S., Xie, X., Kuo, F., Chen, T. Y., & Harman, M. (2014) · Swinburne figshare (Swinburne University of Technology) · Cited by 36
Identifying Coincidental Correctness for Fault Localization by Clustering Test Cases.
Miao, Y., Chen, Z., Li, S., Zhao, Z., & Zhou, Y. (2012) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · Cited by 36
Metrics-Based Spreadsheet Visualization: Support for Focused MaintenancePreprint
Hodnigg, K., & Mittermeir, R. T. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0809.3009 · Cited by 35 · cited 1×
“In response to this, many studies regarding spread-sheet fault localization have been reported [1], [3], [23], [56], [157], [158], [162], [164], [169], [311], [314].”
BackgroundUsing constraints to diagnose faulty spreadsheets
Abreu, R., Hofer, B., Perez, A., & Wotawa, F. (2014) · Software Quality Journal · doi:10.1007/s11219-014-9236-4 · Cited by 35 · cited 1×
“Another constraint-based approach for debugging faulty spreadsheets (CONBUG) is presented by Abreu et al. [15], taking a spreadsheet and one test case as input to compute a set of faulty candidates.”
MethodSelf-citationLe, T.-D. B., & Lo, D. (2013) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2013.42 · Cited by 35 · cited 1×
“…the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393], [420], [406], [410], [424].”
Dynamic slicing method for maintenance of large C programs
Beszédes, Á., Gergely, T., Szabo, Z. M., Csirik, J., & Gyimóthy, T. (2003) · Proceedings of the ... European Conference on Software Maintenance and Reengineering/Proceedings of the European Conference on Software Maintenance and Reengineering · doi:10.1109/csmr.2001.914974 · Cited by 35 · cited 1×
“Collecting dynamic slices may consume excessive time and file space, even though different algorithms [51], [204], [408], [409] have been proposed to address these issues.”
BackgroundDebugging Hardware Designs Using a Value-Based Model
Wotawa, F. (2002) · Applied Intelligence · doi:10.1023/a:1012821511498 · Cited by 34 · cited 1×
“They can be applied to functional programs [336], hardware description languages like VHDL [290], [376], and spreadsheets [163], [169].”
MethodSelf-citationJavaPDG: A New Platform for Program Dependence Analysis
Shu, G., Sun, B., Henderson, T. A. D., & Podgurski, A. (2013) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2013.57 · Cited by 34 · cited 1×
“JavaPDG A new platform for program dependence analysis openly accessible [326]”
BackgroundA general noise-reduction framework for fault localization of Java programs
Xu, J. F., Zhang, Z., Chan, W. K., Tse, T. H., & Li, S. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.08.006 · Cited by 34
Complexity Metrics for Spreadsheet ModelsPreprint
Bregar, A. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0802.3895 · Cited by 33 · cited 1×
“In response to this, many studies regarding spread-sheet fault localization have been reported [1], [3], [23], [56], [157], [158], [162], [164], [169], [311], [314].”
BackgroundHow Significant is the Effect of Fault Interactions on Coverage-Based Fault Localizations?
Xue, X., & Namin, A. S. (2013) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2013.22 · Cited by 33 · cited 1×
“[90], [101], [102], [125], [172], [173], [184], [224], [293], [331], [332], [359], [395], [423].”
A consensus‐based strategy to improve the quality of fault localization
Debroy, V., & Wong, W. E. (2011) · Software Practice and Experience · doi:10.1002/spe.1146 · Cited by 33 · cited 1×
“…that evaluate the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393], [420], [406],…”
Self-citationProximity based weighting of test cases to improve spectrum based fault localization
Bandyopadhyay, A., & Ghosh, S. (2011) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2011.6100088 · Cited by 32 · cited 1×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundComparative causality: explaining the differences between executions
Sumner, W. N., & Zhang, X. (2013) · doi:10.5555/2486788.2486825 · Cited by 32
WhoseFault: automatic developer-to-fault assignment through fault localization
Servant, F., & Jones, J. A. (2012) · doi:10.5555/2337223.2337228 · Cited by 32
Fault localization using a model checker
Griesmayer, A., Staber, S., & Bloem, R. (2009) · Software Testing Verification and Reliability · doi:10.1002/stvr.421 · Cited by 32 · cited 7×
“We now discuss model checking-based fault localization techniques that rely on the use of model checkers to locate bugs [44], [67], [133], [134], [136], [137], [138], [200].”
BackgroundMethodInfluentialSemi-automatic fault localization
Harrold, M. J., & Jones, J. A. (2008) · SMARTech Repository (Georgia Institute of Technology) · Cited by 31
Improving the effectiveness of spectra-based fault localization using specifications
Gopinath, D., Zaeem, R. N., & Sarfraz Khurshid, D. (2012) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2351676.2351683 · Cited by 31 · cited 1×
“In [129], Gopinath et al.”
Relative debugging and its application to the development of large numerical models
Abramson, D., Foster, I. T., Michalakes, J. G., & Sosič, R. (1995) · ACM/IEEE Conference on Supercomputing (SC) · doi:10.1145/224170.224350 · Cited by 31
Locating faulty code by multiple points slicing
Zhang, X., Gupta, N., & Gupta, R. (2006) · Software Practice and Experience · doi:10.1002/spe.795 · Cited by 31 · cited 2×
“Zhang et al. [407] propose the multiple-points dynamic slicing technique, which intersects slices of three techniques: Backward Dynamic Slice ( BwS ), Forward Dynamic Slice ( FwS ), and Bidirectional Dynamic Slice ( BiS ).”
MethodFault Detection Probability Analysis for Coverage-Based Test Suite Reduction
McMaster, S., & Memon, A. M. (2007) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2007.4362646 · Cited by 30 · cited 2×
“Studies such as [127], [253] focus on a cross evaluation of the impact of different test reduction and prioritization techniques on the efficiency of software fault localization.”
BackgroundIs non-parametric hypothesis testing model robust for statistical fault localization?
Zhang, Z., Chan, W. K., Tse, T. H., Hu, P., & Wang, X. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2009.06.013 · Cited by 30
Aspect-Based Instrumentation for Locating Memory Leaks in Java Programs
Chen, K., & Chen, J.-B. (2007) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2007.79 · Cited by 30 · cited 1×
“Chen and Chen [69] develop an aspect-based tool, Fin-dLeak, utilizing an aspect to gather memory consumption statistics and object references created during a program execution.”
MethodSmart debugging software architectural design in SDL
Wong, W. E., Sugeta, T., Qi, Y., & Maldonado, J. C. (2004) · Journal of Systems and Software · doi:10.1016/j.jss.2004.06.026 · Cited by 30
Self-citationLucia, Thung, F., Lo, D., & Jiang, L. (2012) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2012.6224302 · Cited by 30 · cited 1×
“Another study [231] also reports a similar finding.”
ResultA dynamic code coverage approach to maximize fault localization efficiency
Perez, A., Abreu, R., & Riboira, A. (2014) · Journal of Systems and Software · doi:10.1016/j.jss.2013.12.036 · Cited by 29 · cited 1×
“[291] propose coined dynamic code coverage by using coarser instrumentation to”
BackgroundSelf-citationHao, D., Zhang, L., Zhong, H., Mei, H., & Sun, J. (2005) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2005.43 · Cited by 29 · cited 1×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundOn the use of mutations and testing for debugging
Nica, M., Nica, S., & Wotawa, F. (2012) · Software Practice and Experience · doi:10.1002/spe.1142 · Cited by 28 · cited 1×
“Studies such as [272], [377] make use of constraint solving, in which programs are automatically compiled into a set of constraints.”
MethodSelf-citationLocalizing Software Faults Simultaneously
Abreu, R., Zoeteweij, P., & van Gemund, A. J. C. (2009) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2009.55 · Cited by 28 · cited 2×
“Zoltar-M Tool for detecting multiple bugs via author [13]”
MethodSelf-citationEffective and efficient localization of multiple faults using value replacement
Jeffrey, D., Gupta, N., & Gupta, R. (2009) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2009.5306303 · Cited by 28 · cited 2×
“[90], [101], [102], [125], [172], [173], [184], [224], [293], [331], [332], [359], [395], [423].”
BackgroundSpectral Debugging with Weights and Incremental Ranking
Naish, L., Lee, H. J., & Ramamohanarao, K. (2009) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2009.32 · Cited by 28 · cited 1×
“One approach of test prioritization is to give higher priority to failed test cases that execute fewer statements, as they provide more information and minimize the search domain [263].”
BackgroundNainar, P. A., & Liblit, B. (2007) · Springer eBooks · doi:10.1007/978-3-540-71878-9 · Cited by 28 · cited 1×
“Benjamin Robert Liblit [221] Cooperative Bug Isolation Ph.”
BackgroundLogic programs for consistency-based diagnosis.
Bond, G. W. (1994) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/1994-02877 · Cited by 27 · cited 1×
“Gregory [131] Logic Programs for Consistency-based Diagnosis Ph.”
A survey of intelligent debugging
Stumptner, M., & Wotawa, F. (1998) · AI Communications · doi:10.5555/1216095.1216100 · Cited by 27
Self-citationOn the Integration of Test Adequacy, Test Case Prioritization, and Statistical Fault Localization
Jiang, B., & Chan, W. K. (2010) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2010.64 · Cited by 26 · cited 1×
“[126], [127], [128], [146], [175], [176], [348], [362], [399].”
Test suite reduction for fault detection and localization: A combined approach
Vidács, L., Beszédes, Á., Tengeri, D., Siket, I., & Gyimóthy, T. (2014) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/csmr-wcre.2014.6747172 · Cited by 26 · cited 1×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundIdentifying Failure-Inducing Combinations Using Tuple Relationship
Niu, X., Nie, C., Lei, Y., & Chan, A. (2013) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw.2013.38 · Cited by 26 · cited 1×
“Similar studies [273], [274] based on combinatorial testing are reported, which separate input parameters into faulty-possible and healthy-possible and identify minimal failure-inducing combinations of parameters.”
BackgroundSoftware fault localization based on program slicing spectrum
Wen, W. (2012) · doi:10.5555/2337223.2337469 · Cited by 26
Comparative causality: Explaining the differences between executions
Sumner, W. N., & Zhang, X. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606573 · Cited by 26 · cited 1×
“To address these limitations, Sumner and Zhang [340] propose a cause inference model, comparative causality, to provide a systematic technique explaining the difference between a failed execution and a successful execution.”
BackgroundFinding Concurrency-Related Bugs Using Random Isolation
Kidd, N. A., Reps, T., Dolby, J., & Vaziri, M. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-93900-9_18 · Cited by 25
Gao, Y., Zhang, Z., Zhang, L., Gong, C., & Zheng, Z. (2013) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2013.23 · Cited by 25 · cited 1×
“In [119], the authors propose an approach to generate balanced test suites in order to improve fault localization effectiveness by cloning failed test cases a suitable number of times to match the number of successful test cases.”
BackgroundCrisp--A Fault Localization Tool for Java Programs
Chesley, O., Ren, X., Ryder, B. G., & Tip, F. (2007) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2007.29 · Cited by 25
Impacts of Test Suite's Class Imbalance on Spectrum-Based Fault Localization Techniques
Rao, P. C., Zheng, Z., Chen, T. Y., Wang, N., & Cai, K. (2013) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2013.18 · Cited by 25 · cited 1×
“…the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393], [420], [406], [410], [424].”
Multiple Fault Localization with Data Mining
Cellier, P., Ducassé, M., Ferré, S., & Ridoux, O. (2011) · HAL · Cited by 25
Algorithms for Automatically Computing the Causal Paths of Failures
Sumner, W. N., & Zhang, X. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00593-0_24 · Cited by 24 · cited 1×
“Sumner et al. further improve the robustness, precision, and efficiency of delta debugging by combining it with more precise execution alignment techniques [338], [339], [389].”
MethodModel-Based Debugging using Multiple Abstract ModelsPreprint
Mayer, W., & Stumptner, M. (2003) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0309030 · Cited by 24 · cited 1×
“On the other hand, for model-based software fault localization [6], [40], [97], [117], [194], [242], [243], [246], [248], [378], [380], [381], [382], models are generated directly from the actual programs, which may contain bugs.”
BackgroundMitigating the Effect of Coincidental Correctness in Spectrum Based Fault Localization
Bandyopadhyay, A. (2012) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2012.130 · Cited by 24 · cited 2×
“Ban-dyopadhyay and Ghosh [46] suggest a different approach by first measuring the likelihood of coincidental correctness of a successful test case based on the average proximity of its execution profile with that of all failed test cases.”
BackgroundEffective Software Bug Localization Using Spectral Frequency Weighting Function
Lee, H. J., Naish, L., & Ramamohanarao, K. (2010) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2010.26 · Cited by 24 · cited 1×
“To break these ties, the information related to statement execution frequency in addition to statement coverage can also be utilized [7], [213].”
BackgroundImplicit Social Network Model for Predicting and Tracking the Location of Faults
Chen, I.-X., Yang, C., Lu, T.-K., & Jaygarl, H. (2008) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2008.162 · Cited by 24 · cited 1×
“An implicit social network model is presented in [70] to predict possible locations of faults using fault locations cited by similar historical bug reports retrieved from BRMS (bug report managing systems).”
MethodOn Practical Adequate Test Suites for Integrated Test Case Prioritization and Fault Localization
Jiang, B., Chan, W. K., & Tse, T. H. (2011) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2011.37 · Cited by 24 · cited 2×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundVerdict functions in testing with a fault domain or test hypotheses
Hierons, R. M. (2009) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/1538942.1538944 · Cited by 23 · cited 1×
“Studies such as [160], [161] have reported that for many systems and for much of testing as currently practiced in industry, testers do not have formal specifications, assertions, or automated oracles.”
BackgroundPartition Testing with Dynamic Partitioning
Cai, K., Jing, T., & Bai, C. (2006) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2005.118 · Cited by 23 · cited 1×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundAn edge marking technique for dynamic slicing of object-oriented programs
Mohapatra, D. P., Mall, R., & Kumar, R. (2004) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/cmpsac.2004.1342806 · Cited by 22 · cited 1×
“Studies such as [18], [24], [28], [96], [104], [188], [192], [201], [219], [227], [237], [257], [277], [297], [334], [356], [378], [379], [406], [407], [410], which use the dynamic slicing concept in program debugging, have been reported.”
End-user software visualizations for fault localization
Ruthruff, J. R., Creswick, E. R., Burnett, M., Cook, C., Prabhakararao, S., Fisher, M., & Main, M. (2003) · doi:10.1145/774849.774851 · Cited by 22
Exploiting count spectra for Bayesian fault localization
Abreu, R., González-Sánchez, A., & van Gemund, A. J. C. (2010) · doi:10.1145/1868328.1868347 · Cited by 21
Self-citationScaling model checking of dataraces using dynamic information
Shacham, O., Sagiv, M., & Schuster, A. (2005) · ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming · doi:10.1145/1065944.1065958 · Cited by 21 · cited 2×
“For instance, Shacham et al. [324] use a model checker to construct the evidence for data race reported by the lockset algorithm.”
MethodWang, Y., Patil, H., Pereira, C. L., et al. (2014) · doi:10.1145/2581122.2544152 · Cited by 21
Duals in Spectral Fault Localization
Naish, L., & Lee, H. J. (2013) · Australasian Software Engineering Conference (ASWEC) · doi:10.1109/aswec.2013.16 · Cited by 20 · cited 1×
“In [264], Lee et al. further identify a class of optimal fault localization techniques for locating deterministic bugs (similar to Bohrbugs defined in [139]) that will always cause test cases to fail whenever they are executed.”
BackgroundSoftware bug localization with markov logic
Zhang, S., & Zhang, C. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2591062.2591099 · Cited by 20 · cited 1×
“In [403], the authors propose a technique taking advantage of the recent progress in multi-relational data mining for fault localization.”
BackgroundJiang, B., Zhai, K., Chan, W. K., Tse, T. H., & Zhang, Z. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.10.001 · Cited by 20 · cited 1×
“satisfying statement coverage in effectively supporting fault localization, whereas authors of [177] claim that test suites”
BackgroundA Quantitative Analysis into the Economics of Correcting Software Bugs
Wright, C., & Zia, T. A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21323-6_25 · Cited by 19 · cited 1×
“Unfortunately, this has also resulted in more software bugs, which often lead to execution failures with huge losses [260], [275], [365].”
BackgroundEmpirical evaluation of existing algorithms of spectrum based fault localization
Kim, J., & Lee, E. (2014) · International Conference on Information Networking · doi:10.1109/icoin.2014.6799702 · Cited by 19 · cited 1×
“…the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393], [420], [406], [410], [424].”
MZoltar: automatic debugging of Android applications
Machado, P., Campos, J., & Abreu, R. (2013) · International Workshop on Mobile Development Lifecycle · doi:10.1145/2501553.2501556 · Cited by 19 · cited 3×
“JaCoCo Java code coverage Library open source [236]”
BackgroundMethodSelf-citationA Dynamic Fault Localization Technique with Noise Reduction for Java Programs
Xu, J., Chan, W. K., Zhang, Z., Tse, T. H., & Li, S. (2011) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2011.32 · Cited by 19 · cited 1×
“…the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393], [420], [406], [410], [424].”
Wotawa, F., Weber, J., Nica, M., & Ceballos, R. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14264-2_3 · Cited by 18 · cited 1×
“On the other hand, for model-based software fault localization [6], [40], [97], [117], [194], [242], [243], [246], [248], [378], [380], [381], [382], models are generated directly from the actual programs, which may contain bugs.”
BackgroundSelf-citationDebugging with reverse watchpoint
Maruyama, K., & Terada, M. (2003) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2003.1319093 · Cited by 18 · cited 2×
“[238] indicate that the culprit of an overwritten variable is always the last write-access to the memory location where the bug first appeared.”
BackgroundEfficient forward computation of dynamic slices using reduced ordered binary decision diagrams
Zhang, X., Gupta, R., & Zhang, Y. (2004) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2004.1317472 · Cited by 18 · cited 1×
“[409] have been proposed to address these issues.”
BackgroundTowards an integrated debugging environment
Mayer, W., Stumptner, M., Wieland, D., & Wotawa, F. (2002) · European Conference on Artificial Intelligence · Cited by 17
Self-citationIntroducing alias information into model-based debugging
Köb, D., & Wotawa, F. (2004) · Cited by 17
Self-citationAbstract interpretation of programs for model-based debugging
Mayer, W., & Stumptner, M. (2007) · International Joint Conference on Artificial Intelligence · Cited by 17
RADAR: a tool for debugging regression problems in C/C++ software
Pastore, F., Mariani, L., & Goffi, A. (2013) · doi:10.5555/2486788.2486999 · Cited by 17
On the equivalence of certain fault localization techniques
Debroy, V., & Wong, W. E. (2011) · ACM Symposium on Applied Computing · doi:10.1145/1982185.1982498 · Cited by 17 · cited 2×
“pendently, Debroy andWong [93] also report a similar study showing that some similarity coefficient-based fault localization techniques are equivalent to one another.”
BackgroundSelf-citationUsing Cluster Analysis to Identify Coincidental Correctness in Fault Localization
Li, Y., & Liu, C. (2012) · International Conference on Computational and Information Sciences · doi:10.1109/iccis.2012.361 · Cited by 17 · cited 1×
“Studies discussing coincidental correctness have been reported in recent years [44], [46], [159], [218], [239], [254], [355], [419].”
BackgroundSelf-citationA Simple Coverage-Based Locator for Multiple Faults
Steimann, F., & Bertschler, M. (2009) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2009.24 · Cited by 17 · cited 1×
“In response, studies have been conducted using programs with multiple bugs [87], [90], [101], [102], [125], [172], [173], [184], [224], [293], [331], [332], [359], [395], [423].”
Error explanation and fault localization with distance metrics
Groce, A. D., & Clarke, E. (2005) · Cited by 16
A Kernel Density Estimate-Based Approach to Component Goodness Modeling
Cardoso, N., & Abreu, R. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8569 · Cited by 16 · cited 1×
“A potential weakness of most techniques based on Bayesian reasoning (e.g., [14], [64], [193]) is that they all assume program components fail independently; in other words, interferences between multiple bugs are ignored, which is not necessarily the case in practice.”
BackgroundSelf-citationSpectrum-Based Fault Localization for Diagnosing Concurrency Faults
Koca, F., Sözer, H., & Abreu, R. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-41707-8_16 · Cited by 15 · cited 1×
“Koca et al. [198] locate faults in concurrency programs using an idea similar to spectrum-based fault localization techniques.”
MethodSelf-citationSimple and effective static analysis to find bugs
Hovemeyer, D., & Pugh, W. (2005) · University Libraries (University of Maryland) · Cited by 15
Equivalence analysis and its application in improving the efficiency of program slicing
Liang, D., & Harrold, M. J. (2002) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/567793.567796 · Cited by 15 · cited 1×
“relationships among the various memory locations accessed by a procedure, is used to improve the efficiency of dataflow analyses in the presence of pointer variables [220].”
MethodDebugging through Evaluation Sequences: A Controlled Experimental Study
Zhang, Z., Jiang, B., Chan, W. K., & Tse, T. H. (2008) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2008.207 · Cited by 15 · cited 1×
“Zhang et al. [414], [415] identify the short-circuit evaluations of an individual predicate and produce one set of evaluation sequences for each predicate.”
BackgroundSoftware debugging with dynamic instrumentation and test-based knowledge
Pan, H. (1993) · Cited by 13
A Linear Programming Approach for Automated Localization of Multiple Faults
Dean, B. C., Pressly, W. B. S., Malloy, B. A., & Whitley, A. A. (2009) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2009.54 · Cited by 13 · cited 1×
“In response, studies have been conducted using programs with multiple bugs [87], [90], [101], [102], [125], [172], [173], [184], [224], [293], [331], [332], [359], [395], [423].”
On the Consensus-Based Application of Fault Localization Techniques
Debroy, V., & Wong, W. E. (2011) · IEEE Annual Computer Software and Applications Conference Workshops (COMPSACW) · doi:10.1109/compsacw.2011.92 · Cited by 13
Self-citationAn empirical study on the usage of testability information to fault localization in software
González-Sánchez, A., Abreu, R., Groß, H.-G., & van Gemund, A. J. C. (2011) · ACM Symposium on Applied Computing · doi:10.1145/1982185.1982489 · Cited by 12 · cited 2×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundSelf-citationContext-Aware Fault Localization via Control Flow Analysis
Zhao, L., Wang, L., & Yin, X. (2011) · Journal of Software · doi:10.4304/jsw.6.10.1977-1984 · Cited by 12 · cited 1×
“[421], [422] posit that using only individual coverage information may not reveal the execution paths.”
BackgroundUsing Dynamic Information in the Interprocedural Static Slicing of Binary Executables
Kiss, Á., Jász, J., & Gyimóthy, T. (2005) · Software Quality Journal · doi:10.1007/s11219-005-1751-x · Cited by 12 · cited 2×
“Static slicing is also applied for fault localization in binary executables [192], and type-checkers [343].”
MethodImproving spectrum-based fault localization using proximity-based weighting of test cases
Bandyopadhyay, A. (2011) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2011.6100150 · Cited by 12 · cited 1×
“…test case reduction by selecting only a subset of test cases or test case prioritization by assigning different priorities to different cases to improve the efficiency of fault localization techniques [45], [48], [53], [62], [63], [122], [126], [127], [128], [146], [175], [176], [348], [362], [399].”
BackgroundCoincidental Correctness: Refine Code Coverage with Context Pattern to Improve Fault Localization
Wang, X., Cheung, S.-C., Chan, W. K., & Zhang, Z. (2009) · Cited by 12
Spectral debugging: How much better can we do?
Naish, L., Lee, H. J., & Ramamohanarao, K. (2012) · Cited by 11
The Efficiency of Critical Slicing in Fault Localization
Al-Khanjari, Z. A. S., Woodward, M. R., Ramadhan, H. A., & Kutti, N. S. (2005) · Software Quality Journal · doi:10.1007/s11219-005-6214-x · Cited by 11 · cited 2×
“[113], [115], and atomic-set serializability violations [24], [44].”
Exploring program phases for statistical bug localization
Modi, V. K., Roy, S., & Aggarwal, S. K. (2013) · ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering (PASTE) · doi:10.1145/2462029.2462034 · Cited by 11 · cited 1×
“In [256], Modi et al. explore the usage of execution phase information such as cache miss rates, CPU and memory usages in statistical program debugging.”
BackgroundIndexing Noncrashing Failures: A Dynamic Program Slicing-Based Approach
Liu, C., Zhang, X., Han, J., Zhang, Y., & Bhargava, B. (2007) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2007.4362658 · Cited by 11 · cited 1×
“Studies such as [18], [24], [28], [96], [104], [188], [192], [201], [219], [227], [237], [257], [277], [297], [334], [356], [378], [379], [406], [407], [410], which use the dynamic slicing concept in program debugging, have been reported.”
Statements versus Predicates in Spectral Bug Localization
Naish, L., Lee, H. J., & Ramamohanarao, K. (2010) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2010.50 · Cited by 11
On the analysis of spectrum-based fault localization
Xie, X. (2012) · Swinburne figshare (Swinburne University of Technology) · doi:10.25916/sut.26261771 · Cited by 11
Extended program invariants: applications in testing and fault localization
Alipour, M. A., & Groce, A. (2012) · International Workshop on Dynamic Analysis · doi:10.1145/2338966.2336799 · Cited by 11 · cited 1×
“In study [27], Alipour and Groce propose extended invariants by adding execution features such as the execution count of blocks to the invariants.”
BackgroundWorkload-sensitive Timing Behavior Analysis for Fault Localization in Software Systems
Röhr, M. (2015) · MACAU: Open Access Repository of Kiel University (University Library Kiel) · Cited by 10
Multiple-Bug Oriented Fault Localization: A Parameter-Based Combination Approach
Zheng, W., & Bai, H. (2013) · IEEE International Conference on Software Security and Reliability Companion · doi:10.1109/sere-c.2013.18 · Cited by 10 · cited 1×
“In response, studies have been conducted using programs with multiple bugs [87], [90], [101], [102], [125], [172], [173], [184], [224], [293], [331], [332], [359], [395], [423].”
Fault Localization with Non-parametric Program Behavior Model
Hu, P., Zhang, Z., Chan, W. K., & Tse, T. H. (2008) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2008.44 · Cited by 10 · cited 1×
“Hu et al. [168] use a similar heuristic to rank all predicates.”
BackgroundExecution-Aware Fault Localization Based on the Control Flow Analysis
Zhao, L., Wang, L., Xiong, Z., & Gao, D. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16167-4_21 · Cited by 9 · cited 1×
“[421], [422] posit that using only individual coverage information may not reveal the execution paths.”
BackgroundDebugging non-deadlock concurrency bugs
Park, S. (2013) · International Symposium on Software Testing and Analysis · doi:10.1145/2483760.2492395 · Cited by 9 · cited 1×
“Park also presents a study to debug non-deadlock concurrency bugs [283].”
BackgroundA new fault localizing method for the program debugging process
Lian, L., Kusumoto, S., Kikuno, T., Matsumoto, K., & Torii, K. (1997) · Information and Software Technology · doi:10.1016/s0950-5849(96)01149-4 · Cited by 9 · cited 1×
“Studies such as [18], [24], [28], [96], [104], [188], [192], [201], [219], [227], [237], [257], [277], [297], [334], [356], [378], [379], [406], [407], [410], which use the dynamic slicing concept in program debugging, have been reported.”
Automated bug isolation via program chipping
Sterling, C. D., & Olsson, R. A. (2005) · International Symposium on Automated Analysis-Driven Debugging (AADEBUG) · doi:10.1145/1085130.1085134 · Cited by 9 · cited 1×
“Studies such as [18], [24], [28], [96], [104], [188], [192], [201], [219], [227], [237], [257], [277], [297], [334], [356], [378], [379], [406], [407], [410], which use the dynamic slicing concept in program debugging, have been reported.”
Data-driven Methods for Fault Localization in Process Technology
Kühnert, C. (2013) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.24406/publica-fhg-279833 · Cited by 8
Fault Localization Using Textual SimilaritiesPreprint
Fry, Z. P., & Weimer, W. R. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1211.2858 · Cited by 7 · cited 1×
“Fry [118] Fault Localization Using Textual Similarities Master The University of Virginia 2011”
MethodScenario oriented program slicing
Qian, J., & Xu, B. (2008) · ACM Symposium on Applied Computing · doi:10.1145/1363686.1363861 · Cited by 7 · cited 2×
“Qian and Xu [297] propose a scenario-oriented program slicing technique.”
BackgroundOn the Effectiveness of the Tarantula Fault Localization Technique for Different Fault Classes
Bandyopadhyay, A., & Ghosh, S. (2011) · IEEE International Symposium on High Assurance Systems Engineering (HASE) · doi:10.1109/hase.2011.52 · Cited by 7 · cited 1×
“Many studies that evaluate the effectiveness of specific fault localization techniques have been reported [8], [10], [11], [12], [25], [31], [36], [49], [53], [91], [93], [94], [102], [124], [178], [185], [191], [207], [209], [253], [266], [267], [296], [299], [335], [366], [390], [391], [393],…”
Gong, C., Zheng, Z., Zhang, Y., Zhang, Z., & Xue, Y. (2012) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2012.22 · Cited by 7 · cited 1×
“In response, studies have been conducted using programs with multiple bugs [87], [90], [101], [102], [125], [172], [173], [184], [224], [293], [331], [332], [359], [395], [423].”
An integrated solution for testing and analyzing Java applications in an industrial setting
Wong, W. E., & Li, J. (2005) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2005.39 · Cited by 7 · cited 2×
“Tool for collecting execution trace information for C programs via author [22], [366], [367], [369], [370], [371], [372], [373], [374] x Vue Heuristics involving the control graph, execution trace, and the maintainer’s knowledge to help locate features and identify feature interactions via author…”
MethodSelf-citationUsing Spectrum-Based Fault Localization for Test Case Grouping
Weiglhofer, M., Fraser, G., & Wotawa, F. (2009) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2009.78 · Cited by 7 · cited 1×
“[126], [127], [128], [146], [175], [176], [348], [362], [399].”
Self-citationEffective fault localization techniques for concurrent software
Park, S. M. (2014) · SMARTech Repository (Georgia Institute of Technology) · Cited by 7
Dynamic Code Coverage with Progressive Detail LevelsPreprint
Perez, A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.4546 · Cited by 6 · cited 2×
“Alexandre Perez [292] Dynamic Code Coverage with Progressive Detail Levels Master University of Porto 2012”
BackgroundUnderstanding, detecting and exposing concurrency bugs
Zhou, Y., & Lu, S. (2008) · Cited by 6
Statistical fault localization using execution sequence
You, Z., Qin, Z., & Zheng, Z. (2012) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2012.6359473 · Cited by 6 · cited 2×
“You et al. [398] propose a statistical approach employing the behavior of two sequentially connected predicates in the execution.”
BackgroundMethodAdding context to fault localization with integration coverage
de Souza, H. A., & Chaim, M. L. (2013) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2013.6693124 · Cited by 6
Effective fault localization based on minimum debugging frontier set
Li, F., Huo, W., Chen, C., Zhong, L., Feng, X., & Li, Z. (2013) · Proceedings of the CGO/Proceedings of the ... CGO · doi:10.1109/cgo.2013.6494988 · Cited by 6 · cited 1×
“The study in [217] extends the predicate switching technique and reduces the search space of program states by selecting a subset of trace points in a failed execution based on dependence analysis.”
BackgroundProjecting code changes onto execution traces to support localization of recently introduced bugs
Bohnet, J., Voigt, S., & Döllner, J. (2009) · ACM Symposium on Applied Computing · doi:10.1145/1529282.1529378 · Cited by 6 · cited 1×
“Bohnet et al. [54] propose a technique to identify recently introduced changes.”
Cost Optimizations in Runtime Testing and Diagnosis
González-Sánchez, A. (2011) · Research Repository (Delft University of Technology) · Cited by 6
Mayer, W., Stumptner, M., & Wotawa, F. (2003) · Cited by 6
Self-citation
Research works printed but not linked: 17
- jannach, 0, Toward model-based debugging of spreadsheet programs, Proc Knowledge-Based Software Eng Conf, 252
- panko, 2006, Facing the problem of spreadsheet errors, Decision Line, 37, 8
- he, 0, Automated debugging using path-based weakest preconditions, Proc 8th Int Conf Fundam Approaches Softw Eng, 267
- lewis, 1973, Counterfactuals
- lucia lo, 0, Fusing fault localizers, IEEE Int Conf on Auto Soft Eng, 127
- lyle, 0, Automatic program bug location by program slicing, Proc Int Conf Comput Appl, 877
- grottke, 0, A classification of software faults, Proc 16th IEEE Int Symp Softw Rel Eng, 419
- mayer, 0, Prioritizing model-based debugging diagnostic reports, Proc Int Workshop Principles Diagnosis, 127
- mayer, 2004, Approximate modeling for debugging of program loops, Proc Int Workshop Principles Diagnosis, 87
- moon, 2014, Effective software fault localization using dynamic program behaviors, Master thesis
- gong, 0, Diversity maximization speedup for fault, Proc Int Conf Autom Softw Eng, 30
- torlak, 0, MemSAT: Checking axiomatic specifications of memory models, Proc ACM SIGPLAN Conf Programming Language Design and Implementation, 341
- vayani, 2007, Improving automatic software fault localization, Master thesis
- wu, 0, A statistical model to locate faults at input levels, Proc Int Conf Autom Softw Eng, 274
- collofello, 0, Towards automatic software fault localization through decision-to-decision path analysis, Proc Nat Comput Conf, 539
- stumptner, 0, Debugging functional program, Proc Int Joint Conf Artif Intell, 440
- xie, 0, Provably optimal and human-competitive results in SBSE for spectrum based fault localization, Proc 2nd Int Symp Search Based Software Eng, 224
Cited by
Demystifying LLM-Based Software Engineering Agents
Xia, C. S., Deng, Y., Dunn, S., & Zhang, L. (2025) · Proceedings of the ACM on Software Engineering · doi:10.1145/3715754 · Cited by 849
“Fault localization (FL) [Wong et al. 2016] techniques aim to identify the suspicious locations (e.g., statements or methods) in source code related to bugs.”
The DStar Method for Effective Software Fault Localization
Wong, W. E., Debroy, V., Gao, R., & Li, Y. (2014) · IEEE Transactions on Reliability · doi:10.1109/tr.2013.2285319 · Cited by 479
Self-citationEvaluating and Improving Fault Localization
Pearson, S., Campos, J., Just, R., Fraser, G., Abreu, R., Ernst, M. D., Pang, D., & Keller, B. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.62 · Cited by 426
Self-citationAutomated Program Repair via Conversation: Fixing 162 out of 337 Bugs for $0.42 Each using ChatGPT
Xia, C. S., & Zhang, L. (2024) · Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3650212.3680323 · Cited by 203
Automatic Software Repair: A Bibliography
Monperrus, M. (2019) · ACM Computing Surveys · doi:10.1145/3105906 · Cited by 321
Metadata
- Authors
- Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F.
- Affiliations
- The University of Texas at Dallas (US)
- Palo Alto Research Center (US)
- Graz University of Technology (AT)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2016-08-01
- Volume
- 42
- Issue
- 8
- Pages
- 707-740
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- OpenAlex
- W2343875716
- Cited by
- 1,110
- References
- 451
- Citations by year
- 2026: 91 · 2025: 96 · 2024: 127 · 2023: 113 · 2022: 132 · 2021: 118 · 2020: 117 · 2019: 117 · 2018: 88 · 2017: 54 · 2016: 26
- FWCI
- 324.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- software fault localization, debugging, automated fault diagnosis, software defects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.