The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization
Open accessAbstract
An important research area of Spectrum-Based Fault Localization (SBFL) is the effectiveness of risk evaluation formulas. Most previous studies have adopted an empirical approach, which can hardly be considered as sufficiently comprehensive because of the huge number of combinations of various factors in SBFL. Though some studies aimed at overcoming the limitations of the empirical approach, none of them has provided a completely satisfactory solution. Therefore, we provide a theoretical investigation on the effectiveness of risk evaluation formulas. We define two types of relations between formulas, namely, equivalent and better. To identify the relations between formulas, we develop an innovative framework for the theoretical investigation. Our framework is based on the concept that the determinant for the effectiveness of a formula is the number of statements with risk values higher than the risk value of the faulty statement. We group all program statements into three disjoint sets with risk values higher than, equal to, and lower than the risk value of the faulty statement, respectively. For different formulas, the sizes of their sets are compared using the notion of subset. We use this framework to identify the maximal formulas which should be the only formulas to be used in SBFL.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Empirical evaluation of the tarantula automatic fault-localization technique
Jones, J. A., & Harrold, M. J. (2005) · Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/1101908.1101949 · Cited by 1,238
Visualization of test information to assist fault localization
Jones, J. A., Harrold, M. J., & Stasko, J. (2002) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1145/581339.581397 · Cited by 904
Pinpoint: problem determination in large, dynamic Internet services
Chen, M. Y., Kiciman, E., Fratkin, E., Fox, A., & Brewer, E. (2003) · Proceedings International Conference on Dependable Systems and Networks · doi:10.1109/dsn.2002.1029005 · Cited by 835
On the Accuracy of Spectrum-based Fault Localization
Abreu, R., Zoeteweij, P., & van Gemund, A. J. C. (2007) · Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007) · doi:10.1109/taic.part.2007.13 · Cited by 736
Scalable statistical bug isolation
Liblit, B., Naik, M., Zheng, A. X., Aiken, A., & Jordan, M. I. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065014 · Cited by 729
Are automated debugging techniques actually helping programmers?
Parnin, C., & Orso, A. (2011) · Proceedings of the 2011 International Symposium on Software Testing and Analysis · doi:10.1145/2001420.2001445 · Cited by 576
An Evaluation of Similarity Coefficients for Software Fault Localization
Abreu, R., Zoeteweij, P., & Van Gemund, A. (2006) · 2006 12th Pacific Rim International Symposium on Dependable Computing (PRDC'06) · doi:10.1109/prdc.2006.18 · Cited by 563
A model for spectra-based software diagnosis
Naish, L., Lee, H. J., & Ramamohanarao, K. (2011) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2000791.2000795 · Cited by 536
Isolating cause-effect chains from computer programs
Zeller, A. (2002) · Proceedings of the 10th ACM SIGSOFT symposium on Foundations of software engineering · doi:10.1145/587051.587053 · Cited by 530
A practical evaluation of spectrum-based fault localization
Abreu, R., Zoeteweij, P., Golsteijn, R., & van Gemund, A. J. C. (2009) · Journal of Systems and Software · doi:10.1016/j.jss.2009.06.035 · Cited by 495
Scalable statistical bug isolation
Liblit, B., Naik, M., Zheng, A. X., Aiken, A., & Jordan, M. I. (2005) · Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation · doi:10.1145/1065010.1065014 · Cited by 472
Automated support for classifying software failure reports
Podgurski, A., Leon, D., Francis, P., Masri, W., & Minch, M. (2003) · Cited by 314
Proceedings of the 33rd International Conference on Software Engineering
(2011) · doi:10.1145/1985793 · Cited by 307
Fault localization using execution slices and dataflow tests
Agrawal, H., Horgan, J. R., London, S., & Wong, W. E. (2002) · Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95 · doi:10.1109/issre.1995.497652 · Cited by 288
Statistical Debugging: A Hypothesis Testing-Based Approach
Liu, C., Fei, L., Yan, X., Han, J., & Midkiff, S. P. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.105 · Cited by 288
Lightweight fault-localization using multiple coverage types
Santelices, R., Jones, J. A., Yu, Y., & Harrold, M. J. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070508 · Cited by 264
Finding failures by cluster analysis of execution profiles
Dickinson, W. T., De, L., & Fodgurski, A. (2001) · doi:10.5555/381473.381509 · Cited by 252
Jones, J. A., Bowring, J. F., & Harrold, M. J. (2007) · Proceedings of the 2007 international symposium on Software testing and analysis · doi:10.1145/1273463.1273468 · Cited by 245
An empirical study of the effects of test-suite reduction on fault localization
Yu, Y., Jones, J. A., & Harrold, M. J. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368116 · Cited by 236
A family of code coverage-based heuristics for effective fault localization
Eric Wong, W., Debroy, V., & Choi, B. (2010) · Journal of Systems and Software · doi:10.1016/j.jss.2009.09.037 · Cited by 230
The use of program profiling for software maintenance with applications to the year 2000 problem
Reps, T., Ball, T., Das, M., & Larus, J. R. (1997) · doi:10.1145/267895.267925 · Cited by 230
Lightweight Defect Localization for Java
Dallmeier, V., Lindig, C., & Zeller, A. (2005) · Lecture Notes in Computer Science · doi:10.1007/11531142_23 · Cited by 223
Effective Fault Localization using Code Coverage
Wong, W. E., Qi, Y., Zhao, L., & Cai, K.-Y. (2007) · 31st Annual International Computer Software and Applications Conference - Vol. 1- (COMPSAC 2007) · doi:10.1109/compsac.2007.109 · Cited by 205
An empirical investigation of the relationship between spectra differences and regression faults
Harrold, M. J., Rothermel, G., Sayre, K., Wu, R., & Yi, L. (2000) · Software Testing, Verification and Reliability · doi:10.1002/1099-1689(200009)10:3<171::aid-stvr209>3.0.co;2-j · Cited by 205
A Crosstab-based Statistical Method for Effective Fault Localization
Wong, E., Wei, T., Qi, Y., & Zhao, L. (2008) · 2008 International Conference on Software Testing, Verification, and Validation · doi:10.1109/icst.2008.65 · Cited by 166
An empirical investigation of program spectra
Harrold, M. J., Rothermel, G., Wu, R., & Yi, L. (1998) · Proceedings of the 1998 ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering · doi:10.1145/277631.277647 · Cited by 164
Causal inference for statistical fault localization
Baah, G. K., Podgurski, A., & Harrold, M. J. (2010) · International Symposium on Software Testing and Analysis · doi:10.1145/1831708.1831717 · Cited by 150
Zheng, A. X., Jordan, M. I., Liblit, B., Naik, M., & Aiken, A. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143983 · Cited by 149
Liu, C., & Han, J. (2006) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/1181775.1181782 · Cited by 137
Liblit, B. R., & Aiken, A. (2007) · Cited by 103
On the influence of multiple faults on coverage-based fault localization
DiGiuseppe, N., & Jones, J. A. (2011) · International Symposium on Software Testing and Analysis · doi:10.1145/2001420.2001446 · Cited by 101
Effective program debugging based on execution slices and inter-block data dependency
Wong, W. E., & Qi, Y. (2006) · Journal of Systems and Software · doi:10.1016/j.jss.2005.06.045 · Cited by 77
How Well Do Test Case Prioritization Techniques Support Statistical Fault Localization
Jiang, B., Zhang, Z., Tse, T. H., & Chen, T. Y. (2009) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2009.23 · Cited by 70
Self-citationSpectrum-Based Fault Localization: Testing Oracles are No Longer Mandatory
Xie, X., Wong, W. E., Chen, T. Y., & Xu, B. (2011) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2011.20 · Cited by 54
Self-citationIsolating Suspiciousness from Spectrum-Based Fault Localization Techniques
Xie, X., Chen, T. Y., & Xu, B. (2010) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2010.45 · Cited by 41
Self-citationStudy of the relationship of bug consistency with respect to performance of spectra metrics
Lee, H. J., Naish, L., & Ramamohanarao, K. (2009) · IEEE International Conference on Computer Science and Information Technology · doi:10.1109/iccsit.2009.5234512 · Cited by 36
Proximity based weighting of test cases to improve spectrum based fault localization
Bandyopadhyay, A., & Ghosh, S. (2011) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2011.6100088 · Cited by 32
Spectral Debugging with Weights and Incremental Ranking
Naish, L., Lee, H. J., & Ramamohanarao, K. (2009) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2009.32 · Cited by 28
On the analysis of spectrum-based fault localization
Xie, X. (2012) · Swinburne figshare (Swinburne University of Technology) · doi:10.25916/sut.26261771 · Cited by 11
Self-citation
Cited by
A Survey on Software Fault Localization
Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2521368 · Cited by 1,110
The DStar Method for Effective Software Fault Localization
Wong, W. E., Debroy, V., Gao, R., & Li, Y. (2014) · IEEE Transactions on Reliability · doi:10.1109/tr.2013.2285319 · Cited by 479
Practitioners' expectations on automated fault localization
Kochhar, P. S., Xia, X., Lo, D., & Li, S. (2016) · Proceedings of the 25th International Symposium on Software Testing and Analysis · doi:10.1145/2931037.2931051 · Cited by 346
DeepFL: integrating multiple fault diagnosis dimensions for deep fault localization
Li, X., Li, W., Zhang, Y., & Zhang, L. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330574 · Cited by 336
TBar: revisiting template-based automated program repair
Liu, K., Koyuncu, A., Kim, D., & Bissyandé, T. F. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330577 · Cited by 321
Metadata
- Authors
- Xie, X., Chen, T. Y., Kuo, F.-C., & Xu, B.
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 2013-10
- Volume
- 22
- Issue
- 4
- Pages
- 1-40
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W2070249305
- Cited by
- 353
- References
- 39
- FWCI
- 89.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.