Entropy Guided Spectrum Based Bug Localization Using Statistical Language Model
Open accessAbstract
Locating bugs is challenging but one of the most important activities in software development and maintenance phase because there are no certain rules to identify all types of bugs. Existing automatic bug localization tools use various heuristics based on test coverage, pre-determined buggy patterns, or textual similarity with bug report, to rank suspicious program elements. However, since these techniques rely on information from single source, they often suffer when the respective source information is inadequate. For instance, the popular spectrum based bug localization may not work well under poorly written test suite. In this paper, we propose a new approach, EnSpec, that guides spectrum based bug localization using code entropy, a metric that basically represents naturalness of code derived from a statistical language model. Our intuition is that since buggy code are high entropic, spectrum based bug localization with code entropy would be more robust in discriminating buggy lines vs. non-buggy lines. We realize our idea in a prototype, and performed an extensive evaluation on two popular publicly available benchmarks. Our results demonstrate that EnSpec outperforms a state-of-the-art spectrum based bug localization technique.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
SWE-bench unites many separate software engineering tasks under a single task formulation that faithfully mirrors practical software engineering.
“We use SWE-bench because it unites many separate SE tasks, such as automated program repair [10, 40, 55], bug localization [4, 58], and testing [22, 46, 56] under a single task formulation that faithfully mirrors practical SE.”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · cited 1× · see citing works
“Random Forest is an ensemble learning technique developed by Breiman [8] based on a combination of a large set of decision trees.”
MethodOn a Test of Whether one of Two Random Variables is Stochastically Larger than the Other
Mann, H. B., & Whitney, D. R. (1947) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730491 · Cited by 14,320 · cited 1× · see citing works
“These results are also confirmed by Wilcoxon non-parametric test [40, 61].”
ResultA study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R., & Monard, M. (2004) · SKDD · doi:10.1145/1007730.1007735 · Cited by 4,271 · cited 1× · see citing works
“In contrast, to be unbiased to any of the metric, we considered all the data and applied state of the art random under-sampling[7] technique.”
MethodThe class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295 · cited 1× · see citing works
“Such unbalanced data of buggy vs. non-buggy lines poses a threat to the efficiency of any classification probelm [28, 12].”
Background(1992) · doi:10.5555/176313.176316 · Cited by 2,892 · see citing works
API design for machine learning software: experiences from the scikit-learn projectPreprint
Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., Niculae, V., Prettenhofer, P., Gramfort, A., Grobler, J., et al. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.0238 · Cited by 2,387 · see citing works
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,074 · cited 1× · see citing works
“Such unbalanced data of buggy vs. non-buggy lines poses a threat to the efficiency of any classification probelm [28, 12].”
BackgroundDefects4J: a database of existing faults to enable controlled testing studies for Java programs
Just, R., Jalali, D., & Ernst, M. D. (2014) · Proceedings of the 2014 International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2628055 · Cited by 1,447 · cited 2× · see citing works
“We used two publicly available bug dataset: Defects4J [32] and ManyBugs [34] (see Table 4).”
MethodEmpirical evaluation of the tarantula automatic fault-localization technique
Jones, J. A., & Harrold, M. J. (2005) · International Conference on Automated Software Engineering · doi:10.1145/1101908.1101949 · Cited by 1,366 · cited 3× · see citing works
“Existing bug localization techniques can be broadly classified into two categories: i) test coverage-based dynamic approaches [30, 2, 59, 14, 37, 38], and ii) pattern-based [15, 19, 18, 13] or information retrieval-based (IR) static approaches [44, 60, 48, 58].”
BackgroundMethodSimplifying and isolating failure-inducing input
Zeller, A., & Hildebrandt, R. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988498 · Cited by 1,084 · cited 1× · see citing works
“Existing bug localization techniques can be broadly classified into two categories: i) test coverage-based dynamic approaches [30, 2, 59, 14, 37, 38], and ii) pattern-based [15, 19, 18, 13] or information retrieval-based (IR) static approaches [44, 60, 48, 58].”
BackgroundOn the Accuracy of Spectrum-based Fault Localization
Abreu, R., Zoeteweij, P., & Gemund, A. V. (2007) · Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007) · doi:10.1109/taic.part.2007.13 · Cited by 925 · cited 1× · see citing works
“Jaccard and Ochiai are some of the well known variants of this approach proposed by Abreu et al. [3].”
MethodVisualization of test information to assist fault localization
Jones, J. A., Harrold, M. J., & Stasko, J. (2002) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/581339.581397 · Cited by 925 · see citing works
Engler, D., Chen, D. Y., Hallem, S., Chou, A., & Chelf, B. (2001) · doi:10.1145/502034.502041 · Cited by 737 · cited 1× · see citing works
“Existing bug localization techniques can be broadly classified into two categories: i) test coverage-based dynamic approaches [30, 2, 59, 14, 37, 38], and ii) pattern-based [15, 19, 18, 13] or information retrieval-based (IR) static approaches [44, 60, 48, 58].”
BackgroundScalable statistical bug isolation
Liblit, B., Naik, M., Zheng, A. X., Aiken, A., & Jordan, M. I. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065014 · Cited by 736 · see citing works
Automatically learning semantic features for defect prediction
Wang, S., Liu, T., & Tan, L. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884804 · Cited by 720 · cited 1× · see citing works
“Wang et al.[55] proposed a Deep Belief Network based approached to detect file level defects.”
BackgroundCross-project defect prediction: a large scale experiment on data vs. domain vs. process
Zimmermann, T., Nagappan, N., Gall, H. C., Giger, E., & Murphy, B. (2009) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-25785 · Cited by 696 · see citing works
An extensive comparison of bug prediction approaches
D’Ambros, M., Lanza, M., & Robbes, R. (2010) · doi:10.1109/msr.2010.5463279 · Cited by 641 · cited 1× · see citing works
“This AUCEC metric is a non-parametric metric similar to the ROC curve and does not depend on bug distribution [45], thus becomes standard in bug-localization literature [16].”
MethodOn the naturalness of software
Hindle, A., Barr, E. T., Su, Z., Gabel, M., & Dévanbu, P. (2012) · doi:10.5555/2337223.2337322 · Cited by 574 · see citing works
Code completion with statistical language models
Raychev, V., Vechev, M., & Yahav, E. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594321 · Cited by 555 · cited 1× · see citing works
“Although real-world software programs are often large and complex, the program constructs (such as tokens) are repetitive, and thus provide useful predictable statistical property [26, 46, 51, 20].”
BackgroundLocating causes of program failures
Cleve, H., & Zeller, A. (2005) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1145/1062455.1062522 · Cited by 554 · cited 1× · see citing works
“Existing bug localization techniques can be broadly classified into two categories: i) test coverage-based dynamic approaches [30, 2, 59, 14, 37, 38], and ii) pattern-based [15, 19, 18, 13] or information retrieval-based (IR) static approaches [44, 60, 48, 58].”
BackgroundA practical evaluation of spectrum-based fault localization
Abreu, R., Zoeteweij, P., Golsteijn, R., & van Gemund, A. J. C. (2009) · Journal of Systems and Software · doi:10.1016/j.jss.2009.06.035 · Cited by 496 · cited 1× · see citing works
“Existing bug localization techniques can be broadly classified into two categories: i) test coverage-based dynamic approaches [30, 2, 59, 14, 37, 38], and ii) pattern-based [15, 19, 18, 13] or information retrieval-based (IR) static approaches [44, 60, 48, 58].”
BackgroundIdentifying reasons for software changes using historic databases
Mockus, & Votta (2000) · International Conference on Software Maintenance · doi:10.1109/icsm.2000.883028 · Cited by 478 · cited 1× · see citing works
“First, we identified bug-fix commits by searching a project’s commit logs using bug-fix related keywords: ‘error’, ‘bug’, ‘fix’, ‘is-sue’, ‘mistake’, ‘flaw’, and ‘defect’, following the methodology described by Mockus et al. [41].”
Arisholm, E., Briand, L., & Johannessen, E. B. (2009) · Journal of Systems and Software · doi:10.1016/j.jss.2009.06.055 · Cited by 458 · cited 1× · see citing works
“To evaluate the bug localization capability of EnSpec, we adopted commonly used non-parametric measure from literature: Cost Effectiveness (CE) metric originally proposed by Arisholm et al. [4] to investigate defects in telecom softwares.”
MethodMcRank: Learning to Rank Using Multiple Classification and Gradient Boosting
Li, P., Burges, C. J. C., & Wu, Q. (2007) · Cited by 441 · see citing works
Improving bug localization using structured information retrieval
Saha, R. K., Lease, M., Sarfraz Khurshid, D., & Perry, D. E. (2013) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2013.6693093 · Cited by 401 · cited 3× · see citing works
“Existing bug localization techniques can be broadly classified into two categories: i) test coverage-based dynamic approaches [30, 2, 59, 14, 37, 38], and ii) pattern-based [15, 19, 18, 13] or information retrieval-based (IR) static approaches [44, 60, 48, 58].”
BackgroundSelf-citationZhou, J. H., Zhang, H., & Lo, D. (2012) · doi:10.5555/2337223.2337226 · Cited by 381 · see citing works
(2000) · Applied Physics Letters · doi:10.1162/1532443041827916 · Cited by 363 · see citing works
Liu, C., Yan, X., Long, F., et al. (2005) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/1081706.1081753 · Cited by 357 · cited 1× · see citing works
“Existing bug localization techniques can be broadly classified into two categories: i) test coverage-based dynamic approaches [30, 2, 59, 14, 37, 38], and ii) pattern-based [15, 19, 18, 13] or information retrieval-based (IR) static approaches [44, 60, 48, 58].”
BackgroundA theoretical analysis of the risk evaluation formulas for spectrum-based fault localization
Xie, X., Chen, T. Y., Kuo, F., & Xu, B. (2013) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2522920.2522924 · Cited by 354 · cited 1× · see citing works
“Xie et al. proposed five ranking metrics by theoretical analysis and four other metrics based on genetic algorithms [56].”
BackgroundThe ManyBugs and IntroClass benchmarks for automated repair of C programs
Le Goues, C., Holtschulte, N., Smith, E. K., Brun, Y., Devanbu, P., Forrest, S., & Weimer, W. (2015) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2015.2454513 · Cited by 326 · cited 3× · see citing works
“We used two publicly available bug dataset: Defects4J [32] and ManyBugs [34] (see Table 4).”
BackgroundMethodOn the "naturalness" of buggy code
Ray, B., Hellendoorn, V. J., Godhane, S., Tu, Z., Bacchelli, A., & Dévanbu, P. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884848 · Cited by 260 · cited 9× · see citing works
“Previously, Ray et al. [45] and Wang et al. [54] demonstrated that unnaturalness of code elements (measured in terms of entropy) correlate with bug-giness.”
BackgroundMethodResultInfluentialSelf-citationRetrieval from software libraries for bug localization
Rao, S., & Kak, A. C. (2011) · Working Conference on Mining Software Repositories (MSR) · doi:10.1145/1985441.1985451 · Cited by 257 · cited 1× · see citing works
“Existing bug localization techniques can be broadly classified into two categories: i) test coverage-based dynamic approaches [30, 2, 59, 14, 37, 38], and ii) pattern-based [15, 19, 18, 13] or information retrieval-based (IR) static approaches [44, 60, 48, 58].”
BackgroundTu, Z., Su, Z., & Devanbu, P. (2014) · Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering · doi:10.1145/2635868.2635875 · Cited by 238 · see citing works
FIAT-fault injection based automated testing environment
Segall, Z. Z., Vrsalovic, D. F., Siewiorek, D. P., et al. (2003) · doi:10.1109/ftcs.1988.5306 · Cited by 235 · cited 1× · see citing works
“To reduce such imbalance and thus increase the effectiveness of SBBL , previous work injects artificial bugs in the software system under tests [24, 49].”
MethodLearning to Combine Multiple Ranking Metrics for Fault Localization
Xuan, J., & Monperrus, M. (2014) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2014.41 · Cited by 220 · cited 5× · see citing works
“This algorithm is used in the past by Xuan et al. [57] for implementing SBBL at method level bug localization.”
BackgroundMethodInfluentialA study of the uniqueness of source code
Gabel, M., & Su, Z. (2010) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/1882291.1882315 · Cited by 220 · cited 1× · see citing works
“Real-world software that are developed by regular programmers tend to be highly repetitive and predictable [22].”
Predicting Vulnerable Components: Software Metrics vs Text Mining
Walden, J., Stuckman, J., & Scandariato, R. (2014) · IEEE International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2014.32 · Cited by 212 · cited 1× · see citing works
“Note that, this is not an unreasonable assumption; one can use other human-based or automated techniques, e.g., statistical or information retrieval based defect prediction, to locate potential buggy files [43, 53, 48].”
BackgroundA learning-to-rank based fault localization approach using likely invariants
Le, T.-D. B., Lo, D., Goues, C. L., & Grunske, L. (2016) · International Symposium on Software Testing and Analysis · doi:10.1145/2931037.2931049 · Cited by 206 · cited 1× · see citing works
“Le et al.[6] also proposed an approach similar to Pytlic et al. with a larger invariant set.”
ResultEvaluation of error detection schemes using fault injection by heavy-ion radiation
Gunneflo, U., Karlsson, J., & Torin, J. (2003) · doi:10.1109/ftcs.1989.105590 · Cited by 203 · cited 1× · see citing works
“To reduce such imbalance and thus increase the effectiveness of SBBL , previous work injects artificial bugs in the software system under tests [24, 49].”
MethodComparative Power of Student T Test and Mann-Whitney U Test for Unequal Sample Sizes and Variances
Zimmerman, D. W. (1987) · The Journal of Experimental Education · doi:10.1080/00220973.1987.10806451 · Cited by 195 · cited 2× · see citing works
“However, a t-test [61] (see the Table below of 4) confirms that for Fail Only spectra, the difference is statistically significant (p-value 0.05), with a small Cohen’s D effect size.”
ResultInfluentialInformation retrieval and spectrum based bug localization: better together
Le, T.-D. B., Oentaryo, R. J., & Lo, D. (2015) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2786805.2786880 · Cited by 146 · cited 1× · see citing works
“Le et al. [33] proposed a multi-modal technique for bug localization that basically combines the IR and spectrum based bug localization together.”
BackgroundBugram: bug detection with n-gram language models
Wang, S., Chollak, D., Movshovitz‐Attias, D., & Tan, L. (2016) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2970276.2970341 · Cited by 130 · cited 3× · see citing works
“Inthis paper, our key intuition is that, since the high entropic code tends to be buggy [45, 11, 54], code entropy can be an effective orthogonal source of information to SBBL to improve the overall accuracy of bug localization.”
BackgroundExtended comprehensive study of association measures for fault localization
Lucia, L., Lo, D., Jiang, L., Thung, F., & Budi, A. (2013) · Journal of Software Evolution and Process · doi:10.1002/smr.1616 · Cited by 103 · cited 1× · see citing works
“Later, Lucia et al. did a comprehensive study of the different ranking metrics and showed that no ranking metric is unanimously best [39].”
BackgroundSyntax errors just aren't natural: improving error reporting with language models
Campbell, J. C., Hindle, A., & Amaral, J. N. (2014) · Working Conference on Mining Software Repositories (MSR) · doi:10.1145/2597073.2597102 · Cited by 82 · cited 1× · see citing works
“Inthis paper, our key intuition is that, since the high entropic code tends to be buggy [45, 11, 54], code entropy can be an effective orthogonal source of information to SBBL to improve the overall accuracy of bug localization.”
BackgroundRepresentations and operators for improving evolutionary software repair
Goues, C. L., Weimer, W. R., & Forrest, S. (2012) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2330163.2330296 · Cited by 76 · cited 1× · see citing works
“These scores also help to repair program automatically [35].”
BackgroundInteractive fault localization leveraging simple user feedback
Gong, L., Lo, D., Jiang, L., et al. (2012) · Proceedings/Proceedings - Conference on Software Maintenance · doi:10.1109/icsm.2012.6405255 · Cited by 45 · cited 1× · see citing works
“Gong et al. [23] proposed a feedback based fault localization system, which uses user feedback to improve performance.”
BackgroundCACHECA: A Cache Language Model Based Code Suggestion Tool
Franks, C., Tu, Z., Dévanbu, P., & Hellendoorn, V. J. (2015) · Cited by 35 · see citing works
Flagged first, then by citations
1 of the 48 references couldn’t be matched to a known paper.
Research works printed but not linked: 14
- [5][5] N. Ayewah, D. Hovemeyer, J. D. Morgenthaler, J. Penix, and W. Pugh. Using static analysis to find bugs. IEEE software , 25(5), 2008. -
- [12][12] N. V. Chawla, N. Japkowicz, and A. Kotcz. Editorial: special issue on learning from imbalanced data sets. ACM Sigkdd Explorations Newsletter , 6(1):1-6, 2004. -
- [13][13] B. Chelf, D. Engler, and S. Hallem. How to write system-specific, static checkers in metal. In Proceedings of the 2002 ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering , PASTE '02, pages 51-60, New York, NY, USA, 2002. ACM. -
- [21][21] Y. Freund, R. Iyer, R. E. Schapire, and Y. Singer. An efficient boosting algorithm for combining preferences. Journal of machine learning research , 4(Nov):933-969, 2003. -
- [25][25] V. J. Hellendoorn, P. T. Devanbu, and A. Bacchelli. Will they like this?: evaluating code contributions with language models. In Proceedings of the 12th Working Conference on Mining Software Repositories , pages 157-167. IEEE Press, 2015. -
- [27][27] A. Hindle, E. T. Barr, Z. Su, M. Gabel, and P. Devanbu. On the naturalness of software. In 2012 34th International Conference on Software Engineering (ICSE) , pages 837-847. IEEE, 2012. -
- [29][29] B. Johnson, Y. Song, E. Murphy-Hill, and R. Bowdidge. Why don't software developers use static analysis tools to find bugs? In Software Engineering (ICSE), 2013 35th International Conference on , pages 672-681. IEEE, 2013. -
- [38][38] C. Liu, X. Yan, L. Fei, J. Han, and S. P. Midkiff. Sober: statistical model-based bug localization. In ACM SIGSOFT Software Engineering Notes , volume 30, pages 286-295. ACM, 2005. -
- [42][42] B. Pytlik, M. Renieris, S. Krishnamurthi, and S. P. Reiss. Automated fault localization using potential invariants. arXiv preprint cs/0310040 , 2003. - · arXiv
- [43][43] F. Rahman, S. Khatri, E. T. Barr, and P. Devanbu. Comparing static bug finders and statistical prediction. In Proceedings of the 36th International Conference on Software Engineering , pages 424-434. ACM, 2014. -
- [47][47] T. Reps, T. Ball, M. Das, and J. Larus. The use of program profiling for software maintenance with applications to the year 2000 problem. In Software Engineeringâ ˘ A ˇ TESEC/FSE'97 , pages 432-449. Springer, 1997. -
- [50][50] J. ´ Sliwerski, T. Zimmermann, and A. Zeller. When do changes induce fixes? In ACM sigsoft software engineering notes , volume 30, pages 1-5. ACM, 2005. -
- [52][52] Z. Tu, Z. Su, and P. Devanbu. On the localness of software. In Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering , pages 269-280. ACM, 2014. -
- [58][58] X. Ye, R. Bunescu, and C. Liu. Learning to rank relevant files for bug reports using domain knowledge. In Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering , pages 689-699. ACM, 2014. -
Cited by
Sorted by citations
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Jimenez, C. E., Yang, J., Wettig, A., Yao, S., Pei, K., Press, O., & Narasimhan, K. (2023) · arXiv · doi:10.48550/arxiv.2310.06770 · Cited by 72 · see citing works
Spectrum-based multi-fault localization using Chaotic Genetic Algorithm
Ghosh, D., & Singh, J. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106512 · Cited by 49 · see citing works
Multi-Dimension Convolutional Neural Network for Bug Localization
Bei, W., Xu, L., Yan, M. L., et al. (2020) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2020.3006214 · Cited by 34 · see citing works
“have enough code coverage to locate bugs [4].”
BackgroundSWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
Yang, J., Jimenez, C. E., Wettig, A., Lieret, K., Yao, S., Narasimhan, K., & Press, O. (2024) · arXiv · doi:10.48550/arxiv.2405.15793 · Cited by 31 · see citing works
ABFL: An autoencoder based practical approach for software fault localization
Peng, Z., Xiao, X., Hu, G., Sangaiah, A. K., Atiquzzaman, M., & Xia, S. (2019) · Information Sciences · doi:10.1016/j.ins.2019.08.077 · Cited by 27 · see citing works
An Adaptive Approach for Fault Localization using R-CNN
Ghosh, D., Singh, J. P., & Singh, J. (2022) · International Conference on Advancements in Smart, Secure and Intelligent Computing (ASSIC) · doi:10.1109/assic55218.2022.10088417 · Cited by 3 · see citing works
“Using a number of statistical methods, Chakraborty et al. [11] developed a spectrum-based debugging tool to locate the inaccurate statements.”
MethodA Comparison Study of Two Well-known Fault Localization Methods
Chaleshtari, N. B., & Parsa, S. A. (2020) · International Computer Conference, Computer Society of Iran (CSICC) · doi:10.1109/csicc49403.2020.9050064 · Cited by 1 · see citing works
“Several research studies are conducted to automate the fault localization [1][2].”
BackgroundSpectrum-Based Fault Localization for Concurrent Programs
Ghosh, D., & Singh, J. (2020) · doi:10.1109/iccsea49143.2020.9132929 · Cited by 1 · see citing works
“By using those information SBFL calculates the suspicious score of each program statement using different statistical formulae [7].”
Method
- Authors
- Chakraborty, S., Li, Y., Irvine, M., Saha, R., & Ray, B.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1802.06947
- OpenAlex
- W2789200353
- Cited by
- 7
- References
- 48
- Citations by year
- 2022: 2 · 2021: 1 · 2020: 3 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Software › Software Reliability and Analysis Research
- Keywords
- statistical language models, test suite quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
