The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Improving bug localization using structured information retrieval
Abstract
Locating bugs is important, difficult, and expensive, particularly for large-scale systems. To address this, natural language information retrieval techniques are increasingly being used to suggest potential faulty source files given bug reports. While these techniques are very scalable, in practice their effectiveness remains low in accurately localizing bugs to a small number of files. Our key insight is that structured information retrieval based on code constructs, such as class and method names, enables more accurate bug localization. We present BLUiR, which embodies this insight, requires only the source code and bug reports, and takes advantage of bug similarity data if available. We build BLUiR on a proven, open source IR toolkit that anyone can use. Our work provides a thorough grounding of IR-based bug localization research in fundamental IR theoretical and empirical knowledge and practice. We evaluate BLUiR on four open source projects with approximately 3,400 bugs. Results show that BLUiR matches or outperforms a current state-of-the-art tool across applications considered, even when BLUiR does not use bug similarity data used by the other tool.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
No Silver Bullet Essence and Accidents of Software Engineering
Brooks (1987) · Computer · doi:10.1109/mc.1987.1663532 · Cited by 3,186
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/jmlr.2003.3.4-5.993 · Cited by 3,024
Relevance feedback in information retrieval
Rocchio, J. J. (1971) · Medical Entomology and Zoology · Cited by 2,680
A Language Modeling Approach to Information Retrieval
Ponte, J. M., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130368 · Cited by 2,503
A language modeling approach to information retrieval
Ponte, J. M., & Croft, W. B. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291008 · Cited by 1,821
Modern Information Retrieval : A Brief Overview
Singhal, A. (2001) · IEEE Data(base) Engineering Bulletin · Cited by 1,556
Empirical evaluation of the tarantula automatic fault-localization technique
Jones, J. A., & Harrold, M. J. (2005) · Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/1101908.1101949 · Cited by 1,238
Shapiro, E. Y. (1983) · doi:10.7551/mitpress/1192.001.0001 · Cited by 1,085
Simplifying and isolating failure-inducing input
Zeller, A., & Hildebrandt, R. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988498 · Cited by 1,079
Pivoted Document Length Normalization
Singhal, A., Buckley, C., & Mitra, M. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130365 · Cited by 848
Hovemeyer, D., & Pugh, W. (2004) · Companion to the 19th annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applications · doi:10.1145/1028664.1028717 · Cited by 760
Scalable statistical bug isolation
Liblit, B., Naik, M., Zheng, A. X., Aiken, A., & Jordan, M. I. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065014 · Cited by 729
Simple BM25 extension to multiple weighted fields
Robertson, S., Zaragoza, H., & Taylor, M. (2004) · Proceedings of the thirteenth ACM international conference on Information and knowledge management · doi:10.1145/1031171.1031181 · Cited by 701
Feature location in source code: a taxonomy and survey
Dit, B., Revelle, M., Gethers, M., & Poshyvanyk, D. (2013) · Journal of Software: Evolution and Process · doi:10.1002/smr.567 · Cited by 583
Pivoted document length normalization
Singhal, A., Buckley, C., & Mitra, M. (1996) · Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '96 · doi:10.1145/243199.243206 · Cited by 551
Zhou, J., Zhang, H., & Lo, D. (2012) · 2012 34th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2012.6227210 · Cited by 507
A practical evaluation of spectrum-based fault localization
Abreu, R., Zoeteweij, P., Golsteijn, R., & van Gemund, A. J. C. (2009) · Journal of Systems and Software · doi:10.1016/j.jss.2009.06.035 · Cited by 495
Scalable statistical bug isolation
Liblit, B., Naik, M., Zheng, A. X., Aiken, A., & Jordan, M. I. (2005) · Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation · doi:10.1145/1065010.1065014 · Cited by 472
Poshyvanyk, D., Gueheneuc, Y.-G., Marcus, A., Antoniol, G., & Rajlich, V. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.1016 · Cited by 469
An information retrieval approach to concept location in source code
Marcus, A., Sergeyev, A., Rajlich, V., & Maletic, J. I. (2005) · 11th Working Conference on Reverse Engineering · doi:10.1109/wcre.2004.10 · Cited by 455
Finding similar questions in large question and answer archives
Jeon, J., Croft, W. B., & Lee, J. H. (2005) · Proceedings of the 14th ACM international conference on Information and knowledge management · doi:10.1145/1099554.1099572 · Cited by 430
LETOR: Benchmark Dataset for Research on Learning to Rank for Information Retrieval
Liu, T., Xu, J., Qin, T., Xiong, W., & Li, H. (2007) · Cited by 419
Zhou, J. H., Zhang, H., & Lo, D. (2012) · doi:10.5555/2337223.2337226 · Cited by 372
A formal study of information retrieval heuristics
Fang, H., Tao, T., & Zhai, C. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1009004 · Cited by 361
Bug localization using latent Dirichlet allocation
Lukins, S. K., Kraft, N. A., & Etzkorn, L. H. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.04.002 · Cited by 311
Rao, S., & Kak, A. (2011) · Proceedings of the 8th Working Conference on Mining Software Repositories · doi:10.1145/1985441.1985451 · Cited by 252
Experimentation as a way of life: Okapi at TREC
Robertson, S. E., Walker, S., & Beaulieu, M. (2000) · Information Processing & Management · doi:10.1016/s0306-4573(99)00046-1 · Cited by 249
Combining Formal Concept Analysis with Information Retrieval for Concept Location in Source Code
Poshyvanyk, D., & Marcus, A. (2007) · 15th IEEE International Conference on Program Comprehension (ICPC '07) · doi:10.1109/icpc.2007.13 · Cited by 235
On the use of relevance feedback in IR-based concept location
Gay, G., Haiduc, S., Marcus, A., & Menzies, T. (2009) · 2009 IEEE International Conference on Software Maintenance · doi:10.1109/icsm.2009.5306315 · Cited by 185
Mining source code to automatically split identifiers for software analysis
Enslen, E., Hill, E., Pollock, L., & Vijay-Shanker, K. (2009) · 2009 6th IEEE International Working Conference on Mining Software Repositories · doi:10.1109/msr.2009.5069482 · Cited by 170
A Comparative Study of Utilizing Topic Models for Information Retrieval
Yi, X., & Allan, J. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00958-7_6 · Cited by 166
Experimental evaluation of using dynamic slices for fault location
Zhang, X., He, H., Gupta, N., & Gupta, R. (2005) · International Symposium on Automated Analysis-Driven Debugging (AADEBUG) · doi:10.1145/1085130.1085135 · Cited by 152
AUSUM: approach for unsupervised bug report summarization
Mani, S., Catherine, R., Sinha, V. S., & Dubey, A. (2012) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2393596.2393607 · Cited by 110
Validity concerns in software engineering research
Wright, H. K., Kim, M., & Perry, D. E. (2010) · FSE/SDP Workshop on Future of Software Engineering Research (FoSER) · doi:10.1145/1882362.1882446 · Cited by 105
Self-citationCan Better Identifier Splitting Techniques Help Feature Location?
Dit, B., Guerrouj, L., Poshyvanyk, D., & Antoniol, G. (2011) · 2011 IEEE 19th International Conference on Program Comprehension · doi:10.1109/icpc.2011.47 · Cited by 89
Incorporating version histories in Information Retrieval based bug localization
Sisman, B., & Kak, A. C. (2012) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2012.6224299 · Cited by 70
Regression Rank: Learning to Meet the Opportunity of Descriptive Queries
Lease, M., Allan, J., & Croft, W. B. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00958-7_11 · Cited by 67
Self-citationUsing Bug Report Similarity to Enhance Bug Localisation
Davies, S., Roper, M., & Wood, M. (2012) · Working Conference on Reverse Engineering (WCRE) · doi:10.1109/wcre.2012.22 · Cited by 36
Rao, S., & Kak, A. C. (2013) · Purdue e-Pubs (Purdue University System) · Cited by 12
Cited by
A Survey on Software Fault Localization
Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2521368 · Cited by 1,110
“Recently, some studies [85], [234], [298], [315], [425] have applied information retrieval techniques to software fault localization.”
ResultDemystifying LLM-Based Software Engineering Agents
Xia, C. S., Deng, Y., Dunn, S., & Zhang, L. (2025) · Proceedings of the ACM on Software Engineering · doi:10.1145/3715754 · Cited by 849
“Such IR-based techniques [Saha et al. 2013; Wang et al. 2015; Wang and Lo 2014] formulate FL as a search problem and compare the textual similarity between code elements and the bug report (i.e., query).”
DeepFL: integrating multiple fault diagnosis dimensions for deep fault localization
Li, X., Li, W., Zhang, Y., & Zhang, L. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330574 · Cited by 336
Learning to rank relevant files for bug reports using domain knowledge
Ye, X., Bunescu, R., & Liu, C. (2014) · Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering · doi:10.1145/2635868.2635874 · Cited by 290
Ye, X., Shen, H., Ma, X., Bunescu, R., & Liu, C. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884862 · Cited by 282
Metadata
- Authors
- Saha, R. K., Lease, M., Khurshid, S., & Perry, D. E.
- Venue
- 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE)
- Publisher
- IEEE
- Published
- 2013-11
- Pages
- 345-355
- OpenAlex
- W1985947101
- Cited by
- 390
- References
- 46
- FWCI
- 18.03
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.