Improving Automated Bug Triaging with Specialized Topic Model
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Bug triaging refers to the process of assigning a bug to the most appropriate developer to fix. It becomes more and more difficult and complicated as the size of software and the number of developers increase. In this paper, we propose a new framework for bug triaging, which maps the words in the bug reports (i.e., the term space) to their corresponding topics (i.e., the topic space). We propose a specialized topic modeling algorithm namedmulti-feature topic model (MTM)which extends Latent Dirichlet Allocation (LDA) for bug triaging.MTMconsiders product and component information of bug reports to map the term space to the topic space. Finally, we propose an incremental learning method namedTopicMinerwhich considers the topic distribution of a new bug report to assign an appropriate fixer based on the affinity of the fixer to the topics. We pairTopicMinerwith MTM (TopicMiner$^{MTM}$). We have evaluated our solution on 5 large bug report datasets including GCC, OpenOffice, Mozilla, Netbeans, and Eclipse containing a total of 227,278 bug reports. We show thatTopicMiner$^{MTM}$can achieve top-1 and top-5 prediction accuracies of 0.4831-0.6868, and 0.7686-0.9084, respectively. We also compareTopicMiner$^{MTM}$with Bugzie, LDA-KL, SVM-LDA, LDA-Activity, and Yang et al.'s approach. The results show thatTopicMiner$^{MTM}$on average improves top-1 and top-5 prediction accuracies of Bugzie by 128.48 and 53.22 percent, LDA-KL by 262.91 and 105.97 percent, SVM-LDA by 205.89 and 110.48 percent, LDA-Activity by 377.60 and 176.32 percent, and Yang et al.'s approach by 59.88 and 13.70 percent, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096 · cited 1×
“Among the three, LDA is the most recently proposed and it addresses the limitations of LSA and pLSA [12].”
Probabilistic Latent Semantic Analysis
Hofmann, T. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6705 · Cited by 2,047 · cited 1×
“ature including Latent Semantic Indexing/Analysis (LSA) [16], probabilistic LSA (pLSA) [18], and Latent 1.”
BackgroundSteyvers, M., & Griffiths, T. (2015) · Handbook of Latent Semantic Analysis · doi:10.4324/9780203936399.ch21 · Cited by 1,011 · cited 1×
“In the information retrieval community, topic modeling [36], which can infer the inherent latent topics of a tex-”
Anvik, J., Hiew, L., & Murphy, G. C. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134336 · Cited by 924 · cited 2×
“For more information, please email libIR@smu.edu.sg.”
InfluentialParameter estimation for text analysis
Heinrich, G. (2009) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 741
Ordinal Methods for Behavioral Data Analysis
Cliff, N. (2014) · Psychology Press eBooks · doi:10.4324/9781315806730 · Cited by 560 · cited 1×
“Moreover, we also compute Cliffs delta [14],(6) which is a non-parametric effect size measure that quantifies the amount of difference between the results of a pair of competing approaches.”
Improving bug triage with bug tossing graphs
Jeong, G., Kim, S., & Zimmermann, T. (2009) · Proceedings of the 7th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering · doi:10.1145/1595696.1595715 · Cited by 455 · cited 1×
“Published in IEEE Transactions on Software Engineering, Volume 43, Issue 3, 1 March 2017, Article number 7484672, Pages 272-297. http://doi.org/10.1109/TSE.2016.2576454 Dirichlet Allocation (LDA) [12].”
InfluentialImproving bug localization using structured information retrieval
Saha, R. K., Lease, M., Khurshid, S., & Perry, D. E. (2013) · 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2013.6693093 · Cited by 390 · cited 1×
“The success of these approaches depends on the accuracy of feature location techniques which are often still low [32].”
BackgroundTowards more accurate retrieval of duplicate bug reports
Sun, C., Lo, D., Khoo, S.-C., & Jiang, J. (2011) · 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011) · doi:10.1109/ase.2011.6100061 · Cited by 334 · cited 1×
“Values of product and component fields have been used by a number of previous studies on bug report management [29], [37], [39], [43].”
MethodSelf-citationDuplicate bug report detection with a combination of information retrieval and topic modeling
Nguyen, A. T., Nguyen, T. T., Nguyen, T. N., Lo, D., & Sun, C. (2012) · Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/2351676.2351687 · Cited by 239 · cited 3×
“Values of product and component fields have been used by a number of previous studies on bug report management [29], [37], [39], [43].”
BackgroundMethodSelf-citationPanichella, A., Dit, B., Oliveto, R., Di Penta, M., Poshynanyk, D., & De Lucia, A. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606598 · Cited by 216
Panichella, A., Dit, B., Oliveto, R., Penta, M. D., Poshynanyk, D., & Lucia, A. D. (2013) · Archivio Istituzionale della Ricerca - Università degli Studi del Molise · Cited by 206
Bertram, D., Voida, A., Greenberg, S., & Walker, R. J. (2010) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1718918.1718972 · Cited by 204
Fine-grained incremental learning and multi-feature tossing graphs to improve bug triaging
Bhattacharya, P., & Neamtiu, I. (2010) · 2010 IEEE International Conference on Software Maintenance · doi:10.1109/icsm.2010.5609736 · Cited by 178 · cited 1×
“Published in IEEE Transactions on Software Engineering, Volume 43, Issue 3, 1 March 2017, Article number 7484672, Pages 272-297. http://doi.org/10.1109/TSE.2016.2576454 Dirichlet Allocation (LDA) [12].”
InfluentialAnandarajan, M., Hill, C., & Nolan, T. (2019) · Advances in Analytics and Data Science · doi:10.1007/978-3-319-95663-3_8 · Cited by 173
Automated prediction of bug report priority using multi-factor analysis
Tian, Y., Lo, D., Xia, X., & Sun, C. P. (2014) · Empirical Software Engineering · doi:10.1007/s10664-014-9331-y · Cited by 150 · cited 1×
“Values of product and component fields have been used by a number of previous studies on bug report management [29], [37], [39], [43].”
Self-citationShokripour, R., Anvik, J., Kasirun, Z. M., & Zamani, S. (2013) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6623997 · Cited by 139
Accurate developer recommendation for bug resolution
Xia, X., Lo, D., Wang, X., & Zhou, B. (2013) · Working Conference on Reverse Engineering (WCRE) · doi:10.1109/wcre.2013.6671282 · Cited by 136 · cited 4×
“Values of product and component fields have been used by a number of previous studies on bug report management [29], [37], [39], [43].”
BackgroundMethodInfluentialSelf-citationYang, G., Zhang, T., & Lee, B. (2014) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2014.16 · Cited by 115 · cited 4×
“also use LDA to extract topics from bug reports, and find bug reports related to each topic [47].”
InfluentialDetermining Implementation Expertise from Bug Reports
Anvik, J., & Murphy, G. C. (2007) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2007.7 · Cited by 112 · cited 2×
“Our work, similar to past automated bug triaging solutions [7], [8], [15], [20], [26], [27], [35], [38] is complementary to Porchlight.”
BackgroundResultDREX: Developer Recommendation with K-Nearest-Neighbor Search and Expertise Ranking
Wu, W., Zhang, W., Yang, Y., & Wang, Q. (2011) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2011.15 · Cited by 109 · cited 1×
“people that would participate in a bug resolution process [41], [43], [45].”
BackgroundTriaging incoming change requests: Bug or commit history, or code authorship?
Linares‐Vásquez, M., Hossen, K., Dang, H., Kagdi, H., Gethers, M., & Poshyvanyk, D. (2012) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405306 · Cited by 109
Bug report assignee recommendation using activity profiles
Naguib, H., Narayan, N., Brügge, B., & Helal, D. (2013) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6623999 · Cited by 105 · cited 2×
“Singapore Management University Institutional Knowledge at Singapore Management University Research Collection School Of Information Systems School of Information Systems 3-2017 Improving automated bug triaging with specialized topic model Xin XIA Zhejiang University David LO Singapore Management University, davidlo@s…”
InfluentialAssigning change requests to software developers
Kagdi, H., Gethers, M., Poshyvanyk, D., & Hammad, M. M. (2011) · Journal of Software Evolution and Process · doi:10.1002/smr.530 · Cited by 105
Automatic categorization of bug reports using latent Dirichlet allocation
Somasundaram, K., & Murphy, G. C. (2012) · India Software Engineering Conference · doi:10.1145/2134254.2134276 · Cited by 95 · cited 1×
“Published in IEEE Transactions on Software Engineering, Volume 43, Issue 3, 1 March 2017, Article number 7484672, Pages 272-297. http://doi.org/10.1109/TSE.2016.2576454 Dirichlet Allocation (LDA) [12].”
InfluentialXie, X., Zhang, W., Yang, Y., & Wang, Q. (2012) · doi:10.1145/2365324.2365329 · Cited by 89
On the relationship between comment update practices and Software Bugs
Ibrahim, W. M., Bettenburg, N., Adams, B., & Hassan, A. E. (2011) · Journal of Systems and Software · doi:10.1016/j.jss.2011.09.019 · Cited by 73 · cited 1×
“ments [19], unavailability of authorship information for authors without commit rights in CVS and SVN repositories [23], etc.”
BackgroundA time-based approach to automatic bug report assignment
Shokripour, R., Anvik, J., Kasirun, Z. M., & Zamani, S. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2014.12.049 · Cited by 70
PorchLight: a tag-based approach to bug triaging
Bortis, G., & van der Hoek, A. (2013) · eScholarship (California Digital Library) · doi:10.5555/2486788.2486834 · Cited by 30
A Model of the Commit Size Distribution of Open Source
Kolassa, C., Riehle, D., & Salim, M. A. (2013) · Cited by 19
Cited by
Unveiling ChatGPT’s usage in open source projects: A mining-based study
Tufano, R., Mastropaolo, A., Pepe, F., Dabic, O., Di Penta, M., & Bavota, G. (2024) · Proceedings of the 21st International Conference on Mining Software Repositories · doi:10.1145/3643991.3644918 · Cited by 38
“…context” Over the years, researchers have developed various forms of recommenders, aimed at suggesting relevant code elements for a given task [44, 86, 111], helping to fix bugs [48, 81, 106, 114] and vulnerabilities [54, 68, 70], and even to automatically document software systems [43, 83, 100].”
Background
Metadata
- Authors
- Xia, X., Lo, D., Ding, Y., Al-Kofahi, J. M., Nguyen, T. N., & Wang, X.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2017-03-01
- Volume
- 43
- Issue
- 3
- Pages
- 272-297
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- OpenAlex
- W2417608402
- Cited by
- 173
- References
- 34
- FWCI
- 36.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.