The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Detection of Duplicate Defect Reports Using Natural Language Processing
Abstract
Defect reports are generated from various testing and development activities in software engineering. Sometimes two reports are submitted that describe the same problem, leading to duplicate reports. These reports are mostly written in structured natural language, and as such, it is hard to compare two reports for similarity with formal methods. In order to identify duplicates, we investigate using natural language processing (NLP) techniques to support the identification. A prototype tool is developed and evaluated in a case study analyzing defect reports at Sony Ericsson mobile communications. The evaluation shows that about 2/3 of the duplicates can possibly be found using the NLP techniques. Different variants of the techniques provide only minor result differences, indicating a robust technology. User testing shows that the overall attitude towards the technique is positive and that it has a growth potential.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Automatic text processing: the transformation, analysis, and retrieval of information by computer
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0351 · Cited by 3,188
Recovering traceability links between code and documentation
Antoniol, G., Canfora, G., Casazza, G., De Lucia, A., & Merlo, E. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1041053 · Cited by 967
Advancing candidate link generation for requirements tracing: the study of methods
Hayes, J. H., Dekhtyar, A., & Sundaram, S. K. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.3 · Cited by 481
An information retrieval approach for automatically constructing software libraries
Maarek, Y. S., Berry, D. M., & Kaiser, G. E. (1991) · IEEE Transactions on Software Engineering · doi:10.1109/32.83915 · Cited by 442
Automated support for classifying software failure reports
Podgurski, A., Leon, D., Francis, P., Masri, W., & Minch, M. (2003) · Cited by 314
Automated support for classifying software failure reports
Podgurski, A., Leon, D., Francis, P., Masri, W., Minch, M., Sun, J., & Wang, B. (2003) · 25th International Conference on Software Engineering, 2003. Proceedings. · doi:10.1109/icse.2003.1201224 · Cited by 226
Impact Analysis by Mining Software and Change Request Repositories
Canfora, G., & Cerulo, L. (2005) · 11th IEEE International Software Metrics Symposium (METRICS'05) · doi:10.1109/metrics.2005.28 · Cited by 181
Can LSI help reconstructing requirements traceability in design and test?
Lormans, M., & Arie Van Deursen, A. (2006) · Euromicro Conference on Software Maintenance and Reengineering (CSMR) · doi:10.1109/csmr.2006.13 · Cited by 120
Robust, applied morphological generation
Minnen, G., Carroll, J. M., & Pearce, D. (2000) · International Conference on Natural Language Generation · doi:10.3115/1118253.1118281 · Cited by 81
Cited by
Bettenburg, N., Just, S., Schröter, A., Weiss, C., Premraj, R., & Zimmermann, T. (2008) · Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering · doi:10.1145/1453101.1453146 · Cited by 617
An approach to detecting duplicate bug reports using natural language and execution information
Wang, X., Zhang, L., Xie, T., Anvik, J., & Sun, J. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368151 · Cited by 539
Improving bug triage with bug tossing graphs
Jeong, G., Kim, S., & Zimmermann, T. (2009) · Proceedings of the 7th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering · doi:10.1145/1595696.1595715 · Cited by 455
ReLink: recovering links between bugs and changes
Wu, R., Zhang, H., Kim, S., & Cheung, S.-C. (2011) · Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering · doi:10.1145/2025113.2025120 · Cited by 412
Predicting the severity of a reported bug
Lamkanfi, A., Demeyer, S., Giger, E., & Goethals, B. (2010) · 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010) · doi:10.1109/msr.2010.5463284 · Cited by 345
Zimmermann, T., Premraj, R., Bettenburg, N., Just, S., Schroter, A., & Weiss, C. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.63 · Cited by 337
A discriminative model approach for accurate duplicate bug report retrieval
Sun, C., Lo, D., Wang, X., Jiang, J., & Khoo, S.-C. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806811 · Cited by 336
Towards more accurate retrieval of duplicate bug reports
Sun, C., Lo, D., Khoo, S.-C., & Jiang, J. (2011) · 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011) · doi:10.1109/ase.2011.6100061 · Cited by 334
It's not a bug, it's a feature: How misclassification impacts bug prediction
Herzig, K., Just, S., & Zeller, A. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606585 · Cited by 294
Reducing the effort of bug report triage: Recommenders for development-oriented decisions
Anvik, J., & Murphy, G. C. (2011) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2000791.2000794 · Cited by 281
Automated duplicate detection for bug tracking systems
Jalbert, N., & Weimer, W. (2008) · 2008 IEEE International Conference on Dependable Systems and Networks With FTCS and DCC (DSN) · doi:10.1109/dsn.2008.4630070 · Cited by 279
Duplicate bug reports considered harmful … really?
Bettenburg, N., Premraj, R., Zimmermann, T., & Kim, S. (2008) · 2008 IEEE International Conference on Software Maintenance · doi:10.1109/icsm.2008.4658082 · Cited by 278
Characterizing and predicting which bugs get fixed: an empirical study of Microsoft Windows
Guo, P. J., Zimmermann, T., Nagappan, N., & Murphy, B. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806871 · Cited by 265
Multilingual Plagiarism Detection
Ceska, Z., Toman, M., & Jezek, K. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85776-1_8 · Cited by 72
What distinguishes great software engineers
Li, P. L., Ko, A. J., & Begel, A. (2020) · Empirical Software Engineering · doi:10.1007/s10664-019-09773-y · Cited by 48
Identifying linked incidents in large-scale online service systems
Chen, Y., Yang, X., Dong, H., He, X., Zhang, H., Lin, Q., Chen, J., Zhao, P., Kang, Y., Gao, F., et al. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3409768 · Cited by 47
Parameterizing and Assembling IR-Based Solutions for SE Tasks Using Genetic Algorithms
Panichella, A., Dit, B., Oliveto, R., Di Penta, M., Poshyvanyk, D., & De Lucia, A. (2016) · 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER) · doi:10.1109/saner.2016.97 · Cited by 36
Metadata
- Authors
- Runeson, P., Alexandersson, M., & Nyholm, O.
- Venue
- 29th International Conference on Software Engineering (ICSE'07)
- Publisher
- IEEE
- Published
- 2007-05
- Pages
- 499-510
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W2165022036
- Cited by
- 523
- References
- 13
- FWCI
- 12.60
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.