The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
HYDRA: Massively Compositional Model for Cross-Project Defect Prediction
Abstract
Most software defect prediction approaches are trained and applied on data from the same project. However, often a new project does not have enough training data. Cross-project defect prediction, which uses data from other projects to predict defects in a particular project, provides a new perspective to defect prediction. In this work, we propose a HYbrid moDel Reconstruction Approach (HYDRA) for cross-project defect prediction, which includes two phases: genetic algorithm (GA) phase and ensemble learning (EL) phase. These two phases create a massive composition of classifiers. To examine the benefits of HYDRA, we perform experiments on 29 datasets from the PROMISE repository which contains a total of 11,196 instances (i.e., Java classes) labeled as defective or clean. We experiment with logistic regression as the underlying classification algorithm of HYDRA. We compare our approach with the most recently proposed cross-project defect prediction approaches: TCA+ by Nam et al., Peters filter by Peters et al., GP by Liu et al., MO by Canfora et al., and CODEP by Panichella et al. Our results show that HYDRA achieves an average F1-score of 0.544. On average, across the 29 datasets, these results correspond to an improvement in the F1-scores of 26.22 , 34.99, 47.43, 28.61, and 30.14 percent over TCA+, Peters filter, GP, MO, and CODEP, respectively. In addition, HYDRA on average can discover 33 percent of all bugs if developers inspect the top 20 percent lines of code, which improves the best baseline approach (TCA+) by 44.41 percent. We also find that HYDRA improves the F1-score of Zero-R which predict all the instances to be defective by 5.42 percent, but improves Zero-R by 58.65 percent when inspecting the top 20 percent lines of code. In practice, Zero-R can be hard to use since it simply predicts all of the instances to be defective, and thus developers have to inspect all of the instances to find the defective ones. Moreover, we notice the improvement of HYDRA over other baseline approaches in terms of F1-score and when inspecting the top 20 percent lines of code are substantial, and in most cases the improvements are significant and have large effect sizes across the 29 datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Self-citationA decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“We choose logistic regression [7] implemented in WEKA [18] as the underlying machine learning classifier, and we measure the performance of TCA+ using F1-score.”
MethodIndividual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,265
(2006) · Springer eBooks · Cited by 8,123
McCabe, T. J. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233837 · Cited by 6,059
A metrics suite for object oriented design
Chidamber, S. R., & Kemerer, C. F. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.295895 · Cited by 5,669
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Self-citationData Mining: Concepts and Techniques
Thamaraiselvi, G., & Kaliammal, A. (2014) · Journal of Information and Knowledge · Cited by 4,088
Genetic Algorithms and Machine Learning
Goldberg, D. E., & Holland, J. H. (1988) · Machine Learning · doi:10.1023/a:1022602019183 · Cited by 3,193
Ensemble Methods: Foundations and Algorithms
Zhou, Z.-H. (2012) · doi:10.1201/b12207 · Cited by 2,534
Boosting the margin: a new explanation for the effectiveness of voting methods
Bartlett, P., Freund, Y., Lee, W. S., & Schapire, R. E. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691352 · Cited by 2,306
Ensemble Methods: Foundations and Algorithms
Zhou, Z. (2012) · Cited by 2,051
Boosting for transfer learning
Dai, W., Yang, Q., Xue, G.-R., & Yu, Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273521 · Cited by 1,724
An introduction to genetic algorithms
Nijhout, F. (1997) · Complexity · doi:10.1002/(sici)1099-0526(199705/06)2:5<39::aid-cplx8>3.0.co;2-l · Cited by 1,720
Introduction to Genetic Algorithms
(2008) · doi:10.1007/978-3-540-73190-0 · Cited by 1,481
Data Mining Static Code Attributes to Learn Defect Predictors
Menzies, T., Greenwald, J., & Frank, A. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.256941 · Cited by 1,215
A hierarchical model for object-oriented design quality assessment
Bansiya, J., & Davis, C. G. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.979986 · Cited by 1,020
Arcuri, A., & Briand, L. (2011) · Proceedings of the 33rd International Conference on Software Engineering · doi:10.1145/1985793.1985795 · Cited by 968
Instance Weighting for Domain Adaptation in NLP
Jiang, J., & Zhai, C. (2007) · Cited by 765
Object-oriented metrics: measures of complexity
Henderson‐Sellers, B. (1995) · Prentice-Hall, Inc eBooks · Cited by 753
On the relative value of cross-company and within-company data for defect prediction
Turhan, B., Menzies, T., Bener, A. B., & Di Stefano, J. (2009) · Empirical Software Engineering · doi:10.1007/s10664-008-9103-7 · Cited by 725
Boosting the margin: A new explanation for the effectiveness of voting methods
Schapire, R. E., Freund, Y., Barlett, P., & Lee, W. S. (1997) · Cited by 711
Predicting faults using the complexity of code changes
Hassan, A. E. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070510 · Cited by 708
Cross-project defect prediction: a large scale experiment on data vs. domain vs. process
Zimmermann, T., Nagappan, N., Gall, H. C., Giger, E., & Murphy, B. (2009) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-25785 · Cited by 694
Self-citationThe PROMISE Repository of Empirical Software Engineering Data
Boetticher, G. D. (2007) · Medical Entomology and Zoology · Cited by 682
Classifying Software Changes: Clean or Buggy?
Kim, S., Whitehead, & Zhang, Y. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70773 · Cited by 672
A hierarchical model for object-oriented design quality assessment
(2015) · Cited by 655
An extensive comparison of bug prediction approaches
D'Ambros, M., Lanza, M., & Robbes, R. (2010) · 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010) · doi:10.1109/msr.2010.5463279 · Cited by 637
Predicting defects using network analysis on dependency graphs
Zimmermann, T., & Nagappan, N. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368161 · Cited by 580
Self-citationOrdinal Methods for Behavioral Data Analysis
Cliff, N. (2014) · Psychology Press eBooks · doi:10.4324/9781315806730 · Cited by 560
Towards identifying software project clusters with regard to defect prediction
Jureczko, M., & Madeyski, L. (2010) · Proceedings of the 6th International Conference on Predictive Models in Software Engineering · doi:10.1145/1868328.1868342 · Cited by 546
Transfer learning for cross-company software defect prediction
Ma, Y., Luo, G., Zeng, X., & Chen, A. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.09.007 · Cited by 475
Nam, J., Pan, S. J., & Kim, S. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606584 · Cited by 449
Self-citationReLink: recovering links between bugs and changes
Wu, R., Zhang, H., Kim, S., & Cheung, S.-C. (2011) · Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering · doi:10.1145/2025113.2025120 · Cited by 412
Predicting fault-prone software modules in telephone switches
Ohlsson, N., & Alberg, H. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.553637 · Cited by 346
Catal, C., & Diri, B. (2009) · Information Sciences · doi:10.1016/j.ins.2008.12.001 · Cited by 343
Dealing with noise in defect prediction
Kim, S., Zhang, H., Wu, R., & Gong, L. (2011) · Proceedings of the 33rd International Conference on Software Engineering · doi:10.1145/1985793.1985859 · Cited by 330
Nam, J., Pan, S. J., & Kim, S. (2014) · Cited by 282
Self-citationCoping with an open bug repository
Anvik, J., Hiew, L., & Murphy, G. C. (2005) · Proceedings of the 2005 OOPSLA workshop on Eclipse technology eXchange - eclipse '05 · doi:10.1145/1117696.1117704 · Cited by 252
How, and why, process metrics are better
Rahman, F., & Devanbu, P. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606589 · Cited by 248
Recalling the "imprecision" of cross-project defect prediction
Rahman, F., Posnett, D., & Devanbu, P. (2012) · Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering · doi:10.1145/2393596.2393669 · Cited by 246
Personalized defect prediction
Jiang, T., Tan, L., & Kim, S. (2013) · 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2013.6693087 · Cited by 240
Better cross company defect prediction
Peters, F., Menzies, T., & Marcus, A. (2013) · 2013 10th Working Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6624057 · Cited by 214
Implications of ceiling effects in defect predictors
Menzies, T., Turhan, B., Bener, A., Gay, G., Cukic, B., & Jiang, Y. (2008) · Proceedings of the 4th international workshop on Predictor models in software engineering · doi:10.1145/1370788.1370801 · Cited by 185
How, and Why, Process Metrics are better
Rahman, F., & Dévanbu, P. (2013) · Cited by 184
Cross-project defect prediction models: L'Union fait la force
Panichella, A., Oliveto, R., & De Lucia, A. (2014) · 2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering (CSMR-WCRE) · doi:10.1109/csmr-wcre.2014.6747166 · Cited by 176
Multi-objective Cross-Project Defect Prediction
Canfora, G., De Lucia, A., Di Penta, M., Oliveto, R., Panichella, A., & Panichella, S. (2013) · 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation · doi:10.1109/icst.2013.38 · Cited by 171
Identifying Linux bug fixing patches
Tian, Y., Lawall, J., & Lo, D. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227176 · Cited by 155
Self-citationEvolutionary Optimization of Software Quality Modeling with Multiple Repositories
Liu, Y., Khoshgoftaar, T. M., & Seliya, N. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.51 · Cited by 152
On the dataset shift problem in software engineering prediction models
Turhan, B. (2011) · Empirical Software Engineering · doi:10.1007/s10664-011-9182-8 · Cited by 132
Data Mining Techniques for Building Fault-proneness Models in Telecom Java Software
Arisholm, E., Briand, L., & Fuglerud, M. (2007) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2007.22 · Cited by 123
Empirical evaluation of the effects of mixed project data on learning defect predictors
Turhan, B., Tosun, A., & Bener, A. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.10.003 · Cited by 120
Sample size vs. bias in defect prediction
Rahman, F., Posnett, D., Herraiz, I., & Dévanbu, P. (2013) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2491411.2491418 · Cited by 117
Reducing Features to Improve Bug Prediction
Shivaji, S., Whitehead, E. J., Akella, R., & Kim, S. (2009) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2009.76 · Cited by 99
Think Locally, Act Globally: Improving Defect and Effort Prediction Models
Bettenburg, N., & Hassan, A. E. (n.d.) · Cited by 98
Think locally, act globally: Improving defect and effort prediction models
Bettenburg, N., Nagappan, M., & Hassan, A. E. (2012) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2012.6224300 · Cited by 92
Multi-layered approach for recovering links between bug reports and fixes
Nguyen, A. T., Nguyen, T. T., Nguyen, H. A., & Nguyen, T. N. (2012) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2393596.2393671 · Cited by 81
Selective Transfer Between Learning Tasks Using Task-Based Boosting
Eaton, E., & desJardins, M. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.7932 · Cited by 60
Cited by
Deep Semantic Feature Learning for Software Defect Prediction
Wang, S., Liu, T., Nam, J., & Tan, L. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2877612 · Cited by 320
Progress on approaches to software defect prediction
Li, Z., Jing, X.-Y., & Zhu, X. (2018) · IET Software · doi:10.1049/iet-sen.2017.0148 · Cited by 264
Metadata
- Authors
- Xia, X., Lo, D., Pan, S. J., Nagappan, N., & Wang, X.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2016-10-01
- Volume
- 42
- Issue
- 10
- Pages
- 977-998
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- OpenAlex
- W2312398278
- Cited by
- 293
- References
- 61
- FWCI
- 81.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.