The DOI matches its Crossref record; 125 of the 125 references it cites were found in a registry or an index.
A Systematic Literature Review and Meta-Analysis on Cross Project Defect Prediction
Abstract
Background: Cross project defect prediction (CPDP) recently gained considerable attention, yet there are no systematic efforts to analyse existing empirical evidence. Objective: To synthesise literature to understand the state-of-the-art in CPDP with respect to metrics, models, data approaches, datasets and associated performances. Further, we aim to assess the performance of CPDP versus within project DP models. Method: We conducted a systematic literature review. Results from primary studies are synthesised (thematic, meta-analysis) to answer research questions. Results: We identified 30 primary studies passing quality assessment. Performance measures, except precision, vary with the choice of metrics. Recall, precision, f-measure, and AUC are the most common measures. Models based on Nearest-Neighbour and Decision Tree tend to perform well in CPDP, whereas the popular naïve Bayes yields average performance. Performance of ensembles varies greatly across f-measure and AUC. Data approaches address CPDP challenges using row/column processing, which improve CPDP in terms of recall at the cost of precision. This is observed in multiple occasions including the meta-analysis of CPDP versus WPDP. NASA and Jureczko datasets seem to favour CPDP over WPDP more frequently. Conclusion: CPDP is still a challenge and requires more research before trustworthy applications can take place. We provide guidelines for further research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · cited 1×
“In its essence, a meta-analysis incorporates statistical approaches to combine multiple studies in an effort to increase power over individual studies while improving the estimates of the effect sizes and resolve uncertainties when different studies disagree [50], [69], [76].”
BackgroundSMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793 · cited 8×
“The combined effect consequently, cannot be represented as one, but instead is represented by the mean of the population of true effects [76].”
BackgroundMethodInfluentialStatistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,784
Experimentation in Software Engineering
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., & Wesslén, A. (2012) · doi:10.1007/978-3-642-29044-2 · Cited by 4,460
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · cited 2×
“As per the guidelines provided by Wohlin, we applied backward and forward snowballing iteratively until no further papers for inclusion were detected [28].”
MethodMeta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
A User's Guide to Principal Components
Leigh, S., & Jackson, J. E. (1993) · Technometrics · doi:10.2307/1269292 · Cited by 3,332
Interpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884 · cited 4×
“converge to one true effect [76], [77].”
BackgroundInfluentialMulti-Interval Discretization of Continuous-Valued Attributes for Classification Learning
Fayyad, U. M., & Irani, K. B. (1993) · International Joint Conference on Artificial Intelligence · Cited by 2,870
Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2007) · Journal of Systems and Software · doi:10.1016/j.jss.2006.07.009 · Cited by 2,394
Supervised and Unsupervised Discretization of Continuous Features
Dougherty, J., Kohavi, R., & Sahami, M. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50032-3 · Cited by 1,936
Violin Plots: A Box Plot-Density Trace Synergism
Hintze, J. L., & Nelson, R. D. (1998) · The American Statistician · doi:10.1080/00031305.1998.10480559 · Cited by 1,802
A validation of object-oriented design metrics as quality indicators
Basili, V. R., Briand, L. C., & Melo, W. L. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.544352 · Cited by 1,726
Experimentation in software engineering
(2013) · Choice Reviews Online · doi:10.5860/choice.50-5018 · Cited by 1,517
Systematic literature reviews in software engineering – A tertiary study
Kitchenham, B., Pretorius, R., Budgen, D., Pearl Brereton, O., Turner, M., Niazi, M., & Linkman, S. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.03.006 · Cited by 1,230 · cited 1×
“While Catal and Diri’s review provided a conceptual classification of the frequency of metrics, methods and datasets used, it lacks a (qualitative or quantitative) synthesis of primary studies, hence one should consider it more of a systematic mapping study than a literature review [2].”
BackgroundLessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
Data Mining Static Code Attributes to Learn Defect Predictors
Menzies, T., Greenwald, J., & Frank, A. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.256941 · Cited by 1,215
Meta-Analysis: Cumulating Research Findings across Studies
Feldman, J. M., Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1984) · The Academy of Management Review · doi:10.2307/258247 · Cited by 1,199
A Systematic Literature Review on Fault Prediction Performance in Software Engineering
Hall, T., Beecham, S., Bowes, D., Gray, D., & Counsell, S. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.103 · Cited by 1,154 · cited 10×
“[1] for conducting the review and presenting the results.”
BackgroundMethodInfluential(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
A critique of software defect prediction models
Fenton, N. E., & Neil, M. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.815326 · Cited by 1,040
A User's Guide to Principal Components
Freeman, J. (1992) · Journal of the Operational Research Society · doi:10.1057/jors.1992.90 · Cited by 1,018
Empirical validation of object-oriented metrics on open source software for fault prediction
Gyimothy, T., Ferenc, R., & Siket, I. (2005) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2005.112 · Cited by 904
Building knowledge through families of experiments
Basili, V. R., Shull, F., & Lanubile, F. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.799939 · Cited by 852
Śliwerski, J., Zimmermann, T., & Zeller, A. (2005) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/1082983.1083147 · Cited by 805
Meta-Analysis: Cumulating Research Findings across Studies
Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1986) · Educational Researcher · doi:10.2307/1175263 · Cited by 792
Mining metrics to predict component failures
Nagappan, N., Ball, T., & Zeller, A. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134349 · Cited by 782
Use of relative code churn measures to predict system defect density
Nagappan, N., & Ball, T. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062514 · Cited by 775
Evidence-Based Software Engineering and Systematic Reviews
Kitchenham, B. A., Budgen, D., & Brereton, P. (2015) · Chapman & Hall/CRC eBooks · doi:10.1201/b19467 · Cited by 759
Predicting Defects for Eclipse
Zimmermann, T., Premraj, R., & Zeller, A. (2007) · Third International Workshop on Predictor Models in Software Engineering (PROMISE'07: ICSE Workshops 2007) · doi:10.1109/promise.2007.10 · Cited by 753
The PROMISE Repository of Empirical Software Engineering Data
Boetticher, G. D. (2007) · Medical Entomology and Zoology · Cited by 741
On the relative value of cross-company and within-company data for defect prediction
Turhan, B., Menzies, T., Bener, A. B., & Di Stefano, J. (2009) · Empirical Software Engineering · doi:10.1007/s10664-008-9103-7 · Cited by 725
Self-citationField, A. P. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.161 · Cited by 725
Moser, R., Pedrycz, W., & Succi, G. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368114 · Cited by 701
Best-Evidence Synthesis: An Alternative to Meta-Analytic and Traditional Reviews
Slavin, R. E. (1986) · Educational Researcher · doi:10.2307/1174711 · Cited by 698
Cross-project defect prediction: a large scale experiment on data vs. domain vs. process
Zimmermann, T., Nagappan, N., Gall, H. C., Giger, E., & Murphy, B. (2009) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-25785 · Cited by 694
Automatically learning semantic features for defect prediction
Wang, S., Liu, T., & Tan, L. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884804 · Cited by 689
Subramanyam, R., & Krishnan, M. S. (2003) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2003.1191795 · Cited by 672
Understanding and controlling software costs
Boehm, B. W., & Papaccio, P. N. (1988) · IEEE Transactions on Software Engineering · doi:10.1109/32.6191 · Cited by 667
An extensive comparison of bug prediction approaches
D'Ambros, M., Lanza, M., & Robbes, R. (2010) · 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010) · doi:10.1109/msr.2010.5463279 · Cited by 637
Data Preprocessing For Supervised Leaning
Kotsiantis, S. B., Kanellopoulos, D. N., & Pintelas, P. (2007) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1082414 · Cited by 631
Evaluating defect prediction approaches: a benchmark and an extensive comparison
D’Ambros, M., Lanza, M., & Robbes, R. (2012) · Empirical Software Engineering · doi:10.1007/s10664-011-9173-9 · Cited by 626
Data Quality: Some Comments on the NASA Software Defect Datasets
Shepperd, M., Song, Q., Sun, Z., & Mair, C. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.11 · Cited by 570
Towards identifying software project clusters with regard to defect prediction
Jureczko, M., & Madeyski, L. (2010) · Proceedings of the 6th International Conference on Predictive Models in Software Engineering · doi:10.1145/1868328.1868342 · Cited by 546
Software fault prediction metrics: A systematic literature review
Radjenović, D., Heričko, M., Torkar, R., & Živkovič, A. (2013) · Information and Software Technology · doi:10.1016/j.infsof.2013.02.009 · Cited by 538
A systematic review of software fault prediction studies
Catal, C., & Diri, B. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.10.027 · Cited by 530
Transfer learning for cross-company software defect prediction
Ma, Y., Luo, G., Zeng, X., & Chen, A. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.09.007 · Cited by 475
Nam, J., Pan, S. J., & Kim, S. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606584 · Cited by 449
Cliff´s Delta Calculator: A non-parametric effect size program for two groups of observations
Macbeth, G., Razumiejczyk, E., & Ledesma, R. D. (2010) · Universitas Psychologica · doi:10.11144/javeriana.upsy10-2.cdcp · Cited by 442
Cross versus Within-Company Cost Estimation Studies: A Systematic Review
Kitchenham, B. A., Mendes, E., & Travassos, G. H. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.1001 · Cited by 424
ReLink: recovering links between bugs and changes
Wu, R., Zhang, H., Kim, S., & Cheung, S.-C. (2011) · Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering · doi:10.1145/2025113.2025120 · Cited by 412
Revisiting the Impact of Classification Techniques on the Performance of Defect Prediction Models
Ghotra, B., McIntosh, S., & Hassan, A. E. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.91 · Cited by 364
The prediction of faulty classes using object-oriented design metrics
El Emam, K., Melo, W., & Machado, J. C. (2001) · Journal of Systems and Software · doi:10.1016/s0164-1212(00)00086-8 · Cited by 359
Assessing the applicability of fault-proneness models across object-oriented software projects
Briand, L. C., Melo, W. L., & Wust, J. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1019484 · Cited by 352
Predicting fault-prone software modules in telephone switches
Ohlsson, N., & Alberg, H. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.553637 · Cited by 346
Catal, C., & Diri, B. (2009) · Information Sciences · doi:10.1016/j.ins.2008.12.001 · Cited by 343
An investigation on the feasibility of cross-project defect prediction
He, Z., Shu, F., Yang, Y., Li, M., & Wang, Q. (2012) · Automated Software Engineering · doi:10.1007/s10515-011-0090-3 · Cited by 333
Automated parameter optimization of classification techniques for defect prediction models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884857 · Cited by 331
An empirical study on software defect prediction with a simplified metric set
He, P., Li, B., Liu, X., Chen, J., & Ma, Y. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2014.11.006 · Cited by 309
Kamvar, S. D., Klein, D., & Manning, C. D. (2003) · International Joint Conference on Artificial Intelligence · Cited by 289
An Application of Oversampling, Undersampling, Bagging and Boosting in Handling Imbalanced Datasets
Yap, B. W., Rani, K. A., Rahman, H. A. A., Fong, S., Khairudin, Z., & Abdullah, N. N. (2014) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-4585-18-7_2 · Cited by 283
Static analysis tools as early indicators of pre-release defect density
Nagappan, N., & Ball, T. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062558 · Cited by 272
The effectiveness of pair programming: A meta-analysis
Hannay, J. E., Dybå, T., Arisholm, E., & Sjøberg, D. I. K. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2009.02.001 · Cited by 268
Local versus Global Lessons for Defect Prediction and Effort Estimation
Menzies, T., Butcher, A., Cok, D., Marcus, A., Layman, L., Shull, F., Turhan, B., & Zimmermann, T. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.83 · Cited by 261
Self-citationRevisiting the Impact of Classification Techniques on the Performance of Defect Prediction Models
Ghotra, B., McIntosh, S., & Hassan, A. E. (2015) · Cited by 256
Recalling the "imprecision" of cross-project defect prediction
Rahman, F., Posnett, D., & Devanbu, P. (2012) · Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering · doi:10.1145/2393596.2393669 · Cited by 246
Studying just-in-time defect prediction using cross-project models
Kamei, Y., Fukushima, T., McIntosh, S., Yamashita, K., Ubayashi, N., & Hassan, A. E. (2016) · Empirical Software Engineering · doi:10.1007/s10664-015-9400-x · Cited by 236
Exploiting the Essential Assumptions of Analogy-Based Effort Estimation
Kocaguneli, E., Menzies, T., Bener, A., & Keung, J. W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.27 · Cited by 200
Jing, X., Wu, F., Dong, X., Qi, F., & Xu, B. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786813 · Cited by 197
A Framework for Evaluating the Results of the SZZ Approach for Identifying Bug-Introducing Changes
da Costa, D. A., McIntosh, S., Shang, W., Kulesza, U., Coelho, R., & Hassan, A. E. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2616306 · Cited by 197
ScottKnott: A Package for Performing the Scott-Knott Clustering Algorithm in R
Jelihovschi, E., Faria, J. C., & Allaman, I. B. (2014) · TEMA (São Carlos) · doi:10.5540/tema.2014.015.01.0003 · Cited by 192
Implications of ceiling effects in defect predictors
Menzies, T., Turhan, B., Bener, A., Gay, G., Cukic, B., & Jiang, Y. (2008) · Proceedings of the 4th international workshop on Predictor models in software engineering · doi:10.1145/1370788.1370801 · Cited by 185
Self-citationHeterogeneous defect prediction
Nam, J., & Kim, S. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786814 · Cited by 182
Cross-project defect prediction models: L'Union fait la force
Panichella, A., Oliveto, R., & De Lucia, A. (2014) · 2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering (CSMR-WCRE) · doi:10.1109/csmr-wcre.2014.6747166 · Cited by 176
Value-cognitive boosting with a support vector machine for cross-project defect prediction
Ryu, D., Choi, O., & Baik, J. (2016) · Empirical Software Engineering · doi:10.1007/s10664-014-9346-4 · Cited by 176
Teng, C.-M. (1999) · International Conference on Machine Learning · Cited by 173
Multi-objective Cross-Project Defect Prediction
Canfora, G., De Lucia, A., Di Penta, M., Oliveto, R., Panichella, A., & Panichella, S. (2013) · 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation · doi:10.1109/icst.2013.38 · Cited by 171
Negative samples reduction in cross-company software defects prediction
Chen, L., Fang, B., Shang, Z., & Tang, Y. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.01.014 · Cited by 169
A transfer cost-sensitive boosting approach for cross-project defect prediction
Ryu, D., Jang, J., & Baik, J. (2015) · Software Quality Journal · doi:10.1007/s11219-015-9287-1 · Cited by 159
Training data selection for cross-project defect prediction
Herbold, S. (2013) · doi:10.1145/2499393.2499395 · Cited by 158
Learning from Open-Source Projects: An Empirical Study on Defect Prediction
He, Z., Peters, F., Menzies, T., & Yang, Y. (2013) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2013.20 · Cited by 153
Evolutionary Optimization of Software Quality Modeling with Multiple Repositories
Liu, Y., Khoshgoftaar, T. M., & Seliya, N. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.51 · Cited by 152
Towards logistic regression models for predicting fault-prone code across software projects
Cruz, A. E. C., & Ochimizu, K. (2009) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2009.5316002 · Cited by 149
A Systematic Review of Cross- vs. Within-Company Cost Estimation Studies
Kitchenham, B. A., Mendes, E., & Travassos, G. H. (2006) · Electronic workshops in computing · doi:10.14236/ewic/ease2006.10 · Cited by 147
On the dataset shift problem in software engineering prediction models
Turhan, B. (2011) · Empirical Software Engineering · doi:10.1007/s10664-011-9182-8 · Cited by 132
Self-citationEmpirical evaluation of the effects of mixed project data on learning defect predictors
Turhan, B., Tosun, A., & Bener, A. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.10.003 · Cited by 128
Self-citationUsing bad learners to find good configurations
Nair, V., Menzies, T., Siegmund, N., & Apel, S. (2017) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3106237.3106238 · Cited by 127
Special issue on repeatable results in software engineering prediction
Menzies, T., & Shepperd, M. (2012) · Empirical Software Engineering · doi:10.1007/s10664-011-9193-5 · Cited by 122
The Effects of Test-Driven Development on External Quality and Productivity: A Meta-Analysis
Rafique, Y., & Mišić, V. B. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.28 · Cited by 121
Towards building a universal defect prediction model with rank transformed predictors
Zhang, F., Mockus, A., Keivanloo, I., & Zou, Y. (2015) · Empirical Software Engineering · doi:10.1007/s10664-015-9396-2 · Cited by 116
Mockus, A. (2009) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2009.5069476 · Cited by 116
Hosseini, S., Turhan, B., & Mäntylä, M. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2017.06.004 · Cited by 110
Self-citationA Hybrid Instance Selection Using Nearest-Neighbor for Cross-Project Defect Prediction
Ryu, D., Jang, J., & Baik, J. (2015) · Journal of Computer Science and Technology · doi:10.1007/s11390-015-1575-5 · Cited by 109
SZZ revisited: verifying when changes induce fixes
Williams, C. C., & Spacco, J. W. (2008) · doi:10.1145/1390817.1390826 · Cited by 100
Understanding and Controlling Software Costs
BOEHM, B. W. (1988) · Journal of Parametrics · doi:10.1080/10157891.1988.10472819 · Cited by 89
Using Historical In-Process and Product Metrics for Early Estimation of Software Failures
Nagappan, N., Ball, T., & Murphy, T. B. (2006) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2006.50 · Cited by 83
Network Versus Code Metrics to Predict Defects: A Replication Study
Premraj, R., & Herzig, K. (2011) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2011.30 · Cited by 82
LACE2: Better Privacy-Preserving Data Sharing for Cross Project Defect Prediction
Peters, F., Menzies, T., & Layman, L. M. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.92 · Cited by 75
Empirically Detecting False Test Alarms Using Association Rules
Herzig, K., & Nagappan, N. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.133 · Cited by 72
Data mining source code for locating software bugs: A case study in telecommunication industry
Turhan, B., Kocak, G., & Bener, A. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.12.028 · Cited by 57
Self-citationTowards Cross-Project Defect Prediction with Imbalanced Feature SetsPreprint
He, P., Li, B., & Ma, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4228 · Cited by 54
Comparing cost prediction models by resampling techniques
Mittas, N., & Angelis, L. (2007) · Journal of Systems and Software · doi:10.1016/j.jss.2007.07.039 · Cited by 52
Empirically detecting false test alarms using association rules
Herzig, K., & Nagappan, N. (2015) · doi:10.5555/2819009.2819018 · Cited by 49
Software quality prediction using median-adjusted class labels
Pizzi, N. J., Summers, A. R., & Witold Pedrycz, C. (2003) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2002.1007518 · Cited by 48
An empirical study on predicting defect numbers
Chen, M., & Ma, Y. (2015) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2015-132 · Cited by 48
Sharing Data and Models in Software Engineering
Menzies, T., Kocagüneli, E., Turhan, B., Minku, L. L., & Peters, F. (2014) · Cited by 47
Self-citationSearch Based Training Data Selection For Cross Project Defect Prediction
Hosseini, S., Turhan, B., & Mäntylä, M. (2016) · doi:10.1145/2972958.2972964 · Cited by 37
Self-citationThe Tragedy of Defect Prediction, Prince of Empirical Software Engineering Research
Lanza, M., Mocci, A., & Ponzanelli, L. (2016) · IEEE Software · doi:10.1109/ms.2016.156 · Cited by 36
DConfusion: a technique to allow cross study performance evaluation of fault prediction studies
Bowes, D., Hall, T., & Gray, D. H. (2013) · Automated Software Engineering · doi:10.1007/s10515-013-0129-8 · Cited by 34
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · Wiley eBooks · doi:10.1002/9780470743386.ch43 · Cited by 30
An Ensemble Approach of Simple Regression Models to Cross-Project Fault Prediction
Uchigaki, S., Uchida, S., Toda, K., & Monden, A. (2012) · ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD) · doi:10.1109/snpd.2012.34 · Cited by 28
Investigating Associative Classification for Software Fault Prediction: An Experimental Perspective
Ma, B., Zhang, H., Chen, G., Zhao, Y., & Baesens, B. (2014) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s021819401450003x · Cited by 24
Simplification of Training Data for Cross-Project Defect PredictionPreprint
He, P., Li, B., Zhang, D., & Ma, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.0773 · Cited by 23
Data Sets and Data Quality in Software Engineering: Eight Years On
Liebchen, G., & Shepperd, M. (2016) · doi:10.1145/2972958.2972967 · Cited by 22
Sharing experiments using open‐source software
Nelson, A., Menzies, T., & Gay, G. (2010) · Software Practice and Experience · doi:10.1002/spe.1004 · Cited by 20
Better Predictors for Issue LifetimePreprint
Rees-Jones, M., Martin, M. J., & Menzies, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07735 · Cited by 17
A Cross-Project Evaluation of Text-Based Fault-Prone Module Prediction
Mizuno, O., & Hirata, Y. (2014) · International Workshop on Empirical Software Engineering in Practice (IWESEP) · doi:10.1109/iwesep.2014.9 · Cited by 13
Cross Company and within Company Fault Prediction using Object Oriented Metrics
Singh, P., Verma, S., & Vyas, O. P. (2013) · International Journal of Computer Applications · doi:10.5120/12903-9587 · Cited by 13
Software defect prediction based on manifold learning in subspace selection
Gao, Y., & Yang, C. (2016) · doi:10.1145/3028842.3028859 · Cited by 5
Cited by
A systematic literature review of blockchain cyber security
Taylor, P. J., Dargahi, T., Dehghantanha, A., Parizi, R. M., & Choo, K.-K. R. (2020) · Digital Communications and Networks · doi:10.1016/j.dcan.2019.01.005 · Cited by 633
Azeem, M. I., Palomba, F., Shi, L., & Wang, Q. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.12.009 · Cited by 289
A survey on deep learning for software engineering
Yang, Y., Xia, X., Lo, D., & Grundy, J. (2022) · ACM Computing Surveys · doi:10.1145/3505243 · Cited by 223
“Following previous studies [43, 47, 67], we selected 22 widely read SE journals (10) and conferences (12) listed in Table 1 to conduct a comprehensive literature review.”
Method
Metadata
- Authors
- Hosseini, S., Turhan, B., & Gunarathna, D.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2019-02-01
- Volume
- 45
- Issue
- 2
- Pages
- 111-147
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W2766521509
- Cited by
- 317
- References
- 125
- FWCI
- 8.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.