The DOI matches its Crossref record; 104 of the 104 references it cites were found in a registry or an index.
The Impact of Class Rebalancing Techniques on the Performance and Interpretation of Defect Prediction Models
Open accessAbstract
Defect models that are trained on class imbalanced datasets (i.e., the proportion of defective and clean modules is not equally represented) are highly susceptible to produce inaccurate prediction models. Prior research compares the impact of class rebalancing techniques on the performance of defect models but arrives at contradictory conclusions due to the use of different choice of datasets, classification techniques, and performance measures. Such contradictory conclusions make it hard to derive practical guidelines for whether class rebalancing techniques should be applied in the context of defect models. In this paper, we investigate the impact of class rebalancing techniques on the performance measures and interpretation of defect models. We also investigate the experimental settings in which class rebalancing techniques are beneficial for defect models. Through a case study of 101 datasets that span across proprietary and open-source systems, we conclude that the impact of class rebalancing techniques on the performance of defect prediction models depends on the used performance measure and the used classification techniques. We observe that the optimized SMOTE technique and the under-sampling technique are beneficial when quality assurance teams wish to increase AUC and Recall, respectively, but they should be avoided when deriving knowledge and understandings from defect models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Harrell (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7 · Cited by 6,878
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
Regression Modeling Strategies
Walker, E. (2003) · Technometrics · doi:10.1198/tech.2003.s158 · Cited by 3,188
Estimating the error rate of a prediction rule: improvement on cross-validation
Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300
Using AUC and accuracy in evaluating learning algorithms
Huang, J., & Ling, C. X. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.50 · Cited by 2,148
RUSBoost: A Hybrid Approach to Alleviating Class Imbalance
Seiffert, C., Khoshgoftaar, T. M., Van Hulse, J., & Napolitano, A. (2010) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2009.2029559 · Cited by 1,867
caret: Classification and Regression Training
Kuhn, M. (2007) · CRAN: Contributed Packages · doi:10.32614/cran.package.caret · Cited by 1,786
Lessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
A Systematic Literature Review on Fault Prediction Performance in Software Engineering
Hall, T., Beecham, S., Bowes, D., Gray, D., & Counsell, S. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.103 · Cited by 1,154 · cited 2×
“been studied in defect prediction domain [32], [33], [34], [58], [59], [60].”
BackgroundSMOTE for high-dimensional class-imbalanced data
Blagus, R., & Lusa, L. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-106 · Cited by 1,106
Steyerberg, E. W., Eijkemans, M. J. C., Harrell, F. E., & Habbema, J. D. F. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000430)19:8<1059::aid-sim412>3.0.co;2-0 · Cited by 785
Training and assessing classification rules with imbalanced data
Menardi, G., & Torelli, N. (2014) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-012-0295-5 · Cited by 765
Predicting Defects for Eclipse
Zimmermann, T., Premraj, R., & Zeller, A. (2007) · Third International Workshop on Predictor Models in Software Engineering (PROMISE'07: ICSE Workshops 2007) · doi:10.1109/promise.2007.10 · Cited by 753
The PROMISE Repository of Empirical Software Engineering Data
Boetticher, G. D. (2007) · Medical Entomology and Zoology · Cited by 741
A large-scale empirical study of just-in-time quality assurance
Kamei, Y., Shihab, E., Adams, B., Hassan, A. E., Mockus, A., Sinha, A., & Ubayashi, N. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.70 · Cited by 715
Self-citationPredicting faults using the complexity of code changes
Hassan, A. E. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070510 · Cited by 708
Self-citationMoser, R., Pedrycz, W., & Succi, G. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368114 · Cited by 701
Cross-project defect prediction: a large scale experiment on data vs. domain vs. process
Zimmermann, T., Nagappan, N., Gall, H. C., Giger, E., & Murphy, B. (2009) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-25785 · Cited by 694
An extensive comparison of bug prediction approaches
D'Ambros, M., Lanza, M., & Robbes, R. (2010) · 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010) · doi:10.1109/msr.2010.5463279 · Cited by 637
Evaluating defect prediction approaches: a benchmark and an extensive comparison
D’Ambros, M., Lanza, M., & Robbes, R. (2012) · Empirical Software Engineering · doi:10.1007/s10664-011-9173-9 · Cited by 626
Clinical Prediction Models—a Practical Approach to Development, Validation and Updating
Bedogni, G. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2009.00614_16.x · Cited by 581
An Empirical Comparison of Model Validation Techniques for Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2584050 · Cited by 574
Self-citationUsing Class Imbalance Learning for Software Defect Prediction
Wang, S., & Yao, X. (2013) · IEEE Transactions on Reliability · doi:10.1109/tr.2013.2259203 · Cited by 571
Data Quality: Some Comments on the NASA Software Defect Datasets
Shepperd, M., Song, Q., Sun, Z., & Mair, C. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.11 · Cited by 570
Two Further Applications of a Model for Binary Regression
Cox, D. R. (1958) · Biometrika · doi:10.2307/2333203 · Cited by 557
Two further applications of a model for binary regression
COX, D. R. (1958) · Biometrika · doi:10.1093/biomet/45.3-4.562 · Cited by 556
Repeatability of published microarray gene expression analyses
Ioannidis, J. P. A., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., et al. (2009) · Nature Genetics · doi:10.1038/ng.295 · Cited by 551 · cited 1×
“[54] raise concerns that the majority of medical”
BackgroundROSE: a Package for Binary Imbalanced Learning
Lunardon, N., Menardi, G., & Torelli, N. (2014) · The R Journal · doi:10.32614/rj-2014-008 · Cited by 530
The meanings and measurement of clinical significance.
Kazdin, A. E. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.3.332 · Cited by 522
Lee, K. L., & Mark, D. B. (1996) · Cited by 488
Predicting Faults from Cached History
Kim, S., Zimmermann, T., Whitehead Jr., E. J., & Zeller, A. (2007) · 29th International Conference on Software Engineering (ICSE'07) · doi:10.1109/icse.2007.66 · Cited by 486
rms: Regression Modeling Strategies
Harrell Jr, F. E. (2009) · CRAN: Contributed Packages · doi:10.32614/cran.package.rms · Cited by 458
Use of Brier score to assess binary predictions
Rufibach, K. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.009 · Cited by 454
Predicting risk of software changes
Mockus, A., & Weiss, D. M. (2002) · Bell Labs Technical Journal · doi:10.1002/bltj.2229 · Cited by 429
The Impact of Automated Parameter Optimization on Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2794977 · Cited by 415
Self-citationReLink: recovering links between bugs and changes
Wu, R., Zhang, H., Kim, S., & Cheung, S.-C. (2011) · Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering · doi:10.1145/2025113.2025120 · Cited by 412
glmnet: Lasso and Elastic-Net Regularized Generalized Linear Models
Friedman, J., Hastie, T., Tibshirani, R., Narasimhan, B., Tay, K., Simon, N., & Yang, J. (2008) · CRAN: Contributed Packages · doi:10.32614/cran.package.glmnet · Cited by 376
Revisiting the Impact of Classification Techniques on the Performance of Defect Prediction Models
Ghotra, B., McIntosh, S., & Hassan, A. E. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.91 · Cited by 364
Self-citationrandomForest: Breiman and Cutlers Random Forests for Classification and Regression
Breiman, L., Cutler, A., Liaw, A., & Wiener, M. (2002) · CRAN: Contributed Packages · doi:10.32614/cran.package.randomforest · Cited by 358
McIntosh, S., Kamei, Y., Adams, B., & Hassan, A. E. (2014) · Proceedings of the 11th Working Conference on Mining Software Repositories · doi:10.1145/2597073.2597076 · Cited by 348
Self-citationAutomated parameter optimization of classification techniques for defect prediction models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884857 · Cited by 331
Self-citationDealing with noise in defect prediction
Kim, S., Zhang, H., Wu, R., & Gong, L. (2011) · Proceedings of the 33rd International Conference on Software Engineering · doi:10.1145/1985793.1985859 · Cited by 330
Validation techniques for logistic regression models
Miller, M. E., Hui, S. L., & Tierney, W. M. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100805 · Cited by 318
Bennin, K. E., Keung, J., Phannachitta, P., Monden, A., & Mensah, S. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2731766 · Cited by 298
Software Dependencies, Work Dependencies, and Their Impact on Failures
Cataldo, M., Mockus, A., Roberts, J. A., & Herbsleb, J. D. (2009) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2009.42 · Cited by 271
Cross-project defect prediction: a large scale experiment on data vs. domain vs. process
Zimmermann, T., Nagappan, N., Gall, H. C., Giger, E., & Murphy, T. B. (2009) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/1595696.1595713 · Cited by 257
Revisiting the Impact of Classification Techniques on the Performance of Defect Prediction Models
Ghotra, B., McIntosh, S., & Hassan, A. E. (2015) · Cited by 256
Self-citationHow, and why, process metrics are better
Rahman, F., & Devanbu, P. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606589 · Cited by 248
Recalling the "imprecision" of cross-project defect prediction
Rahman, F., Posnett, D., & Devanbu, P. (2012) · Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering · doi:10.1145/2393596.2393669 · Cited by 246
Class prediction for high-dimensional class-imbalanced data
Blagus, R., & Lusa, L. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-523 · Cited by 236
Ranking and Clustering Software Cost Estimation Models through a Multiple Comparisons Algorithm
Mittas, N., & Angelis, L. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.45 · Cited by 234
Online Defect Prediction for Imbalanced Data
Tan, M., Tan, L., Dara, S., & Mayeux, C. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.139 · Cited by 229
Revisiting common bug prediction findings using effort-aware models
Kamei, Y., Matsumoto, S., Monden, A., Matsumoto, K.-I., Adams, B., & Hassan, A. E. (2010) · 2010 IEEE International Conference on Software Maintenance · doi:10.1109/icsm.2010.5609530 · Cited by 207
Self-citationAn Example of Software System Debugging.
Akiyama, F. (1971) · IFIP Congress · Cited by 204
Change Bursts as Defect Predictors
Nagappan, N., Zeller, A., Zimmermann, T., Herzig, K., & Murphy, B. (2010) · 2010 IEEE 21st International Symposium on Software Reliability Engineering · doi:10.1109/issre.2010.25 · Cited by 195
The Effects of Over and Under Sampling on Fault-prone Module Detection
Kamei, Y., Monden, A., Matsumoto, S., Kakimoto, T., & Matsumoto, K. (2007) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2007.28 · Cited by 192
Self-citationHow, and Why, Process Metrics are better
Rahman, F., & Dévanbu, P. (2013) · Cited by 184
Heterogeneous defect prediction
Nam, J., & Kim, S. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786814 · Cited by 182
Thongtanunam, P., McIntosh, S., Hassan, A. E., & Iida, H. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884852 · Cited by 179
Self-citationSeiffert, C., Khoshgoftaar, T. M., Hulse, J. V., & Folleco, A. (2011) · Information Sciences · doi:10.1016/j.ins.2010.12.016 · Cited by 176
The Impact of Mislabelling on the Performance and Interpretation of Defect Prediction Models
Tantithamthavorn, C. K., McIntosh, S., Hassan, A. E., Ihara, A., & Matsumoto, K. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.93 · Cited by 169
Self-citationAttribute Selection and Imbalanced Data: Problems in Software Defect Prediction
Khoshgoftaar, T. M., Gao, K., & Seliya, N. (2010) · 2010 22nd IEEE International Conference on Tools with Artificial Intelligence · doi:10.1109/ictai.2010.27 · Cited by 164
Agrawal, A., & Menzies, T. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180197 · Cited by 159
Applying Novel Resampling Strategies To Software Defect Prediction
Pelayo, L., & Dick, S. (2007) · NAFIPS 2007 - 2007 Annual Meeting of the North American Fuzzy Information Processing Society · doi:10.1109/nafips.2007.383813 · Cited by 158
Online defect prediction for imbalanced data
Tan, M., Tan, L., Dara, S., & Mayeux, C. (2015) · doi:10.5555/2819009.2819026 · Cited by 151
An experience report on defect modelling in practice: pitfalls and challenges
Tantithamthavorn, C. K., & Hassan, A. E. (2018) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3183519.3183547 · Cited by 148
Self-citationPreliminary comparison of techniques for dealing with imbalance in software defect prediction
Rodríguez, D., Herraiz, I., Harrison, R., Dolado, J. J., & Riquelme, J. C. (2014) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/2601248.2601294 · Cited by 147
Organizational volatility and its effects on software defects
Mockus, A. (2010) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/1882291.1882311 · Cited by 144
Bennin, K. E., Keung, J., Phannachitta, P., Monden, A., & Mensah, S. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3180155.3182520 · Cited by 134
On the dataset shift problem in software engineering prediction models
Turhan, B. (2011) · Empirical Software Engineering · doi:10.1007/s10664-011-9182-8 · Cited by 132
Improving Software-Quality Predictions With Data Sampling and Boosting
Seiffert, C., Khoshgoftaar, T. M., & Hulse, J. V. (2009) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2009.2027131 · Cited by 122
Sample size vs. bias in defect prediction
Rahman, F., Posnett, D., Herraiz, I., & Dévanbu, P. (2013) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2491411.2491418 · Cited by 117
Shihab, E., Jiang, Z. M., Ibrahim, W. M., Adams, B., & Hassan, A. E. (2010) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/1852786.1852792 · Cited by 111
Self-citationBugCache for inspections: hit or miss?
Rahman, F., Posnett, D., Hindle, A., Barr, E. T., & Dévanbu, P. (2011) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2025113.2025157 · Cited by 109
ELBlocker: Predicting blocking bugs with ensemble imbalance learning
Xia, X., Lo, D., Shihab, E., Wang, X., & Yang, X. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2014.12.006 · Cited by 104
Performance of prognostic models in critically ill cancer patients – a review
den Boer, S. D., de Keizer, N. D., & de Jonge, E. (2005) · Critical Care · doi:10.1186/cc3765 · Cited by 99
On the relative value of data resampling approaches for software defect prediction
Bennin, K. E., Keung, J., & Monden, A. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9633-6 · Cited by 99
High-impact defects: a study of breakage and surprise defects
Shihab, E., Mockus, A., Kamei, Y., Adams, B., & Hassan, A. E. (2011) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2025113.2025155 · Cited by 96
Self-citationRobles, G. (2010) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2010.5463348 · Cited by 94
Predicting faults from cached history
Kim, S., Zimmermann, T., Whitehead, E. J., & Zeller, A. (2008) · India Software Engineering Conference · doi:10.1145/1342211.1342216 · Cited by 91
(2007) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2007.80 · Cited by 91
AutoSpearman: Automatically Mitigating Correlated Software Metrics for Interpreting Defect Models
Jiarpakdee, J., Tantithamthavorn, C. K., & Treude, C. (2018) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2018.00018 · Cited by 84
Self-citationAn empirical study for software change prediction using imbalanced data
Malhotra, R., & Khanna, M. (2017) · Empirical Software Engineering · doi:10.1007/s10664-016-9488-7 · Cited by 79
Comments on “Researcher Bias: The Use of Machine Learning in Software Defect Prediction”
Tantithamthavorn, C. K., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2553030 · Cited by 76
Self-citationStudying the impact of social interactions on software quality
Bettenburg, N., & Hassan, A. E. (2012) · Empirical Software Engineering · doi:10.1007/s10664-012-9205-0 · Cited by 62
Self-citationC50: C5.0 Decision Trees and Rule-Based Models
Kühn, M., & Quinlan, R. (2012) · doi:10.32614/cran.package.c50 · Cited by 61
High-Impact Bug Report Identification with Imbalanced Learning Strategies
Yang, X.-L., Lo, D., Xia, X., Huang, Q., & Sun, J.-L. (2017) · Journal of Computer Science and Technology · doi:10.1007/s11390-017-1713-3 · Cited by 52
An Exploration of Challenges Limiting Pragmatic Software Defect Prediction
Shihab, E. (2012) · QSpace (Queen's University Library) · Cited by 48
What is the Impact of Imbalance on Software Defect Prediction Performance?
Mahmood, Z., Bowes, D., Lane, P. C. R., & Hall, T. (2015) · doi:10.1145/2810146.2810150 · Cited by 44
A Study of Redundant Metrics in Defect Prediction Datasets
Jiarpakdee, J., Tantithamthavorn, C. K., Ihara, A., & Matsumoto, K. (2016) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew.2016.30 · Cited by 37
Self-citationThe Impact of Correlated Metrics on Defect ModelsPreprint
Jiarpakdee, J., Tantithamthavorn, C. K., & Hassan, A. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.10271 · Cited by 34
Self-citationTantithamthavorn, C. K. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2889160.2889256 · Cited by 28
Self-citationVerification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2
VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078<0001:vofeit>2.0.co;2
Harrell, F., Jr. (1996) · doi:10.1002/(sici)1097-0258(19960229)15:4<361::aid-sim168>3.0.co;2-4
Cited by
The Impact of Automated Parameter Optimization on Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2794977 · Cited by 415
Self-citationLineVul: a transformer-based line-level vulnerability prediction
Fu, M., & Tantithamthavorn, C. (2022) · Proceedings of the 19th International Conference on Mining Software Repositories · doi:10.1145/3524842.3528452 · Cited by 384
Self-citationGenerative Adversarial Networks for face generation: A survey
Kammoun, A., Slama, R., Tabia, H., Ouni, T., & Abid, M. (2022) · ACM Computing Surveys · doi:10.1145/1122445.1122456 · Cited by 311
An Empirical Study of Model-Agnostic Techniques for Defect Prediction Models
Jiarpakdee, J., Tantithamthavorn, C. K., Dam, H. K., & Grundy, J. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2982385 · Cited by 148
Self-citationPredicting Defective Lines Using a Model-Agnostic Technique
Wattanakriengkrai, S., Thongtanunam, P., Tantithamthavorn, C., Hata, H., & Matsumoto, K. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3023177 · Cited by 137
Self-citation
Metadata
- Authors
- Tantithamthavorn, C., Hassan, A. E., & Matsumoto, K.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2020-11-01
- Volume
- 46
- Issue
- 11
- Pages
- 1200-1219
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W2963548617
- Cited by
- 327
- References
- 104
- FWCI
- 44.19
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.