The DOI matches its Crossref record; 120 of the 120 references it cites were found in a registry or an index.
Machine learning techniques for code smell detection: A systematic literature review and meta-analysis
Abstract
Abstract Background: Code smells indicate suboptimal design or implementation choices in the source code that often lead it to be more change- and fault-prone. Researchers defined dozens of code smell detectors, which exploit different sources of information to support developers when diagnosing design flaws. Despite their good accuracy, previous work pointed out three important limitations that might preclude the use of code smell detectors in practice: (i) subjectiveness of developers with respect to code smells detected by such tools, (ii) scarce agreement between different detectors, and (iii) difficulties in finding good thresholds to be used for detection. To overcome these limitations, the use of machine learning techniques represents an ever increasing research area. Objective: While the research community carefully studied the methodologies applied by researchers when defining heuristic-based code smell detectors, there is still a noticeable lack of knowledge on how machine learning approaches have been adopted for code smell detection and whether there are points of improvement to allow a better detection of code smells. Our goal is to provide an overview and discuss the usage of machine learning approaches in the field of code smells. Method: This paper presents a Systematic Literature Review (SLR) on Machine Learning Techniques for Code Smell Detection. Our work considers papers published between 2000 and 2017. Starting from an initial set of 2456 papers, we found that 15 of them actually adopted machine learning approaches. We studied them under four different perspectives: (i) code smells considered, (ii) setup of machine learning approaches, (iii) design of the evaluation strategies, and (iv) a meta-analysis on the performance achieved by the models proposed so far. Results: The analyses performed show that God Class, Long Method, Functional Decomposition, and Spaghetti Code have been heavily considered in the literature. Decision Trees and Support Vector Machines are the most commonly used machine learning algorithms for code smell detection. Models based on a large set of independent variables have performed well. JRip and Random Forest are the most effective classifiers in terms of performance. The analyses also reveal the existence of several open issues and challenges that the research community should focus on in the future. Conclusion: Based on our findings, we argue that there is still room for the improvement of machine learning techniques in the context of code smell detection. The open issues emerged in this study can represent the input for researchers interested in developing more powerful techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
RETRACTED ARTICLE: The smell of fear: on the relation between test smells and flaky tests
Palomba, F., & Zaidman, A. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09683-z · Cited by 36
Self-citationRetractedCortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
(2000) · Cited by 9,198
Software engineering: A practitioner's approach
(1983) · Advances in Engineering Software (1978) · doi:10.1016/0141-1195(83)90118-3 · Cited by 8,234
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793 · cited 3×
“In doing such an analysis, we employed fixed and random effect models [103] based on the F-measure of the approaches proposed in the literature.”
BackgroundMethodA metrics suite for object oriented design
Chidamber, S. R., & Kemerer, C. F. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.295895 · Cited by 5,669
Refactoring: Improving the Design of Existing Code
Fowler, M. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45672-4_31 · Cited by 5,591
A Practical Guide to Support Vector Classication
Hsu, C., Chang, C.-C., & Lin, C. (2008) · Cited by 5,046
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · cited 3×
“c We performed a snowballing process to search for possible missing papers [67].”
BackgroundMethodInfluentialA survey of decision tree classifier methodology
Safavian, S. R., & Landgrebe, D. (1991) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.97458 · Cited by 3,808
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Devijver, P. A., & Kittler, J. (1982) · Prentice-Hall International eBooks · Cited by 2,910
Methods for Trend Estimation from Summarized Dose-Response Data, with Applications to Meta-Analysis
Greenland, S., & Longnecker, M. P. (1992) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116237 · Cited by 2,353
Introduction to Machine Learning
Yu, F. R., & He, Y. (2019) · SpringerBriefs in Electrical and Computer Engineering · doi:10.1007/978-3-030-10546-4_1 · Cited by 1,594
Suthaharan, S. (2016) · Integrated Series in Information Systems · doi:10.1007/978-1-4899-7641-3_9 · Cited by 1,579
Statistics Notes: The odds ratio
Bland, J. M. (2000) · BMJ · doi:10.1136/bmj.320.7247.1468 · Cited by 1,294
Programs, life cycles, and laws of software evolution
Lehman, M. M. (1980) · Proceedings of the IEEE · doi:10.1109/proc.1980.11805 · Cited by 1,181
A Systematic Literature Review on Fault Prediction Performance in Software Engineering
Hall, T., Beecham, S., Bowes, D., Gray, D., & Counsell, S. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.103 · Cited by 1,154
Object-oriented metrics that predict maintainability
Li, W., & Henry, S. (1993) · Journal of Systems and Software · doi:10.1016/0164-1212(93)90077-b · Cited by 1,077
Software Engineering: A Practitioners Approach
Khan, R. A., & Agrawal, A. (2014) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,057
An Introduction to Machine Learning
Kubat, M. (2015) · Springer eBooks · doi:10.1007/978-3-319-20010-1 · Cited by 1,007
AntiPatterns: Refactoring Software, Architectures, and Projects in Crisis
Brown, W. H., Malveau, R. C., McCormick, H. W., & Mowbray, T. J. (1998) · Cited by 932
DECOR: A Method for the Specification and Detection of Code and Design Smells
Moha, N., Gueheneuc, Y.-G., Duchien, L., & Le Meur, A.-F. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2009.50 · Cited by 803
Evidence-Based Software Engineering and Systematic Reviews
Kitchenham, B. A., Budgen, D., & Brereton, P. (2015) · Chapman & Hall/CRC eBooks · doi:10.1201/b19467 · Cited by 759
The WyCash portfolio management system
Cunningham, W. (1992) · Addendum to the proceedings on Object-oriented programming systems, languages, and applications (Addendum) - OOPSLA '92 · doi:10.1145/157709.157715 · Cited by 742
Technical Debt: From Metaphor to Theory and Practice
Kruchten, P., Nord, R. L., & Ozkaya, I. (2012) · IEEE Software · doi:10.1109/ms.2012.167 · Cited by 735
On the relative value of cross-company and within-company data for defect prediction
Turhan, B., Menzies, T., Bener, A. B., & Di Stefano, J. (2009) · Empirical Software Engineering · doi:10.1007/s10664-008-9103-7 · Cited by 725
Field, A. P. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.161 · Cited by 725
Best-Evidence Synthesis: An Alternative to Meta-Analytic and Traditional Reviews
Slavin, R. E. (1986) · Educational Researcher · doi:10.2307/1174711 · Cited by 698
Cross-project defect prediction: a large scale experiment on data vs. domain vs. process
Zimmermann, T., Nagappan, N., Gall, H. C., Giger, E., & Murphy, B. (2009) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-25785 · Cited by 694
Parnas, D. L. (1994) · doi:10.5555/257734.257788 · Cited by 655
An Empirical Comparison of Model Validation Techniques for Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2584050 · Cited by 574
Detection strategies: metrics-based rules for detecting design flaws
Marinescu, R. (2004) · 20th IEEE International Conference on Software Maintenance, 2004. Proceedings. · doi:10.1109/icsm.2004.1357820 · Cited by 551
The WyCash portfolio management system
Cunningham, W. (1993) · ACM SIGPLAN OOPS Messenger · doi:10.1145/157710.157715 · Cited by 545
Comparing and experimenting machine learning techniques for code smell detection
Arcelli Fontana, F., Mäntylä, M. V., Zanoni, M., & Marino, A. (2016) · Empirical Software Engineering · doi:10.1007/s10664-015-9378-4 · Cited by 450
The Impact of Automated Parameter Optimization on Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2794977 · Cited by 415
The Qualitas Corpus: A Curated Collection of Java Code for Empirical Studies
Tempero, E., Anslow, C., Dietrich, J., Han, T., Li, J., Lumpe, M., Melton, H., & Noble, J. (2010) · 2010 Asia Pacific Software Engineering Conference · doi:10.1109/apsec.2010.46 · Cited by 407
An exploratory study of the impact of antipatterns on class change- and fault-proneness
Khomh, F., Penta, M. D., Guéhéneuc, Y.-G., & Antoniol, G. (2012) · Empirical Software Engineering · doi:10.1007/s10664-011-9171-y · Cited by 395
Identification of Move Method Refactoring Opportunities
Tsantalis, N., & Chatzigeorgiou, A. (2009) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2009.1 · Cited by 339
Software complexity and maintenance costs
Banker, R. D., Datar, S. M., Kemerer, C. F., & Zweig, D. (1993) · Communications of the ACM · doi:10.1145/163359.163375 · Cited by 334
A Systematic Literature Review and Meta-Analysis on Cross Project Defect Prediction
Hosseini, S., Turhan, B., & Gunarathna, D. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2770124 · Cited by 317
Quantifying the Effect of Code Smells on Maintenance Effort
Sjoberg, D. I. K., Yamashita, A., Anda, B. C. D., Mockus, A., & Dyba, T. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.89 · Cited by 316
An empirical study on software defect prediction with a simplified metric set
He, P., Li, B., Liu, X., Chen, J., & Ma, Y. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2014.11.006 · Cited by 309
Abbes, M., Khomh, F., Gueheneuc, Y.-G., & Antoniol, G. (2011) · 2011 15th European Conference on Software Maintenance and Reengineering · doi:10.1109/csmr.2011.24 · Cited by 309
Palomba, F., Bavota, G., Penta, M. D., Fasano, F., Oliveto, R., & Lucia, A. D. (2018) · Empirical Software Engineering · doi:10.1007/s10664-017-9535-z · Cited by 305
Self-citationDetecting code smells using machine learning techniques: Are we there yet?
Di Nucci, D., Palomba, F., Tamburri, D. A., Serebrenik, A., & De Lucia, A. (2018) · 2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330266 · Cited by 305
Self-citationThe effectiveness of pair programming: A meta-analysis
Hannay, J. E., Dybå, T., Arisholm, E., & Sjøberg, D. I. K. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2009.02.001 · Cited by 268
Mining Version Histories for Detecting Code Smells
Palomba, F., Bavota, G., Penta, M. D., Oliveto, R., Poshyvanyk, D., & De Lucia, A. (2015) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2014.2372760 · Cited by 259
Self-citationRevisiting the Impact of Classification Techniques on the Performance of Defect Prediction Models
Ghotra, B., McIntosh, S., & Hassan, A. E. (2015) · Cited by 256
Do They Really Smell Bad? A Study on Developers' Perception of Bad Code Smells
Palomba, F., Bavota, G., Di Penta, M., Oliveto, R., & De Lucia, A. (2014) · 2014 IEEE International Conference on Software Maintenance and Evolution · doi:10.1109/icsme.2014.32 · Cited by 251
Self-citationRohde, H., Elsner, M., & Clarke, A. V. (2014) · The Association for Computational Linguistics · Cited by 248
When and Why Your Code Starts to Smell Bad (and Whether the Smells Go Away)
Tufano, M., Palomba, F., Bavota, G., Oliveto, R., Penta, M. D., De Lucia, A., & Poshyvanyk, D. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2653105 · Cited by 236
Self-citationAn experimental investigation on the innate relationship between quality and refactoring
Bavota, G., De Lucia, A., Di Penta, M., Oliveto, R., & Palomba, F. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2015.05.024 · Cited by 232
Self-citationDo code smells reflect important maintainability aspects?
Yamashita, A., & Moonen, L. (2012) · 2012 28th IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405287 · Cited by 222
Managing Technical Debt in Software Engineering (Dagstuhl Seminar 16162)
Avgeriou, P., Kruchten, P. B., Özkaya, İ., & Seaman, C. B. (2016) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/dagrep.6.4.110 · Cited by 218
Measuring and Monitoring Technical Debt
Seaman, C., & Guo, Y. (2011) · Advances in Computers · doi:10.1016/b978-0-12-385512-1.00002-5 · Cited by 217
Better cross company defect prediction
Peters, F., Menzies, T., & Marcus, A. (2013) · 2013 10th Working Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6624057 · Cited by 214
Code Bad Smells: a review of current knowledge
Zhang, M., Hall, T., & Baddoo, N. (2011) · Journal of Software Maintenance and Evolution: Research and Practice · doi:10.1002/smr.521 · Cited by 213
Automatic detection of bad smells in code: An experimental assessment.
Arcelli Fontana, F., Braione, P., & Zanoni, M. (2012) · The Journal of Object Technology · doi:10.5381/jot.2012.11.2.a5 · Cited by 203
A review-based comparative study of bad smell detection tools
Fernandes, E., Oliveira, J., Vale, G., Paiva, T., & Figueiredo, E. (2016) · Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2915970.2915984 · Cited by 192
Product Metrics for Automatic Identification of "Bad Smell" Design Problems in Java Source-Code
Munro, M. J. (2005) · 11th IEEE International Software Metrics Symposium (METRICS'05) · doi:10.1109/metrics.2005.38 · Cited by 191
Cross-project defect prediction models: L'Union fait la force
Panichella, A., Oliveto, R., & De Lucia, A. (2014) · 2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering (CSMR-WCRE) · doi:10.1109/csmr-wcre.2014.6747166 · Cited by 176
Subjective evaluation of software evolvability using code smells: An empirical study
Mäntylä, M. V., & Lassenius, C. (2007) · Empirical Software Engineering · doi:10.1007/s10664-006-9002-8 · Cited by 171
Source code metrics: A systematic mapping study
Nuñez-Varela, A. S., Pérez-Gonzalez, H. G., Martínez-Perez, F. E., & Soubervielle-Montalvo, C. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2017.03.044 · Cited by 171
An empirical investigation into the nature of test smells
Tufano, M., Palomba, F., Bavota, G., Di Penta, M., Oliveto, R., De Lucia, A., & Poshyvanyk, D. (2016) · Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/2970276.2970340 · Cited by 160
Self-citationMethodbook: Recommending Move Method Refactorings via Relational Topic Models
Bavota, G., Oliveto, R., Gethers, M., Poshyvanyk, D., & Lucia, A. D. (2014) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.60 · Cited by 154
Investigating the Evolution of Bad Smells in Object-Oriented Code
Chatzigeorgiou, A., & Manakos, A. (2010) · International Conference on the Quality of Information and Communications Technology (QUATIC) · doi:10.1109/quatic.2010.16 · Cited by 148
Fine-grained just-in-time defect prediction
Pascarella, L., Palomba, F., & Bacchelli, A. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.12.001 · Cited by 146
Self-citationProceedings of 11th European Conference on Software Maintenance and Reengineering
Krikhaar, R. L. (2007) · Data Archiving and Networked Services (DANS) · Cited by 130
On the impact of code smells on the energy consumption of mobile applications
Palomba, F., Nucci, D. D., Panichella, A., Zaidman, A., & Lucia, A. D. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.08.004 · Cited by 129
Self-citationBeyond Technical Aspects: How Do Community Smells Influence the Intensity of Code Smells?
Palomba, F., Tamburri, D. A., Fontana, F. A., Oliveto, R., Zaidman, A., & Serebrenik, A. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2883603 · Cited by 127
Self-citationA review of code smell mining techniques
Rasool, G., & Arshad, Z. (2015) · Journal of Software Evolution and Process · doi:10.1002/smr.1737 · Cited by 126
A Developer Centered Bug Prediction Model
Nucci, D. D., Palomba, F., Rosa, G. D., Bavota, G., Oliveto, R., & Lucia, A. D. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2659747 · Cited by 124
Self-citationThe Effects of Test-Driven Development on External Quality and Productivity: A Meta-Analysis
Rafique, Y., & Mišić, V. B. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.28 · Cited by 121
Context is king: The developer perspective on the usage of static analysis tools
Vassallo, C., Panichella, S., Palomba, F., Proksch, S., Zaidman, A., & Gall, H. C. (2018) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330195 · Cited by 115
Self-citationA large-scale empirical study on the lifecycle of code smell co-occurrences
Palomba, F., Bavota, G., Penta, M. D., Fasano, F., Oliveto, R., & Lucia, A. D. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.02.004 · Cited by 112
Self-citationToward a Smell-Aware Bug Prediction Model
Palomba, F., Zanoni, M., Fontana, F. A., Lucia, A. D., & Oliveto, R. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2770122 · Cited by 111
Self-citationUsing Cohesion and Coupling for Software Remodularization: Is It Enough?
Candela, I., Bavota, G., Russo, B., & Oliveto, R. (2016) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2928268 · Cited by 106
Proceedings of the 28th International Conference on Program Comprehension
(2020) · doi:10.1145/3387904 · Cited by 104
How developers perceive smells in source code: A replicated study
Taibi, D., Janes, A., & Lenarduzzi, V. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2017.08.008 · Cited by 100
Beecham, S., Kitchenham, B., & MacDonell, S. G. (2016) · doi:10.1145/2915970 · Cited by 93
Using tabu search to configure support vector regression for effort estimation
Corazza, A., Martino, S. D., Ferrucci, F., Gravino, C., Sarro, F., & Mendes, E. (2011) · Empirical Software Engineering · doi:10.1007/s10664-011-9187-3 · Cited by 90
The Impact of Classifier Configuration and Classifier Combination on Bug Localization
Thomas, S. W., Nagappan, M., Blostein, D., & Hassan, A. E. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.27 · Cited by 87
Integration between requirements engineering and safety analysis: A systematic literature review
Vilela, J., Castro, J., Martins, L. E. G., & Gorschek, T. (2016) · Journal of Systems and Software · doi:10.1016/j.jss.2016.11.031 · Cited by 86
Understanding the longevity of code smells
Arcoverde, R., Garcia, A., & Figueiredo, E. (2011) · doi:10.1145/1984732.1984740 · Cited by 85
What recommendation systems for software engineering recommend: A systematic literature review
Gašparič, M., & Janes, A. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2015.11.036 · Cited by 85
Discovering community patterns in open-source: a systematic approach and its evaluation
Tamburri, D. A., Palomba, F., Serebrenik, A., & Zaidman, A. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9659-9 · Cited by 84
Self-citationHow is video game development different from software development in open source?
Pascarella, L., Palomba, F., Penta, M. D., & Bacchelli, A. (2018) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3196398.3196418 · Cited by 78
Self-citationDynamic Selection of Classifiers in Bug Prediction: An Adaptive Method
Nucci, D. D., Palomba, F., Oliveto, R., & Lucia, A. D. (2017) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2699224 · Cited by 72
Self-citationCross-project Defect Prediction A Large Scale Experiment on Data vs. Domain vs. Process
Zimmermann, T., Gall, H., Giger, E., et al. (2010) · Cited by 72
Automatic test case generation: what if test code quality matters?
Palomba, F., Panichella, A., Zaidman, A., Oliveto, R., & de Lucia, A. (2016) · International Symposium on Software Testing and Analysis · doi:10.1145/2931037.2931057 · Cited by 70
Self-citationThe Scent of a Smell: An Extensive Comparison Between Textual and Structural Smells
Palomba, F., Panichella, A., Zaidman, A., Oliveto, R., & Lucia, A. D. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2752171 · Cited by 70
Self-citationAntoine, J.-Y., Villaneau, J., & Lefeuvre, A. (2014) · Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-1058 · Cited by 64
Enhancing change prediction models using developer-related factors
Catolino, G., Palomba, F., Lucia, A. D., Ferrucci, F., & Zaidman, A. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.05.003 · Cited by 62
Self-citationThe scent of a smell: an extensive comparison between textual and structural smells
Palomba, F., Panichella, A., Zaidman, A., Oliveto, R., & Lucia, A. D. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3180155.3182530 · Cited by 57
Self-citationSearch-Based Refactoring: Metrics Are Not Enough
Simons, C., Singer, J., & White, D. R. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22183-0_4 · Cited by 53
On the use of developers’ context for automatic refactoring of software anti-patterns
Morales, R., Soh, Z., Khomh, F., Antoniol, G., & Chicano, F. (2016) · Journal of Systems and Software · doi:10.1016/j.jss.2016.05.042 · Cited by 50
Khan, S. U., & Azeem, M. I. (2014) · IET Software · doi:10.1049/iet-sen.2013.0012 · Cited by 49
Self-citationContinuous code quality: are we (really) doing that?
Vassallo, C., Palomba, F., Bacchelli, A., & Gall, H. C. (2018) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3238147.3240729 · Cited by 44
Self-citationOn the Effectiveness of Concern Metrics to Detect Code Smells: An Empirical Study
Padilha, J., Pereira, J. A., Figueiredo, E., Almeida, J. M., Garcia, A., & Sant’Anna, C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07881-6_44 · Cited by 35
Bad Smells in Software Product Lines: A Systematic Review
Vale, G., Figueiredo, E., Abilio, R., & Costa, H. A. X. (2014) · Brazilian Symposium on Software Components, Architectures, and Reuse (SBCARS) · doi:10.1109/sbcars.2014.21 · Cited by 30
Mining file histories: should we consider branches?
Kovalenko, V., Palomba, F., & Bacchelli, A. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238169 · Cited by 28
Self-citationDeveloping Fault-Prediction Models: What the Research Can Show Industry
Hall, T., Beecham, S., Bowes, D., Gray, D. H., & Counsell, S. (2011) · IEEE Software · doi:10.1109/ms.2011.138 · Cited by 27
Continuous Refactoring in CI: A Preliminary Study on the Perceived Advantages and Barriers
Vassallo, C., Palomba, F., & Gall, H. C. (2018) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2018.00068 · Cited by 25
Self-citationOn the Use of Ontologies in Software Process Assessment
Tarhan, A., & Giray, G. (2017) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3084226.3084261 · Cited by 21
Developer-Related Factors in Change Prediction: An Empirical Assessment
Catolino, G., Palomba, F., Lucia, A. D., Ferrucci, F., & Zaidman, A. (2017) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2017.19 · Cited by 21
Self-citationSelf-reported activities of Android developers
Pascarella, L., Geiger, F.-X., Palomba, F., Nucci, D. D., Malavolta, I., & Bacchelli, A. (2018) · IEEE/ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft) · doi:10.1145/3197231.3197251 · Cited by 20
Self-citationEnsemble techniques for software change prediction: A preliminary investigation
Catolino, G., & Ferrucci, F. (2018) · IEEE Workshop on Machine Learning Techniques for Software Quality Evaluation (MaLTeSQuE) · doi:10.1109/maltesque.2018.8368455 · Cited by 20
Framing program comprehension as fault localization
Perez, A., & Abreu, R. (2016) · Journal of Software Evolution and Process · doi:10.1002/smr.1799 · Cited by 10
Evaluating the adaptive selection of classifiers for cross-project bug prediction
Nucci, D. D., Palomba, F., & Lucia, A. D. (2018) · International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE) · doi:10.1145/3194104.3194112 · Cited by 9
Self-citation
Cited by
Research and application of machine learning for additive manufacturing
Qin, J., Hu, F., Liu, Y., Witherell, P., Wang, C. C. L., Rosen, D. W., Simpson, T. W., Lu, Y., & Tang, Q. (2022) · Additive Manufacturing · doi:10.1016/j.addma.2022.102691 · Cited by 391
Giray, G. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111031 · Cited by 187
Predicting Design Impactful Changes in Modern Code Review: A Large-Scale Empirical Study
Uchoa, A., Barbosa, C., Coutinho, D., Oizumi, W., Assuncao, W. K. G., Vergilio, S. R., Pereira, J. A., Oliveira, A., & Garcia, A. (2021) · 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr52588.2021.00059 · Cited by 42
Moreb, M., Mohammed, T. A., & Bayat, O. (2020) · IEEE Access · doi:10.1109/access.2020.2970178 · Cited by 39
Metadata
- Authors
- Azeem, M. I., Palomba, F., Shi, L., & Wang, Q.
- Venue
- Information and Software Technology
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 108
- Pages
- 115-138
- ISSN
- 0950-5849 (ISSN-L)
- OpenAlex
- W2908058835
- Cited by
- 289
- References
- 120
- FWCI
- 5.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.