The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Code smells and refactoring: A tertiary systematic review of challenges and observations
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537
Systematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239
Systematic literature reviews in software engineering – A tertiary study
Kitchenham, B., Pretorius, R., Budgen, D., Pearl Brereton, O., Turner, M., Niazi, M., & Linkman, S. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.03.006 · Cited by 1,230
Selecting Empirical Methods for Software Engineering Research
Easterbrook, S., Singer, J., Storey, M.-A., & Damian, D. (2008) · Guide to Advanced Empirical Software Engineering · doi:10.1007/978-1-84800-044-5_11 · Cited by 1,167
How We Refactor, and How We Know It
Murphy-Hill, E., Parnin, C., & Black, A. P. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.41 · Cited by 547
Quantifying the Effect of Code Smells on Maintenance Effort
Sjoberg, D. I. K., Yamashita, A., Anda, B. C. D., Mockus, A., & Dyba, T. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.89 · Cited by 316
Behutiye, W. N., Rodríguez, P., Oivo, M., & Tosun, A. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2016.10.004 · Cited by 116
Use, disuse, and misuse of automated refactorings
Vakilian, M., Chen, N., Negara, S., Rajkumar, B. A., Bailey, B. P., & Johnson, R. E. (2012) · 2012 34th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2012.6227190 · Cited by 106
Centre for Reviews and Dissemination
(2009) · Nursing Standard · doi:10.7748/ns2009.10.24.6.30.p4606 · Cited by 24
Research works printed but not linked: 73
- Abebe, 2014, Classification and summarization of software refactoring researches: a literature review approach, 279
- Abebe, 2014, Trends, opportunities and challenges of software refactoring: a systematic literature review, Int. J. Softw. Eng. Appl., 8, 299
- Al Dallal, 2012, Constructing models for predicting extract subclass refactoring opportunities using object-oriented quality metrics, Inf. Softw. Technol., 54, 1125, 10.1016/j.infsof.2012.04.004 · DOI
- Al Dallal, 2015, Identifying refactoring opportunities in object-oriented code: a systematic literature review, Inf. Softw. Technol., 58, 231, 10.1016/j.infsof.2014.08.002 · DOI
- Al Dallal, 2018, Empirical evaluation of the impact of object-Oriented code refactoring on quality attributes: a systematic literature review, IEEE Trans. Softw. Eng., 44, 44, 10.1109/TSE.2017.2658573 · DOI
- Ali, 2014, A systematic literature review of code clone prevention approaches, Int. J. Softw. Eng., 1, 1
- Alkharabsheh, 2018, Software design smell detection: a systematic mapping study, Softw. Qual. J.
- Alves, 2016, Identification and management of technical debt: asystematic mapping study, Inf. Softw. Technol., 70, 100, 10.1016/j.infsof.2015.10.008 · DOI · Paper page
- Bansiya, 2002, A hierarchical model for object-oriented design quality assessment, IEEE Trans. Softw. Eng., 28, 4, 10.1109/32.979986 · DOI · Paper page
- Barrett, 1995, Knowledge elicitation and knowledge representation in a large domain with multiple experts, Expert Syst. Appl., 8, 169, 10.1016/0957-4174(94)E0007-H · DOI
- Besker, 2018, Managing architectural technical debt: a unified model and systematic literature review, J. Syst. Softw., 135, 1, 10.1016/j.jss.2017.09.025 · DOI
- Cairo, 2018, The impact of code smells on software bugs: a systematic literature review, J. Inf. Sci. Technol.Eng., 9, 1
- Canfora, 2011, Achievements and challenges in software reverse engineering, Commun. ACM, 54, 142, 10.1145/1924421.1924451 · DOI
- Chatzigeorgiou, 2017, Identifying extract method refactoring opportunities based on functional relevance, IEEE Trans. Softw. Eng., 43, 1
- Dig, 2017, The landscape of refactoring research in the last decade (keynote), SIGPLAN Not., 52, 10.1145/3170492.3148040 · DOI
- Fernandes, 2016, A review-based comparative study of bad smell detection tools, 1
- Garousi, 2016, Highly-cited papers in software engineering: the top-100, Inf. Softw. Technol., 71, 108, 10.1016/j.infsof.2015.11.003 · DOI
- Garousi, 2016, Highly-cited papers in software engineering: the top-100, Inf. Softw. Technol., 71, 108, 10.1016/j.infsof.2015.11.003 · DOI
- Garousi, 2019, Closing the gap between software engineering education and industrial needs, IEEE Software
- Garousi, 2018, Smells in software test code: a survey of knowledge in industry and academia, J. Syst. Softw., 138, 52, 10.1016/j.jss.2017.12.013 · DOI · Paper page
- Garousi, 2016, A systematic literature review of literature reviews in software testing, Inf. Softw. Technol., 80, 195, 10.1016/j.infsof.2016.09.002 · DOI · Paper page
- Garousi, 2019, Characterizing industry-academia collaborations in software engineering: evidence from 101 projects, Empir. Softw. Eng., 10.1007/s10664-019-09711-y · DOI
- Garousi, 2019, Successful engagement of practitioners and software engineering researchers: Evidence from 26 international industry-academia collaborative projects, IEEE Software
- Goldman, 2004, Being extreme in the classroom: experiences teaching xp, J. Braz. Comput. Soc., 10, 4, 10.1007/BF03192356 · doi:10.1007/bf03192356
- Goues, 2018, Bridging the gap: from research to practical advice, IEEE Softw., 35, 50, 10.1109/MS.2018.3571235 · doi:10.1109/ms.2018.3571235
- GRADIŠNIKMITJA and HERIČKO, 2018, Impact of code smells on the rate of defects in software: a literature review, 1
- Griswold, 2015, The birth of refactoring: a retrospective on the nature of high-impact software engineering research, IEEE Softw., 32, 30, 10.1109/MS.2015.107 · DOI
- Gupta, 2017, A systematic literature review: code bad smells in java source code, 665
- Haendler, 2019, Serious refactoring games, 1, 10.24251/HICSS.2019.927 · DOI
- Hall, 2014, Some code smells have a significant but small effect on faults, ACM Trans. Softw. Eng. Methodol., 23, 33:1, 10.1145/2629648 · DOI · Paper page
- Highsmith, 2001, The agile manifesto, Softw. Dev. Mag., 9, 29
- Hoda, 2017, Systematic literature reviews in agile software development: a tertiary study, Inf. Softw. Technol., 85, 60, 10.1016/j.infsof.2017.01.007 · DOI · Paper page
- Hozano, 2018, Are you smelling it? Investigating how similar developers detect code smells, Inf. Softw. Technol., 93, 130, 10.1016/j.infsof.2017.09.002 · DOI
- Khan, 2019, Landscaping systematic mapping studies in software engineering: a tertiary study, J. Syst. Softw., 149, 396, 10.1016/j.jss.2018.12.018 · DOI
- Khomh, 2012, An exploratory study of the impact of antipatterns on class change- and fault-proneness, Empir. Softw. Eng., 17, 243, 10.1007/s10664-011-9171-y · DOI · Paper page
- Kruchten, 2012, Technical debt: from metaphor to theory and practice, IEEE Softw., 29, 18, 10.1109/MS.2012.167 · DOI · Paper page
- Laguna, 2013, A systematic mapping study on software product line evolution: from legacy system reengineering to product line refactoring, Sci. Comput. Program., 78, 1010, 10.1016/j.scico.2012.05.003 · DOI
- Leppänen, 2015, Refactoring - a shot in the dark?, IEEE Softw., 32, 62, 10.1109/MS.2015.132 · doi:10.1109/ms.2015.132
- Li, 2015, A systematic mapping study on technical debt and its management, J. Syst. Softw., 101, 193, 10.1016/j.jss.2014.12.027 · DOI · Paper page
- Mariani, 2017, A systematic review on search-based refactoring, Inf. Softw. Technol., 83, 14, 10.1016/j.infsof.2016.11.009 · DOI
- Mens, 2003, Refactoring: Current research and future trends, Electronic Notes in Theoretical Computer Science, 82, 483, 10.1016/S1571-0661(05)82624-6 · doi:10.1016/s1571-0661(05)82624-6
- Mens, 2004, A survey of software refactoring, IEEE Trans. Softw. Eng., 30, 126, 10.1109/TSE.2004.1265817 · DOI · Paper page
- Misbhauddin, 2015, UML model refactoring: a systematic literature review, Empir. Softw. Eng., 20, 206, 10.1007/s10664-013-9283-7 · DOI
- Moha, 2010, Decor: a method for the specification and detection of code and design smells, IEEE Trans. Softw. Eng., 10.1109/TSE.2009.50 · DOI · Paper page
- Mohan, 2018, A survey of search-based refactoring for software maintenance, J. Softw. Eng. Res.Dev., 6, 3, 10.1186/s40411-018-0046-4 · doi:10.1186/s40411-018-0046-4
- Nurdiani, 2016, The impacts of agile and lean practices on project constraints: a tertiary study, J. Syst. Softw., 119, 162, 10.1016/j.jss.2016.06.043 · DOI
- d. P. Sobrinho, 2018, A systematic literature review on bad smells – 5 w’s: which, when, what, who, where, IEEE Transactions on Software Engineering
- Pate, 2013, Clone evolution: a systematic review, J. Softw., 25, 261
- Petersen, 2015, Guidelines for conducting systematic mapping studies in software engineering: an update, Inf. Softw. Technol., 64, 1, 10.1016/j.infsof.2015.03.007 · DOI · Paper page
- Piveta, 2006, Detecting bad smells in aspectj, JUCS, 12, 811
- Rasool, 2015, A review of code smell mining techniques, J. Softw., 27, 867
- Rattan, 2013, Software clone detection: a systematic review, Inf. Softw. Technol., 55, 1165, 10.1016/j.infsof.2013.01.008 · DOI · Paper page
- Rios, 2018, A tertiary study on technical debt: types, management strategies, research trends, and base information for practitioners, Inf. Softw. Technol., 102, 117, 10.1016/j.infsof.2018.05.010 · DOI · Paper page
- Rochimah, 2015, Non-Source code refactoring: A Systematic literature review, Int. J. Softw. Eng. and Its Applications, 9, 197, 10.14257/ijseia.2015.9.6.19 · doi:10.14257/ijseia.2015.9.6.19
- Sabir, 2018, A systematic literature review on the detection of smells and their evolution in object-oriented and service-oriented systems, Software, 49, 1
- Sandalski, 2011, Development of a refactoring learning environment, Cybern. Inf. Technol., 11
- Santos, 2018, A systematic review on the code smell effect, J. Syst. Softw., 144, 450, 10.1016/j.jss.2018.07.035 · DOI
- dos Santos Neto, 2015, Autorefactoring: a platform to build refactoring agents, Expert Syst. Appl., 42, 1652, 10.1016/j.eswa.2014.09.022 · DOI
- Sharma, 2018, A survey on software smells, J. Syst. Softw., 138, 158, 10.1016/j.jss.2017.12.034 · DOI · Paper page
- Sheneamer, 2016, A survey of software clone detection techniques, Int. J. Comput. Appl., 137, 975
- Sidhu, 2018, Refactoring UML models of object-oriented software: a systematic review, Int. J. Softw. Eng. Knowl. Eng., 28, 1287, 10.1142/S0218194018500365 · doi:10.1142/s0218194018500365
- da Silva, 2011, Six years of systematic literature reviews in software engineering: An updated tertiary study, Information and Software Technology, 53, 899, 10.1016/j.infsof.2011.04.004 · DOI · Paper page
- Singh, 2018, Identifying various code-smells and refactoring opportunities in object-oriented software system : a systematic literature review, Int. J. Fut. Revol.Comput. Sci. Commun. Eng., 8, 62
- Singh, 2017, A systematic literature review: refactoring for disclosing code smells in object oriented software, Ain Shams Eng. J.
- Taibi, 2017, How developers perceive smells in source code: areplicated study, Inf. Softw. Technol., 92, 223, 10.1016/j.infsof.2017.08.008 · DOI
- Telea, 2011, Visual software analytics for the build optimization of large-scale software systems, Comput. Stat., 26, 635, 10.1007/s00180-011-0248-2 · doi:10.1007/s00180-011-0248-2
- Tempero, 2017, Barriers to refactoring, Commun. ACM, 60, 54, 10.1145/3131873 · DOI
- Terra, 2018, JMove: a novel heuristic and tool to detect move method refactoring opportunities, J. Syst. Softw., 138, 19, 10.1016/j.jss.2017.11.073 · DOI
- Vale, 2014, Bad smells in software product lines: a systematic review, 84
- Welf Löwe, 2005, Rapid construction of software comprehension tools, Int. J. Software Eng. Knowl. Eng., 15, 995, 10.1142/S0218194005002622 · doi:10.1142/s0218194005002622
- Wohlin, 2007, An analysis of the most cited articles in software engineering journals - 2000, Information and Software Technology, 49, 2, 10.1016/j.infsof.2006.08.004 · DOI
- Wohlin, 2008, An analysis of the most cited articles in software engineering journals – 2001, Information and Software Technology, 50, 3, 10.1016/j.infsof.2007.10.002 · doi:10.1016/j.infsof.2007.10.002
- Zhang, 2011, Code bad smells: a review of current knowledge, Journal of Software Maintenance and Evolution: Research and Practice, 23, 179, 10.1002/smr.521 · DOI · Paper page
Cited by
Borg, M., Tornhill, A., & Mones, E. (2023) · Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/3593434.3593480 · Cited by 18
Echoes of AI: Investigating the downstream effects of AI assistants on software maintainability
Borg, M., Hewett, D., Hagatulah, N., Couderc, N., Söderberg, E., Graham, D., Kini, U., & Farley, D. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10889-1 · Cited by 4
Metadata
- Authors
- Lacerda, G., Petrillo, F., Pimenta, M., & Guéhéneuc, Y. G.
- Venue
- Journal of Systems and Software
- Publisher
- Elsevier BV
- Published
- 2020-09
- Volume
- 167
- Pages
- 110610
- ISSN
- 0164-1212 (ISSN-L)
- OpenAlex
- W3020617474
- Cited by
- 220
- References
- 9
- FWCI
- 4.65
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Code smells and refactoring: A tertiary systematic review of challenges and observations. https://app.cochat.ai/papers/10.1016/j.jss.2020.110610
- The paper
- Lacerda, G., Petrillo, F., Pimenta, M., & Guéhéneuc, Y. G. (2020). Code smells and refactoring: A tertiary systematic review of challenges and observations. Journal of Systems and Software. https://doi.org/10.1016/j.jss.2020.110610
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.