Measuring Program Comprehension: A Large-Scale Field Study with Professionals
The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Abstract
During software development and maintenance, developers spend a considerable amount of time on program comprehension activities. Previous studies show that program comprehension takes up as much as half of a developer's time. However, most of these studies are performed in a controlled setting, or with a small number of participants, and investigate the program comprehension activities only within the IDEs. However, developers' program comprehension activities go well beyond their IDE interactions. In this paper, we extend our ActivitySpace framework to collect and analyze Human-Computer Interaction (HCI) data across many applications (not just the IDEs). We follow Minelli et al.'s approach to assign developers' activities into four categories: navigation, editing, comprehension, and other. We then measure the comprehension time by calculating the time that developers spend on program comprehension, e.g., inspecting console and breakpoints in IDE, or reading and understanding tutorials in web browsers. Using this approach, we can perform a more realistic investigation of program comprehension activities, through a field study of program comprehension in practice across a total of seven real projects, on 78 professional developers, and amounting to 3,148 working hours. Our study leverages interaction data that is collected across many applications by the developers. Our study finds that on average developers spend ~58 percent of their time on program comprehension activities, and that they frequently use web browsers and document editors to perform program comprehension activities. We also investigate the impact of programming language, developers' experience, and project phase on the time that is spent on program comprehension, and we find senior developers spend significantly less percentages of time on program comprehension than junior developers. Our study also highlights the importance of several research directions needed to reduce program comprehension time, e.g., building automatic detection and improvement of low quality code and documentation, construction of software-engineering-specific search engines, designing better IDEs that help developers navigate code and browse information more efficiently, etc.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,042
An analysis of variance test for normality (complete samples)
SHAPIRO, S. S., & WILK, M. B. (1965) · Biometrika · doi:10.1093/biomet/52.3-4.591 · Cited by 23,480
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Software engineering: A practitioner's approach
(1983) · Advances in Engineering Software (1978) · doi:10.1016/0141-1195(83)90118-3 · Cited by 8,234
Refactoring: Improving the Design of Existing Code
Fowler, M. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45672-4_31 · Cited by 5,591
Manifesto for agile software development
Beck, K., Beedle, M., van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., & Thomas, D. A. (2001) · Cited by 4,284
Dual-task interference in simple tasks: data and theory
Pashler, H. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.2.220 · Cited by 3,112
Refactoring improving the design of existing code
Saca, M. A. (2017) · 2017 IEEE 37th Central America and Panama Convention (CONCAPAN XXXVII) · doi:10.1109/concapan.2017.8278488 · Cited by 2,054
The psychology of computer programming
(1999) · Choice Reviews Online · doi:10.5860/choice.36-4535 · Cited by 962
Research works printed but not linked: 3
- whitaker, 1999, What causes IT workers to leave, Manag Rev, 88, 8
- spencer, 2009, Card Sorting Designing Usable Categories
- fjeldstad, 1983, Application program maintenance study: Report to our respondents, Proc GUIDE
Cited by
Items 201–300 of 325
Component Comprehension in Context
Heinonen, A. (2023) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/3573074.3573086 · Cited by 2
Query expansion using novel use case scenario relationship for finding feature location
Arwan, A., Rochimah, S., & Fatichah, C. (2023) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v13i5.pp5501-5516 · Cited by 3
ArCode: A Tool for Supporting Comprehension and Implementation of Architectural Concerns
Shokri, A., & Mirakhorli, M. T. (2021) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc52881.2021.00056 · Cited by 2
The neural bases of program comprehension: a coordinate-based fMRI meta-analysisPreprint
Ikutani, Y., Itoh, T., & Kubo, T. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.15.439937 · Cited by 3
Lavazza, L., Abualkishik, A. Z., Liu, G., & Morasca, S. (2022) · doi:10.31219/osf.io/2mbwe · Cited by 2
Code2tree: A Method for Automatically Generating Code Comments
Wen, W., Chu, J., Zhao, T., Zhang, R., Zhi, B., & Shen, C. (2022) · Scientific Programming · doi:10.1155/2022/6350686 · Cited by 3
Developer's Cognitive Effort Maintaining Monoliths vs. Microservices - An Eye-Tracking Study
Simhandl, G., Paulweber, P., & Zdun, U. (2023) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec60848.2023.00044 · Cited by 5
PRECOS: Project-specific Retrieval for Better Code Summarization
Zhu, T., Li, Z., Zhang, T. Y., Pan, M., & Li, X. (2024) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58944.2024.00051 · Cited by 1
Pereira-Vale, A., Vera, T., Vásquez, C., Perovich, D., Simmonds, J., & Ochoa, S. F. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107738 · Cited by 1
Towards Detecting Comment-Code Inconsistency in Smart Contract via Pre-Training Techniques
Liu, X., Hao, S., Yang, L., & Shi, X. (2024) · IEEE International Conference on Security, Privacy, Anonymity in Computation, Communication and Storage (SpaCCS) · doi:10.1109/spaccs63173.2024.00013 · Cited by 1
Learning from Mistakes: Understanding Ad-hoc Logs through Analyzing Accidental Commits
Chou, Y.-H., Min, Y., Wang, A. Y., & Jones, J. (2025) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr66628.2025.00017 · Cited by 4
Identifying Students' Code Quality Defects while Contributing to Large Code Bases
Shah, A., Rexin, T., Allen-Perez, G., Wu, K., Griswold, W. G., & Raj, A. G. S. (2025) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3724363.3729074 · Cited by 3
Shenoy, M., & Rausch, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04403-7_13 · Cited by 2
Tracing vs. comprehension: On different levels of understanding Boolean expressions
Bar-On, A. Z., & Feitelson, D. G. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10818-2 · Cited by 1
TriGraSum: A Tri-level Graph-based Architecture for Source Code Summarization
Hu, R.-G., Wang, D.-Q., Xie, M., Li, Z.-L., & Chen, D.-M. (2025) · Asia-Pacific Software Engineering Conference · doi:10.1109/apsec66846.2025.00104 · Cited by 1
CodeVoyager: Integrating Interactive Visual Aids with LLMs for Code Comprehension
Kim, Y., Jang, K., Song, H., Shin, M., & Suh, B. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789057 · Cited by 3
The impact of contextual information on parameter description generation: An empirical study
Chen, X., Lin, P., Peng, R., Huang, Y., & Zhou, X. (2026) · Science of Computer Programming · doi:10.1016/j.scico.2026.103524 · Cited by 1
A Study of Debugging Sequence on Multi-Bug Program
Liu, H., Liu, W., Zhou, Y., Li, X., & Cheng, W. (2021) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale52509.2021.9678847 · Cited by 1
Robledo, C., Sallicati, F., de Chalendar, G., Fernández, M., Manzano, P. D. C., Martín, E., Gutiérrez, J., & Bouachera, Y. (2022) · Open Research Europe · doi:10.12688/openreseurope.14507.1 · Cited by 1
Avaliação de Modelos Neurais para Sumarização de Código-fonte
Pontes, L. B. L., Oliveira, H., & Boldt, F. D. A. (2022) · Anais do Seminário Integrado de Software e Hardware (SEMISH) · doi:10.5753/semish.2022.223154 · Cited by 1
Improving Just-In-Time Comment Updating via AST Edit Sequence
Huang, J., Yu, H., Fan, G., Zhou, Z., & Li, M. (2022) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194022500516 · Cited by 1
API + code = better code summary? insights from an exploratory study
Sarmah, P. P., & Chimalakonda, S. (2022) · doi:10.1145/3558489.3559075 · Cited by 1
Mi, Q., Wang, L., Hu, L., Ou, L., & Yu, Y. (2022) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194022500656 · Cited by 2
Code Summarization Through Learning Linearized AST Paths with Transformer
Tian, Z., Zhang, C., & Tian, B. (2023) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-20738-9_7 · Cited by 2
Leveraging Comment Retrieval for Code Summarization
Hou, S., Chen, L., Ju, M., & Ye, Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-28238-6_34 · Cited by 2
Enhancing source code summarization from structure and semantics
Lu, X., & Niu, J. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191872 · Cited by 2
A Semantic and Structural Transformer for Code Summarization Generation
Ji, R., Tong, Z., Luo, T., Liu, J., & Zhang, L. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191735 · Cited by 1
Wang, J., Tang, G., & Wang, Y. (2023) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa59317.2023.00115 · Cited by 1
“C”ing the light – assessing code comprehension in novice programmers using C code patterns
Glasauer, C., Yeh, M. K. ‐., DeLong, L. A., Yu, Y., & Zhuang, Y. (2024) · Computer Science Education · doi:10.1080/08993408.2024.2317079 · Cited by 2
Allen, J. A., & Kelleher, C. L. (2024) · International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) · doi:10.1145/3641822.3641864 · Cited by 4
ASKDetector: An AST-Semantic and Key Features Fusion based Code Comment Mismatch Detector
Yang, H., Chen, H., Kuai, Z., Tu, S., & Kuang, L. (2024) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3643916.3644405 · Cited by 1
Leveraging Generative Artificial Intelligence for Software Antipattern Detection
Miño, J., Andrade, R., Torres, J., & Chicaiza, K. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-64359-0_11 · Cited by 1
Feijó, D. N., de Almeida, C. D. A., & Rocha, L. S. (2024) · Journal of Software Engineering Research and Development · doi:10.5753/jserd.2024.4118 · Cited by 1
An alternative to code comment generation? Generating comment from bytecode
Chen, X., Chen, J., Lian, Z., Huang, Y., Zhou, X., Wu, Y., & Zheng, Z. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107623 · Cited by 3
Nishikawa, K., Koreki, G., & Kanuka, H. (2024) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec65559.2024.00061 · Cited by 2
On the Effects of Developers' Intuition on Measuring Similarity Between UML Models
Gonçales, L. J., Farias, K., & Bischoff, V. (2019) · Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI) · doi:10.1145/3330204.3330238 · Cited by 1
Research Publication Trends in Software Engineering
Sahito, S. F., Gilal, A. R., Abro, R. A., Waqas, A., & Shaikh, K. (2019) · International Conference on Mathematics, Actuarial Science, Computer Science and Statistics (MACS) · doi:10.1109/macs48846.2019.9024767 · Cited by 1
Lightweight Fault Localization using Weighted Dynamic Control Flow Subgraph
Wang, Y., SanMing, L., Li, J., Cheng, X., & Zhou, W. (2020) · International Journal of Performability Engineering · doi:10.23940/ijpe.20.02.p6.214222 · Cited by 1
A quantitative benefit evaluation of code search platform for enterprises
Shi, Z., Tang, J., Yu, H. C., Xing, Y., Liu, Z., Bai, W., & Li, T. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2831-6 · Cited by 1
Combining Biometric Data with Focused Document Types Classifies a Success of Program Comprehension
Ishida, T., Uwano, H., & Ikutani, Y. (2020) · International Conference on Program Comprehension · doi:10.1145/3387904.3389291 · Cited by 1
Influencing Factors Analysis and Evaluation for Undergraduate Programming Ability
Wang, J., Wang, Y., & Wang, X. (2021) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c55045.2021.00047 · Cited by 1
Suggesting method names based on graph neural network with salient information modelling
Kuang, L., Ge, F., & Zhang, L. (2022) · Expert Systems · doi:10.1111/exsy.13030 · Cited by 2
An Empirical Study on Code Comment Completion
Mastropaolo, A., Aghajani, E., Pascarella, L., & Bavota, G. (2021) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.26226/morressier.613b5418842293c031b5b5da · Cited by 34
Live Visualization of Dynamic Software Cities with Heat Map Overlays
Krause, A., Hansen, M., & Hasselbring, W. (2021) · doi:10.26226/morressier.613b545d842293c031b5b992 · Cited by 1
2019 Index IEEE Transactions on Software Engineering Vol. 45
(2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2960169
[Journal First] Measuring Program Comprehension: A Large-Scale Field Study with Professionals
Xia, X., Bao, L., Lo, D., Xing, Z., Hassan, A. E., & Li, S. (2018)
Self-citationEGAN: An Effective Code Readability Classification using Ensemble Generative Adversarial Networks
Sharma, S., & Srivastava, S. (2020) · International Conference on Computation, Automation and Knowledge Management (ICCAKM) · doi:10.1109/iccakm46823.2020.9051555 · Cited by 1
A new technique for understanding large-scale software systems
Al-Rousan, T., & Abualese, H. (2020) · Telfor Journal · doi:10.5937/telfor2001034a
Discovery of Event-Related Potentials during a Cognitive Process of Comparison Operation
Murai, K., Uwano, H., Ikutani, Y., & Kubo, T. (2020) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)
Code Comprehension Confounders: A Study of Intelligence and PersonalPreprint
Wagner, S., & Wyrich, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.13546
SABER: Identifying SimilAr BEhavioR for Program Comprehension
Sridhar, A., Qiao, G., & Kaiser, G. E. (2020)
Program Comprehension Technique in Teaching and Leaning: A Cognitive Perspective
Kadar, R., Sumari, P., Othman, J., & Yusoff, S. A. M. (2021) · International Journal of Academic Research in Progressive Education and Development · doi:10.6007/ijarped/v10-i3/11570
Code Generation with Hybrid of Structural and Semantic Features Retrieval
Yang, K., Yu, H., Fan, G., Huang, Z., & Zhou, Z. (2022) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194022500267
Combining Global and Local Representations of Source Code for Method Naming
Zhou, C., & Kuang, L. (2022) · IEEE International Conference on Engineering of Complex Computer Systems (ICECCS) · doi:10.1109/iceccs54210.2022.00026
Wijendra, D., & Hewagamage, K. P. (2022) · Journal of ICT Research and Applications · doi:10.5614/itbj.ict.res.appl.2022.16.3.6
Improving Programming Q&A with Neural Generative Augmentation
Chaidaroon, S., Zhang, X., Subramaniyam, S., Svajlenko, J., Shourya, T., Keivanloo, I., & Joy, R. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591860
G-DCS: GCN-Based Deep Code Summary Generation Model
Du, C. D. C., Du, Y., & Li, M. W. Y. (2023) · 網際網路技術學刊 · doi:10.53106/160792642023072404014
(2023) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets43691
Enhancing Smart Contract Security: Assessing Vulnerability with Code Complexity MetricsPreprint
Jamshidiyantehrani, M., & Hashemi, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4553042
An Empirical Study of Adversarial Training in Code Comment Generation
Shen, Y., Ju, X., Chen, X., & Yang, G. (2023) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2023-108
ПРОГРАМУВАННЯ ЗА ДОПОМОГОЮ СИСТЕМ ГЕНЕРАТИВНОГО ШТУЧНОГО ІНТЕЛЕКТУ: РИЗИКИ ТА ВИКЛИКИ
БОЙКО, В., Василенко, М. Д., & Слатвінська, В. М. (2023) · INFORMATION TECHNOLOGY AND SOCIETY · doi:10.32689/maup.it.2023.2.2 · Cited by 2
Enhancing Smart Contract Security: Assessing Vulnerability with Code Complexity MetricsPreprint
Jamshidiyantehrani, M., & Hashemi, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4591953
An Exploratory Evaluation of Code Smell AgglomerationsPreprint
Santana, A., Figueiredo, E., Pereira, J. A., & Garcia, A. (2023) · Research Square · doi:10.21203/rs.3.rs-3486799/v1
Study on Automatic Code Summary Generation Method based on Graph Neural Network
Du, C., Li, Y., Wang, Y., & Yu, J. (2023) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa59317.2023.00015
Beyond Code: Is There a Difference between Comments in Visual and Textual Languages?Preprint
Boll, A., Rani, P., Schultheiß, A., & Kehrer, T. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4650661
Feature Location Using Extraction of Code Documentation
Arwan, A., Rochimah, S., & Fatichah, C. (2023) · International Conference on Sustainable Information Engineering and Technology (SIET) · doi:10.1145/3626641.3627149
Investigating the Relation between Code Comments and Issue Resolution Time in Java Repositories
Hamza, A. A., El‐Ramly, M., & ElKady, M. (2023) · International Conference on Intelligent Computing and Information Systems (ICICIS) · doi:10.1109/icicis58388.2023.10391201
Improving Code Summarization Performance with Model Fusion
Guo, Y., Su, H., Gao, H., & Sun, Q. (2023) · International Conference on Intelligent Design (ICID) · doi:10.1109/icid60307.2023.10396770
Fostering a natural language approach in programming education (Doctoral Consortium)
van der Werf, V. (2023) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3631802.3631838
Context-Focused Prompt Tuning Pre-Trained Code Models to Improve Code Summarization
Pan, X., Liu, C., Zou, Y., Zhao, X., & Xie, B. (2024) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac61105.2024.00177 · Cited by 3
Profiling Software Developers: Fingerprints and textual abstractions of software process smellsPreprint
Caldeira, J., Abreu, F. B. E., Cardoso, J., Ribeiro, R., & Werner, C. M. L. (2024) · doi:10.22541/au.172493465.54289190/v1
Co-Designing Web Interfaces for Code Comparison
Middleton, J., Patil, N., & Stolee, K. T. (2024) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc60511.2024.00029 · Cited by 2
Lee, G., Ju, H., & Lee, S. U.-J. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695056 · Cited by 4
Collaborative Design and Planning of Software Architecture Changes via Software City Visualization
Krause-Glau, A., Hansen, M., & Hasselbring, W. (2024) · IEEE Working Conference on Software Visualization (VISSOFT) · doi:10.1109/vissoft64034.2024.00030 · Cited by 2
User-centered Software Visualization Design for Professional Developers
Heidrich, D., & Schreiber, A. (2024) · IEEE Working Conference on Software Visualization (VISSOFT) · doi:10.1109/vissoft64034.2024.00019
Code Parameter Summarization Based on Transformer and Fusion Strategy
Zhang, F., Fan, J., Li, W., & Khoo, S. (2024) · IET Software · doi:10.1049/sfw2/3706673
A Retrospective on How Developers Seek, Relate, and Collect Information About Code
Ko, A. J., Myers, B. A., Coblenz, M. J., & Aung, H. H. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3534071 · Cited by 2
CodeQG: Automated Multiple Question Generation for Source Code Comprehension
Zhang, X., Chen, L., Qi, K., Zou, W., Pang, L., Zhang, L., Zhang, P., Xu, G., & Zhang, D. (2025) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194025500214
SCATCom: Code Comment Generation by Fusing Multi-Information
Wang, R., Zhou, J., Chen, X., Cui, Z., & Jiang, S. (2025) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194025500263
Michael, J., Uneputty, P. G., Enda, R. P., Santoso, H. B., Adianto, D., & Cenka, B. A. N. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93230-4_12
ComCat : Expertise-Guided Context Generation to Enhance Code Comprehension
Grandel, S., Andersen, S. T., Huang, Y., & Leach, K. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3742475 · Cited by 3
RAPRSUM: Retrieval-Augmented Code Summarization with Advanced Prototype Refinement
Lin, Y., Wang, X., Zhan, S., Wei, D., & Chen, B. (2025) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194025500317
Abdiukov, T. (2023) · World Journal of Advanced Engineering Technology and Sciences · doi:10.30574/wjaets.2023.9.1.0149
Is “notDone” the Same as “!done”? The Effect of Different Ways for Expressing Negation
Baron, A., & Feitelson, D. G. (2025) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3702652.3744213
Key-Augmented Neural Triggers for Knowledge SharingPreprint
Wolf, A., Palma, M. A., Rani, P., & Gall, H. C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5376750
A Machine Learning Approach to Analyze Patterns and Comments in Java Code using Python
Sharma, K., Gupta, M., Ahuja, R., Prawar, P., & Kumari, M. (2025) · WSEAS Transactions on Information Science and Applications archive · doi:10.37394/23209.2025.22.54
A tool for measuring program comprehensibility using readability-driven metrics
Rahman, M. M., Chowdhury, Z., & Rab, R. (2025) · Software Impacts · doi:10.1016/j.simpa.2025.100782 · Cited by 1
Qi, H., Funabiki, N., Wai, K. H., & Hendryanna, F. V. (2025) · Engineering headway · doi:10.4028/p-qu2uyk
The Impact of Generative AI on Developer Practices, Behavior, and Software Quality
Oertel, J., & Hebig, R. (2025) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme64153.2025.00097 · Cited by 1
CodeVoyager: An Interactive Tool for Rapid Code Comprehension through LLM-Assisted Graph Navigation
Kim, Y., Jang, K., Song, H., Shin, M., & Suh, B. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746058.3758378
Billah, M. M., Rahman, M. S., & Roy, B. (2025) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3756681.3756977 · Cited by 2
DevTales: A Tool for Providing Narrative Code Histories into Developer Workflows
Allen, J., Park, S., & Kelleher, C. L. (2025) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl-hcc65237.2025.00013 · Cited by 1
AI-Guided Exploration of Large-Scale Codebases
Alebachew, Y. B. (2025) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl-hcc65237.2025.00053
An Empirical Study of Test Code Summarization
Chen, Y., Chen, X., Huang, Y., & Zhou, X. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-3483-8_24
Identifier Name Similarities: An Exploratory Study
Wong, C., Abe, M., Benedictis, S. D., Halim, M., & Peruma, A. (2025) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem64174.2025.00034
Idris, H. S., Isah, O. M., Fasola, O. O., & Onwudebelu, U. (2026) · ITM Web of Conferences · doi:10.1051/itmconf/20268101005 · Cited by 2
Clara: A Developer’s Companion for Code Comprehension and Analysis
Adnan, A., Rahman, M., Noor, S. S., & Sakib, K. M. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00387 · Cited by 1
Process Management for Learning from Professional Source Code: Cultivating Experts in the Age of AI
Dasu, G., O’Rourke, E., Zhang, H., Whitely, M., Wilcox, R. G., Rosenberg, L., Mulat, M., Liu, J. L., & Brewster, N. (2026) · ACM Transactions on Computing Education · doi:10.1145/3796525 · Cited by 1
Wang, R., Chang, C., Chen, X., Tian, Y., & Huang, R. (2026) · Automated Software Engineering · doi:10.1007/s10515-026-00604-1
Metadata
- Authors
- Xia, X., Bao, L., Lo, D., Xing, Z., Hassan, A. E., & Li, S.
- Affiliations
- Zhejiang University (CN)
- Singapore Management University (SG)
- Australian National University (AU)
- Queen's University (CA)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2018-10-01
- Volume
- 44
- Issue
- 10
- Pages
- 951-976
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W2741561716
- Cited by
- 326
- References
- 64
- Citations by year
- 2026: 30 · 2025: 37 · 2024: 54 · 2023: 62 · 2022: 60 · 2021: 38 · 2020: 22 · 2019: 14 · 2018: 8
- FWCI
- 22.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion)
- Funders
- National Natural Science Foundation of China (61602403, 61572426)
- National Key Technology R&D Program
- Ministry of Science and Technology of China (2015BAH17F01)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- program comprehension, professional developers, developer experience, project phases, software maintenance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.