The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
On the Comprehension of Program Comprehension
Abstract
Research in program comprehension has evolved considerably over the past decades. However, only little is known about how developers practice program comprehension in their daily work. This article reports on qualitative and quantitative research to comprehend the strategies, tools, and knowledge used for program comprehension. We observed 28 professional developers, focusing on their comprehension behavior, strategies followed, and tools used. In an online survey with 1,477 respondents, we analyzed the importance of certain types of knowledge for comprehension and where developers typically access and share this knowledge. We found that developers follow pragmatic comprehension strategies depending on context. They try to avoid comprehension whenever possible and often put themselves in the role of users by inspecting graphical interfaces. Participants confirmed that standards, experience, and personal communication facilitate comprehension. The team size, its distribution, and open-source experience influence their knowledge sharing and access behavior. While face-to-face communication is preferred for accessing knowledge, knowledge is frequently shared in informal comments. Our results reveal a gap between research and practice, as we did not observe any use of comprehension tools and developers seem to be unaware of them. Overall, our findings call for reconsidering the research agendas towards context-aware tool support.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Students had to comprehend and reason about the code [Maalej et al. 2014] to arrive at the solution or to formulate a relevant prompt for getting effective assistance from the bot.”
From How Do Programming Students Use Generative AI? (2025) · cites this paper as Maalej et al. 2014
Citations
Cites
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Creswell, J. W. (1994) · Cited by 35,204
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Sloane-Seale, A. (2009) · Canadian Journal of University Continuing Education · doi:10.21225/d54s3d · Cited by 14,328
Protocol Analysis: Verbal Reports as Data
Venkatesan, M., Ericsson, K. A., & Simon, H. A. (1986) · Journal of Marketing Research · doi:10.2307/3151491 · Cited by 4,347
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Cabrera, A., & Cabrera, E. F. (2002) · Organization Studies · doi:10.1177/0170840602235001 · Cited by 1,355
An empirical study of speed and communication in globally distributed software development
Herbsleb, J. D., & Mockus, A. (2003) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2003.1205177 · Cited by 997
Empirical Studies of Programming Knowledge
Soloway, E., & Ehrlich, K. (1984) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1984.5010283 · Cited by 877
Towards a theory of the comprehension of computer programs
Brooks, R. (1983) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(83)80031-5 · Cited by 756
Ko, A. J., Myers, B. A., Coblenz, M. J., & Aung, H. H. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.116 · Cited by 685
Maintaining mental models: a study of developer work habits
LaToza, T. D., Venolia, G., & DeLine, R. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134355 · Cited by 628
Research works printed but not linked: 5
- Francoise Detienne . 2002. Software Design -- Cognitive Aspect . Springer . Francoise Detienne. 2002. Software Design -- Cognitive Aspect. Springer.
- R. K. Fjeldstad and W. T. Hamlen . 1979. Application program maintenance study: Report to our respondents . In Proceedings of GUIDE 48 . PA. R. K. Fjeldstad and W. T. Hamlen. 1979. Application program maintenance study: Report to our respondents. In Proceedings of GUIDE 48. PA.
- G. Gilder . 2013. Knowledge and Power: The Information Theory of Capitalism and How it is Revolutionizing our World . Regnery Publishing . G. Gilder. 2013. Knowledge and Power: The Information Theory of Capitalism and How it is Revolutionizing our World. Regnery Publishing.
- 10.5555/1018434.1021568 · doi:10.5555/1018434.1021568
- A. Von Mayrhauser , A. M. Vans , and S. Lang . 1998. Program comprehension and enhancement of software . In Proceedings of the IFIP World Computing Congress - Information Technology and Knowledge Engineering. A. Von Mayrhauser, A. M. Vans, and S. Lang. 1998. Program comprehension and enhancement of software. In Proceedings of the IFIP World Computing Congress - Information Technology and Knowledge Engineering.
Cited by
Using an LLM to Help With Code Understanding
Nam, D., Macvean, A., Hellendoorn, V., Vasilescu, B., & Myers, B. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3639187 · Cited by 487
“” This behavior might be attributed to developers’ inclination to focus on task completion rather than comprehending the software, as reported in the literature [44].”
BackgroundResultMeasuring Program Comprehension: A Large-Scale Field Study with Professionals
Xia, X., Bao, L., Lo, D., Xing, Z., Hassan, A. E., & Li, S. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2734091 · Cited by 326
Application Programming Interface Documentation: What Do Software Developers Want?
Meng, M., Steinhardt, S., & Schubert, A. (2018) · Journal of Technical Writing and Communication · doi:10.1177/0047281617721853 · Cited by 78
Spreadsheet Comprehension: Guesswork, Giving Up and Going Back to the Author
Srinivasa Ragavan, S., Sarkar, A., & Gordon, A. D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445634 · Cited by 67
Experiences with Improving the Transparency of AI Models and Services
Hind, M., Houde, S., Martino, J., Mojsilovic, A., Piorkowski, D., Richards, J., & Varshney, K. R. (2020) · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3334480.3383051 · Cited by 44
Metadata
- Authors
- Maalej, W., Tiarks, R., Roehm, T., & Koschke, R.
- Affiliations
- Universität Hamburg (DE)
- Technical University of Munich (DE)
- University of Bremen (DE)
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 2014-09-05
- Volume
- 23
- Issue
- 4
- Pages
- 1-37
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W2144651866
- Cited by
- 180
- References
- 71
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 16 · 2023: 13 · 2022: 14 · 2021: 24 · 2020: 12 · 2019: 8 · 2018: 17 · 2017: 21 · 2016: 10 · 2015: 21
- FWCI
- 47.76
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Software Engineering and Methodology (publishedVersion)
- Funders
- Seventh Framework Programme (FP7-258109)
- Deutsche Forschungsgemeinschaft (KO 2342/3-1/BR 2906/1-1)
- European Commission
- Sixth Framework Programme (FP6-35111)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- program comprehension, developer practices, comprehension strategies, knowledge sharing, access to knowledge, team size, face-to-face communication, research-practice gap
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On the Comprehension of Program Comprehension. https://app.cochat.ai/papers/10.1145/2622669
- The paper
- Maalej, W., Tiarks, R., Roehm, T., & Koschke, R. (2014). On the Comprehension of Program Comprehension. ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/2622669
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.