The DOI matches its Crossref record; 86 of the 87 references it cites were found in a registry or an index.
Understanding understanding source code with functional magnetic resonance imaging
Open accessAbstract
Program comprehension is an important cognitive process that inherently eludes direct measurement. Thus, researchers are struggling with providing suitable programming languages, tools, or coding conventions to support developers in their everyday work. In this paper, we explore whether functional magnetic resonance imaging (fMRI), which is well established in cognitive neuroscience, is feasible to soundly measure program comprehension. In a controlled experiment, we observed 17 participants inside an fMRI scanner while they were comprehending short source-code snippets, which we contrasted with locating syntax errors. We found a clear, distinct activation pattern of five brain regions, which are related to working memory, attention, and language processing---all processes that fit well to our understanding of program comprehension. Our results encourage us and, hopefully, other researchers to use fMRI in future studies to measure program comprehension and, in the long run, answer questions, such as: Can we predict whether someone will be an excellent programmer? How effective are new languages and tools for program understanding? How should we train programmers?
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When comprehension of code was compared to detection of syntactic errors in code, activity in both fronto-parietal and putative language areas was observed (Siegmund et al., 2014, Siegmund, 2017).”
From Computer code comprehension shares neural resources with formal logical inference in the fronto-parietal network (2020) · cites this paper as Siegmund et al., 2014
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900
Co-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798
Wing, J. M. (2006) · Communications of the ACM · doi:10.1145/1118178.1118215 · Cited by 8,102
McCabe, T. J. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233837 · Cited by 6,059
Kiczales, G. (1996) · ACM Computing Surveys · doi:10.1145/242224.242420 · Cited by 5,146
Binder, J. R., Desai, R. H., Graves, W. W., & Conant, L. L. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp055 · Cited by 4,060
Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies
Cabeza, R., & Nyberg, L. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/08989290051137585 · Cited by 3,598
Bergmans, L., & Lopes, C. V. (1999) · Lecture notes in computer science · doi:10.1007/3-540-46589-8_17 · Cited by 2,951
Halstead, M. H. (1977) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,339
Research works printed but not linked: 1
- J. Raven . Mental Tests Used in Genetic Studies: The Performances of Related Individuals in Tests Mainly Educative and Mainly Reproductive. Master’s thesis , University of London , 1936 . J. Raven. Mental Tests Used in Genetic Studies: The Performances of Related Individuals in Tests Mainly Educative and Mainly Reproductive. Master’s thesis, University of London, 1936.
Cited by
Sorted by citations
Coding as another language: a pedagogical approach for teaching computer science in early childhood
Bers, M. U. (2019) · Journal of Computers in Education · doi:10.1007/s40692-019-00147-3 · Cited by 248
Eye Movements in Code Reading: Relaxing the Linear Order
Busjahn, T., Bednarik, R., Begel, A., Crosby, M. E., Paterson, J. H., Schulte, C., Sharif, B., & Tamm, S. (2015) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2015.36 · Cited by 182
Stuck and Frustrated or in Flow and Happy: Sensing Developers' Emotions and Progress
Muller, S. C., & Fritz, T. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.334 · Cited by 150
Comprehension of Procedural Visual Business Process Models
Figl, K. (2017) · Business & Information Systems Engineering · doi:10.1007/s12599-016-0460-2 · Cited by 140
Decoding the Representation of Code in the Brain: An fMRI Study of Code Review and Expertise
Floyd, B., Santander, T., & Weimer, W. R. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2017.24 · Cited by 136
Metadata
- Authors
- Siegmund, J., Kästner, C., Apel, S., Parnin, C., Bethmann, A., Leich, T., Saake, G., & Brechmann, A.
- Affiliations
- University of Passau (DE)
- Carnegie Mellon University (US)
- Georgia Institute of Technology (US)
- Leibniz Institute for Neurobiology (DE)
- Metop Research Institute, Germany
- Otto-von-Guericke-Universität Magdeburg (DE)
- Venue
- Proceedings of the 36th International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2014-05-31
- Pages
- 378-389
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W2014232144
- Cited by
- 219
- References
- 87
- Citations by year
- 2026: 19 · 2025: 13 · 2024: 15 · 2023: 8 · 2022: 12 · 2021: 24 · 2020: 38 · 2019: 22 · 2018: 18 · 2017: 10 · 2016: 18 · 2015: 17 · 2014: 4
- FWCI
- 13.93
- Type
- conference paper
- Language
- en
- Open access
- green
- figshare.com
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- KiltHub Repository (submittedVersion)
- Figshare (submittedVersion, cc-by)
- KiltHub Repository
- Funders
- National Science Foundation
- Deutsche Forschungsgemeinschaft
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience, Education and Cognitive Function
- Keywords
- program comprehension, source code understanding, functional MRI, brain activation patterns, working memory, attention, language processing, programming languages, programmer training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
