The DOI matches its Crossref record; 86 of the 87 references it cites were found in a registry or an index.
Understanding understanding source code with functional magnetic resonance imaging
Open accessAbstract
Program comprehension is an important cognitive process that inherently eludes direct measurement. Thus, researchers are struggling with providing suitable programming languages, tools, or coding conventions to support developers in their everyday work. In this paper, we explore whether functional magnetic resonance imaging (fMRI), which is well established in cognitive neuroscience, is feasible to soundly measure program comprehension. In a controlled experiment, we observed 17 participants inside an fMRI scanner while they were comprehending short source-code snippets, which we contrasted with locating syntax errors. We found a clear, distinct activation pattern of five brain regions, which are related to working memory, attention, and language processing---all processes that fit well to our understanding of program comprehension. Our results encourage us and, hopefully, other researchers to use fMRI in future studies to measure program comprehension and, in the long run, answer questions, such as: Can we predict whether someone will be an excellent programmer? How effective are new languages and tools for program understanding? How should we train programmers?
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When comprehension of code was compared to detection of syntactic errors in code, activity in both fronto-parietal and putative language areas was observed (Siegmund et al., 2014, Siegmund, 2017).”
From Computer code comprehension shares neural resources with formal logical inference in the fronto-parietal network (2020) · cites this paper as Siegmund et al., 2014
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900
Co-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798
Wing, J. M. (2006) · Communications of the ACM · doi:10.1145/1118178.1118215 · Cited by 8,102
McCabe, T. J. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233837 · Cited by 6,059
Kiczales, G. (1996) · ACM Computing Surveys · doi:10.1145/242224.242420 · Cited by 5,146
Binder, J. R., Desai, R. H., Graves, W. W., & Conant, L. L. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp055 · Cited by 4,060
Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies
Cabeza, R., & Nyberg, L. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/08989290051137585 · Cited by 3,598
Bergmans, L., & Lopes, C. V. (1999) · Lecture notes in computer science · doi:10.1007/3-540-46589-8_17 · Cited by 2,951
Halstead, M. H. (1977) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,339
Research works printed but not linked: 1
- J. Raven . Mental Tests Used in Genetic Studies: The Performances of Related Individuals in Tests Mainly Educative and Mainly Reproductive. Master’s thesis , University of London , 1936 . J. Raven. Mental Tests Used in Genetic Studies: The Performances of Related Individuals in Tests Mainly Educative and Mainly Reproductive. Master’s thesis, University of London, 1936.
Cited by
Sorted by citations
Coding as another language: a pedagogical approach for teaching computer science in early childhood
Bers, M. U. (2019) · Journal of Computers in Education · doi:10.1007/s40692-019-00147-3 · Cited by 248
Eye Movements in Code Reading: Relaxing the Linear Order
Busjahn, T., Bednarik, R., Begel, A., Crosby, M. E., Paterson, J. H., Schulte, C., Sharif, B., & Tamm, S. (2015) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2015.36 · Cited by 182
Stuck and Frustrated or in Flow and Happy: Sensing Developers' Emotions and Progress
Muller, S. C., & Fritz, T. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.334 · Cited by 150
Comprehension of Procedural Visual Business Process Models
Figl, K. (2017) · Business & Information Systems Engineering · doi:10.1007/s12599-016-0460-2 · Cited by 140
Decoding the Representation of Code in the Brain: An fMRI Study of Code Review and Expertise
Floyd, B., Santander, T., & Weimer, W. R. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2017.24 · Cited by 136
Using (bio)metrics to predict code quality online
Muller, S. C., & Fritz, T. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884803 · Cited by 120
(2017) · doi:10.1145/3106237.3106268 · Cited by 117
Self-citationThe effect of poor source code lexicon and readability on developers' cognitive load
Fakhoury, S., Ma, Y., Arnaoudova, V., & Adesope, O. (2018) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3196321.3196347 · Cited by 116
Comprehension of computer code relies primarily on domain-general executive brain regions
Ivanova, A. A., Srikant, S., Sueoka, Y., Kean, H., Dhamala, R., O’Reilly, U.-M., Bers, M. U., & Fedorenko, E. G. (2020) · eLife · doi:10.7554/elife.58906 · Cited by 120
Eye Movements in Code Reading: Relaxing the Linear Order
Busjahn, T., Bednarik, R., Begel, A., Crosby, M. E., Paterson, J. H., Schulte, C., Sharif, B., & Tamm, S. (2016) · Cited by 111
Tracing software developers' eyes and interactions for change tasks
Kevic, K., Walters, B. M., Shaffer, T., Sharif, B., Shepherd, D. C., & Fritz, T. (2015) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2786805.2786864 · Cited by 113
Towards a theory of software development expertise
Baltes, S., & Diehl, S. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3236061 · Cited by 109
Program Comprehension: Past, Present, and Future
Siegmund, J. (2016) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2016.35 · Cited by 93
Self-citationTowards an affordable brain computer interface for the assessment of programmers’ mental workload
Kosti, M. V., Georgiadis, K., Adamos, D. A., Laskaris, N., Spinellis, D. D., & Angelis, L. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.03.002 · Cited by 83
Program Comprehension and Code Complexity Metrics: An fMRI Study
Peitek, N., Apel, S., Parnin, C., Brechmann, A., & Siegmund, J. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00056 · Cited by 84
Self-citationA Look into Programmers’ Heads
Peitek, N., Siegmund, J., Apel, S., Kästner, C., Parnin, C., Bethmann, A., Leich, T., Saake, G., & Brechmann, A. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2863303 · Cited by 82
Self-citationWeber, B., Fischer, T., & Riedl, R. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.110946 · Cited by 82
The Language of Programming: A Cognitive Perspective
Fedorenko, E. G., Ivanova, A. A., Dhamala, R., & Bers, M. U. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.04.010 · Cited by 75
Mining biometric data to predict programmer expertise and task difficulty
Lee, S., Hooshyar, D., Ji, H., Nam, K., & Lim, H. (2017) · Cluster Computing · doi:10.1007/s10586-017-0746-2 · Cited by 75
Understanding Programming Expertise
Crk, I., Kluthe, T., & Stefik, A. (2015) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2829945 · Cited by 71
How programmers read regular code: a controlled experiment using eye tracking
Jbara, A., & Feitelson, D. G. (2016) · Empirical Software Engineering · doi:10.1007/s10664-016-9477-x · Cited by 68
Liu, Y.-F., Kim, J., Wilson, C., & Bedny, M. (2020) · eLife · doi:10.7554/elife.59340 · Cited by 64
Lee, S., Matteson, A. S., Hooshyar, D., Kim, S., Jung, J., Nam, G., & Lim, H. (2016) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2016.30 · Cited by 67
Understanding misunderstandings in source code
Gopstein, D., Iannacone, J., Yu, Y., DeLong, L. A., Zhuang, Y., Yeh, M. K. ‐., & Cappos, J. (2017) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3106237.3106264 · Cited by 65
Identifying Experts in Software Libraries and Frameworks Among GitHub Users
Montandon, J. E., Silva, L. L., & Valente, M. T. (2019) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2019.00054 · Cited by 63
The role of the insula in intuitive expert bug detection in computer code: an fMRI study
Castelhano, J., Duarte, I. C., Ferreira, C., Duraes, J. A., Madeira, H., & Castelo-Branco, M. S. (2018) · Brain Imaging and Behavior · doi:10.1007/s11682-018-9885-1 · Cited by 66
Gender Differences in Personality Traits of Software Engineers
Russo, D., & Stol, K.-J. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3003413 · Cited by 61
How does the degree of variability affect bug finding?
Melo, J., Brabrand, C., & Wąsowski, A. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884831 · Cited by 55
ActionNet: Vision-Based Workflow Action Recognition From Programming Screencasts
Zhao, D., Xing, Z., Chen, C., Xia, X., & Li, G. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00049 · Cited by 49
Project-Level Encoding for Neural Source Code Summarization of Subroutines
Bansal, A., Haque, S., & McMillan, C. (2021) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc52881.2021.00032 · Cited by 45
Feitelson, D. G., Mizrahi, A., Noy, N., Shabat, A. B., Eliyahu, O., & Sheffer, R. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2976920 · Cited by 48
WAP: understanding the brain at software debugging
Duraes, J., Madeira, H., Castelhano, J., Duarte, C., & Branco, M. C. (2016) · 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2016.53 · Cited by 47
Simultaneous measurement of program comprehension with fMRI and eye tracking
Peitek, N., Siegmund, J., Parnin, C., Apel, S., Hofmeister, J. C., & Brechmann, A. (2018) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/3239235.3240495 · Cited by 47
Self-citationLeveraging Biometric Data to Boost Software Developer Productivity
Fritz, T., & Muller, S. C. (2016) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2016.107 · Cited by 48
Fakhoury, S., Roy, D., Ma, Y., Arnaoudova, V., & Adesope, O. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09751-4 · Cited by 45
Can EEG Be Adopted as a Neuroscience Reference for Assessing Software Programmers’ Cognitive Load?
Medeiros, J., Couceiro, R., Duarte, G., Duraes, J. A., Castelhano, J., Duarte, I. C., Castelo-Branco, M. S., Madeira, H., Carvalho, P., & Teixeira, C. (2021) · Sensors · doi:10.3390/s21072338 · Cited by 44
On the Optimal Order of Reading Source Code Changes for Review
Baum, T., Schneider, K. A., & Bacchelli, A. (2017) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2017.28 · Cited by 42
Ivie: Lightweight Anchored Explanations of Just-Generated Code
Yan, L., Hwang, A., Wu, Z., & Head, A. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642239 · Cited by 55
Krueger, R., Huang, Y., Liu, X., Santander, T., Weimer, W. R., & Leach, K. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377811.3380348 · Cited by 45
Yan, L., Xu, S., & Liu, J. (2021) · Journal of Pacific Rim Psychology · doi:10.1177/18344909211010240 · Cited by 58
Huang, Y., Leach, K., Sharafi, Z., McKay, N., Santander, T., & Weimer, W. R. (2020) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3368089.3409681 · Cited by 44
The introductory computer programming course is first and foremost a language course
Portnoff, S. R. (2018) · ACM Inroads · doi:10.1145/3152433 · Cited by 37
Distilling Neural Representations of Data Structure Manipulation using fMRI and fNIRS
Huang, Y., Liu, X., Krueger, R., Santander, T., Hu, X., Leach, K., & Weimer, W. R. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00053 · Cited by 37
Cognitive load measurement - A methodology to compare low cost commercial EEG devices
Das, R., Chatterjee, D., Das, D., Sinharay, A., & Sinha, A. (2014) · International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2014.6968528 · Cited by 37
A Replication Study on Code Comprehension and Expertise using Lightweight Biometric Sensors
Fucci, D., Girardi, D., Novielli, N., Quaranta, L., & Lanubile, F. (2019) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2019.00050 · Cited by 35
What Drives the Reading Order of Programmers?
Peitek, N., Siegmund, J., & Apel, S. (2020) · International Conference on Program Comprehension · doi:10.1145/3387904.3389279 · Cited by 34
Self-citationAn Empirical Study on the Patterns of Eye Movement during Summarization Tasks
Rodeghero, P., & McMillan, C. (2015) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2015.7321188 · Cited by 34
Studying the difference between natural and programming language corpora
Casalnuovo, C., Sagae, K., & Devanbu, P. (2019) · Empirical Software Engineering · doi:10.1007/s10664-018-9669-7 · Cited by 33
Eye gaze and interaction contexts for change tasks – Observations and potential
Kevic, K., Walters, B. M., Shaffer, T., Sharif, B., Shepherd, D. C., & Fritz, T. (2016) · Journal of Systems and Software · doi:10.1016/j.jss.2016.03.030 · Cited by 33
Indentation: Simply a Matter of Style or Support for Program Comprehension?
Bauer, J., Siegmund, J., Peitek, N., Hofmeister, J. C., & Apel, S. (2019) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2019.00033 · Cited by 33
Self-citationObserving and predicting knowledge worker stress, focus and awakeness in the wild
Soto, M., Satterfield, C., Fritz, T., Murphy, G. C., Shepherd, D. C., & Kraft, N. A. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102560 · Cited by 33
Toward an Objective Measure of Developers’ Cognitive Activities
Sharafi, Z., Huang, Y., Leach, K., & Weimer, W. R. (2021) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3434643 · Cited by 30
Peitek, N., Bergum, A., Rekrut, M., Mucke, J., Nadig, M., Parnin, C., Siegmund, J., & Apel, S. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549084 · Cited by 32
Self-citationNeed for Sleep: The Impact of a Night of Sleep Deprivation on Novice Developers’ Performance
Fucci, D., Scanniello, G., Romano, S., & Juristo, N. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2834900 · Cited by 31
Toward measuring program comprehension with functional magnetic resonance imaging
Siegmund, J., Brechmann, A., Apel, S., Kästner, C., Liebig, J., Leich, T., & Saake, G. (2012) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2393596.2393624 · Cited by 28
Self-citationVariability through the Eyes of the Programmer
Melo, J., Narcizo, F. B., Hansen, D. W., Brabrand, C., & Wąsowski, A. (2017) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2017.34 · Cited by 27
Biofeedback Augmented Software Engineering: Monitoring of Programmers' Mental Effort
Couceiro, R., Duarte, G., Duraes, J. A., Castelhano, J., Duarte, I. C., Teixeira, C., Castelo-Branco, M. S., Carvalho, P., & Madeira, H. (2019) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1109/icse-nier.2019.00018 · Cited by 27
Spotting Problematic Code Lines using Nonintrusive Programmers' Biofeedback
Couceiro, R., Barbosa, R., Duraes, J. A., Duarte, G., Castelhano, J., Duarte, I. C., Teixeira, C., Laranjeiro, N., Medeiros, J., Carvalho, P., et al. (2019) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2019.00019 · Cited by 26
Eyes on Code: A Study on Developers’ Code Navigation Strategies
Sharafi, Z., Bertram, I., Flanagan, M., & Weimer, W. R. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3032064 · Cited by 27
The effects of visualization and interaction techniques on feature model configuration
Asadi, M., Soltani, S., Gašević, D., & Hatala, M. (2015) · Empirical Software Engineering · doi:10.1007/s10664-014-9353-5 · Cited by 24
Expert Programmers Have Fine-Tuned Cortical Representations of Source Code
Ikutani, Y., Kubo, T., Nishida, S., Hata, H., Matsumoto, K.-I., Ikeda, K., & Nishimoto, S. (2020) · eNeuro · doi:10.1523/eneuro.0405-20.2020 · Cited by 27
Statistical errors in software engineering experiments
Ch., R. P. R., Dieste, Ó., Fonseca, E. R., & Juristo, N. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3180155.3180161 · Cited by 24
Duran, R., Sorva, J., & Seppälä, O. (2021) · ACM Transactions on Computing Education · doi:10.1145/3469128 · Cited by 25
Information flow and cognition affect each other: Evidence from digital learning
Sharma, K., Mangaroska, K., van Berkel, N., Giannakos, M. N., & Kostakos, V. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102549 · Cited by 27
Debugging: The key to unlocking the mind of a novice programmer?
Lowe, T. (2019) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie43999.2019.9028699 · Cited by 23
Xu, S., Li, Y., & Liu, J. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab182 · Cited by 20
Graafsma, I. L., Robidoux, S., Nickels, L., Roberts, M., Polito, V., Zhu, J. D., & Marinus, E. (2023) · Journal of Cognitive Psychology · doi:10.1080/20445911.2023.2166054 · Cited by 21
Measuring User Experience of Adaptive User Interfaces using EEG: A Replication Study
Gaspar-Figueiredo, D., Abrahão, S., Insfrán, E., & Vanderdonckt, J. M. (2023) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3593434.3593452 · Cited by 21
Brain Activity Measurement during Program Comprehension with NIRS
Ikutani, Y., & Uwano, H. (2014) · The International journal of networked and distributed computing · doi:10.2991/ijndc.2014.2.4.7 · Cited by 21
Peitek, N., Siegmund, J., Parnin, C., Apel, S., & Brechmann, A. (2018) · doi:10.1145/3216723.3216725 · Cited by 21
Self-citationSemantic Transfer in Programming Languages: Exploratory Study of Relative Novices
Tshukudu, E., & Cutts, Q. I. (2020) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3341525.3387406 · Cited by 21
Endres, M., Fansher, M., Shah, P., & Weimer, W. R. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3468583 · Cited by 19
Relating Reading, Visualization, and Coding for New Programmers: A Neuroimaging Study
Endres, M., Karas, Z., Hu, X., Kovelman, I., & Weimer, W. R. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00062 · Cited by 18
Real-Time Monitoring of Neural State in Assessing and Improving Software Developers' Productivity
Radevski, S., Hata, H., & Matsumoto, K. (2015) · International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) · doi:10.1109/chase.2015.28 · Cited by 19
Understanding the impact of pair programming on the minds of developers
Busechian, S., Ivanov, V. V., Rogers, A., Sirazitdinov, I., Succi, G., Tormasov, A. G., & Yi, J. (2018) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1145/3183399.3183413 · Cited by 16
Studying programming in the neuroage
Siegmund, J., Peitek, N., Brechmann, A., Parnin, C., & Apel, S. (2020) · Communications of the ACM · doi:10.1145/3347093 · Cited by 16
Self-citationHow Programmers Read Regular Code: A Controlled Experiment Using Eye Tracking
Jbara, A., & Feitelson, D. G. (2015) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2015.35 · Cited by 16
Feitelson, D. G. (2022) · Empirical Software Engineering · doi:10.1007/s10664-022-10160-3 · Cited by 15
Software code complexity assessment using EEG features
Medeiros, J., Teixeira, C., Couceiro, R., Castelhano, J., Castelo-Branco, M. S., Duarte, G., Duarte, I. C., Duraes, J. A., Madeira, H., & Carvalho, P. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8856283 · Cited by 15
EEG Activities During Program Comprehension: An Exploration of Cognition
Lin, Y., Liao, Y.-Z., Hu, X., & Wu, C.-C. (2021) · IEEE Access · doi:10.1109/access.2021.3107795 · Cited by 14
Using biometric data in software engineering: a systematic mapping study
Menzen, J. P., Farias, K., & Bischoff, V. (2020) · Behaviour and Information Technology · doi:10.1080/0144929x.2020.1734086 · Cited by 14
Program Comprehension in Virtual Reality
Dominic, J., Tubre, B., Houser, J. A., Ritter, C., Kunkel, D., & Rodeghero, P. (2020) · International Conference on Program Comprehension · doi:10.1145/3387904.3389287 · Cited by 14
Gaze-Driven Design Insights to Amplify Debugging Skills: A Learner-Centered Analysis Approach
Mangaroska, K., Sharma, K., Giannakos, M. N., Trætteberg, H., & Dillenbourg, P. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.7 · Cited by 15
Stangl, F. J., & Riedl, R. (2024) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-58396-4_11 · Cited by 13
Initial evaluation of the brain activity under different software development situations
Ikramov, R., Ivanov, V. V., Masyagin, S., Shakirov, R., Sirazidtinov, I., Succi, G., Thapaliya, A., Tormasov, A. G., & Zufarova, O. (2019) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2019-215 · Cited by 13
Hands-on in Computer Programming Education
von Hausswolff, K. (2017) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3105726.3105735 · Cited by 13
Santos, A. R., Machado, I., de Almeida, E. S., Siegmund, J., & Apel, S. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9658-x · Cited by 13
Self-citationReal-time monitoring of neural state in assessing and improving software developers' productivity
Radevski, S., Hata, H., & Matsumoto, K. (2015) · doi:10.5555/2819321.2819339 · Cited by 12
Doukakis, S. (2019) · AIMS neuroscience · doi:10.3934/neuroscience.2019.3.175 · Cited by 12
Measuring software developers' perceived difficulty with biometric sensors
Muller, S. C. (2015) · doi:10.5555/2819009.2819206 · Cited by 12
Computer Programming as a Second Language
Pandža, N. B. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-41932-9_36 · Cited by 12
Artifact Removal from EEG Signals Recorded Using Low Resolution Emotiv Device
Sinha, A., Chatterjee, D., Das, R., Datta, S., Gavas, R. D., & Saha, S. K. (2015) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.256 · Cited by 12
Medeiros, J., Simões, M. A., Castelhano, J., Abreu, R., Couceiro, R., Henriques, J. M. O., Castelo-Branco, M. S., Madeira, H., Teixeira, C., & Carvalho, P. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299108 · Cited by 11
Moving towards objective measures of program comprehension
Fakhoury, S. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3275426 · Cited by 11
Beller, M., Zaidman, A., & Карпов, А. Г. (2015) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2015.34 · Cited by 11
Karas, Z., Jahn, A., Weimer, W. R., & Huang, Y. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3468579 · Cited by 11
Gonçales, L. J., Farias, K., Kupssinskü, L. S., & Segalotto, M. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117354 · Cited by 11
User experience with adaptive user interfaces: Comparing performance and preferences
Gaspar-Figueiredo, D., Vanderdonckt, J. M., Abrahão, S., & Insfrán, E. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112598 · Cited by 10
Beller, M., Zaidman, A., & Карпов, А. Г. (2015) · doi:10.5555/2820282.2820317 · Cited by 10
EEG monitoring during software development
Calcagno, A., Coelli, S., Couceiro, R., Duraes, J. A., Amendola, C., Pirovano, I., Re, R., & Bianchi, A. M. (2020) · IEEE Mediterranean Electrotechnical Conference (MELECON) · doi:10.1109/melecon48756.2020.9140717 · Cited by 10
Metadata
- Authors
- Siegmund, J., Kästner, C., Apel, S., Parnin, C., Bethmann, A., Leich, T., Saake, G., & Brechmann, A.
- Affiliations
- University of Passau (DE)
- Carnegie Mellon University (US)
- Georgia Institute of Technology (US)
- Leibniz Institute for Neurobiology (DE)
- Metop Research Institute, Germany
- Otto-von-Guericke-Universität Magdeburg (DE)
- Venue
- Proceedings of the 36th International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2014-05-31
- Pages
- 378-389
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W2014232144
- Cited by
- 219
- References
- 87
- Citations by year
- 2026: 19 · 2025: 13 · 2024: 15 · 2023: 8 · 2022: 12 · 2021: 24 · 2020: 38 · 2019: 22 · 2018: 18 · 2017: 10 · 2016: 18 · 2015: 17 · 2014: 4
- FWCI
- 13.93
- Type
- conference paper
- Language
- en
- Open access
- green
- figshare.com
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- KiltHub Repository (submittedVersion)
- Figshare (submittedVersion, cc-by)
- KiltHub Repository
- Funders
- National Science Foundation
- Deutsche Forschungsgemeinschaft
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience, Education and Cognitive Function
- Keywords
- program comprehension, source code understanding, functional MRI, brain activation patterns, working memory, attention, language processing, programming languages, programmer training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
