Using psycho-physiological measures to assess task difficulty in software development
Open accessThe DOI matches its Crossref record; 70 of the 72 references it cites were found in a registry or an index.
Abstract
Software developers make programming mistakes that cause serious bugs for their customers. Existing work to detect problematic software focuses mainly on post hoc identification of correlations between bug fixes and code. We propose a new approach to address this problem --- detect when software developers are experiencing difficulty while they work on their programming tasks, and stop them before they can introduce bugs into the code.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Various studies have shown that biometric data such as heart rate (HR), heart rate variability (HRV), electro-dermal activity (EDA), eye tracking, skin temperature or electroencephalography (EEG) can be used to assess mental effort and cognitive load [85,66,28,13], task difficulty [79,22], emotions [48,27,62], or stress [29,70,84].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [22]
In the citing paper
“Since biometric and computer interaction data is highly individual and trained models can often not easily be transferred to new participants [22,88,81]”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [22]
In the citing paper
“Psycho-physiological measures like EEG, which have been validated for measuring cognitive load in traditional programming contexts, could provide valuable insights into the mental demands of working with AI assistants.”
From Towards Decoding Developer Cognition in the Age of AI Assistants (2025) · cites this paper as [13]
In the citing paper
“Fritz et.al. [13] used a combination of EEG, eye tracking and electrodermal activity sensors to predict task difficulty with upto 84% precision.”
From Towards Decoding Developer Cognition in the Age of AI Assistants (2025) · cites this paper as [13]
In the citing paper
“This approach was chosen as it has been demonstrated to effectively return participants' physiological features to a baseline level after approximately one minute.”
From How do Copilot Suggestions Impact Developers' Frustration and Productivity? (2025) · cites this paper as Fritz et al. [30]
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 5×
“In some cases, this yielded better performance on our data (e.g. EDA+EEG f-measure rose from 62.01% to 69.73%), however running ANOVA tests on the Weka output failed to show any significant differences be-tween the original and shrunken sets of features.”
MethodInfluentialDevelopment of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 16×
“We used two outcome measures in our tasks: the NASA Task Load Index (TLX) [32] filled out on paper after each task, and a subjective ranking of tasks based on the subject’s post hoc perception of their difficulty at the end of the experimental session.”
MethodInfluentialÜber das Elektrenkephalogramm des Menschen
Berger, H. (1929) · Archiv für Psychiatrie und Nervenkrankheiten · doi:10.1007/bf01797193 · Cited by 4,235
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334 · cited 1×
“…questionnaire selected 20 of these candidates who had at least 2 years of software development experience, knew how to program in C# (and had done so in the last year), did not need to wear bifocal or trifocal glasses (they interfere with the eye-tracker), and were available to come to our lab.”
BackgroundTask-evoked pupillary responses, processing load, and the structure of processing resources.
Beatty, J. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.2.276 · Cited by 1,959 · cited 1×
“in particular the peak amplitude of the pupil diameter, is an indicator for memory load or also processing load and that it varies with task difficulty [6].”
BackgroundDawson, M. E., Schell, A. M., Filion, D. L., & Berntson, G. G. (2009) · Handbook of Psychophysiology · doi:10.1017/cbo9780511546396.007 · Cited by 1,720 · cited 1×
“Electrodermal activity (EDA), also known as skin conductance (SC) or galvanic skin response (GSR), has been closely linked with arousal, attention, emotional states, stress and anxiety [13, 17].”
BackgroundPublication Recommendations for Electrodermal Measurements
Fowles, D. C., Christie, M. J., Edelberg, R., GRINGS, W. W., Lykken, D. T., & Venables, P. H. (1981) · Psychophysiology · doi:10.1111/j.1469-8986.1981.tb03024.x · Cited by 1,699
Eye Tracking in Human-Computer Interaction and Usability Research
Jacob, R. J. K., & Karn, K. S. (2003) · The Mind's Eye · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,567
Computer interface evaluation using eye movements: methods and constructs
Goldberg, J. H., & Kotval, X. P. (1999) · International Journal of Industrial Ergonomics · doi:10.1016/s0169-8141(98)00068-7 · Cited by 1,053 · cited 2×
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundEEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks.
Berka, C., Levendowski, D. J., Lumicao, M. N., Yau, A., Davis, G., Zivkovic, V. T., Olmstead, R. E., Tremoulet, P. D., & Craven, P. L. (2007) · PubMed · Cited by 1,050
Psychophysiology -- Human Behavior and Physiological Response
McGuigan, F. J., & Andreassi, J. L. (1981) · The American Journal of Psychology · doi:10.2307/1422751 · Cited by 974
The Physiological Differentiation between Fear and Anger in Humans
AX, A. F. (1953) · Psychosomatic Medicine · doi:10.1097/00006842-195309000-00007 · Cited by 895 · cited 3×
“under the curve (AUC) [3, 62], and normalize these by time.”
BackgroundEvent-related potentials : a methods handbook
Handy, T. C. (2005) · The MIT Press eBooks · Cited by 777
Discriminating Stress From Cognitive Load Using a Wearable EDA Device
Setz, C., Arnrich, B., Schumm, J., La Marca, R., Troster, G., & Ehlert, U. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036164 · Cited by 742 · cited 3×
“under the curve (AUC) [3, 62], and normalize these by time.”
BackgroundA Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity
Poh, M.-Z., Swenson, N. C., & Picard, R. W. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2009.2038487 · Cited by 693 · cited 1×
“0 [56] worn on the wrist of the subject’s non-dominant”
Background(1992) · Applied Ergonomics · doi:10.1016/0003-6870(92)90300-k · Cited by 571
Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods
Gevins, A., Smith, M. E., Leong, H., McEvoy, L., Whitfield, S., Du, R., & Rush, G. (1998) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779480578 · Cited by 535 · cited 1×
“Each subject performed eight code comprehension tasks as we recorded various psycho-physiological and subjective measurements 1 .”
MethodAn Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures
Wilson, G. F. (2002) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1201_2 · Cited by 488 · cited 2×
“Wilson, for instance, measured brain activity, eye blinks, electrodermal activity and heart rate and found that electrodermal activity measures as well as alpha and delta bands of brain activity showed significant changes to varying mental workload demands in flying scenarios, while the heart rate was less sensitive […”
BackgroundPsychophysiological responses to changes in workload during simulated air traffic control
Brookings, J. B., Wilson, G. F., & Swain, C. R. (1996) · Biological Psychology · doi:10.1016/0301-0511(95)05167-8 · Cited by 475 · cited 3×
“showed that a person’s blink rate decreases significantly when tasks become more difficult [15].”
BackgroundMethodPhysiological metrics of mental workload: A review of recent progress
Kramer, A. F. (2020) · Multiple-task performance · doi:10.1201/9781003069447-14 · Cited by 459
Galvanic skin response (GSR) as an index of cognitive load
Shi, Y., Ruiz, N., Taib, R., Choi, E., & Chen, F. (2007) · CHI '07 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1240866.1241057 · Cited by 423 · cited 1×
“Those that completed the 1.5 hour experiment were remunerated with a single license for their choice of Microsoft consumer software (a standard payment for Microsoft user study participants).”
MethodInfluentialRyu, K., & Myung, R. (2005) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2005.04.005 · Cited by 399 · cited 2×
“for distinguishing between the difficulty levels of tasks [60].”
BackgroundPsycho-physiological measures for assessing cognitive load
Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864395 · Cited by 382 · cited 1×
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundBailey, B. P., & Iqbal, S. T. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1314683.1314689 · Cited by 325 · cited 2×
“dilation as a measure for workload at task boundaries [4].”
BackgroundTask-evoked pupillary response to mental workload in human-computer interaction
Iqbal, S. T., Zheng, X. S., & Bailey, B. P. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.986094 · Cited by 317
Tonic, phasic, and transient EEG correlates of auditory awareness in drowsiness
Makeig, S., & Jung, T.-P. (1996) · Cognitive Brain Research · doi:10.1016/0926-6410(95)00042-9 · Cited by 248 · cited 1×
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundAffectAura: an intelligent system for emotional memory
McDuff, D., Karlson, A., Kapoor, A., Roseway, A., & Czerwinski, M. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208525 · Cited by 242
Psychophysiology: Human Behavior & Physiological Response
Andreassi, J. L. (2000) · Cited by 242
The use of psychophysiology to assess driver status
BROOKHUIS, K. A., & DE WAARD, D. (1993) · Ergonomics · doi:10.1080/00140139308967981 · Cited by 241 · cited 1×
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundUsing galvanic skin response for cognitive load measurement in arithmetic and reading tasks
Nourbakhsh, N., Wang, Y., Chen, F., & Calvo, R. A. (2012) · Proceedings of the 24th Australian Computer-Human Interaction Conference · doi:10.1145/2414536.2414602 · Cited by 219 · cited 1×
“have shown that normalized frequency domains of electrodermal activity were significant to indicate task difficulty levels for arithmetic and reading tasks [53].”
BackgroundSoftware Design — Cognitive Aspects
Détienne, F. (2002) · Practitioner Series · doi:10.1007/978-1-4471-0111-6 · Cited by 205 · cited 1×
“We mitigated this risk somewhat by carefully constructing the tasks to vary their difficulty and effects on various brain functions according to past empirical results on programmers [19].”
MethodAn eye-tracking methodology for characterizing program comprehension processes
Bednarik, R., & Tukiainen, M. (2006) · Proceedings of the 2006 symposium on Eye tracking research & applications - ETRA '06 · doi:10.1145/1117309.1117356 · Cited by 197 · cited 1×
“also analyzed differences in strategies for less and more experienced developers in program comprehension and debugging [8, 9].”
Heart rate variability: indicator of user state as an aid to human-computer interaction
Rowe, D. W., Sibert, J., & Irwin, D. (1998) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '98 · doi:10.1145/274644.274709 · Cited by 192 · cited 2×
“, [41, 59]), but only little work has investigated the use of such measures in software development.”
BackgroundFeasibility and pragmatics of classifying working memory load with an electroencephalograph
Grimes, D., Tan, D. S., Hudson, S. E., Shenoy, P., & Rao, R. P. N. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357187 · Cited by 192 · cited 2×
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundMethodAnalyzing individual performance of source code review using reviewers' eye movement
Uwano, H., Nakamura, M., Monden, A., & Matsumoto, K.-I. (2006) · Proceedings of the 2006 symposium on Eye tracking research & applications - ETRA '06 · doi:10.1145/1117309.1117357 · Cited by 175 · cited 2×
“Thereby, they found that a longer scan time correlates significantly with a better defect detection [73, 65].”
BackgroundHow do we read algorithms? A case study
Crosby, M. E., & Stelovsky, J. (1990) · Computer · doi:10.1109/2.48797 · Cited by 174 · cited 2×
“In their study, they used eye fixation as a measure of attention, classified code into 5 categories from easy to hard and found that highexperienced developers use less time on comments and more time on complex statements than low experienced developers [16].”
MethodHolland, M. K., & Tarlow, G. (1972) · Psychological Reports · doi:10.2466/pr0.1972.31.1.119 · Cited by 173 · cited 1×
“To study the link between code reviews and defect detection, researchers have also examined the time developers spend scanning code by summarizing fixation durations over specific areas of interest and counting the number of fixa-tions.”
BackgroundUsing a low-cost electroencephalograph for task classification in HCI research
Lee, J. C., & Tan, D. S. (2006) · Proceedings of the 19th annual ACM symposium on User interface software and technology · doi:10.1145/1166253.1166268 · Cited by 165 · cited 2×
“In addition, inspired by Kramer and Lee [42, 44], we compute Beta(β)/(Alpha(α) + Theta(θ)) and Theta(θ)/(Alpha(α) +Beta(β)) as additional measures of task difficulty.”
BackgroundAssessing Cognitive Load with Physiological Sensors
Ikehara, C. S., & Crosby, M. E. (2005) · Proceedings of the 38th Annual Hawaii International Conference on System Sciences · doi:10.1109/hicss.2005.103 · Cited by 150 · cited 1×
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundAn Eye Tracking Study on camelCase and under_score Identifier Styles
Sharif, B., & Maletic, J. I. (2010) · 2010 IEEE 18th International Conference on Program Comprehension · doi:10.1109/icpc.2010.41 · Cited by 144 · cited 1×
“looked at the effect of identifier naming conventions—camelCase and under_score—in code comprehension and found that the accuracy in answers stays the same but time and visual effort decreases [66].”
BackgroundAn eye-tracking study on the role of scan time in finding source code defects
Sharif, B., Falcone, M., & Maletic, J. I. (2012) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2168556.2168642 · Cited by 143 · cited 2×
“Thereby, they found that a longer scan time correlates significantly with a better defect detection [73, 65].”
BackgroundWhat do you want to do next: a novel approach for intent prediction in gaze-based interaction
Bednarik, R., Vrzakova, H., & Hradis, M. (2012) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2168556.2168569 · Cited by 130 · cited 1×
“Machine learning has been shown to be a promising approach to find links between low-level data capture and highlevel phenomena of interest [10].”
BackgroundSimola, J., Salojärvi, J., & Kojo, I. (2008) · Cognitive Systems Research · doi:10.1016/j.cogsys.2008.01.002 · Cited by 124 · cited 1×
“For instance, Sharif et al. looked at the effect of identifier naming conventions—camelCase and under_score—in code comprehension and found that the accuracy in answers stays the same but time and visual effort decreases [66].”
BackgroundDo moods affect programmers’ debug performance?
Khan, I. A., Brinkman, W.-P., & Hierons, R. M. (2011) · Cognition, Technology & Work · doi:10.1007/s10111-010-0164-1 · Cited by 115 · cited 1×
“have looked into another psycho-physiological aspect and its link to performance by investigating how the mood of developers affects debugging and programming [38, 39].”
BackgroundEmotion Recognition through Physiological Signals for Human-Machine Communication
Maaoui, C., & Pruski, A. (2010) · Cutting Edge Robotics 2010 · doi:10.5772/10312 · Cited by 109 · cited 1×
“Each subject performed eight code comprehension tasks as we recorded various psycho-physiological and subjective measurements1.”
MethodAn eye tracking study on the effects of layout in understanding the role of design patterns
Sharif, B., & Maletic, J. I. (2010) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2010.5609582 · Cited by 104 · cited 1×
“other representations, such as graphical and textual representations of code variables [52], requirements [64] as well as the representation and layout of design patterns [67, 57].”
BackgroundHolland, M. K., & Tarlow, G. (1975) · PubMed · Cited by 99
Holland, M. K., & Tarlow, G. (1975) · Perceptual and Motor Skills · doi:10.2466/pms.1975.41.2.403 · Cited by 96 · cited 1×
“To study the link between code reviews and defect detection, researchers have also examined the time developers spend scanning code by summarizing fixation durations over specific areas of interest and counting the number of fixa-tions.”
BackgroundSchmidt, S., & Walach, H. (1999) · FreiDok plus (Universitätsbibliothek Freiburg) · Cited by 84
Haarmann, A., Boucsein, W., & Schaefer, F. (2009) · Applied Ergonomics · doi:10.1016/j.apergo.2009.04.011 · Cited by 76 · cited 1×
“, to adapt the workload of an operator and avoid it to become too high [29] or to detect emotions and improve the gaming experience [49].”
BackgroundPorras, G. C., & Guéhéneuc, Y. (2010) · Empirical Software Engineering · doi:10.1007/s10664-009-9125-9 · Cited by 60
Women and men — Different but equal: On the impact of identifier style on source code reading
Sharafi, Z., Soh, Z., Guéhéneuc, Y., & Antoniol, G. (2012) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2012.6240505 · Cited by 60 · cited 1×
“comprehension strategies in male and female subjects using eye-tracking [63].”
MethodEyeblink Frequency, Rehearsal Activity, and Sympathetic Arousal
De Jong, P. J., & Merckelbach, H. (1990) · International Journal of Neuroscience · doi:10.3109/00207459009000513 · Cited by 57
Temporal eye-tracking data: evolution of debugging strategies with multiple representations
Bednarik, R., & Tukiainen, M. (2008) · Proceedings of the 2008 symposium on Eye tracking research & applications - ETRA '08 · doi:10.1145/1344471.1344497 · Cited by 56 · cited 1×
“also analyzed differences in strategies for less and more experienced developers in program comprehension and debugging [8, 9].”
Neurophysiologic monitoring of mental workload and fatigue during operation of a flight simulator
Smith, M. E., & Gevins, A. (2005) · SPIE Proceedings · doi:10.1117/12.602181 · Cited by 56 · cited 1×
“Each subject performed eight code comprehension tasks as we recorded various psycho-physiological and subjective measurements 1 .”
MethodAuditory Discrimination and the Eyeblink
Bauer, L. O., Strock, B. D., Goldstein, R., Stern, J. A., & Walrath, L. C. (1985) · Psychophysiology · doi:10.1111/j.1469-8986.1985.tb01660.x · Cited by 53 · cited 1×
“To study the link between code reviews and defect detection, researchers have also examined the time developers spend scanning code by summarizing fixation durations over specific areas of interest and counting the number of fixa-tions.”
BackgroundAn empirical study on requirements traceability using eye-tracking
Ali, N., Sharafl, Z., Guéhéneuc, Y., & Antoniol, G. (2012) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405271 · Cited by 49 · cited 1×
“Eye-tracking has been used to assess task difficulty and cognitive and mental load [40, 36, 1, 15].”
MethodFixation-aligned pupillary response averaging
Klingner, J. (2010) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/1743666.1743732 · Cited by 46 · cited 3×
“Eye-tracking has been used to assess task difficulty and cognitive and mental load [40, 36, 1, 15].”
BackgroundMethodOn the deconvolution analysis of electrodermal activity in bipolar patients
Greco, A., Lanata, A., Valenza, G., Rota, G., Vanello, N., & Scilingo, E. P. (2012) · 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/embc.2012.6347529 · Cited by 42 · cited 1×
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundSubvocalization - Toward Hearing the Inner Thoughts of Developers
Parnin, C. (2011) · 2011 IEEE 19th International Conference on Program Comprehension · doi:10.1109/icpc.2011.49 · Cited by 39 · cited 4×
“Closest to our work is a preliminary pilot study by Parnin, who has explored the use of electromyography to measure sub-vocal utterances [54].”
BackgroundInfluentialSome factors influencing voluntary and reflex eyelid responses.
Telford, C. W., & Thompson, N. (1933) · Journal of Experimental Psychology · doi:10.1037/h0071694 · Cited by 35 · cited 1×
“To study the link between code reviews and defect detection, researchers have also examined the time developers spend scanning code by summarizing fixation durations over specific areas of interest and counting the number of fixa-tions.”
BackgroundHESNARD, M. (1953) · Postgraduate Medical Journal · doi:10.1136/pgmj.29.333.373-a · Cited by 26
Empirical Analysis of EEG and ERPs for Pyschophysiological Adaptive Task Allocation
Prinzel, L. J., Alan, T. P., Frederick, G. F., Mark, W., & Peter, J. (2001) · NASA Technical Reports Server (NASA) · Cited by 25
Quantitative EEG patterns of differential in-flight workload
Sterman, M. B., Mann, C., & Kaiser, D. A. (1993) · NASA Technical Reports Server (NASA) · Cited by 17
Khan, I. A., Hierons, R. M., & Brinkman, W. (2007) · European Conference on Cognitive Ergonomics · doi:10.1145/1362550.1362606 · Cited by 17 · cited 1×
“have looked into another psycho-physiological aspect and its link to performance by investigating how the mood of developers affects debugging and programming [38, 39].”
BackgroundEye-blinking artefacts analysis
Manoilov, P. K. (2007) · International Conference on Computer Systems and Technologies (CompSysTech) · doi:10.1145/1330598.1330654 · Cited by 15 · cited 2×
“Taking advantage of a technique illustrated by Manoilov [47], we use a band-pass Butterworth filter to filter our EEG signal from 0 .”
MethodShort-Term Effects of Graphical versus Textual Visualisation of Variables on Program Perception
Nevalainen, S., & Sajaniemi, J. (2005) · PPIG · Cited by 13
Women and men — Different but equal: On the impact of identifier style on source code reading
Sharafi, Soh, Gueheneuc, et al. (2012) · International Conference on Program Comprehension · Cited by 10
The relation between manifest anxiety and rate of eyeblink in a stress situation.
Doehring, D. G. (1957) · PsycEXTRA Dataset · doi:10.1037/e459222004-001 · Cited by 6
Research works printed but not linked: 8
- 10.1037/0033-2909.91.2.276 · DOI · Paper page
- 10.5555/502973 · doi:10.5555/502973
- S. Eivazi and R. Bednarik . Predicting problem-solving behavior and performance levels from visual attention data . In Proc. of the 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction , pages 9– 16 , 2011 . S. Eivazi and R. Bednarik. Predicting problem-solving behavior and performance levels from visual attention data. In Proc. of the 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction, pages 9–16, 2011.
- 10.1145/1864349.1864395 · DOI · Paper page
- A. Nakasone , H. Prendinger , and M. Ishizuka . Emotion recognition from electromyography and skin conductance . In Proc. of the 5th Int’l. Workshop on Biosignal Interpretation , pages 219– 222 , 2005 . A. Nakasone, H. Prendinger, and M. Ishizuka. Emotion recognition from electromyography and skin conductance. In Proc. of the 5th Int’l. Workshop on Biosignal Interpretation, pages 219–222, 2005.
- Neurosky. Neurosky’s eSense™ meters and detection of mental state , 2009 . Neurosky. Neurosky’s eSense™ meters and detection of mental state, 2009.
- 10.5555/152181 · doi:10.5555/152181
- Z. Sharafl , A. Marchetto , A. Susi , and G. Antoniol . An empirical study on the efficiency of graphical vs. textual representations in requirements comprehension . In Proc. of the Int’l. Conf. on Program Comprehension. IEEE , 2013 . Z. Sharafl, A. Marchetto, A. Susi, and G. Antoniol. An empirical study on the efficiency of graphical vs. textual representations in requirements comprehension. In Proc. of the Int’l. Conf. on Program Comprehension. IEEE, 2013.
Cited by
Human Mental Workload: A Survey and a Novel Inclusive Definition
Longo, L., Wickens, C. D., Hancock, G., & Hancock, P. A. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.883321 · Cited by 222
“These include electrodermal activity and galvanic skin conductance response (Pierce, 2009; Fritz et al., 2014; Zhang et al., 2014).”
BackgroundStuck and Frustrated or in Flow and Happy: Sensing Developers' Emotions and Progress
Muller, S. C., & Fritz, T. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.334 · Cited by 149
“Finally, in a previous study, we used a combination of biometric sensors and found that they can be used to assess the difficulty of small code comprehension tasks [16].”
BackgroundMethodInfluentialSelf-citationA survey of machine learning techniques in physiology based mental stress detection systems
Panicker, S. S., & Gayathri, P. (2019) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2019.01.004 · Cited by 207
I Know What You Did Last Summer - An Investigation of How Developers Spend Their Time
Minelli, R., Mocci, A., & Lanza, M. (2015) · 2015 IEEE 23rd International Conference on Program Comprehension · doi:10.1109/icpc.2015.12 · Cited by 181
“used data from psycho-physiological sensors to assess the nominal difficulty of code comprehension tasks [30].”
Eye Movements in Code Reading: Relaxing the Linear Order
Busjahn, T., Bednarik, R., Begel, A., Crosby, M., Paterson, J. H., Schulte, C., Sharif, B., & Tamm, S. (2015) · 2015 IEEE 23rd International Conference on Program Comprehension · doi:10.1109/icpc.2015.36 · Cited by 176
“[11] conducted a study with 15 developers and used signals from eye tracking, electroencephalogram (EEG), and electrodermal activity (EDA) sensors to predict if developers found a task to be difficult.”
MethodSelf-citation
Metadata
- Authors
- Fritz, T., Begel, A., Müller, S. C., Yigit-Elliott, S., & Züger, M.
- Affiliations
- University of Zurich (CH)
- Microsoft (United States) (US)
- University of Zurich, Switzerland
- Exponent, USA
- Venue
- Proceedings of the 36th International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2014-05-31
- Pages
- 402-413
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W1973204205
- Cited by
- 262
- References
- 72
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 19 · 2023: 21 · 2022: 23 · 2021: 23 · 2020: 36 · 2019: 26 · 2018: 33 · 2017: 12 · 2016: 22 · 2015: 22 · 2014: 1
- FWCI
- 16.21
- Type
- conference paper
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- task difficulty, software developers, bug detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.