The DOI matches its Crossref record; 70 of the 72 references it cites were found in a registry or an index.
Using psycho-physiological measures to assess task difficulty in software development
Open accessAbstract
Software developers make programming mistakes that cause serious bugs for their customers. Existing work to detect problematic software focuses mainly on post hoc identification of correlations between bug fixes and code. We propose a new approach to address this problem --- detect when software developers are experiencing difficulty while they work on their programming tasks, and stop them before they can introduce bugs into the code.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Various studies have shown that biometric data such as heart rate (HR), heart rate variability (HRV), electro-dermal activity (EDA), eye tracking, skin temperature or electroencephalography (EEG) can be used to assess mental effort and cognitive load [85,66,28,13], task difficulty [79,22], emotions [48,27,62], or stress [29,70,84].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [22]
In the citing paper
“Since biometric and computer interaction data is highly individual and trained models can often not easily be transferred to new participants [22,88,81]”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [22]
In the citing paper
“Psycho-physiological measures like EEG, which have been validated for measuring cognitive load in traditional programming contexts, could provide valuable insights into the mental demands of working with AI assistants.”
From Towards Decoding Developer Cognition in the Age of AI Assistants (2025) · cites this paper as [13]
In the citing paper
“Fritz et.al. [13] used a combination of EEG, eye tracking and electrodermal activity sensors to predict task difficulty with upto 84% precision.”
From Towards Decoding Developer Cognition in the Age of AI Assistants (2025) · cites this paper as [13]
In the citing paper
“This approach was chosen as it has been demonstrated to effectively return participants' physiological features to a baseline level after approximately one minute.”
From How do Copilot Suggestions Impact Developers' Frustration and Productivity? (2025) · cites this paper as Fritz et al. [30]
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 5×
“In some cases, this yielded better performance on our data (e.g. EDA+EEG f-measure rose from 62.01% to 69.73%), however running ANOVA tests on the Weka output failed to show any significant differences be-tween the original and shrunken sets of features.”
MethodInfluentialDevelopment of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 16×
“We used two outcome measures in our tasks: the NASA Task Load Index (TLX) [32] filled out on paper after each task, and a subjective ranking of tasks based on the subject’s post hoc perception of their difficulty at the end of the experimental session.”
MethodInfluentialÜber das Elektrenkephalogramm des Menschen
Berger, H. (1929) · Archiv für Psychiatrie und Nervenkrankheiten · doi:10.1007/bf01797193 · Cited by 4,235
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334 · cited 1×
“…questionnaire selected 20 of these candidates who had at least 2 years of software development experience, knew how to program in C# (and had done so in the last year), did not need to wear bifocal or trifocal glasses (they interfere with the eye-tracker), and were available to come to our lab.”
BackgroundTask-evoked pupillary responses, processing load, and the structure of processing resources.
Beatty, J. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.2.276 · Cited by 1,959 · cited 1×
“in particular the peak amplitude of the pupil diameter, is an indicator for memory load or also processing load and that it varies with task difficulty [6].”
BackgroundDawson, M. E., Schell, A. M., Filion, D. L., & Berntson, G. G. (2009) · Handbook of Psychophysiology · doi:10.1017/cbo9780511546396.007 · Cited by 1,720 · cited 1×
“Electrodermal activity (EDA), also known as skin conductance (SC) or galvanic skin response (GSR), has been closely linked with arousal, attention, emotional states, stress and anxiety [13, 17].”
BackgroundPublication Recommendations for Electrodermal Measurements
Fowles, D. C., Christie, M. J., Edelberg, R., GRINGS, W. W., Lykken, D. T., & Venables, P. H. (1981) · Psychophysiology · doi:10.1111/j.1469-8986.1981.tb03024.x · Cited by 1,699
Eye Tracking in Human-Computer Interaction and Usability Research
Jacob, R. J. K., & Karn, K. S. (2003) · The Mind's Eye · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,567
Computer interface evaluation using eye movements: methods and constructs
Goldberg, J. H., & Kotval, X. P. (1999) · International Journal of Industrial Ergonomics · doi:10.1016/s0169-8141(98)00068-7 · Cited by 1,053 · cited 2×
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
Background
Research works printed but not linked: 8
- 10.1037/0033-2909.91.2.276 · DOI · Paper page
- 10.5555/502973 · doi:10.5555/502973
- S. Eivazi and R. Bednarik . Predicting problem-solving behavior and performance levels from visual attention data . In Proc. of the 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction , pages 9– 16 , 2011 . S. Eivazi and R. Bednarik. Predicting problem-solving behavior and performance levels from visual attention data. In Proc. of the 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction, pages 9–16, 2011.
- 10.1145/1864349.1864395 · DOI · Paper page
- A. Nakasone , H. Prendinger , and M. Ishizuka . Emotion recognition from electromyography and skin conductance . In Proc. of the 5th Int’l. Workshop on Biosignal Interpretation , pages 219– 222 , 2005 . A. Nakasone, H. Prendinger, and M. Ishizuka. Emotion recognition from electromyography and skin conductance. In Proc. of the 5th Int’l. Workshop on Biosignal Interpretation, pages 219–222, 2005.
- Neurosky. Neurosky’s eSense™ meters and detection of mental state , 2009 . Neurosky. Neurosky’s eSense™ meters and detection of mental state, 2009.
- 10.5555/152181 · doi:10.5555/152181
- Z. Sharafl , A. Marchetto , A. Susi , and G. Antoniol . An empirical study on the efficiency of graphical vs. textual representations in requirements comprehension . In Proc. of the Int’l. Conf. on Program Comprehension. IEEE , 2013 . Z. Sharafl, A. Marchetto, A. Susi, and G. Antoniol. An empirical study on the efficiency of graphical vs. textual representations in requirements comprehension. In Proc. of the Int’l. Conf. on Program Comprehension. IEEE, 2013.
Cited by
Human Mental Workload: A Survey and a Novel Inclusive Definition
Longo, L., Wickens, C. D., Hancock, G., & Hancock, P. A. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.883321 · Cited by 222
“These include electrodermal activity and galvanic skin conductance response (Pierce, 2009; Fritz et al., 2014; Zhang et al., 2014).”
BackgroundStuck and Frustrated or in Flow and Happy: Sensing Developers' Emotions and Progress
Muller, S. C., & Fritz, T. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.334 · Cited by 267
“Finally, in a previous study, we used a combination of biometric sensors and found that they can be used to assess the difficulty of small code comprehension tasks [16].”
BackgroundMethodInfluentialSelf-citationA survey of machine learning techniques in physiology based mental stress detection systems
Panicker, S. S., & Gayathri, P. (2019) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2019.01.004 · Cited by 207
I Know What You Did Last Summer - An Investigation of How Developers Spend Their Time
Minelli, R., Mocci, A., & Lanza, M. (2015) · 2015 IEEE 23rd International Conference on Program Comprehension · doi:10.1109/icpc.2015.12 · Cited by 181
“used data from psycho-physiological sensors to assess the nominal difficulty of code comprehension tasks [30].”
Eye Movements in Code Reading: Relaxing the Linear Order
Busjahn, T., Bednarik, R., Begel, A., Crosby, M., Paterson, J. H., Schulte, C., Sharif, B., & Tamm, S. (2015) · 2015 IEEE 23rd International Conference on Program Comprehension · doi:10.1109/icpc.2015.36 · Cited by 176
“[11] conducted a study with 15 developers and used signals from eye tracking, electroencephalogram (EEG), and electrodermal activity (EDA) sensors to predict if developers found a task to be difficult.”
MethodSelf-citation
Metadata
- Authors
- Fritz, T., Begel, A., Müller, S. C., Yigit-Elliott, S., & Züger, M.
- Affiliations
- University of Zurich (CH)
- Microsoft (United States) (US)
- University of Zurich, Switzerland
- Exponent, USA
- Venue
- Proceedings of the 36th International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2014-05-31
- Pages
- 402-413
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W1973204205
- Cited by
- 262
- References
- 72
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 19 · 2023: 21 · 2022: 23 · 2021: 23 · 2020: 36 · 2019: 26 · 2018: 33 · 2017: 12 · 2016: 22 · 2015: 22 · 2014: 1
- FWCI
- 16.21
- Type
- conference paper
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- task difficulty, software developers, bug detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using psycho-physiological measures to assess task difficulty in software development. https://app.cochat.ai/papers/10.1145/2568225.2568266
- The paper
- Fritz, T., Begel, A., Müller, S. C., Yigit-Elliott, S., & Züger, M. (2014). Using psycho-physiological measures to assess task difficulty in software development. Proceedings of the 36th International Conference on Software Engineering. https://doi.org/10.1145/2568225.2568266
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.