Interruptibility of Software Developers and its Prediction Using Psycho-Physiological Sensors
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Interruptions of knowledge workers are common and can cause a high cost if they happen at inopportune moments. With recent advances in psycho-physiological sensors and their link to cognitive and emotional states, we are interested whether such sensors might be used to measure interruptibility of a knowledge worker. In a lab and a field study with a total of twenty software developers, we examined the use of psycho-physiological sensors in a real-world context. The results show that a Naive Bayes classifier based on psycho-physiological features can be used to automatically assess states of a knowledge worker's interruptibility with high accuracy in the lab as well as in the field. Our results demonstrate the potential of these sensors to avoid expensive interruptions in a real-world context. Based on brief interviews, we further discuss the usage of such an interruptibility measure and interruption support for software developers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since biometric and computer interaction data is highly individual and trained models can often not easily be transferred to new participants [22,88,81]”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [88]
In the citing paper
“While previous researchers have used a variety of time windows for predicting interruptibility, predominantly between 1s and 5mins [34,20,88], there is no general guideline on which time windows to use for which feature.”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [88]
In the citing paper
“The time window can have a significant impact on the classifier as previous research has shown [82,88].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [88]
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Heart rate variability: Standards of measurement, physiological interpretation, and clinical use
Malik, M., Bigger, J. T., Camm, A. J., Kleiger, R. E., Malliani, A., Moss, A. J., & Schwartz, P. J. (1996) · European Heart Journal · doi:10.1093/oxfordjournals.eurheartj.a014868 · Cited by 15,289 · cited 1×
“Finally, from the IBI, we computed features of heart rate variability, such as the standard deviation of the signal (SDNN) and the percentage of successive IBIs with a difference greater than 20ms (PNN20) and 50ms (PNN50) [34].”
Witten, I. H. (2008) · Cited by 9,143
Über das Elektrenkephalogramm des Menschen
Berger, H. (1929) · Archiv für Psychiatrie und Nervenkrankheiten · doi:10.1007/bf01797193 · Cited by 4,235
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526
Task-evoked pupillary responses, processing load, and the structure of processing resources.
Beatty, J. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.2.276 · Cited by 1,959 · cited 1×
“the peak amplitude of the pupil diameter) is an indicator for memory load or processing load, and varies with task difficulty [8].”
BackgroundEye Tracking in Human-Computer Interaction and Usability Research
Jacob, R. J. K., & Karn, K. S. (2003) · The Mind's Eye · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,567
A diary study of task switching and interruptions
Czerwinski, M., Horvitz, E., & Wilhite, S. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985715 · Cited by 830 · cited 1×
“While some of these interruptions are desired, others might incur a high cost, including long resumption lags, slower performance, negative emotions and an increase in errors due to the interruption happening at inopportune moments [6, 16].”
BackgroundMemory for goals: an activation‐based model
Altmann, E. M., & Trafton, J. G. (2002) · Cognitive Science · doi:10.1207/s15516709cog2601_2 · Cited by 795 · cited 1×
“Using negotiated interruptions allows to measure interruption lag, which is the timespan between the notification and the moment a participant starts to address the interruption [2].”
BackgroundEvent-related potentials : a methods handbook
Handy, T. C. (2005) · The MIT Press eBooks · Cited by 777
Event-Related Potentials: A Methods Handbook
Loiselle, D. L. (2006) · Neurology · doi:10.1212/01.wnl.0000217365.45426.9a · Cited by 766
"Constant, constant, multi-tasking craziness": managing multiple working spheres
González, V. M., & Mark, G. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985707 · Cited by 715 · cited 1×
“These time intervals model interruption frequency occurring in reality [20].”
BackgroundBailey, B. P., & Konstan, J. A. (2006) · Computers in Human Behavior · doi:10.1016/j.chb.2005.12.009 · Cited by 600 · cited 1×
“While some of these interruptions are desired, others might incur a high cost, including long resumption lags, slower performance, negative emotions and an increase in errors due to the interruption happening at inopportune moments [6, 16].”
BackgroundMonitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods
Gevins, A., Smith, M. E., Leong, H., McEvoy, L., Whitfield, S., Du, R., & Rush, G. (1998) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779480578 · Cited by 535 · cited 1×
“found that an increase in theta activity and a decrease in alpha activity can be linked to an increase in memory load [19].”
BackgroundIf not now, when?: the effects of interruption at different moments within task execution
Adamczyk, P. D., & Bailey, B. P. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985727 · Cited by 531 · cited 1×
“Resumption lag is the timespan between the end of the interruption and the beginning of the suspended primary task, usually measured by monitoring the first mouse or keyboard action [1, 3].”
BackgroundAn Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures
Wilson, G. F. (2002) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1201_2 · Cited by 488 · cited 1×
“For instance, Wilson analyzed mental workload in pilots during flight with multiple measures [47].”
BackgroundPhysiological metrics of mental workload: A review of recent progress
Kramer, A. F. (2020) · Multiple-task performance · doi:10.1201/9781003069447-14 · Cited by 459
Trafton, J. G., Altmann, E. M., Brock, D. P., & Mintz, F. E. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00023-5 · Cited by 457 · cited 2×
“Researchers also found a possible link between resumption/edit lag and interruption lag or interruptibility [44].”
BackgroundPsycho-physiological measures for assessing cognitive load
Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864395 · Cited by 382 · cited 1×
“They assessed the performance of different features to classify cognitive load on elementary cognitive tasks and found that the ECG median absolute deviation and median heat flux performed best, providing over 80% accuracy [22].”
BackgroundMcFarlane, D. C. (2002) · Human–Computer Interaction · doi:10.1207/s15327051hci1701_2 · Cited by 378 · cited 3×
“Participants were instructed to decide for themselves when to address the interruption—a technique for coordinating interruptions called “negotiated interruption” [37].”
BackgroundMethodInfluentialUsing context-aware computing to reduce the perceived burden of interruptions from mobile devices
Ho, J., & Intille, S. S. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055100 · Cited by 367 · cited 1×
“Their results show that messages delivered at activity transitions are better received than those delivered at random times [24].”
BackgroundPredicting human interruptibility with sensors
Fogarty, J., Hudson, S. E., Atkeson, C. G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J. C., & Yang, J. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1057237.1057243 · Cited by 344 · cited 2×
“Prior work examined the use of context-aware sensors to gather information, such as audio and video streams, keyboard and mouse interaction, or task characteristics (e.g., [17,18,27]).”
BackgroundBailey, B. P., & Iqbal, S. T. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1314683.1314689 · Cited by 325 · cited 2×
“This suggests that high level context switches are good moments for interruptions [5].”
BackgroundResultTask-evoked pupillary response to mental workload in human-computer interaction
Iqbal, S. T., Zheng, X. S., & Bailey, B. P. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.986094 · Cited by 317
Lay Epistemic Theory in Social-Cognitive Psychology
Kruglanski, A. W. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0103_1 · Cited by 301 · cited 1×
“After participants typed an answer into a text box on the tablet and clicked the “Ok” button, the correct solution was displayed to satisfy participants’ need for closure [31].”
BackgroundThe effect of interruption duration and demand on resuming suspended goals.
Monk, C. A., Trafton, J. G., & Boehm-Davis, D. A. (2008) · Journal of Experimental Psychology: Applied · doi:10.1037/a0014402 · Cited by 296 · cited 1×
“It has been shown that resumption lag is influenced by the availability of cues [3], the interruption length and demand [38], but not by stress, time pressure and flow [15].”
BackgroundPredicting human interruptibility with sensors: a Wizard of Oz feasibility study
Hudson, S., Fogarty, J., Atkeson, C., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J., & Yang, J. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642657 · Cited by 295 · cited 1×
“all other states) with 78% accuracy by simulating sensors and manually coding features from audio and video recordings, such as the number of people present, who was speaking, or whether the phone was on the hook [25].”
BackgroundAutonomic nervous system response patterns specificity to basic emotions
Collet, C., Vernet-Maury, E., Delhomme, G., & Dittmar, A. (1997) · Journal of the Autonomic Nervous System · doi:10.1016/s0165-1838(96)00108-7 · Cited by 287
(2001) · Cited by 269
The effect of stress on core and peripheral body temperature in humans
Vinkers, C. H., Penning, R., Hellhammer, J., Verster, J. C., Klaessens, J. H. G. M., Olivier, B., & Kalkman, C. J. (2013) · Stress · doi:10.3109/10253890.2013.807243 · Cited by 220
Using galvanic skin response for cognitive load measurement in arithmetic and reading tasks
Nourbakhsh, N., Wang, Y., Chen, F., & Calvo, R. A. (2012) · Proceedings of the 24th Australian Computer-Human Interaction Conference · doi:10.1145/2414536.2414602 · Cited by 219 · cited 1×
“In a study on text reading and arithmetic tasks imposing multiple cognitive load levels, a strong link between cognitive load and EDA was found [39].”
BackgroundIqbal, S. T., & Bailey, B. P. (2005) · CHI '05 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1056808.1056948 · Cited by 203 · cited 1×
“In addition to providing evidence for the benefits of using these sensors to measure interruptibility, the results of our study also confirm previous results on the correlation between mental load and interruptibility [7, 26], the link between interruption lag and interruptibility in setups with negotiated interruptio…”
ResultFeasibility and pragmatics of classifying working memory load with an electroencephalograph
Grimes, D., Tan, D. S., Hudson, S. E., Shenoy, P., & Rao, R. P. N. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357187 · Cited by 192 · cited 1×
“Several studies also used EEG devices to classify mental tasks or states of cognitive load [21, 32].”
BackgroundThe Role of Working Memory Resources in Simple Cognitive Arithmetic
Lemaire, P. (1996) · European Journal of Cognitive Psychology · doi:10.1080/095414496383211 · Cited by 181 · cited 1×
“As mental arithmetic exercises generally impose a high working memory load [33], they are considered an effective interruption for software developers [18].”
BackgroundUsing a low-cost electroencephalograph for task classification in HCI research
Lee, J. C., & Tan, D. S. (2006) · Proceedings of the 19th annual ACM symposium on User interface software and technology · doi:10.1145/1166253.1166268 · Cited by 165 · cited 2×
“Additionally, we computed fractions of all combinations of frequency bands and the two ratios θ/(α + β) and β/(α + θ) that have previously been shown to carry information on a person’s mental activity [30, 32].”
BackgroundMethod(2004) · eScholarship (California Digital Library) · Cited by 160
Leveraging characteristics of task structure to predict the cost of interruption
Iqbal, S. T., & Bailey, B. P. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124882 · Cited by 138 · cited 1×
“They measured the cost based on resumption lag—the time needed to resume the primary task [27].”
BackgroundUsing mental load for managing interruptions in physiologically attentive user interfaces
Chen, D., & Vertegaal, R. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.986103 · Cited by 120 · cited 1×
“They also developed a mobile phone, which classifies interruptibility into four states combining high / low mental load with high / low movement [13].”
BackgroundExamining task engagement in sensor-based statistical models of human interruptibility
Fogarty, J., Ko, A. J., Aung, H. H., Golden, E., Tang, K. P., & Hudson, S. E. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055018 · Cited by 111 · cited 7×
“In addition to providing evidence for the benefits of using these sensors to measure interruptibility, the results of our study also confirm previous results on the correlation between mental load and interruptibility [7, 26], the link between interruption lag and interruptibility in setups with negotiated interruptio…”
BackgroundMethodResultInfluentialInterrupts: just a minute never is
van Solingen, R., Berghout, E., & van Latum, F. (1998) · IEEE Software · doi:10.1109/52.714843 · Cited by 104 · cited 1×
“It is based on the assumption that interruptions in software development have a large effect and it takes minutes to regather context as opposed to resumption lag which is in the order of seconds [45].”
BackgroundResumption strategies for interrupted programming tasks
Parnin, C., & Rugaber, S. (2011) · Software Quality Journal · doi:10.1007/s11219-010-9104-9 · Cited by 103 · cited 1×
“Edit lag is the timespan between the end of the interruption and the first edit and represents a specialized measure of the resumption lag [40].”
BackgroundSchmidt, S., & Walach, H. (1999) · FreiDok plus (Universitätsbibliothek Freiburg) · Cited by 84
Böhmer, M., Lander, C., Gehring, S., Brumby, D. P., & Krüger, A. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557066 · Cited by 63 · cited 1×
“Only recently, novel designs to handle interruptions from incoming calls on smart phones have been developed adding new actions, such as ‘postpone’ or ‘send a message’, to traditional ones, such as ‘accept’ and ‘decline’ [10].”
BackgroundTowards a Physiological Model of User Interruptability
Chen, D., Hart, J., & Vertegaal, R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74800-7_39 · Cited by 40 · cited 4×
“They measured heart rate variability as indicator for cognitive load and muscle activity trough EMG and calculated interruptibility using linear regression [12].”
BackgroundMethodInfluentialAttention and Intention Goals Can Mediate Disruption in Human-Computer Interaction
Arroyo, E., & Selker, T. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23771-3_34 · Cited by 31 · cited 1×
“In their study they achieved a five times higher answer rate to messages compared to non-mediated message delivery [4].”
Background(2007) · Cited by 25
Eye-blinking artefacts analysis
Manoilov, P. K. (2007) · International Conference on Computer Systems and Technologies (CompSysTech) · doi:10.1145/1330598.1330654 · Cited by 15 · cited 2×
“Following a technique suggested by Manilov [35], we extracted eye blinks from the raw signal using a Butterworth filter and a peak finding algorithm and calculated the number of eye blinks per time unit.”
MethodEstimating user interruptibility by measuring table-top pressure
Tani, T., & Yamada, S. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2468662 · Cited by 8 · cited 1×
“were able to achieve a similar two state interruptibility classification accuracy on typing and mouse operation with easy and hard phases [43].”
Wilson, G. F. (2002) · International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1201_1 · Cited by 3
Conard, M. A., & Marsh, R. (2010) · Cited by 2
Research works printed but not linked: 7
- Altmann E. M., 2004, DTIC Document
- 10.5555/2042118.2042162 · doi:10.5555/2042118.2042162
- Bailey B. P., 2001, Proc. INTERACT'01
- 10.5555/1778331.1778380 · doi:10.5555/1778331.1778380
- Mathan S., 2007, Proc. ICACS'07
- Peper E., 2007, Is there more to blood volume pulse than heart rate variability, respiratory sinus arrhythmia, and cardiorespiratory synchrony?, Biofeedback, 35, 2
- Witten I. H., 2005, Morgan Kaufmann
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“…27, 40, 41, 49, 50, 76, 78, 82, 85, 87, 99, 106, 146, 152, 160, 169, 184, 185, 194, 201, 202, 214, 216, 217, 224, 225, 227, 240, 244, 264, 264, 266, 268] Respiration [87, 99, 106, 184, 185, 194] Temperature [1, 2, 8, 87, 184, 185, 194, 216, 217, 268] Dermal Skin Conductance (EDA) [25, 50, 51, 76,…”
InfluentialThe Work Life of Developers: Activities, Switches and Perceived Productivity
Meyer, A. N., Barton, L. E., Murphy, G. C., Zimmermann, T., & Fritz, T. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2656886 · Cited by 170
“In particular, one could use this to indicate the availability of a developer for interruptions by changing the availability status in instant messaging tools, or with a visual external cue to avoid external interruptions at particularly inopportune moments, similar to what Z€ uger and Fritz suggested [63].”
MethodSelf-citationContent-driven music recommendation: Evolution, state of the art, and challenges
Deldjoo, Y., Schedl, M., & Knees, P. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100618 · Cited by 164
Rethinking Productivity in Software Engineering
Sadowski, C., & Zimmermann, T. (2019) · Apress eBooks · doi:10.1007/978-1-4842-4221-6 · Cited by 144
Tracing software developers' eyes and interactions for change tasks
Kevic, K., Walters, B. M., Shaffer, T. R., Sharif, B., Shepherd, D. C., & Fritz, T. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786864 · Cited by 106
“Most of this research focuses on eye-tracking [31, 19], while only few studies have been conducted so far that also use other signals, such as an fMRI to identify brain activation patterns for small comprehension tasks [42], or a combination of eye-tracking, EDA, and EEG sensors to measure aspects such as task difficu…”
BackgroundSelf-citation
Metadata
- Authors
- Züger, M., & Fritz, T.
- Affiliations
- University of Zurich (CH)
- ORCID
- Fritz, Thomas
- Venue
- Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2015-04-18
- Pages
- 2981-2990
- OpenAlex
- W2058310153
- Cited by
- 96
- References
- 50
- Citations by year
- 2026: 7 · 2025: 12 · 2024: 5 · 2023: 5 · 2022: 5 · 2021: 6 · 2020: 10 · 2019: 16 · 2018: 11 · 2017: 9 · 2016: 9 · 2015: 1
- FWCI
- 17.51
- Type
- conference paper
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- SNF
- ABB Research
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Personal Information Management and User Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- interruptibility, software developers, interruptions, knowledge workers, cognitive states, emotional state, Naive Bayes classifier
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.